Vous êtes sur la page 1sur 8

This article has been accepted for publication in a future issue of this journal, but has not been

fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2749040, IEEE
Transactions on Biomedical Engineering
IEEE Transactions on Biomedical Engineering 1

A high-resolution mini-microscope system for


wireless real-time monitoring
Zongjie Wang, Student Member, IEEE, Akash Boddeda, Benjamin Parker, Roya Samanipour, Sanjoy
Ghosh, Frederic Menard, and Keekyoung Kim, Member, IEEE

behavior inside an incubator and monitor lab-on-a-chip devices


Abstract—Objective: Compact, cost-effective and high- [5]. Kim et al. demonstrated that the mini-microscope was able
performance microscope that enables the real-time imaging of to monitor cellular processes, including embryonic
cells and lab-on-a-chip devices is highly demanded for cell biology development, wound healing, and disease progression over time
and biomedical engineering. This paper aims to present the design
[6]. Previously, monitoring such processes required a
and application of an inexpensive wireless mini-microscope with
resolution up to 2592 x 1944 pixels and speed up to 90 fps. Methods: microscope equipped with an incubating chamber and anti-
The mini-microscope system was built on a commercial embedded vibration table that involve additional cost and maintenance.
system (Raspberry Pi). We modified a camera module and Mini-microscope systems using an image sensor have been
adopted an inverse dual lens system to obtain the clear field of view developed and used inside a standard cell culture incubator [6]–
and appropriate magnification for tens of micrometer objects. [8]. A camera module containing a complementary metal oxide
Results: The system was capable of capturing time-lapse images
semiconductors (CMOS) image sensor was disassembled from
and transferring image data wirelessly. The entire system can be
operated wirelessly and cordlessly in a conventional cell culturing a webcam. The position of the camera lens placed over the
incubator. The developed mini-microscope was used to monitor image sensor was adjusted to achieve suitable magnification for
the attachment and proliferation of NIH-3T3 and HEK 293 cells biological samples. Table S1 in the supplementary file provides
inside an incubator for 50 hours. In addition, the mini-microscope a summary of previously reported webcam-based mini-
was used to monitor a droplet generation process in a microfluidic microscopes. In addition, a number of lens-free systems have
device. The high-quality images captured by the mini-microscope
been developed with advantages in cost, weight and portability
enabled us an automated analysis of experimental parameters.
Conclusion: The successful applications prove the great potential since it does not require any lens [9]–[12]. The lens-free
of the developed mini-microscope for monitoring various systems have been used in a variety of applications such as
biological samples and microfluidic devices. Significance: This monitoring cell behavior [9], [12] and detecting biomarkers in
paper presents the design of a high resolution mini-microscope microfluidic devices [10], [11]. However, the mini-microscope
system that enables the wireless real-time imaging of cells inside systems without lenses can only focus objects very close (e.g.,
the incubator. This system has been verified to be a useful tool to
~100 – 200 μm) to the image sensor which is less than the
obtain high-quality images and videos for the automated
quantitative analysis of biological samples and lab-on-a-chip thickness of petri dishes and glass slides (e.g., ~2 mm). Also,
devices in the long term. most of the previously reported systems have the resolution of
640 x 480 (0.3 megapixels) [6]–[9], which is much lower than
Index Terms—Cell imaging, Microfluidics, Mini-microscope the resolution of the camera designed for a bright-light
microscope (usually higher than 3 megapixels). The limited
resolution usually results in the poor quality of images and
I. INTRODUCTION makes post image processing difficult. In addition, cell phones
have been employed as a portable and rapid cell monitoring
A microscope is an essential tool for many research areas
including cell biology, material science, and
nanotechnology. In addition to traditional bright-field
system [13]. The image sensors on cell phones usually have 5
to 8 megapixel resolution, which is much better than the
microscopes, different types of microscopy techniques have webcam-based mini-microscopes. However, the cell phone-
been developed for specific applications. Phase contrast based systems are relatively expensive (~ US$500) than other
microscopy [1], [2] is used for low-contrast object imaging, mini-microscopes, not robust, and has limitations to control
polarization microscopy [3] for ordered molecules, and since the operating program are not open to the public.
differential interference contrast microscopy [4] for the Moreover, current cell phone-based systems require keeping a
inspection of cultured cells. Recently, miniaturized substrate inside a small, closed chamber, which is not suitable
microscopes have been developed to check long-term cell for cell culturing and monitoring.

This work was supported by Natural Sciences and Engineering Research K. Kim is with Biomedical Engineering Program, University of British
Council of Canada (RGPIN-2014-04010). Columbia, Vancouver, BC V6T 1Z4, Canada.
Z. Wang, A. Boddeda, B. Parker, R. Samanipour and K. Kim are with School S. Ghosh and F. Menard are with Irving K. Barber School of Arts and
of Engineering, University of British Columbia, Kelowna, BC V1V 1V7, Sciences, University of British Columbia, Kelowna, BC V1V 1V7, Canada.
Canada (e-mail: keekyoung.kim@ubc.ca). A. Boddeda is with Department of Mechanical Engineering, Indian Institute
of Technology Guwahati, Guwahati, Assam, 781039, India.

Copyright (c) 2016 IEEE. Personal use of this material is permitted. However, permission to use this material for any other
purposes must be obtained from the IEEE by sending an email to pubs-permissions@ieee.org
0018-9294 (c) 2017 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2749040, IEEE
Transactions on Biomedical Engineering
IEEE Transactions on Biomedical Engineering 2

broadcasting allowed other devices in the same network, such


as the host computer and portable devices, to receive the real-
time images or videos that enable users to do the remote
monitoring and data analysis.
A Raspberry Pi camera module (Raspberry Pi Foundation,
UK) was connected to the embedded system. The camera is
capable of recording video clips at 7, 30, 60 and 90 frames-per-
second (FPS) with the resolutions of 2592 x 1944, 1920 x 1080,
1280 x 720 and 640 x 480 pixels, respectively. The detailed
specification can be found in the supplementary material (Table
S2). The camera module was originally designed for normal
distance recording, which is not suitable to provide
magnifications for microscale objects. Therefore, we flipped
the original lens and added another lens to build a two-lens
system for capturing clear and magnified images (Fig. 1A and
1B). Since the camera module does not have the autofocus
function, a 3D printed z-axis stage is needed to find the best
Fig. 1. Inverse dual lens system. (A) Schematic of the inverse dual lens system. focal plane for different types of cell substrates (e.g. petri dishes,
(B) Working principle of the dual lens system to achieve different flasks, or glass slides) with various thickness.
magnification rate. (C) An image of microfluidic channel obtained by The camera module, z-axis stage, and embedded system were
commercial ball lens (D) An image of microfluidic channel obtained by the
inverse dual lens system. Scale bar = 200 μm.
integrated and assembled into an acrylic box to build the mini-
microscope system. The entire system was operated by a USB
In this study, we present a low-cost, high-resolution, highly power adaptor with the output voltage of 5V and current of 1A.
controllable and multi-functional platform for monitoring cell This system can also be operated by a mobile supplementary
behavior inside an incubator and experimental situation on a battery, making the system fully remote and portable. The
lab-on-a-chip device. We used an inexpensive embedded circuit schematic diagram of the system configuration is illustrated in
board (Raspberry Pi) and a 5 megapixel CMOS camera module the supplementary material (Fig. S1). The Raspberry Pi system
to build the mini-microscope. This mini-microscope with the is controlled by a Python program for recording images/videos,
cost around US$100 can be easily placed in a conventional cell storing data into a flashdisk, and broadcasting a video stream
incubator and controlled wirelessly (See Table. S1 for the into a wireless network. The host computer receives the video
specification). We demonstrated that the mini-microscope was stream from the wireless network and further processes the data
able to observe the long-term behavior of biological cells. Real- for analysis via a MATLAB-based program (Mathworks,
time image processing was conducted to analyze the coverage Natick, MA, USA). Other portable devices, such as a mobile
rate of cells during proliferation. Also, to demonstrate the high phone and a tablet computer, can also receive the captured
speed image capturing capability, the mini-microscope was video stream for remote monitoring.
used to examine a droplet generation process in a continuous
B. Lens System Design
microfluidic system. The various experiments demonstrated
that the mini-microscope could facilitate many studies in long- Although there is a commercial polymer-based ball lens with
term cell monitoring inside the incubator and examining certain magnification, only the central part of the image is clear,
experimental processes in lab-on-a-chip devices. while the rest of the area is blurred due to the effect of field
curvature and spherical aberration [14]. Switz et al. developed
II. MATERIALS AND METHODS a novel inverse dual lens configuration to have both the wide
field of view and appropriate image quality of microscale
A. System Design and Integration sample [14]. We adopted this configuration to design the lens
Raspberry Pi Model B+ (Raspberry Pi Foundation, UK) was system of the mini-microscope. The schematic and working
adopted as a platform to construct the mini-microscope. The principle of the lens system is given in Fig. 1. Briefly, a lens
system was connected to a host computer wirelessly through a from the camera module was flipped to make an inverse lens.
USB Wi-Fi adapter (Cana Kit Corporation, North Vancouver, Then, another lens in an ordinary direction was placed over the
BC, Canada). Debian-based Raspbian operating system was inverse lens to build the dual lens system. The CMOS sensor
installed in the system to control all hardware. The CPU and captured object images through the dual lens system. As
GPU of Raspberry Pi were controlled by Python-based scripts illustrated in Fig. 1B, the object was demagnified through the
to realize real-time image capturing and video recording. One inverse lens and then magnified by the ordinary lens.
USB port was used to supply 5V via transistor–transistor logic Theoretically, another advantage of the dual lens method is that
(TTL) interface to turn on a white LED array for illumination. the magnification can be adjustable by changing the distance
An open source software, VLC player (VideoLAN, Paris, (d1) between the CMOS sensor and inverse lens [14]. However,
France), was installed in the system for the real-time video we fixed the d1 to be 1.4 cm for two reasons: First, the typical
streaming and broadcasting. The video streaming and field of view (around 1 mm x 1 mm) is suitable for many

Copyright (c) 2016 IEEE. Personal use of this material is permitted. However, permission to use this material for any other
purposes must be obtained from the IEEE by sending an email to pubs-permissions@ieee.org
0018-9294 (c) 2017 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2749040, IEEE
Transactions on Biomedical Engineering
IEEE Transactions on Biomedical Engineering 3

Fig. 2. Mini-microscope platform. (A) A schematic of the mini-microscope system. (B) and (C) Photographs of the assembled mini-microscope system. Scale bar
= 4 cm. (D) An image of a microscope calibration slide obtained by the mini microscope. Scale bar = 200 μm.

biomedical engineering applications. Second, the adjustment of A flow-focusing microfluidic device was fabricated by
d1 can easily introduce dusts on the surface of the CMOS standard photolithography and softlithography processes as
camera, resulting in the ‘dead zone’ of the CMOS sensor. Fig. described in [16], [17] (See supplementary data for the detailed
1C and 1D show images of generating droplets in a microfluidic protocol). The fabricated device has a cross junction where a
device using a single lens and dual lens system, respectively. water phase fluid and mineral oil with 20% v/v surfactant (Span
The image from the dual lens system was much clearer with the 80, Sigma Aldrich, St. Louis, MO, USA) infused by two syringe
same field of view in a single lens system, offering the better pumps (Kent Scientific Corp., Torrington, CT, USA) were met
quality of image without blurred areas resulted from the lens together to generate droplets. The water phase fluids were made
system. of 5% and 8% w/v gelatin methacrylate (GelMA) prepolymer
dissolved in a phosphate buffered saline (PBS). The GelMA
C. Experimental Setup
was synthesized by a protocol previously described in [18], [19]
First, NIH-3T3 fibroblast and HEK 293 human kidney cells (See supplementary data for the detailed protocol). The
were cultured in Dulbecco's minimum essential medium viscosities of the GelMA prepolymer solution and mineral oil
(DMEM) supplemented with 1% v/v penicillin streptomycin with the surfactant were measured by a viscometer (Cannon
and 1% v/v amphotericin B. All items were purchased from Life Instrument, State College, PA, USA).
Technologies, Carlsbad, CA, USA. These cells were cultured During the droplet generation process, the device was placed
on a T25 cell culture flask (VWR scientific, Radnor, PA, USA) on the mini-microscope and the cross junction of the device was
and passaged every three days when the cells were confluent. precisely focused to obtain clear images of the droplet
Cells were trypsinized for the experiments. The half of the cells generation process. Subsequently, the droplet generation
were seeded onto a new flask that was placed on the mini- process was recorded by the mini-microscope with the
microscope for monitoring long-term cell behavior. Time-lapse resolution of 640 x 480 pixels and frame rate of 90 fps. The
images were captured after two hours from seeding the cells to recorded video clips were post-processed by MATLAB to
allow them attaching on the surface of the flask. Before analyze the diameter of droplets, the generation frequency, as
recording images, we manually adjusted the focus of the mini- well as the length of thread at the junction. The image
microscope to find the best focal plane of the cells. Then, high- processing is based on Canny edge detection method and the
quality images with the 2952 x 1944 pixel resolution were taken line traverse method developed by Wang et al.[20]. The details
every minute and stored in the shared folder on the embedded of the imaging processing method are discussed in the
system. A MATLAB-based program was operated to read the supplementary data. To compare the effect of the frame rate on
captured images and complete the real-time image processing analysis, an inverted microscope (ToupTek Photonics,
to measure the coverage rate of cells. The image processing Hangzhou, Zhejiang, China) was also used to record the droplet
algorithm is based on the threshold Canny edge detection generation at its maximal frame rate of 24 fps.
method [15] and morphological image closure. Detail
information for the image processing is discussed in the D. Statistical Analysis
supplementary data. A one-way analysis of variance (ANOVA) was proceeded to

Copyright (c) 2016 IEEE. Personal use of this material is permitted. However, permission to use this material for any other
purposes must be obtained from the IEEE by sending an email to pubs-permissions@ieee.org
0018-9294 (c) 2017 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2749040, IEEE
Transactions on Biomedical Engineering
IEEE Transactions on Biomedical Engineering 4

Fig. 3. Experiment for monitoring cell attachment and proliferation inside the incubator. (A) Representative images show NIH-3T3 and HEK 293 cells at 2, 14,
26, and 50 hours after seeding. Scale bar = 100 μm. (B) Microscopy images show a cell division process. Scale bar = 100 μm.

statistically analyze the measured data. Results were shown as 1.4 cm. 10 μm gap can be clearly distinguished in most of the
an average ± standard deviation. The curve fitting was obtained area. The blurred area near the edge of the field of view may be
through the built-in curve fitting function in Microsoft Excel attributed from that the CMOS sensor was not perfectly
(Microsoft, Redmond, WA, USA). Among three curve fittings positioned horizontally on the stage. It is noticed that there were
(exponential, linear, and logarithmic), the one with the highest several artifacts appeared in the field of view resulted from the
R2 was selected. dusts introduced when assembling the lens. It is also worth
noting that the light from the LED array was not uniform
III. RESULTS AND DISCUSSION throughout the entire field of view, causing shades near the edge
of images (i.e., Fig. 1D and 2D). Introducing the so-called
A. System Characterization
‘illumination shaping filter’ [14] may further improve the light
The schematic of the mini-microscope was shown in Fig. 2A. uniformity to obtain a better quality of images near the corner.
The lens system and camera module were positioned on the top We also took the images of microscope calibration slide from
of a manual z-axis stage to adjust distance between the object other microscopes as shown in the supplementary Fig. S2. The
and the camera (adjustable d2 in Fig. 1A). With this stage, the mini-microscope and the high resolution microscope show
mini-microscope can precisely focus cells on various cell sharp images of 10 μm gaps in the middle portion of the field
substrates (i.e., petri dishes, flasks, and glass slides) with of view, while the image from the medium resolution
different thickness. The CMOS camera was connected to the microscope was not clear. Only the high resolution microscope
Raspberry Pi system for the image acquisition control and could maintain the clear image around both ends of the field
wireless data transfer. The entire mini-microscope was installed view. In summary, although it is not comparable to the high
in an acrylic box with 16 cm long and 6 cm tall and wide which resolution microscope, the mini-microscope offers an
is suitable for keeping it in an incubator for biomedical acceptable image quality at a low cost. The image quality of the
applications. The photography of the developed mini- developed mini-microscope can be further improved by
microscope is given in Fig. 2B and 2C. We briefly examined introducing a better lens system (i.e., ISF) or using the latest
the system for the feasibility of cordless power operation. With camera module with a higher resolution.
a 3000 mAh power bank, the mini-microscope can be operated
to wirelessly record and transport full HD video (1920x1080, B. Cell Behavior Study
30 fps) for about 5 hours. It may be possible to run the mini- Understanding the attachment and proliferation of
microscope system cordlessly for a day with a commercial mammalian cells is critical for the researches in stem cells,
20000 mAh power bank. tissue engineering, as well as the clinical trials [21]. One of the
During the operation, the object was placed on the window most widely used methods to monitor cell attachment and
of the acrylic box, and a simple array of LED lights was proliferation is the time-lapse microscopy of live cells [22], [23].
positioned above the object for providing illumination. We However, it usually requires to use the expensive incubation
firstly examined the field of view and clearness of the image accessories of the microscope. It is desired to develop an
through the mini-microscope using the microscope calibration alternative method offering the inexpensive but high quality of
slide (the smallest gap = 10 μm) as given in Fig. 2D. The field time-lapse cell images. Here, we developed the mini-
of view was approximately 1 mm by 1 mm when d1 was set to microscope to place into a commercial incubator, and took the

Copyright (c) 2016 IEEE. Personal use of this material is permitted. However, permission to use this material for any other
purposes must be obtained from the IEEE by sending an email to pubs-permissions@ieee.org
0018-9294 (c) 2017 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2749040, IEEE
Transactions on Biomedical Engineering
IEEE Transactions on Biomedical Engineering 5

division, which matches the reported results from [24].


We conducted the coverage rate analysis using the image
processing method. The processed images are also shown in Fig.
3A. It is noticeable that the processed images could not identify
the border between the single cells as the cells were connected
to each other when the confluency reached high. Therefore, the
edge detection-based image processing algorithm presented
here is not feasible to find the morphology of single cells and
count the quantity of cells. However, the bright area of the
processed images can still be used to approximately reflect the
areas covered by cells in the field of view. The relationship
between the coverage rate and culturing time was plotted in Fig.
4A. Supplementary video 2 is a real-time video clip showing
the image analysis process of HEK 293 cells. We found the
significant difference between NIH-3T3 and HEK 293 cells in
Fig. 4. Image processing data to show cell coverage rates. (A) A plot shows their behavior of attachment and proliferation. For NIH-3T3
cell coverage rate over time. Curve fitting results show that the coverage rate cells, most of the cells attached and elongated rapidly and the
of NIH-3T3 cells (B) is faster than HEK293 cells (C) during culturing.
coverage rate was dramatically increased after 7 hours.
However, HEK 293 cells formed a small group of cells before
high quality time-lapse images of NIH-3T3 fibroblasts and
attaching on the flask (see supplementary video 2), which
HEK 293 human embryonic kidney cells for monitoring long-
resulted in the low coverage rate within 17 hours. After small
term cell behavior during attachment of proliferation.
groups of cells attached, HEK 293 cells started to proliferate.
Using the developed mini-microscope for time-lapse
There was a significant difference between the attachment time
imaging has several advantages. First, the mini-microscope is
for NIH-3T3 fibroblasts (approximately 7 – 8 hours maximally)
relatively small (16 cm x 6 cm x 6 cm), making it suitable to be
and HEK 293 cells (at least higher than 16 hours), as shown in
placed directly into the incubator. No modification of the
Fig. 4A. The coverage rate of cells was obtained by the curve
incubation system is needed. Second, the mini-microscope does
fitting (Fig. 4B and 4C). The slope of the coverage rate plot of
not require a host computer near the incubator as the mini-
NIH-3T3 cells was significantly greater than that of HEK 293
microscope can be controlled wirelessly. The mini-microscope
cells, indicating the different cell behaviors. The successful
also provides the live stream video for remote monitoring to
observation of the long-term cell culturing process inside the
maintain the reliability of the experiment over days. The
incubator demonstrates the feasibility of the developed mini-
capability of wirelessly monitor and control can greatly
microscope for the time-lapse imaging and analysis. In short,
improve the observability, reliability, and efficiency of the
the mini-microscope has provided an inexpensive but high
experiments.
resolution method to monitor and analyze cell development in
In addition to the ease of high observability, our mini-
vitro. Such a capability would be very useful for the study of
microscope provides cell images with better quality than the
the long-term cell-cell and cell-extracellular interactions and
previously reported mini-microscopes. The recent
especially for the factors that regulate stem cell fate [25].
improvement of the CMOS sensor (maximum resolution: 2592
x 1944) enabled us to obtain a better quality of images C. Microfluidic Experiment Investigation
compared to the previously reported mini-microscopes based Droplets are a useful tool for tissue engineering [17], [26],
on the low resolution sensor (maximum resolution: 640 x 480) drug delivery [27], and organ-on-a-chip systems [28]. The most
[6]–[8]. The morphology of single NIH-3T3 cell can be clearly widely used devices for generating droplets are the flow-
distinguished (See Fig. S3 for the comparison of the images of focusing microfluidic channel devices. In a flow-focusing
NIH-3T3 cells from the mini-microscope in this study and device, two immiscible fluid phases (dispersed and continuous
previous works by Kim et al. [6]). The representative images phase) are injected into the cross-junction channel through
captured at 2, 14, 26 and 50 hours after seeding cells on a cell syringe pumps with different flow rates (Fig. 5A). Commonly,
culture flask were presented in Fig. 3A. The shapes and the continuous phase is the mixture of oil and surfactant, which
boundaries of single cells can be clearly seen from the captured is very viscous and has high surface tension. The dispersed
images. After 2 hours, most of the cells were remained in a phase is usually an aqueous solution, such as a hydrogel
round shape. However, cells (especially NIH-3T3 cells) prepolymer solution. Droplets are generated when two phases
attached and elongated after 14 hours. The confluency of cells meet at the cross junction, where the shear force induced by the
was significantly increased when comparing the coverage rate continuous phase breaks the dispersed phase to form droplets.
of cells after 14 hours and after 50 hours. We attached a video There are many studies on the physics of droplet generation
clip (supplementary video 1) to show the division process of [29]–[31]. However, it is still hard to use the physics model to
NIH-3T3 during proliferation in-between 30 and 50 hours. Fig. predict the droplet generation process of biomaterials since
3B shows four snapshots of supplementary video 1. It is noticed those models are based on water as the dispersed phase [32]. In
that in the highlighted area, the attached cells became round for

Copyright (c) 2016 IEEE. Personal use of this material is permitted. However, permission to use this material for any other
purposes must be obtained from the IEEE by sending an email to pubs-permissions@ieee.org
0018-9294 (c) 2017 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2749040, IEEE
Transactions on Biomedical Engineering
IEEE Transactions on Biomedical Engineering 6

Fig. 5. Experiment for monitoring a droplet generation process in a microfluidic device. (A) Flow-focusing droplet generation at the cross junction of the
microfluidic device. (B) Experimental setup with two syringe pumps. Scale bar = 2 cm. (C) Images show periodic changes of the thread during droplet formation.
Scale bar = 200 μm.

addition, previous works using hydrogels as the dispersed phase fps is highly significant. In addition, the developed mini-
briefly reported the relationship between the diameter of microscope with 90 fps offers more frames in the generation
droplets and flow rates [17], [33]. Here, we utilized the mini- process of each droplet (~ 6 frames for a droplet) compared to
microscope to investigate fundamental parameters for the the previously reported mini-microscopes with the maximum
droplet generation process of hydrogel prepolymer. The fps of 30 [6], [7]. The mini-microscope with the high fps can
experimental setup is presented in Fig. 5B. The parameters capture the droplet generation process more smoothly and
include the diameter of droplets, droplet generation frequency, clearly, providing high quality data for image processing.
and the length of thread. The term ‘thread’ was firstly Therefore, we employed the highest fps for the microfluidic
introduced by Tan et al. to explain the flow-focusing droplet droplet generation experiments, although the high fps resulted
generation mechanism [34]. It indicates the portion of aqueous in relatively low resolution images.
phase which is passed the junction before forming droplets. The The processed image is given in Fig. 6A. The white point is
end point of the thread is the point that the highest shear stress the detected end of threads. The detection of the droplet
occurred [34]. As can be seen in Fig. 5C, the length of thread generation frequency and the diameter of droplets are presented
was changed periodically during droplet generation. in supplementary video 4 and 5, respectively. Thanks to the
The investigation of microfluidic experiment aims to show capability of the mini-microscope to record videos at high fps,
the advantages of the developed mini-microscope in terms of the generation of each droplet and the corresponding change of
the high frame rate per second. In general, the requirements of ‘thread’ can be accurately tracked and analyzed. As illustrated
the mini-microscope system for monitoring the droplet in the video 5, the length of threads exponentially increased
generation process is different from the cell behavior over the time. After it reached a peak, a new droplet was formed
monitoring. First, the contrast difference between the droplets and the length went back to a minimum value close to zero.
and microfluidic channel is significant and the size of droplets Since the end point of the thread is the point that the highest
is three times greater than cells. Therefore, the morphology of shear stress occurred [34], the dynamic tracking of the thread
the droplets can be easily detected even with the low resolution length enabled by the high fps of the mini-microscope can help
of captured video clips. However, since the droplet generation researchers better understand the droplet generation process of
frequency is very high, the camera with low frame rate per various materials and study the unusual phenomenon of droplet
second may not be able to capture enough number of images to generation induced by encapsulating foreign particles (e.g.,
show the detail process. For example, with the conventional cell-induced instability [35]).
microscope with the maximal fps of 24 (Fig. 6A), the end of the In addition to the dynamic tracking of ‘thread’, the mini-
thread near the junction area was not clear due to the relatively microscope was also capable of providing quantitative data (i.e.,
low fps. On the contrary, when we used the maximal fps of the average diameter of droplets) for statistical studies. After
mini-microscope (fps = 90) to record the droplet generation testing various conditions listed in the method section, we
process, the end of the thread was much clearer (Fig. 6A). In summarized the data in Fig. 6B – 6E. The kinematic viscosity
supplementary video 3, the difference between 24 fps and 90 from different fluids was measured by the viscometer. As

Copyright (c) 2016 IEEE. Personal use of this material is permitted. However, permission to use this material for any other
purposes must be obtained from the IEEE by sending an email to pubs-permissions@ieee.org
0018-9294 (c) 2017 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2749040, IEEE
Transactions on Biomedical Engineering
IEEE Transactions on Biomedical Engineering 7

device, but also a main part of active control systems for


microfluidic devices inside the incubator. For example, the
mini-microscope can be integrated with syringe pumps that
regulate flow rates of the droplet generation process. A real-
time feedback control and analysis system based on the videos
obtained from the mini-microscope can actively control the
droplet generation process to produce large amounts of uniform
droplets inside the incubator for the long term. Such a highly
automated system may greatly benefit the labor-intensive
biofabrication process that usually requires large amounts of
uniform cell-laden droplets [36].

IV. CONCLUSION
In this paper, we present an inexpensive, high resolution
mini-microscope system suitable for in situ monitoring of
biological samples and microfluidic experiments. The system
was built on the Raspberry Pi embedded system. To make the
normal camera module clearly visualize microscale images, we
employed the inverse dual lens system that provides the clear
field of view and suitable magnification rate. The mini-
microscope was able to obtain and transfer the image data
wirelessly, offering the capability of operating it in a
conventional cell culturing incubator. To demonstrate the
feasibility of the system, the developed mini-microscope was
used to monitor cell attachment and proliferation processes, as
well as droplet generation processes inside microfluidic devices.
Benefited from high-quality images, the post image processing
was able to automatically investigate many useful information,
such as the coverage rate of cells and the generation frequency,
Fig. 6. Analysis of droplet generation process. (A) Representative images was diameter, and thread length of droplets. Successful applications
captured by the commercial camera (24 fps) and mini microscope (90 fps). The
image processing was based on the image captured by the mini microscope and demonstrate that the mini-microscope system has a great
a white point indicate the detected end of the thread. Scale bar = 200 μm. (B) potential in many biological and biomedical applications.
The kinematic viscosity of PBS, 5% GelMA, 8% GelMA, and oil with 20%
surfactant was measured by the viscometer (n = 3, *p < 0.05). (C) Diameters,
(D) Length of thread, and (E) generation frequency of the droplets from PBS, REFERENCES
5% GelMA, and 8% GelMA with two different flow rates of continuous phase [1] C. R. Burch and J. P. P. Stock, “Phase-contrast microscopy,” J. Sci.
were calculated by the image processing (*p < 0.05, n = 5). (F) Curve fitting Instrum., vol. 19, no. 5, pp. 71–75, 1942.
results show the logarithmic relationship between the kinematic viscosity ratios [2] C. J. Mann et al., “High-resolution quantitative phase-contrast
of continuous phase and dispersed phase and the diameter of droplets (n = 5). microscopy by digital holography,” Opt. Express, vol. 13, no. 22, pp.
8693–8698, 2005.
shown in Fig. 6B, with the increment of GelMA concentration, [3] R. Oldenbourg, “New views on polarization microscopy,” Eur. Cell.
the dispersed phase become more viscous. The continuous Mater., vol. 1, no. 2, p. 13, 2001.
[4] C. J. Cogswell and C. J. R. Sheppard, “Confocal differential interference
phase (oil with 20% surfactant), however, is much more viscous contrast (DIC) microscopy: including a theoretical analysis of
than the dispersed phase. At the same flow rate, viscous conventional and confocal DIC imaging,” J. Microsc., vol. 165, no. 1, pp.
dispersed phase resulted in bigger droplets, the longer length of 81–101, 1992.
[5] E. Schwan et al., “A modular and affordable time-lapse imaging and
thread, and lower frequency of droplet generation. On the incubation system based on 3D- printed parts, a smartphone, and off-the-
contrary, the increment of continuous phase flow rate shelf electronics,” PLoS One, vol. 11, no. 12, pp. 1–15, Dec. 2016.
contributed to smaller droplets, the shorter length of thread, and [6] S. B. Kim et al., “A mini-microscope for in situ monitoring of cells.,” Lab
Chip, vol. 12, no. 20, pp. 3976–82, Oct. 2012.
higher frequency of droplet generation. These trends are well [7] K. Koo et al., “An optical multi-sensing system for detection of
matched with previous experimental results [16]. The analyzed cardiovascular toxicity.,” Biotechnol. Lett., vol. 36, no. 5, pp. 1089–1094,
data can be further used to find parameters for modeling droplet 2014.
[8] Y. S. Zhang et al., “A cost-effective fluorescence mini-microscope for
generation mechanisms. For example, we found that the biomedical applications,” Lab Chip, vol. 15, no. 18, pp. 3661–3669, 2015.
diameter of droplets seems to be a logarithmic function of the [9] S. B. Kim et al., “A cell-based biosensor for real-time detection of
ratios of kinematic viscosities of two flow phases (Fig. 6F). The cardiotoxicity using lensfree imaging.,” Lab Chip, vol. 11, no. 10, pp.
1801–7, May 2011.
R2 values of the fitted curves are around 0.95. The successful
[10] S. Seo et al., “High-throughput lens-free blood analysis on a chip,” Anal
capturing and analysis of the droplet generation process proves Chem, vol. 82, no. 11, pp. 4621–4627, 2010.
the feasibility of using the developed mini-microscope for [11] J. Balsam et al., “Lensless CCD-based fluorometer using a
monitoring lab-on-a-chip devices. In the future work, the mini- micromachined optical Söller collimator.,” Lab Chip, vol. 11, no. 5, pp.
941–9, Mar. 2011.
microscope can be used not only as a passive observation
Copyright (c) 2016 IEEE. Personal use of this material is permitted. However, permission to use this material for any other
purposes must be obtained from the IEEE by sending an email to pubs-permissions@ieee.org
0018-9294 (c) 2017 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TBME.2017.2749040, IEEE
Transactions on Biomedical Engineering
IEEE Transactions on Biomedical Engineering 8

[12] X. Zhang et al., “Lensless imaging for simultaneous microfluidic sperm [25] N. Bertani, “Neurogenic potential of human mesenchymal stem cells
monitoring and sorting.,” Lab Chip, vol. 11, no. 15, pp. 2535–40, Aug. revisited: analysis by immunostaining, time-lapse video and microarray,”
2011. J. Cell Sci., vol. 118, no. 17, pp. 3925–3936, 2005.
[13] D. Tseng et al., “Lensfree microscopy on a cellphone.,” Lab Chip, vol. 10, [26] Y. T. Matsunaga et al., “Molding cell beads for rapid construction of
no. 14, pp. 1787–92, Jul. 2010. macroscopic 3D tissue architecture,” Adv. Mater., vol. 23, no. 12, pp. 90–
[14] N. A. Switz et al., “Low-cost mobile phone microscopy with a reversed 94, 2011.
mobile phone camera lens,” PLoS One, vol. 9, no. 5, p. e95330, May 2014. [27] H. Shibata et al., “Injectable hydrogel microbeads for fluorescence-based
[15] J. Canny, “A computational approach to edge detection,” IEEE Trans. in vivo continuous glucose monitoring.,” Proc. Natl. Acad. Sci. U. S. A.,
Pattern Anal. Mach. Intell., vol. PAMI-8, no. 6, pp. 679–698, 1986. vol. 107, no. 42, pp. 17894–17898, 2010.
[16] R. Samanipour et al., “Computational and experimental study of [28] Z. Wang et al., “Organ-on-a-chip platforms for drug delivery and cell
microfluidic flow-focusing generation of hydrogel droplets,” J. Appl. characterization : a review,” Sensors Mater., vol. 27, no. 6, pp. 487–506,
Polym. Sci., 2016. 2015.
[17] C. Cha et al., “Microfluidics-assisted fabrication of gelatin-silica core − [29] W. Lee et al., “Role of geometry and fluid properties in droplet and thread
shell microgels for injectable tissue constructs,” Biomacromolecules, vol. formation processes in planar flow focusing,” Phys. Fluids, vol. 21, no. 3,
15, pp. 283–290, 2014. pp. 1–15, 2009.
[18] Z. Wang et al., “A simple and high-resolution stereolithography-based 3D [30] C. N. Baroud et al., “Dynamics of microfluidic droplets.,” Lab Chip, vol.
bioprinting system using visible light crosslinkable bioinks,” 10, no. 16, pp. 2032–2045, 2010.
Biofabrication, vol. 7, no. 4, p. 45009, 2015. [31] P. He et al., “Flow of two immiscible liquids with low viscosity in Y
[19] Z. Wang et al., “An ultrafast hydrogel photocrosslinking method for direct shaped microfluidic systems: effect of geometry,” Microfluid.
laser bioprinting,” RSC Adv., vol. 6, no. 25, pp. 21099–21104, 2016. Nanofluidics, vol. 9, no. 2–3, pp. 293–301, 2009.
[20] Z. Wang et al., “Development of anatomically realistic numerical breast [32] Z. Wang et al., “An automated system for high-throughput generation and
phantoms based on T1- and T2-weighted MRIs for microwave breast optimization of microdroplets,” Biomicrofluidics, vol. 10, no. 5, p.
cancer detection,” IEEE Antenna Wirel. Propag. Lett., vol. 13, pp. 1757– 013605BMF, 2016.
1760, 2014. [33] T.-D. Dang et al., “Preparation of monodisperse PEG hydrogel
[21] R. Dai et al., “Adipose-derived stem cells for tissue engineering and microparticles using a microfluidic flow-focusing device,” J. Ind. Eng.
regenerative medicine applications,” Stem Cells Int., 2016. Chem., vol. 18, no. 4, pp. 1308–1313, Jul. 2012.
[22] P. M. Kulesa and S. E. Fraser, “Neural crest cell dynamics revealed by [34] Y.-C. Tan et al., “Monodispersed microfluidic droplet generation by shear
time-lapse video microscopy of whole chick explant cultures,” Dev. Biol., focusing microfluidic device,” Sensors Actuators B Chem., vol. 114, no.
vol. 204, pp. 327–344, 1998. 1, pp. 350–356, 2006.
[23] A. L. Siegel et al., “Muscle satellite cell proliferation and association: new [35] J. Jung and J. Oh, “Cell-induced flow-focusing instability in gelatin
insights from myofiber time-lapse imaging,” Skelet. Muscle, vol. 1, no. 1, methacrylate microdroplet generation,” Biomicrofluidics, vol. 8, no. 3,
pp. 327–344, 2011. 2014.
[24] A. Lesman et al., “Contractile forces regulate cell division in three- [36] Y. Morimoto et al., “Point-, line-, and plane-shaped cellular constructs for
dimensional environments,” J. Cell Biol., vol. 205, no. 2, pp. 155–162, 3D tissue assembly,” Adv. Drug Deliv. Rev., vol. 95, pp. 29–39, 2015.
2014.

Copyright (c) 2016 IEEE. Personal use of this material is permitted. However, permission to use this material for any other
purposes must be obtained from the IEEE by sending an email to pubs-permissions@ieee.org
0018-9294 (c) 2017 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.

Vous aimerez peut-être aussi