Particle sorting apparatus and particle sorting method

This application claims the benefit under 35 U.S.C. § 371 as a U.S. National Stage Entry of International Application No. PCT/JP2022/004854, filed in the Japanese Patent Office as a Receiving Office on Feb. 8, 2022, which claims priority to Japanese Patent Application Number JP2021-121980, filed in the Japanese Patent Office on Jul. 26, 2021, each of which is hereby incorporated by reference in its entirety.

The present technology relates to a particle sorting apparatus and a particle sorting method. In more detail, the present technology relates to a particle sorting apparatus and a particle sorting method capable of stably detecting a particle velocity with high accuracy.

Currently, a technology called flow cytometry is used to examine biologically relevant particles such as cells and microorganisms, and particles such as microbeads. Flow cytometry is an examination technique in which particles in an aligned state are flowed into a fluid, and the particles are irradiated with laser light or the like to detect light released from each particle, thereby analyzing and sorting the particles.

When particles are sorted in flow cytometry, specified particles can be selectively collected by controlling sorting of the particles on the basis of detected optical information. Here, in order to efficiently control particle sorting, Patent Document 1 discloses a technology in which the time taken by a particle to move between two detection positions is counted using two light sources and two light receivers corresponding to the light sources, the time taken by the particle to reach a break-off point is worked out by finding a particle velocity, and each particle is charged at a timing according to the worked-out time.

Patent Document 1: Japanese Patent Application Laid-Open No. 2009-145213

However, in the case of finding the particle velocity using two light receivers, there has been a disadvantage that, when two detection positions change over time, an error attributable to the change may be produced in the particle velocity detection.

Thus, a main object of the present technology is to provide a technology capable of stably detecting a particle velocity with high accuracy.

The present technology first provides a particle sorting apparatus including: an irradiation unit that includes a plurality of light sources and irradiates a particle contained in a fluid with light from the plurality of light sources; a detection unit that includes a plurality of pixels configured to detect, as an event, a luminance change in the light emitted from the particle due to irradiation of the light from each of the light sources; and a sorting control unit that controls sorting of the particle on the basis of event data detected by the detection unit.

In addition, the present technology also provides a particle sorting method including: an irradiation step of including a plurality of light sources and irradiating a particle contained in a fluid with light from the plurality of light sources; a detection step of detecting, as an event, a luminance change in the light emitted from the particle due to irradiation of the light from each of the light sources; and a sorting control step of controlling sorting of the particle on the basis of event data detected in the detection step.

Hereinafter, a preferred mode for carrying out the present technology will be described with reference to the drawings.

100 (1) Particles (2) Flow Path P 11 (3) Irradiation Unit 12 (4) Detection Unit 13 (5) Sorting Control Unit 14 (6) Processing Unit 15 (7) Sorting Unit 16 (8) Analysis Unit 1. Configuration Example of Particle Sorting Apparatusaccording to Present Technology 2. One Embodiment 100 122 (1) EVS Device 14 (2) Processing Unit 2-1. Configuration Example of Particle Sorting Apparatusaccording to Present Embodiment 122 2-2. Configuration Example of EVS Device 100 2-3. Another Configuration Example of Particle Sorting Apparatusaccording to Present Embodiment 100 2-4. Specific Example of Optical System of Particle Sorting Apparatusaccording to Present Embodiment 3. Operation Flow Examples The embodiments to be described below are intended to illustrate examples of representative embodiments of the present technology, and the scope of the present technology will not be construed narrower by these embodiments. Note that the description will be given in the following order.

1 FIG. 1 FIG. 100 100 11 12 13 12 100 14 15 16 is a schematic diagram illustrating a configuration example of a particle sorting apparatusaccording to the present technology. The particle sorting apparatusillustrated inincludes at least an irradiation unitthat irradiates a particle flowing in a flow path P with light, a detection unitthat detects light produced by the irradiation, and a sorting control unitthat controls sorting of the particle on the basis of information detected by the detection unit. In addition, the particle sorting apparatusmay include a processing unit, a sorting unit, an analysis unit, and the like, as necessary.

(1) Particles

In the present technology, “particles” can broadly include biologically relevant particles such as cells, microorganisms, and ribosomes, or synthetic particles such as latex particles, gel particles, and industrial particles, or the like. In addition, in the present technology, the particles are contained in a fluid such as a liquid sample.

Escherichia coli The biologically relevant particles can include chromosomes composing various cells, ribosomes, mitochondria, organelles (cell organelles), and the like. The cells can include animal cells (such as blood cells as an example) and plant cells. The microorganisms can include bacteria such as, viruses such as tobacco mosaic virus, fungi such as yeast, and the like. In addition, the biologically relevant particles can also include biologically relevant polymers such as nucleic acids, proteins, and composites of these, for example.

For example, the industrial particles may be an organic or inorganic polymer material, metal, or the like. The organic polymer material can include polystyrene, styrene/divinylbenzene, polymethyl methacrylate, and the like. The inorganic polymer material can include glass, silica, magnetic material, and the like. The metal can include gold colloid, aluminum, and the like. In general, shapes of these particles are normally spherical, but may be non-spherical in the present technology, while the dimensions, mass, and the like thereof are also not particularly limited.

In the present technology, the biologically relevant particles are particularly preferable as the particles.

In the present technology, the particles may be labeled with one or two or more kinds of dyes such as fluorescent dyes. In these circumstances, for example, the available fluorescent dyes include Cascade Blue, Pacific Blue, fluorescein isothiocyanate (FITC), phycoerythrin (PE), propidium iodide (PI), Texas Red (TR), peridinin chlorophyll protein (PerCP), allophycocyanin (APC), 4′, 6-diamidino-2-phenylindole (DAPI), Cy3, Cy5, Cy7, Brilliant Violet (BV421), and the like.

(2) Flow Path P

100 The flow path P can be configured such that a flow in which particles are placed in a substantially line is formed. The flow path P may be provided in advance in the particle sorting apparatus, but it is also possible to install a commercially available flow path, a disposable chip provided with a flow path, or the like.

The form of the flow path P is also not particularly limited and can be freely designed as appropriate. For example, without restricting to the flow path formed in a substrate T of two-dimensional or three-dimensional plastic, glass, or the like, a flow path as used in a conventional flow cytometer can also be used.

100 11 The particle sorting apparatusaccording to the present technology can be configured such that particles contained in a fluid flowing inside the flow path P are irradiated with light from the irradiation unit. In addition, the light irradiation point (interrogation point) may be configured such that the irradiation point (interrogation point) is located inside a flow path structure in which the flow path P is formed.

Specifically, for example, a configuration in which the flow path P inside a chip or a flow cell is irradiated with light can be mentioned.

100 A flow path width, a flow path depth, a flow path cross-sectional shape, and the like of the flow path P are not particularly limited, as long as a laminar flow can be formed, and can be freely designed as appropriate. For example, a micro flow path having a flow path width of 1 mm or less can also be used in the particle sorting apparatus.

2 FIG. 11 12 12 11 12 12 13 a b a b A method of pouring particles into the flow is not particularly limited, and the particles can be caused to flow through the flow path P according to the form or the like of the flow path P. Specifically, for example, in the case of the flow path P (chip approach) formed in the substrate T as illustrated in, a sample liquid containing particles is introduced into a sample liquid flow path P, and a sheath liquid is introduced into two sheath liquid flow paths Pand P, separately. Then, the sample liquid flow path Pand the two sheath liquid flow paths Pand Pmerge into a main flow path P.

11 12 12 13 a b A sample liquid laminar flow fed to inside the sample liquid flow path Pand sheath liquid laminar flows fed to inside the two sheath liquid flow paths Pand Pmerge inside the main flow path P, whereby a sheath flow in which the sample liquid laminar flow is sandwiched between the sheath liquid laminar flows can be formed. In these circumstances, vibration is imparted to a part of a surface of the substrate T by a vibration element, and a droplet can be formed out of a liquid column projected from an orifice.

Inside the flow path P, the laminar flows in which the sheath liquid and the sample liquid containing particles flow do not mix with each other and flow in parallel. In a case where a liquid feeding pressure of the sample liquid is not so high with respect to a liquid feeding pressure of the sheath liquid, the laminar flow of the sample liquid flows substantially at the center of the flow path P and has a narrower width with respect to the laminar flow of the sheath liquid. Therefore, the particles flow inside the flow path P at a constant speed. However, when the liquid feeding pressure of the sample liquid is increased in order to increase an event rate at which the particles are detected, the width of the laminar flow of the sample liquid is widened, and the respective particles are caused to flow at different speeds depending on the distance from the center.

In particular, the present technology can be suitably used in a case where the respective particles flow at different speeds inside the flow path P as described above.

11 (3) Irradiation Unit

11 The irradiation unitincludes a plurality of light sources and irradiates particles contained in a fluid with light from the plurality of light sources. The plurality of light sources may discharge light with the same wavelength as each other or may discharge light with different wavelengths from each other.

11 The type of light for irradiation from the irradiation unitis not particularly limited, but in order to reliably cause light to arise from the particles, light having a constant light direction, wavelength, and light intensity is desirable. Specifically, for example, laser light, a light emitting diode (LED), and the like can be mentioned.

Examples of the laser light include a semiconductor laser, an argon ion (Ar) laser, a helium-neon (He—Ne) laser, a dye laser, a krypton (Cr) laser, a solid-state laser in which a semiconductor laser and a wavelength conversion optical element are combined, and the like, and two or more kinds of these lasers can also be used in combination.

11 11 100 The irradiation unitcan be configured such that the light discharged from the plurality of light sources is multiplexed and then, the particles are irradiated with the multiplexed light. In the present technology, the irradiation unitis preferably configured to perform irradiation with light from the plurality of light sources at different positions in a flow direction of the fluid. In these circumstances, the position irradiated with light may be configured such that at least two or more (such as two, three, four, five, six, or seven as an example) spots are irradiated, and the particle sorting apparatuscan be configured such that the particle passes through these spots.

11 11 In order to configure the irradiation unitin such a manner, the irradiation unitcan include a light-guiding optical system for guiding this plurality of light rays to predetermined positions. The light-guiding optical system may include, for example, optical constituents such as a beam splitter group, a mirror group, and an optical fiber in order to multiplex the plurality of light rays. In addition, the light-guiding optical system may include a lens group for condensing the multiplexed excitation light and can include, for example, an objective lens.

1 FIG. Note that, in, the particles being flowing through the flow path P are irradiated with light (cuvette detection approach), but in the case of ejecting the fluid as a jet flow from the orifice of the flow path P, the liquid column portion of the jet flow may be irradiated with light (jet in air detection approach).

12 (4) Detection Unit

12 In the present technology, a plurality of pixels that detects, as an event, a change in luminance (also referred to as “light intensity”) of light emitted from a particle due to irradiation of each of the light rays is provided as a sensor (detection unit) for acquiring information regarding the particle. Specifically, it is possible to use an event-based vision sensor (EVS) that asynchronously outputs the coordinates (position information) of the pixel that has detected a luminance change, time information at which the luminance change was detected, and a direction (polarity information) of the luminance change, as event data. By using the EVS as the detection unit, the particle velocity can be stably detected with high accuracy, of which details will be described later.

Note that the information regarding the particle may include, for example, particle image data (particle image) reconstructed from the event data, a particle feature such as a shape, dimensions, or a color extracted from the event data or the particle image data, information generated from the event data, the particle image data, the particle feature, or the like, and attribute information indicating normality or anomaly, or the like.

11 14 The present technology can include a light detection unit that detects light (also referred to as “measurement target light”) emitted from a particle due to irradiation of the particle with light by the irradiation unit. In these circumstances, examples of the light to be detected include fluorescence, scattered light (for example, any one or more of forward scattered light, backward scattered light, or side scattered light), transmitted light, reflected light, and the like. The light detection unit is constituted by at least one or more photodetectors, and the photodetector includes one or more light-receiving elements and, for example, includes a light-receiving element array. The photodetector may include one or a plurality of photodiodes such as a photomultiplier tube (PMT) and/or an avalanche photodiode (APD) and a multi-pixel photon counter (MPPC), as the light-receiving elements. The photodetector can include, for example, a PMT array in which a plurality of PMTs is arranged in a one-dimensional direction. In addition, the photodetector may include an imaging element such as a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS). The measurement target light is converted into an electrical signal by the photodetector, and the electrical signal is output to the processing unitto be described later and utilized to acquire the information regarding the particle.

14 14 The light detection unit can include a signal processing unit that converts the electrical signal obtained by the photodetector into a digital signal. In addition, the signal processing unit may include an analog-to-digital (A/D) converter as an apparatus that performs the conversion. The digital signal obtained by the conversion by the signal processing unit can be sent to the processing unitto be described later. The digital signal can be treated as data relating to light (also referred to as “light data”) by the processing unit. Examples of the light data include light data including fluorescence data, and the like. More specifically, the light data may be light intensity data, and the light intensity may be light intensity data of light including fluorescence (such as features including the area, height, and width, as an example).

Furthermore, along with the light detection unit, the present technology can include a detection optical system that causes light having a predetermined detection wavelength to reach the EVS or the corresponding photodetector described above. The detection optical system can include a spectroscopic unit such as a prism or a diffraction grating, or a wavelength separation unit such as a dichroic mirror or an optical filter. For example, the detection optical system may be configured to disperse light from the particle and detect light in different wavelength bands in a plurality of photodetectors, of which the number is larger than the number of fluorescent dyes. In addition, the detection optical system may be configured to separate the light corresponding to the fluorescence wavelength band of a fluorescent dye from the light from the particle, for example, and cause the EVS or the corresponding photodetector described above to detect the separated light.

13 (5) Sorting Control Unit

13 12 13 15 The sorting control unitcontrols sorting of the particles on the basis of information detected by the detection unitand the light detection unit. Specifically, the charging timing for a droplet D containing a specified particle to be sorted is controlled on the basis of the event data detected using the EVS, of which details will be described later. In addition, determination as to whether or not to sort each particle is executed on the basis of a sorting control signal based on the information regarding the particle acquired by the light detection unit, and the like. Then, the sorting control unitcontrols the sorting unitto be described later on the basis of the result of the determination, whereby the particles are sorted.

14 (6) Processing Unit

14 14 13 15 The processing unitdesignates the particle velocity on the basis of the event data. For example, the calculation can be performed on the basis of the event data output every time each particle passes through each light source, and the particle velocity of each particle can be acquired, of which details will be described later. In addition, the processing unitperforms sorting verification on the basis of the information regarding the particle (such as the features of the particle including the dimensions, form, and internal structure of the particle, and the attribute information on the particle, as an example) acquired by the light detection unit, light data, sorting conditions given by an input unit to be described later, and the like and generates the sorting control signal. On the basis of the sorting control signal, the sorting control unitdescribed above controls the sorting unitto be described later so as to execute determination as to whether or not to sort each particle. Here, the sorting control signal may include information regarding the presence or absence of charging by a charging unit and the magnitude of the charge.

15 (7) Sorting Unit

15 13 2 FIG. The sorting unitincludes a charging unit that charges the droplet D containing the particles and sorts the droplet D containing a specified particle to be sorted. Specifically, for example, the droplet D containing particles is generated by vibration formed by a vibration element such as a piezoelectric element, the droplet D to be sorted is charged by the charging unit according to an instruction from the sorting control unitdescribed above, and a traveling direction of the droplet D is controlled by a counter electrode. In the present technology, the traveling direction of the particles may be controlled within the flow path structure to sort particles. In these circumstances, the flow path structure may be provided with, for example, a control mechanism by pressure (injection or suction) or a charge, and examples of the flow path structure include a chip as illustrated in, and the like.

16 (8) Analysis Unit

16 The analysis unitperforms information processing for executing processing of various kinds of data (such as the information regarding the particle, a feature based on a result of examination, statistical data, and a class discrimination result, as an example) and stores the various kinds of data. As the information processing, for example, in a case where the light data corresponding to a fluorescent dye is acquired from the light detection unit, fluorescence leakage correction (compensation process) is performed on the light intensity data. In addition, a fluorescence separation process is executed on the light data, and the light intensity data corresponding to the fluorescent dye is acquired.

16 16 The fluorescence separation process may be performed in accordance with an unmixing method disclosed in JP 2011-232259 A, for example. In addition, in a case where the light detection unit includes an imaging element, particle form information may be acquired on the basis of the image acquired by the imaging element. In these circumstances, the analysis unitmay be configured such that the acquired light data can be held. The analysis unitmay be configured such that spectral reference data to be used in the unmixing process can be further held.

16 In addition, the analysis unitmay be configured such that various kinds of data can be output.

16 16 16 Specifically, for example, the light data, image data, and various kinds of data (such as two-dimensional plots and spectral plots, as an example) generated on the basis of the light data can be output. Furthermore, the analysis unitmay be configured such that input of the various kinds of data can be accepted and accepts, for example, a gating process on a plot by a user. The analysis unitcan include an output unit (such as a display, a portable information terminal, or a printer, as an example) or an input unit (such as a mouse, a keyboard, or a portable information terminal, as an example) for causing the output or the input to be executed. In addition, the analysis unitcan include a display unit that presents various kinds of data such as the information regarding the particle, a feature based on a result of examination, statistical data, and a class discrimination result.

16 16 11 12 16 16 The analysis unitmay be configured as a general-purpose computer and may be configured as an information processing apparatus including, for example, a central processing unit (CPU), a random access memory (RAM), and a read only memory (ROM). The analysis unitmay be included in a housing provided with the irradiation unit, the detection unit, and the like, or may be located outside the housing. Note that, in the present technology, the analysis unitis not indispensable, and the above-described various processes or functions by the analysis unitmay be implemented by a server computer or a cloud connected via a network.

Next, an embodiment according to the present technology will be described in detail with reference to the drawings.

2 FIG. 2 FIG. 1 FIG. 2 FIG. 100 100 111 112 11 121 122 123 12 13 14 15 15 15 111 112 121 123 13 14 15 16 a b is a block diagram illustrating a more specific configuration example of the particle sorting apparatusaccording to an embodiment of the present technology. As illustrated in, the particle sorting apparatusaccording to the present embodiment includes light sourcesand a light-guiding optical systemconstituting the irradiation unit, a detection optical system, an EVS device, and a light detection unitconstituting the detection unit, the sorting control unit, the processing unit, and charging unitsand counter electrodesconstituting the sorting unitand observes an image of light emitted from a particle contained in a fluid flowing in the flow path P. Note that the light sources, the light-guiding optical system, the detection optical system, the light detection unit, the sorting control unit, the processing unit, and the sorting unitmay be partially or entirely similar to those described above with reference to. Note that, in, the analysis unitis omitted.

111 112 122 121 123 122 More specifically, light (excitation light) output from the light sourcesis condensed by the light-guiding optical system. The condensed light serves to irradiate the particles flowing at a high speed inside the flow path P in which a fluid (such as a biological sample as an example) with particles in a floating state flows. The light emitted from a particle irradiated with light is formed as an image on a light-receiving surface of the EVS devicethrough the detection optical systemor detected by the light detection unit. Examples of the light emitted from the particle include fluorescence, scattered light (for example, any one or more of forward scattered light, backward scattered light, or side scattered light), transmitted light, and reflected light. In the present embodiment, the light detected by the EVS deviceis particularly preferably fluorescence or scattered light. In addition, since scattered light is produced at any excitation wavelength, scattered light is more preferable, and among the kinds of scattered light, forward scattered light having high light intensity is particularly preferable.

122 (1) EVS Device

122 The EVS deviceincludes, for example, pixels (hereinafter, referred to as “event pixels”) arranged in a two-dimensional lattice pattern, of which details will be described later. Each event pixel detects an event on the basis of a luminance change in incident light.

3 FIG. 3 FIG. 122 122 is an image (an example of output images of the EVS) when particles pass on the light-receiving surface of the EVS device. In, the particles pass from the left to right, and light is radiated at a light-condensing position of each light source. Therefore, a luminance change is caused. The EVS devicedetects that luminance change asynchronously (preferably asynchronously) and outputs the detected luminance change as event data including position information (X address and Y address) on the pixel that detected the event, polarity information (positive event or negative event) on the detected event, time information (time stamp) at which the event was detected, and the like.

13 Since the event data described above is output every time a particle passes through each light source, in the present embodiment, the sorting control unitcan acquire each particle velocity by performing calculation according to the position information on the pixel that detected the event and the time information at which the event was detected.

13 111 110 110 110 111 110 111 13 15 15 a g a 3 FIG. Specifically, the sorting control unitspecifies a light interval between the plurality of light sourceson the basis of the position information obtained every time a particle passes through specified spots(see also spotstoin) based on the light sources. In addition, using the time information obtained every time a particle passes through the specified spotsbased on the light sources, the particle velocity=light interval/particle passing time is found, and a droplet charging time (delay time) of each particle is computed according to the found particle velocity and a liquid feeding distance. Then, the sorting control unitcontrols the charging unitin the sorting uniton the basis of this delay time and applies a charge to the droplet D containing a specified particle to be sorted at an optimum timing.

Here, in Patent Document 1 described above, a moving speed of the particle is found on the basis of two detection positions (=excitation light spot interval) irradiated by a plurality of light sources, and the charging timing for the droplet containing the particle is controlled on the basis of the found moving speed. However, in the method described in Patent Document 1, it is not considered that the excitation light spot interval is affected by heat or the like arising from the irradiation unit or the whole particle sorting apparatus and changes over time. Therefore, when the excitation light spot interval changes, this leads to a detection error for the particle velocity, and the optimum charging timing is not allowed to be computed. As a result, the sorting performance such as the yield, the recovery rate, and the purity will deteriorate.

In addition, in order to sort the particles at a high speed by increasing the event rate, a core flow (sample flow) becomes larger, and thus the speed difference between respective particles becomes larger. Moreover, a driving frequency of the vibration element that generates the droplets becomes higher, and the required time accuracy to the break-off point at which the droplets are charged becomes severe.

122 100 In contrast to this, in the present embodiment, since the delay time can be specified using the EVS device, a change in the light interval over time can be handled, and the particle velocity can be stably detected with high accuracy. As a result, since a speed compensation system that optimizes the timing of charging according to individual particles can be constructed, the particle sorting apparatuswith improved sorting performance such as yield, recovery rate, and purity can be implemented.

111 In addition, in the present embodiment, on the basis of the fact that the light-condensing position of each light sourcedoes not greatly fluctuate, the position information on the pixel that detected the event is gated in advance, and the luminance change at the detection position of the pixel is calculated, whereby the calculation speed and the detection accuracy can be further enhanced.

111 111 111 122 111 111 110 110 110 110 111 3 FIG. a g a g Furthermore, in the present embodiment, in a case where the plurality of light sourcesis made up of three or more light sources, the event is preferably detected by irradiation of light based on two light sourcesfarthest from each other in the flow direction of the fluid, from the viewpoint of time resolution of the EVS device. Specifically, for example, in the example of the output images of the EVS illustrated in, the particles are irradiated with light from the seven light sources, and it is preferable to specify the interval of the light on the basis of the position information obtained every time a particle passes through the spots based on the two light sourcesfarthest from each other with respect to the flow direction of the fluid, that is, the spotand the spot, among the spotstobased on the seven light sources. This enables to detect the particle velocity with higher accuracy.

111 111 111 111 111 122 111 122 111 122 3 FIG. In addition, in a case where the plurality of light sourcesis made up of three or more light sources, it is preferable that each of the light sourcesis positioned at intervals to such an extent that the light sourcesdo not mutually interfere with each other. Furthermore, a detection position interval (see L of) between the two light sourcesfarthest from each other in the flow direction of the fluid is preferably 100 μm or more, more preferably 250 μm or more, and still more preferably 400 μm or more in the flow cell. In addition, in a case where scattered light is detected as light radiated from particles in the EVS device, the shorter the excitation wavelength, the easier it is to detect scattered light from a particle having a small size. Therefore, for example, the light sourcehaving the shortest excitation wavelength that can be detected by the EVS deviceand the light sourcehaving the second shortest excitation wavelength that can be detected by the EVS devicecan be positioned at the farthest positions in the flow direction of the fluid.

122 14 A string of the event data (also referred to as an “event stream”) arising from each pixel in correspondence with the image of the particle moving on the light-receiving surface of the EVS deviceis convey to the processing unit.

14 (2) Processing Unit

14 122 The processing unitreconstructs frame data of the image of the particle from the event stream and the particle velocity input from the EVS deviceand examines the reconstructed frame data.

14 123 13 15 In addition, the processing unitperforms sorting verification on the basis of the information regarding the particle and the light data acquired by the light detection unit, the input sorting conditions, and the like and generates the sorting control signal. On the basis of the generated sorting control signal, the sorting control unitcontrols the sorting unitto execute determination as to whether or not to sort each particle. Here, the sorting control signal may include information regarding the presence or absence of charging by the charging unit and the magnitude of the charge.

122 Next, a configuration example of the EVS devicewill be described in detail with reference to the drawings.

4 FIG. 4 FIG. 122 122 201 202 203 204 205 206 is a block diagram illustrating a configuration example of the EVS deviceaccording to the present embodiment. As illustrated in, the EVS deviceincludes a pixel array unit, an X arbiterand a Y arbiter, an event signal processing circuit, a system control circuit, and an output interface (I/F).

201 20 The pixel array unithas a configuration in which a plurality of event pixelsthat each detect an event on the basis of a luminance change in the incident light is arranged in a two-dimensional lattice pattern. Note that, in the following description, a row direction refers to an arrangement direction of pixels in a pixel row (the lateral direction in the drawing), and a column direction refers to an arrangement direction of pixels in a pixel column (the longitudinal direction in the drawing).

20 20 202 203 202 203 Each event pixelincludes a photoelectric conversion element that generates a charge according to the luminance of the incident light and, in a case where a luminance change in the incident light has been detected on the basis of a photocurrent flowing out from the photoelectric conversion element, outputs a request for demanding reading from the own event pixel, to the X arbiterand the Y arbiter, and outputs an event signal indicating that an event has been detected, in accordance with arbitration by the X arbiterand the Y arbiter.

20 20 Each event pixeldetects the presence or absence of an event, depending on whether or not a change exceeding a predetermined threshold value has been produced in the photocurrent according to the luminance of the incident light. For example, each event pixeldetects, as an event, that the luminance change has exceeded the predetermined threshold value (positive event) or has fallen below the predetermined threshold value (negative event).

20 202 203 20 204 202 203 When detecting an event, the event pixeloutputs a request for demanding permission to output an event signal representing the occurrence of the event, to each of the X arbiterand the Y arbiter. Then, the event pixeloutputs the event signal to the event signal processing circuitin a case where a response representing permission to output the event signal is given by each of the X arbiterand the Y arbiter.

202 203 20 20 The X arbiterand the Y arbiterarbitrate a request for demanding output of the event signal supplied from each of the plurality of event pixelsand send a response based on a result of the arbitration (permission or non-permission of the output of the event signal) and a reset signal for resetting the event detection, to the event pixelthat has output the request.

204 20 The event signal processing circuitgenerates and outputs the event data by executing predetermined signal processing on the event signal input from the event pixel.

20 20 20 20 As described above, the change in the photocurrent generated in the event pixelcan also be regarded as a light amount change (luminance change) of the light incident on a photoelectric conversion unit of the event pixel. Accordingly, it can be said that the event is a light amount change (luminance change) in the event pixelexceeding the predetermined threshold value. The event data representing the occurrence of an event includes at least the position information such as coordinates representing the position of the event pixelwhere the light amount change as an event has occurred. The event data can include the polarity of light amount change along with the position information.

20 For the series of pieces of the event data output from the event pixelsat a timing when an event occurred, as long as an interval between pieces of the event data is maintained as it was when the events occurred, the event data implicitly includes time information representing a relative time at which the event occurred.

204 However, when the interval between pieces of the event data is not maintained as it was when the events occurred because, for example, the event data is stored in a storage unit, the time information implicitly included in the event data is lost. Therefore, before the interval between pieces of the event data is no longer maintained as it was when the events occurred, the event signal processing circuitmay include time information representing a relative time at which the event occurred, such as a time stamp, in the event data.

205 202 203 204 As another configuration, the system control circuitis constituted by a timing generator or the like that generates various timing signals and performs drive control of the X arbiter, the Y arbiter, the event signal processing circuit, and the like on the basis of various timings generated by the timing generator.

206 204 14 In addition, the output I/Foutputs the event data output in units of rows from the event signal processing circuitto the processing unitas an event stream at any time, that is, asynchronously.

5 FIG. 5 FIG. 1 2 FIGS.and 5 FIG. 100 100 111 112 11 121 122 123 12 13 14 15 15 15 111 112 121 122 123 13 14 15 16 a b is a block diagram illustrating another more specific configuration example of the particle sorting apparatusaccording to the embodiment of the present technology. As illustrated in, the particle sorting apparatusaccording to the present embodiment includes light sourcesand a light-guiding optical systemconstituting the irradiation unit, a detection optical system, an EVS device, and a light detection unitconstituting the detection unit, the sorting control unit, the processing unit, and charging unitsand counter electrodesconstituting the sorting unitand observes an image of light emitted from a particle contained in a fluid flowing in the flow path P. Note that the light sources, the light-guiding optical system, the detection optical system, the EVS device, the light detection unit, the sorting control unit, the processing unit, and the sorting unitmay be partially or entirely similar to those described above with reference to. Note that, in, the analysis unitis omitted.

100 100 2 FIG. 2 FIG. 5 FIG. The particle sorting apparatusaccording to the present embodiment is different from the particle sorting apparatusillustrated inin the configuration of the flow path P. As described above, in the present technology, the flow path P is not restricted to the flow path formed in the substrate T of two-dimensional or three-dimensional plastic, glass, or the like illustrated in, and a flow path as used in a conventional flow cytometer as illustrated incan also be used.

5 FIG. 13 13 13 In the case of the flow cell approach as illustrated in, the sheath liquid and the sample liquid are inserted into a conical container. The conical container is installed with its apex facing vertically downward, and a tube or the like for introducing the sheath liquid is connected to an upper side surface. An upper surface of the conical container is open, and a vibration element is attached in a sealed state with an O-ring. The sample liquid is inserted vertically from above the container. The conical container narrows at the lowermost portion, and its tip is coupled to a cuvette portion with a linear flow path Pformed inside. When a laminar flow is formed such that the sheath liquid surrounds the sample liquid in the conical container and the sample liquid travels to the cuvette portion as a laminar flow as it is, detection by light irradiation is performed in the linear flow path P. A detachable outlet nozzle is installed at the endpoint of the linear flow path P, and a connection portion has a sloped shape so as to be continuously narrowed from a cuvette outlet to the outlet nozzle.

8 FIG. 8 FIG. 1 2 5 FIGS.,, and 8 FIG. 100 111 112 11 121 122 123 12 100 13 14 15 16 123 is a schematic diagram illustrating a specific example of an optical system of the particle sorting apparatusaccording to the embodiment of the present technology.illustrates a configuration example of a part of the light sourcesand the light-guiding optical systemconstituting the irradiation unit, and the detection optical system, the EVS device, and the light detection unitconstituting the detection unitin the particle sorting apparatusaccording to the present embodiment. The sorting control unit, the processing unit, the sorting unit, and the analysis unit(not illustrated) may be partially or entirely similar to those described above with reference to. Note that, in, photodetectors of the light detection unitother than a forward scattered light detector are omitted.

100 13 112 13 The particle sorting apparatusaccording to the present embodiment includes seven light sources, and these light sources project light having wavelengths different from each other. The light projected from each light source is condensed at different positions in the linear flow path Pwithin the cuvette via the light-guiding optical systemsuch as a lens, a beam splitter, or a mirror. Then, the particles flowing in the linear flow path Pare irradiated with light to produce fluorescence and forward scattered light. The forward scattered light is incident on an objective lens, the forward scattered light condensed by the objective lens is separated by a half mirror, and one ray of the separated light is condensed by a condenser lens and formed as an image at different positions on the light-receiving surface of the EVS device. In addition, the other ray of the separated light is condensed by a condenser lens after the excitation light is removed by a light-shielding mask, a disturbance component is removed by a field stop (pinhole), an unnecessary light component is removed by a bandpass filter (BPF) that transmits only light of a specified wavelength, and the other ray of the separated light is detected by a forward scattered light (FSC) detector.

100 100 2 FIG. 6 7 FIGS.and Next, operation examples executed by the particle sorting apparatusaccording to the embodiment illustrated inwill be described.are flowcharts illustrating operation examples according to the present embodiment. Note that the execution of the operations described below may be controlled by a control unit (not illustrated) or the like that controls the particle sorting apparatus.

6 FIG. 122 101 102 11 111 103 123 101 103 As illustrated in, in this operation, first, the EVS deviceis activated (step S), delivery of a fluid containing particles (such as a biological sample as an example) to the flow path P is started (step S), and light output from the irradiation unitthat performs irradiation with light from the plurality of light sourcesis also started (step S: irradiation step). In addition, the light detection unitmay be activated at this timing. Note that the execution order of steps Sto Smay be switched.

104 122 105 14 Subsequently, when sorting is started (step S), the EVS devicedetects a luminance change in light emitted from the particles, as an event (step S: detection step), and inputs a result of the detection to the processing unit.

110 11 110 110 110 122 121 20 122 110 20 14 122 Here, the plurality of specified spotsin the flow path P is irradiated with light from the irradiation unit. Accordingly, when the particles contained in the fluid delivered to the flow path P pass through the plurality of spots, fluorescence, scattered light, or the like is emitted from each spot. These rays of light emitted from each spotis incident on the light-receiving surface of the EVS devicevia the detection optical system. Thus, each event pixelin the EVS devicedetects a luminance change due to an image of light emitted when each particle passes through each spot, as a positive event and a negative event. The event data detected for each event pixelis output to the processing unitfrom the EVS deviceat any time, that is, asynchronously.

14 122 20 Note that, since the event data including the polarity and the time stamp of the event that has occurred is output as a stream (event stream) to the processing unitfrom the EVS deviceonly for the event pixelin which an event has occurred, the data transfer amount can be significantly reduced as compared with the approach of outputting the light reception amounts of all the pixels.

14 20 122 106 20 Subsequently, the processing unitacquires the event stream for each particle on the basis of the event data for each event pixeloutput from the EVS device(step S). Note that the event stream of each particle may be a set of event streams for each event pixel.

14 107 14 108 14 123 Then, the processing unitdesignates each particle velocity on the basis of the event stream for each particle (step S). In addition, the processing unitcomputes the delay time according to each particle velocity and the liquid feeding distance (step S). In addition, at the same time as the computation of the delay time, the processing unitperforms sorting verification on the basis of the information regarding the particle acquired by the light detection unitand generates the sorting control signal including information regarding the presence or absence, magnitude, and the like of charging.

13 15 15 109 a Subsequently, the sorting control unitcontrols the charging unitin the sorting unitin accordance with these delay time and sorting control signal to carry out sorting (step S: sorting control step).

110 110 105 110 11 111 112 Thereafter, it is verified whether or not sorting is to be terminated (step S), and in a case where sorting is not to be terminated (NO in step S), the process goes back to step S, and the following operations are executed. On the other hand, in a case where sorting is to be terminated (YES in step S), the light output from the irradiation unitis stopped (step S), the delivery of the fluid containing the particles to the flow path P is also stopped (step S), and this operation is terminated.

106 106 6 FIG. 7 FIG. 7 FIG. 6 FIG. Next, the operation of acquiring the event stream described in step Sinwill be described in more detail with reference to.is a flowchart illustrating a more detailed operation example of an event stream acquisition operation indicated in step Sin.

7 FIG. 6 FIG. 6 FIG. 106 14 122 110 121 14 As illustrated in, in the event stream acquisition operation indicated in step Sin, first, the processing unitmonitors a sequence of event data (event stream) input from the EVS device, thereby determining whether or not a particle has arrived at the specified spotsin the flow path P (step S). Note that the monitoring of the event stream by the processing unitmay be regularly executed after the operation illustrated inis started.

121 14 122 122 122 When the particle arrives at the specified spots in the flow path P (YES in step S), the processing unitstarts collecting event data after the arrival of the particle, including event data indicating the arrival of the particle (step S). Note that all the event data input from the EVS devicemay be accumulated in a predetermined storage area separately from the collection of the event data in step S.

14 122 110 123 110 123 14 124 110 20 125 6 FIG. Thereafter, the processing unitmonitors a sequence of event data (event stream) input from the EVS device, thereby determining whether or not the particle has finished passing through the specified spotsin the flow path P (step S). Then, when the particle has finished passing through the specified spotsin the flow path P (YES in step S), the processing unitstops collecting the event data (step S) and generates an event stream for each particle having passed through the specified spotsin the flow path P, for each event pixel, from the collected event data (step S). Thereafter, the process returns to the operation illustrated in.

Note that the present technology can also adopt the following configurations.

[1]

an irradiation unit that includes a plurality of light sources and irradiates a particle contained in a fluid with light from the plurality of light sources; a detection unit that includes a plurality of pixels configured to detect, as an event, a luminance change in the light emitted from the particle due to irradiation of the light from each of the light sources; and a sorting control unit that controls sorting of the particle on the basis of event data detected by the detection unit.[2] A particle sorting apparatus including:

The particle sorting apparatus according to [1], in which the irradiation unit is configured to perform irradiation at different positions in a flow direction of the fluid with light from the plurality of light sources.

[3]

The particle sorting apparatus according to [1] or [2], in which the detection unit asynchronously detects the luminance change in the light, as the event.

[4]

The particle sorting apparatus according to any one of [1] to [3], in which the event data includes any one or more pieces of data from a group made up of position information on the pixels that detected the event, time information at which the event was detected, and polarity information on the event.

[5]

The particle sorting apparatus according to any one of [1] to [4], in which the event data includes position information on the pixels that detected the event and time information at which the event was detected.

[6]

The particle sorting apparatus according to [5], in which the position information on the pixels that detected the event is gated in advance.

[7]

The particle sorting apparatus according to any one of [1] to [6], further including a processing unit that designates the particle velocity on the basis of the event data.

[8]

the sorting unit includes a charging unit that charges the droplet, and the sorting control unit controls a charging timing by the charging unit on the basis of the particle velocity.[9] The particle sorting apparatus according to [7], further including a sorting unit that sorts a droplet containing the particle, in which

The particle sorting apparatus according to any one of [1] to [8], in which the light emitted from the particle includes fluorescence or scattered light.

[10]

The particle sorting apparatus according to [9], in which the scattered light includes forward scattered light.

[11]

The particle sorting apparatus according to any one of [1] to [10], in which, in a case where the plurality of light sources is made up of three or more light sources, the event is detected by irradiation with light based on two light sources farthest from each other in a flow direction of the fluid.

[12]

The particle sorting apparatus according to any one of [1] to [11], in which the particle includes a biologically relevant particle.

[13]

an irradiation step of including a plurality of light sources and irradiating a particle contained in a fluid with light from the plurality of light sources; a detection step of detecting, as an event, a luminance change in the light emitted from the particle due to irradiation of the light from each of the light sources; and a sorting control step of controlling sorting of the particle on the basis of event data detected in the detection step. A particle sorting method including:

100 Particle sorting apparatus 11 Irradiation unit 110 110 110 a g ,toSpot 111 Light source 112 Light-guiding optical system 12 Detection unit 121 Detection optical system 122 EVS device 123 Light detection unit 13 Sorting control unit 14 Processing unit 15 Sorting unit 15 a Charging unit 15 b Counter electrode 16 Analysis unit 20 Event pixel 201 Pixel array unit 202 X arbiter 203 Y arbiter 204 Event signal processing circuit 205 System control circuit 206 Output interface (I/F) P Flow path 11 PSample liquid flow path 12 12 a b P, PSheath liquid flow path 13 PMain flow path, linear flow path D Droplet containing particles BOP Break-off point