Information Generation Device and Camera Device

This application is the U.S. national stage application of International Patent Application No. PCT/KR2023/095086, filed Nov. 16, 2023, which claims the benefit under 35 U.S.C. § 119 of Korean Application Nos. 10-2022-0155406, filed Nov. 18, 2022; and 10-2022-0155407, filed Nov. 18, 2022; the disclosures of each of which are incorporated herein by reference in their entirety.

The embodiment relates to an information generation device and a camera device.

3D content is being applied in many fields such as those of games, culture, education, manufacturing, and autonomous driving, and a depth map is required to obtain the 3D content. The depth map represents information that represents distances in a space and represents perspective information on one point in a two-dimensional image with respect to another point thereof. Methods for obtaining a depth map include a method in which infrared (IR) structured light is projected onto an object, a method using a stereo camera, and a time of flight (ToF) method.

According to the TOF method, a distance to an object is calculated by measuring aToF, that is, a time taken during which light is emitted and then reflected back. The biggest advantage of the TOF method is that it is possible to quickly provide distance information on a three-dimensional space in real time. Additionally, users can obtain accurate distance information without having to apply separate algorithms or perform hardware revisions. It is also possible to obtain an accurate depth map even when subjects very close by or moving subjects are measured.

Meanwhile, in order to obtain a depth map, alight-emitting unit of a camera device generates an output light signal and irradiates an object with the output light signal, alight-receiving unit of the camera device receives an input light signal reflected from the object, and a depth map generation unit of the camera device generates a depth map of the object using the input light signal received by the light-receiving unit.

In this case, since accurate active alignment is required for simultaneous assembly of the light-emitting unit and the light-receiving unit, there are problems in that process efficiency is reduced, it is difficult to check performance or defects of individual modules, and the entire device needs to be replaced in the event of a malfunction.

In addition, in order to generate a three-dimensional color image, attempts are being related to a technology in which an RGB camera that acquires an RGB image and a depth camera that acquires a depth image are mounted together in a single device, such as a mobile device, and the RGB image acquired from the RGB camera matches the depth image acquired from the depth camera. The depth camera may include a light-emitting unit and a light-receiving unit. In order to obtain a depth map by a triangular method, a minimum baseline between the light-emitting unit and the light-receiving unit has to be ensured.

Accordingly, when an RGB camera and a depth camera are mounted together in one device, there is a problem in that a physical size of the device has to increase. Additionally, since a field of view (FOV) of a sensor of the RGB camera and an FOV of a sensor of the depth camera do not exactly coincide with each other, a separate calibration process is required to match the RGB image with the depth image.

The present invention is directed to providing an information generation device with improved assembly and process efficiency.

Further, the present invention is directed to providing a compact camera device capable of generating a three-dimensional color image.

The problem to be solved in the embodiment is not limited thereto, and it can be said that the purpose or effect that can be understood from the solution of the problem or embodiment described below is also included.

An information generation device according to an embodiment of the present invention includes a light-emitting unit configured to generate an output light signal and irradiate a target region with the output light signal, a light-receiving unit configured to receive an input light signal reflected by the target region, and a base including a first hole and a second hole spaced apart from each other, wherein the light-emitting unit includes a light source, a first holder disposed on the light source and disposed in the first hole of the base, and a first lens group disposed in the first holder, the light-receiving unit includes an image sensor, a second holder disposed on the image sensor and disposed in the second hole of the base, and a second lens group disposed in the second holder, the light-emitting unit further includes a third holder disposed on the first holder and a diffusion member disposed in the third holder, an upper edge of the second holder is seated on an upper surface of the base, and a lower edge of the third holder is seated on the upper surface of the base.

The light-emitting unit may further include a first substrate on which the light source is disposed and a first joining member disposed between the first substrate and a lower surface of the base to join the first substrate and the lower surface of the base, the light-receiving unit may further include a second substrate on which the image sensor is disposed and a second joining member disposed between the second substrate and the lower surface of the base to join the second substrate and the lower surface of the base, and the first substrate and the second substrate may be spaced apart from each other.

The first substrate and the second substrate may have a different height based on the upper surface of the base.

The lower surface of the base may include a first region having a first thickness based on the upper surface of the base and a second region having a second thickness different from the first thickness based on the upper surface of the base, and the first joining member may be disposed in the first region, and the second joining member is disposed in the second region.

A first opening that accommodates the light source may be formed in the first joining member, a second opening that accommodates the image sensor may be formed in the second joining member, and at least one of the first joining member and the second joining member may be in direct contact with the lower surface of the base.

The first joining member may include a first substrate fixing unit fixed to the first substrate, a first base fixing unit fixed to the lower surface of the base, and a first adhesive disposed between the first substrate fixing unit and the first base fixing unit.

The second joining member may include a second substrate fixing unit fixed to the second substrate, a second base fixing unit fixed to the lower surface of the base, and a second adhesive disposed between the second substrate fixing unit and the second base fixing unit.

The first joining member may be fastened to the first substrate and the lower surface of the base.

The second joining member may be fastened to the second substrate and the lower surface of the base.

The third holder may have screw threads provided to be coupled with the first holder via rotation.

The upper edge of the second holder and the upper surface of the base may be fastened by a fastening member.

The upper edge of the first holder is disposed on the upper surface of the base, and the upper edge of the first holder and the upper surface of the base may be adhered by a third adhesive.

A camera device according to another embodiment of the present invention includes a light source configured to output an output light signal, a light-receiving unit configured to receive an input light signal reflected by an object and then input, and an information generation unit configured to generate information on the object using the input light signal input into the light-receiving unit, wherein the light-receiving unit includes a beam splitter that separates the input light signal, a first sensor that receives light reflected by the beam splitter, and a second sensor that receives light transmitted through the beam splitter, an optical axis of the light source and an optical axis of the second sensor are parallel to each other, and an optical axis of the first sensor is perpendicular to the optical axis of the light source and the optical axis of the second sensor.

The camera device may further include a substrate, and the light source, the first sensor, and the second sensor may be sequentially disposed on the substrate in a first direction, and the first direction may be perpendicular to an optical axis of the light source.

The light source may be disposed in a first region on the substrate, the second sensor may be disposed in a second region on the substrate that is lower than the first region in a second direction perpendicular to the first direction and is parallel to the first region, the first sensor may be disposed in a third region on a substrate perpendicular to the first region and the second region between the first region and the second region, and the second direction may be parallel to an optical axis of the light source.

The third region may be a wall that connects the first region and the second region.

An incident surface of the beam splitter may be coated with an IR reflective material, an IR pass filter may be further disposed between the beam splitter and the first sensor, and an IR blocking filter may be further disposed between the beam splitter and the second sensor.

An incident surface of the beam splitter may be coated with an IR reflective material, an IR blocking filter may be further disposed between the beam splitter and the first sensor, and an IR pass filter may be further disposed between the beam splitter and the second sensor.

A FOV of the first sensor and a FOV of the second sensor may be the same and overlap each other.

The camera device may further include a lens group disposed between the object and the beam splitter and configured to collect an input light signal reflected and input from the object and then input the input light signal into the beam splitter.

The camera device may further include an optical path conversion member disposed between the lens group and the object.

One of the first sensor and the second sensor may be an RGB sensor that detects visible light, and the other of the first sensor and the second sensor may be an IR sensor that detects IR light.

The information generation unit may fuse an RGB image of (X, Y) coordinates received from the RGB sensor and a depth map of (X, Y, Z) coordinates received from the IR sensor.

The (X, Y) coordinates of the RGB image and the (X, Y) coordinates of the depth map may be the same.

According to an embodiment of the present invention, an information generation device with improved assembly and process efficiency can be obtained.

According to an embodiment of the present invention, an information generation device with easy Z-direction focusing and XY-axis alignment can be obtained.

According to an embodiment of the present invention, active alignment of a light-emitting unit and a light-receiving unit is easy.

According to an embodiment of the present invention, an information generation device in which replacement of parts due to defects or malfunctions in individual modules is also easily made possible can be obtained.

According to an embodiment of the present invention, a compact camera device capable of generating a three-dimensional color image can be obtained.

According to an embodiment of the present invention, a camera device can be obtained in which a calibration process for matching between an RGB image and a depth image is minimized.

The various advantageous and beneficial effects of the present invention are not limited to the above-described descriptions and will be more easily understood in the course of explaining specific embodiments of the present invention.

The present invention may have various modifications and embodiments, and specific embodiments are exemplified and described in the accompanying drawings. However, the specific embodiments are not intended to limit the present invention and should be understood to include all modifications, equivalents, or substitutes included in the spirit and technical scope of the present invention.

Terms that include ordinal numbers, such as second, first, or the like, may be used to describe various components, but the components are not limited by the terms. The terms are used solely to distinguish one component from another. For example, without departing from the scope of the present invention, a second component could be named a first component, and similarly, the first component could also be named the second component. The term and/or includes any combination of multiple related/described items or any one of the multiple/related described items.

When a component is “connected” or “coupled” to another component, it should be understood that the component may be directly connected or coupled to the other components, but that there may be other components therebetween. On the other hand, when it is said that a component is “directly connected” or “directly coupled” to another component, it should be understood that there are no other components therebetween.

The terminology used in this application is only used to describe specific embodiments and is not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, it should be understood that terms such as “include” and “have” are intended to specify the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but do not exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which this invention belongs. Terms defined in commonly used dictionaries should be interpreted as having meanings consistent with their meanings in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly defined otherwise in this application.

Hereinafter, embodiments will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or corresponding components are given the same reference numerals, and redundant descriptions thereof will be omitted.

1 FIG. 2 FIG. is a block diagram of an information generation device according to an embodiment of the present invention, andis a conceptual cross-sectional view of the information generation device according to the embodiment of the present invention.

1 2 FIGS.and 1000 100 200 300 400 Referring to, an information generation deviceaccording to the embodiment of the present invention includes a light-emitting unit, a light-receiving unit, an information generation unit, and a control unit.

100 1000 100 200 100 100 200 The light-emitting unitmay generate and output an output light signal in the form of a pulse wave or continuous wave. The continuous wave may be in the form of a sinusoid wave or square wave. By generating an output light signal in the form of a pulse wave or continuous wave, the information generation devicemay detect a time difference or phase difference between an output light signal output from the light-emitting unitand an input light signal reflected from an object and then input to the light-receiving unit. In this specification, output light may be light that is output from the light-emitting unitand is incident on an object, and input light may be light that is output from the light-emitting unit, reaches an object, is reflected from the object, and is then input into the light-receiving unit. In this specification, a pattern of the output light may be referred to as an emission pattern, and a pattern of the input light may be referred to as an incident pattern. From the point of view of the object, the output light may be incident light, and the input light may be reflected light.

100 110 120 110 130 120 110 110 110 110 110 110 110 110 The light-emitting unitmay include a light source, a lens groupdisposed on the light source, and a diffusion memberdisposed on the lens group. The light sourcegenerates and outputs light. The light generated by the light sourcemay be infrared light having a wavelength of 770 to 3000 nm. Alternatively, the light generated by the light sourcemay be visible light having a wavelength of 380 to 770 nm. The light sourcemay use a light emitting diode (LED) and have a form in which a plurality of LEDs are disposed in a certain pattern. In addition, the light sourcemay include an organic LED (OLED) or laser diode (LD). Alternatively, the light sourcemay be a vertical cavity surface emitting laser (VCSEL). The VCSEL is one type of laser diode that converts an electrical signal into a light signal and may output a light signal having a wavelength of about 800 to 1000 nm, such as about 850 nm or about 940 nm. When the light sourceis the VCSEL, the light sourcemay include a plurality of emitters disposed in an m*n matrix.

110 The light sourcegenerates an output light signal in the form of a pulse wave or continuous wave by repeatedly turning on and off at regular time intervals. The regular time interval may be a frequency of the output light signal.

120 110 120 110 110 110 110 120 120 120 110 130 110 120 130 110 120 120 110 2 FIG. The lens groupmay collect light output from the light sourceand output the collected light to the outside. The lens groupmay be disposed above the light sourceto be spaced apart from the light source. Here, the expression “above the light source” may mean the side from which light from the light sourceis output. The lens groupmay include at least one lens. When the lens groupincludes a plurality of lenses, the lenses may be arranged based on a central axis thereof to form an optical system. Here, the central axis may be the same as an optical axis of the optical system. As shown in, the lens groupmay include a plurality of lenses which are disposed on the light sourceand sequentially disposed in a direction from the diffusion membertoward the light source. For example, the lens groupmay include five lenses sequentially disposed in the direction from the diffusion membertoward the light source. In this specification, the lens groupmay be referred to as a collimator because the lens groupcollects and outputs light output from the light source.

130 110 120 The diffusion membermay receive light output from the light sourceand the lens groupand then output the received light by refracting or diffracting the light.

200 100 The light-receiving unitmay receive a light signal reflected from an object. In this case, the received light signal may be a light signal output by the light-emitting unitand reflected from the object.

200 210 220 210 230 220 230 230 210 220 230 210 220 210 220 220 220 220 210 210 210 210 110 210 The light-receiving unitmay include an image sensor, a filterdisposed on the image sensor, and a lens groupdisposed on the filter. The light signal reflected from the object may pass through the lens group. An optical axis of the lens groupmay be aligned with an optical axis of the image sensor. The filtermay be disposed between the lens groupand the image sensor. The filtermay be disposed on an optical path between the object and the image sensor. The filtermay filter light having a wavelength in a predetermined range. The filtermay transmit light in a specific wavelength band. The filtermay transmit light having a specific wavelength. For example, the filtermay transmit light in an infrared band and block light outside the infrared band. The image sensormay detect light. The image sensormay receive a light signal. The image sensormay detect the light signal and output the light signal as an electrical signal. The image sensormay detect light having a wavelength corresponding to a wavelength of light output by the light source. For example, the image sensormay detect light in the infrared band.

210 210 210 The image sensormay be formed with a structure in which a plurality of pixels are disposed in a grid shape. The image sensormay be a complementary metal oxide semiconductor (CMOS) image sensor or may be a charge coupled device (CCD) image sensor. Additionally, the image sensormay include a ToF sensor that receives IR light reflected from an object and measures a distance using a time difference or phase difference.

200 100 200 100 200 100 The light-receiving unitand the light-emitting unitcan be disposed side by side. The light-receiving unitmay be disposed beside the light-emitting unit. The light-receiving unitmay be disposed in the same direction as the light-emitting unit.

300 200 300 100 200 300 210 1000 300 1000 The information generation unitmay generate a depth map of an object using the input light signal input to the light-receiving unit. For example, the information generation unitmay calculate the depth map of the object using a ToF taken during which the output light signal output from the light-emitting unitis reflected from the object and then input into the light-receiving unit. For example, the information generation unitmay calculate a time difference between the output light signal and the input light signal using an electric signal received by the image sensorand calculate a distance between the object and the information generation deviceusing the calculated time difference. For example, the information generation unitmay calculate a phase difference between the output light signal and the input light signal using the electric signal received from the sensor and calculate the distance between the object and the information generation deviceusing the calculated phase difference.

400 100 200 300 300 400 300 400 400 1000 400 1000 1000 The control unitcontrols operations of the light-emitting unit, the light-receiving unit, and the information generation unit. The information generation unitand the control unitmay be implemented in the form of a printed circuit board (PCB). In addition, the information generation unitand the control unitmay be implemented in the form of other configurations. Alternatively, the control unitmay be included in a terminal or vehicle in which the information generation deviceaccording to the embodiment of the present invention is disposed. For example, the control unitmay be implemented in the form of an application processor (AP) of a smartphone equipped with an information generation deviceaccording to the embodiment of the present invention or may be implemented in the form of an electronic control unit (ECU) of a vehicle equipped with the information generation deviceaccording to the embodiment of the present invention.

1000 1000 The information generation deviceaccording to the embodiment of the present invention may be a solid state LiDAR. Unlike a mechanical LiDAR that rotates 360°, a fixed LiDAR does not include mechanical parts to rotate a LiDAR device, and thus the fixed LiDAR has an advantage of being inexpensive and being implemented in a compact form. The information generation deviceaccording to the embodiment of the present invention may be a fixed flash LiDAR. The fixed flash LiDAR uses an optical flash, and a single large-area laser pulse may illuminate a frontal environment.

3 FIG. 4 FIG. 5 FIG. 6 FIG. 7 FIG. 8 FIG. 9 9 FIGS.A andB is a perspective view of the information generation device according to the embodiment of the present invention,is an exploded perspective view of the information generation device according to the embodiment of the present invention,is a cross-sectional view of the information generation device according to the embodiment of the present invention,is a perspective view of a base included in the information generation device according to the embodiment of the present invention,is a perspective view of a first substrate, a second substrate, and a connection member included in the information generation device according to the embodiment of the present invention,is a cross-sectional view of a base, a first joining member, a second joining member, the first substrate, and the second substrate of the information generation device according to the embodiment of the present invention, andare exploded perspective views of the first joining member and the second joining member of the information generation device according to the embodiment of the present invention.

3 4 FIGS.and 1 2 FIGS.and 1 2 FIGS.and 1000 100 200 500 1000 300 400 100 200 300 400 Referring to, the information generation deviceaccording to the embodiment of the present invention includes the light-emitting unit, the light-receiving unit, and a base. As described with reference to, the information generation devicefurther includes the information generation unitand the control unit. Duplicate descriptions of the same descriptions as those provided with reference toregarding the light-emitting unit, the light-receiving unit, the information generation unit, and the control unitwill be omitted.

100 110 120 130 200 210 220 230 As described above, the light-emitting unitgenerates an output light signal and irradiates a target region with the output light signal and includes the light source, the lens group, and the diffusion member. As described above, the light-receiving unitreceives an input light signal that is reflected from the target region and then input, and includes the image sensor, the filter, and the lens group.

500 100 200 100 200 500 500 510 520 500 500 110 210 520 520 510 1 2 500 1 2 500 510 520 520 500 521 522 510 500 1 521 2 522 520 500 521 1 522 2 510 500 1 2 2 1 1 2 100 200 6 FIG. According to the embodiment of the present invention, the baseis coupled with the light-emitting unitand the light-receiving unit. The light-emitting unitand the light-receiving unitare coupled with one base. Referring to, the basehas an upper surfaceand a lower surface. In this specification, in terms of the both surfaces of the base, the surface of the basethat is disposed to face the light sourceand the image sensoris referred to as the lower surface, and the surface opposite to the lower surfaceis referred to as the upper surface. A first hole THand a second hole THare formed in the base. The first hole THand the second hole THare each formed to pass through the basefrom the upper surfaceto the lower surface. According to the embodiment of the present invention, the lower surfaceof the basehas a first regionand a second regionhaving different thicknesses based on the upper surfaceof the base, and the first hole THmay be formed in the first region, and the second hole THmay be formed in the second region. For example, the lower surfaceof the basemay have the first regionhaving a first thickness Tand the second regionhaving a second thickness Tbased on the upper surfaceof the base. It is illustrated that the first thickness Tis greater than the second thickness Tbut is not limited thereto. The second thickness Tmay be designed to be greater than the first thickness T. The first thickness Tand the second thickness Tmay be designed according to an effective focal length of the light-emitting unitand an effective focal length of the light-receiving unit.

100 140 120 140 110 1 500 120 140 140 1 500 140 120 1 500 More specifically, the light-emitting unitincludes a first holderthat accommodates the lens group. The first holderis disposed on the light sourceand is disposed to pass through the first hole THof the base, and the lens groupis disposed in the first holder. In this case, screw threads that interlock with each other may be formed on an outer circumferential surface of the first holderand an inner circumferential surface of the first hole THof the base. Thus, the first holderin which the lens groupis accommodated may be fitted into the first hole THof the basevia rotation, and in this process, Z-axis focusing and XY-axis active alignment may be easily performed.

200 240 230 240 210 2 500 230 240 The light-receiving unitincludes a second holderthat accommodates a lens group. The second holderis disposed on the image sensorand disposed to pass through the second hole THof the base, and the lens groupis disposed in the second holder.

140 120 100 1 240 230 200 2 500 100 200 500 100 200 In this way, when the first holderthat accommodates the lens groupof the light-emitting unitis disposed in the first hole THand the second holderthat accommodates the lens groupof the light-receiving unitis disposed in the second hole THformed in one base, the light-emitting unitand the light-receiving unitcan be assembled based on the base, and thus alignment and support of the light-emitting unitand the light-receiving unitare made easy.

140 240 500 In particular, according to the embodiment of the present invention, an upper edge of at least one of the first holderand the second holderis disposed to be seated on an upper surface of the base.

240 500 240 230 500 230 210 230 240 510 500 700 240 500 1000 According to the embodiment of the present invention, the second holderis disposed to be seated on the upper surface of the base. Thus, the second holderthat accommodates the lens groupis fixed based on the upper surface of the base, and active alignment between the lens groupand the image sensormay be accurately performed based on the fixed lens group. In this case, the upper edge of the second holderand the upper surfaceof the basemay be fastened by a fastening member. Accordingly, since the second holderand the baseare firmly fixed, durability of the information generation devicecan be improved even in an environment with vibration or shaking.

100 150 110 160 150 520 500 150 520 500 200 250 210 260 250 520 500 250 520 500 100 200 500 100 200 150 250 According to the embodiment of the present invention, the light-emitting unitfurther includes a first substrateon which the light sourceis disposed and a first joining memberdisposed between the first substrateand the lower surfaceof the baseto join the first substrateand the lower surfaceof the base. In addition, the light-receiving unitfurther includes a second substrateon which the image sensoris disposed and a second joining memberthat is disposed between the second substrateand the lower surfaceof the baseto join the second substrateand the lower surfaceof the base. Accordingly, since the light-emitting unitand the light-receiving unitmay be assembled based on the base, alignment and support of the light-emitting unitand the light-receiving unitare made easy. Here, each of the first substrateand the second substratemay be a flexible PCB (FPCB), a rigid-FPCB (RFPCB), or a rigid PCB (RPCB).

150 250 100 200 500 1 150 2 250 510 500 100 200 In this case, the first substrateand the second substratemay be disposed to be spaced apart from each other. Thus, the light-emitting unitand the light-receiving unitare assembled based on the base, and a distance Dof the first substrateand a distance Dof the second substratemay be adjusted in a different manner based on the upper surfaceof the baseaccording to the effective focal length of the light-emitting unitand the effective focal length of the light-receiving unit.

150 250 600 600 150 250 150 150 110 250 250 210 600 150 250 100 200 600 100 200 600 300 400 150 250 210 250 300 400 600 400 110 150 210 250 600 7 FIG. In this case, the first substrateand the second substratemay be connected to each other by a connection member. Referring to, the connection membermay be connected to a lower surface of the first substrateand a lower surface of the second substrate. Here, in terms of both surfaces of the first substrate, the lower surface may be a surface opposite to the surface of the first substrateon which the light sourceis disposed, and in terms of both surfaces of the second substrate, the lower surface may be a surface opposite to the surface of the second substrateon which the image sensoris disposed. The connection membermay support the first substrateand the second substratethat are spaced apart from each other. In addition, an electrical signal may be transmitted between the light-emitting unitand the light-receiving unitthrough the connection member, or an electrical signal may be transmitted between the light-emitting unitand the light-receiving unitand an external device through the connection member. For example, at least one of the information generation unitand the control unitaccording to the embodiment of the present invention may be implemented in the form of a chip disposed on at least one of the first substrateand the second substrate. The electrical signal of the image sensorat the second substratemay be transmitted to at least one of the information generation unit, the control unit, and the external device through the connection member. Additionally, a control signal of the control unitor the external device may be transmitted to the light sourceat the first substrateand the image sensorat the second substratethrough the connection member.

520 500 521 522 510 500 160 521 260 522 160 150 521 500 260 250 522 500 1 150 2 250 510 500 100 120 200 230 100 200 500 1 150 110 2 250 210 510 500 120 100 230 200 100 200 8 FIG. As described above, the lower surfaceof the basemay have the first regionand the second regionhaving different thicknesses based on the upper surfaceof the base. Referring to, the first joining memberis disposed in the first region, and the second joining memberis disposed in the second region. The first joining memberjoins the first substrateand the first regionof the base, and the second joining memberjoins the second substrateand the second regionof the base. Thus, the distance Dof the first substrateand the distance Dof the second substratebased on the upper surfaceof the basemay be different from each other. The effective focal length of the light-emitting unitmay vary according to a design of the lens group, and the effective focal length of the light-receiving unitmay vary according to a design of the lens group. As provided in the embodiment of the present invention, when the light-emitting unitand the light-receiving unitare coupled with one baseand the distance Dof the first substrateon which the light sourceis disposed and the distance Dof the second substrateon which the image sensoris disposed are disposed differently from each other based on the upper surfaceof the base, the degree of freedom in the design of the lens groupof the light-emitting unitand the design of the lens groupof the light-receiving unitmay be increased, and alignment between the light-emitting unitand the light-receiving unitis made easy.

8 9 FIGS.-B 1 110 160 2 210 260 160 260 520 500 160 520 500 160 520 500 520 160 500 700 150 110 160 520 500 110 120 110 260 520 500 260 520 500 520 260 500 700 250 210 260 520 500 210 230 210 Referring to, a first opening Rthat accommodates the light sourceis formed in the first joining member, and a second opening Rthat accommodates the image sensoris formed in the second joining member. In this case, at least one of the first joining memberand the second joining memberis in direct contact with the lower surfaceof the base. In the embodiment of the present invention, the first joining memberand the lower surfaceof the basemay be in direct contact with each other. Here, the term “direct contact” means that no other structure is disposed between the first joining memberand the lower surfaceof the base. To this end, the lower surfaceof the first joining memberand the baseare in direct contact with each other and may be fastened by the fastening member. Therefore, the first substrate, the light sourceand the first joining membercan be fixed based on the lower surfaceof the base, and active alignment between the light sourceand the lens groupmay be accurately performed based on the fixed light source. In the embodiment of the present invention, the second joining memberand the lower surfaceof the basemay be in direct contact with each other. Here, the term “direct contact” means that no other structure is disposed between the second joining memberand the lower surfaceof the base. To this end, the lower surfaceof the second joining memberand the baseare in direct contact with each other and may be fastened by the fastening member. Therefore, the second substrate, the image sensor, and the second joining membermay be fixed based on the lower surfaceof the base, and active alignment between the image sensorand the lens groupmay be accurately performed based on the fixed image sensor.

160 520 500 700 110 150 160 520 500 260 520 500 700 210 250 260 520 500 When the first joining memberis fastened to the lower surfaceof the basethrough the fastening member, even when a malfunction occurs in the light sourceor a chip on the first substrate, it is possible to replace only the malfunctioning part after releasing the fastening between the first joining memberand the lower surfaceof the base. Likewise, when the second joining memberis fastened to the lower surfaceof the basethrough the fastening member, even when a malfunction occurs in the image sensoror a chip on the second substrate, it is possible to replace only the malfunctioning part after releasing the fastening between the second joining memberand the lower surfaceof the base.

160 161 150 162 520 500 163 161 162 150 500 260 261 250 262 520 500 263 261 262 250 500 240 230 510 500 262 520 500 200 250 210 263 In this case, the first joining membermay include a first substrate fixing unitfixed to the first substrate, a first base fixing unitfixed to the lower surfaceof the base, and a first adhesivedisposed between the first substrate fixing unitand the first base fixing unit. Thus, assembly between the first substrateand the baseis made easy. Similarly, the second joining membermay include a second substrate fixing unitfixed to the second substrate, a second base fixing unitfixed to the lower surfaceof the base, and a second adhesivedisposed between the second substrate fixing unitand the second base fixing unit. Thus, the assembly between the second substrateand the baseis made easy. In particular, when the second holderthat accommodates the lens groupis fixed to the upper surfaceof the base, in a state in which the second base fixing unitis fastened to the lower surfaceof the base, active alignment of the light-receiving unitmay be performed by shifting and tilting the second substrateon which the image sensoris disposed using the second adhesive.

100 130 130 120 130 110 120 130 110 130 110 130 170 170 500 170 140 170 140 140 170 170 140 130 110 120 130 170 140 As described above, the light-emitting unitincludes the diffusion member. The diffusion memberis disposed on the lens group, and the diffusion membermay receive light output from the light sourceand the lens groupand then may refract or diffract the received light to output the light. The diffusion membermay be a diffractive optical element (DOE) that replicates an output pattern output from the light source. Alternatively, the diffusion membermay be a diffuser that diffuses the output pattern output from the light source. According to the embodiment of the present invention, the diffusion membermay be disposed in the third holder, and a lower edge of the third holderis seated on the upper surface of the base. The third holdermay be disposed in the first holder. An outer circumferential surface of the third holdermay be disposed on an inner circumferential surface of the first holder. To this end, screw threads that interlock with each other may be formed on the inner circumferential surface of the first holderand the outer circumferential surface of the third holder. Therefore, the outer circumferential surface of the third holdermay be coupled with the inner circumferential surface of the first holdervia rotation. Thus, the assembly of the diffusion memberis made easy. In particular, accurate active alignment of the light source, the lens group, and the diffusion membermay be performed in the process in which the third holderis coupled with the inner circumferential surface of the first holdervia rotation.

10 10 FIGS.A-F show an example of an assembly process of the information generation device according to the embodiment of the present invention.

10 FIG.A 240 230 510 500 240 510 500 700 240 510 500 500 240 230 1000 Referring to, the upper edge of the second holderthat accommodates the lens groupis seated on the upper surfaceof the base. In this case, the upper edge of the second holderand the upper surfaceof the basemay be fastened by the fastening member. Thus, the second holdermay be fixed based on the upper surfaceof the base, and since the baseand the second holderthat accommodates the lens groupare firmly fixed, the durability of the information generation devicecan be improved even in an environment with vibration or shaking.

10 FIG.B 262 260 522 520 500 Referring to, the second base fixing unitof the second joining memberis fastened to the second regionon the lower surfaceof the base.

10 FIG.C 250 210 250 261 250 210 250 263 261 261 262 210 230 250 210 263 261 262 263 250 210 Referring to, in a state in which the second substrate, the image sensordisposed on the second substrate, and the second substrate fixing unitdisposed on the second substrateto surround the image sensorand fixed to the second substrateare assembled in advance, the second adhesiveis applied to the upper surface of the second substrate fixing unit, and then the second substrate fixing unitis adhered to the lower surface of the second base fixing unit. During the adhering process, active alignment between the image sensorand the lens groupmay be formed by shifting and tilting the second substrateon which the image sensoris disposed. As shown in the drawing, since the second adhesiveis disposed between the second substrate fixing unitand the second base fixing unit, the second adhesivemay not be exposed to the outside. Here, fine focus adjustment (for example, fine tuning) may be performed through a process of shifting and tilting the second substrateon which the image sensoris disposed.

10 FIG.D 150 110 150 160 110 150 150 521 520 500 160 521 520 500 700 150 110 160 520 500 160 161 162 163 160 150 520 500 150 110 160 521 520 500 162 521 520 500 150 110 161 162 163 Referring to, the first substrate, the light sourcedisposed on the first substrate, and the first joining memberdisposed to surround the light sourceon the first substrateand fixed to the first substrateare fixed to the first regionon the lower surfaceof the base. In this case, the first joining membermay be fixed to the first regionon the lower surfaceof the basethrough the fastening member. Thus, the first substrate, the light source, and the first joining membermay be fixed based on the lower surfaceof the base. Here, the first joining memberis illustrated as including the first substrate fixing unit, the first base fixing unit, and the first adhesive, but is not limited thereto. The first joining membermay be designed so that one member is fixed to the first substrateand the lower surfaceof the base. That is, according to one embodiment of the present invention, the pre-assembled first substrate, light source, and first joining membermay be fixed to the first regionon the lower surfaceof the base. According to another embodiment of the present invention, the first base fixing unitmay first be fixed to the first regionon the lower surfaceof the base, and then the pre-assembled first substrate, light source, and first substrate fixing unitmay be adhered to the first base fixing unitusing the first adhesive.

10 FIG.E 140 120 1 1 510 500 140 1 140 1 140 140 120 140 510 500 140 510 500 140 510 500 140 1 140 140 510 500 110 120 140 120 140 Referring to, the first holderthat accommodates the lens groupmay be disposed within the first hole THto pass through the first hole THfrom the upper surfaceof the base. In this case, screw threads that interlock with each other are formed on an outer circumferential surface of the first holderand an inner circumferential surface of the first hole TH, and the first holdermay be fixed to the first hole THby rotating the first holder. Therefore, Z-axis focusing and XY-axis active alignment may be performed by rotation of the first holderthat accommodates the lens group. Alternatively, an upper surface edge of the first holdermay be seated on the upper surfaceof the base. In this case, instead of the upper surface edge of the first holderbeing in direct contact with the upper surfaceof the base, a third adhesive (not shown) may be disposed between the upper surface edge of the first holderand the upper surfaceof the base. In the process in which the first holderis fixed to the first hole THby rotating the first holderor the upper edge of the first holderand the upper surfaceof the baseare adhered to each other by the third adhesive (not shown), active alignment between the light sourceand the lens groupmay be performed, and focusing may be achieved by shifting or tilting the first holderin which the lens groupis accommodated. Here, fine focus adjustment (for example, fine tuning) may be performed through the process of shifting and tilting the first holder.

10 FIG.F 170 130 140 140 170 170 140 170 140 110 120 130 Referring to, a third holderin which the diffusion memberis disposed is disposed in the first holder. In this case, screw threads that are interlocked with each other may be formed on an inner circumferential surface of the first holderand an outer circumferential surface of the third holder, and the outer circumferential surface of the third holdermay be coupled with the inner circumferential surface of the first holdervia rotation. In the process in which the third holderis coupled with the inner circumferential surface of the first holdervia rotation, accurate active alignment of the light source, the lens group, and the diffusion membermay be performed.

240 230 510 500 200 250 210 260 150 110 160 520 500 100 140 120 In this way, according to one embodiment of the present invention, first, the second holderthat accommodates the lens groupis fixed based on the upper surfaceof the base, and then the active alignment of the light-receiving unitmay be performed by shifting or tilting the second substrate, the image sensor, and the second joining member, and the first substrate, the light source, and the first joining memberare first fixed based on the lower surfaceof the base, and then the active alignment of the light-emitting unitmay be performed by shifting or tilting the first holderthat accommodates the lens group.

140 120 510 500 150 110 160 250 210 260 500 200 240 230 According to another embodiment of the present invention, first, the first holderthat accommodates the lens groupis fixed based on the upper surfaceof the base, and then active alignment of the light-emitting unit may be performed by shifting or tilting the first substrate, the light source, and the first joining member, and first, the second substrate, the image sensor, and the second joining memberare fixed based on the lower surface of the base, and then active alignment of the light-receiving unitmay be performed by shifting or tilting the second holderthat accommodates the lens group.

140 120 240 230 510 500 150 110 160 200 250 210 260 According to still another embodiment of the present invention, first, the first holderthat accommodates the lens groupand the second holderthat accommodates the lens groupare fixed based on the upper surfaceof the base, and then active alignment of the light-emitting unit may be performed by shifting or tilting the first substrate, the light source, and the first joining member, and active alignment of the light-receiving unitmay also be performed by shifting or tilting the second substrate, the image sensor, and the second joining member.

150 110 160 520 500 250 210 260 100 140 120 200 240 230 According to yet another embodiment of the present invention, the first substrate, the light source, and the first joining memberare first fixed based on the lower surfaceof the base, the second substrate, the image sensorand the second joining memberare first fixed, and then active alignment of the light-emitting unitmay be performed by shifting or tilting the first holderthat accommodates the lens group, and active alignment of the light-receiving unitmay be performed by shifting or tilting the second holderthat accommodates the lens group.

100 200 510 520 500 100 200 In this way, when the light-emitting unitand the light-receiving unitare assembled based on the upper surfaceand the lower surfaceof the base, active alignment may be easily and accurately performed, and when a malfunction occurs in some parts of the light-emitting unitor some parts of the light-receiving unit, only the parts that have malfunctioned may be replaced.

11 FIG. is a perspective view of a vehicle to which the information generation device according to the embodiment of the present invention is applied.

11 FIG. 1000 For example,is an exterior view of a vehicle equipped with a vehicle driving assistance device to which the information generation deviceaccording to the embodiment is applied.

11 FIG. 700 13 13 Referring to, a vehicleof the embodiment may be equipped with wheelsFL andFR that rotate by a power source, and a predetermined sensor. The sensor may be a camera sensor but is not limited thereto.

1000 700 2000 The camera may be a camera sensor to which the information generation deviceaccording to the embodiment is applied. The vehicleof the embodiment may obtain image information through a camera sensorthat captures a forward image or surrounding image and may use the image information to determine a lane non-identification situation and create a virtual lane when the lane is not identified.

700 For example, the camera sensor may capture a forward image of the vehicleto obtain a forward image, and a processor (not shown) may analyze an object included in the forward image to obtain image information.

For example, when images of objects such as lane lines, nearby vehicles, driving obstructions, and indirect road markings such as central dividers, curbs, and street trees are captured in the image captured by the camera sensor, the processor may detect these objects and include the objects in the image information. In this case, the processor may obtain distance information from the objects detected by the camera sensor to further supplement the image information.

The image information may be information on an object in the captured image. The camera sensor may include an image sensor and an image processing module.

The camera sensor may process still images or moving images obtained by an image sensor (for example, a CMOS or CCD sensor).

The image processing module may process still images or moving images acquired by the image sensor, extract necessary information, and transmit the extracted information to the processor.

700 In this case, the camera sensor may include a stereo camera to improve measurement accuracy related to an object and secure more information such as a distance between the vehicleand the object but is not limited thereto.

The camera device according to the embodiment of the present invention may be a device that acquires an RGB image and a depth image and matches the RGB image with the depth image to acquire a three-dimensional color image. For convenience of explanation, description will focus on using a ToF principle to obtain a depth image but is not limited thereto. The camera device according to the embodiment of the present invention may obtain the depth image not only using the ToF principle, but also using a frequency modulation continuous wave (FMCW) principle or a structured light principle.

12 FIG. is a perspective view of a mobile terminal to which the information generation device according to the embodiment of the present invention is applied.

12 FIG. 1500 1000 1530 1510 As shown in, the mobile terminalof the embodiment may include the information generation device, a flash module, and an autofocus deviceprovided on a rear surface thereof.

1000 1000 The information generation devicemay include an image capturing function and an autofocus function. For example, the information generation devicemay include the autofocus function using an image.

1000 The information generation deviceprocesses image frames of still images or moving images obtained by the image sensor in an image capturing mode or video call mode.

The processed image frames may be displayed on a predetermined display unit or stored in a memory. A camera (not shown) may also be disposed on a front surface of a mobile terminal body.

1000 For example, the information generation devicemay include a first camera module and a second camera module and may be capable of implementing OIS together with an AF function by the first camera module.

1530 1530 The flash modulemay include a light-emitting element that emits light. The flash modulemay be operated by a camera operation of the mobile terminal or by a user's control.

1510 The autofocus devicemay include one among a package of surface-emitting laser devices as the light-emitting unit.

1510 1510 1000 The autofocus devicemay include an autofocus function using a laser. The autofocus devicemay be mainly used in conditions in which the autofocus function using the image of the information generation deviceis degraded, such as at a close range of equal to or less than 10 m or in a dark environment.

1510 The autofocus devicemay include a light-emitting unit including a VCSEL semiconductor device and a light-receiving unit such as a photodiode that converts light energy into electrical energy.

13 FIG. is an example of a block diagram of the camera device.

13 FIG. 1 10 20 30 40 Referring to, the camera deviceincludes a depth camera, an RGB camera, an information generation unit, and a control unit.

10 The depth cameramay be, for example, a ToF camera. The ToF camera calculates a distance to an object by measuring a ToF, that is, a time taken during which light is emitted and then reflected back.

20 The RGB cameramay be a general camera capable of capturing a two-dimensional RGB image.

10 20 The depth cameraand the RGB cameramay be disposed within one device to capture an image of the same region.

30 10 20 10 20 Additionally, the information generation unitis connected to the depth cameraand the RGB cameraand may obtain a three-dimensional color image by fusing a depth image obtained from the depth cameraand an RGB image obtained from the RGB camera.

40 10 20 30 The control unitcontrols overall operations of the depth camera, the RGB camera, and the information generation unit.

30 40 10 20 1 10 20 30 40 10 20 Here, the information generation unitand the control unitare shown as being disposed adjacent to the depth cameraand the RGB camerawithin the camera device, but are not limited thereto, and may be disposed remotely from the depth cameraand the RGB camera. Alternatively, some functions of the information generation unitand the control unitmay be included in the depth cameraand the RGB camera.

10 12 14 12 12 1 12 2 12 1 Here, the depth cameraincludes a light-emitting unitand a light-receiving unit. The light-emitting unitmay include a light source-that generates and outputs an output light signal and a lens group-disposed on the light source-.

14 14 1 14 2 14 1 14 3 14 2 The light-receiving unitmay include a depth sensor unit-, an IR pass filter-disposed on the depth sensor unit-, and a lens group-disposed on the IR pass filter-.

20 22 24 22 26 24 The RGB cameraincludes an RGB sensor unit, an IR blocking filterdisposed on the RGB sensor unit, and a lens groupdisposed on the IR blocking filter.

12 14 10 20 12 14 10 10 20 1 In this case, the light-emitting unitand light-receiving unitof the depth cameraand the RGB cameramay both be disposed side by side to face an object. In order to measure a depth using a triangular method, a baseline of a predetermined distance is required between the light-emitting unitand the light-receiving unitof the depth camera. In addition, due to structural issues, the depth cameraand the RGB cameraneed to be spaced by a certain distance or more. Thus, a length of the camera devicemay increase.

According to the embodiment of the present invention, it is intended that a compact camera device capable of generating a three-dimensional color image be obtained by changing an internal structure of the camera device.

14 FIG. 15 FIG. is a block diagram of the camera device according to the embodiment of the present invention, andis a cross-sectional view of the camera device according to the embodiment of the present invention.

14 15 FIGS.and 2000 2100 2200 2300 2400 Referring to, a camera deviceaccording to the embodiment of the present invention includes a light-emitting unit, a light-receiving unit, an information generation unit, and a control unit.

2100 2000 2100 2200 2100 2100 2200 The light-emitting unitmay generate and output an output light signal in the form of a pulse wave or continuous wave. The continuous wave may be in the form of a sinusoid wave or square wave. By generating the output light signal in the form of a pulse wave or continuous wave, the camera devicemay detect a time difference or phase difference between the output light signal output from the light-emitting unitand an input light signal reflected from an object and then input into the light-receiving unit. In this specification, output light may be light that is output from the light-emitting unitand is incident on an object, and input light may be light that is output from the light-emitting unit, reaches an object, is reflected from the object, and is input into the light-receiving unit. In this specification, a pattern of the output light may be referred to as an emission pattern, and a pattern of the input light may be referred to as an incident pattern. From the point of view of the object, the output light may be incident light, and the input light may be reflected light.

2100 2110 2120 2110 2130 2120 2110 2110 2110 2110 2110 2110 2110 2110 The light-emitting unitmay include a light source, a lens groupdisposed on the light source, and a diffusion memberdisposed on the lens group. The light sourcegenerates and outputs light. The light generated by the light sourcemay be infrared rays. For example, the light generated by the light sourcemay be infrared rays having a wavelength of 770 to 3000 nm. The light sourcemay use an LED and have a form in which a plurality of LEDs are disposed in a certain pattern. In addition, the light sourcemay include an OLED or LD. Alternatively, the light sourcemay be a VCSEL. The VCSEL is a laser diode that converts an electrical signal into a light signal and may output a light signal having a wavelength of about 800 to 1000 nm, for example, about 850 nm or about 940 nm. When the light sourceis the VCSEL, the light sourcemay include a plurality of emitters disposed in an m*n matrix.

2110 The light sourcegenerates an output light signal in the form of a pulse wave or continuous wave by repeatedly turning on and off at regular time intervals. The regular time interval may be a frequency of the output light signal.

2120 2110 2120 2110 2110 2110 2110 2120 2120 2120 2110 2130 2110 2120 2130 2110 2120 2120 2110 The lens groupmay collect light output from the light sourceand output the collected light to the outside. The lens groupmay be disposed above the light sourceto be spaced apart from the light source. Here, the expression “above the light sourcemay mean the side from which light from the light sourceis output. The lens groupmay include at least one lens. When the lens groupincludes a plurality of lenses, each of the lenses may be arranged based on a central axis thereof to form an optical system. Here, the central axis may be identical to an optical axis of the optical system. The lens groupmay include a plurality of lenses disposed on the light sourceand sequentially disposed in a direction from the diffusion membertoward the light source. For example, the lens groupmay include five lenses sequentially disposed in a direction from the diffusion membertoward the light source. In this specification, the lens groupmay be referred to as a collimator because the lens groupcollects and outputs light output from the light source.

2130 2110 2120 The diffusion membermay receive light output from the light sourceand the lens groupand then output the received light by refracting or diffracting the light.

2200 2200 2210 2220 2210 2220 2210 2110 2220 2210 2220 2210 2220 The light-receiving unitreceives a light signal reflected from an object and generates an electrical signal using the received light signal. The light-receiving unitincludes a first sensorand a second sensor. The first sensormay be a depth sensor that detects IR light, and the second sensormay be an RGB sensor that detects visible light. The light signal received by the first sensormay be a light signal output from the light sourceand then reflected from the object. The light signal received by the second sensormay be a light signal reflected from the object. Each of the first sensorand the second sensormay have a structure in which a plurality of pixels are disposed in a grid shape. The first sensormay be a ToF sensor that receives IR light reflected from the object and measures a distance using a time difference or phase difference. The second sensormay be an RGB sensor and be a CMOS image sensor or CCD image sensor.

2300 2210 2300 2110 2210 2300 2210 2000 2300 2000 2300 2220 2300 The information generation unitmay generate a depth image using the input light signal input into the first sensor. For example, the information generation unitmay calculate a depth map of an object using a flight time taken during which an output light signal output from the light sourceis reflected from the object and then input into the first sensor. For example, the information generation unitmay calculate a time difference between the output light signal and the input light signal using the electric signal received by the first sensorand calculate a distance between the object and the camera deviceusing the calculated time difference. For example, the information generation unitmay calculate a phase difference between the output light signal and the input light signal using the electric signal received from the sensor and calculate the distance between the object and the camera deviceusing the calculated phase difference. The information generation unitmay generate an RGB image using the input light signal input into the second sensor. The RGB image can be a two-dimensional image. The information generation unitgenerates a three-dimensional color image by fusing the depth image and the RGB image.

2400 2100 2200 2300 2300 2400 2300 2400 2400 2000 2400 2000 2000 The control unitcontrols operations of the light-emitting unit, the light-receiving unit, and the information generation unit. The information generation unitand the control unitmay be implemented in the form of a PCB. Additionally, the information generation unitand the control unitmay be implemented in the form of other configurations. Alternatively, the control unitmay be included in a mobile terminal, an electronic device, a vision device, or a vehicle in which the camera deviceaccording to the embodiment of the present invention is disposed. For example, the control unitmay be implemented in the form of an AP of a smartphone equipped with the camera deviceaccording to the embodiment of the present invention or may be implemented in the form of an ECU of a vehicle equipped with the camera deviceaccording to the embodiment of the present invention.

2000 2210 2220 2200 According to one embodiment of the present invention, the camera deviceis intended to be implemented in a compact form by utilizing the arrangement of the first sensorand the second sensorincluded in the light-receiving unit.

14 15 FIGS.and 2200 2210 2220 2230 2240 2200 2240 2240 2230 2230 2240 2230 Referring to, the light-receiving unitincludes the first sensorand the second sensordescribed above and further includes a beam splitterand a lens group. The input light signal reflected from an object and incident on the light-receiving unitis collected by the lens group, and the input light signal collected by the lens groupis separated by the beam splitter. The beam splitterreflects some of the light that is reflected from the object and then collected by the lens groupand transmits the remaining light. To this end, the beam splittermay include a semi-transparent reflective surface.

2240 2230 2240 In this case, the lens groupis disposed between the object and the beam splitter, and the input light signal collected by the lens groupincludes both IR light (I) and visible light (R, G, B).

2110 2220 2210 2110 2220 2230 2210 2220 2210 2220 2210 2220 2230 2210 2220 2230 2210 2230 2220 2210 2220 2210 2220 2210 2230 2220 According to the embodiment of the present invention, an optical axis of the light sourceand an optical axis of the second sensorare disposed parallel to each other, and an optical axis of the first sensoris disposed perpendicular to the optical axis of the light sourceand the optical axis of the second sensor. Additionally, an incident surface of the beam splitteris disposed between the first sensorand the second sensorto be inclined with respect to the first sensorand the second sensor. For example, the optical axis of the first sensorand the optical axis of the second sensormay be disposed perpendicular to each other, but the incident surface of the beam splittermay be disposed to form a 45° angle with respect to the optical axis of the first sensorand a 45° angle with respect to the optical axis of the second sensor. Thus, light reflected by the incident surface of the beam splitteris received by the first sensor, and light transmitted through the incident surface of the beam splitteris received by the second sensor. That is, the number of optical path conversions of the input light signal received by the first sensorafter being reflected from the object may be different from the number of optical path conversions of the input light signal received by the second sensorafter being reflected from the object. For example, the number of optical path conversions of the input light signal received by the first sensorafter being reflected from the object may be greater than the number of optical path conversions of the input light signal received by the second sensorafter being reflected from the object. For example, the optical path of the input light signal received by the first sensorafter being reflected from the object may be converted once at the incident surface of the beam splitter, but the optical path of the input light signal received by the second sensorafter being reflected from the object may be converted zero times.

2210 2220 2230 2212 2230 2210 2222 2230 2220 2230 2210 2230 2220 As described above, according to one embodiment of the present invention, the first sensoris a depth sensor and the second sensoris an RGB sensor. To this end, the incident surface of the beam splittermay be coated with an IR reflective material, a first filterdisposed between the beam splitterand the first sensormay be an IR pass filter, and a second filterdisposed between the beam splitterand the second sensormay be an IR blocking filter. Thus, IR light reflected by the incident surface of the beam splittermay be received by the first sensorand used to generate a depth image, and visible light transmitted through the incident surface of the beam splittermay be received by the second sensorand used to generate an RGB image.

15 FIG. 2110 2210 2220 2500 2110 2210 2110 2510 2500 2220 2520 2500 2210 2530 2500 2520 2530 2510 2520 2510 2520 2510 2110 2530 2510 2520 2510 2520 2530 2510 2520 2510 2210 2210 2530 2500 2210 More specifically, referring to, the light source, the first sensor, and the second sensorare sequentially disposed on a substratein a first direction. In this case, the first direction may be a direction perpendicular to the optical axis of the light source. The first direction may be a direction parallel to the optical axis of the first sensor. According to the embodiment of the present invention, the light sourcemay be disposed in a first regionon the substrate, the second sensormay be disposed in a second regionon the substrate, and the first sensormay be disposed in a third regionon the substrate. Here, the second regionand the third regionmay be disposed in the first direction with respect to the first region. A height of the second regionis smaller than that of the first region, and the second regionmay be a plane parallel to the first region. Here, the height may be a height in a direction parallel to the optical axis of the light source. The third regionis disposed between the first regionand the second regionto be perpendicular to the first regionand the second region. For example, the third regionmay be a wall surface that connects the first regionand the second region. In this case, a height of the third regionin the second direction may be greater than a width of the first sensor. In this way, when the first sensoris disposed in the third region, a length of the substratein the first direction may be reduced due to the width of the first sensor, and thus it is possible to obtain a camera device that can be implemented with a smaller size while generating a three-dimensional color image.

2210 2220 2240 Meanwhile, according to the embodiment of the present invention, since the first sensorwhich is the depth sensor and the second sensorwhich is the RGB sensor share the lens group, the camera device may be implemented with a smaller size than a camera device in which the lens group near the depth sensor and the lens group near the RGB sensor have to be disposed separately.

2240 2240 2210 2220 In this case, the lens groupmay include a plurality of lenses, and the optical axis of the lens groupmay be aligned with the optical axis of the first sensorand the optical axis of the second sensor.

2240 2210 2220 2240 2210 2220 In this case, a diameter of an effective region on an object-side surface of the lens closest to an object among the plurality of lenses included in the lens groupmay be larger than a diameter of an effective area of an image-side surface of the lens closest to at least one of the first sensorand the second sensoramong the plurality of lenses included in the lens group. Thus, an amount of light of the input light signal that reaches at least one of the first sensorand the second sensorafter being reflected by the object may be maximized.

2240 2230 2230 2230 2240 2230 For example, the lens groupmay include three to five lenses disposed sequentially from the object to the beam splitter. The object-side surface of the lens disposed closest to the object may be convex toward the object side, the image-side surface of the lens disposed closest to the beam splittermay be convex toward the image side, and the diameter of the effective region on the object-side of the lens disposed closest to the object may be larger than the diameter of the effective region on the image-side of the lens disposed closest to the beam splitter. Thus, the lens groupmay correct a chromatic aberration of the incident light after being reflected from the object and efficiently collect the light and cause the collected light to be incident on the semi-transparent reflective surface of the beam splitter.

2210 2220 2240 2000 As provided in the embodiment of the present invention, when the first sensorand the second sensorshare the lens group, active alignment between the lens group near the depth sensor and the lens group near the RGB sensor may be omitted, and thus a manufacturing process can be simplified, and the durability and reliability of the camera devicecan be increased.

2210 2220 2210 2220 2210 2220 2220 2210 According to the embodiment of the present invention, a field of view (FoV) of the first sensor, which is a depth sensor, and a FoV of the second sensorare the same and may overlap each other. Here, the expression “the FoV of the first sensorand the FoV of the second sensorare the same and overlap each other” may mean that 90% or more, preferably 95% or more, and more preferably 97% or more of the FoV of the first sensoroverlaps the FoV of the second sensoror may mean that 90% or more, preferably 95% or more, and more preferably 97% or more of the FoV of the second sensoroverlaps the FoV of the first sensor.

2210 2220 Accordingly, pixel coordinates of the first sensorand pixel coordinates of the second sensormay be synchronized.

16 FIG.A 16 FIG.B 16 FIG.C 16 FIG.D is a conceptual diagram showing the camera device according to the embodiment of the present invention that captures a three-dimensional color image,is a depth image acquired by the first sensor of the camera device according to the embodiment of the present invention,is an RGB image acquired by the second sensor of the camera device according to the embodiment of the present invention, andis a composite image of the depth image acquired by the first sensor and the RGB image acquired by the second sensor of the camera device according to the embodiment of the present invention.

16 FIG.A 2210 2220 2200 2000 2240 2210 2220 2210 2220 Referring to, since the first sensorand the second sensorin the light-receiving unitof the camera deviceshare the lens group, the FoV of the first sensorand the FoV of the second sensorare the same and overlap each other. That is, a vertical FoVFoVV and a horizontal FoVFoVH of the first sensorare identical to a vertical FoVFoVV and a horizontal FoVFoVH of the second sensor, respectively.

16 FIG.B 2210 2000 Referring to, the depth image acquired by the first sensorrefers to a 3D point cloud of (X, Y, Z) coordinates. Here, an X value and a Y value represent two-dimensional coordinate values, and a Z value may represent a distance between the object and the camera device, that is, a depth of the object.

16 FIG.C 2220 Referring to, the RGB image acquired by the second sensoris a two-dimensional color image of (X, Y) coordinates.

16 FIG.D 2300 2210 2220 Referring to, the information generation unitfuses the 3D point cloud of (X, Y, Z) coordinates received from the first sensorand the RGB image of (X, Y) coordinates received from the second sensorto color the 3D point cloud with a color of the RGB image.

16 FIG.A 2210 2220 2210 2220 2210 2220 As described with reference to, since the FoV of the first sensorand the FoV of the second sensorare the same and overlap each other, the (X, Y) coordinates of the RGB image and the (X, Y) coordinates of the 3D point cloud are the same. In this way, since there is no error between the first sensorwhich is the depth sensor and the second sensorwhich is the RGB sensor, an operation for extrinsic calibration between the depth image of the first sensorand the RGB image of the second sensormay be minimized.

2210 2220 In the above description, the example in which the first sensoris the depth sensor and the second sensoris the RGB sensor is described, but the present invention is not limited thereto.

2210 2220 2230 2212 2230 2210 2222 2230 2220 2230 2210 2230 2220 According to another embodiment of the present invention, the first sensormay be the RGB sensor, and the second sensormay be the depth sensor. To this end, the incident surface of the beam splitteris coated with an IR-transmitting material or visible light reflecting material, the first filterdisposed between the beam splitterand the first sensoris an IR blocking filter, and the second filterdisposed between the beam splitterand the second sensormay be an IR pass filter. Accordingly, visible light reflected by the incident surface of the beam splitteris received by the first sensorand may be used to generate the RGB image, and IR light transmitted through the incident surface of the beam splitteris received by the second sensorand may be used to generate the depth image.

17 FIG. is a cross-sectional view of a camera device according to another embodiment of the present invention.

17 FIG. 15 FIG. 14 16 FIGS.toD 2600 2100 2200 2000 Referring to, an optical path conversion membermay be further disposed between the light-emitting unitand the light-receiving unitof the camera deviceaccording toand a target surface. Other configurations are identical to those described using, so redundant descriptions thereof will be omitted.

2100 2600 2200 2600 Thus, light output from the light-emitting unitmay be incident on the target surface after the optical path thereof is converted by the optical path conversion member. Similarly, light reflected by the target surface may be incident on the light-receiving unitafter the optical path thereof is converted by the optical path conversion member.

2600 2100 2200 2000 2230 As provided in another embodiment of the present invention, when the optical path conversion memberis further disposed between the light-emitting unitand the light-receiving unitof the camera deviceand the target surface, a space constraint issue that arises due to a length of the entire body being increased by the beam splittermay be minimized.

Although the above matters have been described with reference to embodiments, these embodiments are merely examples and do not limit the present invention. Those skilled in the art will appreciate that various modifications and applications not exemplified above are made possible without departing from the essential characteristics of the present invention. For example, each component specifically shown in the embodiments may be modified and implemented. The differences related to such modifications and applications should be interpreted as being included in the scope of the present invention as defined in the appended claims.