Electronic equipment includes a processor, and a memory storing a program which, when executed by the processor, causes the electronic equipment to acquire a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having parallax with respect to the first image are arranged side by side, apply predetermined processing to a target range included in the third image, and, wherein each of the first image and the second image is a circular region, set a rectangular region circumscribed around a circular region of the first image or a circular region of the second image as a movable region in which the target range included in the third image is movable.
Legal claims defining the scope of protection, as filed with the USPTO.
a processor; and a memory storing a program which, when executed by the processor, causes the electronic equipment to: acquire a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having parallax with respect to the first image are arranged side by side; apply predetermined processing to a target range included in the third image; and set so that a region of the first image or a region of the second image is included inside a movable region in which the target range included in the third image is movable. . Electronic equipment comprising:
claim 1 perform control in such a way as to display an item indicating the target range on the third image; and perform control in such a way as to move and display the item within the movable region according to a user operation, wherein the predetermined processing is applied to a target range included in the third image and corresponding to a position at which the item is displayed. . The electronic equipment according to, wherein the program when executed by the processor further causes the electronic equipment to:
claim 2 perform control in such a way as to display, on a screen, the first image and the second image side by side in such a manner that the first image is located left and the second image is located right; and perform control in such a way as not to change a position of the item even if, after a position of the item arrives at a right end of the movable region of the first image, a user operation for further movement in a rightward direction is received, and in such a way as not to change a position of the item even if, after a position of the item arrives at a left end of the movable region of the second image, a user operation for further movement in a leftward direction is received. . The electronic equipment according to, wherein the program when executed by the processor further causes the electronic equipment to:
claim 2 discriminate a lens unit mounted on the electronic equipment; and perform control in such a way as to display the item within the movable region in a case where the discriminated lens unit includes the first optical system and the second optical system, and in such a way as to display the item within a fourth image acquired by being captured via the lens unit in a case where the mounted lens unit does not include the first optical system and the second optical system. . The electronic equipment according to, wherein the program when executed by the processor further causes the electronic equipment to:
claim 1 . The electronic equipment according to, wherein the predetermined processing is performed according to a user operation.
claim 1 . The electronic equipment according to, wherein the predetermined processing is enlargement display processing.
claim 1 acquire optical system information about the first optical system and the second optical system; and calculate respective center positions and radii of the circular region of the first image and the circular region of the second image based on the optical system information. . The electronic equipment according to, wherein the program when executed by the processor further causes the electronic equipment to:
claim 1 . The electronic equipment according to, wherein whole of either the first image or the second image is included inside in the movable region.
claim 8 . The electronic equipment according to, wherein only the entirety of either the first image or the second image is included inside in the moveable region.
claim 1 . The electronic equipment according to, wherein the moveable region is set so that the target range cannot be set to include only an area not including the first image area or the second image area.
a processor; and a memory storing a program which, when executed by the processor, causes the electronic equipment to: acquire a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having parallax with respect to the first image are arranged side by side; apply predetermined processing to a target range included in the third image; and set the moveable region so that the target range cannot be set to include only an area not including the first image area or the second image area. . Electronic equipment comprising:
acquiring a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having parallax with respect to the first image are arranged side by side; applying predetermined processing to a target range included in the third image; and setting so that a region of the first image or a region of the second image is included inside a movable region in which the target range included in the third image is movable. . A method comprising:
claim 12 performing control in such a way as to display an item indicating the target range on the third image; and performing control in such a way as to move and display the item within the movable region according to a user operation, wherein the predetermined processing is applied to a target range included in the third image and corresponding to a position at which the item is displayed. . The method according to, further comprising:
claim 13 performing control in such a way as to display, on a screen, the first image and the second image side by side in such a manner that the first image is located left and the second image is located right; and performing control in such a way as not to change a position of the item even if, after a position of the item arrives at a right end of the movable region of the first image, a user operation for further movement in a rightward direction is received, and in such a way as not to change a position of the item even if, after a position of the item arrives at a left end of the movable region of the second image, a user operation for further movement in a leftward direction is received. . The method according to, further comprising:
claim 12 . The method according to, wherein the predetermined processing is performed according to a user operation.
claim 12 . The method according to, wherein the predetermined processing is enlargement display processing.
claim 12 acquiring optical system information about the first optical system and the second optical system; and calculating respective center positions and radii of the circular region of the first image and the circular region of the second image based on the optical system information. . The method according to, further comprising:
acquiring a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having parallax with respect to the first image are arranged side by side; applying predetermined processing to a target range included in the third image; and setting so that a region of the first image or a region of the second image is included inside a movable region in which the target range included in the third image is movable. . A non-transitory computer-readable storage medium storing a program which, when executed by a processor, causes the processor to perform a method, the method comprising:
Complete technical specification and implementation details from the patent document.
This application is a Continuation of co-pending U.S. patent application Ser. No. 17/824,500 filed May 25, 2022, which claims priority benefit of Japanese Application No. 2021-091347 filed May 31, 2021, all of which are hereby incorporated by reference herein in their entireties.
Aspects of the embodiments generally relate to electronic equipment, a control method therefor, and a storage medium.
Recently, there has been known a digital camera including two lens optical systems. If two optical systems are arranged to enable image capturing in the same direction, the digital camera is able to generate, from two images having parallax acquired via the respective two optical systems, an image obtained by image capturing of a range of 180 degrees (a hemispherical image) or an image available for stereoscopic view. If two optical systems are arranged to enable image capturing in opposite directions, the digital camera is able to generate, from two images acquired via the respective two optical systems, an image obtained by image capturing of a range of 360 degrees (a full spherical image). In a case where a fisheye lens is used to perform image capturing of a wide angle of view, a circular image is acquired.
In the case of capturing two images having parallax by such a digital camera including two optical systems, the user performs image capturing while checking two live view images. With regard to an ordinary camera including a single optical system, the user is allowed to enlarge a single displayed live view image and check the enlarged live view in a minute manner.
Japanese Patent Application Laid-Open No. 2020-108114 discusses that two live view images acquired via two optical systems can be displayed on a single screen. Then, in response to the user performing a pinch-out operation (enlargement instruction) in any one of display regions for the two live view images, the displayed live view is enlarged.
However, with regard to the enlargement instruction discussed in Japanese Patent Application Laid-Open No. 2020-108114, the user is not able to recognize in advance which region is to be enlarged in response to the enlargement instruction. Moreover, in a case where an image is displayed in a circular form on a rectangular screen and only a region other than the image is enlarged for display, even when viewing the enlarged image, the user may be unable to recognize which region of the original image has been enlarged.
According to an aspect of the embodiments, electronic equipment includes a processor, and a memory storing a program which, when executed by the processor, causes the electronic equipment to acquire a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having parallax with respect to the first image are arranged side by side, apply predetermined processing to a target range included in the third image, and, wherein each of the first image and the second image is a circular region, set a rectangular region circumscribed around a circular region of the first image or a circular region of the second image as a movable region in which the target range included in the third image is movable.
Further features of the disclosure will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
Various exemplary embodiments, features, and aspects of the disclosure will be described in detail below with reference to the drawings. In the following exemplary embodiments, a case where electronic equipment is a digital camera (imaging apparatus) is described as an example.
100 100 100 78 70 a The digital cameraaccording to the present exemplary embodiment is able to acquire a dual-lens image in which a left image and a right image having predetermined parallax in the left-right direction are arranged side by side as a single image and display the acquired dual-lens image on a display unit. Moreover, the digital camerais able to apply predetermined image processing to a target range included in an image displayed on the display unit. The predetermined image processing is, for example, enlargement processing, and, in the following description, a case where the predetermined image processing is enlargement processing is described in detail. The digital cameradisplays, on the display unit, an enlarged image obtained by enlarging the target range according to an enlargement instruction. Furthermore, the predetermined image processing is not limited to enlargement processing. For example, the predetermined image processing can be processing for detecting, for example, a luminance distribution or chromaticity distribution in the target range to generate a histogram or a waveform monitor, or can be processing for applying filter processing, such as contrast enhancement processing, to the target range. While, in the present exemplary embodiment, the enlargement instruction is assumed to be issued in response to a pressing operation on an enlargement button, which is a pressable physical member, the enlargement instruction can be issued in response to a pinch-out operation on a touch paneland a cancellation instruction for enlargement displaying can be issued in response to a pinch-in operation thereon.
100 100 100 The digital cameraaccording to the present exemplary embodiment displays an item indicating the target range in a dual-lens image in conformity with the dual-lens image. The item is, for example, a frame-like indicator indicating the target range or a semi-transparent color image which is combined with the target range. The digital camerais able to change a display position of the item (i.e., a target range indicated by the item) according to a user operation. When displaying a dual-lens image, the digital cameradisplays the item at a position which does not span both a left image and a right image. Thus, the target range is set in such a way as not to include both a left image and a right image. In other words, the target range is set in such a way as to include only one of a left image and a right image.
100 Even when a user operation for changing a display position of the item (position of the target range) has been performed, the digital cameracontrols displaying of the item in such a manner that a target range indicated by the item does not span both a left image and a right image.
1 1 FIGS.A andB 1 FIG.A 1 1 FIGS.A andB 100 100 1 100 28 100 70 28 43 100 100 28 100 100 28 54 100 a are appearance diagrams of the digital camera, which serves as an example of electronic equipment to which the present exemplary embodiment is applicable.is a front surface perspective view of the digital camera, and FIG.B is a back surface perspective view of the digital camera. Referring to, a display unitis a display unit mounted on the back surface of the digital camera, which displays an image and various pieces of information. A touch panelis a touch detection unit capable of detecting a touch operation on the display surface (operation surface) of the display unit. An extra-viewfinder display unitis a display unit mounted on the top surface of the digital camera, which displays various setting values for the digital camera, such as a shutter speed and an aperture value. The display unitmay be built into the digital cameraor detachably attached to the digital camera. Also, the display unitmay be an external device connected to a communication unitof the digital camera.
61 60 40 100 71 70 71 72 100 2 FIG. A shutter buttonis an operation unit which is usable to issue an image capturing instruction. A mode selection switchis an operation unit which is usable to switch between various modes. A terminal coveris a cover which protects connectors (not illustrated) of, for example, a connection cable which interconnects an external device and the digital camera. A main electronic dialis a rotational operation member included in an operation unit(), so that the main electronic dialcan be rotated by the user to perform, for example, changing of setting values such as a shutter speed and an aperture value. A power switchis an operation member which is usable to switch between turning-on and turning-off of the power source of the digital camera.
73 70 74 70 74 75 70 76 A sub-electronic dialis a rotational operation member included in the operation unit, which is usable to perform, for example, movement of a selection frame or image feeding. Arrow keys, which are included in the operation unit, are arrow keys (four-way keys) in which upper, lower, left, and right arrow portions thereof are able to be pressed. An operation corresponding to a pressed arrow portion of the arrow keysis able to be performed. A SET buttonis a push button included in the operation unit, which is mainly used to, for example, determine a selection item. A moving image buttonis usable to issue instructions for starting and stopping moving image capturing (recording).
78 70 71 78 79 70 79 100 28 200 The enlargement buttonis an operation button included in the operation unit, which is usable to perform turning-on and turning off of an enlargement mode in live view display of the image capturing mode. The user is allowed to enlarge or reduce a live view (LV) image by turning on the enlargement mode and then operating the main electronic dial. In the playback mode, the enlargement buttonfunctions as an enlargement button which is usable to enlarge a played-back image and increase an enlargement factor. A playback button, which is included in the operation unit, is an operation button used to switch between the image capturing mode and the playback mode. When the playback buttonis pressed during the image capturing mode, the digital cameratransitions to the playback mode, thus causing the display unitto display the latest image out of images recorded on a recording medium.
81 70 81 28 28 74 75 A menu buttonis included in the operation unit, and, when the menu buttonis pressed, a menu screen which is available for various settings is displayed on the display unit. The user is allowed to intuitively perform various settings with use of the menu screen displayed on the display unit, the arrow keys, and the SET button.
82 82 83 28 29 83 A multi-controlleris tiltable in 360 degree directions to be used for issuing instructions for eight-way keys, such as up, down, left, and right keys. Moreover, the multi-controlleris pushable to be used for activating an allocated function. A display mode switching buttonis an operation member usable to switch between a plurality of different display modes regarding information, such as a live view image or image capturing information display, which is displayed on the display unitor an electronic viewfinder (EVF). Each time the user presses the display mode switching button, switching between display modes is performed, so that the user is able to visually recognize information about an image which is being captured or being played back in the display mode desired by the user.
10 100 100 A communication terminal groupis a communication terminal group via which the digital cameraperforms communication with a lens unit (attachable to and detachable from the digital camera).
16 29 16 57 16 202 200 90 100 61 71 61 71 100 90 73 73 An eyepiece unitis an eyepiece portion of an eyepiece viewfinder (a looking-into-type viewfinder), so that the user is able to visually recognize a video image displayed on the internal EVFvia the eyepiece unit. An eye access detection unitis an eye access detection sensor which detects whether the user is accessing the eyepiece unit. A lidis the lid of a slot which contains the recording medium. A grip portionis a holding portion configured to be in a shape able to be easily gripped by the right hand of the user when the user holds the digital camera. The shutter buttonand the main electronic dialare located at positions where the shutter buttonand the main electronic dialare able to be operated with the index finger of the right hand in a state in which the user holds the digital cameraby gripping the grip portionwith the little finger, ring finger, and middle finger of the right hand. Moreover, the sub-electronic dialis located at a position where the sub-electronic dialis able to be operated with the thumb of the right hand in the same state.
2 FIG. 2 FIG. 2 FIG. 100 150 103 6 150 100 10 100 150 150 50 6 10 4 150 1 2 103 3 50 150 100 6 10 is a block diagram illustrating a configuration example of the digital cameraaccording to the present exemplary embodiment. In, the lens unitis a lens unit in which an interchangeable image capturing lens is mounted. A lensis usually composed of a plurality of lens elements, but, in, is illustrated simply as a single lens element. A communication terminal groupis a communication terminal group used for the lens unitto perform communication with the digital camera, and the communication terminal groupis a communication terminal group used for the digital camerato perform communication with the lens unit. The lens unitperforms communication with a system control unitvia the communication terminal groupsand, and causes a lens system control circuit, which is included in the lens unit, to perform control of a diaphragmvia a diaphragm drive circuitand to vary the position of the lensvia an autofocus (AF) drive circuit, thus adjusting focus. Moreover, the system control unitdiscriminates the type of the lens unitmounted on the digital cameravia the communication terminal groupsand.
101 22 50 A shutteris a focal plane shutter capable of freely controlling the exposure time of the imaging unitunder the control of the system control unit.
22 22 50 23 23 22 The imaging unitis an image sensor configured with, for example, a charge-coupled device (CCD) sensor or a complementary metal-oxide semiconductor (CMOS) sensor, which converts an optical image into an electrical signal. The imaging unitcan include an imaging plane phase-difference sensor which outputs defocus amount information to the system control unit. An analog-to-digital (A/D) converterconverts an analog signal into a digital signal. The A/D converteris used to convert an analog signal output from the imaging unitinto a digital signal.
24 23 15 24 50 24 24 An image processing unitperforms predetermined pixel interpolation, resizing processing such as reduction, and color conversion processing on the data output from the A/D converteror data output from a memory control unit. Moreover, the image processing unitperforms predetermined calculation processing using the captured image data. The system control unitperforms exposure control and distance measurement control based on a calculation result obtained by the image processing unit. With this, autofocus (AF) processing of the through-the-lens (TTL) type, automatic exposure (AE) processing, and electronic flash (EF) (flash preliminary light emission) processing are performed. The image processing unitfurther performs predetermined calculation processing using the captured image data, and performs automatic white balance (AWB) processing of the TTL type based on the obtained calculation result.
23 32 24 15 15 24 32 22 23 28 29 32 Data output from the A/D converteris then written in the memoryvia the image processing unitand the memory control unitor directly via the memory control unitwithout via the image processing unit. The memorystores image data acquired by the imaging unitand converted into digital data by the A/D converteror image data that is to be displayed on the display unitand the EVF. The memoryhas a storage capacity sufficient to store a predetermined number of still images or a moving image and sound taken for a predetermined time.
32 19 32 28 29 32 28 29 19 28 29 19 28 29 19 23 32 Moreover, the memoryalso serves as a memory for image display (video memory). A digital-to-analog (D/A) converterconverts data for image display stored in the memoryinto an analog signal and supplies the analog signal to the display unitand the EVF. In this way, image data for display written in the memoryis displayed by the display unitand the EVFvia the D/A converter. Each of the display unitand the EVFperforms displaying corresponding to an analog signal output from the D/A converteron a display device such as a liquid crystal display (LCD) or an organic electroluminescent (EL) display. Sequentially transferring to and displaying on the display unitor the EVFa signal obtained by the D/A converterperforming digital-to-analog conversion of the data analog-to-digital converted by the A/D converterand stored in the memoryenables performing live view display (LV display). Hereinafter, an image which is displayed in live view is referred to as a “live view image (LV image)”.
43 44 Various camera setting values, including a shutter speed and an aperture value, are displayed on the extra-viewfinder display unitvia an extra-viewfinder display unit drive circuit.
56 50 56 A non-volatile memoryis an electrically erasable and recordable memory, for which, for example, an electrically erasable programmable read-only memory (EEPROM) is used. For example, constants and a program for operations of the system control unitare stored in the non-volatile memory. The program as used here is a computer program (computer-executable instructions) which is executed to implement various flowcharts described below in the present exemplary embodiment.
50 100 50 56 52 50 56 50 32 19 28 The system control unitis a control unit composed of at least one processor or circuit, and controls the entire digital camera. The system control unitimplements various processing operations described below in the present exemplary embodiment by executing the above-mentioned program recorded on the above-mentioned non-volatile memory. A system memoryincludes, for example, a random access memory (RAM), on which, for example, constants and variables for operations of the system control unitand a program read out from the non-volatile memoryare loaded. Moreover, the system control unitalso performs display control by controlling, for example, the memory, the D/A converter, and the display unit.
53 A system timeris a timer unit which measures times for use in various control operations and time in a built-in clock.
70 50 The operation unitis an operation unit which is operable to input various operation instructions to the system control unit.
60 70 50 60 50 60 The mode selection switch, which is included in the operation unit, switches an operation mode of the system control unitto any one of, for example, a still image capturing mode, a moving image capturing mode, and a playback mode. Modes included in the still image capturing mode include an automatic image capturing mode, an automatic scene discrimination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program automatic exposure (AE) mode (P mode). Moreover, the modes included in the still image capturing mode further include, for example, various scene modes in which image capturing settings for the respective image capturing scenes are performed and a custom mode. The mode selection switchis used to directly switch the operation mode of the system control unitto any one of these modes. Alternatively, after switching to displaying of a list screen for image capturing modes is once performed by the mode selection switch, another operation member can also be used to perform switching to any one of a plurality of image capturing modes displayed in the list screen. Likewise, a plurality of modes can also be included in the moving image capturing mode.
62 61 100 1 1 The first shutter switchis configured to be turned on in response to a halfway operation, in other words, a half-pressed state, of the shutter buttonof the digital camera(an image capturing preparation instruction), thus generating a first shutter switch signal SW. In response to the first shutter switch signal SW, image capturing preparation operations, such as autofocus (AF) processing, automatic exposure (AE) processing, automatic white balance (AWB) processing, and flash preliminary emission (EF) processing, are started.
64 61 2 2 50 22 200 The second shutter switchis configured to be turned on in response to a complete operation, in other words, a fully-pressed state, of the shutter button(an image capturing instruction), thus generating a second shutter switch signal SW. In response to the second shutter switch signal SW, the system control unitstarts a series of image capturing processing operations starting with a signal readout operation from the imaging unitand leading to a writing operation for the captured image data as an image file to the recording medium.
70 70 61 71 72 73 74 75 76 77 78 79 81 82 70 2 FIG. The operation unitincludes various operation members serving as input units which receive operations from the user. The operation unitincludes at least the following operation members. The operation members include the shutter button, the main electronic dial, the power switch, the sub-electronic dial, the arrow keys, the SET button, the moving image button, an AF lock button, the enlargement button, the playback button, the menu button, and the multi-controller. The operation unitfurther includes various operation members which are not particularly illustrated in the block diagram of.
80 80 50 200 30 A power source control unitis configured with, for example, a battery detection circuit, a direct current (DC)-DC converter, and a switch circuit for switching blocks to be energized, and detects the presence or absence of attachment of a battery, the type of a battery, and the remaining amount of battery power. Moreover, the power source control unitcontrols the DC-DC converter based on a result of such detection and an instruction from the system control unit, and supplies required voltages to various portions, including the recording medium, for respective required periods. A power source unitincludes, for example, a primary battery, such as an alkaline battery or a lithium battery, a secondary battery, such as a nickel-cadmium (NiCd) battery, a nickel-metal hydride (NiMH) battery, or a lithium (Li) battery, or an alternating current (AC) adapter.
18 200 200 A recording medium interface (I/F)is an interface with the recording medium, such as a memory card or a hard disk. The recording mediumis a recording medium, such as a memory card, which is used to record the captured image, and is configured with, for example, a semiconductor memory or a magnetic disc.
54 54 54 54 22 200 The communication unitconnects to an external device or a network via wireless or via a wired cable, and performs transmission and reception of, for example, a video signal and an audio signal. The communication unitis also able to connect to a wireless local area network (LAN) or the Internet. Moreover, the communication unitis also able to connect to an external device via Bluetooth® or Bluetooth® Low Energy. The communication unitis able to transmit an image (including a live view (LV) image) captured by the imaging unitand an image recorded on the recording medium, and is also able to receive an image or various other pieces of information from an external device.
55 100 22 100 100 55 50 55 22 55 55 100 An orientation detection unitdetects the orientation of the digital camerawith respect to the direction of gravitational force. Whether an image captured by the imaging unitis an image captured with the digital cameraheld in a landscape orientation or an image captured with the digital cameraheld in a portrait orientation can be discriminated based on the orientation detected by the orientation detection unit. The system control unitis able to append orientation information corresponding to the orientation detected by the orientation detection unitto an image file of the image captured by the imaging unitor to perform recording with an image rotated. The orientation detection unitto be used includes, for example, an acceleration sensor and a gyroscope sensor. The acceleration sensor or gyroscope sensor serving as the orientation detection unitis also able to be used to detect motions of the digital camera(for example, panning, tilting, lifting, and remaining still or not).
57 16 50 28 29 57 100 50 28 28 29 50 29 29 28 The eye access detection unitis an eye access detection sensor which detects the access (eye access) and the departure (eye departure) of the eye of the user (an object) with respect to the eyepiece unit(i.e., performs access detection). The system control unitswitches between displaying (display state) and non-displaying (non-display state) of each of the display unitand the EVFaccording to the state detected by the eye access detection unit. More specifically, in a case where the digital camerais at least in an image capturing waiting state and the switching setting for a display destination is automatic switching setting, during non-eye access, the system control unitsets the display unitas the display destination, thus turning on displaying of the display unitand setting the EVFto non-displaying. Moreover, during eye access, the system control unitsets the EVFas the display destination, thus turning on displaying of the EVFand setting the display unitto non-displaying.
57 16 29 16 57 57 57 16 57 16 The eye access detection unitcan be configured with, for example, an infrared proximity sensor, and is able to detect the access of an object of some kind to the eyepiece unitof the viewfinder having the EVFincorporated therein. In a case where an object has accessed the eyepiece unit, infrared light projected from a light projection portion (not illustrated) of the eye access detection unitis reflected from the object and is then received by a light receiving portion (not illustrated) of the eye access detection unit. The eye access detection unitis also able to discriminate up to which distance to the eyepiece unitthe object has come close (eye access distance), based on the amount of the received infrared light. In this way, the eye access detection unitperforms eye access detection for detecting the access distance of the object to the eyepiece unit.
16 57 16 57 57 57 57 In a case where, starting with the non-eye access state (non-access state), an object which comes close to the eyepiece unitwithin a predetermined distance has been detected, the eye access detection unitis assumed to detect that eye access has been performed. In a case where, starting with the eye access state (access state), an object the access of which has been detected departs from the eyepiece unitby a predetermined distance or more, the eye access detection unitis assumed to detect that eye departure has been performed. A threshold value used for detecting eye access and a threshold value used for detecting eye departure can be made different from each other by providing, for example, a hysteresis. Moreover, after detecting eye access, the eye access detection unitis assumed to detect that the eye access state continues until detecting eye departure. After detecting eye departure, the eye access detection unitis assumed to detect that the non-eye access state continues until detecting eye access. Furthermore, the infrared proximity sensor is merely an example, and the eye access detection unitcan be configured with another type of sensor as long as it is able to detect the access of the eye or object which is able to be deemed as eye access.
70 28 70 28 28 70 28 28 50 70 a a a a 70 70 a a the state in which a finger or pen, which has not been touching the touch panel, has newly touched the touch panel, in other words, starting of a touch (hereinafter referred to as “touch-down”); 70 a the state in which a finger or pen is touching the touch panel(hereinafter referred to as “touch-on”); 70 a the state in which a finger or pen is moving while touching the touch panel(hereinafter referred to as “touch-move”); 70 70 a a the state in which a finger or pen, which has been touching the touch panel, has been separated from the touch panel, in other words, ending of a touch (hereinafter referred to as “touch-up”); and 70 a the state in which none is touching the touch panel(hereinafter referred to as “touch-off”). The touch paneland the display unitcan be configured in an integrated manner. For example, the touch panelis configured to have such a light transmittance as not to hinder displaying performed by the display unit, and is attached to the upper layer of a display surface of the display unit. Then, the input coordinates in the touch panelare associated with the display coordinates on a display screen of the display unit. With this, a graphical user interface (GUI) can be configured as if the user were able to directly operate a screen displayed on the display unit. The system control unitis able to detect the following operations performed on the touch panelor states thereof:
70 a When touch-down is detected, touch-on is also detected at the same time. After touch-down, unless touch-up is detected, touch-on normally continues being detected. Touch-move is also detected in the state in which touch-on is detected. Even if touch-on is detected, unless the touch position is not moving, touch-move is not detected. After touch-up of all of the fingers or pen touching the touch panelis detected, touch-off is detected.
70 50 50 70 a a Information on these operations or states and the coordinates of a position at which a finger or pen is touching the touch panelis communicated to the system control unitvia an internal bus, and then, the system control unitdetermines how an operation (touch operation) has been performed on the touch panelbased on the communicated information.
50 70 70 a a With regard to touch-move, the system control unitis able to also detect the direction of movement of a finger or pen moving on the touch panelfor each of a vertical component and a horizontal component on the touch panelbased on a change of the position coordinates.
50 70 70 70 70 50 a a a a When it is detected that touch-move has been performed a predetermined distance or more, the system control unitis assumed to determine that a slide operation has been performed. An operation of quickly moving the finger a certain degree of distance while keeping the finger touching the touch paneland then directly separating the finger from the touch panelis referred to as “flick”. In other words, the flick is an operation of quickly tracing the surface of the touch panelas if flicking the touch panelwith the finger. When touch-move performed a predetermined distance or more at a predetermined speed or higher is detected and touch-up is then detected, the system control unitdetermines that flick has been performed (determines that flick has been performed subsequent to a slide operation).
70 a Additionally, a touch operation of concurrently touching a plurality of positions (for example, two points) and then moving the touch positions closer to each other is referred to as “pinch-in”, and a touch operation of moving the touch positions away from each other is referred to as “pinch-out”. Pinch-out and pinch-in are collectively referred to as a “pinch operation” (or simply as “pinch”). The touch panelcan be any type of touch panel selected from among touch panels of various types including, for example, the resistance film type, the capacitance type, the surface acoustic wave type, the infrared ray type, the electromagnetic induction type, the image recognition type, and the optical sensor type. Among these types, there are a type which detects that touch has been performed based on contact with the touch panel and a type which detects that touch has been performed based on access of a finger or pen to the touch panel, but any one of the two types can be employed.
3 FIG. 3 FIG. 3 FIG. 2 FIG. 300 300 100 100 is a schematic diagram illustrating an example of a configuration of a lens unit.illustrates a state in which the lens unithas been mounted on the digital camera. Furthermore, in the digital cameraillustrated in, the same constituent elements as the respective constituent elements illustrated inare assigned the respective same reference characters and are omitted from description here.
300 100 300 300 300 The lens unitis a type of interchangeable lens which is detachably attachable to the digital camera. The lens unitis a dual lens capable of being used for acquiring optical images having parallax between a left image and a right image. The lens unitincludes two optical systems (image capturing lenses), each of which has a wide field of view of 180 degrees and is capable of being used to perform image capturing of a front hemispheric range. Specifically, each of two optical systems of the lens unitis capable of inputting an optical image of subjects included in a field of view portion of 180 degrees in the left-right direction (horizontal angle, azimuth angle, or yaw angle) and 180 degrees in the up-down direction (vertical angle, elevation or depression angle, or pitch angle).
300 301 301 303 301 301 302 302 301 301 301 301 22 301 301 22 22 The lens unitincludes a right eye optical systemR, which includes, for example, a plurality of lenses and reflecting mirrors, a left eye optical systemL, which includes, for example, a plurality of lenses and reflecting mirrors, and a lens system control circuit. The right eye optical systemR corresponds to an example of a first optical system, and the left eye optical systemL corresponds to an example of a second optical system. Respective lensesR andL included in the right eye optical systemR and the left eye optical systemL and each located at the subject side thereof face in the same direction and have respective optical axes parallel to each other. Moreover, each of the right eye optical systemR and the left eye optical systemL is what is called a fisheye lens, so that two circular optical images are formed on the imaging unit(image sensor). An optical image (left image) input via the left eye optical systemL and an optical image (right image) input via the right eye optical systemR are formed on the imaging plane of the single imaging unit, so that the imaging unitacquires images including the left image and the right image.
300 301 301 301 301 301 301 100 The lens unitin the present exemplary embodiment is a VR180 lens, which is used to perform image capturing for what is called VR180 serving as a virtual reality (VR) image format capable of dual-lens stereoscopic viewing. In the VR180 lens, each of the right eye optical systemR and the left eye optical systemL includes a fisheye lens capable of capturing a range of 180 degrees. Furthermore, in the VR180 lens, each of the right eye optical systemR and the left eye optical systemL only needs to be capable of acquiring video available for dual-lens VR display as VR180, and can be a lens capable of capturing a range of a wide angle of view of about 160 degrees narrower than the range of 180 degrees. The VR 180 lens is capable of forming, on one or two image sensors of a camera with the VR180 lens mounted thereon, a right image (first image) formed via the right eye optical systemR and a left image (second image) formed via the left eye optical systemL and having parallax with respect to the right image. In the digital cameraaccording to the present exemplary embodiment, the right image and the left image are assumed to be formed on a single image sensor (sensor), and a single image in which an image corresponding to the right image and an image corresponding to the left image are arranged side by side in the left-right direction (dual-lens image) is assumed to be formed. The thus-formed dual-lens image includes an image corresponding to the right image, an image corresponding to the left image, and a region in which no optical image is formed (hatched portion).
300 100 304 305 100 50 100 303 300 10 100 306 300 Moreover, the lens unitis mounted on the digital cameravia a lens mount portionand a camera mount portionof the digital camera. With this mounting, the system control unitof the digital cameraand the lens system control circuitof the lens unitare electrically connected to each other via a communication terminal groupof the digital cameraand a communication terminal groupof the lens unit.
301 301 22 100 301 301 22 300 301 301 In the present exemplary embodiment, a right image formed via the right eye optical systemR and a left image formed via the left eye optical systemL and having parallax with respect to the right image are formed side by side on the imaging unitof the digital camera. Thus, two optical images formed by the right eye optical systemR and the left eye optical systemL are formed on a single image sensor. The imaging unitconverts the formed subject images (light signals) into analog electrical signals to acquire image data about a dual-lens image. In this way, using the lens unitenables acquiring two images having parallax concurrently (as a set) from two portions (optical systems), i.e., the right eye optical systemR and the left eye optical systemL. Moreover, performing VR display of the acquired images separately as a left-eye image and a right-eye image enables the user to view a stereoscopic VR image in a range of 180 degrees, what is called VR 180 video.
100 100 Conventionally, in an ordinary single lens, an image having entered the lens inverts symmetrically with respect to a point being the optical axis center and is made incident on a sensor. An imaging apparatus such as the digital cameraperforms generation of an image free from uncomfortable feeling (non-inverting image) by performing, for example, inversion processing of the order of reading from the sensor or the read image. On the other hand, in the case of a dual lens, while the up-down relationship inverts symmetrically with respect to a point and is made incident on the sensor, the left-right relationship does not invert and is made incident on the sensor with an image acquired via the left eye optical system serving as a left-side image and an image acquired via the right eye optical system serving as a right-side image. Therefore, if inversion processing is performed as in a conventional way, the left-right relationship in the digital cameraand the left-right relationship in the images obtained by inversion processing become opposite to each other, in other words, an image acquired via the left eye optical system is displayed at the right side and an image acquired via the right eye optical system is displayed at the left side.
100 300 Here, the VR image is an image available for VR display described below. The VR image includes, for example, an omnidirectional image (full spherical image) captured by an omnidirectional camera (full spherical camera) or a panoramic image with a video range (effective video range) wider than a display range able to be displayed at one time on a display unit. Moreover, the VR image is not limited to a still image, but also includes a moving image and a live image (an image acquired from the camera almost in real time). The VR image has a video range (effective video range) corresponding to a field of view of up to 360 degrees in the left-right direction and 360 degrees in the up-down direction. Moreover, the VR image also includes an image having an angle of view of less than 360 degrees in the left-right direction and less than 360 degrees in the up-down direction but wider than an angle of view able to be captured by an ordinary camera or having a video range wider than a display range able to be displayed at one time on a display unit. An image which is captured by the digital camerawith use of the above-mentioned lens unitis a type of VR image. The VR image is able to be displayed for VR display by, for example, setting the display mode of a display device (a display device capable of displaying a VR image) to “VR view”. When causing a VR image having an angle of view of 360 degrees to be displayed for VR display and changing the orientation of the display device in the left-right direction (horizontal rotational direction), the user is able to view an omnidirectional video which is seamless in the left-right direction.
Here, the VR display (VR view) is a display method (display mode) capable of changing a display range in which to display a video image having a field of view corresponding to the orientation of the display device in a VR image. The VR display includes “single-lens VR display (single-lens VR view), which performs deformation to map a VR image to a virtual sphere (deformation subjected to distortion correction) and displays a single deformed VR image. Moreover, the VR display also includes “dual-lens VR display (dual-lens VR view), which performs deformation to map a left-eye VR image and a right-eye VR image to respective virtual spheres and displays the deformed VR images side by side at left and right areas. Performing “dual-lens VR display” using a left-eye VR image and a right-eye VR image having parallax with respect to each other enables stereoscopic viewing.
With any type of VR display used, for example, in a case where the user wears a display device such as a head-mounted display (HMD), a video image in a field of view range corresponding to the direction of the face of the user is displayed. For example, suppose that, in a VR image, a video image in a field of view range the center of which is located at 0 degrees in the left-right direction (a specific azimuth direction, e.g., north) and at 90 degrees in the up-down direction (90 degrees from the zenith, i.e., the horizon) is displayed at a given point of time. When, from this state, the user reverses the orientation of the display device between front and back sides (for example, changes the display surface from orientation to the south to orientation to the north), the display range is changed to a video image in a field of view range the center of which is located at 180 degrees in the left-right direction (an opposite azimuth direction, e.g., south) and at 90 degrees in the up-down direction in the same VR image. Thus, when the user with the HMD worn thereon turns the face from the north to the south (i.e., faces rearward), a video image which is being displayed in the HMD is changed from a video image in the north to a video image in the south.
300 Furthermore, a VR image captured with use of the lens unitin the present exemplary embodiment is a VR180 image obtained by performing image capturing of a range of forward 180 degrees, and there is no video image in a range of backward 180 degrees. When such a VR180 image is displayed for VR display, in a case where the user has changed the orientation of the display device to the side in which there is no video image, a blank area is displayed.
Displaying a VR image for VR display in the above-mentioned way causes the user to have a feeling of being visually in a VR image (in a VR space). Furthermore, the display method for a VR image is not limited to a method of changing the orientation of the display device. For example, the display range can be moved (scrolled) in response to a user operation performed via, for example, a touch panel or direction buttons. Moreover, at the time of VR display (at the time of the display mode “VR view”), in addition to changing of the display range by the orientation change, the display range can also be changed in response to, for example, touch-move at the touch panel, a drag operation of, for example, a mouse, or pressing of a direction button. Furthermore, a smartphone mounted on a VR goggle (head-mounted adapter) is a type of HMD.
100 300 22 100 A dual-lens image which is captured in the digital cameraconfigured as described above via the lens unitis an image including a right image and a left image input to the imaging unitvia the right eye optical system and the left eye optical system. Moreover, the user who is using the digital cameramay perform an operation to enlarge and display a part of a live view image or a recorded image to check details of the image. When performing an operation for enlargement, the user may uniquely set the center position of a range targeted for enlargement of an image as the center position of the whole image.
In the case of enlarging a part of a dual-lens image to check the part of the dual-lens image, it is desirable to display only a part of the right image or left image. If, at the time of enlargement, the center position of a range targeted for enlargement of an image is uniquely set as the center position of the whole image, in a case where parts of both the right image and the left image are included in the enlarged image, it is difficult for the user to intuitively recognize which portion in the original image the enlarged image is showing. Specifically, an image in which a left end portion of the right image is shown as a right-hand portion of the enlarged image and a right end portion of the left image is shown as a left-hand portion of the enlarged image may be obtained, so that an enlarged image which differs in left-right positional relationship from a field of view targeted for image capturing may be obtained.
100 300 4 FIG. Therefore, in the present exemplary embodiment, processing which the digital cameraperforms for live view enlargement processing suitable for performing image capturing with a dual lens such as the lens unitis described with reference to the flowchart of.
4 FIG. 4 FIG. 4 FIG. 4 FIG. 100 50 56 52 100 50 is a flowchart illustrating an example of processing which the digital cameraperforms in the image capturing mode. The flowchart ofis implemented by the system control unitloading a program stored in the non-volatile memoryonto the system memoryand executing the program. Moreover, the flowchart ofis started when the digital camerais powered on and is in the image capturing waiting state. When starting the control flowchart of, the system control unitinitializes, for example, control variables and then starts processing.
28 4 FIG. 5 5 5 5 5 5 FIGS.A,B,C,D,E, andF 5 5 FIGS.A toF 4 FIG. Moreover, examples of displaying on the display unitin a case where the control flowchart ofis performed are described with reference to. Furthermore, details of examples of displaying illustrated inare described after the control flowchart ofis described.
401 50 56 28 50 50 50 In step S, the system control unitacquires a display mode which was used last time from a flag (N) stored in the non-volatile memoryand performs displaying of a live view image and information concerning image capturing on the display unitbased on the display mode which was used last time. For example, in a case where the flow is started in response to the system control unitbeing powered on, the display mode which was used last time is a display mode which had previously been used at the time when the system control unitwas powered off. Alternatively, in a case where the flow is started in response to the system control unittransitioning from a mode other than the image capturing mode, such as a playback mode, to the image capturing mode, the display mode which was used last time is a display mode which had been used at timing when processing had been performed in the image capturing mode last time.
402 50 83 83 402 50 403 402 50 410 In step S, the system control unitdetermines whether the display mode switching buttonhas been pressed. If it is determined that the display mode switching buttonhas been pressed (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
403 50 52 403 50 404 403 50 405 In step S, the system control unitrefers to the system memoryand determines whether the flag N indicating a display mode is 5 (N=5). If it is determined that N=5 (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
404 50 6 10 404 50 406 404 50 408 301 301 In step S, the system control unitdetermines whether the lens mounted via the communication terminal groupsandis a dual lens (i.e., a VR180 lens). If it is determined that the mounted lens is a dual lens (YES in step S), the system control unitadvances the processing to step S, and, if not so (i.e., the mounted lens is an ordinary single lens or no lens is mounted) (NO in step S), the system control unitadvances the processing to step S. The dual lens is a lens unit including a left-side lens and a right-side lens, each of which is a wide-angle fisheye lens capable of capturing a range of at least 180 degrees included in a range on a side at which each lens is arranged, i.e., on a subject side. Data about a left image and data about a right image captured via the left eye optical systemL and the right eye optical systemR are able to be acquired by one or two image sensors.
405 403 50 52 In step S, since a result of the determination in step Sis NO, the system control unitincrements the flag N indicating a display mode by one (N=N+1), and stores the incremented flag N in the system memory.
406 50 52 In step S, the system control unitsets the flag N to 6 (N=6), and stores the set flag N in the system memory.
407 50 28 5 FIG.F 5 FIG.F In step S, in a case where N=6, the system control unitdisplays a display mode exclusive for a dual lens on the display unit. An example of display provided at that time is illustrated in.is explained in detail below.
408 404 50 52 In step S, since a result of the determination in step Sis NO, the system control unitsets the flag N to 1 (N=1), and stores the set flag N in the system memory.
409 50 28 52 28 404 409 5 5 FIGS.A toE In step S, the system control unitperforms, on the display unit, displaying of a live view image and information in a display mode corresponding to a numerical value of the flag N stored in the system memory. Examples of display corresponding to the display mode for displaying on the display unitare illustrated in. Since, in a case where a result of the determination in step Sis NO, the processing also comes at step S, such displaying of a live view image and information is also performed when a dual lens is not mounted, i.e., when a single lens is mounted or no lens is mounted.
28 100 83 28 28 5 5 FIGS.A toF 5 5 FIGS.A toF 4 FIG. 5 FIG.F 5 5 FIGS.A toF 4 FIG. Displaying of a live view (LV) image and information which are displayed on the display unitis described with reference to. Whileillustrate displaying of two LV images in a state in which a dual lens (VR180 lens) is mounted on the digital camera, in a case where a single lens is mounted, one LV image is displayed and displaying of information other than the LV image is similarly displayed. In case where a single lens is mounted, as mentioned above with reference to, there is no transition to the display mode illustrated in. Each time a switching operation for a display mode (in the present exemplary embodiment, pressing of the display mode switching button) is performed by the user, information which is displayed on the display unitis made to vary. Specifically, displaying illustrated inis performed according to the numerical value of the flag N indicating a display mode described above with reference to. Furthermore, while, in the present exemplary embodiment, an LV image which is displayed on the display unitis a circular fisheye view, the present exemplary embodiment is not limited to this, and equirectangular (equidistant cylindrical projection) conversion processing can be performed on an LV image generated as a circular fisheye view to acquire an equirectangular view.
5 FIG.A 5 FIG.A 5 FIG.B 100 28 500 500 501 501 28 501 501 83 a c a c illustrates a display mode which is used when the flag N=1, i.e., when the digital camerais powered on and LV images are displayed on the display unitin the image capturing waiting state. Two LV images (LV imageR and LV imageL) are displayed side by side in the left-right direction and information indicationstoare also displayed on the display unit. At this time, two LV images arranged side by side in the left-right direction are referred to as “side-by-side images”. The information indicationsto, which indicate image capturing information, are minimum information indications for the user to perform image capturing. In response to the display mode switching buttonbeing pressed in the state illustrated in, a transition to displaying illustrated inoccurs.
5 FIG.B 5 FIG.B 5 FIG.B 5 FIG.C 500 500 501 501 502 502 502 502 501 501 200 501 501 83 a c a b a b a c a c illustrates a display mode which is used when the flag N=2. In, in addition to the LV imageR, the LV imageL, and the information indicationsto, information indicationsandare displayed. The information indicationsand, which indicate image capturing information as with the information indicationsto, are used to display various pieces of information concerning image capturing (for example, the currently set setting values and the type of the recording mediumcurrently inserted. Since the amount of information increases as compared with a case where only the information indicationstoare displayed, the user is enabled to visually recognize a large number of pieces of image capturing information. On the other hand, the visibility of LV images may decrease. In response to the display mode switching buttonbeing pressed in the state illustrated in, a transition to displaying illustrated inoccurs.
5 FIG.C 5 FIG.C 5 FIG.C 5 FIG.D 500 500 501 501 502 502 503 503 503 503 503 83 a c a b illustrates a display mode which is used when the flag N=3. In, in addition to the LV imageR, the LV imageL, and the information indicationsto,, and, an information indication, which is a histogram of an LV image currently captured, is displayed. The information indicationis a graph with the brightness incremented on the horizontal axis and the number of pixels incremented on the vertical axis, and serves as a target for checking how degree of brightness an LV image currently captured has or checking the tendency of exposure level or the gradation of the whole LV image. Since some users may want to check the information indicationat the time of performing image capturing, the information indicationis displayed. On the other hand, since the information indicationis displayed in a relatively large area in an LV image, the visibility of the LV image may decrease. In response to the display mode switching buttonbeing pressed in the state illustrated in, a transition to displaying illustrated inoccurs.
5 FIG.D 5 FIG.D 5 FIG.D 5 FIG.E 501 501 502 502 503 500 500 83 a c a b illustrates a display mode which is used when the flag N=4. In the display mode illustrated in, all of the information indicationsto,,, andare hidden, and only the LV imageR and the LV imageL are displayed. Performing such displaying enables the user to perform image capturing while viewing only LV images without feeling various pieces of image capturing information to be cumbersome. In response to the display mode switching buttonbeing pressed in the state illustrated in, a transition to displaying illustrated inoccurs.
5 FIG.E 5 FIG.E 5 FIG.E 5 FIG.F 5 FIG.A 83 illustrates a display mode which is used when the flag N=5. In the display mode illustrated in, no LV image is displayed, and only information indications concerning image capturing are displayed in a table-like form. In response to the display mode switching buttonbeing pressed in the state illustrated in, in a case where a dual lens is mounted, a transition to displaying illustrated inoccurs, and, in a case where a single lens is mounted or no lens is mounted, a transition to displaying illustrated inoccurs.
5 FIG.F 4 FIG. 5 FIG.F 407 100 500 500 505 506 28 511 512 513 505 500 301 506 500 301 illustrates a display mode which is used when the flag N=6 (step Sin). Thus, the display mode illustrated inis a display mode a transition to which occurs only in a case where a dual lens is mounted on the digital camera. At this time, the LV imageR, the LV imageL, the information indicationsandare displayed on the display unit, and an enlargement frame, a focus guide, and magic windowsare also displayed thereon in superimposition on LV images. The information indicationindicates that the LV imageR is an LV image captured by the right eye optical systemR, and is displayed as “R”, which means right. The information indicationindicates that the LV imageL is an LV image captured by the left eye optical systemL, and is displayed as “L”, which means left.
100 22 28 29 22 28 22 3 FIG. Originally, in the case of an optical system such as that for use in the digital camera, an image captured by an image sensor (imaging unit) is an image captured upside down. Up and down sides of such an image captured upside down are inverted by 180 degrees, so that the inverted image is displayed on the display unitor the EVF. In light of such a structure, suppose that image capturing is performed with use of a lens including two optical systems such as that illustrated in(dual lens). As mentioned above, if two LV images captured via left and right optical systems and input to the imaging unitare displayed on the display unitwithout being subjected to inversion processing, LV images inverted upside down are displayed, so that the user may feel inconvenience. Therefore, as with a case where a single lens is mounted, inversion processing is performed on two LV images input to the imaging unit.
28 301 301 22 50 22 28 However, even if inversion processing is performed, with regard to two LV images which are displayed on the display unit, an LV image (right image) acquired via the right eye optical systemR is displayed in the left region and an LV image (left image) acquired via the left eye optical systemL is displayed in the right region. Particularly, since, in the present exemplary embodiment, image capturing is performed with a single image sensor (imaging unit), processing for determining a boundary between two LV images on the single image sensor and reversing left and right LV images increases processing load in the system control unit. Therefore, LV images input to the imaging unitare inverted upside down by 180 degrees and are then displayed on the display unitwithout being subjected to left and right reversing.
28 301 301 505 506 505 506 In a case where two LV images are displayed on the display unit, the user usually thinks that an LV image displayed in the left region is an image captured via the left eye optical systemL and an LV image displayed in the right region is an image captured via the right eye optical systemR. Thus, unless the information indicationsandare displayed, the user has a high probability of being unable to understand that left and right LV images have been inverted between left and right, and, if the user does not have an awareness that inversion between left and right occurs at the time of image capturing, the user may become confused. Therefore, displaying the information indicationsandenables the user to clearly visually recognize an image captured via which of the left and right optical systems each LV image is.
511 801 512 512 512 512 8 FIG.A 5 FIG.F The enlargement frame, which is displayed in superimposition on an LV image, is a frame indication indicating a region to be enlarged in the LV image when an enlargement instruction (described below in step Sin) has been issued by the user. The focus guideis an indicator indicating, with an index and information about, for example, color, a frame representing a focus detection area and a degree of in-focus in focusing on a subject at a position where the focus detection area is displayed in a superimposed manner. In the present exemplary embodiment, the degree of in-focus in focusing is expressed by three indexes displayed above or below the focus detection area. The focus guideillustrated inenables knowing that the degree of in-focus in focusing is out of focus on a subject at a position where the focus detection area is displayed and is far focus (a state in which focusing is adjusted to behind the subject and is not adjusted to the subject). Moreover, in a case where the degree of in-focus in focusing is not in focus, the focus guideis displayed in white. Such three indexes becoming two indexes indicates that the degree of in-focus in focusing is in focus, so that the focus guideis displayed in green.
513 28 513 500 500 513 The magic windows, which are displayed on the display unit, are indicators representing ranges which are displayed in the beginning before the user moves the user's point of view. The magic windowsrepresent ranges which are displayed in the beginning before the user moves the user's point of view, when one 180-degree image (hemispherical image) is generated from the LV imageR and the LV imageL and is then played back via a browser or a head-mounted display (HMD). Displaying the magic windowsin LV images enables the user to visually recognize, at the time of image capturing, a range which is displayed in the beginning at the time of playback, i.e., which a viewing person sees for the first time, and enables more effectively performing image capturing of a composition or subject desired by the user.
513 513 513 513 5 FIG.F In one embodiment, the magic windowsare indicators which become necessary only when a 180-degree image has been generated, and are specific indicators which the user particularly needs when performing image capturing with a dual lens mounted. Therefore, the display mode illustrated inis not displayed when a single lens is mounted. Moreover, since the display positions of the magic windowsare fixed, as long as the user is able to check the ranges of the magic windows, the magic windowsdo not necessarily need to be always displayed at the time of subsequent image capturing.
511 512 513 511 512 Furthermore, in the present exemplary embodiment, the enlargement frameand the focus guideare displayed in a superimposed manner in only one LV image out of the two LV images, and the magic windowsare displayed in a superimposed manner in both of the two LV images. While, since the enlargement frameindicates a position at which to perform enlargement, displaying only one enlargement frame is thought to be optimal, the focus guidecan be configured to be displayed not in one LV image but in both of the two LV images.
410 404 50 6 10 410 50 411 410 50 412 In step S, as with step S, the system control unitdetermines whether the lens mounted via the communication terminal groupsandis a dual lens. If it is determined that the mounted lens is a dual lens (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
411 50 6 10 12 FIG. In step S, the system control unitcalculates the centers and sizes of a left image and a right image from lens information acquired via the communication terminal groupsand. The method of calculation at this time is described with reference to.
12 FIG. 1200 22 100 1200 22 300 is a diagram illustrating a physical coordinate systemfor optical images formed on the imaging unit(image sensor) of the digital camerain the present exemplary embodiment. The coordinate systemcorresponds to a case where the imaging unitis viewed from the side of the lens unit.
1201 301 1201 301 22 1300 13 FIG. In the present exemplary embodiment, a circular optical imageR formed by the left eye optical systemL and a circular optical imageL formed by the right eye optical systemR are formed on a single image sensor. Moreover, the imaging unitconverts the formed subject images into analog electrical signals, thus forming a logical coordinate systemillustrated in.
50 6 10 50 1203 1210 1200 1201 1203 1210 1200 1201 50 1204 1201 1204 1201 The system control unitis able to acquire pieces of information such as those described below from the lens mounted via the communication terminal groupsand. For example, the system control unitis able to acquire a distanceR between the center lineof the image sensorand the center position of the circular optical imageR and a distanceL between the center lineof the image sensorand the center position of the circular optical imageL. Moreover, the system control unitis able to acquire a radiusR of the optical imageR and a radiusL of the optical imageL.
50 13 FIG. The system control unitis able to calculate, from the thus-acquired lens information, the centers and sizes of two LV images (a left image and a right image) acquired via two optical systems, such as those illustrated in.
70 70 50 100 100 50 100 50 50 100 50 a a Next, processing which is performed when a touch-down operation on the touch panelhas been performed is described. In response to touch-down on the touch panelhaving been performed during displaying of images, the system control unitof the digital cameradisplays, in an image, an item concerning focus control and an item indicating an enlargement range. In a case where the lens unit mounted on the digital camerais not a dual lens (is a conventional single lens), the system control unitdisplays, at a position corresponding to touch-down, a focus guide indicating the degree of in-focus or an autofocus (AF) frame indicating a region targeted for autofocus. Moreover, in a case where the lens unit mounted on the digital camerais a dual lens, in response to touch-down, the system control unitdisplays a focus guide indicating the degree of in-focus at the center of any one of a region used for displaying a left image and a region used for displaying a right image. Additionally, the system control unitdisplays an enlargement frame indicating an enlargement range at a position corresponding to touch-down. In a case where the lens unit mounted on the digital camerais a dual lens, the system control unitperforms displaying in such a manner that the enlargement frame includes regions in which optical images of the left image and the right image are formed (does not include only a hatched portion which includes neither the left image nor the right image).
412 50 70 412 50 413 412 50 601 a 6 FIG. In step S, the system control unitdetermines whether a touch-down operation on the touch panelhas been performed. If it is determined that the touch-down operation has been performed (YES in step S), the system control unitstores coordinates (xt, yt) indicating the touch-down position (touch position) and then advances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step Sillustrated in.
413 404 50 6 10 413 50 414 413 50 419 In step S, as with step S, the system control unitdetermines whether the lens mounted via the communication terminal groupsandis a dual lens. If it is determined that the mounted lens is a dual lens (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
414 50 70 412 701 701 414 50 415 701 414 50 417 705 700 700 705 22 a 7 7 FIGS.A andB In step S, the system control unitdetermines whether the touch position (touch-down position) of a touch operation on the touch panelperformed in step Sis within a left-side region (regionL) of the dual-lens image.are schematic diagrams illustrating an example of display in which a dual-lens image is shown. If it is determined that the touch position is within a left region (within the regionL) (YES in step S), the system control unitadvances the processing to step S, and, if it is determined that the touch position is within a right region (within a regionR) (NO in step S), the system control unitadvances the processing to step S. A lineis a line serving just as a boundary between live view images (an LV imageR and an LV imageL) respectively captured via the right and left optical systems. Furthermore, in the present exemplary embodiment, the lineis a center line along which the imaging unitis assumed to be divided into halves right and left.
415 50 In step S, the system control unitdisplays the focus guide at the center of the left region.
50 301 In a case where, at this time, the focus guide is already displayed in any of LV images in the left region and right region in superimposition on the LV image, the system control unitmoves the focus guide to the center of the left region (the center of an LV image captured via the right eye optical systemR and displayed in the left region). The focus guide is composed of a frame indicating a focus detection area and a plurality of indexes indicating the degree of in-focus with a relationship between display positions thereof. The display positional relationship of indexes enables the user to visually recognize whether an in-focus state is obtained at a display position of the focus detection area, how much an out-of-focus state is, and, in the case of an out-of-focus state, at which of the near and far sides with respect to a subject in the focus detection area, the out-of-focus state is. Furthermore, the focus guide is not limited to such a display form, but can indicate the degree of in-focus with, for example, color.
416 50 10 FIG.A In step S, the system control unitperforms position calculation processing (left region) for the enlargement frame by a touch operation. This processing is described below with reference to.
417 414 50 301 50 512 5 FIG.F In step S, since a result of the determination in step Sis NO, the system control unitdisplays the focus guide at the center of the right region (the center of an LV image captured via the left eye optical systemL and displayed in the right region). In a case where, at this time, the focus guide is already displayed in superimposition on the LV image, the system control unitmoves the focus guide to the center of the right region. An example of displaying performed at this time is shown as the guideillustrated in.
418 50 10 FIG.B In step S, the system control unitperforms position calculation processing (right region) for the enlargement frame by a touch operation. This processing is described below with reference to.
10 10 FIGS.A andB 4 FIG. 13 FIG. 70 416 418 50 a are control flowcharts illustrating processing for calculating the position of the enlargement frame in a case where a touch-down operation on the touch panelhas been performed by the user, in steps Sand S, respectively, illustrated in. The system control unitdetermines whether the position of touch-down performed by the user is within a specific range out of the left and right regions, and, if the touch-down position is within the specific range, moves displaying of the enlargement frame to the touch-down position and, if the touch-down position is outside the specific range, moves displaying of the enlargement frame to within a specific range closest to the touch-down position. The specific range mentioned herein is assumed to be a range in which the display range of the left image or the right image is included. XminL, XmaxL, YminL, and YmaxL denote coordinates representing threshold values of a range in which the center of the enlargement frame is movable in the left region. XminR, XmaxR, YminR, and YmaxR denote coordinates representing threshold values of a range in which the center of the enlargement frame is movable in the right region. Details of this coordinate system are described below with reference to.
412 1310 1310 701 10 FIG.A 13 FIG. 7 FIG.B Calculation processing which is performed in a case where the touch position (the position of touch-down performed in step S) is within the left region is described with reference to. The left region mentioned herein refers to a regionL illustrated in. Furthermore, the regionL is the same region as the regionL illustrated in.
1001 50 1001 50 1002 1001 50 1003 13 FIG. In step S, the system control unitdetermines whether the touch position is to the left of XminL (illustrated in). If it is determined that the touch position is to the left of XminL (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1002 50 52 In step S, the system control unitsets the X coordinate of the center of the enlargement frame to X=XminL and then stores the set X coordinate in the system memory.
1003 50 412 1003 50 1004 1003 50 1005 In step S, the system control unitdetermines whether the touch position (the position of touch-down performed in step S) is to the right of XmaxL. If it is determined that the touch position is to the right of XmaxL (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1004 50 52 In step S, the system control unitsets the X coordinate of the center of the enlargement frame to X=XmaxL and then stores the set X coordinate in the system memory.
1005 50 52 In step S, the system control unitsets the X coordinate of the center of the enlargement frame to X=xt of the touch position and then stores the set X coordinate in the system memory.
1006 50 1006 50 1007 1006 50 1008 In step S, the system control unitdetermines whether the touch position is upper than YminL. If it is determined that the touch position is upper than YminL (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1007 50 52 In step S, the system control unitsets the Y coordinate of the center of the enlargement frame to Y=YminL and then stores the set Y coordinate in the system memory.
1008 50 1008 50 1009 1008 50 1010 In step S, the system control unitdetermines whether the touch position is lower than YmaxL. If it is determined that the touch position is lower than YmaxL (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1009 50 52 In step S, the system control unitsets the Y coordinate of the center of the enlargement frame to Y=YmaxL and then stores the set Y coordinate in the system memory.
1010 50 52 In step S, the system control unitsets the Y coordinate of the center of the enlargement frame to Y=yt of the touch position and then stores the set Y coordinate in the system memory.
1011 50 52 50 In step S, the system control unitmoves the enlargement frame according to the values of the X and Y coordinates stored in the system memory. At this time, the system control unitmoves the display position in such a manner that the center of vertical and horizontal sides of the enlargement frame becomes coincident with the stored values of the X and Y coordinates.
412 1310 1310 701 10 FIG.B 13 FIG. 7 FIG.B Similarly, calculation processing which is performed in a case where the touch position (the position of touch-down performed in step S) is within the right region is described with reference to. The right region mentioned herein refers to a regionR illustrated in. Furthermore, the regionR is the same region as the regionR illustrated in.
1021 50 1021 50 1022 1021 50 1023 13 FIG. In step S, the system control unitdetermines whether the touch position is to the left of XminR (illustrated in). If it is determined that the touch position is to the left of XminR (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1022 50 52 In step S, the system control unitsets the X coordinate of the center of the enlargement frame to X=XminR and then stores the set X coordinate in the system memory.
1023 50 1023 50 1024 1023 50 1025 13 FIG. In step S, the system control unitdetermines whether the touch position is to the right of XmaxR (illustrated in). If it is determined that the touch position is to the right of XmaxR (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1024 50 52 In step S, the system control unitsets the X coordinate of the center of the enlargement frame to X=XmaxR and then stores the set X coordinate in the system memory.
1025 50 52 In step S, the system control unitsets the X coordinate of the center of the enlargement frame to X=xt of the touch position and then stores the set X coordinate in the system memory.
1026 50 1026 50 1027 1026 50 1028 13 FIG. In step S, the system control unitdetermines whether the touch position is upper than YminR (illustrated in). If it is determined that the touch position is upper than YminR (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1027 50 52 In step S, the system control unitsets the Y coordinate of the center of the enlargement frame to Y=YminR and then stores the set Y coordinate in the system memory.
1028 50 1028 50 1029 1028 50 1030 13 FIG. In step S, the system control unitdetermines whether the touch position is lower than YmaxR (illustrated in). If it is determined that the touch position is lower than YmaxR (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1029 50 52 In step S, the system control unitsets the Y coordinate of the center of the enlargement frame to Y=YmaxR and then stores the set Y coordinate in the system memory.
1030 50 52 In step S, the system control unitsets the Y coordinate of the center of the enlargement frame to Y=yt of the touch position and then stores the set Y coordinate in the system memory.
1031 50 52 50 In step S, the system control unitmoves the enlargement frame according to the values of the X and Y coordinates stored in the system memory. At this time, the system control unitmoves the display position in such a manner that the center of vertical and horizontal sides of the enlargement frame becomes coincident with the stored values of the X and Y coordinates.
1311 1301 1301 28 1311 28 13 FIG. 13 FIG. Performing the above-described control prevents the movement of the enlargement frame due to a touch operation performed by the user from being performed to a region in which neither the left image nor the right image is displayed (no optical image is formed). Thus, even if a touch operation (touch-down) by the user has been performed on a region in which no optical image is formed (a regionillustrated in), the entire target range included in the enlargement frame is prevented from becoming a region in which no optical image is formed. At this time, the enlargement frame is moved in such a way as to include at least a part of a region in which the left image or the right image is displayed (a circular regionL or a circular regionR illustrated in). With this movement, in a case where the user has issued an enlargement instruction, enlargement displaying in which at least the left image or the right image is included is performed on the display unit. Since only enlargement displaying of a portion in which neither the left image nor the right image is included at all (the regionin which no optical image is formed) being performed on the display unitis prevented, it is possible to reduce the user from becoming confused or feeling that operability is low.
100 Next, control which is performed in response to touch-down in a case where the lens mounted on the digital camerais not a dual lens (is a single lens) is described.
419 50 56 419 50 420 419 50 421 50 In step S, the system control unitrefers to the non-volatile memoryand determines whether the setting of a focus mode is an autofocus mode (AF mode) or a manual focus mode (MF mode). If it is determined that the setting of a focus mode is the MF mode (MF in step S), the system control unitadvances the processing to step S, and, if it is determined that the setting of a focus mode is the AF mode (AF in step S), the system control unitadvances the processing to step S. In a case where the display setting of the focus guide is ON when the setting of a focus mode is the MF mode, the system control unitdisplays the focus guide to assist in focus adjustment in the MF operation.
420 50 412 In step S, the system control unitmoves displaying of the focus guide to the touch position designated by the user in step S.
421 50 412 In step S, the system control unitdisplays an autofocus frame (AF frame), which indicates an in-focus position, at the touch position designated by the user in step S.
422 50 412 In step S, the system control unitdisplays the enlargement frame at the touch position designated by the user in step S.
100 Thus, in a case where the lens mounted on the digital camerais not a dual lens (is a single lens), irrespective of the setting content of a focus mode, the enlargement frame or the focus guide is displayed at the touch position designated by the user. Moreover, the enlargement frame is displayed in conjunction with a focus detection area of the AF frame or the focus guide. On the other hand, in a case where a dual lens is mounted, the display position of the enlargement frame is not moved in conjunction with a focus detection area of the focus guide.
28 In the present exemplary embodiment, the display position of the focus guide in a case where a dual lens is mounted is fixed to the center of a display region for each of left and right LV images. Therefore, if the display position of the focus guide and the display position of the enlargement frame are moved in conjunction with each other, only the center of the LV image is able to be enlarged, so that the usability for the user is low. Moreover, since, in the case of a dual lens, two LV images are displayed on the display unit, every single LV image becomes half or less in size as compared with an LV image obtained at the time of mounting of a single lens. Therefore, the user has a high probability of checking an LV image in more detail by enlarging the LV image a larger number of times than at the time of mounting of a single lens. Therefore, to enable the user to freely check the desired position, the enlargement frame (i.e., an enlargement range for the LV image) is not moved in conjunction with the focus guide.
Furthermore, even in a case where the focus guide is not fixed to the center, when a dual lens is mounted, the focus guide and the enlargement frame are made not to be moved in conjunction with each other. While the user performs more rigorous focus adjustment with use of the focus guide, a case where the user wants to enlarge a position different from a position targeted for focusing and then check the enlarged position in more detail is assumable. For example, in a case where the user wants to enlarge and check the inside of a range of the magic window described below or a region near the circumference of an LV image as a circular fisheye view, causing the positions of the focus guide and the enlargement frame not to be moved in conjunction with each other is beneficial for operability for the user.
6 FIG. 100 is a control flowchart illustrating display control for the digital camerawhen an operation has been performed on an operation member capable of issuing a direction instruction in the present exemplary embodiment.
50 100 100 50 In response to receiving a direction instruction during displaying of a dual-lens image and an item such as the enlargement frame, the system control unitof the digital cameramoves the position of the item in the image. In a case where the lens unit mounted on the digital camerais not a dual lens (is a conventional single lens), the system control unitmoves the focus guide or the AF frame and the enlargement frame according to the direction instruction.
100 50 50 28 50 28 50 Moreover, in a case where the lens unit mounted on the digital camerais a dual lens, the system control unitmoves the enlargement frame according to the direction instruction. Furthermore, the system control unitdoes not move the focus guide. Additionally, in a state in which the enlargement frame is displayed in the right region on the display unitand near the boundary in such a manner that the enlargement frame does not include both the left image and the right image, in response to receiving an instruction for a leftward direction, the system control unitmoves the display position of the enlargement frame to the left region. In a state in which the enlargement frame is displayed in the left region on the display unitand near the boundary in such a manner that the enlargement frame does not include both the left image and the right image, in response to receiving an instruction for a rightward direction, the system control unitmoves the display position of the enlargement frame to the right region.
601 50 82 74 70 601 50 602 601 50 610 In step S, the system control unitdetermines whether a direction instruction by the multi-controller (MC)or the arrow keysincluded in the operation unithas been issued. If it is determined that the direction instruction has been issued (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
602 413 50 6 10 602 50 607 602 50 603 In step S, as with step S, the system control unitacquires the type of the lens mounted via the communication terminal groupandand determines whether the mounted lens is a dual lens. If it is determined that the mounted lens is a dual lens (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
603 419 50 100 603 50 604 603 50 605 50 28 70 412 50 a In step S, as with step S, the system control unitdetermines whether the current focus mode of the digital camerais the AF mode or the MF mode. If it is determined that the current focus mode is the AF mode (AF in step S), the system control unitadvances the processing to step S, and if it is determined that the current focus mode is the MF mode (MF in step S), the system control unitadvances the processing to step S. Furthermore, in a case where, at the time of the MF mode, display setting of the focus guide for assisting in MF focus adjustment is ON, the system control unitdisplays the focus guide in any one of LV images displayed on the display unit. If a touch-down operation on the touch panelas mentioned above in step Shas not still been performed, the system control unitdisplays the focus guide in superimposition on an LV image in the right region.
604 50 28 601 In step S, the system control unitmoves the AF frame displayed on the display unitin a direction designated in step S.
605 50 28 601 50 605 50 In step S, the system control unitmoves the focus guide displayed on the display unitin a direction designated in step S. In a case where display setting of the focus guide is set to OFF by the user setting, the system control unitskips step S. At this time, the system control unitmoves the entire focus guide, but can move not the entire focus guide but only the focus detection area.
606 50 28 604 605 In step S, the system control unitmoves the enlargement frame displayed on the display unitin conjunction with the AF frame or the focus guide to the position of the AF frame moved in step Sor the position of a frame indicating the focus detection area of the focus guide moved in step S.
607 50 607 50 608 607 50 609 50 50 1310 In step S, the system control unitdetermines whether the currently displayed enlargement frame is displayed in the left region. If it is determined that the currently displayed enlargement frame is displayed in the left region (YES in step S), the system control unitadvances the processing to step S, and, if not so, i.e., if it is determined that the currently displayed enlargement frame is displayed in the right region (NO in step S), the system control unitadvances the processing to step S. At this time, the system control unitdetermines whether the entire enlargement frame is displayed in the left region. Thus, the system control unitdetermines whether the coordinates of the center position of the enlargement frame is at least in the regionL.
608 50 11 FIG.A In step S, the system control unitperforms position calculation processing for the enlargement frame (left region) by the direction instruction. This processing is described below with reference to.
609 50 11 FIG.B In step S, the system control unitperforms position calculation processing for the enlargement frame (right region) by the direction instruction. This processing is described below with reference to.
11 11 FIGS.A andB 6 FIG. 10 10 FIGS.A andB 13 FIG. 82 74 608 609 50 50 50 are control flowcharts illustrating processing for calculating the position of the enlargement frame which is displayed in a case where a direction instruction has been issued by the user via the multi-controller (MC)or the arrow keys, in steps Sand S, respectively, illustrated in. The system control unitdetermines whether the display position of the currently displayed enlargement frame (the central coordinate position of the enlargement frame) is on a side inner than a specific range in the left and right regions. In a case where the display position is on a side inner than the specific range, the system control unitmoves the enlargement frame by one step in a direction designated by the user instruction. In a case where the central coordinate position of the enlargement frame is on a boundary of the specific range in the left and right regions, the system control unitperforms control depending on the direction designated by the direction instruction, for example, in such a way as prevent the enlargement frame from being moved or in such a way as to cause the enlargement frame to jump from one optical image to the other optical image (e.g., from the left image to the right image). The specific range mentioned herein is the same as the specific range mentioned above inand is assumed to be within a rectangular range in which the display range of the left image or the right image is included. A coordinate system which is used for determination at this time is described below with reference to.
11 FIG.A 13 FIG. 1310 Calculation processing which is performed in a case where the display region of the enlargement frame which has been displayed before a movement instruction (direction instruction) for the enlargement frame is issued is a left region is described with reference to. The left region mentioned herein refers to the regionL illustrated in.
1101 50 82 74 601 1101 50 1102 1101 50 1104 6 FIG. In step S, the system control unitdetermines whether the direction instruction is a rightward direction instruction. The instruction in this step refers to an instruction issued by the user via the MCor the arrow keysin step Sillustrated in. If it is determined that the direction instruction is a rightward direction instruction (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1102 50 1102 50 1103 1102 50 1106 In step S, the system control unitdetermines whether the X coordinate of the center of the enlargement frame obtained before the instruction is received is X=XmaxL. If so (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1103 50 In step S, the system control unitmoves the enlargement frame in such a manner that the X coordinate of the center of the enlargement frame becomes X=XminR.
1104 50 1104 50 1105 1104 50 1108 In step S, the system control unitdetermines whether the direction instruction is a leftward direction instruction. If it is determined that the direction instruction is a leftward direction instruction (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1105 50 1105 50 1107 1105 50 1106 In step S, the system control unitdetermines whether the X coordinate of the center of the enlargement frame obtained before the instruction is received is X=XminL. If so (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1106 50 28 In step S, the system control unitmoves the display position of the enlargement frame in the direction designated by the direction instruction. At this time, the amount of movement by which the display position moves according to one occurrence of a direction instruction is assumed to be an amount corresponding to one pixel of the display unit.
1107 50 1105 1302 1311 28 50 1302 1301 1302 13 FIG. In step S, the system control unitdoes not move the enlargement frame. A result of the determination in step Sbeing YES reveals that the left side of the enlargement frame which is displayed before a direction instruction is issued by the user is inscribed in a rectangleL illustrated in. If, in response to an instruction for a leftward direction being issued in such a state, the enlargement frame is moved a distance corresponding to one pixel in a leftward direction, a region in which no optical image is formed (region) becomes included in an enlargement range indicated by the enlargement frame (a range targeted for enlargement). If such control is performed, many portions other than the left image or the right image may be displayed in an enlarged display image displayed on the display unit, so that the user may feel that usability is low. Therefore, the system control unitkeeps the enlargement frame from moving to outside the rectangleL circumscribed around the circular regionL, in which the left image is displayed, in other words, keeps the enlargement range indicated by the enlargement frame from including outside the range of the rectangleL.
1108 50 1108 50 1109 1108 50 1111 In step S, the system control unitdetermines whether the direction instruction is an upward direction instruction. If it is determined that the direction instruction is an upward direction instruction (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1109 50 1109 50 1110 1109 50 1112 In step S, the system control unitdetermines whether the Y coordinate of the center of the enlargement frame obtained before the instruction is received is Y=YminL. If so (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1110 50 1109 1302 1311 1107 50 1302 13 FIG. In step S, the system control unitdoes not move the enlargement frame. A result of the determination in step Sbeing YES reveals that the upper side of the enlargement frame which is displayed before a direction instruction is issued by the user is inscribed in the rectangleL illustrated in. If, in response to an instruction for an upward direction being issued in such a state, the enlargement frame is moved a distance corresponding to one pixel in an upward direction, a region in which no optical image is formed (region) becomes included in an enlargement range indicated by the enlargement frame (a range targeted for enlargement). As also mentioned above in step S, since, if such control is performed, the user may feel that usability is low, the system control unitkeeps the enlargement frame from including outside the range of the rectangleL.
1111 50 1111 50 1113 1111 50 1112 In step S, the system control unitdetermines whether the Y coordinate of the center of the enlargement frame obtained before the instruction is received is Y=YmaxL. If so (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1112 1106 50 28 In step S, as with step S, the system control unitmoves the display position of the enlargement frame in the direction designated by the direction instruction. At this time, the amount of movement by which the display position moves according to one occurrence of a direction instruction is assumed to be an amount corresponding to one pixel of the display unit.
1113 50 1111 1302 1311 1107 1110 50 1302 13 FIG. In step S, the system control unitdoes not move the enlargement frame. A result of the determination in step Sbeing YES reveals that the lower side of the enlargement frame which is displayed before a direction instruction is issued by the user is inscribed in the rectangleL illustrated in. If, in response to an instruction for a downward direction being issued in such a state, the enlargement frame is moved a distance corresponding to one pixel in a downward direction, a region in which no optical image is formed (region) becomes included in an enlargement range indicated by the enlargement frame (a range targeted for enlargement). As also mentioned above in steps Sand S, since, if such control is performed, the user may feel that usability is low, the system control unitkeeps the enlargement frame from including outside the range of the rectangleL.
11 FIG.B 13 FIG. 1310 Similarly, calculation processing which is performed in a case where the display region of the enlargement frame which has been displayed before a movement instruction (direction instruction) for the enlargement frame is issued is a right region is described with reference to. The right region mentioned herein refers to the regionR illustrated in.
1121 50 82 74 601 1121 50 1122 1121 50 1124 6 FIG. In step S, the system control unitdetermines whether the direction instruction is a rightward direction instruction. The instruction in this step refers to an instruction issued by the user via the MCor the arrow keysin step Sillustrated in. If it is determined that the direction instruction is a rightward direction instruction (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1122 50 1122 50 1123 1122 50 1126 In step S, the system control unitdetermines whether the X coordinate of the center of the enlargement frame obtained before the instruction is received is X=XmaxR. If so (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1123 50 1107 1311 50 1302 1301 1302 In step S, the system control unitdoes not move the enlargement frame. As mentioned above in step S, if the enlargement frame is moved a distance corresponding to one pixel in a leftward direction in response to the user instruction, a region in which no optical image is formed (region) becomes included in an enlargement range indicated by the enlargement frame (a range targeted for enlargement). If such control is performed, the user may feel that usability is low. Therefore, the system control unitkeeps the enlargement frame from moving to outside the rectangleR circumscribed around the circular regionR, in which the right image is displayed, in other words, keeps the enlargement range indicated by the enlargement frame from including outside the range of the rectangleR.
1124 50 1124 50 1125 1124 50 1128 In step S, the system control unitdetermines whether the direction instruction is a leftward direction instruction. If it is determined that the direction instruction is a leftward direction instruction (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1125 50 1125 50 1127 1125 50 1126 In step S, the system control unitdetermines whether the X coordinate of the center of the enlargement frame obtained before the instruction is received is X=XminR. If so (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1126 50 28 In step S, the system control unitmoves the display position of the enlargement frame in the direction designated by the direction instruction. At this time, the amount of movement by which the display position moves according to one occurrence of a direction instruction is assumed to be an amount corresponding to one pixel of the display unit.
1127 50 50 In step S, the system control unitmoves the enlargement frame to X=XmaxL. At this time, the system control unitmoves the enlargement frame in such a manner that the X coordinate of the center of the enlargement frame becomes X=XmaxL.
1128 50 1128 50 1129 1128 50 1131 In step S, the system control unitdetermines whether the direction instruction is an upward direction instruction. If it is determined that the direction instruction is an upward direction instruction (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1129 50 1129 50 1130 1129 50 1132 In step S, the system control unitdetermines whether the Y coordinate of the center of the enlargement frame obtained before the instruction is received is Y=YminR. If so (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1130 50 1110 1311 50 1302 In step S, the system control unitdoes not move the enlargement frame. As mentioned above in step S, if the enlargement frame is moved a distance corresponding to one pixel in an upward direction in response to the user instruction, a region in which no optical image is formed (region) becomes included in an enlargement range indicated by the enlargement frame (a range targeted for enlargement). Since, if such control is performed, the user may feel that usability is low, the system control unitkeeps the enlargement range indicated by the enlargement frame from including outside the range of the rectangleR.
1131 50 1131 50 1133 1131 50 1132 In step S, the system control unitdetermines whether the Y coordinate of the center of the enlargement frame obtained before the instruction is received is Y=YmaxR. If so (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
1132 1126 50 28 In step S, as with step S, the system control unitmoves the display position of the enlargement frame in the direction designated by the direction instruction. At this time, the amount of movement by which the display position moves according to one occurrence of a direction instruction is assumed to be an amount corresponding to one pixel of the display unit.
1133 50 1113 1311 50 1302 In step S, the system control unitdoes not move the enlargement frame. As mentioned above in step S, if the enlargement frame is moved a distance corresponding to one pixel in a downward direction in response to the user instruction, a region in which no optical image is formed (region) becomes included in an enlargement range indicated by the enlargement frame (a range targeted for enlargement). Since, if such control is performed, the user may feel that usability is low, the system control unitkeeps the enlargement range indicated by the enlargement frame from including outside the range of the rectangleR.
1311 50 1311 1302 1302 1301 1301 50 50 418 416 50 608 609 50 50 50 4 FIG. 10 10 FIG.A orB 6 FIG. 11 11 FIG.A orB In the present exemplary embodiment, control is performed in such a manner that the percentage in which the left image or the right image is included in the enlargement range indicated by the enlargement frame is set at least greater than or equal to one-half (50% or more) of the size of the enlargement frame and the percentage in which the hatched portion (region) is included therein is set less than or equal to one-half (50%) of the size of the enlargement frame. However, even one pixel of the left image or the right image only needs to be included in the enlargement range indicated by the enlargement frame, and the system control unitonly needs to prevent all of the regions included in the enlargement range from becoming a region in which no optical image is formed, i.e., the hatched portion (region). Thus, in the present exemplary embodiment, the rectangleL orR in which the enlargement frame is movable does not necessarily need to be circumscribed around the circular regionL orR or be a rectangle, or such a region does not need to be provided (calculated). For example, in a case where a touch operation or a movement operation has been performed, the system control unitperforms determination of a target range included in the current enlargement frame. In a case where a touch operation has been performed, the system control unitdetermines whether a portion in which an optical image for the left or right image is formed is included in a target range included in the enlargement frame which has been moved in such a manner that the position of the touch operation becomes the center of the enlargement frame in step Sor Sillustrated in(corresponding to). In a case where a movement operation (direction instruction) has been performed, the system control unitdetermines whether a portion in which an optical image for the left or right image is formed is included in a target range included in the enlargement frame which has been moved in step Sor Sillustrated in(corresponding to). The system control unitcan determine whether only one pixel of an optical image for the left image or the right image is included in a target range included in the enlargement frame obtained before being moved. If even one pixel of the optical image is included in a target range for the enlargement frame obtained after being displayed and moved, the system control unitsets the enlargement frame movable, and, if no pixel of the optical image is included in the target range, the system control unitsets the enlargement frame immovable.
82 74 Thus far is the flow for movement control for items such as the enlargement frame and the focus guide in a case where a direction instruction by, for example, the MCor the arrow keyshas been input.
82 75 50 50 50 Next, control which is performed in a case where an operation for returning the display positions of items such as the enlargement frame and the focus guide to predetermined positions has been performed is described. In response to receiving a predetermined operation (e.g., pushing of the MCor pressing of the SET button), the system control unitdisplays items such as the enlargement frame and the focus guide at predetermined positions. In a case where a dual-lens image is displayed, in response to receiving a predetermined operation, the system control unitdisplays the items at the center of any one of the right region and the left region in which the items are displayed before reception of the predetermined operation. On the other hand, in a case where a dual-lens image is not displayed, in response to receiving a predetermined operation, the system control unitdisplays the items at the center of the screen. This enables adaptively controlling the display positions of the items according to whether the displayed image is a dual-lens image.
610 50 82 75 610 50 611 610 50 801 82 75 8 FIG.A In step S, the system control unitdetermines whether pushing of the center of the MC(not a movement operation for up, down, left, or right) or pressing of the SET buttonhas been performed. If it is determined that the pushing or pressing has been performed (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step Sillustrated in. It can be said that pushing of the MCor pressing of the SET buttonin this step is a center movement instruction for moving (returning) the currently displayed enlargement frame to the center of an LV image in the region in which the enlargement frame is displayed.
611 413 50 6 10 611 50 616 611 50 612 In step S, as with step S, the system control unitacquires the type of the lens mounted via the communication terminal groupsandand determines whether the mounted lens is a dual lens. If it is determined that the mounted lens is a dual lens (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
612 419 50 100 612 50 613 612 50 614 In step S, as with step S, the system control unitdetermines whether the current focus mode of the digital camerais an AF mode or an MF mode. If it is determined that the current focus mode is the AF mode (AF in step S), the system control unitadvances the processing to step S, and, if it is determined that the current focus mode is the MF mode (MF in step S), the system control unitadvances the processing to step S.
613 50 28 In step S, the system control unitmoves the AF frame to the center of an LV image displayed on the display unit.
614 50 28 In step S, the system control unitmoves the focus guide to the center of an LV image displayed on the display unit.
615 50 28 In step S, the system control unitmoves the enlargement frame to the center of an LV image displayed on the display unitin conjunction with the position of the AF frame or a focus detection area of the focus guide.
616 50 50 701 616 50 618 616 50 617 7 FIG.B In step S, the system control unitdetermines whether the enlargement frame is currently displayed in an LV image in the right region. Thus, the system control unitdetermines whether the enlargement frame is currently displayed in the regionR illustrated in. If so (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
617 616 50 50 701 7 FIG.B In step S, since a result of the determination in step Sis NO, the system control unitmoves the display position of the enlargement frame to the center of an LV image displayed in the left region. Thus, the system control unitmoves the display position of the enlargement frame to the center of an LV image displayed in the regionL illustrated in.
618 616 50 50 701 7 FIG.B In step S, since a result of the determination in step Sis YES, the system control unitmoves the display position of the enlargement frame to the center of an LV image displayed in the right region. Thus, the system control unitmoves the display position of the enlargement frame to the center of an LV image displayed in the regionR illustrated in.
Thus far is the flow representing control which is performed in a case where an operation for returning the display positions of items such as the enlargement frame and the focus guide to predetermined positions has been performed.
410 22 4 FIG. 12 FIG. 13 FIG. Processing, which is started in a case where a result of the determination in step Sillustrated inis YES, i.e., in a case where it is determined that a dual lens is mounted, for calculating the centers and sizes of two LV images (a left image and a right image) with use of lens information such as that illustrated inand determining positions at which two LV images are displayed in one optical image captured by the imaging unitand composed of two LV images and a blank (hatched) region is described with reference to.
4 FIG. 6 FIG. 50 1302 1302 50 In the case of moving the enlargement frame in such a way as illustrated inand, at the time of moving the enlargement frame on two LV images, if the enlargement frame is made movable to the blank portion, no LV image may be included in an image enlarged and displayed at the time of execution of enlargement. Alternatively, a large portion of the image enlarged and displayed may be a blank region and include only a small portion of an LV image, so that this has a high probability of causing confusion for the user. Therefore, the system control unitcalculates two rectangular regions (regionsL andR) in which circular regions, which are display regions of two LV images, are respectively inscribed, and, in a case where a movement instruction for the enlargement frame has been issued by the user, the system control unitmakes the enlargement frame movable only within the calculated rectangular regions.
50 1302 1302 1302 1302 1301 1301 1301 1301 1201 301 1201 301 1300 50 6 10 1203 1203 1200 1201 1201 12 FIG. First, the system control unitcalculates the center position of each of the rectangular regionsL andR from the acquired lens information illustrated in. The rectangular regionsL andR are rectangles circumscribed around the circular regionsL andR, respectively. The circular regionsL andR are regions obtained by converting a circular optical imageL, which is formed by the right eye optical systemR, and a circular optical imageR, which is formed by the left eye optical systemL, onto a logical coordinate system, respectively. The system control unitacquires, from the lens mounted via the communication terminal groupsand, distancesL andR between the center position of a physical coordinate systemfor optical images and the center positions of the circular optical imagesL andR, respectively.
1304 1304 1302 1302 1303 1300 1203 1203 1304 1303 1203 L=−(L÷k) 1304 1303 1203 R=−(R÷k) The center positionsL andR of the rectangular regionsL andR can be expressed by the following equations with use of the center positionof the logical coordinate systemfor optical images, a conversion coefficient k determined by the ratio between sizes of the physical coordinate system and logical coordinate system, and the distancesL andR.
50 1302 1302 50 1204 1204 1201 1201 1302 1302 1204 1204 12 FIG. 1302 1204 Size ofL=(L÷k)×2 1302 1204 Size ofR=(R÷k)×2 Next, the system control unitcalculates the sizes of the rectangular regionsL andR from the lens information. The system control unitacquires the radiiL andR of the respective circular optical imagesL andR from the lens information, as illustrated in. The sizes of the rectangular regionsL andR can be expressed by the following equations with use of a conversion coefficient k determined by the ratio between sizes of the physical coordinate system and logical coordinate system and the radiiL andR.
1203 1203 1204 1204 1302 1302 The distancesL andR and the radiiL andR are determined by the type of the lens, and the conversion coefficient k for converting the physical coordinate system for optical images into the logical coordinate system is determined by the type of the image sensor. Performing calculation in this way enables obtaining the center positions and sizes of the rectangular regionsL andR even if the type of the lens or the type of the image sensor changes.
50 1302 1302 10 10 FIGS.A andB The system control unitis able to determine coordinates for use in performing movement restriction of the enlargement frame, described above with reference to, from the center positions and sizes of the rectangular regionsL andR and the size of the enlargement frame.
50 1302 Thus, the system control unitis able to obtain XminL, XmaxL, YminL, and YmaxL from the sizes of the rectangular regionL and the enlargement frame.
1302 50 1304 XminL and XmaxL represent coordinates in the horizontal axis (X-axis) direction, and become coordinates indicating that the enlargement frame is in contact with the inside of the left or right side of the rectangleL when the central coordinate position of the enlargement frame has arrived at XminL or XmaxL. The system control unitperforms control in such a manner that, when a movement instruction for a direction opposite to the center positionL as viewed from the enlargement frame is issued in a state in which the central coordinate position of the enlargement frame has arrived at XminL or XmaxL, the enlargement frame is limited in movement or is caused to jump to the other LV image (rectangular region).
1302 1302 1304 1302 XminL represents the center position of the enlargement frame obtained in a state in which the left side of the enlargement frame is in contact with the left side of the rectangleL. Thus, XminL denotes a value obtained by subtracting a distance corresponding to one-half of the size of the enlargement frame in the horizontal direction (X-direction) inside the rectangleL and on the side of the center positionL, from the X coordinate of the left side of the rectangleL.
1302 1302 1304 1302 XmaxL represents the center position of the enlargement frame obtained in a state in which the right side of the enlargement frame is in contact with the right side of the rectangleL. Thus, XmaxL denotes a value obtained by subtracting a distance corresponding to one-half of the size of the enlargement frame in the horizontal direction (X-direction) inside the rectangleL and on the side of the center positionL, from the X coordinate of the right side of the rectangleL.
1302 50 1304 YminL and YmaxL represent coordinates in the vertical axis (Y-axis) direction, and become coordinates indicating that the enlargement frame is in contact with the inside of the upper or lower side of the rectangleL when the central coordinate position of the enlargement frame has arrived at YminL or YmaxL. The system control unitperforms control in such a manner that, when a movement instruction for a direction opposite to the center positionL as viewed from the enlargement frame is issued in a state in which the central coordinate position of the enlargement frame has arrived at YminL or YmaxL, the enlargement frame is limited in movement.
1302 1302 1304 1302 YminL represents the center position of the enlargement frame obtained in a state in which the upper side of the enlargement frame is in contact with the upper side of the rectangleL. Thus, YminL denotes a value obtained by subtracting a distance corresponding to one-half of the size of the enlargement frame in the vertical direction (Y-direction) inside the rectangleL and on the side of the center positionL, from the Y coordinate of the upper side of the rectangleL.
1302 1302 1304 1302 YmaxL represents the center position of the enlargement frame obtained in a state in which the lower side of the enlargement frame is in contact with the lower side of the rectangleL. Thus, YmaxL denotes a value obtained by subtracting a distance corresponding to one-half of the size of the enlargement frame in the vertical direction (Y-direction) inside the rectangleL and on the side of the center positionL, from the Y coordinate of the lower side of the rectangleL.
50 1302 1302 1305 Similarly, the system control unitis able to obtain XminR, XmaxR, YminR, and YmaxR from the sizes of the rectangular regionR and the enlargement frame. Unlike the case of the rectangular regionL, such coordinates are in reflective symmetry with respect to the line.
1302 50 1304 As with XminL and XmaxL, XminR and XmaxR represent coordinates in the horizontal axis (X-axis) direction, and become coordinates indicating that the enlargement frame is in contact with the inside of the left or right side of the rectangleR when the central coordinate position of the enlargement frame has arrived at XminR or XmaxR. The system control unitperforms control in such a manner that, when a movement instruction for a direction opposite to the center positionR as viewed from the enlargement frame is issued in a state in which the central coordinate position of the enlargement frame has arrived at XminR or XmaxR, the enlargement frame is limited in movement or is caused to jump to the other LV image (rectangular region).
1302 1302 1302 1304 1302 1302 1304 1302 XminR represents the center position of the enlargement frame obtained in a state in which the left side of the enlargement frame is in contact with the left side of the rectangleR, and XmaxR represents the center position of the enlargement frame obtained in a state in which the right side of the enlargement frame is in contact with the right side of the rectangleR. XminR denotes a value obtained by subtracting a distance corresponding to one-half of the size of the enlargement frame in the horizontal direction (X-direction) inside the rectangleR and on the side of the center positionR, from the X coordinate of the left side of the rectangleR, and XmaxR denotes a value obtained by subtracting a distance corresponding to one-half of the size of the enlargement frame in the horizontal direction (X-direction) inside the rectangleR and on the side of the center positionR, from the X coordinate of the right side of the rectangleR.
1302 50 1304 As with YminL and YmaxL, YminR and YmaxR represent coordinates in the vertical axis (Y-axis) direction, and become coordinates indicating that the enlargement frame is in contact with the inside of the upper or lower side of the rectangleL when the central coordinate position of the enlargement frame has arrived at YminR or YmaxR. The system control unitperforms control in such a manner that, when a movement instruction for a direction opposite to the center positionR as viewed from the enlargement frame is issued in a state in which the central coordinate position of the enlargement frame has arrived at YminR or YmaxR, the enlargement frame is limited in movement.
1302 1302 1302 1304 1302 1302 1304 1302 YminR represents the center position of the enlargement frame obtained in a state in which the upper side of the enlargement frame is in contact with the upper side of the rectangleR, and YmaxR represents the center position of the enlargement frame obtained in a state in which the lower side of the enlargement frame is in contact with the lower side of the rectangleR. Thus, YminR denotes a value obtained by subtracting a distance corresponding to one-half of the size of the enlargement frame in the vertical direction (Y-direction) inside the rectangleR and on the side of the center positionR, from the Y coordinate of the upper side of the rectangleR, and YmaxR denotes a value obtained by subtracting a distance corresponding to one-half of the size of the enlargement frame in the vertical direction (Y-direction) inside the rectangleR and on the side of the center positionR, from the Y coordinate of the lower side of the rectangleR.
1304 1304 1301 1301 50 1302 1302 XminL and XminR, XmaxL and XmaxR, YminL and YminR, and YmaxL and YmaxR vary according to lens information which is acquired, i.e., the values of the center positionsL andR and the circular regionsL andR. For example, even in the case of a dual lens, different pieces of lens information may be acquired depending on, for example, parameters used at the time of manufacturing thereof. Therefore, XminL and XminR, XmaxL and XmaxR, YminL and YminR, and YmaxL and YmaxR do not necessarily coincide with each other. Thus, the system control unitobtains the center positions and sizes of the rectangular regionsL andR from respective pieces of lens information about the left and right optical systems, and calculates the X coordinate and Y coordinate to perform different control operations depending on the display position of the enlargement frame.
50 82 74 1302 1302 1301 1301 As described above, the system control unitperforms control in such a manner that, when a position designation by a touch operation or a direction instruction (movement instruction) by the MCor the arrow keyshas been performed, the central coordinate position of the enlargement frame indicating an enlargement region does not move to outside a rectangular region in which an LV image displayed in a circular shape is inscribed. Thus, even if an instruction is issued by the user, the central coordinate position of the enlargement frame does not move to regions other than the rectangular regionsL andR in which the circular regionsL andR are respectively inscribed. Performing such control prevents a region in which no LV image is displayed from being displayed in an enlarged manner when an enlargement instruction is issued by the user, and enables reducing the probability of the user being confused. Additionally, performing enlargement display enables checking every detail of an LV image in more detail.
78 Next, enlargement processing and change processing for an enlargement factor which are performed when the enlargement buttonhas been pressed are described.
8 8 FIGS.A andB 8 8 FIGS.A andB 9 9 9 9 9 9 FIGS.A,B,C,D,E, andF 9 9 FIGS.A toF 8 8 FIGS.A andB 28 28 are control flowcharts concerning an enlargement operation and an image capturing operation for an LV image which is displayed on the display unitin the present exemplary embodiment. Examples of displaying on the display unitin a case where the control flowcharts ofare performed are described with reference to. Furthermore, details of display examples illustrated inare described below after the control flowcharts ofare described.
801 50 78 78 801 50 802 801 50 819 78 70 a In step S, the system control unitdetermines whether the enlargement buttonhas been pressed. If it is determined that the enlargement buttonhas been pressed (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S. While, in the present exemplary embodiment, an enlargement instruction by the user is assumed to be pressing of the enlargement button, the present exemplary embodiment is not limited to this, and, for example, pinch-out on the touch panelcan be set as an instruction for enlargement display and pinch-in thereon can be set as an instruction for cancellation of enlargement display.
802 410 50 6 10 802 50 803 802 50 812 In step S, as with step S, the system control unitacquires the type of the lens mounted via the communication terminal groupsandand determines whether the mounted lens is a dual lens. If it is determined that the mounted lens is a dual lens (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
803 50 28 28 28 9 9 FIGS.C andD In step S, the system control unitenlarges an LV image in a position at which the enlargement frame is displayed six times and displays the enlarged LV image on the display unit. The size of the enlargement frame which is displayed before enlargement processing is performed is assumed to be previously set in such a manner that the entirety of the enlarged image is displayed on the display unitin a case where enlargement processing with an enlargement factor of six times is performed. Such an enlargement factor of six times is an enlargement factor that is based on a state in which an LV image to be displayed on the display unitis not enlarged (is displayed at a unit magnification). Display examples at that time are illustrated in.
804 50 804 50 805 804 50 806 82 74 70 6 FIG. a. In step S, the system control unitdetermines whether a movement operation for the enlargement position (a region being enlarged) has been performed. If it is determined that a movement operation for the enlargement position has been performed (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S. The movement operation for the enlargement position is assumed to be a direction instruction by the MCor the arrow keys, as mentioned in the flowchart of. Furthermore, the movement operation for the enlargement position can be performed by an operation on the touch panel
805 50 28 804 705 705 50 In step S, the system control unitmoves the enlargement position only within a region being currently enlarged out of left and right display regions for two LV images which are displayed on the display unit, based on the movement operation for the enlargement position in step S. In other words, even if, in a state in which the region targeted for enlargement processing is in contact with the linein any one of the left and right regions, a movement operation for bringing the center of the enlargement position further close to the lineis performed, the system control unitdisables the movement operation and thus does not move the enlargement position.
607 614 28 In the case of the movement of the enlargement frame when an LV image is in the state of a unit magnification as mentioned in steps Sto S, since the user is able to visually recognize the enlargement frame displayed on the display unit, even if the enlargement frame is made movable from one region currently used for displaying to the other region, the user never loses the enlargement frame. On the other hand, if, in a state in which the enlarged image is being displayed, the enlargement position is moved in such a way as to span the regions, it is difficult for the user to intuitively know which position the enlarged image is showing.
705 50 Suppose a case where the user wants to check the left end of an LV image in the right region (a state in which the left side of the enlargement position is in contact with the line) in more detail. If, in response to the user unintentionally performing a movement operation for the enlargement frame while checking the enlarged and displayed region of the left end of an LV image in the right region, a region to be enlarged and displayed becomes an LV image of the right end of an LV image in the left region, this may cause confusion for the user. Therefore, in a state in which the enlarged image is being displayed, in a case where, when a movement instruction for the enlargement position is issued by the user, the enlargement position is an end portion of each LV image, the system control unitprevents the enlargement position from moving between left and right regions.
806 50 806 50 807 806 50 808 In step S, the system control unitdetermines whether a left-right switching operation has been performed. If it is determined that a left-right switching operation has been performed (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S. The left-right switching operation refers to a switching operation from one image to the other image out of two images displayed side by side in the left-right direction. Specifically, the left-right switching operation is assumed to be pressing of a button having a left-right switching function (for example, an INFO button (not illustrated)).
807 50 50 50 50 28 In step S, the system control unitmoves the enlargement position from one region in which the enlargement position is set before the button having a left-right switching function is pressed to the other region and then performs enlargement displaying in the other region. At this time, the system control unitmoves the enlargement position in such a manner that the relative position of the enlargement position in the region in which the enlargement position is set before the button having a left-right switching function is pressed is kept even after the enlargement position is moved to the other region. For example, when enlarging an LV image in the right region, the system control unitcalculates a distance from the center of the LV image in the right region to the enlargement position. In response to a left-right switching operation being performed by the user, the system control unitapplies the calculated distance from the center of the LV image to the enlargement position to a distance from the center of an LV image in the opposite region (here, the left region) to the enlargement position and then performs enlargement displaying at the enlargement position on the display unit.
With such control performed, in a case where the user wants to check the same positions of both left and right LV images displayed side by side in the left-right direction, the user is enabled to simply perform left-right switching of left and right LV images with a smaller number of operations, so that the user does not need to spend much time on image capturing.
808 50 78 78 808 50 809 808 50 804 In step S, the system control unitdetermines whether the enlargement buttonhas been pressed. If it is determined that the enlargement buttonhas been pressed (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitreturns the processing to step S.
809 50 52 28 809 50 810 809 50 811 In step S, the system control unitrefers to the system memoryand determines whether the enlargement factor for an LV image to be displayed on the display unitis 15 times. If it is determined that the enlargement factor is 15 times (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
810 50 28 9 9 FIGS.A andB In step S, the system control unitcancels the enlargement state for an LV image and displays an LV image which is not enlarged (is at a unit magnification) on the display unit. Display examples at that time are illustrated in.
811 50 28 9 9 FIGS.E andF In step S, the system control unitperforms enlargement displaying of an LV image at an enlargement factor of 15 times at the display position of the enlargement frame superimposed on the LV image on the display unit. Such an enlargement factor of 15 times is an enlargement factor that is based on an LV image which is not enlarged (is displayed at a unit magnification). Display examples at that time are illustrated in.
812 802 50 28 In step S, since a result of the determination in step Sis NO, the system control unitperforms enlargement displaying of an LV image at an enlargement factor of six times at the display position of the enlargement frame superimposed on the LV image on the display unit. Such an enlargement factor of six times is an enlargement factor that is based on an LV image which is not enlarged (is displayed at a unit magnification).
813 804 50 813 50 814 813 50 815 In step S, as with step S, the system control unitdetermines whether a movement operation for the enlargement position has been performed. If it is determined that a movement operation for the enlargement position has been performed (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
814 50 802 100 28 50 805 In step S, the system control unitmoves the enlargement position within the display region for an LV image based on the movement operation for the enlargement position. In this step, a result of the determination in step Sbeing NO makes it known that the lens mounted on the digital camerais a single lens or no lens is mounted thereon. Thus, since only one LV image is displayed on the display unit, the system control unitis able to move the enlargement position without taking into consideration left and right regions such as in step S.
815 808 50 78 78 815 50 816 815 50 813 In step S, as with step S, the system control unitdetermines whether the enlargement buttonhas been pressed. If it is determined that the enlargement buttonhas been pressed (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitreturns the processing to step S.
816 50 52 816 50 817 816 50 818 In step S, the system control unitrefers to the system memoryand determines whether the enlargement factor for an LV image currently displayed is 15 times. If it is determined that the enlargement factor is 15 times (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
817 810 50 28 In step S, as with step S, the system control unitcancels the enlargement state for an LV image and displays an LV image which is not enlarged (is at a unit magnification) on the display unit.
818 50 28 In step S, the system control unitperforms enlargement displaying of an LV image at an enlargement factor of 15 times at the display position of the enlargement frame superimposed on the LV image on the display unit. Such an enlargement factor of 15 times is an enlargement factor that is based on an LV image which is not enlarged (is displayed at a unit magnification).
819 50 62 62 819 50 820 819 50 829 62 61 In step S, the system control unitdetermines whether the first shutter switchhas been turned on. If it is determined that the first shutter switchhas been turned on (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S. The first shutter switchbeing turned on refers to a state in which the shutter buttonis in a half-pressed state as mentioned above. Thus, it is supposable that the user is going to perform image capturing.
820 410 50 6 10 820 50 823 820 50 821 In step S, as with step S, the system control unitacquires the type of the lens mounted via the communication terminal groupsandand determines whether the mounted lens is a dual lens. If it is determined that the mounted lens is a dual lens (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
821 50 821 50 822 821 50 823 150 In step S, the system control unitdetermines whether the focus mode is set to the AF mode. If it is determined that the focus mode is set to the AF mode (YES in step S), the system control unitadvances the processing to step S, and, if not so (if it is determined that the focus mode is set to the MF mode) (NO in step S), the system control unitadvances the processing to step S. Switching between the AF mode and the MF mode is performed via, for example, a setting menu screen or a switch mounted on the exterior portion of the lens unit.
822 50 In step S, the system control unitperforms AF processing based on the position of the AF frame.
823 50 In step S, the system control unitperforms other image capturing preparation operations such as automatic exposure (AE) and automatic white balance (AWB).
824 50 64 64 61 824 50 825 824 50 828 In step S, the system control unitdetermines whether the second shutter switchhas been turned on. If it is determined that the second shutter switchhas been turned on, i.e., the shutter buttonhas been fully pressed (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
825 410 50 6 10 825 50 826 825 50 827 In step S, as with step S, the system control unitacquires the type of the lens mounted via the communication terminal groupsandand determines whether the mounted lens is a dual lens. If it is determined that the mounted lens is a dual lens (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
826 50 200 In step S, the system control unitperforms a series of image capturing processing operations until recording, for example, an image captured via a dual lens and dual-lens information as an image file on the recording medium.
827 50 200 In step S, the system control unitperforms a series of image capturing processing operations until recording, for example, a captured image captured and ordinary (single-lens) information as an image file on the recording medium.
828 50 62 62 828 50 824 828 50 829 In step S, the system control unitdetermines whether the first shutter switchis kept turned on. If it is determined that the first shutter switchis kept turned on (YES in step S), the system control unitreturns the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S.
829 50 829 50 830 829 50 831 50 81 79 In step S, the system control unitdetermines whether any operation other than the above-mentioned operations has been detected. If it is determined that any other operation has been detected (YES in step S), the system control unitadvances the processing to step S, and, if not so (NO in step S), the system control unitadvances the processing to step S. Specifically, the system control unitdetermines whether pressing of, for example, the menu buttonor the playback buttonhas been detected.
830 50 81 50 79 50 200 28 In step S, the system control unitstarts performing other processing corresponding to the detected other operation. In a case where the menu buttonhas been pressed, the system control unitdisplays a setting menu screen, and, in a case where the playback buttonhas been pressed, the system control unitdisplays an image stored in the recording mediumon the display unit.
831 50 100 831 50 831 50 401 8 8 FIGS.A andB 4 FIG. In step S, the system control unitdetermines whether the image capturing waiting state has ended. For example, in a case where the image capturing waiting state has ended due to, for example, powering-off of the digital camera(YES in step S), the system control unitends the control flowcharts of, and, if not so (NO in step S), the system control unitreturns the processing to step Sillustrated in.
28 9 9 FIGS.A toF LV images each of which is displayed on the display unitwhen an enlargement instruction is issued by the user are described with reference to.
9 FIG.A 903 900 301 28 900 301 900 301 900 301 900 301 illustrates a display example in a case where the enlargement factor corresponds to a unit magnification (i.e., an unmagnified state) and the enlargement frameis displayed in the left region, i.e., in superimposition on an LV image (LV imageR) captured via the right eye optical systemR. On the display unit, the LV imageR captured via the right eye optical systemR and an LV imageL captured via the left eye optical systemL are displayed. As mentioned above, the LV imageR, which is displayed in the left region, is an image captured via the right eye optical systemR, and the LV imageL, which is displayed in the right region, is an image captured via the left eye optical systemL.
901 902 901 902 78 900 900 9 FIG.A 9 FIG.C 9 FIG.B To inform the user that inversion between left and right occurs, indication itemsandare displayed. The indication itemis displayed as “R”, which indicates right, and the indication itemis displayed as “L”, which indicates left. In the state illustrated in, in response to the enlargement buttonbeing pressed once, a transition to a state illustrated inoccurs, and, in response to a left-right switching button (not illustrated) being pressed once, the enlargement frame superimposed on the LV imageR moves to the relatively same position in the LV imageL and a transition to a state illustrated inoccurs.
9 FIG.B 9 FIG.B 9 FIG.B 9 FIG.D 9 FIG.A 904 900 301 904 900 78 900 900 illustrates a display example in a case where the enlargement factor corresponds to a unit magnification (i.e., an unmagnified state) and the enlargement frameis displayed in the right region, i.e., in superimposition on an LV image (LV imageL) captured via the left eye optical systemL. In, the enlargement frameis displayed in superimposition on the LV imageL. In the state illustrated in, in response to the enlargement buttonbeing pressed once, a transition to a state illustrated inoccurs, and, in response to the left-right switching button being pressed once, the enlargement frame superimposed on the LV imageL moves to the relatively same position in the LV imageR and a transition to the state illustrated inoccurs.
9 FIG.C 900 901 28 910 illustrates a display example in a case where the LV imageR has been enlarged at an enlargement factor of six times. The indication item, which indicates via which optical system the enlarged image displayed on the display unithas been captured, is displayed in superimposition on an LV imageR, which is an enlarged LV image.
9 FIG.D 900 902 28 910 illustrates a display example in a case where the LV imageL has been enlarged at an enlargement factor of six times. The indication item, which indicates via which optical system the enlarged image displayed on the display unithas been captured, is displayed in superimposition on an LV imageL, which is an enlarged LV image.
9 FIG.E 900 illustrates a display example in a case where the LV imageR has been enlarged at an enlargement factor of 15 times for display.
28 901 301 920 In the enlarged image displayed on the display unit, the indication item, which indicates an LV image captured via the right eye optical systemR, is displayed in superimposition on an LV imageR, which is an LV image enlarged 15 times.
9 FIG.F 900 illustrates a display example in a case where the LV imageL has been enlarged at an enlargement factor of 15 times for display.
28 902 301 920 In the enlarged image displayed on the display unit, the indication item, which indicates an LV image captured via the left eye optical systemL, is displayed in superimposition on an LV imageL, which is an LV image enlarged 15 times.
9 9 FIGS.A andB 9 9 FIGS.C andD 9 9 FIGS.E andF 28 28 28 Thus,illustrate LV images displayed on the display unitin a case where the enlargement factor corresponds to a unit magnification (i.e., an unmagnified state),illustrate LV images displayed on the display unitin a case where the enlargement factor is six times, andillustrate LV images displayed on the display unitin a case where the enlargement factor is 15 times.
78 28 900 900 Each time the enlargement buttonis pressed once, the enlargement factor for LV images to be displayed on the display unitis changed in order of unit magnification, six times, 15 times, and unit magnification. Moreover, if the left-right switching button is pressed, in a case where the enlargement factor corresponds to a unit magnification, switching is performed in such a way as to display the enlargement frame in superimposition on the other LV image. Thus, in a case where the enlargement frame is displayed in superimposition on the LV imageR, which is displayed in the left region, the display region is switched in such a way as to display the enlargement frame in superimposition on the LV imageL, which is displayed in the right region. In a case where the enlargement factor is other than a unit magnification, the enlargement position is switched to the region of the other LV image serving as the relatively same position. At this time, the enlargement factor is not changed.
Furthermore, while, in the above description, operations for, for example, an instruction for switching of the display mode, an instruction for movement for the enlargement frame or the enlargement position, and an instruction for enlargement are performed via operation buttons having respective dedicated functions, the respective functions can be allocated to buttons to which various optional functions are able to be allocated.
50 50 28 As described above, in a case where image capturing is performed with a lens including two optical systems (dual lens) mounted, during image capturing, the system control unitcauses the enlargement frame indicating the enlargement position of an LV image to include a region in which an optical image is formed (not to include only a region in which no optical image is formed). The system control unitdisplays two LV images captured via two optical systems side by side in the left-right direction on the display unit, and performs displaying and movement of the enlargement frame in such a way as not to include only a region in which no optical image is formed and in such a way as to include at least a part of a region (of a left image or a right image) in which an optical image is formed. With this control performed, when the user has issued an enlargement instruction, it is possible to prevent only a region in which no optical image is formed from being enlarged and displayed, and it is possible to reduce the user from becoming confused.
82 74 50 Moreover, in a case where two LV images are displayed at a unit magnification (in an unmagnified state), when a position designation by a touch operation or a direction instruction (movement instruction) by the MCor the arrow keyshas been performed, the system control unitperforms control in such a manner that the center of the enlargement frame does not move to outside a rectangular region in which an LV image displayed in a circular form is inscribed.
1311 1302 1302 1301 1301 1310 28 Thus, even if an instruction by the user has been issued, the central coordinate position of the enlargement frame does not move to the region, which represents a blank (hatched) portion obtained by excluding the rectangular regionsL andR circumscribed around the circular regionsL andR from the regionof the display unit. Performing such control enables preventing a region in which no LV image is displayed from being displayed in an enlarged manner when an enlargement instruction has been issued by the user, and enables reducing the probability of the user becoming confused. Additionally, performing such control enables checking every detail of an LV image in more detail.
50 50 On the other hand, in a case where any one of two LV images has been enlarged, even if a movement instruction for the enlargement position is issued in a state in which the enlargement frame has arrived at an end on the boundary side of the currently enlarged image (the right end in the case of enlarging the left region, and the left end in the case of enlarging the right region), the system control unitdoes not move the enlargement position in a direction designated by the movement instruction. Thus, in a situation in which it is difficult for the user to visually recognize the current enlargement position, the system control unitdoes not move the enlargement position beyond the region (a boundary between LV images). This enables reducing an unintended movement of the enlargement position beyond the boundary between LV images, and enables reducing the user from becoming confused.
50 50 50 28 Moreover, in a case where a lens including two optical systems (dual lens) is mounted, the system control unitcauses the focus guide and the enlargement frame not to move in conjunction with each other. With this control, in a case where two LV images are displayed, for example, at the time of mounting of a dual lens and it is difficult to check every detail of an LV image which is in an unenlarged state, there is a high possibility that the user wants to enlarge an LV image irrespective of the in-focus position and check the LV image in more detail. Therefore, without enabling enlarging only the position of the focus guide having a frame indicating the focus detection area, to enable the user to enlarge the desired position, the system control unitcauses the focus guide and the enlargement frame not to move in conjunction with each other. On the other hand, in a case where an ordinary lens (single lens) is mounted, the system control unitcauses the focus guide or the AF frame and the enlargement frame to move in conjunction with each other, so that, when the focus guide or the AF frame is moved, the position of the enlargement frame is also moved together. Since only one LV image is displayed at the time of mounting of a single lens and the LV image is displayed on the display unitin a size larger than in a case where two LV images are displayed, it is easy to check the LV image in the state of a unit magnification in more detail than at the time of mounting of a dual lens.
50 Furthermore, the above-described various control operations, which have been described as being performed by the system control unit, can be performed by one piece of hardware or can be performed by a plurality of pieces of hardware sharing processing operations to control the entire equipment.
Moreover, while the disclosure has been described in detail based on exemplary embodiments thereof, the disclosure is not limited to such specific exemplary embodiments, and various configurations which are included in a range not departing from the gist of the disclosure are also included in the disclosure. Additionally, the above-described exemplary embodiments represent only examples of implementation of the disclosure, and some or all of the above-described exemplary embodiments can be combined as appropriate.
100 Moreover, while, in the above-described exemplary embodiments, an example in which the disclosure is applied to the digital camerahas been described, the disclosure is not limited to this example, but can also be applied to electronic equipment capable of displaying images captured via two optical systems. Thus, the disclosure can be applied to, for example, a personal computer, a personal digital assistant (PDA), a mobile telephone terminal, a portable image viewer, a printer apparatus with a display, a digital photo frame, a music player, a gaming machine, a digital book reader, home electrical appliance, a vehicle-mounted apparatus, and medical equipment.
Moreover, the disclosure can be applied to not only an imaging apparatus body but also electronic equipment which communicates with an imaging apparatus (including a network camera) via wired or wireless communication to remotely control the imaging apparatus. Examples of the electronic equipment which remotely controls the imaging apparatus include a smartphone, a tablet personal computer (PC), and a desktop PC. The electronic equipment is able to communicate, to the imaging apparatus, commands for causing the imaging apparatus to perform various operations and settings based on an operation performed on the electronic equipment or a processing operation performed by the electronic equipment, thus remotely controlling the imaging apparatus. Moreover, the electronic equipment can be configured to receive a live view image captured by the imaging apparatus via wired or wireless communication and display the received live view image thereon.
Embodiment(s) of the disclosure can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random access memory (RAM), a read-only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.
According to aspects of the disclosure, it is possible to check every detail of an image, and it is possible to perform enlargement displaying in such a way as not to cause confusion for the user.
While the disclosure has been described with reference to exemplary embodiments, it is to be understood that the disclosure is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
April 16, 2025
June 11, 2026
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.