Information Processing Device, Information Processing Method, and Program

This application is a Continuation of application Ser. No. 18/044,280, filed Mar. 7, 2023, which is a National Stage Application of PCT/JP2021/033167, filed Sep. 9, 2021, and claims the benefit of Japanese Priority Patent Application JP 2020-166281 filed Sep. 30, 2020, the entire contents of which are incorporated herein by reference.

The present technology relates to an information processing device, an information processing method, and a program, and particularly relates to a technology suitable for creating an image collection of an event.

For example, there are services in which camera operators photograph an event related to marriage such as a wedding, a reception, a post-party, or the like, create a photo album as an image collection, and provide the photo album to participants or the like.

In this case, the camera operators or the like take in images captured by imaging devices in a personal computer, a smartphone, or the like after the end of the event, and edits the images using editing software or the like to create an image collection. Then, the image collection can be assumed to be provided by a social networking service (SNS), a cloud service, an e-mail, a message application, or the like.

Patent Document 1 below describes a technique for transferring images captured by cameras to smartphones or the like and sharing the images.

Patent Document 1: Japanese Patent Application Laid-Open No. 2016-81173

Meanwhile, an image collection of an event is fun for participants, and they often want to view the image collection as soon as possible after the end of the event.

For example, it is considered that the bride and groom and the participants can feel a greater excitement if the captured images can be viewed while the afterglow remains immediately after the end of the wedding or reception.

However, for example, in a case where a large number of photos are taken at a wedding, it is troublesome for the viewers to simply browse the photos in order, which is not appropriate.

Therefore, it is considered that an image collection edited using images selected from among a large number of images is created and can be browsed by the related parties. However, also in this case, for people who create an image collection such as camera operators or the like, it is a troublesome work to determine and select which image is added to the image collection among a large number of images.

Therefore, an object of the present disclosure is to provide an information processing function that assists creators in creating such an image collection.

An information processing device according to the present technology includes: a user interface control unit that performs processing of executing list display and individual display as display in which an image can be selected from an image group captured in a specific event, and processing of detecting an archive operation on the image displayed; and an event data management unit that performs processing of storing archive information indicating that an archive setting has been performed in association with the image targeted for the archive operation.

For example, a use case is assumed in which images (photos) are selected for creating an image collection or the like with respect to an image group which is a plurality of pieces of image data captured in an event such as a wedding or the like. In this case, images can be arbitrarily archived among a large number of images.

In the information processing device described above according to the present technology, it is conceivable to include a filter processing unit that performs filtering on the basis of the archive information, and the user interface control unit performs control such that images extracted by filtering are displayed in a list as the list display.

For example, filtering such as extraction of archived images, extraction of unarchived images, or the like is performed.

In the information processing device described above according to the present technology, it is conceivable that whether or not to perform the filtering based on the archive information or a filtering condition can be selected.

For example, it is made possible to select whether or not to perform filtering or a filtering condition, for example, extraction of images that can be set as archive, extraction of images that are not set as archive, or the like.

In the information processing device described above according to the present technology, it is conceivable that the user interface control unit performs control to provide a user interface capable of setting operation of selection information for creating an image collection by selectively using image data included in the image group, and the event data management unit performs processing of storing the archive information and the selection information as separate information. The selection information includes information indicating that an image is selected as an image to be used for the image collection, and the like. This is associated with the image as information different from the archive information.

In the information processing device described above according to the present technology, it is conceivable that the user interface control unit enables the archive operation for a display image at a time of the individual display.

In a state where one image is displayed, a user can perform an archive operation on the image.

In the information processing device described above according to the present technology, it is conceivable that the user interface control unit detects a swipe operation in a predetermined direction with respect to a display image as an archive operation with respect to the image.

For example, an operation of touching the image portion and swiping upward on the screen or the like is detected as the archive operation.

In the information processing device described above according to the present technology, it is conceivable that the user interface control unit performs control to execute display that enables cancellation of the archive operation for a predetermined time when the archive operation is detected.

For example, an undo instruction is enabled as a toast display at the time of the archive operation.

In the information processing device described above according to the present technology, it is conceivable to include an image analysis unit that performs image analysis on each image of the image group and determines eye closure of a subject person, and the event data management unit performs processing of storing eye closure information in association with an image determined to be of eye closure.

For example, an image group, which is a plurality of pieces of image data captured in an event such as a wedding or the like, is analyzed for each image, it is determined whether or not the subject person is in a state of closing eyes, and the determination result is stored as eye closure information.

In the information processing device described above according to the present technology, it is conceivable that the user interface control unit performs control to execute display indicating an image determined to be of eye closure on the basis of the eye closure information at a time of the list display or the individual display.

For example, an eye closure icon is displayed corresponding to an image.

In the information processing device described above according to the present technology, it is conceivable to include a filter processing unit that performs filtering on the basis of the eye closure information, and the user interface control unit performs control such that images extracted by the filtering are displayed in a list as the list display.

For example, images excluding eye closure images are displayed in a list.

In the information processing device described above according to the present technology, it is conceivable that whether or not to perform the filtering based on the eye closure information can be selected.

Whether or not to perform filtering of eye closure images, that is, whether or not to perform display can be selected.

In the information processing device described above according to the present technology, it is conceivable that the user interface control unit performs control to provide a user interface capable of setting operation of selection information for creating an image collection by selectively using image data included in the image group, and the event data management unit performs processing of storing the eye closure information and the selection information as separate information.

For example, similarly to the archive information, the eye closure information is also managed as information separate from the selection information.

In the information processing device described above according to the present technology, it is conceivable to include a filter processing unit that performs filtering on the basis of information of an imaging device that has captured an image, and the user interface control unit performs control such that images extracted by the filtering are displayed in a list as the list display.

For example, images captured by an imaging device of a specific model or a specific serial number are displayed in a list.

According to an information processing method of the present technology, an information processing device performs: processing of executing list display and individual display as display in which an image can be selected from an image group captured in a specific event, and processing of detecting an archive operation on the image displayed; and processing of storing archive information indicating that an archive setting has been performed in association with the image targeted for the archive operation.

These are support processing for improving the efficiency of the work of creating an image collection by camera operators or the like.

A program according to the present technology is a program that causes an information processing device to execute processing corresponding to such an information processing method.

<1. System Configuration and Work Procedure for Image Collection Providing Service> <2. Configuration of Information Processing Device> <3. Presetting Processing> <4. Transfer/Editing Processing> <5. Selection Processing> [5-1 Flow of Entire Selection] [5-2 Filter Processing Based on Archive and Eye Closure] [5-3 Cover and Highlight Selection] <6. Server Processing> <7. Web Gallery Delivery Processing> <8. Actual Delivery Processing> <9. Event View> <10. Conclusion and Modifications> Hereinafter, embodiments will be described in the following order.

In the embodiment, for example, a case is assumed that a camera operator performs still image capturing (photographing) at an event such as a wedding or the like, generates content as an image collection by captured images, and provides the content to a client for a fee or free of charge.

Note that not only still images but also moving images with audio or moving images without audio may be captured, and an image collection including these moving images or an image collection by a plurality of moving images may be generated.

For the sake of description, camera operators and assistants thereof are collectively referred to as camera staff.

In addition, the client is a generic term for not only the orderer but also users who can browse the image collection provided. For example, related parties such as the bride and groom, relatives, friends, and the like are collectively referred to as clients.

The image collection broadly refers to content in which images (still images and moving images) are collected such as a photo album, and the provision form thereof is not limited. However, in the present embodiment, as an example, an image collection as a web gallery and an image collection of actual delivery can be provided.

Here, the image collection of web gallery is, for example, an electronic image collection in which photos of an event can be quickly browsed on a website after the end of the event such as a wedding or the like. Note that, in the description, a website is used as an example, but this is merely an example, and a provision form in which a content file as an image collection can be transmitted to a terminal device of a client by using, for example, an e-mail, an electronic message, an SNS, or the like may be adopted.

In addition, the image collection of the actual delivery is, for example, an image collection of an event that the camera staff officially creates as a photo album and provides to the client at a later date. The image data captured in the event may be edited to form an electronic image collection as image album content, slide show content, or the like, or for example, an image collection by a paper medium may be created. The electronic image collection may be provided by download, streaming, or the like, or may be provided by being stored in a portable storage medium such as a disk-shaped storage medium, a card-shaped storage medium, a tape-shaped storage medium, or a flash memory medium.

In the present embodiment, as an image collection of web gallery, an image collection that can be quickly browsed by a client can be generated before an image collection of the actual delivery. In addition, the image collection of web gallery is not merely a simple arrangement of a large number of captured images, but is selected images and can have a quality that the viewer can enjoy.

On the other hand, the image collection of the actual delivery is regarded as being able to be created by the camera staff taking time to perform more creative editing.

1 FIG. 1 1 2 3 4 5 5 6 illustrates terminal devicesA andB, an imaging device, a personal computer, a server device, terminal devicesA andB, and a network.

1 1 1 Note that the terminal devicesA andB indicate terminal devices used by the camera staff, and these terminal devices are collectively referred to as a staff terminalfor distinction in description.

5 5 5 The terminal devicesA andB indicate terminal devices used by the users as the above-described clients, and these terminal devices are collectively referred to as a client terminalfor the sake of description.

1 5 Here, as the staff terminaland the client terminal, a portable terminal device such as a smartphone, a tablet device, and the like is exemplified.

1 1 For example, the terminal deviceA is assumed to be a smartphone used by a camera operator, and the terminal deviceB is assumed to be a smartphone or the like used by an assistant.

5 5 In addition, the terminal deviceA is assumed to be a smartphone used by the bride, and the terminal deviceB is assumed to be a tablet device or the like used by a friend in the venue.

1 5 1 5 The staff terminaland the client terminalmay be so-called information processing devices, and as specific examples thereof, various examples such as a personal computer device, a mobile phone device, a game device, an audio device, a video device, a communication device, a television device, and the like are assumed. That is, the staff terminalor the client terminalof the present disclosure can be an information processing device capable of performing information processing calculation, for example, a device incorporating a microcomputer.

However, since use in an event venue or the like is assumed, a portable terminal such as a smartphone, a tablet device, or the like is preferable.

2 2 As the imaging device, various imaging devices as a video camera or a still camera are assumed. The imaging deviceillustrated in the drawing is assumed to be a camera used by a camera operator in a venue of a wedding.

2 1 1 The imaging deviceand the staff terminal(for example, the terminal deviceA) can perform data communication. For example, data communication is performed by file transfer protocol (FTP) communication.

1 2 Specifically, it is conceivable that the terminal deviceA serves as an FTP server, and image files (including image data and metadata) captured by the imaging deviceare sequentially or collectively uploaded by FTP communication.

1 2 Therefore, it is assumed that FTP settings for performing data transfer to the terminal deviceA are set in the imaging device.

The content of the FTP setting information includes a host name, a save destination path, a user name, a password, a connection type, and the like of the FTP server.

2 1 However, the imaging deviceand the terminal deviceA are not necessarily limited to the FTP, and other protocols may be used.

2 1 In addition, it is sufficient that an image or metadata can be transferred between the imaging deviceand the terminal deviceA by any communication method. For example, mutual information communication may be performed by short-range wireless communication such as Bluetooth (registered trademark), wireless fidelity (WI-FI: registered trademark), near field communication (NFC: registered trademark), or the like, infrared communication, or the like.

2 1 Furthermore, the imaging deviceand the terminal deviceA may be communicable with each other by wired connection communication such as a wired LAN or the like.

3 The personal computeris exemplified as an information processing device used by a camera staff to create an image collection content of the actual delivery, for example.

3 4 The personal computeris used for work of acquiring data related to images of the event from the server deviceand creating an image collection content of the actual delivery by an image editing application or the like.

4 The server deviceprovides and manages various types of information in order for the camera staff to create a web gallery and an image collection of the actual delivery.

1 4 For example, the staff terminalhas installed an application program for the image collection providing service, and performs processing to be described later according to the application program. Correspondingly, the server devicemanages data related to the event, generates a web gallery, and the like.

1 4 For example, the staff terminaland the server deviceare always connected during activation of the application program described above, and event data is synchronized. Examples of the event data will be described later, and include image data captured in the event, data used for generating a web gallery, and the like.

1 4 In the present disclosure, “synchronization” means that at least a part of the content of the event data stored in the staff terminaland the content of the event data stored in the server deviceare maintained so as to have the same data content. In particular, the data to be synchronized includes image data, rating information, selection information, editing information, archive information, eye closure information, and the like. The respective contents will be described later.

6 As the network, for example, the Internet, a home network, a local area network (LAN), a satellite communication network, and various other networks are assumed.

1 4 6 The staff terminalcan upload image data and the like to the server devicevia the networkand can transmit information for synchronization.

5 4 6 The client terminalcan access a web page provided by the server devicevia the networkand browse the web gallery.

3 4 6 The personal computercan acquire an image file for creating the image collection content of the actual delivery from the server devicevia the network.

2 2 Note that the imaging deviceincludes, for example, a display device such as a display panel, a viewfinder, or the like provided on a device back surface, and can perform operation input with functions of various operators, a touch panel, and the like. That is, it has a sufficient function as a user interface. In addition, the imaging deviceis equipped with a microcomputer, and can perform various types of information processing and communication.

2 4 1 1 1 1 Therefore, it is also assumed that the imaging devicefunctions as the information processing device referred to in the present disclosure, communicates with the server devicewithout passing through the terminal devicesA andB, and executes processing performed by the terminal devicesA andB as described later.

1 4 2 1 In the embodiment, processing of the staff terminaland the server devicewill be mainly described, but an example in which the imaging deviceperforms all or part of the processing of the staff terminaldescribed below is also conceivable.

1 FIG. 2 FIG. 1 A schematic procedure of image collection provision implemented by the system as illustrated inwill be described with reference to. This is a work procedure in the staff terminalbased on an operation of a camera staff as a service provider.

1 1 2 Presetting is performed as step S. For example, the camera staff performs communication setting between the staff terminaland the imaging device, event setting, image retouch setting, and the like. This presetting is performed before the start of the wedding.

2 In step S, imaging/transfer/automatic editing during the wedding is performed.

2 1 1 The image file captured by the camera operator with the imaging deviceis sequentially transferred to the staff terminal(for example, the terminal deviceA).

1 4 The staff terminaltakes in the image file, transfers the image file and the like to the server device, automatically edits the images according to the presetting, and the like.

3 Step Sillustrates a work that can be performed on the day after the end of the wedding or the like.

1 1 4 The camera staff performs selection operation using the staff terminal. The selection includes selection of images to be posted on the web gallery, selection of cover images and highlight images, further editing of images, and the like. The staff terminalperforms update processing or the like of event data according to an operation of the camera staff. Processing for synchronizing the event data with the server deviceside is also sequentially performed.

3 Note that the selection in step Smay be performed while the wedding or the like is in progress.

4 4 1 In step S, web gallery delivery processing is performed. In the server device, a web gallery is created on the basis of the event data. The camera staff confirms the content of the web gallery on the staff terminaland then performs an operation to make the content browsable to the client. Therefore, for example, on the day after the end of the wedding or the like, the client can browse the web gallery that is an image collection of the wedding.

5 Step Sillustrates creation of an image collection of the actual delivery and actual delivery processing.

3 The camera staff creates the image collection content of the actual delivery at a later date using, for example, the personal computerand provides the image collection content to the client.

As a result, the client can receive the image collection content as the actual delivery.

3 FIG. 70 1 5 4 3 1 3 4 70 2 1 70 illustrates a configuration example of an information processing devicethat can be configured as the staff terminal, the client terminal, the server device, or the personal computer. The staff terminal, the personal computer, or the server devicecan execute processing to be described later by having the following configuration of the information processing device. In addition, the imaging devicecan also execute processing similar to that of the staff terminaldescribed later by including the following configuration of the information processing device.

71 70 72 79 73 73 71 A central processing unit (CPU)of the information processing deviceexecutes various types of processing in accordance with a program stored in a read only memory (ROM)or a program loaded from a storage unitinto a random access memory (RAM). The RAMalso appropriately stores data and the like necessary for the CPUto execute various processes.

71 72 73 74 75 74 The CPU, the ROM, and the RAMare connected to one another via a bus. An input/output interfaceis also connected to the bus.

76 75 An input unitincluding an operator and an operation device is connected to the input/output interface.

76 For example, as the input unit, various operators and operation devices such as a keyboard, a mouse, a key, a dial, a touch panel, a touch pad, a remote controller, and the like are assumed.

76 71 An operation of the user is detected by the input unit, and a signal corresponding to the input operation is interpreted by the CPU.

77 78 75 In addition, a display unitincluding a liquid crystal display (LCD), an organic electro-luminescence (EL) display, or the like, and an audio output unitincluding a speaker or the like are integrally or separately connected to the input/output interface.

77 70 70 The display unitis a display unit that performs various displays, and includes, for example, a display device provided in a housing of the information processing device, a separate display device connected to the information processing device, or the like.

77 71 77 71 The display unitexecutes display of an image for various types of image processing, an image to be processed, and the like on a display screen on the basis of an instruction from the CPU. In addition, the display unitdisplays various operation menus, icons, messages, and the like, that is, displays as a graphical user interface (GUI) on the basis of an instruction from the CPU.

75 79 80 The input/output interfacemay be connected with the storage unitincluding a hard disk, a solid-state memory, or the like, and a communication unitthat performs communication using various communication methods.

80 The communication unitperforms communication processing via a transmission path such as the Internet, wired/wireless communication with various devices, bus communication, and the like.

70 1 80 2 4 6 80 80 In a case where the information processing deviceis assumed as the staff terminal, the communication unithas a function of FTP communication with the imaging deviceand a function of performing communication with the server devicevia the network. Alternatively, the communication unitmay have a function of performing communication by short-range wireless communication such as Bluetooth, Wi-Fi, NFC, or the like, infrared communication, wired connection communication, or the like. In addition, the communication unitmay have a function of performing communication through a communication line for mobile phones such as long term evolution (LTE) or the like.

70 4 3 80 6 In a case where the information processing deviceis assumed as the server deviceor the personal computer, the communication unithas at least a function of performing communication via the network.

82 75 81 A driveis also connected to the input/output interfaceas necessary, and a removable recording mediumsuch as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately mounted.

82 81 79 77 78 81 79 By the drive, a data file such as an image file, various computer programs, and the like can be read from the removable recording medium. The read data file is stored in the storage unit, and images and sounds included in the data file are output by the display unitand the audio output unit. In addition, the computer program and the like read from the removable recording mediumare installed in the storage unitas necessary.

70 80 81 72 79 In the information processing device, for example, software for processing of the present disclosure can be installed via network communication by the communication unitor the removable recording medium. Alternatively, the software may be stored in advance in the ROM, the storage unit, or the like.

1 70 70 71 4 FIG. In a case where the staff terminalis assumed as the information processing device, in the information processing device, the functional configuration as illustrated inis constructed in the CPUby the application program.

4 FIG. 30 31 32 33 34 35 70 1 illustrates an event data management unit, a user interface (UI) control unit, a communication control unit, a filter processing unit, an image analysis unit, and a division determination unitas functions provided in the information processing deviceserving as the staff terminal.

30 2 30 The event data management unitis a processing function of storing additional information including image data received through communication with the imaging device, rating information corresponding to the image data, and the like as event data regarding a specific event. In addition, the event data management unitalso performs update processing of the event data according to the operation input of the camera staff.

5 FIG. An example of the content of the event data is schematically illustrated in.

1 60 5 FIG. The event data is a data group including images and various contents regarding one event registered by the camera staff operating the staff terminal.illustrates event datafor an event named “event2”.

60 61 62 63 In this example, the event dataincludes presetting information, imaging/editing information table, and division information.

61 1 2 FIG. The presetting informationis information set by the camera staff through the presetting in step Sof. For example, editing information such as a retouch parameter or the like is included.

62 2 3 2 FIG. The imaging/editing information tableis a table in which information is sequentially added and updated in the processing of steps Sand Sof.

62 2 In the imaging/editing information table, various types of information are described corresponding to the image file transferred from the imaging device.

2 1 2 The image file transferred from the imaging deviceincludes image data and metadata (MT, MT. . . ). This image data is managed as original image data, and added metadata is also managed.

The image data includes, for example, row (RAW) data, data compressed by the JPEG method, and the like, and the data format is not limited, but here, data compressed by the JPEG method such as “DSC0001.jpg” or the like is exemplified.

1 2 2 2 The metadata (MT, MT. . . ) includes imaging date and time of the image data, camera information such as a model, a manufacturer, a serial number, or the like of the imaging device, a data format, a data size, angle of view information, focus point information, and various other information added by the imaging device.

62 The imaging/editing information tablestores rating information corresponding to image data. The rating information is information indicating an evaluation value obtained by evaluating an image by a camera operator or the like, and is, for example, evaluation information of six stages such as “no star”, “1 star”, “2 stars”, “3 stars”, “4 stars”, and “5 stars” in the number of star marks. For example, the larger the number of stars, the higher the evaluation. Of course, such evaluation information is an example. Since such rating information serves as a reference for the camera staff to select an image, for example, when setting a selection flag (setting of used image information) to be described later, it can be said that an image having a higher evaluation indicated by the rating information is an image having a high possibility to be used for the web gallery or the actual delivery.

2 1 This rating information can be given by confirming the captured image when the camera operator captures the image. The imaging deviceis provided with a user interface for inputting rating information. It is conceivable that this rating information is transferred to the staff terminaltogether with image data included in metadata corresponding to the image data, for example. Alternatively, it is also conceivable that the image file is written in the XMP region of Exif.

1 The staff terminalextracts and manages rating information from metadata (or Exif data).

1 This rating information can be added or updated in association with the image data by an operation on the staff terminalside.

62 The imaging/editing information tablestores selection information corresponding to image data. As one of the selection information, there is used image information indicating whether or not the image is posted on the web gallery. This is a “selection flag” (which may be simply described as a “flag”) described later, and the flag-off indicates that the image is not used in the web gallery, and the flag-on indicates that the image is selected as the image to be used in the web gallery.

In addition, as one of the selection information, there is front cover image information indicating that the image is selected as a cover image to be arranged as a front cover at the top of the web gallery.

In addition, as one of the selection information, there is emphasized display image information indicating the image selected as an image to be emphasized (highlighted) in the web gallery. The highlight display is to be displayed larger than other images. Alternatively, a normal image may be a monochrome image, but a highlight image may be displayed in color. Conversely, in the sense of emphasis, it is also conceivable that the normal image is a color image, but the highlight image is an image displayed in monochrome. Furthermore, the normal image may be displayed without borders, and the highlight image may be displayed with borders, or the like. There are various ways of emphasized display.

34 The eye closure information is information indicating the eye closure state of the subject person obtained by the image analysis processing executed by the function of the image analysis unit. For example, most simply, flag information of “0” and “1” indicating whether or not an image is an eye closure image can be considered.

The archive information is information indicating that archiving is set by the user. The archive operation and the like will be described later. For example, most simply, it is conceivable to use flag information of “0” and “1” indicating whether or not the image is an archived image.

The editing information includes various image processing parameters such as retouch parameters, inclination correction parameters, and the like. Examples of the retouch parameter include image quality adjustment parameters such as a luminance adjustment value, a color adjustment value, a contrast adjustment value, a sharpness adjustment value, and the like.

The retouch parameters can be set in presetting, but can also be set for individual images. Furthermore, the inclination correction parameters are individually set. For these reasons, editing information corresponding to image data is stored so that parameters set for individual images can be stored.

62 Note that, as illustrated, edited image data corresponding to the image data may be stored in the imaging/editing information table.

The edited image data is image data in which image editing is performed on the original image data on the basis of editing information determined in presetting or editing information individually set. In addition, not only the image data retouched by the editing information but also the image data edited image data in which the quality of the image is changed may be used. The change in quality includes, for example, a change in image size, a change in resolution, cutout, a change in frame rate in a moving image, and the like.

1 In the drawing, the edited image data is distinguished from the original image data by adding “E” to the file name such as “DSC0001E.jpg” or the like. The edited image data is used for display on a user interface in the staff terminalor the like.

62 Such edited image data is not necessarily created and stored, and for example, at the time of image display, the display may be performed by applying the editing information each time. Therefore, in the imaging/editing information table, the editing information may be updated and managed, and the edited image data may not be stored. However, as a matter of course, the edited image data is generated and stored as needed as illustrated in the drawing, which is effective in terms of reduction of a processing load at the time of display processing and the like.

63 63 The division informationis information on division of sub-events or scenes set as a result of division determination processing to be described later. The division informationis updated every time the division determination processing is performed.

71 70 1 60 30 4 FIG. The CPUof the information processing deviceserving as the staff terminalexecutes the additional storage and update of the information regarding the event dataas described above by the function of the event data management unitin.

60 62 Note that the format of the event dataand the format of the imaging/editing information tableare merely examples, and any format may be used as long as at least the above contents are managed for each event.

62 For example, the original image data, the metadata, the rating information, the selection information, the eye closure information, the archive information, the editing information, and the edited image data included in the imaging/editing information tableare not limited to being collectively stored as a table. Metadata, rating information, selection information, eye closure information, archive information, editing information, and edited image data may be stored in any format and form as long as the metadata, rating information, selection information, eye closure information, archive information, editing information, and edited image data are associated with at least one piece of original image data.

31 60 4 FIG. The UI control unitofis a function of performing presentation control of an image, rating information, and the like related to the event dataof a specific event and performing processing of detecting an operation input. That is, it is a function of performing user interface processing.

Examples of the user interface processing include presentation of various types of information, provision of an environment in which an operation can be input, processing of detecting an operation by the user, processing of detecting/estimating an intention of the user, and the like.

31 77 78 Specifically, the UI control unitperforms control processing of providing an operation input environment or presenting information to the user by causing the display unitor the audio output unitto execute output such as display output, audio output, or the like to the user, for example.

31 Alternatively, the UI control unitperforms processing of detecting an operation by the user, for example.

31 Alternatively, the UI control unitperforms, for example, both processing of providing an operation input environment to the user and processing of detecting an operation by the user.

31 Of course, the UI control unitmay perform other user interface processing.

32 4 60 The communication control unitis a function of controlling communication for synchronizing event data with the external server devicein accordance with storage or update of the event data.

2 32 80 4 4 60 For example, when receiving an image transfer from the imaging device, the communication control unitperforms control of processing of transferring the image data from the communication unitto the server device, and performs control of notifying the server deviceof the update content according to the update of the content of the event data.

33 The filter processing unitis a function of performing processing of filtering images in an image group captured for an event and extracting images to be displayed according to a user's operation. The filter condition is set by a user operation. Specifically, an archive setting state, an eye closure state, metadata, or the like is set as the filter condition.

34 2 60 The image analysis unithas a function of setting the above-described eye closure information. For example, image analysis is performed on image data received by communication with the imaging deviceto sense a person who is a subject and determine the eye closure state of the person. In a case where the image is in the eye closure state, eye closure information is generated. Such analysis is performed for each image, and the eye closure information is managed in the event data.

35 The division determination unitis a function of performing processing of determining division in chronological order for an image group as a series of images captured for an event.

For example, division of sub-events in an event such as a wedding or the like, scenes obtained by subdividing sub-events, or the like is determined. For example, in a case where a wedding and a reception are set as one event, chronological-order division includes various events such as ceremony, reception, greeting, cake cut, cheers, bouquet toss, and the like. Although the contents of division are arbitrary, for example, in a case where a series of wedding is defined as an event, an event obtained by dividing the event is referred to as a “sub-event” for the sake of explanatory distinction. In addition, there is also a case where two-stage division determination is performed such that one sub-event is further subdivided. In this case, the subdivided one is referred to as a “scene”.

What kind of event, matter, action, or the like is defined as a “sub-event” or a “scene” is arbitrary, and each division when the whole is defined as one “event” is defined as a “sub-event”, and a further subdivided unit is defined as a “scene”. For example, in some cases, “cake cut” may be one of “sub-events” or one of “scenes”.

4 FIG. 70 30 31 32 70 1 The above functions ofare merely examples. Since the information processing deviceincludes at least the event data management unit, the UI control unit, and the communication control unit, the information processing deviceperforms processing as the staff terminalof the present embodiment.

70 Such functions are implemented, for example, when the information processing deviceinstalls an application program for image collection content creation.

4 70 70 71 3 FIG. 6 FIG. Next, in a case where the server deviceis assumed as the information processing deviceas illustrated in, in the information processing device, the functional configuration as illustrated inis constructed in the CPUby the application program.

6 FIG. 40 41 42 43 70 4 illustrates an event data management unit, an image collection generation unit, an event data provision control unit, and a data output unitas functions provided in the information processing deviceas the server device.

40 4 The event data management unitis a processing function that performs storage/update management of event data in the server device.

90 4 90 7 FIG. 5 FIG. The contents of the event dataon the server deviceside are schematically illustrated in. Similarly to, the event datais the event data for the event named “event2”.

90 91 92 In this example, it is assumed that the event dataincludes presetting informationand an imaging/editing information table.

91 61 1 1 4 2 FIG. The presetting informationis the same information as the presetting informationin the staff terminal. For example, the contents set in presetting in step Sinare similarly managed in the server device.

90 63 5 FIG. Note that, in the event data, the division informationinmay be managed in synchronization.

92 62 The imaging/editing information tablehas substantially the same contents of information as the imaging/editing information table. That is, the original image data, the metadata, the rating information, the selection information, the eye closure information, the archive information, and the editing information can be managed for each image.

92 4 92 Note that edited image data is not associated in the imaging/editing information table, but this is because an edited image is created at the time of generating the web gallery. Of course, the server devicemay sequentially generate edited image data and associate the edited image data with the original image data in the imaging/editing information table.

71 70 4 90 40 6 FIG. The CPUof the information processing deviceserving as the server deviceexecutes the additional storage and update of the information regarding the event dataas described above by the function of the event data management unitin.

41 41 90 6 FIG. The image collection generation unitinis a function of generating image collection content as a web gallery of a specific event. In particular, the image collection generation unitgenerates image collection data, that is, web page data as a web gallery, with reference to selection information and editing information in the event data.

8 FIG. An example of the web gallery data to be generated is illustrated in.

4 96 97 96 The server devicegenerates page information in a hypertext markup language (HTML) format or an extensible markup language (XML) format as web page setting informationas web gallery data, for example, and generates an image folderin which images called from the web page setting informationand displayed in a page are collected.

97 The image folderincludes edited image data of images adopted as the web gallery.

42 1 90 6 FIG. The event data provision control unitinis a function of performing control to cause the staff terminalto execute transmission for providing the event data.

1 4 90 1 1 60 60 1 For example, in response to the staff terminallogging in to the server deviceand designating an event, all or part of the event dataof the event is transmitted to the staff terminal. The staff terminalsets the received content as the event dataunder its own management. As a result, for example, the assistant can perform an operation using the event dataon the terminal deviceB side.

42 1 3 Of course, a case is also assumed where the event data provision control unitperforms the event data provision control on the terminal deviceA or the personal computer.

43 3 The data output unitperforms control to transmit a part or all of data included in the event data, for example, metadata, rating information, selection information, eye closure information, archive information, editing information, or image data (for example, original image data) as a file of a predetermined format to the terminal device (for example, the personal computer).

That is, it is a processing function of providing data necessary for creating the image collection content of the actual delivery to the camera staff side.

6 FIG. 70 40 1 4 4 41 The functions ofdescribed above are merely examples. Since the information processing deviceincludes the event data management unit, event data synchronization can be performed between the staff terminaland the server device. In addition, since the server deviceincludes the image collection generation unit, it is possible to quickly generate the web gallery.

6 FIG. 70 Each function ofis implemented, for example, when the information processing deviceinstalls an application program for image collection content creation.

Hereinafter, a specific processing example will be described.

1 1 2 FIG. 9 10 FIGS.and First, a processing example of presetting in the staff terminalillustrated as step Sinwill be described with reference to.

1 71 70 4 FIG. Note that the processing of the staff terminaldescribed below is processing performed by the CPUof the information processing devicehaving the function of.

70 1 In addition, in each screen example described below together with the flowchart, for example, it is assumed that the information processing deviceas the staff terminalis a smartphone, and is an example of display contents on a display formed on a housing thereof.

9 FIG. 1 illustrates processing of the staff terminal.

1 1 71 10 For example, the camera staff activates the application program using the staff terminaland performs an operation for preparation processing. In response to the operation, in the staff terminal, the CPUexecutes the processing in and after step S.

10 1 In step S, the staff terminalperforms project creation processing. This is processing of setting a target event for creating an image collection.

77 1 110 10 FIG.A For example, on the display unitof the staff terminalthat has activated the application program, a project list screenis displayed as illustrated in.

110 111 112 134 127 The project list screenis provided with a list areain which event names as individual project targets are displayed in a list. In addition, an addition icon, a communication icon, a menu icon, and the like are displayed.

110 On such a project list screen, the camera staff creates a target project for image collection creation. For example, an operation of creating one project is performed by inputting an event name or the like.

112 For example, by operating the addition icon, a project setting screen (not illustrated) is displayed, and the title of the project (for example, an event name), the date and time of the event, the place, whether or not the auto retouch setting is applied, and the like can be set.

1 111 The camera staff appropriately inputs items and performs an operation of setting project contents. In response to this, the staff terminalcreates one project and displays it in the list area.

10 FIG.B illustrates an example in which two projects with names “event1” and “event2” are displayed. For example, information such as an event name, a date and time, a place, and the like is presented for each project.

10 1 31 9 FIG. In step Sof, the staff terminalperforms control to provide a user interface of such a screen by the function of the UI control unit, and performs the project creation processing according to the operation of the camera staff.

1 4 1 4 32 Note that this project creation processing is performed, for example, in an online connection state between the staff terminaland the server device. In this case, the staff terminaltransmits information for the synchronization processing to the server deviceaccording to the operation content of the user by the function of the communication control unit.

4 As a result, the server devicecan also enter information as one project in synchronization.

11 1 2 9 FIG. In step Sof, the staff terminalperforms transfer setting. The transfer setting is a setting of FTP transfer with the imaging device, and is, for example, a setting of a file format to be transferred, an FTP connection server, or the like.

1 31 The staff terminalexecutes screen display for transfer setting for the camera staff by the function of the UI control unit, and performs necessary transfer setting according to the operation of the camera staff.

12 1 In step S, the staff terminalperforms auto retouch setting. The auto retouch setting is processing of setting a parameter of image editing processing to be commonly applied to each image.

1 31 60 61 The staff terminalexecutes screen display for auto retouch setting for the camera staff by the function of the UI control unit, and performs necessary auto retouch setting according to the operation of the camera staff. The parameter of the auto retouch setting is described in the event dataof the created project as the presetting information.

1 4 1 4 In addition, this auto retouch setting is also performed, for example, in a state where the staff terminaland the server deviceare connected online, and the staff terminaltransmits the parameter information set to the auto retouch setting to the server devicefor synchronization processing.

4 91 61 60 90 As a result, the server devicecan also store the presetting informationhaving the same content as the presetting informationof the event dataas the event dataof the project.

13 1 In step S, the staff terminalperforms watermark setting. For example, a camera operator's name or the like can be inserted as a watermark (electronic watermark) into the image of the web gallery. The watermark setting is processing of setting the presence or absence and contents of the watermark.

1 31 60 61 The staff terminalexecutes screen display for watermark setting for the camera staff by the function of the UI control unit, and performs necessary watermark setting according to the operation of the camera staff. The information of this watermark setting is also described in the event dataof the created project as the presetting information.

1 4 1 4 In addition, this watermark setting is also performed in a state where the staff terminaland the server deviceare connected online, and the staff terminaltransmits the information of the watermark setting to the server devicefor synchronization processing.

4 91 61 90 As a result, the server devicecan also store the presetting informationsynchronized with the presetting informationin the event dataof the project.

11 12 13 Note that the order of steps S, S, and Sdescribed above may be different. In addition, the processing of each step may not be performed as a series of processing, and for example, may be performed each time during activation according to a user's operation.

11 10 11 10 12 12 13 In addition, each processing may be skipped if it is not necessary. For example, the transfer setting in step Smay be performed every time a project is created in step S. However, if the setting does not need to be particularly changed after the FTP transfer setting is performed once, step Smay be skipped after the project is created in step S, and the process may proceed to step S. Of course, the same applies to the processing of steps Sand S, and these may be skipped in a case where it is not particularly necessary to change the setting after the setting.

4 61 91 In addition, the communication with the server devicefor synchronization may be performed at the timing of each processing, but the information may be collectively transmitted at the time when some settings are made so that the presetting informationandare synchronized.

4 61 91 Moreover, in a case where there is content set under an environment in which the online connection with the server devicecannot be established, the set information may be transmitted and the presetting informationandmay be synchronized when the online connection state is established.

1 2 1 30 32 34 2 FIG. 11 FIG. 4 FIG. Next, a specific processing example of the staff terminalin step Sinwill be described with reference to. That is, the processing is processing executed by the staff terminalmainly by the functions of the event data management unit, the communication control unit, and the image analysis unitinwhen a wedding is being held.

101 1 2 11 FIG. 11 FIG. In step Sof, the staff terminalchecks whether or not image file transfer from the imaging devicehas been started. In a period in which no image transfer is performed, the processing ofis not particularly performed.

2 2 1 For example, during a wedding, a camera operator captures an image of a scene of a ceremony or a reception by the imaging device. For example, after a still image is captured, the imaging devicesequentially transfers an image file to the staff terminalautomatically or according to an operation of a camera operator. Note that the transfer timing is an example. Transfer may be performed every time one image is captured, or a plurality of images may be transferred together.

In addition, in the case of moving image capturing, transfer may be performed in a period in which recording is not performed in units of recording start/stop, or transfer may be performed during a recording period after recording is started. All the recorded videos may be transferred, or only a first predetermined period may be transferred.

2 In addition, the camera operator can add rating information to the captured image by an operation on the imaging deviceside. For example, an image is confirmed immediately after imaging, and rating information is input. This rating information is described in metadata.

The transfer of the image file including the image data and the metadata may be executed, for example, in response to the camera operator confirming the captured image and inputting the rating information.

1 101 102 62 60 In the staff terminal, when it is detected that the transfer of such an image file is started, the process proceeds from step Sto step S, and the reception processing of the image data and the metadata is performed. In this case, the received image data is managed as original image data in the imaging/editing information tableof the event data. In addition, the received metadata is also managed correspondingly.

1 103 4 The staff terminalperforms image compression processing in step S. For example, the compression processing is performed so as to increase the compression rate of the received image data. This is processing of generating image data to be transmitted to the server device.

104 1 103 62 60 In step S, the staff terminalperforms processing of eye closure image analysis. That is, image analysis processing is performed on the received image or the image compressed in step S, and sensing of person as a subject, pupil sensing, and eye closure determination are performed. Then, in a case where it is determined that it is an image where the person of the subject is in the eye closure state, eye closure information indicating the eye closure state is generated for the image. The eye closure information is registered in the imaging/editing information tableof the event data.

105 1 2 62 60 In step S, the staff terminalperforms rating information management. This is processing of confirming the metadata of the received image file, extracting the rating information given by the imaging deviceside, and managing the rating information updatably in the imaging/editing information tableof the event data.

106 1 4 60 90 1 103 4 4 90 60 In step S, the staff terminaltransmits information to the server devicefor synchronization of the event dataand. In this case, the staff terminaltransmits the image data compressed in step S, the metadata, the rating information, and the eye closure information to the server device. The server deviceside updates the event datain response to the reception, and maintains the synchronization state with the event data.

107 1 62 In step S, the staff terminalperforms auto retouch application processing. That is, the original image data is automatically subjected to image processing by the preset retouch parameter to generate edited image data, and is managed in the imaging/editing information table.

1 This edited image data is generated for use in UI display on the staff terminal.

Note that, in this example, the auto retouch application processing is performed as the processing at the time of receiving the image file, but the auto retouch application processing may be performed as necessary at another time point, for example, when display of one image is requested or the like.

103 106 107 Furthermore, it is also conceivable to perform image processing on the compressed image data generated in step S. In that case, for example, the order of the processing in step Sand step Smay be changed, image processing of applying auto retouch to the compressed image data may be performed, and then the compressed image data may be transmitted to the server.

11 FIG. 1 60 60 By performing the processing ofdescribed above, in the staff terminal, an image is taken in in accordance with imaging of the camera operator, and information corresponding to the image is managed by the event data. For example, all the captured images are in a state of being managed by the event dataat the time point when the wedding is ended.

90 4 60 1 In addition, by performing sequential transmission for synchronization, the event dataon the server deviceside is synchronized with the event dataon the staff terminalside during and at the end of the wedding.

11 FIG. 2 120 1 Furthermore, also in the process of the processing of, the list of images transferred from the imaging deviceand the communication status are displayed in a time viewand the like to be described later, so that the camera staff can confirm the image taking-in status and the like to the staff terminal.

3 2 FIG. 12 18 FIGS.to 19 35 FIGS.to Next, a detailed processing example as the selection in step Sinwill be described with reference to the flowcharts inand the screen examples in.

12 18 FIGS.to 1 2 3 4 6 7 8 Note thatillustrate a series of flowchart separately, and “c”, “c”, “c”, “c”, “c”, “c”, “c”, and “c” indicate connection relationships.

30 31 32 33 35 4 FIG. The processing in these flowcharts is processing by the functions of the event data management unit, the UI control unit, the communication control unit, the filter processing unit, and the division determination unitin.

201 110 12 FIG. 10 FIG.B Step Sinillustrates processing of displaying a list of projects (event names and the like) on the project list screenas illustrated in.

202 1 110 203 In step S, the staff terminalmonitors whether or not a project selection operation has been performed on the project list screen, and monitors an end operation of the application program in step S.

When the end operation of the application program is performed, the application program is closed, and the processing is ended.

110 111 For example, in a case where selection is performed in the middle or immediately after a wedding, the camera staff performs an operation of selecting a target project on the project list screen. For example, an operation such as tapping one of the projects displayed in the list areaor the like is performed.

1 202 204 1 4 90 90 60 60 90 60 When detecting such an operation, the staff terminaladvances the processing from step Sto step S, and acquires the latest event data for the selected project. For example, the staff terminalrequests the server devicefor the event dataof the selected project, and takes in the transmitted event data. Then, it is compared with the event dataheld by itself and updated to the latest information contents. For example, some information that can be determined whether the information is old or new is compared between the event dataand the event data, such as update date and time information, version management information, and the like. If the information is different, the event datais ensured to have the latest information content.

1 1 60 1 For example, assuming the terminal deviceA possessed by the camera operator, there may be a case where the assistant inputs the rating information and the selection information on the terminal deviceB side during the wedding, and these are not reflected in the event dataon the terminal deviceA side.

1 1 In addition, in a case where the terminal deviceB side possessed by the assistant tries to input the rating information and the selection information, it is appropriate to input with reference to the latest information on the terminal deviceA side.

1 90 4 1 1 60 60 Therefore, the staff terminalreceives the event dataof the server deviceto which the latest information is transmitted from both the terminal devicesA andB, and updates the information of the event dataif the own event datais not the latest.

1 1 204 Note that there may be only one staff terminal, and the information on the staff terminalis always the latest. In such a case, the processing of step Smay be unnecessary.

1 211 120 13 FIG. 19 FIG. Subsequently, the staff terminalproceeds to step Sinand displays an event image list. For example, a time viewas illustrated inis displayed.

120 128 The time viewis a list display as a simple chronological display in which images are arranged in order of imaging time in the image area.

120 20 20 20 FIGS.A,B, andC The display mode of the time viewchanges as illustrated inaccording to the enlargement/reduction operation.

19 20 FIGS.andA 20 FIG.B 20 FIG.C 128 illustrate a state in which four images are arranged in one row in the image area,illustrates a state in which two images are arranged in one row, andillustrates a state in which one image is arranged in the vertical direction of the screen. The user can optionally adjust the image size to view the list.

211 1 200 120 13 FIG. 21 22 FIG.or In addition, in the event image list display in step Sof, the staff terminalmay display an event viewas illustrated ininstead of the time view.

128 200 An image areais also provided in the event view, and images are displayed in a list. In this case, a division of a sub-event or a scene is set for each image, and the list is displayed in units of sub-events or scenes.

21 FIG. 22 FIG. 201 200 201 illustrates a state in which an index baris displayed in the event view, andillustrates a state in which the index baris not displayed.

200 Details of event viewwill be described later.

120 200 121 123 132 134 127 In the time viewand the event view, an event titleis displayed, and an all-flag icon, a next icon, a communication icon, a menu icon, and the like are displayed.

127 The menu iconis an operator for displaying various menu items.

134 2 The communication iconis an icon for displaying the FTP communication state with the imaging deviceor the like.

123 The all-flag iconis an operator for setting on/off of a selection flag indicating an image to be used for image collection for all images.

132 The next iconis an operator for transition to the next screen.

128 120 200 2 125 126 128 As described above, the image areais provided in the time viewand the event view, and images transferred from the imaging deviceare displayed in a list by thumbnails. However, an all taband a candidate tabare provided for display of the image area.

125 2 128 125 19 FIG. When the all tabis selected, the images transferred from the imaging deviceare displayed in the image arearegardless of whether the state of the selection flag is ON or OFF. For example,is a list display when the all tabis selected.

126 2 128 126 23 FIG. On the other hand, when the candidate tabis selected, only images for which the selection flag is set to ON among all the images transferred from the imaging deviceare listed in the image area. For example,illustrates an example of list display when the candidate tabis selected. On/off of the selection flag is set by operating the individual images depending on whether or not the images are to be adopted for the web gallery by the camera staff.

125 126 125 126 23 FIG. The number of corresponding images is also displayed in the all taband the candidate tab. “2065” inindicates the number of images displayed in the all tab, and “54” indicates the number of images displayed in the candidate tab.

202 120 200 120 200 19 FIG. 21 FIG. A view switching buttonis displayed in the time viewand the event view. When “Time” is selected as illustrated in, the time viewis displayed. In addition, when “Event” is selected as illustrated in, the event viewis displayed.

120 200 202 The user may optionally switch between the time viewand the event viewfor the list display. For example, the view switching buttonalternately switches between “Time” and “Event” each time a tap operation is performed.

128 120 200 210 20 20 21 FIGS.B,C, and In addition, for each image in the image areain the time viewand the event view, an eye closure iconmay be displayed as illustrated in. This is to present an image in which the subject person is in the eye closure state by the icon based on the above-described eye closure information.

20 21 FIGS.B and 210 In particular, in a case where a relatively small thumbnail image is displayed as illustrated in, it may be difficult to discriminate whether or not the person is in the eye closure state. Presentation of the eye closure state by the eye closure iconis useful for image confirmation.

210 210 210 20 FIG.A However, in this example, the eye closure iconis not displayed in. This is because, in a case where thumbnail images are made extremely small and it is desired to browse a large number of images at a time, if the eye closure iconis also displayed, the screen becomes complicated. Meanwhile, even in such a case, an example of displaying the eye closure iconis also conceivable.

128 120 200 130 131 20 20 21 FIGS.B,C, and In addition, for each image in the image areain the time viewand the event view, a rating iconand a flag setting iconare displayed corresponding to the image as illustrated in.

130 130 The rating iconnot only displays the rating information set by the number of stars, but also serves as an operator for changing the rating. For example, the number of stars can be changed by tapping or sliding a portion of the rating icon, which is the rating change operation.

131 131 In addition, the flag setting iconrepresents on/off of the selection flag by, for example, a change in a color or luminance of the icon, or the like. In addition, the flag setting iconis also used as an operator for switching on/off of the selection flag. For example, the selection flag is switched on/off by a tap operation.

20 FIG.A 20 FIG.B 130 131 130 131 Note that In, the rating iconand the flag setting iconare not displayed. This is because the rating iconand the flag setting iconare displayed when the display corresponding to the images becomes an easily viewable size or an easily operable size as illustrated in.

130 131 20 FIG.A Note that, as a matter of course, the rating iconand the flag setting iconmay be displayed corresponding to the images even in the state of.

129 120 200 137 129 128 In addition, a filter designation areais provided in the time viewand the event view. The rate designation iconof the filter designation areaenables narrowing of images by, for example, six-stage rating. For example, operators as the number of stars are provided, filtering is performed according to the designated operators, and the extracted images are displayed in a list in the image area.

For example, in a case where an operator of three stars is operated, images with rating information of “three stars” or more (that is, images corresponding to any one of “three stars”, “four stars”, and “five stars”) are extracted and displayed in a list. Alternatively, in this case, only images whose rating information is “three stars” may be extracted and displayed in a list.

129 137 In addition, in the filter designation area, the number of images for which the rating is set is also indicated together with the rate designation iconrepresented by the number of stars.

136 129 136 Furthermore, a filter operation iconis displayed in the filter designation area. Setting of filter conditions other than the rating and filtering of the display images are enabled by operating the filter operation icon.

120 200 211 1 212 222 13 FIG. 15 FIG. In a state where the time viewor the event viewis displayed as described above in step Sof, the staff terminalperforms a monitoring loop process from step Sto step Sof.

212 1 132 132 13 FIG. In step Sof, the staff terminalmonitors the operation of the next icon. Processing in a case where the operation of the next iconis detected will be described later.

213 1 126 125 125 126 In step S, the staff terminalmonitors the tab switching operation. The tab switching operation is an operation of the candidate tabduring the list display of the all tabor an operation of the all tabduring the list display of the candidate tab.

1 128 240 When detecting the tab switching operation, the staff terminalperforms processing of switching the list display content in the image areaaccording to the selected tab in step S.

214 1 128 In step S, the staff terminalmonitors the operation related to the screen state performed by the camera staff on the image area.

Here, the operation related to the screen state is an operation such as enlargement/reduction of images, screen scrolling, appearance/deletion of display items, and the like.

1 For example, the staff terminalmonitors a pinch operation. The pinch operation here is a pinch-out operation for enlarging images and a pinch-in operation for reducing images.

1 128 241 When the pinch operation is detected, the staff terminalenlarges or reduces the display state in the image areain step S.

20 20 20 FIGS.A,B, andC 128 illustrate examples of display changes of the image areaaccording to pinch-in/pinch-out.

20 FIG.A 20 FIG.B 20 FIG.C illustrates a display state in which the thumbnail images are the smallest. When the pinch-out operation is performed, the images displayed in the list are enlarged as illustrated in. The images are enlarged as illustrated inby further pinch-out operation.

20 FIG.C 20 FIG.B 20 FIG.A In addition, when the pinch-in operation is performed, the state inis reduced to the state in, and the state returns to the state inby further pinch-in operation.

210 130 131 In addition, as described above, the presence or absence of display of the eye closure icon, the rating icon, the flag setting icon, and the like is also switched according to the enlargement/reduction.

214 1 120 200 241 19 FIG. 21 FIG. In addition, in step S, the staff terminalalso monitors the swipe operation. For example, in the time viewas illustrated inor the event viewin, the up-down swipe operation is recognized as a scroll operation in the up-down direction, and the display is vertically scrolled in step S.

200 1 241 In addition, the left-right swipe operation in the event viewis recognized as a scroll operation in the left-right direction, and the staff terminalhorizontally scrolls the display in step S.

1 201 200 201 201 241 201 21 FIG. 22 FIG. In addition, the staff terminalrecognizes, for example, a swipe operation to the right on the index barin the event viewofas an operation of deleting the index bar, and recognizes a swipe operation to the left from the right end of the screen in the state ofas an operation of calling the index bar. Then, in step S, display control of closing or making the index barappear is performed.

215 1 128 13 FIG. In step Sof, the staff terminalmonitors whether or not an operation for selecting one of the images displayed in the image areahas been performed. For example, the operation is such that one thumbnail image is tapped. Processing in a case where this selection operation is detected will be described later.

216 1 137 136 129 In step S, the staff terminalmonitors the filter operation. That is, the operation is an operation of the rate designation iconor an operation of the filter operation iconin the filter designation area.

129 1 242 128 In a case where the operation of any operator in the filter designation areais detected, the staff terminalproceeds to step S, sets and stores a filter condition according to the operation, performs filtering processing according to the filter condition, and extracts corresponding images. Then, extracted images as filtering results are displayed in a list in the image area.

243 When the end of the filter processing is detected in step S, the process returns to the monitoring loop.

242 243 136 Note that a specific example of the processing in steps Sand Swhen the filter operation iconis operated will be described later.

217 1 130 14 FIG. 20 20 21 FIGS.B,C, and Subsequently, in step Sof, the staff terminalmonitors the rating operation. For example, the operation is performed on the rating iconas illustrated in.

130 1 230 60 130 In a case where the operation on the rating iconis detected, the staff terminalproceeds to step Sand updates the event dataso that the rating information of the image corresponding to the rating iconbecomes a value corresponding to the operation.

231 1 4 90 4 In addition, in step S, the staff terminaltransmits the updated rating information to the server device, and the event datais updated on the server deviceside. That is, the synchronization state is maintained.

218 1 131 20 20 21 FIGS.B,C, and In step S, the staff terminalmonitors the flag-on/off operation. For example, the operation is performed on the flag setting iconas illustrated in.

131 1 232 60 131 In a case where the operation on the flag setting iconis detected, the staff terminalproceeds to step Sand updates the event dataso that the selection flag is switched on/off as the selection information of the image corresponding to the flag setting icon.

233 1 4 90 4 In addition, in step S, the staff terminaltransmits the updated flag information to the server device, and the event datais updated on the server deviceside. That is, the synchronization state is maintained.

219 1 123 In step S, the staff terminalmonitors the operation of the all-flag icon.

123 1 234 1 236 60 In a case where the operation on the all-flag iconis detected, the staff terminalproceeds to step Sand branches the processing depending on whether or not the selection flag of all the images is currently on. When some images are in the flag-on state or all the images are in the flag-off state and not all the images are in the flag-on state, the staff terminalproceeds to step Sand updates the event dataso as to set the flag-on state for all the images.

123 1 235 60 On the other hand, if the all-flag iconis operated when all the images are in the flag-on state, the staff terminalproceeds to step Sand updates the event dataso that all the images are in the flag-off state.

237 1 4 90 4 In addition, in step S, the staff terminaltransmits the updated flag information to the server device, and the event datais updated on the server deviceside. That is, the synchronization state is maintained.

220 1 120 200 120 202 15 FIG. In step Sof, the staff terminalmonitors the switching operation to the time view. That is a case where, in the display state of the event view, an instruction on the display of the time viewis given by the operation of the view switching button.

1 350 120 In this case, the staff terminalproceeds to step Sand performs processing of switching to the display of the time view.

221 1 200 120 200 202 In step S, the staff terminalmonitors the switching operation to the event view. That is a case where, in the display state of the time view, an instruction on the display of the event viewis given by the operation of the view switching button.

1 351 359 200 In this case, the staff terminalperforms the processing from step Sto step S. Details of these processes will be described later together with a description of the image transitions regarding the event view.

222 1 200 1 360 363 200 In step S, the staff terminalmonitors the update operation for the scene setting. The scene setting is a setting of division of sub-events and scenes in the event view, and the update referred to here is recalculation of the division determination processing. The staff terminalperforms processing from step Sto step Sin response to the update operation, and this processing will also be described later as processing related to the event view.

222 1 211 13 FIG. After the monitoring processing up to step Sdescribed above, the staff terminalreturns to step Sinand repeats the monitoring processing.

215 13 FIG. Next, processing in a case where an image selection operation is detected in step Sofwill be described.

120 200 That is a case where, in the time viewor the event view, the user performs an operation to select one image in the list.

1 250 140 16 FIG. 24 FIG. In this case, the processing of the staff terminalproceeds to step Sof, and a one-picture display screenas illustrated inis displayed.

142 140 A one-picture display areais provided on the one-picture display screen, and the selected image is displayed in a large size.

142 60 107 61 11 FIG. The image displayed in the one-picture display areais, for example, an image based on edited image data managed by the event data. That is, it is a reproduced image of the edited image data generated by the auto retouch application processing in step Sin, in which the retouch parameter in the presetting informationis reflected.

148 In addition, a focus point markindicating a focus position in the image may be displayed on the image.

133 120 200 138 130 131 140 In addition, a return iconwhich is an operator for returning the display to the time viewor the event view, a filter condition iconfor displaying the filter condition, a rating iconfor the displayed image, and a flag setting iconare displayed on the one-picture display screen.

210 In addition, in a case where the eye closure state of the image is indicated by the eye closure information, an eye closure iconis displayed.

140 145 146 149 135 141 Further, on the one-picture display screen, an edit icon, a focus point operation icon, an export icon, an archive icon, and an original iconfor operation related to the displayed image are displayed.

140 1 251 259 16 17 FIGS.and In a state where such a one-picture display screenis displayed, the staff terminalperforms the monitoring loop processing from step Sto step Sin.

251 1 145 In step S, the staff terminalmonitors the operation of the edit icon.

145 1 260 In a case where the operation of the operator of the edit iconis detected, the staff terminalproceeds to step Sand displays an editing screen (not illustrated). On the editing screen, for example, a user interface capable of retouch operation and inclination correction operation is prepared, and the camera staff can perform image editing operation through the user interface.

As the retouch operation, for example, a luminance adjustment value, a color adjustment value, a contrast adjustment value, a sharpness adjustment value, and the like can be set as retouch parameters.

As the inclination correction operation, for example, an operator for adjusting the angle of the image is prepared.

140 140 Note that the editing screen may be a screen different from the one-picture display screen, or may be a screen superimposed on the one-picture display screento display various operators.

1 261 262 1 60 In a case where the staff terminaldetects the retouch operation, the process proceeds from step Sto step S, and the staff terminalperforms the retouch processing. This is processing of further editing the edited image data by the retouch parameter input by the operation of the camera staff. In addition, the retouch parameter input in this case is stored in the event dataas editing information for individual image data.

1 263 264 1 60 In a case where the staff terminalhas detected the inclination correction operation, the process proceeds from step Sto step S, and the staff terminalperforms the inclination correction processing of the image. This is processing of editing the edited image data by the inclination correction parameter input by the operation of the camera staff. In addition, the inclination correction parameter input in this case is stored in the event dataas editing information for individual image data.

265 1 60 4 266 90 4 When the end of the editing operation is detected in step S, the staff terminaltransmits the editing information of the event dataupdated in accordance with the editing processing to the server devicein step S, and the event datais updated on the server deviceside. That is, the synchronization state is maintained.

267 1 140 In step S, the staff terminalends the editing screen and returns to the normal one-picture display screen. The image displayed at this time reflects the editing result.

145 In this manner, the camera staff can perform retouch and inclination correction of an arbitrary image by the operation from the edit icon.

140 1 146 252 In the display state of the one-picture display screen, the staff terminalmonitors the operation of the focus point operation iconin step S.

146 1 270 148 142 In a case where the operation of the focus point operation iconis detected, the staff terminalproceeds to step Sand branches the processing depending on whether or not the focus point markis currently displayed on the image in the one-picture display area.

148 1 271 2 If the focus point markis not currently displayed, the staff terminalproceeds to step Sand acquires focus point information on the image being displayed. The focus point is information indicating a position at which the imaging deviceis brought into focus in an image at the time of imaging, and is described in metadata. For example, the focus point is described by coordinate information of one point in the image.

1 148 148 24 FIG. The staff terminalacquires focus point information from the metadata of the displayed image, and displays a focus point markon the displayed image according to the information as illustrated in. For example, the focus point markis displayed as an area having a predetermined spread around coordinate information of one point in an image stored as a focus point. As a result, the user can confirm the subject in focus at the time of imaging.

148 148 24 FIG. Note that the display mode of the focus point markis a mark (square expressed by parentheses) displaying four corners in, but may be another display mode such as a square frame, a circular frame, or the like. In addition, a plurality of focus point marksmay be displayed.

24 FIG. 148 148 128 120 200 In addition, as illustrated in, the focus point markis displayed on the one-picture display screen, but for example, the focus point markmay be displayed on an image displayed in a list in the image areaof the time viewor the event view.

146 252 148 1 270 273 148 In a case where the operation of the focus point operation iconis detected in step Swhile the focus point markis displayed, the staff terminalproceeds from step Sto step Sand ends the display of the focus point mark.

148 146 Therefore, the camera staff can turn on/off the display of the focus point markby the focus point operation icon.

253 1 138 1 268 33 FIG. In step S, the staff terminalmonitors on/off operation of the filter condition display. That is, an operation on the filter condition iconis monitored. In this case, the staff terminalproceeds to step Sand controls the display related to the setting of the filter condition as described later with reference to.

1 149 254 140 17 FIG. The staff terminalmonitors the operation of the export iconin step Sofin the display state of the one-picture display screen.

149 1 280 In a case where the operation of the export iconis detected, the staff terminalproceeds to step Sand performs the export processing. That is, the export processing is performed on the information regarding the displayed image data.

255 1 141 In step S, the staff terminalmonitors the image switching operation. The image switching operation in this case is an operation of the original icon.

141 1 281 In a case where the operation of the original iconis detected, the staff terminalproceeds to step Sand switches between the image based on the original image data and the image based on the edited image data. That is, if the reproduced image based on the edited image data is displayed at that time, the reproduced image based on the original image data is displayed. In addition, if the reproduced image based on the original image data is displayed at that time, the reproduced image based on the edited image data is displayed.

141 Therefore, the camera staff can arbitrarily compare the edited image with the original image by operating the original icon.

140 130 On the one-picture display screen, the rating iconfor the image being displayed is displayed.

256 1 In step S, the staff terminalmonitors the rating operation.

130 1 282 60 In a case where the operation on the rating iconis detected, the staff terminalproceeds to step Sand updates the event dataso that the rating information of the displayed image has a value corresponding to the operation.

283 1 4 90 4 In addition, in step S, the staff terminaltransmits the updated rating information to the server device, and the event datais updated on the server deviceside. That is, the synchronization state is maintained.

140 131 On the one-picture display screen, the flag setting iconfor the image being displayed is displayed.

257 1 131 In step S, the staff terminalmonitors the flag-on/off operation, that is, the operation of the flag setting icon.

131 1 284 60 In a case where the operation on the flag setting iconis detected, the staff terminalproceeds to step Sand updates the event dataso that on/off of the flag in the selection information of the displayed image is switched.

285 1 4 90 4 In addition, in step S, the staff terminaltransmits the updated flag information to the server device, and the event datais updated on the server deviceside. That is, the synchronization state is maintained.

258 1 1 390 395 In step S, the staff terminalmonitors the archive operation on the image. In a case where the archive operation is detected, the staff terminalperforms processing from step Sto step S. The processing related to archive will be described later.

259 1 133 In step S, the staff terminalmonitors the operation of the return icon.

133 1 211 140 120 200 13 FIG. When detecting the operation of the return icon, the staff terminalproceeds to step Sin, ends the one-picture display screen, and returns to a state in which the time viewor the event viewis displayed.

140 Note that, although not illustrated in the flowchart, for example, on the one-picture display screen, it is also possible to switch the image to a previous image or a subsequent image by a swipe operation in the left-right direction.

Here, the processing related to archive, the processing according to the eye closure information, and the filter processing using them described above will be described in detail.

1 258 17 FIG. First, the archive operation detected by the staff terminalin step Sinwill be described.

25 FIG.A 140 illustrates an example of an archive operation on the one-picture display screen.

135 One is an operation of an archive icon.

The other is a swipe operation to the screen upper side with respect to the image indicated by an arrow UP.

140 The user can set an archive of the displayed image on the one-picture display screenby, for example, these two operations.

140 120 200 120 135 20 FIG.C Note that, in the present embodiment, as described above, the archive operation can be performed on the one-picture display screen, and the archive operation cannot be performed on the list display of the time viewor the event view. However, when one image is displayed in a large size as illustrated inin the time view, the archive iconmay be displayed to enable an archive operation.

1 258 390 17 FIG. In a case where the staff terminaldetects the archive operation in step Sof, the process proceeds to step S, and the display is switched according to the display setting at that time. The display setting in this case is a setting as to whether or not to display archived images. This can be selected by the filtering setting.

26 FIG.A 26 FIG.B In the case of the setting to display the archived images, the image is not switched according to the archive operation ofas illustrated in.

135 140 135 In this case, the display color of the archive iconis changed to present that the displayed image is archived. Therefore, on the one-picture display screen, the archive iconalso has a function of indicating whether or not the image being displayed is archived.

27 FIG.B 27 FIG.A 27 FIG.C In the case of the setting not to display the archived images, the image is immediately switched to another image as illustrated inin response to the archive operation in. The image to be switched is the next image in chronological order. In a case where there is no next image, the previous image in chronological order is set. In addition, in a case where there is no image that can be displayed, it is notified that there is no image to be displayed as illustrated in.

1 390 391 220 25 FIG.B As in the above example, the staff terminalswitches the image according to the display setting in step S, and performs the toast display for a predetermined time (for example, about 5 seconds) for undo on the screen in step S.illustrates an example of the toast display.

220 In the toast display, a notification of archiving is provided, and an operation of “restore” is enabled.

1 392 393 1 60 17 FIG. If the user does not perform an operation of “restore”, that is, undo operation, the staff terminalproceeds from step Sto step Sinand updates the archive information. That is, the staff terminalupdates the archive information of the event dataso that the displayed image is set to be archived.

394 1 4 90 4 In addition, in step S, the staff terminaltransmits the updated archive information to the server device, and the event datais updated on the server deviceside. That is, the synchronization state is maintained.

220 391 1 392 395 390 135 17 FIG. 27 FIG.B 27 FIG.A 26 FIG.B 26 FIG.A On the other hand, in a case where the user selects the “restore” operation, that is, undo for the toast displayin step S, the staff terminalproceeds from step Sto step Sinand restore the display. That is, in a case where the display is switched as illustrated inin step S, the display is returned to the state of. In addition, in a case where archive iconis changed as illustrated in, the state returns to the state shown in.

259 393 394 Then, the process proceeds to step S. That is, in this case, the archive setting processing in steps Sand Sis not performed.

393 394 220 Note that, as a processing example, it is also conceivable to perform update of the archive information in steps Sand Swhile performing the toast display, and to return the archive information to the original state if the undo operation is performed.

By enabling archiving of images as described above, the camera staff can archive images that are not required to be displayed, thereby reducing the number of images to be displayed in a list or individually, in accordance with filtering to be described next. This can reduce the population parameter of selection tasks and improve the efficiency of the selection.

In particular, an image that is determined not to be adopted for image collection immediately by the camera staff is archived, which is suitable for improving selection efficiency.

60 Furthermore, the image with the selection flag turned on is archived so as not to be displayed in accordance with the filter processing, whereby the population parameter of images at the time of selection can be reduced. Since the archive information is treated as information separate from the selection information in the event data, archiving does not affect the selection flag.

Note that it is also possible to unarchive the image that has been archived once.

135 For example, when the archive iconindicating that the image is archived by a color change is operated, the image is unarchived.

1 258 390 393 394 As the processing of the staff terminal, regarding the archive operation detected in step S, in the case of the archive cancellation (that is, in the case of the archive operation on the archived image), a dialog for the archive cancellation is displayed in step S, the archive cancellation is updated in step S, and the processing in step Sis performed accordingly.

The eye closure information will also be mentioned.

104 1 2 120 200 140 210 11 FIG. As described in step Sof, the staff terminalperforms the eye closure determination on the image received from the imaging deviceand sets the eye closure information. Then, as described above, in the time view, the event view, and the one-picture display screen, the eye closure iconis displayed for the image in which the subject person is in the eye closure state on the basis of the eye closure information.

By combining the eye closure information and the filtering, the number of images to be displayed in the list or individually can be reduced, and the population parameter of selection tasks can be reduced to improve the efficiency of the selection.

60 Furthermore, since the eye closure information is treated as information separate from the selection information in the event data, the eye closure information does not affect the selection flag. In other words, even an image determined to be in the eye closure state can be adopted for image collection with the selection flag turned on.

Filtering using the above eye closure information and archive information will be described.

120 200 136 As described above, in the time viewand the event view, the filter operation iconis displayed.

28 FIG.A 13 FIG. 136 1 216 242 illustrates a state in which the filter operation iconis operated. With this operation, the processing of the staff terminalproceeds from step Sto step Sin, sets the filter condition according to the operation, and performs filtering and display change according to the filtering as follows.

28 FIG.B 221 First, a display example for filter condition setting is illustrated in. A filter condition setting unitis displayed on the screen and can be operated by the user.

221 222 223 224 225 226 227 In the filter condition setting unit, a close button, a camera condition button, an archive condition button, an eye closure condition switch, and information buttons,are prepared.

225 The eye closure condition switchis a switch for selecting whether or not to display the eye closure images, and the user can arbitrarily select display on/off of the eye closure images.

224 230 28 FIG.D When the archive condition buttonis operated, an archive condition setting unitis displayed as illustrated in, and the user can select an archive condition.

232 For example, check boxesfor “display archive images” and “display non-archive images” are prepared. In addition, the number of archive images (80) and the number of non-archive images (123) are also displayed.

display only archive images; display only non-archive images; or display archive images and non-archive images. This allows the user to select to:

224 230 225 display only non-archive images; or display archive images and non-archive images. Note that, instead of the display of the archive condition button(and the archive condition setting unitcorresponding thereto) described above, an archive condition switch may be provided similarly to the eye closure condition switchso that the on/off of the filter condition of the archive image can be simply selected. In that case, it is conceivable that the selectable condition is any one of:

223 235 28 FIG.C When the camera condition buttonis operated, the camera condition setting unitis displayed as illustrated in, and the user can select the camera condition.

2 2 235 232 2 The camera condition is a condition for designating the imaged imaging device. Model information and a serial number of the imaging deviceare added to each image in metadata. In the camera condition setting unit, information of the imaging device and a check boxare displayed for all images of the event to be processed. For example, in this case, the model name and the serial number are displayed. For the imaging devicewhose serial number is unknown, only the model name is displayed.

2 In addition, the number of images is also displayed for each imaging device. For example, in this drawing, the number of images is displayed as “80”, “123”, and “333”.

2 2 2 In this example, three imaging devicesare displayed, but in a case where three or more imaging devicesare present, the imaging devicesare displayed by a scroll operation.

2 232 2 The user can specify the imaged imaging deviceby checking the check boxand set the filter condition so as to display the images of the imaging device.

221 235 230 1 Every time a condition is changed by any one of the filter condition setting unit, the camera condition setting unit, and the archive condition setting unit, the staff terminalperforms filtering under a new condition, and performs image display and other display changes as a result.

242 225 230 235 128 13 FIG. That is, as the processing in step Sin, filtering is performed on the basis of condition settings in the eye closure condition switch, the archive condition setting unit, and the camera condition setting unitat that time. Then, extracted images as filtering results are displayed in a list in the image area.

228 235 230 221 28 FIG.C 28 FIG.D 28 FIG.B Note that, when the return iconis operated in the camera condition setting unitofand the archive condition setting unitof, the display returns to the display of the filter condition setting unitof.

222 221 235 230 243 222 221 235 230 243 28 28 28 FIGS.B,C, andD 28 FIG.A 13 FIG. In addition, when the close buttonis operated in any one of, the filter condition setting unit, the camera condition setting unit, or the archive condition setting unitis closed, and the state returns to the state of. This is a case where it is determined in step Softhat the change of the filter setting is ended, and the process returns to the monitoring loop. Note that, in addition to the close button, in a case where an area other than the area of the filter condition setting unit, the camera condition setting unit, or the archive condition setting unitis tapped on the screen, it is also possible to similarly end the filter setting change and return from step Sto the monitoring loop.

136 The display change according to the filtering is performed on not only the displayed images but also the display mode of the filter operation iconand the number of images.

29 FIG.A 29 FIG.B 29 FIG.A 29 FIG.B 225 128 illustrates a state before filtering is performed, andillustrates a state after filtering is performed. For example, it is assumed that the display of the eye closure images is turned off by the eye closure condition switch, and the images displayed in the list in the image areainclude the eye closure images in, but the eye closure images are not displayed in.

136 29 FIG.B In addition, the color of the filter operation iconis changed in the state ofwhere filtering has been performed. Therefore, it presents that it is the list display after filtering.

125 In addition, the number of images displayed in the all tabis changed from “2065” to “2010”. This represents a decrease in the number of images in response to the fact that the eye closure images are no longer displayed by filtering.

Note that the display of the number of images is changed immediately when the filter condition is changed.

30 FIG.A 2 235 2 125 In, all the three imaging devicesare selected by the camera condition setting unit, the number of images of each imaging deviceis “100”, “1000”, and “1065”, and the number of images displayed in the all tab, that is, the total number is “2165”.

2 125 30 FIG.B A state in which the user unchecks the first imaging devicefrom this state is illustrated in, and the number of images displayed in the all tabbecomes “2065” in response to the 100 images being hidden by the filtering.

226 2 31 FIG.A 31 FIG.B In a case where the information buttonis tapped as illustrated in, the guidance display inis performed. Here, a setting guide in the imaging devicefor performing filtering for each model is displayed.

227 140 32 FIG.A 32 FIG.B In a case where the information buttonis tapped as illustrated in, the guidance display inis performed. Here, it is displayed that image archiving can be executed on the one-picture display screen.

31 32 FIGS.B andB The guidance display inis closed by an OK operation.

242 13 FIG. Each processing such as filter condition setting, filtering, display change, guidance display, and the like described above is performed in step Sin.

2 According to this filtering, display of the archived image, the eye closure image, and the image for each model of the imaging devicecan be turned on/off. This makes selection by the user efficient.

Note that the filter processing merely sets whether to display on the screen. The non-display due to the filter processing does not affect the adoption/rejection to the image collection. That is, it does not affect the setting of the selection flag.

126 126 126 The non-display of the image by the filtering is also effective when the candidate tabis displayed, that is, even when the selection flag is turned on, there may be images that are not displayed in the candidate tab. This can be used to reduce the population parameter in a case of reviewing ones whose selection flag is turned on once in the candidate tabor the like.

126 140 126 For example, if the transition from the candidate tabto the one-picture display screenis made, the images to be delivered are archived, and then the archive images are hidden in the candidate tab, the population parameter of selection can be reduced when an image whose selection flag is to be removed is selected.

136 125 29 FIG.B Meanwhile, when the images extracted under the selected filter condition are displayed, it is desirable to clearly indicate to the user that not all the images are displayed. Therefore, the display mode of the filter operation iconis changed as illustrated in. For example, the color is changed. Therefore, even if the user selects the all tab, the user can recognize that the images are not all images.

140 140 138 253 268 33 FIG.A 33 FIG.B 16 FIG. Meanwhile, in the case of the one-picture display screen, it is convenient to know the current filter condition. Therefore, on the one-picture display screen, as illustrated in, the filtering condition display inis performed by operating the filter condition icon. That is, a rating condition, a model condition of the imaging device, a setting state for displaying the archive images/non-archive images, and the eye closure images are illustrated. This is the processing of steps Sand Sof.

When the current filtering condition is indicated, it is possible to recognize what kind of condition the current image corresponds to and is displayed.

33 FIG.B 16 FIG. 33 FIG.B 253 268 Note that the OK operation performed in the filtering condition display incorresponds to the OFF operation of the filtering condition display in step Sin. In this case, in step S, the filter condition display inis ended.

132 212 13 FIG. Next, processing in a case where the operation of the next iconis detected in step Sofwill be described.

1 300 150 18 FIG. 34 FIG. In this case, the processing of the staff terminalproceeds to step Sof, and the cover/highlight selection screenas illustrated inis displayed.

150 The cover/highlight selection screenis a screen for the camera staff to perform an operation of selecting images to be a cover (front cover) or images to be highlighted (emphasized) in the web gallery.

150 133 132 On the cover/highlight selection screen, a return iconand a next iconare displayed.

153 150 151 152 In addition, a list designation areais provided on the cover/highlight selection screen, and a candidate taband a selection tabare prepared.

151 153 When the candidate tabis selected, the list designation areadisplays a list of the images that are selected as the flag-on images (that is, the images selected as the images to be used in the web gallery).

155 156 155 156 In addition, a highlight buttonand a cover buttonare displayed for each image. The highlight buttonis an operator for designating an image as a highlight, and the cover buttonis an operator for designating an image as a cover.

155 156 Note that the highlight buttonmay also express the presence or absence of the current highlight setting according to the display mode, and the cover buttonmay express the current cover setting state according to the display mode.

152 153 When the selection tabis selected, images for which cover designation or highlight designation has been made are listed in the list designation area.

150 The camera staff operates such a cover/highlight selection screento select images to be used as a cover or images to be highlighted.

150 300 1 301 305 18 FIG. In a state where the cover/highlight selection screenis displayed in step Sof, the staff terminalperforms the monitoring loop processing from step Sto step S.

301 1 156 In step S, the staff terminalmonitors the operation of the cover button.

156 1 310 60 In a case where the operation on the cover buttonis detected, the staff terminalproceeds to step S, sets the front cover image information in the selection information so as to set the corresponding image as the cover image, and updates the event data.

311 1 4 90 4 In addition, in step S, the staff terminaltransmits the updated selection information to the server device, and the event datais updated on the server deviceside. That is, the synchronization state is maintained.

302 1 155 In step S, the staff terminalmonitors the operation of the highlight button.

155 1 320 60 In a case where the operation on the highlight buttonis detected, the staff terminalproceeds to step S, sets the emphasized display image information in the selection information so as to set the corresponding image as a highlight image, and updates the event data.

321 1 4 90 4 In addition, in step S, the staff terminaltransmits the updated selection information to the server device, and the event datais updated on the server deviceside. That is, the synchronization state is maintained.

303 1 152 151 151 152 In step S, the staff terminalmonitors the tab switching operation. The tab switching operation in this case is an operation of the selection tabdisplayed during the list display of the candidate tabor an operation of the candidate tabdisplayed during the list display of the selection tab.

1 153 330 When detecting the tab switching operation, the staff terminalperforms processing of switching the list display content in the list designation areaaccording to the selected tab in step S.

305 1 133 133 1 211 120 200 13 FIG. In step S, the staff terminalmonitors the operation of the return icon. When detecting the operation of the return icon, the staff terminalproceeds to step Sofand returns to the display state of the time viewor the event view.

As a result, the camera staff can interrupt the cover/highlight designation or redo the selection from the flag setting.

150 132 When the operation on the cover/highlight selection screenis completed, the camera staff operates the next icon.

304 1 132 132 1 340 18 FIG. In step Sof, the staff terminalmonitors the operation of the next icon. When detecting the operation of the next icon, the staff terminalproceeds to step Sand displays a confirmation screen.

35 FIG. 160 160 133 132 161 illustrates an example of the confirmation screen. On the confirmation screen, a return iconand a next iconare prepared, a detail areais prepared, and the final confirmation content is displayed. For example, detailed information such as the number of flagged images to be adopted for the web gallery, the number of images to be highlighted, a title, a date, and the like is displayed.

1 132 341 133 342 18 FIG. The staff terminalmonitors the operation of the next iconin step Sofand monitors the operation of the return iconin step S.

133 1 300 150 When detecting the operation of the return icon, the staff terminalreturns to step Sand returns to the display state of the cover/highlight selection screen.

132 1 343 4 When detecting the operation of the next icon, the staff terminalproceeds to step Sand transmits a web gallery generation request to the server device.

201 110 211 120 200 12 FIG. 13 FIG. Then, the process proceeds to step Sin, and returns to the display state of the project list screen. Note that, in this case, the processing may proceed to step Sinand return to the time viewor the event view.

1 3 4 2 FIG. Although the processing of the staff terminalup to the selection stage of step Sinhas been described above, the processing on the server deviceside will be described here.

36 FIG. 6 FIG. 36 FIG. 4 1 4 71 70 40 41 illustrates processing of the server devicecorresponding to communication from the staff terminal. Note that the processing of the server devicedescribed below is processing performed by the CPUof the information processing devicehaving the function of. In, processing is mainly executed by the functions of the event data management unitand the image collection generation unit.

1 1 4 2 FIG. At the stage of step Sin, presetting information is transmitted from the staff terminalto the server device.

1 4 500 510 4 After receiving the information regarding the project setting from the staff terminal, the server deviceproceeds from step Sto step S, and performs the project setting processing in the server device.

1 1 10 13 4 90 9 FIG. The project setting communication from the staff terminalis communication performed by the staff terminalto the server in the processing from step Sto step Sin. For example, information such as an event name, a date and time, a place, and the like of the created project is transmitted. The server devicesets a new project on the basis of these pieces of information, and sets the event data.

1 4 4 91 90 90 60 In addition, on the staff terminalside, not only setting of the project itself but also auto retouch setting, watermark setting, and the like are performed, and sequential setting information is transmitted to the server device. The server devicedescribes these pieces of information as the presetting informationof the event data, thereby synchronizing the event datawith the event datain the presetting state.

2 2 4 105 1 2 FIG. 11 FIG. At the stage of step Sin, the metadata including the images and the rating information, the eye closure information, and the like transferred from the imaging deviceare transmitted to the server deviceby the processing of step Sinof the staff terminal.

1 4 501 520 90 90 36 FIG. After receiving the images and the metadata from the staff terminal, the server deviceproceeds from step Sto step Sin, and takes in the images and the metadata as information of the event dataof the corresponding project. Rating information in the metadata is extracted from the metadata and managed in an updatable state thereafter in the event data.

3 1 2 1 4 2 FIG. 12 18 FIGS.to At the stage of step Sof, in the process of the processing ofof the staff terminal, various types of information for maintaining synchronization with the imaging deviceare transmitted from the staff terminalto the server device.

1 4 502 530 90 36 FIG. After receiving the rating information from the staff terminal, the server deviceproceeds from step Sto step Sin, and updates the rating information for the corresponding image in the event dataof the corresponding project.

1 4 503 540 90 After receiving the selection information from the staff terminal, the server deviceproceeds from step Sto step S, and updates the selection information for the corresponding image in the event dataof the corresponding project.

4 That is, updating of the used image information by flag setting, the front cover image information as a cover, the emphasized display image information by highlight setting, and the like is sequentially performed on the server deviceside.

1 4 504 550 90 After receiving the editing information from the staff terminal, the server deviceproceeds from step Sto step S, and updates the editing information for the corresponding image in the event dataof the corresponding project.

1 4 505 555 90 After receiving the archive information from the staff terminal, the server deviceproceeds from step Sto step S, and updates the archive information on the corresponding image in the event dataof the corresponding project.

1 4 506 560 1 343 18 FIG. After receiving the web gallery editing information from the staff terminal, the server deviceproceeds from step Sto step S. This is information transmitted by the staff terminalin step Sof.

560 4 61 97 36 FIG. 8 FIG. In step Sof, the server devicefirst performs image editing processing using the parameter as the editing information (including the editing information by the presetting information) on each image that is set as the flag-on image as the used image information, and writes out the image as an image for the web gallery. That is, each edited image stored in the image folderofis generated.

561 4 96 36 FIG. 8 FIG. In step Sof, the server deviceperforms web gallery generation processing. That is, for example, the web page setting informationofas HTML data or the like is generated, and entry is performed as a web page. This forms a web gallery.

562 4 1 1 36 FIG. In step Sof, the server devicetransmits a uniform resource locator (URL) of the web gallery to the staff terminal. As a result, the staff terminalcan browse the web gallery.

1 Note that, at this time, the web gallery is still set to be non-public, and only the staff terminalof the URL transmission destination can browse.

4 1 3 2 FIG. The processing of the server devicecorresponding to the processing of the staff terminalup to step Sinhas been described above.

36 FIG. 12 FIG. 90 1 4 201 Note that, although not illustrated in, processing of providing the event datato the staff terminallogged in to the server deviceis performed as necessary (see the description of step Sin).

4 1 4 2 FIG. 37 FIG. After the web gallery is generated, as the stage of step Sin, a share request is transmitted from the staff terminalto the server device(described later with reference to).

1 507 570 5 36 FIG. In this case, the staff terminalproceeds from step Sto step Sin, and sets the corresponding web gallery as a publishing setting. For example, it can also be browsed from the client terminal.

1 4 2 FIG. 37 FIG. The processing of the staff terminalat the stage of the web gallery delivery processing in step Sofwill be described with reference to.

4 90 4 1 37 FIG. When the web gallery generation request is transmitted to the server deviceas described above, the web gallery is generated on the basis of the event datain the server device, and the URL of the web page is transmitted.illustrates processing of the staff terminalafter the URL is acquired.

1 370 1 The staff terminalaccesses the web page using the URL acquired in step S. As a result, a preview of the web gallery can be browsed on the staff terminal.

180 38 FIG. This is a browsing for the camera staff to preview for confirmation, and the web gallery for the preview is, for example, a preview screenin.

183 181 182 For example, a created web gallery is displayed in a preview area, and an edit buttonand a share buttonare prepared.

183 4 The web gallery content displayed in the preview area, that is, the web gallery created by the server devicehas a configuration in which images with flags set to ON are arranged in chronological order, for example. In addition, an image to which the front cover image information is set is displayed on the top as a front cover. In addition, the images highlighted by the emphasized display image information are displayed in a larger size than the images not highlighted. Note that even an image for which highlight setting has not been performed may be automatically arranged in a large size. This is done to give balance and sharpness to the gallery as a whole.

1 371 181 372 182 373 37 FIG. In the staff terminal, the browsing end operation is monitored in step Sof, the operation of the edit buttonis monitored in step S, and the operation of the share buttonis monitored in step S.

When the operation of ending the browsing is detected, the web page browsing is ended.

181 1 380 When the operation of the edit buttonis detected, the staff terminalproceeds to step Sand performs editing processing.

183 181 The camera staff can view the web gallery content in the preview areaand operate the edit buttonas needed to further edit.

380 1 In the editing processing in step S, the staff terminaldisplays an interface image for editing, receives an operation of the camera staff, and edits the preview image accordingly. For example, the background color, the font of the title, the color of the title, the position of the title, the music of the slide show, and the like can be edited.

4 Then, in response to the editing completion operation, the editing information is transmitted to the server device, and the editing operation is reflected in the web gallery.

182 1 381 4 4 570 36 FIG. The camera staff performs an editing operation as necessary, and then operates the share button. In this case, the staff terminalproceeds to step Sand transmits a share request to the server device. As described above, the server devicemakes the web gallery public in step Sinin response to the share request.

382 1 37 FIG. In step Sof, the staff terminalperforms screen display for completion of delivery of the web gallery and processing corresponding to screen operation.

1 190 190 193 191 192 39 FIG. For example, the staff terminaldisplays a web gallery delivery screenof. The web gallery delivery screendisplays a notification of completion of creation of the web gallery, a valid period, and a URLof the web gallery. In addition, a copy buttonand a share buttonare displayed.

191 5 192 The camera staff can copy the URL by operating the copy button, attach the URL to an e-mail or the like, and transmit the e-mail to the client terminal. In addition, the share buttonis operated to provide a URL to an SNS or the like so that a client can browse the web gallery via the SNS.

As described above, the client can browse the web gallery at an extremely early time such as during the day after the end of the wedding or the like.

Note that distributing the URL to the client to allow the client to browse the image collection as a web gallery is an example. For example, image collection content corresponding to the web gallery described above may be created and distributed to the client as a content file.

5 2 FIG. The actual delivery processing is performed at the stage of step Sin.

40 FIG. 3 1 3 illustrates processing at the actual delivery stage. This is, for example, processing performed by the personal computeror the staff terminal. Hereinafter, processing performed by the personal computerwill be described.

3 4 400 The camera staff performs an operation using the personal computer, accesses the server devicein step S, and makes an information reading request for actual delivery.

401 90 4 Then, in step S, the event datais acquired from the server device.

4 3 For example, in this case, it is conceivable that the server devicecauses the rating information and the selection information or the editing information to be downloaded as an XMP file so that it can be applied to the RAW image file in the personal computer.

3 That is, the personal computertakes over the rating information, the used image information indicating the flag setting, the front cover image information indicating the cover image, the emphasized display image information indicating the highlight setting, and the like.

90 3 Note that all of the event datamay be provided to the personal computer.

2 3 90 4 The camera staff takes in RAW image data as image data captured by the imaging deviceinto the personal computer, and generates an image collection of actual delivery using the RAW image data. In this case, the creation work can be made efficient by acquiring the XMP file based on the event datafrom the server device.

3 402 The personal computerperforms necessary editing processing in step Sto complete the image collection of the actual delivery.

403 Thereafter, in step S, processing for actual delivery is performed. For example, processing of generating content data as image collection content, electronically transmitting the content data, recording the content data on a recording medium, or using the content data as print data is performed.

Then, the created content data, a recording medium recording the content data, or an image collection by a printed paper medium is delivered to the client.

200 21 22 FIGS., The event viewillustrated in, and the like will be described.

200 120 128 The event viewdiffers from the time viewin an arrangement manner of images in the image area.

128 A series of images in an event such as a wedding or the like is divided into sub-events and scenes, and images of one scene are arranged in the image areain the horizontal direction. Then, each scene and each sub-event are arranged in the vertical direction.

240 240 An event title unitis displayed for each sub-event. In the event title unit, for example, names of sub-events such as “Ceremony”, “Cocktails”, and the like are indicated. Note that the name may be more regularly “event1”, “event2”, . . . , or the like.

240 The number of images included in the sub-event, the time when the sub-event is performed, and the like are also displayed in the event title unit.

241 In addition, the sub-event is subdivided into scenes, and the name of each scene is displayed as a scene title unit. For example, “Scene1”, “Scene2”, and . . . are set.

The names of the sub-events or the scenes may be arbitrarily input by the user, or candidates may be set in advance and selected. In a case where a sub-event or a scene can be predicted for each classification of an event, a name candidate for the sub-event or the scene may be prepared and selected by the user, or the sub-event or the scene may be automatically determined from image contents.

Images of one scene are arranged in the horizontal direction. Each image appears in a horizontal scrolling operation.

21 FIG. In the example of, “Scene1”, “Scene2”, and “Scene3” are divided in a sub-event of “Ceremony”, and then a sub-event of “Cocktails” are arranged in the vertical direction. Sub-events and scenes appear in chronological order by a vertical scroll operation.

200 203 In the event view, an update buttonis displayed. This is an operator for giving an instruction to update of the division of the sub-events and scenes.

200 201 201 In the event view, the index barcan be displayed. The index bardisplays, for example, the time and title of each sub-event.

201 As a result, the number and types of sub-events can be listed. When the number of sub-events is large, it is handled by scrolling the index baritself.

201 201 In addition, the index baralso functions as a jump operation unit for displaying a sub-event. For example, by tapping the portion of “Party Time” of the index bar, the display is jumped in the vertical scroll direction, and the portion of the images of each scene of the sub-event “Party Time” is displayed.

201 214 241 13 FIG. The tap operation on the index baris detected in step Sof, and the display jump is performed as the processing of step S.

201 200 201 201 201 201 In addition, it is conceivable that the index baris automatically erased after being displayed for a predetermined time when the event viewis displayed. In that case, the user can call the index barby swiping from the right end of the screen. Furthermore, the index barmay be closed by swiping to the right from the position of the index barwhile the index baris being displayed.

214 241 13 FIG. The processing corresponding to such swipes is also the processing of steps Sand Sof.

210 130 131 120 For each image, the eye closure icon, the rating icon, and the flag setting iconare displayed, and rating and selection flag setting can be performed similarly to the time view.

200 125 126 120 In addition, also in the event view, the all taband the candidate tabcan be switched as in the time view.

200 129 In addition, also in the event view, the filter designation areais provided, and the above-described filtering function can be implemented.

41 FIG. illustrates display switching.

110 211 120 200 10 FIG. 13 FIG. In a case where the process proceeds from the project list screenillustrated into step Sin, the time viewor the event viewis displayed. At this time, it is conceivable that which view is displayed is, for example, the last view selected for the event at the time of the previous browsing.

120 200 202 As described above, the time viewand the event vieware switchable by the view switching button.

120 200 200 120 200 200 200 136 It is conceivable that the filtering condition is maintained even when the time viewis switched to the event view. That is, in a case where switching to the event viewis performed in a state where filtering is performed in the time view, images according to the filtering condition are also displayed in the event view. For example, when a filtering condition under which archived images are not displayed is set, the archive images are not displayed even if the view is switched to the event view. Of course, also in the event view, the filter condition can be changed from the filter operation icon.

120 200 140 133 140 120 200 140 When one image is selected from the time viewor the event view, the display transitions to the one-picture display screen. When the return iconof the one-picture display screenis operated, the display returns to the time viewor the event viewas the list state before the transition to the one-picture display screen.

120 200 Since such a screen transition is performed, the user can arbitrarily switch between the time viewand the event viewas a list display.

120 200 42 FIG. Differences between the time viewand the event vieware illustrated in.

42 FIG. 20 FIG.B 120 illustrates an arrangement of images in the time view. For example, as illustrated in, two images are displayed in the horizontal direction of the screen.

Each image is simply arranged in chronological order as the imaging time. The user can confirm each image by a vertical scroll operation. However, in other words, in a case where it is desired to confirm an image of a desired sub-event, the target image cannot be reached unless a long vertical scroll is performed with consideration of an approximate time.

200 42 FIG.B On the other hand, an image arrangement of the event viewis as illustrated in.

128 Each scene is arranged in a vertical direction, and a plurality of images of one scene is arranged in a horizontal direction. When searching for images in one scene, each image of the scene appears in the image areaby horizontal scrolling.

Since the sub-events and the scenes are arranged in the vertical direction, in a case where there is a sub-event for which an image is desired to be confirmed, the scene of the sub-event can be reached relatively quickly by scrolling in the vertical direction.

Moreover, in the scene to be confirmed, the images are arranged in the horizontal direction, and thus it is easy to compare.

200 120 From the above, the event viewhas advantages that it is easy to access each image and it is easy to compare images of the same scene for selection as compared with the time view.

Note that, although a plurality of images of one scene is arranged in the horizontal direction as one row, if the number of images of the scene is excessively large, horizontal scrolling becomes long, and usability may be deteriorated. Therefore, the upper limit of the number of images arranged in the horizontal direction is set. For example, the upper limit of the number of images arranged in the horizontal direction is 30. In a case where the number of images in the scene exceeds, the next row is used to align horizontally. Therefore, images of one scene may be displayed over a plurality of lines.

120 200 In addition, when the time viewis switched to the event view, it is desirable to make the display easy for the user to understand.

120 200 128 Therefore, in the time viewimmediately before the display switching, the display state in the event viewis set by focusing on the uppermost left image in the image area.

1 6 Suppose that there are six images of image pctto image pctin a certain scene.

1 128 120 200 1 128 43 FIG.A Suppose that the image pctis displayed at the upper left of the image areain the time viewimmediately before switching. In this case, when the view is switched to the event view, as illustrated in, the image pctis displayed at the upper left of the image area. An image or a portion of the image indicated by a broken line in the drawing is not displayed at that time but appears by scrolling.

3 128 120 200 3 128 43 FIG.B In addition, suppose that the image pctis displayed at the upper left of the image areain the time viewimmediately before switching. In this case, when the view is switched to the event view, as illustrated in, the image pctis displayed at the upper left of the image area.

6 128 120 6 128 200 6 43 FIG.C Suppose that the image pctat the rear end of the scene is displayed at the upper left of the image areain the time viewimmediately before switching. In this case, it is not very appropriate to set a state in which the image pctis displayed at the upper left of the image areawhen the view is switched to the event view. Therefore, as illustrated in, at least the image pctis displayed.

120 200 As described above, the user will be not confused even if the display is changed as long as the upper left image in the time viewis arranged at the upper left even if the view is switched to the event view. Even in a case where the image cannot be displayed at the upper left after switching, it is desirable that at least the same image is displayed.

44 FIG. 125 126 200 Next,illustrates display switching of the all taband candidate tabsin the event view.

125 44 FIG.A In the display of the all tabin, all images are displayed for each scene.

126 44 FIG.B In the display of the candidate tabin, images in which the selection flag is turned on are displayed for each scene.

240 241 126 The event title unitand the scene title unitare also displayed in the display of the candidate tab, and the images of each scene are arranged side by side in the horizontal direction.

126 240 44 FIG.B Furthermore, in the candidate tab, the event title unitis also displayed for a sub-event or scene for which no image is selected. For example, in the sub-event “EVENT2” in, there is no image for which the selection flag is turned on, and the number of images is also “0”.

241 In addition, there is no image for which the selection flag is turned on in the scene “SCENE1” in the sub-event “EVENT3”, but the scene title unitis displayed.

126 By browsing such a candidate tab, the user can confirm what kind of image is selected (selection flag is turned on) to be used for image collection, how many images are selected, or the like for each sub-event or scene, which is useful in considering the balance of image contents and the number of images in units of sub-events or in units of scenes.

200 351 359 360 363 15 FIG. With regard to the display of the event viewas described above, the processing from step Sto step Sand the processing from step Sto step Sinare performed. These processes will be described.

120 200 221 1 351 200 63 60 15 FIG. 5 FIG. In a case where the switching operation from the time viewto the event viewis detected in step Sof, the staff terminalproceeds to step Sand branches the processing depending on whether or not the event viewis requested to be displayed for the first time for the current event (event set as one project). The first time can be said to be a state in which the division informationis not stored in the event dataof.

355 352 If it is not the first time, the process proceeds to step S, but if it is the first time, it is confirmed in step Swhether or not the number of images of the target event is less than a predetermined number. For example, it is determined whether or not the number of pictures is less than 100.

1 353 If the number of images is less than the predetermined number, the staff terminaldisplays a dialog for confirming the event view display in step S, and requests the user to OK or cancel.

200 200 200 For example, in order to accurately classify sub-events and scenes and appropriately display the event view, it is preferable that the number of images is large. If the number of images is small, appropriate scene determination may not be performed. In addition, if the number of images of each scene is one, or the like, there is a possibility that the display of the event viewis not very effective. In addition, the transition to the event viewrequires division determination processing, and may take time such as several seconds to a maximum of about several 10 seconds or the like.

1 358 Therefore, such a description is made by a confirmation dialog, and when it is the first time and the number of images is less than a predetermined number, confirmation of the user is requested. In a case where the user performs the cancel operation, the process returns to the monitoring loop. In a case where the user performs an OK operation on the dialog display, the staff terminalproceeds to step S.

353 354 200 Note that the request for confirmation from the user in steps Sand Shas a meaning of asking the user whether or not to execute the time-consuming division determination processing in a case where the number of images is small as described above and there is a possibility that the event viewis not very effective (not so different from the time view).

353 354 Here, it is also assumed that the time required for the division determination processing changes due to device performance, improvement in program efficiency, or the like, and the user hardly feels the waiting time. If the division determination processing does not require time, there is no waiting time of the user even if the division determination processing is particularly performed, and thus the processing of steps Sand Smay not be performed.

200 1 358 In addition, even if the switching operation to the event viewis the first time, in a case where there is a predetermined number or more of images, the staff terminalproceeds to step Swithout presenting the confirmation dialog described above.

200 In this case, since the number of images is a predetermined number or more, the event viewis assumed to be useful as a list, and a division determination processing is required for this display.

200 358 In the display of the event view, it is necessary to perform the division determination processing to determine the division of the sub-events or scenes for a series of images in chronological order. Therefore, in a case where the process target project responds to the first switching request, the division determination processing is performed in step S.

200 355 Note that division determination processing may be performed in advance prior to the first request for display of the event view. In that case, it is conceivable to proceed to step Seven for the first time.

358 359 200 When the division determination processing is performed in step Sand the division of the sub-events and the scenes for each image in chronological order is determined, the process proceeds to step S, and the event viewis displayed using the information of the result of the determination processing.

200 1 351 355 In a case where the switching operation to the event viewis not the first time, the staff terminalproceeds from step Sto step Sand confirms whether or not there is an image with no scene setting.

200 2 In a case where the division determination processing has been performed in the past for the images of the target event and the division of the sub-events and the scenes has been set, the event viewcan be displayed accordingly. However, even if the division determination processing has been performed in the past, in a case where images for the target event have been newly transferred from the imaging devicethereafter, these images have not been targets of the division determination processing, and thus the scenes have not been set.

359 200 63 5 FIG. If there is no image for which a scene has not been set, and division of scenes has been set for all the images at the present time, the process proceeds to step S, and the event viewis displayed by using the information of the result of the past division determination processing stored as the division informationin.

355 1 355 356 In a case where it is determined in step Sthat there is an image with no scene setting, the staff terminalproceeds from step Sto step S, performs dialog display of whether or not to execute calculation as the division determination processing, and confirms to the user whether or not the division determination processing for updating the scene setting may be performed. This is because the division determination processing takes about several 10 seconds.

1 358 359 200 In a case where the user performs the OK operation, the staff terminalperforms the division determination processing in step S, and determines the division of the sub-events and scenes for each image in chronological order. Then, the process proceeds to step S, and the event viewis displayed using the information of the result of the determination processing.

356 1 359 200 In a case where the user has not performed the OK operation on the dialog in step S, the staff terminalproceeds to step Swithout performing new division determination processing, and displays the event viewusing the information of the result of the past division determination processing. In this case, images (update-waiting images) not included in the scenes are also displayed.

356 357 356 357 355 358 Note that, in steps Sand S, the user is asked whether or not to allow the waiting time for the division determination processing. Therefore, if the division determination processing can be executed in a short time (for example, about several seconds), the processing of steps Sand Smay be omitted. That is, when there is an image with no scene setting, the process may unconditionally proceed from step Sto step S.

1 356 357 Alternatively, the estimated time of the division determination processing may be determined from the processing capability of the staff terminal, the number of images at that time, and the like, and permission may be requested from the user in the processing of steps Sand Sonly in a case where the estimated time is long such as several 10 seconds or the like.

15 FIG. 221 355 358 1 1 359 221 Moreover, in the example of, when the switching operation to the event view is detected in step S, an image for which a scene is not set is determined in step S, and the division determination processing is performed in step S, but the present invention is not limited thereto. For example, the staff terminalmay sequentially confirm the presence of an image with no scene setting, and if there is an image with no scene setting, the staff terminalmay automatically perform division determination processing to reset the event and the scenes. In particular, in a case where the processing time of the division determination processing is extremely short or in a case where the processing load is light, it is preferable to perform the division determination processing by the background processing. In a case where the division determination processing is automatically sequentially performed in this manner, the process can immediately proceed to step Sin response to the operation detection in step S.

45 FIG. 358 illustrates an example of the division determination processing in step S.

601 1 2 2 First, in step S, the staff terminalsorts the processing order of all the images of the event that is the project targeted for the division determination processing by the imaging time. For example, sorting is performed with reference to the imaging time in the metadata of each image. In this case, although there is a case where images are transferred from a plurality of imaging devices, all the images of the event are sorted in order of imaging time regardless of the type of the imaging device.

602 1 611 603 609 610 In step S, the staff terminalsets the total number of target images as the total number xmax and sets the variable x to 1, and thereafter, while incrementing the variable x in step S, repeats the processing from step Sto step Suntil the variable x reaches the total number xmax in step S.

603 1 601 In step S, the staff terminalacquires information of the x-th image in the sorting order in step S. For example, the imaging time is acquired from the metadata. In addition, if there is information as an image analysis result, it is also conceivable to acquire information of the recognized subject, for example, people, the number of people, face recognition information, personal identification information, article information, and the like. In addition, it is also conceivable to acquire various types of information at the time of imaging included in the metadata, for example, positional information, environmental information such as ambient brightness or the like, identification information of the imaging device, angle of view information at the time of imaging, exposure information, white balance information, a fixed state of the imaging device to the tripod, and the like.

1 604 610 611 603 When the variable x=1, that is, when the first image in chronological order is targeted, the staff terminalproceeds from step Sto steps Sand S, and acquires information of the next image in step Swith x=2.

1 604 605 When the information is acquired for the second and subsequent images in the sorting order, the staff terminalproceeds from step Sto step S, and compares the acquired information with the image at the imaging time one time before.

606 1 In step S, the staff terminaldetermines whether or not a space between the x-th image and the (x−1)-th image in the order of imaging time satisfies a division condition of sub-events.

603 For example, in a case where the information of the imaging time is acquired in step S, if the difference between the times of the two images is greater than or equal to a first threshold value, it is assumed that the division condition of sub-events is satisfied. For example, the first threshold value is five minutes or the like.

1 607 In a case where the division condition of sub-events is satisfied, the staff terminalsets one sub-event range in step Son the assumption that the space between the x-th image and the (x−1)-th image is the division of sub-events. That is, images in a range from the division of the sub-event sensed immediately before (the head time in the case of the division of the first sub-event) to the division of the current sub-event is defined as a range of one sub-event.

1 606 608 In a case where the division condition of sub-events is not satisfied, the staff terminalproceeds from step Sto step S, and determines whether or not a space between the x-th image and the (x−1)th image satisfies the division of scenes.

603 For example, in a case where the information on the imaging time is acquired in step S, if the difference between the times of the two images is equal to or larger than a second threshold value, it is assumed that the division condition of scenes is satisfied. For example, the second threshold value is shorter than the first threshold value. For example, the second threshold value is three minutes.

1 609 In a case where the division condition of scenes is satisfied, the staff terminalsets one scene range in step Son the assumption that the space between the x-th image and the (x−1)-th image is division of scenes. That is, images in a range from the division of the scene or the division of the sub-event sensed immediately before to the division of the current scene is defined as one scene division.

610 By repeating the above processing until the variable x=xmax is satisfied in step S, the sub-event division and the scene division are determined from all the images sorted in chronological order.

1 610 612 63 5 FIG. When the variable x=xmax, the staff terminalproceeds from step Sto step S, and stores the information of the determined division of sub-events and division of scenes as the division informationin the event data of.

358 359 200 200 15 FIG. 21 FIG. By performing such division determination processing in step Sof, in step S, the event viewas illustrated incan be displayed on the basis of the division determination result. In particular, in the division determination processing, the division of sub-events and the division of scenes are determined by the difference in time between the images arranged in order of imaging time, so that the display of each scene in the event viewcan be implemented relatively easily. In addition, for the camera operator, the division of scenes is likely to be appropriate.

45 FIG. 606 608 In the division determination processing ofdescribed above, the determination of the sub-event division and the determination of the scene division in steps Sand Sare made based on the difference between the imaging times (for example, five minutes and three minutes), but other determination conditions may be used.

The following examples are conceivable.

Change in People's Behavior (how Much People have Moved)

For example, by comparing the position information of each image, the movement of the place (ceremony hall, reception hall, outdoor, and the like) can be detected. Therefore, the division of sub-events or scenes can be determined by the change or the change amount of the position information.

1 Note that the position information of the staff terminalpossessed by the camera staff is stored for each time, and the movement trajectory can be determined, so that the position and movement of the camera staff at the time of capturing each image can be determined by collating the movement trajectory with the imaging time of each image. The division determination can also be performed on the basis of the information.

The angle of view information of each image is compared to determine the zoom state. The zoom magnification change can be one of determination elements of division of sub-events or scenes, as it is an operation performed by the camera operator according to a change in the subject situation.

A change in the number of subjects, a change in an individual subject, or the like can also be considered as a change of scenes or a change of sub-events. By comparing the information of the result of the image analysis between the images, it is possible to determine the division of sub-events or scenes.

4 Note that the image analysis information may be used by storing image analysis information for eye closure determination, for example. In addition, the number of subjects and the identification information of the subject person may be acquired from the server deviceas an image analysis result of each image.

Sub-events or scenes are determined on the basis of objects included in each image. For example, it is possible to determine a section of images in which a cake is captured, a section of images in which a bouquet is captured, and the like in chronological order, and to set the division of scenes or sub-events.

2 2 Information on the fixed state of each image is compared, and a timing at which the imaging deviceis fixed to the tripod and a timing at which the imaging deviceis removed from the fixed state are determined as division of scenes or sub-events.

In a case where a change in exposure correction or white balance is large, it is determined as division of scenes or sub-events.

2 Since the current brightness is metered inside the imaging device, division of scenes or sub-events is determined with reference to the value.

Although the above is an example, it is possible to determine division of sub-events or scenes on the basis of such various criteria. Of course, the division determination may be performed by combining a plurality of determination conditions.

222 203 200 15 FIG. Next, processing in a case where the scene setting update operation is detected in step Sofwill be described. This is a case where the user operates the update buttonin the event view.

360 1 In step S, the staff terminaldisplays a dialog to confirm to the user whether or not the scene setting may be updated. This is because the update may take time for performing the above-described division determination processing.

361 When the user performs a cancel operation, the process returns from step Sto the monitoring loop.

1 362 1 200 363 45 FIG. When the user performs an OK operation, the staff terminalproceeds to step Sand performs the division determination processing described in. Then, the staff terminalupdates the display of the event viewin step Son the basis of the result of the division determination.

200 2 2 2 200 2 200 200 For example, after the event viewis displayed, images may be newly transferred from the imaging device. In a case where the camera staff uses a plurality of imaging devices, after images of one imaging deviceis received and the event viewis displayed, images from another imaging devicemay be received. The new images cannot be reflected in sub-events or scenes in the event view. Therefore, it is preferable to redo the division determination processing including the new images so that the display of the event viewcan be updated.

360 361 360 361 Note that, as described above, it is also assumed that it does not take much time for the division determination processing. In that case, the processing of steps Sand Smay be omitted. Furthermore, steps Sand Smay be performed when a relatively long time is expected to be required depending on device performance and the number of images.

200 46 47 FIGS.and Examples of an interface for updating the event viewas illustrated inbelow are also conceivable.

46 FIG.A 128 200 illustrates an example in which the update-waiting images are displayed in a frame different from the sub-events in the image areaof the event view. The update-waiting images are images that have not yet been subjected to the division determination processing, that is, images received after the latest division determination processing.

For example, the update-waiting images are collectively displayed at a position ahead of the head sub-event (above in the scroll direction) or at a position behind the last sub-event (below in the scroll direction).

204 Furthermore, update-waiting labelsare superimposed and displayed on the update-waiting images for clearly indicating the update-waiting images.

205 In addition, at this time, an update dialogis displayed to indicate that there are update-waiting images and to function as an update operator.

With such a display, the user can recognize that the update-waiting images exist, and the update operation is recommended.

205 1 206 207 46 FIG.B 46 FIG.C 46 FIG.D When the user performs an operation such as tapping the update dialogor the like, the staff terminalstarts division determination processing and displays the updating dialogas illustrated in. Then, when the division determination processing is completed, a completion dialogis displayed as illustrated in. When the user taps, the display is updated as illustrated in. That is, all the images of the event at that time including the images that have been waiting for update are displayed in a list on the basis of the division of sub-events and scenes.

46 FIG. 207 The example ofis an example of a case where the user can perform another operation even during the update. Therefore, the display is updated after waiting for the tap operation of the completion dialog.

47 FIG. Other operations may be disabled during the update. An example of this case is illustrated in.

47 FIG.A 46 FIG.A is similar to.

205 1 206 47 FIG.B When the user performs an operation such as tapping the update dialogor the like, the staff terminalstarts the division determination processing and displays the updating dialogat the center of the screen as illustrated in. Other images may be grayed out and made inoperable. In addition, it is possible to perform an update cancel operation.

47 FIG.C Then, when the division determination processing is completed, the display is updated as illustrated in.

In the above embodiments, the following effects can be obtained.

1 31 30 The staff terminal, which is the information processing device according to the embodiment, includes the UI control unitthat performs processing of executing list display and individual display as display in which an image can be selected from an image group captured in a specific event, and processing of detecting an archive operation on the image displayed, and the event data management unitthat performs processing of storing archive information indicating that an archive setting has been performed in association with the image targeted for the archive operation.

Since the archive setting can be arbitrarily set for images, the camera staff can distinguish images that are not to be delivered, images that do not require confirmation, images that have been determined to be delivered, or the like from other images. Therefore, it is also possible to reduce the population parameter of the images for considering whether or not selection is performed by selection, and it is possible to promote the efficiency of selection.

1 33 31 In the example described above, the staff terminalaccording to the embodiment includes the filter processing unitthat performs filtering on the basis of the archive information, and the UI control unitperforms control such that images extracted by the filtering are displayed in a list as the list display.

Therefore, after arbitrarily setting archive, the image can be prevented from being displayed in a list or the like. For example, if an image determined not to be delivered is archived, it is possible to prevent the image from being displayed as a selection target, and it is possible to reduce the selection population parameter to promote the efficiency of selection.

28 FIG.D In the embodiment, an example has been described in which whether or not to perform the filtering based on the archive information or a filtering condition can be selected (see).

Therefore, the user can select to display images regardless of the presence or absence of the archive setting, to display only images not set with the archive setting, to display only images set for the archive setting, or the like, and can execute display according to the circumstances at that time.

31 30 62 60 5 FIG. In the embodiment, the UI control unitperforms control to provide a user interface capable of setting operation of selection information for creating an image collection by selectively using image data included in an image group of an event, and the event data management unitperforms processing of storing the archive information and the selection information in the imaging/editing information tableof the event dataas separate information (see).

Therefore, the user can perform the archive setting separately from the selection setting. For example, an archive setting can be performed for a certain image without considering whether or not the image is adopted for image collection. That is, the archive setting can be performed only from the viewpoint of whether or not to display. Therefore, for example, not only the images not to be delivered but also the images determined to be delivered can be archived to reduce the population parameter of the selection.

31 140 120 200 In the embodiment, an example has been described in which the UI control unitenables the archive operation on the display image at the time of individual display as the one-picture display screen. Furthermore, in the embodiment, when the time viewor the event viewis displayed as a list, the archive operation for the display images is not allowed.

Therefore, the user can perform the archive operation after firmly confirming the image while displaying one image. If the icon of the archive operation is displayed for each image on the list display, the screen becomes complicated, and it is difficult to operate the icon on a small image. In addition, it is difficult to perform an operation of swiping a specific image on the list image. Under such circumstances, if the archive operation can be performed on the list image, the screen is likely to be complicated and erroneous operation is likely to occur. Therefore, the archive operation can be performed only in the case of individual image display, and prevention of erroneous operation and elimination of screen complication are realized.

Note that an example of specifying an image and enabling an archive operation at the time of the list display is also conceivable.

31 25 FIG. In the embodiment, the UI control unitdetects a swipe operation in a predetermined direction with respect to a display image as an archive operation with respect to the image (see).

As a result, the user can perform archive setting on an arbitrary image by an intuitive operation of swiping the image upward on the screen.

In addition, in combination with the image switching according to the archive operation or the image switching by the swipe operation in the horizontal direction, it is possible to provide efficient operability such as archiving an arbitrary image by swiping upward while quickly confirming images one by one by swiping in the horizontal direction.

31 17 25 FIGS.and In the embodiment, the UI control unitperforms control to execute display that enables cancellation of the archive operation for a predetermined time when the archive operation is detected. For example, an undo instruction is enabled as a toast display at the time of the archive operation (See).

For example, in a case where the archive setting can be performed by a simple operation such as swiping or the like, there is a possibility that the archive operation is performed on an image that the user does not intend to archive. Therefore, it is possible to easily cancel the archive operation and recover from an unintended operation.

1 34 30 The staff terminalof the embodiment includes the image analysis unitthat performs image analysis on each image of the image group and determines eye closure of a subject person, and the event data management unitperforms processing of storing eye closure information in association with an image determined to be of eye closure.

By storing the eye closure information for each image, it is possible to perform processing of distinguishing between images with eyes closed and images with eyes not closed.

31 120 200 140 210 In the embodiment, the UI control unitperforms control to execute display indicating an image determined to be of eye closure on the basis of the eye closure information at the time of the list display (the time viewor the event view) or the individual display (the one-picture display screen). For example, the eye closure iconis displayed corresponding to the image.

210 As a result, the camera staff can easily discriminate whether or not each image is an eye closure image. In particular, in the case of a thumbnail image or a so-called “wide shot” image, it may be difficult to know whether or not eyes are closed. Since the eye closure images are presented with the eye closure iconsas in the embodiment, images not adopted for the image collection or the like can be efficiently discriminated.

33 31 120 200 In the embodiment, an example has been described in which the filter processing unitthat performs filtering on the basis of the eye closure information is included, and the UI control unitperforms control such that images extracted by the filtering are displayed in a list as the list display by the time viewand the event view.

Therefore, selection can be performed in a state in which the eye closure images are removed. Since the eye closure images are usually not appropriate for posting to an image collection, it is possible to reduce the selection population parameter and promote the efficiency of selection by displaying a list excluding such images and performing selection.

28 FIG.A In the exemplary embodiment, whether or not to perform the filtering based on the eye closure information can be selected (see).

Therefore, the user can arbitrarily select to browse the display excluding the eye closure images or to browse images to which the eye closure images are added. Even the eye closure images may be suitable for image collection depending on the scene or situation. Therefore, it is desirable to be able to display the eye closure images for image collection creation.

30 62 60 In the embodiment, the event data management unitperforms processing of storing the eye closure information and the selection information as separate information in the imaging/editing information tableof the event data.

Since the eye closure information based on the image analysis is managed as information different from the selection information, the eye closure state does not affect the selection to the image collection. The camera staff can decide the images to be adopted for the image collection with his/her own will regardless of whether or not the images are of eye closure.

33 2 31 28 FIG.C In the embodiment, the filter processing unitthat performs filtering on the basis of the information of the imaging devicethat has captured an image is included, and the UI control unitperforms control such that images extracted by the filtering are displayed in a list as the list display (see).

2 2 2 For example, images captured by the imaging deviceof a specific model or a specific serial number are displayed in a list. Therefore, selection can be performed in a state in which captured images for each type or each model of the imaging deviceare extracted. In a case where the camera staff distinguishes and uses imaging devices, it is extremely useful from the viewpoint of increasing the selection speed.

1 35 31 35 200 The staff terminalaccording to the embodiment includes the division determination unitthat determines chronological division for an image group captured in a specific event, and the UI control unitthat performs control such that, for each time zone divided by the division determined by the division determination unit, division reflection display is presented, that is, the event viewis displayed in a state in which all or some of images captured within a time zone are aligned in a first direction (for example, a horizontal direction: a left-right direction) and each time zone is aligned in a second direction (for example, a vertical direction: an up-down direction).

200 As the event view, a large number of images can be arranged with different meanings in the horizontal direction (first direction) and the vertical direction (second direction), and operability for image confirmation can be better than simple display arranged in chronological order. By providing a UI that makes it easy to confirm images, it is possible to promote the efficiency of selection.

Note that the vertical direction may be the first direction, and the horizontal direction may be the second direction. That is, images in the same time zone may be arranged in the vertical direction, and sub-events and scenes may be arranged in order in the horizontal direction.

31 120 200 In the embodiment, the UI control unitperforms switching control between the time viewas the simple chronological display in which images are displayed side by side in the order of time of imaging without being on the basis of the division, and the event viewas the division reflection display.

120 200 Since the time view(simple chronological display) is a simple list display, it is useful in a case where it is desired to immediately view the list. Meanwhile, since the event view(division reflection display) is executed through the division determination processing, it may take some time to display, but the division of the sub-events or the scenes is reflected as the list display, so that the visibility and the searchability are improved. In addition, the balance for each scene or sub-event is easy to understand.

120 200 Therefore, by switching the time viewand the event view, a list display according to the situation is provided.

31 120 200 202 In the embodiment, the UI control unitperforms control to alternately switch the time viewand the event viewin accordance with the operation of the view switching button.

120 200 By alternately switching the time viewand the event view, the user can easily select a suitable list display mode according to the situation.

200 31 In the embodiment, in the event view, the UI control unitperforms control such that scrolling is performed such that each image in one time zone (for example, a scene) by the division moves in the left-right direction (first direction) in accordance with a first direction operation such as a swipe in the left-right direction or the like, and scrolling is performed in the up-down direction (second direction) such that each time zone by the division appears in accordance with a second direction operation such as a swipe in the up-down direction or the like.

200 In the event view, the user can view images of a scene with a horizontal scroll. In addition, a scene desired to be viewed can be quickly searched by vertical scrolling. By setting the vertical and horizontal arrangement reflecting the division in this manner, it is possible to significantly improve the operability of image browsing.

35 The division determination unitaccording to the embodiment performs the division determination for sub-events performed in an event.

Since the division of sub-events is determined in the division determination processing, the camera staff can easily confirm the images for each sub-event.

In the embodiment, the example in which the images are displayed side by side in the horizontal direction in units of scenes has been described, but if the number of images is relatively small, the images may be displayed side by side in the horizontal direction in units of sub-events. This makes it suitable for image confirmation for each sub-event.

That is, the division is not hierarchized like sub-events and scenes, and may be, for example, one stage of only sub-events.

35 The division determination unitaccording to the embodiment performs the division determination for sub-events performed in an event and the division determination for scenes in sub-events.

By determining the division between the sub-events and scenes in the division determination processing, the division can be performed particularly in two stages, and the list display can be provided in units of sub-events, scenes, or the like. In particular, in a case where there are a large number of images even in units of sub-events, the image list can be viewed in units of finer division by subdividing the sub-events into scenes.

Of course, division of three or more stages may be set to further subdivide scenes.

31 In the embodiment, the UI control unitperforms control such that display of arranging images in the left-right direction (first direction) is performed with a unit of scene as one time zone.

In a case where a large number of images are captured in an event, the number of images may be extremely large even in units of sub-events. In this case, it is preferable to provide the list display by further subdividing the sub-events into scenes. That is, the images are displayed to be arranged in the horizontal direction in units of scenes. As a result, it is possible to search for images in a horizontal direction in units that are easy for the camera staff to see, and it is possible to provide an interface that makes it easier to confirm or select an image.

35 45 FIG. The example in which the division determination unitaccording to the embodiment determines a division on the basis of the time interval of each image in chronological order of the imaging time in the image group has been described (see).

If the time interval between the imaging time of one image and the imaging time of the next image is large, it can be determined that the subject content has been greatly changed, that is, it can be determined as a division of sub-events or scenes, and it is possible to perform the division determination with relatively simple processing and high reliability. As a result, appropriate division reflection display can be relatively easily implemented.

35 In the embodiment, an example has been described in which the division determination unitdetermines a division on the basis of an image analysis result of each image in chronological order of imaging times in an image group.

Division of sub-events and scenes can be performed depending on the subject person, the number of persons, the items shown, and the like. Accordingly, it is possible to implement appropriate division reflection display.

31 In the embodiment, the UI control unitprevents the number of images arranged in the left-right direction (first direction) from exceeding the upper limit number.

In a case where one scene is arranged in the horizontal direction without providing the upper limit number, if the number of images of the scene is extremely large, image search by horizontal scrolling is not easy. Therefore, in a case where the number of images in one time zone by the division has become large, for example, in a case where the number exceeds 30, the images are displayed in different rows. Therefore, the number of images scrolled side by side in the horizontal direction does not become an excessive number, and easiness of confirming the images can be maintained.

35 200 15 FIG. The division determination unitaccording to the embodiment performs the division determination processing in a case where display of the event viewis requested by an operation (see).

In a case where the division determination processing is processing that requires a certain amount of time and has a large load, it is preferable to perform the processing only when necessary so as not to perform unnecessary processing in a situation where normal list display is required.

2 Of course, the processing may be performed in a case where images are collectively received or sequentially received from the imaging device. In particular, in a case where the processing resources are abundant or in a case where the division determination processing is performed by an algorithm with a relatively light load, it is possible to quickly cope with the display when the division reflection display is requested by the user by performing the division determination processing in advance.

200 31 In the embodiment, an example has been described in which, in a case where execution of display of the event viewis requested by an operation, the UI control unitrequests confirmation as to whether or not to execute the division determination processing.

356 353 360 15 FIG. In a case where the division determination processing is processing that requires a certain amount of time and has a large load, a user is notified of the fact and a dialog for requesting whether or not to execute is presented (see steps S, S, and Sin). As a result, the division determination processing can be performed according to the convenience of the user. In other words, in a case where the user does not want to perform time-consuming processing, it is possible not to forcibly execute the division determination processing.

35 In the embodiment, it is assumed that an operation of giving an instruction on execution of the division determination processing by the division determination unitis possible.

203 205 For example, an update buttonand an update dialogare prepared, and division determination processing that takes a relatively long time is executed when it is convenient for the user.

200 In the embodiment, title display for each sub-event is performed in the event view.

For example, the sub-event names such as “Ceremony”, “Cocktails”, “Party Time”, and the like and the mechanically attached sub-event names such as “event1”, “event2”, and the like are displayed in units of sub-events, so that the division reflection display can be easily viewed, and it is convenient for the camera staff to search for images.

200 In addition, in the event view, title display for each scene is also performed.

For example, by displaying the names as “scene1”, “scene2”, and the like in units of scenes, in particular, in a case where images are arranged in the horizontal direction in units of scenes, the division reflection display is easy to see, and it is convenient for the camera staff to search for images.

200 201 21 FIG. In the event viewof the embodiment, the time zones based on the division, for example, the index barfor the sub-events is displayed (see).

For example, by displaying the names in units of sub-events such as “Ceremony”, “Cocktails”, and the like, what kind of division is performed in the entire list is clearly presented.

201 The index baris also used as an operator for image search.

201 200 214 241 13 FIG. By specifying the title in the index barin the event view, the display jumps to the display of the images of the time zone of the sub-event (steps Sand Sin). Therefore, it is possible to extremely improve the searchability of the division reflection display.

2 1 1 4 2 4 Note that, in the embodiment, image files from the imaging deviceare transferred to the staff terminal, and the staff terminaluploads the image files to the server device. However, the imaging devicemay directly upload the image files to the server device.

Although the description has been given assuming generation of an image collection of still images in the embodiment, the image collection may include moving images as a part of content, or an image collection by a plurality of moving images may be generated. In these cases, the processing described in the embodiment can be similarly applied.

The moving images in this case may be moving images with audio or moving images with only image information without audio.

2 1 1 2 In addition, the imaging devicemay perform the processing of the staff terminaldescribed above as the information processing device of the embodiment. Alternatively, the staff terminalmay have an imaging function and also function as the imaging device.

The technology of the present disclosure is not limited to the processing related to an image group of an event related to a marriage. For example, it is also useful for selection of an image group captured in a sport event or the like.

200 200 In particular, the event viewis a list display mode that is extremely convenient for image confirmation and selection if sub-events and scenes in a sports event can be divided into categories such as the types of competition, players to play in order in an individual competition, and the like. In the case of sports, a more appropriate event viewcan be implemented by changing a division condition of sub-events or scenes for each competition.

12 18 FIGS.to The program according to the embodiment is a program for causing, for example, a CPU, a DSP, or the like, or a device including the CPU, the DSP, or the like to execute the processing in.

That is, the program according to the embodiment is a program for causing an information processing device to perform: processing of executing list display and individual display as display in which an image can be selected from an image group captured in a specific event, and processing of detecting an archive operation on the image displayed; and processing of storing archive information indicating that an archive setting has been performed in association with the image targeted for the archive operation.

12 18 45 FIGS.toand In addition, another program of the embodiment is a program for causing, for example, a CPU, a DSP, or the like, or a device including the CPU, the DSP, or the like to execute the processing illustrated in.

That is, the program according to the embodiment is a program for causing an information processing device to execute: division determination processing of determining chronological division for an image group captured in a specific event; and user interface control processing of performing control such that, for each time zone divided by the division determined in the division determination processing, division reflection display is performed in which all or some of images captured within a time zone are presented in a state of being aligned in a first direction and in which each time zone is aligned in a second direction.

1 With these programs, the staff terminalsuitable for increasing the selection speed can be implemented in, for example, a mobile terminal device, a personal computer, or other devices capable of executing information processing.

1 A program for implementing such a staff terminalcan be recorded in advance in an HDD as a recording medium built in a device such as a computer device or the like, a ROM in a microcomputer having a CPU, or the like.

Alternatively, the program can be temporarily or permanently stored (recorded) in a removable recording medium such as a flexible disk, a compact disc read only memory (CD-ROM), a magneto optical (MO) disk, a digital versatile disc (DVD), a Blu-ray disc (registered trademark), a magnetic disk, a semiconductor memory, a memory card, or the like. Such a removable recording medium can be provided as so-called package software.

Furthermore, such a program can be installed from a removable recording medium to a personal computer or the like, or can be downloaded from a download site via a network such as a local area network (LAN), the Internet, or the like.

1 1 In addition, such a program is suitable for providing the staff terminalof the embodiment in a wide range. For example, by downloading the program to a portable terminal device such as a smartphone, a tablet, or the like, an imaging device, a mobile phone, a personal computer, a still camera, a video camera, a game device, a video device, a personal digital assistant (PDA), or the like, the smartphone or the like can be caused to function as the staff terminalof the present disclosure.

Note that the effects described in the present specification are merely examples and are not limited, and other effects may be provided.

Note that the present technology can also adopt the following configurations.

(1)

a user interface control unit that performs processing of executing list display and individual display as display in which an image can be selected from an image group captured in a specific event, and processing of detecting an archive operation on the image displayed; and an event data management unit that performs processing of storing archive information indicating that an archive setting has been performed in association with the image targeted for the archive operation.(2) An information processing device including:

a filter processing unit that performs filtering on the basis of the archive information, in which the user interface control unit performs control such that images extracted by filtering are displayed in a list as the list display.(3) The information processing device according to (1), further including

in which whether or not to perform the filtering based on the archive information or a filtering condition can be selected.(4) The information processing device according to (2),

in which the user interface control unit performs control to provide a user interface capable of setting operation of selection information for creating an image collection by selectively using image data included in the image group, and the event data management unit performs processing of storing the archive information and the selection information as separate information.(5) The information processing device according to any one of (1) to (3),

in which the user interface control unit enables the archive operation on a display image at a time of the individual display.(6) The information processing device according to any one of (1) to (4),

in which the user interface control unit detects a swipe operation in a predetermined direction with respect to a display image as an archive operation with respect to the display image.(7) The information processing device according to any one of (1) to (5),

in which the user interface control unit performs control to execute display that enables cancellation of the archive operation for a predetermined time when the archive operation is detected.(8) The information processing device according to any one of (1) to (6),

an image analysis unit that performs image analysis on each image of the image group and determines eye closure of a subject person, in which the event data management unit performs processing of storing eye closure information in association with an image determined to be of eye closure.(9) The information processing device according to any one of (1) to (7), further including

in which the user interface control unit performs control to execute display indicating an image determined to be of eye closure on the basis of the eye closure information at a time of the list display or the individual display.(10) The information processing device according to (8),

a filter processing unit that performs filtering on the basis of the eye closure information, in which the user interface control unit performs control such that images extracted by the filtering are displayed in a list as the list display.(11) The information processing device according to (8) or (9), further including

in which whether or not to perform the filtering based on the eye closure information can be selected.(12) The information processing device according to (10),

in which the user interface control unit performs control to provide a user interface capable of setting operation of selection information for creating an image collection by selectively using image data included in the image group, and the event data management unit performs processing of storing the eye closure information and the selection information as separate information.(13) The information processing device according to any one of (8) to (11),

a filter processing unit that performs filtering on the basis of information of an imaging device that has captured an image, in which the user interface control unit performs control such that images extracted by the filtering are displayed in a list as the list display.(14) The information processing device according to any one of (1) to (12), further including

processing of executing list display and individual display as display in which an image can be selected from an image group captured in a specific event, and processing of detecting an archive operation on the image displayed; and processing of storing archive information indicating that an archive setting has been performed in association with the image targeted for the archive operation.(15) An information processing method in which an information processing device performs:

processing of executing list display and individual display as display in which an image can be selected from an image group captured in a specific event, and processing of detecting an archive operation on the image displayed; and processing of storing archive information indicating that an archive setting has been performed in association with the image targeted for the archive operation. A program for causing an information processing device to perform:

1 Staff terminal 2 Imaging device 3 Personal computer 4 Server device 5 Client terminal 6 Network 30 Event data management unit 31 UI control unit 32 Communication control unit 33 Filter processing unit 34 Image analysis unit 35 Division determination unit 70 Information processing device 120 Time view 200 Event View