Information Processing Method, Information Processing Device, and Non-Transitory Computer Readable Recording Medium

The present disclosure relates to a technique for changing a display mode of an image displayed on a display.

1 The technique described in Patent Literaturediscloses a display device including an image display means, a map display means, and a changing means. The image display means displays an image in an image display area of the display screen. The map display means displays a map in a map display area of the display screen. The changing unit changes the scale of the map such that the scale of the map displayed in the map display area increases as the number of captured images per unit area in the vicinity of the image capturing position of the image displayed in the image display area increases.

1 In the technique described in Patent Literature, it is not possible to clarify the location of an imaging point icon associated with image data to which annotation information is added. Therefore, in order to confirm the location of the imaging point icon associated with the image data to which annotation information is added, the processing steps of the computer increase, and the burden on the computer increases.

Patent Literature 1: JP 2009-237243 A

The present disclosure has been made based on the above problem, and an object of the present disclosure is to provide a technique for suppressing an increase in a burden on a computer by clarifying the location of an imaging point icon in which the annotation information is added.

An information processing method according to one aspect of the present disclosure is an information processing method in a computer, the method including: displaying, on a display, a bird’s-eye view on which a plurality of imaging point icons are overlaid; partitioning the bird’s-eye view into a plurality of areas, each of the plurality of imaging point icons being associated with imaging data captured at imaging points corresponding to the plurality of imaging point icons, annotation information being added to the imaging data associated with at least one first imaging point icon included in the plurality of imaging point icons; and displaying, on the display, a first area including the at least one first imaging point icon in a display mode different from a display mode of a second area that does not include the at least one first imaging point icon.

According to the present disclosure, it is possible to clarify the location of the imaging point icon in which the annotation information is added. Therefore, an increase in load on the computer can be suppressed.

(Knowledge underlying present disclosure) There has been developed a user interface that displays a plurality of imaging point icons indicating imaging points at which a construction site or the like is actually captured on a two-dimensional design drawing of a site such as a construction site, and displays an image captured at an imaging point indicated by one imaging point icon when the one imaging point icon is selected. Thus, the administrator of the construction site can know the situation of the construction site without visiting the construction site.

In the user interface described above, annotation information may be added to imaging data associated with at least one imaging point icon among a plurality of imaging point icons. Here, in a case where a plurality of imaging point icons are displayed on the design drawing, it is not easy for the user to grasp which imaging point icon has imaging data to which the annotation information is added to. In this case, the user may input, to the computer, an operation for searching for the imaging point icon in which the annotation information is added to the imaging data. This increases the processing steps of the computer, and consequently increases the burden on the computer.

1 It is difficult to solve such a problem with the technology described in Patent Literature. Patent Literature 1 merely discloses a technique for increasing the scale of a map based on the number of captured images per unit area, and does not disclose a technique for clarifying the location of an imaging point icon in which the annotation information is added to imaging data.

In order to solve the above problems, the following technique is disclosed.

1 () An information processing method according to one aspect of the present disclosure is an information processing method in a computer, the method including: displaying, on a display, a bird’s-eye view on which a plurality of imaging point icons are overlaid; partitioning the bird’s-eye view into a plurality of areas, each of the plurality of imaging point icons being associated with imaging data captured at imaging points corresponding to the plurality of imaging point icons, annotation information being added to the imaging data associated with at least one first imaging point icon included in the plurality of imaging point icons; and displaying, on the display, a first area including the at least one first imaging point icon in a display mode different from a display mode of a second area that does not include the at least one first imaging point icon.

With this configuration, the first area including the first imaging point icon can be displayed on the display in a mode different from the second area not including the first imaging point icon. That is, it is possible to make the first area including the first imaging point icon that is the imaging point icon in which the annotation information is added to the imaging data stand out. Thus, it is possible to clarify the location of the imaging point icon in which the annotation information is added to the imaging data. In this manner, it is not necessary to input an operation for searching for the imaging point icon in which the annotation information is added to the imaging data to the computer, and thus it is possible to suppress an increase in the processing steps of the computer. As a result, it is possible to suppress an increase in the load on the computer.

2 1 () The information processing method according to () may further include detecting enlargement or reduction of the bird’s-eye view, in which the displaying the first area on the display in a mode different from the second area may be performed in response to detection of enlargement or reduction of the bird’s-eye view.

With this configuration, the display mode of the first area can be made different from that of the second area by using the enlargement or reduction of the bird’s-eye view as a trigger.

3 1 2 () In the information processing method according to () or (), the displaying the first area on the display in a mode different from the second area may include changing a display mode of the first area based on a number of the first imaging point icons included in the first area.

With this configuration, the display mode of the first area changes based on the number of first imaging point icons. In this manner, for example, there is a difference in the display mode of the first area between a case where the first area includes a large number of first imaging point icons and a case where the first area includes a small number of first imaging point icons. Therefore, the user can understand the number of first imaging point icons included in the first area.

4 1 3 () In the information processing method according to any one of () to (), the displaying the first area on the display in a mode different from the second area may include displaying a total number of the first imaging point icons in the first area.

With this configuration, the user can clearly understand the total number of first imaging point icons included in the first area.

5 1 4 () In the information processing method according to any one of () to (), the annotation information may include label information indicating a status of a subject related to the imaging data, and the displaying the first area on the display in a mode different from the second area may include displaying the first area in a different mode for each type of the label information added to the imaging data of the first imaging point icon.

With this configuration, since the display mode of the first area changes according to the type of label information added to the imaging data of the first imaging point icon, it is easy for the user to understand the type of label information added to the imaging data of the first imaging point icon.

6 1 5 () In the information processing method according to any one of () to (), the annotation information may include comment information indicating a comment added to the imaging data, the information processing method may further include detecting an input of a keyword, and the displaying the first area on the display in a mode different from the second area may include: specifying, in the first area, an area with a keyword including the first imaging point icon in which comment information including the keyword is added to the imaging data; and making a display mode of the area with a keyword different from a display mode of the second area.

With this configuration, it is possible to clarify the location of the first imaging point icon in which the comment information including the keyword is added to the imaging data.

7 1 6 () In the information processing method according to any one of () to (), the displaying the first area on the display in a mode different from the second area may include making a display mode of the first imaging point icon different from a display mode of at least one second imaging point icon included in the plurality of imaging point icons, the second imaging point icon having no annotation information added to the imaging data.

With this configuration, the display modes of the first imaging point icon in which the annotation information is added to the imaging data and the second imaging point icon in which the annotation information is not added to the imaging data can be made different from each other. Thus, it is possible to clarify to which of the plurality of imaging point icons displayed on the display the annotation information is added.

8 7 () The information processing method according to () may further include: detecting enlargement or reduction of the bird’s-eye view; and determining whether or not a degree of overlap between the first imaging point icon and the second imaging point icon is equal to or greater than a reference degree of overlap in response to detection of enlargement or reduction of the bird’s-eye view, in which the displaying the first area on the display in a mode different from the second area may include making a display mode of the first imaging point icon different from a display mode of the second imaging point icon when the degree of overlap between the first imaging point icon and the second imaging point icon is equal to or greater than the reference degree of overlap.

When the degree of overlap between the first imaging point icon and the second imaging point icon is equal to or greater than the reference degree of overlap, the visibility of the first imaging point icon may decrease.

On the other hand, according to the above configuration, when the degree of overlap is equal to or greater than the reference degree of overlap, the first imaging point icon is displayed on the display in a mode different from the second imaging point icon, so that the location of the first imaging point icon can be made clearer.

9 1 8 () In the information processing method according to any one of () to (), the partitioning the bird’s-eye view into the plurality of areas may include setting a grid-like boundary line in the bird’s-eye view.

With this configuration, since the bird’s-eye view is divided into a plurality of areas by the grid-like boundary lines, the shape of each area can be set to a simple shape. Thus, the visibility of the bird’s-eye view is improved as compared with a case where the shape of each area is set to a complicated shape. As a result, the location of the first imaging point icon is further clarified.

10 1 9 () In the information processing method according to any one of () to (), the bird’s-eye view may include floor plan information indicating a shape of each of a plurality of spaces included in a building, the information processing method may further include detecting enlargement or reduction of the bird’s-eye view, and the partitioning the bird’s-eye view into the plurality of areas may include setting a boundary line of a shape along the shape of each of the plurality of spaces in the bird’s-eye view based on the floor plan information in response to detection of enlargement or reduction of the bird’s-eye view.

With this configuration, the boundary line of the shape along each shape of the plurality of spaces included in the building is set in the bird’s-eye view based on the floor plan information. Thus, a plurality of spaces included in the building and a plurality of areas on the design drawing correspond to each other. By displaying the first area in a mode different from the second area in this state, it is possible to clarify in which space in the building the first imaging point icon is disposed.

11 1 10 () In the information processing method according to any one of () to (), the bird’s-eye view may be associated with function information indicating a function of each of a plurality of spaces of a building, the information processing method may further include detecting enlargement or reduction of the bird’s-eye view, and the partitioning the bird’s-eye view into the plurality of areas may include setting a boundary line in the bird’s-eye view such that the bird’s-eye view is partitioned for each function of the plurality of spaces in response to detection of enlargement or reduction of the bird’s-eye view.

With this configuration, since the design drawing is divided into a plurality of areas for each function of a plurality of spaces included in the building, the function of the area where the first imaging point icon is disposed can be clarified.

12 1 11 () In the information processing method according to any one of () to (), the bird’s-eye view may include a first floor map corresponding to a first floor included in a building and a second floor map corresponding to a second floor different from the first floor included in the building, and the displaying the first area on the display in a mode different from the second area may include displaying a floor map including the first imaging point icon out of the first floor map and the second floor map on the display in a mode different from a floor map not including the first imaging point icon.

With this configuration, it is possible to clarify which floor of the building the first imaging point icon is disposed on.

13 1 12 () The information processing method according to any one of () to () may further include: detecting enlargement of the bird’s-eye view; determining whether or not an enlargement ratio is equal to or larger than a reference enlargement ratio when the enlargement of the bird’s-eye view is detected; specifying a position of a first range displayed on the display in the bird’s-eye view and positions and a number of the first imaging point icons included in a second range not displayed on the display in the bird’s-eye view when the enlargement ratio is equal to or larger than the reference enlargement ratio; and displaying guidance information indicating positions and the number of the first imaging point icons included in the second range on the display together with the first range.

With this configuration, when the first range of the design drawing is displayed on the display, the guidance information indicating the positions and the number of the first imaging point icons present outside the display screen of the display (the second range of the design drawing) can be presented to the user. In this manner, the user can easily grasp the positions and the number of the first icons present outside the display screen of the display.

Further, the present disclosure can be implemented not only as an information processing method for executing the characteristic processing as described above, but also as an information processing device or the like having a characteristic configuration corresponding to characteristic processing executed with the information processing method. Further, the present disclosure can also be realized as a computer program that causes a computer to execute characteristic processing included in the information processing method described above. Therefore, an effect similar to the effect in the above information processing method can also be achieved by another aspect described below.

14 () An information processing device according to another aspect of the present disclosure is an information processing device including a processor, in which the processor is configured to execute: displaying, on a display, a bird’s-eye view on which a plurality of imaging point icons are overlaid; partitioning the bird’s-eye view into a plurality of areas, each of the plurality of imaging point icons being associated with imaging data captured at imaging points corresponding to the plurality of imaging point icons, annotation information being added to the imaging data associated with at least one first imaging point icon included in the plurality of imaging point icons; and displaying, on the display, a first area including the at least one first imaging point icon in a display mode different from a display mode of a second area that does not include the at least one first imaging point icon.

15 () An information processing program according to still another aspect of the present disclosure causes a computer to execute: displaying, on a display, a bird’s-eye view on which a plurality of imaging point icons are overlaid; partitioning the bird’s-eye view into a plurality of areas, each of the plurality of imaging point icons being associated with imaging data captured at imaging points corresponding to the plurality of imaging point icons, annotation information being added to the imaging data associated with at least one first imaging point icon included in the plurality of imaging point icons; and displaying, on the display, a first area including the at least one first imaging point icon in a display mode different from a display mode of a second area that does not include the at least one first imaging point icon.

The present disclosure can be also implemented as an information processing system that is operated by such an information processing program. Further, it is needless to say that the present disclosure allows such a program to be distributed using a computer-readable non-transitory recording medium such as a CD-ROM, or via a communication network such as the Internet.

Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. Note that each embodiment to be described below illustrates a specific example of the present disclosure. Numerical values, shapes, components, steps, order of steps, and the like of the embodiments below are merely examples, and are not intended to limit the present disclosure. Further, a component not described in an independent claim representing a highest concept among components in the embodiments below is described as an optional component. In all the embodiments, respective contents can be combined.

1 FIG. 1 10 20 30 (First embodiment)is a block diagram illustrating one example of an entire configuration of an information processing systemin the present embodiment. The information processing system 1 includes a server, an information terminal, and an imaging device.

10 10 20 30 10 10 20 20 20 The serveris an example of an information processing device and a computer. The server, the information terminal, and the imaging deviceare communicably connected to each other via a network NT. An example of the network NT is the Internet. The serveris, for example, a cloud server including one or more computers. However, this is an example, and the servermay be configured as an edge server or may be implemented in the information terminalAn aspect in which the server 10 is implemented in the information terminalis an example of an aspect in which the information terminalis configured as an information processing device.

20 30 20 20 10 20 21 22 23 24 1 FIG. The information terminalis a terminal operated by a user. The user is, for example, an administrator of a predetermined space imaged by the imaging device. The predetermined space is, for example, a construction site of a building. However, this is an example, and the predetermined space may be a building site, a factory, a store, an office, or the like. The information terminalmay be configured as, for example, a portable computer such as a smartphone or a tablet computer or may be configured as a stationary computer. Although one information terminalis illustrated in the example of, a plurality of information terminals may be connected to the servervia the network NT. The information terminalincludes a communication unit, a processor, a display, and an operation unit.

2 FIG. 2 FIG. 4 5 FIGS.and 1 1 50 50 50 200 50 is a block diagram illustrating another example of the overall configuration of the information processing system. As illustrated in, the information processing systemmay include a PCconnected to a network NT. The PCis an information processing terminal installed in a place other than the site, for example, an office located away from the site. The PCcan be configured as various information processing terminals such as a stationary personal computer, a laptop personal computer, a smartphone, and a tablet computer. A design drawing() to be described later may be displayed on a display (not illustrated) provided or connected to the PC

21 20 24 10 The communication unitis a communication interface that connects the information terminalto the network NT. The communication unit 21 transmits signals indicating various instructions received from the user by the operation unitto the server.

22 23 The processorincludes, for example, a central processing unit (CPU), and causes the displayto display the design drawing of the predetermined space transmitted from the server 10. The design drawing is an example of a bird’s-eye view. The design drawing is a drawing illustrating a design of a construction site. Specifically, the design drawing is a bird’s-eye view of a building including a pillar, a wall, or a material. The bird’s-eye view may be an overhead view, and may be a view from above. The design drawing may be a plan view, a blueprint, a map, a perspective view, or the like of the construction site.

23 22 The displayis configured as various display devices such as a liquid crystal display and an organic EL display, and displays various display screens under the control of the processor.

24 20 24 The operation unitincludes, for example, a keyboard, a touch panel, a mouse, and the like. The user inputs various instructions to the information terminalby operating the operation unit.

30 30 30 30 30 30 40 40 20 30 The imaging deviceis configured as, for example, an omnidirectional camera, and captures imaging data (image) at a predetermined frame rate. The omnidirectional camera is also referred to as a 360 degree camera, and is a camera capable of acquiring an omnidirectional imaging data of 360 degrees. The imaging deviceis, for example, a portable imaging device carried by an operator. The operator is, for example, a worker or a site supervisor at a construction site. Note that the imaging devicemay be configured as a normal camera. The imaging deviceincludes an image sensor, an operation device, a communication circuit, a signal processing circuit, and the like. The imaging devicemay be configured as a portable computer such as a smartphone or a tablet computer. The imaging deviceincludes a communication unit. The communication unitcommunicably connects the information terminaland the imaging deviceto each other via a close proximity wireless communication path such as Bluetooth (registered trademark) or a wireless LAN.

10 20 20 20 30 20 30 23 30 20 20 30 20 30 20 20 20 10 20 The operator downloads a design drawing of the site from the serverto the information terminal, causes the information terminalto display the design drawing, and connects the information terminaland the imaging deviceusing a wireless LAN or the like. Thus, an imaging start button is displayed on the information terminal, and therefore the operator presses the imaging start button in a state where the imaging deviceis directed in a predetermined direction, and starts imaging. The predetermined direction is a direction for matching the direction with the design drawing displayed on the display. The predetermined direction is, for example, the north direction, but is not limited thereto. The operator moves on site while performing imaging by the imaging device. Thus, a plurality of pieces of imaging data (image data) are generated. Upon reaching an imaging end point, the operator presses an imaging end button displayed on the information terminal. At this time, the operator touches the design drawing displayed on the information terminal, and instructs the imaging end point on the design drawing. Note that, when the imaging by the imaging deviceis started, the operator may designate an imaging start point by touching the design drawing displayed on the information terminal. When the operator instructs the imaging end point, transfer of the plurality of pieces of imaging data from the imaging deviceto the information terminalis started. The plurality of transferred imaging data are temporarily accumulated in the information terminal. The plurality of pieces of imaging data accumulated in the information terminalare uploaded to the serverwhen the operator operates the information terminal.

20 10 10 111 10 Upon acquiring the plurality of pieces of imaging data from the information terminal, the serveranalyzes position information on the design drawing of each piece of imaging data by using a visual simultaneous localization and mapping (SLAM) technology based on the imaging start point, the imaging end point, and the plurality of pieces of imaging data, and adds (links) the position information on the design drawing to each piece of imaging data. In the design drawing, two-dimensional coordinate axes are defined. Therefore, the position information on the design drawing of each piece of imaging data is defined by two-dimensional coordinate values. The serveroverlays an imaging point icon indicating an imaging point of each piece of imaging data on the design drawing based on the position information on the design drawing of each piece of imaging data. Thus, a design drawing in which a plurality of imaging point icons are overlaid is generated. The series of processing is executed by, for example, an acquisition unitdescribed later of the server.

20 10 A worker at the site causes the information terminalto display the design drawing generated by the serverat an appropriate timing. That is, the information terminal 20 is caused to display the design drawing on which the plurality of imaging point icons are overlaid. Then, by designating (for example, touching) a specific imaging point icon among the plurality of imaging point icons, the imaging data can be called and displayed. In addition, annotation information can be added to the imaging data.

The annotation information is a kind of meta information added to the imaging data. The annotation information according to the present embodiment includes comment information and label information. One or both of the comment information and the label information is added to the imaging data.

122 12 The comment information is a text (character string) added to predetermined imaging data by a worker who performs predetermined work on site. For example, the worker attaches a text “Starting work on April 1. Worker X, Company A” to the predetermined imaging data. This text is the comment information. The comment information added to the imaging data by the worker is stored in an image information storageof a memoryin a state of being associated with the imaging data. Not only the worker but also a person such as a site supervisor of a construction site may add the comment information to the imaging data.

The label information indicates a status of a construction site (an example of a subject) related to the imaging data. The label information according to the present embodiment includes three types of class labels of “not started”, “in progress”, and “resolved”. The worker adds an appropriate class label to the imaging data according to the status of the construction site included in the imaging data.

Specifically, the worker adds a class label according to a degree of progress of a predetermined work performed at the construction site reflected in the imaging data. For example, the worker adds a class label of “not started” to the imaging data in which the construction site where the worker has not started working is captured. Further, the worker adds a class label of “in progress” to the imaging data in which the construction site where the work is in progress is captured. Further, the worker adds a class label of “resolved” to the imaging data in which the construction site where the work is completed is captured. The class label may be added by a site supervisor or the like.

The above class labels are merely examples, and the worker may add a wide variety of class labels according to the status of the subject. That is, the class label added to the imaging data by the worker is not limited to “not started”, “in progress”, or “resolved”.

30 20 30 20 Various pieces of meta information are added to the imaging data captured by the imaging devicein addition to the annotation information. For example, meta information such as imaging date and time information and a design drawing ID is added to each piece of imaging data. The imaging date and time information indicates a year, month, day, time, and the like when imaging has been performed. The design drawing ID is identification information used when specifying a design drawing corresponding to a construction site where imaging has been performed. The information terminalor the imaging devicegenerates the meta information such as the imaging date and time information and the design drawing ID, and gives the meta information to each piece of imaging data. Note that, in a case where the imaging device 30 or the information terminalincludes a position sensor such as a GPS sensor, information indicating the latitude and longitude of the imaging point may be added to each piece of imaging data.

10 11 12 13 The serverincludes a processor, the memory, and a communication unit.

11 11 111 113 111 113 11 The processorincludes, for example, a central processing unit (CPU), a graphics processing unit (GPU), or the like. The processorincludes an acquisition unitand a display control unit. The acquisition unitand the display control unitmay be implemented by the processorexecuting the information processing program, or may be constituted by a dedicated hardware circuit such as an ASIC.

111 30 The acquisition unitacquires the imaging data transmitted from the imaging deviceand the meta information added to the imaging data. Further, the acquisition unit 111 executes VSLAM processing described above to generate a design drawing on which a plurality of imaging point icons are overlaid.

111 20 20 50 13 20 50 23 20 50 23 23 20 The acquisition unitacquires a display instruction from the information terminalby communicating with the information terminalor the PCusing the communication unit. The display instruction is an instruction input by the user to the information terminalor the PC. The display instruction is an instruction for requesting display of a design drawing on which a plurality of imaging point icons are overlaid on the displayof the information terminalor the display of the PC. The display instruction includes a design drawing ID that is an identifier of a design drawing that the user requests to display on the display. Hereinafter, it is assumed that an instruction for requesting display of a design drawing on which a plurality of imaging point icons are overlaid on the displayof the information terminalis input as a display instruction.

113 20 20 113 23 20 20 20 23 The display control unitgenerates various instructions for controlling the information terminaland transmits the instructions to the information terminal. The information terminal 20 that has received the instruction generated by the display control unitdisplays, on the display, a design drawing on which a plurality of imaging point icons are overlaid. Further, the information terminalthat has received the instruction partitions the design drawing into a plurality of areas. For example, the information terminalsets at least one boundary line for partitioning the design drawing into a plurality of areas on the design drawing. Further, the information terminalthat has received the instruction displays, on the display, a first area including a first imaging point icon to be described later among the plurality of areas in a mode different from a second area not including the first imaging point icon among the plurality of areas.

12 121 122 The memoryis constituted by a nonvolatile rewritable storage device such as a hard disk drive or a solid state drive. The memory 12 includes a design drawing information storageand an image information storage.

121 121 121 The design drawing information storagestores at least one of the design drawings. Further, the design drawing information storagestores a design drawing ID added to each of the at least one design drawing and the position information of each of the at least one design drawings. The position information of the design drawing is information indicating a geographical position of a predetermined space corresponding to the design drawing. For example, when the design drawing corresponds to a building site, information indicating the latitude and longitude of the building site is stored in the design drawing information storage. Specifically, latitudes and longitudes corresponding to key points (for example, four corners of the design drawing) of the design drawing are stored.

122 20 10 The image information storagestores a plurality of pieces of imaging data transmitted from the information terminalto the serverand meta information added to each of the plurality of pieces of imaging data.

122 The meta information stored in the image information storagemay include information such as an imaging ID, an imaging period ID, an imaging direction, and position information of an imaging point icon.

30 The imaging ID is an identifier added to each piece of imaging data. The imaging period ID is an identifier of the imaging period. The imaging period refers to a period from the start to the end of the imaging operation. The imaging direction indicates a direction in which the imaging deviceis directed when each piece of imaging data is captured. The position information of the imaging point icon indicates a display position of the imaging point icon on the design drawing. The position information of the imaging point icon is represented by, for example, coordinate values in a two-dimensional coordinate system defined in the design drawing.

13 10 The communication unitis a communication interface that connects the serverto the network.

3 FIG. 1 is a flowchart illustrating an example of a flow of processing performed in the information processing system.

1 20 23 1 24 20 10 111 121 12 111 122 12 111 12 113 113 111 111 23 In step S, the information terminaldisplays the design drawing on the display. Specifically, in step S, the user operates the operation unitto input a display instruction to the information terminal. The information terminal 20 that has received the display instruction transmits the display instruction to the server. The acquisition unitof the server 10 that has received the display instruction reads the design drawing indicated by the design drawing ID included in the display instruction from the design drawing information storageof the memory. At this time, using the design drawing ID as a key, the acquisition unitreads, from the image information storageof the memory, various types of information such as imaging data having an imaging ID associated with the design drawing ID, position information indicating a display position on the design drawing of an imaging point icon indicating an imaging point of the imaging data, and annotation information added to the imaging data. The acquisition unitinputs the information read from the memoryto the display control unit. The display control unitgenerates an instruction based on the information acquired from the acquisition unit. Specifically, an instruction to display the design drawing read by the acquisition uniton the displayand to overlay boundary lines for dividing the design drawing into a plurality of areas on the design drawing is generated and transmitted.

4 FIG. 4 FIG. 4 FIG. 4 FIG. 400 23 20 113 400 200 501 515 501 515 is a view illustrating an example of a display screendisplayed on the displayby the information terminalaccording to the instruction received from the display control unit. As illustrated in, the display screenincludes a design drawingon which a plurality of imaging point icons are overlaid. In the example illustrated in, the plurality of imaging point icons includes imaging point iconsto. Note that, for convenience of description, in, the imaging point icons other than the imaging point iconstoare not denoted by reference numerals. Here, each of the plurality of imaging point icons is configured as a circular image. Each of the plurality of imaging point icons is associated with at least one imaging data captured at the imaging point indicated by each of the plurality of imaging point icons. Hereinafter, it is assumed that one imaging data is associated with one imaging point icon unless otherwise specified.

The annotation information is added to the imaging data of at least one imaging point icon among the plurality of imaging point icons. Hereinafter, the imaging point icon in which the annotation information is added to the imaging data is referred to as a first imaging point icon. Further, in the following description, among the plurality of imaging point icons, the imaging point icon to which the annotation information is not added to the imaging data is referred to as a second imaging point icon. That is, the plurality of imaging point icons include at least one first imaging point icon in which the annotation information is added to the imaging data and at least one second imaging point icon in which the annotation information is not added to the imaging data.

4 FIG. 4 FIG. 400 400 Further, as illustrated in, the display screenincludes grid-like boundary lines L (grid lines). That is, boundary lines L including a plurality of vertical lines and a plurality of horizontal lines orthogonal to each other are drawn on the display screen. The design drawing 200 is divided into a plurality of areas by the boundary lines L. In the example illustrated in, the plurality of areas are formed in a square shape. However, this is merely an example, and the plurality of areas may be formed in a rectangular shape.

2 113 113 20 113 20 23 113 2 3 20 113 2 4 In step S, the display control unitdetermines whether or not enlargement or reduction of the design drawing has been detected. Specifically, the display control unitcommunicates with the information terminal. Then, the display control unitdetermines whether or not the information terminalhas received, from the user, an operation (hereinafter referred to as an enlargement/reduction operation) for requesting display of the enlarged or reduced design drawing on the display. When the information terminal 20 has received the enlargement/reduction operation, the display control unitdetermines that the enlargement or reduction has been detected (YES in step S). In this case, the processing proceeds to step S. On the other hand, when the information terminalhas not received the enlargement/reduction operation, the display control unitdetermines that the enlargement or reduction has not been detected (NO in step S). In this case, the processing proceeds to step S.

3 20 2 20 200 200 200 400 200 200 4 FIG. In step S, the information terminalredraws the boundary lines L according to an enlargement ratio of the design drawing. For example, in step S, it is assumed that the information terminalhas received an operation of reducing the design drawing(an operation of reducing the enlargement ratio of the design drawing). Further, it is assumed that, with the enlargement ratio of the design drawingillustrated inbeing 100%, the enlargement/reduction operation includes an operation for requesting setting of the enlargement ratio of the design drawingto 80%. In this case, the information terminal 20 displays, on the display screen, the design drawinghaving the enlargement ratio set to 80%. Further, at this time, the information terminal 20 redraws the boundary lines L according to the enlargement ratio (enlargement ratio 80%) designated by the user. Specifically, the arrangement interval of the plurality of vertical lines and the arrangement interval of the plurality of horizontal lines included in the boundary lines L, the number of vertical lines or horizontal lines, and the like are adjusted in response to the reduction of the design drawing.

5 FIG. 5 FIG. 4 FIG. 401 23 20 200 200 200 3 1 16 is a view illustrating an example of the display screendisplayed on the displayby the information terminalthat has received the operation of reducing and displaying the design drawing. The display screen 401 illustrated inincludes a reduced design drawingas compared to the design drawingillustrated in. Further, the display screen 401 includes the boundary lines L redrawn in the processing of step S. The design drawing 200 is partitioned into a plurality of areas from an area Ato an area Aby the boundary lines L.

23 200 23 501 502 401 501 502 5 FIG. Meanwhile, some (for example, two) imaging point icons among the plurality of imaging point icons may be displayed on the displayin a state of overlapping each other. For example, in a case where the design drawingis reduced while maintaining the display size of each of the plurality of imaging point icons on the display screen, the imaging point icons are densely arranged, whereby the two imaging point icons may be displayed on the displayin a state of overlapping each other. Specifically, in, the imaging point iconand the imaging point iconare displayed on the display screenin a state of overlapping each other. It is assumed that the imaging point iconis a first imaging point icon, and the imaging point iconis a second imaging point icon. Here, when the degree of overlap between the first imaging point icon and the second imaging point icon is equal to or greater than the reference degree of overlap, the first imaging point icon is hidden by the second imaging point icon, and the visibility of the first imaging point icon is reduced. The degree of overlap indicates a ratio of the area of the second imaging point icon to the area of the first imaging point icon.

4 113 4 113 20 5 Therefore, in step S, the display control unitaccording to the present embodiment determines whether or not the degree of overlap between the first imaging point icon and the second imaging point icon is equal to or greater than a reference degree of overlap. Then, when the degree of overlap is equal to or greater than the reference degree of overlap (YES in step S), the display control unittransmits, to the information terminal, an instruction to make the display mode of the first imaging point icon different from the display mode of the second imaging point icon in step S.

4 113 23 113 113 4 5 4 6 Specifically, in step S, the display control unitspecifies the first imaging point icon from among the plurality of imaging point icons displayed on the display. Subsequently, the display control unitspecifies the second imaging point icon overlaid on the first imaging point icon. Then, the display control unitdetermines whether or not the degree of overlap between the first imaging point icon and the second imaging point icon is equal to or greater than the reference degree of overlap. The reference degree of overlap is not particularly limited, but is, for example, 50%. When the degree of overlap between the first imaging point icon and the second imaging point icon is equal to or greater than the reference degree of overlap (YES in step S), the processing proceeds to step S. On the other hand, when the degree of overlap between the first imaging point icon and the second imaging point icon is less than the reference degree of overlap (NO in step S), the processing proceeds to step S.

4 113 4 When there is no second imaging point icon overlaid on the first imaging point icon in step S, the display control unitdetermines NO in step S.

4 113 4 In addition, in step S, the display control unitmay determine whether or not a plurality of second imaging point icons are overlaid on one first imaging point icon. Then, in a case where the plurality of second imaging point icons are overlaid on one first imaging point icon, it may be determined whether or not the ratio of the total area of the plurality of second imaging point icons to the area of the first imaging point icon is equal to or greater than the reference degree of overlap. Then, when the ratio of the total area of the plurality of second imaging point icons to the area of the first imaging point icon is equal to or greater than the reference degree of overlap, YES may be determined in step S.

5 113 20 502 501 502 501 113 502 20 5 FIG. In step S, the display control unittransmits, to the information terminal, an instruction to make the display mode of the first imaging point icon different from the display mode of the second imaging point icon. The instruction to make the display mode of the first imaging point icon different from the display mode of the second imaging point icon is, for example, an instruction to hide the second imaging point icon. It is assumed that the imaging point iconillustrated inis the second imaging point icon, the imaging point iconis the first imaging point icon, and the imaging point iconoverlaps the imaging point iconby the reference degree of overlap or more. In this case, the display control unittransmits an instruction to hide the imaging point iconto the information terminal.

5 113 20 401 200 501 502 20 401 502 5 FIG. In addition, in step S, the display control unitmay transmit, to the information terminal, an instruction to arrange the first imaging point icon on the forefront in order to make the display mode of the first imaging point icon different from the display mode of the second imaging point icon. For example, it is assumed that the display screenillustrated inincludes a first layer on which the design drawingis drawn, a second layer on which the imaging point icon(first imaging point icon) is drawn, and a third layer on which the imaging point icon(second imaging point icon) is drawn. In this case, the display control unit 113 transmits an instruction to arrange the second layer on the forefront to the information terminal. In this manner, the imaging point icon 501 is preferentially displayed on the display screenover the imaging point icon.

5 113 In addition, in step S, the display control unitmay transmit, to the information terminal 20, an instruction to make the radius of the first imaging point icon larger than the radius of the second imaging point icon. In addition, the display control unit 113 may transmit, to the information terminal 20, an instruction to change the image constituting the first imaging point icon to a quadrangular image. In addition, the display control unit 113 may transmit, to the information terminal 20, an instruction to add a border line to the peripheral edge portion of the circular image constituting the first imaging point icon.

5 113 20, 113 20 113 In addition, in step S, the display control unitmay transmit, to the information terminalan instruction to make the radius of the second imaging point icon overlaid on the first imaging point icon smaller than the radius of the first imaging point icon. In addition, the display control unitmay transmit, to the information terminal, an instruction to change the transmittance of the second imaging point icon overlaid on the first imaging point icon to make the second imaging point icon transparent. In this manner, the display control unitimproves the visibility of the first imaging point icon.

6 113 In step S, the display control unitselects one imaging point icon from the plurality of imaging point icons.

7 113 6 113 501 113 6 501 501 10 113 501 10 5 FIG. 5 FIG. In step S, the display control unitspecifies an area to which the imaging point icon selected in step Sbelongs. The display control unitdetermines an area to which the imaging point icon belongs based on the position (coordinates) of the center point of the imaging point icon. For example, it is assumed that the imaging point iconillustrated inis selected by the display control unitin step S. As illustrated in, a center pointP of the imaging point iconis present inside the area A. In this case, the display control unitspecifies that the imaging point iconbelongs to the area A.

8 113 6 In step S, the display control unitchecks whether or not annotation information is added to the imaging data of the imaging point icon selected in step S. That is, it is confirmed whether or not an arbitrary imaging point icon is the first imaging point icon.

9 113 7 8 200 7 8 9 10 7 8 9 6 113 6 9 113 9 6 113 7 8 In step S, the display control unitdetermines whether or not the processing of steps Sand Shas been executed for all the imaging point icons overlaid and displayed on the design drawing. When the processing related to steps Sand Shas been executed for all the imaging point icons (YES in step S), the processing proceeds to step S. When the processing of step Sand step Shas not been executed for all the imaging point icons (NO in step S), the processing returns to step S. That is, the display control unitrepeats the processing of steps Sto Suntil the area to which all the imaging point icons belong is specified and the processing of determining whether or not all the imaging point icons are the first imaging point icons is executed. Note that, in a case where the display control unitdetermines NO in step Sand the processing returns to step S, the display control unitnewly selects an imaging point icon on which the processing in steps Sand Sis not executed from among the plurality of imaging point icons.

9 113 9 7 8 200 Note that, in step S, the display control unitmay determine YES in step Sin a case where the processing of steps Sand Shas been executed for all the imaging point icons included in the area currently displayed on the display in the design drawing.

10 113 In step S, the display control unitdiscriminates the content of the annotation information added to the imaging data of the first imaging point icon for each area.

11 113 In step S, the display control unitgrasps the number of first imaging point icons for each area.

12 113 10 10 14 14 14 5 FIG. In step S, the display control unitspecifies the first area and the second area. The first area is an area including at least one first imaging point icon. The second area is an area not including the first imaging point icon. For example, the area Aillustrated inincludes one first imaging point icon. In this case, the area Acorresponds to the first area. On the other hand, for example, it is assumed that the area Adoes not include the first imaging point icon. That is, it is assumed that there is no imaging point icon (first imaging point icon) in which the annotation information is added to the imaging data in the area A. In this case, the area Acorresponds to the second area.

13 113 23 20 113 23 113 13 In step S, the display control unitgenerates an instruction for displaying the first area on the displayin a mode different from the second area and transmits the instruction to the information terminal. The display control unitgenerates the above instruction based on at least one of the contents of the comment indicated by the comment information, the type of the label information, and the number of first imaging point icons. The information terminal 20 that has acquired this instruction displays the first area on the displayin a mode different from the second area. Hereinafter, details of the processing executed by the display control unitin step Swill be described with an example.

113 (First example) The display control unitaccording to a first example generates an instruction to change the display mode of the first area based on the number of first imaging point icons included in the first area.

113 113 7 10 14 7 1 10 2 14 3 113 20 1 2 3 5 FIG. Specifically, the display control unitaccording to the first example changes the display size of the first area according to the number of first imaging point icons included in the first area. That is, the display control unitchanges the display size of the first area such that the display size of the first area increases as the first area includes more first imaging point icons. For example, it is assumed that the area Aillustrated inincludes four first imaging point icons, the area Aincludes one first imaging point icon, and the area Adoes not include any first imaging point icon. In this case, when the display size of the area Ais X, the display size of the area Ais X, and the display size of the area Ais X, the display control unitinstructs the information terminalto change the display size of the first area so that a relationship of “X> X> X” is established. The display size of the first area refers to the area of one first area on the display screen.

113 113 In addition, the display control unitaccording to the first example may change the color of the first area according to the number of first imaging point icons included in the first area. For example, the display control unitmay instruct the information terminal 20 to display the first area including one or two first imaging point icons in green, display the first area including three or four first imaging point icons in yellow, and display the first area including five or more first imaging point icons in red.

As described above, by changing the display mode of the first area according to the number of first imaging point icons, the user can intuitively understand the number of first imaging point icons included in the first area.

113 (Second example) The display control unitaccording to a second example generates an instruction for requesting display of the total number of first imaging point icons in the first area.

6 6 20 4 6 5 FIG. For example, it is assumed that the area Aillustrated inis the first area, and that the area Aincludes a total of four first imaging point icons. In this case, the display control unit 113 instructs the information terminalto display the character “” in the area A.

401 In this manner, by displaying the total number of first imaging point icons on the display screen, the user can intuitively understand the total number of first imaging point icons for each first area.

6 FIG. 6 FIG. 4 FIG. 113 402 23 20 (Third example)is a view for describing processing of the display control unitaccording to the third example.is a view illustrating a display screendisplayed on the displaywhen the information terminalreceives an operation for designating enlargement of the area VI illustrated in.

402 200 1 16 3 503 5 504 8 505 9 506 15 507 16 508 503 504 505 504 505 3 5 8 On the display screen, the design drawingis partitioned into a plurality of areas from an area Bto an area Bby the boundary lines L. The area Bincludes an imaging point icon, the area Bincludes an imaging point icon, the area Bincludes an imaging point icon, the area Bincludes an imaging point icon, the area Bincludes an imaging point icon, and the area Bincludes an imaging point icon. The label information of “not started” is added to the imaging data of the imaging point icon, the label information of “in progress” is added to the imaging data of the imaging point icon, and the label information of “resolved” is added to the imaging data of the imaging point icon. That is, the imaging point icon 503, the imaging point icon, and the imaging point iconare the first imaging point icons in which the annotation information is added to the imaging data. Therefore, the area B, the area B, and the area Bare the first areas.

113 20 113 20 23 The display control unitaccording to the third example instructs the information terminalto display the first area in different modes for each type of label information associated with the first imaging point icon. For example, the display control unitinstructs the information terminalto display, on the display, a first area including a first imaging point icon to which the label information of “not started” is added in red, a first area including a first imaging point icon to which the label information of “in progress” is added in yellow, and a first area including a first imaging point icon to which the label information of “resolved” is added in green.

6 FIG. 3 503 503 113 3 5 504 504 113 5 8 505 505 113 8 Referring to, as described above, the area Bincludes the imaging point icon. Then, the label information of “not started” is added to the imaging data of the imaging point icon. In this case, the display control unitdisplays the area Bin red. Further, the area Bincludes the imaging point icon. Then, the label information of “in progress” is added to the imaging data of the imaging point icon. In this case, the display control unitdisplays the area Bin yellow. Further, the area Bincludes the imaging point icon. Then, the label information of “resolved” is added to the imaging data of the imaging point icon. In this case, the display control unitdisplays the area Bin green.

113 As described above, the display control unitaccording to the third example changes the color of the first area to which the first imaging point icon belongs according to the type of label information added to the imaging data of the first imaging point icon. This allows the user to understand the type of label information added to the first imaging point icon. Moreover, the user can immediately understand the status of each area.

113 20 (Fourth example) When one first area includes a plurality of first imaging point icons and label information of different types is added to the plurality of first imaging point icons, the display control unitaccording to the fourth example instructs the information terminalto display a plurality of colors in the first area.

505 7 509 510 7 511 7 5 FIG. For example, it is assumed that the label information of “not started” is added to the imaging point iconin the area Aillustrated in, the label information of “in progress” is added to the imaging point iconand the imaging point iconin the area A, and the label information of “resolved” is added to the imaging point iconin the area A.

113 7 20 20 20 In this case, the display control unitfirst partitions the area Ainto three portions of a left portion LE, a center portion CE, and a right portion RI. Then, the display control unit 113 instructs the information terminalto display the left portion LE in a color corresponding to the type of “not started”, for example, red. Further, the display control unit 113 instructs the information terminalto display the center portion CE in a color corresponding to the type of “in progress”, for example, yellow. Further, the display control unit 113 instructs the information terminalto display the right portion RI in a color corresponding to the type of “resolved”, for example, green.

In this manner, it is possible to allow the user to intuitively understand that a plurality of first imaging point icons is included in one first area and that label information of different types is added to imaging data of the plurality of first imaging point icons.

113 7 7 Further, the display control unitaccording to the fourth example partitions the area Ainto three portions of the left portion LE, the center portion CE, and the right portion RI, and displays the left portion LE in red. As described above, when the left portion LE where the line of sight of a person is likely to gather is displayed in red, which is a noticeable color, the user can be guided to pay attention to the area A.

113 7 505 509 510 511 113 20 1 7 2 1 7 The display control unitaccording to the fourth example may display the total number of first imaging point icons in the first area for each type of label information. For example, in the area A, there is one first imaging point icon (imaging point icon) to which the label information of “not started” is added, there are two first imaging point icons (imaging point iconand imaging point icon) to which the label information of “in progress” is added, and there is one first imaging point icon (imaging point icon) to which the label information of “resolved” is added. In this case, the display control unittransmits, to the information terminal, an instruction to display the character “” in the left portion LE of the area Adisplayed in red, the character “” in the center portion CE displayed in yellow, and the character “” in the right portion RI displayed in green. In this manner, it is possible to allow the user to intuitively understand that, in the area A, there is one first imaging point icon to which the label information of “not started” is added, there are two first imaging point icons to which the label information of “in progress” is added, and there is one first imaging point icon to which the label information of “resolved” is added.

113 600 7 600 600 7 600 601 602 603 601 602 603 601 602 602 603 601 603 601 7 602 7 7 7 FIG. 7 FIG. In addition, the display control unitaccording to the fourth example may instruct the information terminal 20 to display a status icon() in the area A.is a view illustrating an example of the status icon. The status iconis constituted by a plurality of circles each having a different radius, each having a different color, and each center point being disposed on the same coordinate on the design drawing. As described above, in the area A, there is one first imaging point icon to which the label information of “not started” is added, there are two first imaging point icons to which the label information of “in progress” is added, and there is one first imaging point icon to which the label information of “resolved” is added. In this case, the status iconincludes a first circle, a second circle, and a third circle. The first circleis a circular image displayed in a color corresponding to the label information of “not started”, for example, red. The second circleis a circular image displayed in a color corresponding to the label information of “in progress”, for example, yellow. The third circleis a circular image displayed in a color corresponding to the label information of “resolved”, for example, green. The radius of the first circleis larger than the radius of the second circle, and the radius of the second circleis larger than the radius of the third circle. The centers of the first circleto the third circleare disposed at the same position (coordinates). In the first circle, the total number of first imaging point icons to which the label information of “not started” is added in the area Ais displayed. That is, “1” is displayed. In the second circle, the total number of first imaging point icons to which the label information of “in progress” is added in the area Ais displayed. That is, “2” is displayed. In the third circle 603, the total number of first imaging point icons to which the label information of “in progress” is added in the area Ais displayed. That is, “1” is displayed.

600 7 7 When the status iconis displayed in the area A, the user can intuitively understand that there is one first imaging point icon to which the label information of “not started” is added, there are two first imaging point icons to which the label information of “in progress” is added, and there is one first imaging point icon to which the label information of “resolved” is added in the area A.

113 113 (Fifth example) The display control unitaccording to the fifth example detects input of a keyword. Then, the display control unitspecifies an area with a keyword including the first imaging point icon in which the comment information including the keyword is added to the imaging data in the first area and makes the display mode of the area with the keyword different from the display mode of the second area.

113 20 and 23 20 24 111 13 111 113 512 14 113 14 5 FIG. Specifically, the display control unitaccording to the fifth example transmits a predetermined instruction to the information terminalcauses the displayof the information terminalto display a keyword input field (not illustrated). Then, the user inputs a keyword into the keyword input field through the operation unit. The keyword input by the user is acquired by the acquisition unitvia the communication unit. Upon detecting that the acquisition unithas acquired the keyword, the display control unitspecifies an area with a keyword. The area with a keyword refers to the first area including the first imaging point icon in which the comment information including the keyword is added to the imaging data. For example, it is assumed that, in the imaging data of the imaging point iconincluded in the area Aillustrated in, comment information indicating a comment such as "Wood is insufficient on May 1. Worker X, Company A" is added. Here, it is assumed that the user inputs the keyword “A company” in the keyword input field. In this case, the display control unitspecifies the area Aas the area with a keyword.

113 20 113 14 1 14 2 113 1 2 113 512 14 113 14 The display control unitthat has specified the area with a keyword instructs the information terminalto make the display mode of the area with a keyword different from the display mode of the second area. Specifically, the display control unitmakes the display size of the area with a keyword relatively larger than the display size of the second area. For example, when the display size of the area A, which is the area with a keyword, is Yand the display size of the area A, which is the second area, is Y, the display control unitchanges the display size of the area with a keyword such that “Y> Y” holds. In addition, the display control unitmay blink the area with a keyword. For example, it is assumed that not only the comment information but also the label information of “resolved” is added to the imaging data of the imaging point iconin the area A. In this case, the display control unitblinks the area Ain green.

As described above, when the area with a keyword is displayed in a display mode different from that of the second area, the user can easily grasp the location of the first imaging point icon to which the comment information including a keyword input by the user is added.

113 In addition, the display control unitaccording to the fifth example may change the display mode of the area with a keyword according to the number of first imaging point icons (hereinafter, referred to as an icon with a keyword) to which the comment information including the keyword is added. For example, as the area with a keyword includes more icons with a keyword, the area with a keyword may be displayed larger.

113 113 (Sixth example) The display control unitaccording to the sixth example displays an imaging point icon matching the period input by the user on the design drawing. Then, when the imaging point icon that matches the period input by the user is the first imaging point icon, the display control unitdisplays the first area including the first imaging point icon in a mode different from the second area.

113 23 The display control unitaccording to the sixth example first causes the displayto display a period input field (not illustrated). The period input field is an input field for receiving designation of a period from the user.

2024 23 Here, it is assumed that the user inputs information designating a period of “April 1,to April 30, 2024” in the period input field. In this case, the display control unit 113 causes the displayto display the imaging point icon associated with the imaging data captured between April 1, 2024 and April 30, 2024.

11 113 11 2024, 513 11 2024, 514 11 2024, 515 11 113 513 11 514 515 11 5 FIG. The area Aillustrated inwill be described as an example. Upon detecting that the user inputs the information designating the period, the display control unitconfirms the imaging date and time added to the imaging data of the imaging point icon included in the area A. For example, it is assumed that information indicating that the image is captured on April 1,is added to the imaging data of the imaging point iconincluded in the area A. Further, it is assumed that information indicating that the image is captured on May 1,is added to the imaging data of the imaging point iconin the area A. It is assumed that information indicating that the image is captured on June 1,is added to the imaging data of the imaging point iconin the area A. In this case, the display control unitdisplays only the imaging point iconin the area A. On the other hand, the imaging point iconsandare not displayed in the area A.

513 113 11 113 11 513 113 11 Here, when the imaging point iconis the first imaging point icon, the display control unithandles the area Aas the first area. Then, the display control unitmakes the display mode of the area A(first area) different from that of the second area. For example, in a case where the label information of “not started” is added to the imaging data of the imaging point icon, the display control unitdisplays the area Ain red.

2024 514 11 514 11 Further, it is assumed that the user inputs information designating a period of “May 1,to May 31, 2024” in the period input field. In this case, the display control unit 113 displays the imaging point iconassociated with the imaging data captured on May 1 in the area A. Here, it is assumed that the label information of “in progress” is added to the imaging data of the imaging point icon. In this case, the display control unit 113 displays the area Ain yellow, for example.

2024 515 11 515 11 Further, it is assumed that the user inputs information designating a period of “June 1,to June 30, 2024” in the period input field. In this case, the display control unit 113 displays the imaging point iconassociated with the imaging data captured on June 1 in the area A. Here, it is assumed that the label information of “resolved” is added to the imaging data of the imaging point icon. In this case, the display control unit 113 displays the area Ain green, for example.

11 In this manner, the user can intuitively understand the progress status of work at the construction site. In the above example, in the area A, the user can intuitively understand that the worker has started work in April 2024, the work is in progress as of May 2024, and the work has been completed in June 2024.

2024 113 11 113 11 Note that, it is assumed that, when the user inputs information designating a period of “July 1,to July 31, 2024” in the period input field, the display control unitdoes not display the imaging point icon in the area A. In this case, the display control unithandles the area Aas the second area.

516 8 516 516 516 Further, a plurality of pieces of imaging data captured at different imaging dates and times may be associated with one imaging point icon. For example, first imaging data, second imaging data, and third imaging data are associated with the imaging point iconillustrated in the area A. The first imaging data is data captured at the imaging point indicated by the imaging point iconon April 1. The second imaging data is data captured at the imaging point indicated by the imaging point iconon May 1. The third imaging data is data captured on June 1 at the imaging point indicated by the imaging point icon. The label information indicating a status of “not started” is added to the first imaging data, the label information indicating a status of “in progress” is added to the second imaging data, and the label information indicating a status of “resolved” is added to the third imaging data.

2024, 113 8 516 516 2024, 113 8 2024, 113 8 Here, it is assumed that the user inputs information designating a period of “April 1,to April 30, 2024” in the period input field. In this case, the display control unitdisplays the area A, which is an area including the imaging point icon, in green based on the first imaging data among the imaging data associated with the imaging point icon. Note that, it is assumed that, when the user inputs information designating a period of “May 1,to May 31, 2024” in the period input field, the display control unitdisplays the area Ain yellow. Further, when the user inputs information designating a period of “June 1,to June 30, 2024”, the display control unitdisplays the area Ain red.

113 20 20 20 (Seventh example) The display control unitaccording to the seventh example instructs the information terminalto make the display mode of the first imaging point icon different from the display mode of the second imaging point icon. For example, the display control unit 113 instructs the information terminalto make the color of the first imaging point icon different from the color of the second imaging point icon. Alternatively, the display control unit 113 instructs the information terminalto configure the first imaging point icon with a quadrangular image and configure the second imaging point icon with a circular image. In addition, the display control unit 113 may make the first imaging point icon different from the second imaging point icon by an appropriate method.

113 23 The display methods according to the first to seventh examples are merely examples. The display control unitmay cause the displayto display the first area in a mode different from the second area by a method different from the display methods according to the first to seventh examples. In addition, the display methods according to the first to seventh examples may be appropriately combined.

1 23 10 10 10 According to the information processing systemdescribed above, the first area including the first imaging point icon can be displayed on the displayin a mode different from the second area not including the first imaging point icon. That is, it is possible to make the first area including the first imaging point icon that is the imaging point icon in which the annotation information is added to the imaging data stand out. Thus, it is possible to clarify the location of the imaging point icon in which the annotation information is added to the imaging data. As a result, it is not necessary to input an operation for searching for the imaging point icon in which the annotation information is added to the imaging data to the serveror the like, and thus it is possible to suppress an increase in the processing steps of the serveror the like. Therefore, it is possible to suppress an increase in load on the serverand the like.

1 2 3 4 5 3 FIG. 3 FIG. () The processing according to steps Sand Sinis not essential. Further, the processing according to steps Sand Sinis not essential. 2 113 4 5 3 FIG. () In order to make the display of the first area different from the display of the second area, the display control unitmay execute the processing according to steps Sand Sin. 3 113 () The design drawing may include floor plan information indicating a shape of each of a plurality of spaces included in the building. Then, in a case where the enlargement or reduction of the design drawing is detected, the display control unitmay set the boundary lines L of the shape along each shape of the plurality of spaces in the design drawing based on the floor plan information. A modification below can be employed for the present disclosure.

113 403 23 1 2 1 1 8 FIG. 8 FIG. In the design drawing, a line (an example of floor plan information) indicating a wall of the building may be drawn. For example, a line indicating a partition wall for partitioning a room from another room, a line indicating a partition wall for partitioning a room from a corridor, and the like may be written in the design drawing. When a line indicating a wall is drawn in the design drawing and the enlargement ratio of the design drawing is set to a predetermined enlargement ratio (for example, an enlargement ratio of 50%), the display control unitmay set the boundary lines L along the line indicating the wall.is a view illustrating an example of a display screendisplayed on the displayin the present modification. In the example illustrated in, the boundary lines L are set along a partition wall disposed between the room Rand the room R, a partition wall disposed between the room Rand the corridor H, and the like.

113 2 113 2 3 113 3 113 1 According to the present modification, the display control unitcan vary the display mode for each space such as a room or a corridor included in the building. For example, if the label information of “not started” is added to imaging data of a predetermined imaging point icon in the room R, the display control unitdisplays the room Rin red. Further, if the label information of “resolved” is added to the imaging data of the predetermined imaging point icon in the room R, the display control unitdisplays the room Rin green. Further, the display control unitdoes not particularly change the display mode for the second area such as the room R. In this manner, the user can easily grasp the status of each space included in the building, for example, the progress status of predetermined work in each space for each space.

113 In addition, the display control unitaccording to the present modification may set in each area an additional boundary line for further finely dividing each area. At this time, the display control unit 113 may set another boundary line so that each area is partitioned into a plurality of areas having a similar shape to each area.

4 113 () The display control unitmay partition the design drawing for each function. For example, the design drawing may be divided into a plurality of areas such as a conference room area, a habitable area, and an elevator area.

Specifically, the design drawing according to the present modification is associated with function information indicating the function of each of the plurality of spaces of the building. For example, information indicating that a space described in the design drawing has a function of a “conference room”, that another space described in the design drawing has a function of a “corridor (passage)”, that still another space described in the design drawing has a function of a “habitable room”, that still another space described in the design drawing has a function of an “elevator”, and the like is associated with the design drawing.

113 113 The display control unitaccording to the present modification sets the boundary lines L in the design drawing so that the design drawing is partitioned for each function of the plurality of spaces when detecting enlargement or reduction of the design drawing. For example, in a case where the enlargement ratio of the design drawing is set to a predetermined enlargement ratio, the display control unitsets the boundary lines L such that spaces having the function of the conference room are collectively displayed as the conference room area, the spaces having the function of the corridor are collectively displayed as the corridor area, spaces having the function of the habitable room are collectively displayed as the habitable area, and spaces having the function of the elevator are collectively displayed as the elevator area.

In this manner, since the design drawing is divided into areas based on the function of each space included in the building, the user can easily grasp the progress status of work in each area and the like for each area.

5 113 () When the enlargement ratio of the design drawing is set to a predetermined enlargement ratio (for example, an enlargement ratio of 30%), the display control unitmay draw the boundary lines L such that the design drawing is partitioned into four areas (sectors) such as an east area, a west area, a south area, and a north area.

6 200 121 121 200 121 113 () In the first embodiment, an example in which the design drawingis stored in the design drawing information storagehas been described, but the design drawing stored in the design drawing information storageis not limited to the design drawing. The design drawing information storagemay store a design drawing including a first-floor map corresponding to the first floor included in the building and a second-floor map corresponding to the second floor included in the building. The first-floor map is, for example, a floor plan illustrating a floor plan of the first floor of a building. The second-floor map is, for example, a floor plan illustrating a floor plan of the second floor of the building. That is, the design drawing may be image data in which the floor map of the first floor and the floor map of the second floor of the building are displayed in a list form. The display control unitmay display a plurality of imaging point icons on each of the first-floor map and the second-floor map. Then, among the first floor map and the second floor map, the floor map including the first imaging point icon may be treated as the first area, the floor map not including the first imaging point icon may be treated as the second area, and the display of the first area may be made different from that of the second area.

7 23 113 113 113 () The design drawing may display a map (an example of a bird’s-eye view) on the display. The map is an area map indicating a position of a building, a facility, or the like. The display control unitmay divide the map into a plurality of areas by displaying grid lines on the map. The display control unitmay display a plurality of imaging point icons on the map. The display control unitmay display the first area including the first imaging point icon among the plurality of areas on the map in a mode different from the second area not including the first imaging point icon.

8 113 23 () When the enlargement ratio designated by the user is equal to or larger than the reference enlargement ratio, the display control unitmay display the guidance information on the display.

113 113 23 23 1 1 23 23 9 FIG. The display control unitaccording to the present modification first detects that the user has input an operation of enlarging the design drawing. Subsequently, the display control unitdisplays the design drawing set to the enlargement ratio designated by the user on the display. Hereinafter, a range that is a part of the entire design drawing and is displayed on the displaybased on the enlargement operation of the user is referred to as a first range RA(). Further, in the entire design drawing, a range other than the first range RAis referred to as a second range. That is, in the entire design drawing, a portion displayed on the displayis referred to as a first range RA1, and a portion not displayed on the display(a portion present outside the display screen) is referred to as a second range.

113 113 200 1 200 200 1 113 200 113 200 1 113 23 Subsequently, the display control unitdetermines whether or not the enlargement ratio of the design drawing designated by the user is equal to or larger than the reference enlargement ratio. When the enlargement ratio designated by the user is equal to or larger than the reference enlargement ratio, the display control unitspecifies the position of the first range RA1. Specifically, the position information on the design drawingof the first range RAis acquired. The position information on the design drawingof the first range RA1 includes coordinate values on the design drawingof key points (for example, four corners) of the first range RA. Subsequently, the display control unitspecifies the positions and the number of first imaging point icons included in the second range. Specifically, the position information (coordinate values) on the design drawingof each of the first imaging point icons present in the second range and the number thereof are acquired. At this time, the display control unitacquires a relative positional relationship between the position on the design drawing of the first imaging point icon present in the second range and the position on the design drawingof the first range RAfor each of the first imaging point icons present in the second range. Subsequently, the display control unitdisplays, on the display, guidance information indicating the position and the number on the design drawing of each of the first imaging point icons included in the second range.

9 FIG. 9 FIG. 404 23 404 1 2 1 2 2 12 1 is a view illustrating an example of a display screendisplayed on the displayin the present modification. As illustrated in, the display screenincludes a first range display field Cand a guidance information display field C. The first range display field Cdisplays the first range RA1. The guidance information display field Cdisplays guidance information. The guidance information display field Caccording to the present modification includescells disposed around the first range display field C.

113 113 1 21 1 404 It is assumed that the display control unitspecifies that there is one first imaging point icon in a portion located in the upper left direction with respect to the first range RA1 in the second range. In this case, the display control unitwrites a number “” in the cell Cdisposed in the upper left direction of the first range display field Con the display screen.

113 1 113 3 22 1 404 Further, it is assumed that the display control unitspecifies that there are three first imaging point icons in a portion located in the lower left direction with respect to the first range RAin the second range. In this case, the display control unitwrites a number “” in the cell Cdisposed in the lower left direction of the first range display field Con the display screen.

1 113 2 23 1 404 Further, it is assumed that two first imaging point icons are present in a portion located in the lower right direction with respect to the first range RAin the second range. In this case, the display control unitwrites a number “” in the cell Cdisposed in the lower right direction of the first range display field Con the display screen.

113 2 In addition, the display control unitmay change the color, the display size, and the like of the cells included in the guidance information display field Cbased on the content (type of label information, content of comment included in comment information, and the like) of the annotation information added to the imaging data of the first imaging point icon and the total number of first imaging point icons.

200 404 According to the configuration of the present modification, when the first range RA1 of the design drawingis displayed on the display screen, it is possible to present the user with guidance information indicating the positions and the number of first imaging point icons present outside the display screen (second range). In this manner, the user can easily grasp the position and the number of the first icons present outside the display screen.

113 23 Note that when the enlargement ratio of the design drawing designated by the user is less than the reference enlargement ratio, the display control unitdoes not display the guidance information on the display.

The technology according to the present disclosure is useful in the technical field of displaying an image on a display.