Non-Transitory Computer-Readable Storage Medium, System, and Method

This non-provisional application is based on Japanese Patent Application No. 2025-037072 filed with the Japan Patent Office on Mar. 10, 2025, the entire contents of which are hereby incorporated by reference.

The present disclosure relates to a computer program, a system, and a method.

A camera image may be used not only in a video chat but also in a game application.

There is room for improvement in method of using a camera image in a game application from a point of view of usability or user experiences.

An exemplary embodiment provides one or more non-transitory computer-readable media having stored therein instructions. The instructions, when executed, cause one or more processors to perform operations that include obtaining from a running game application, designation information that indicates one or more camera image display modes among a plurality of camera image display modes different in degree of visibility of surroundings of a face of a person located within a field of view of a camera, performing selection processing based on the designation information for selecting one camera image display mode, and causing the running game application to obtain camera image data corresponding to the selected camera image display mode.

In Configuration 1, the selection processing may include presenting a selection screen for having a user select one camera image display mode from among the plurality of camera image display modes based on the designation information and selecting one camera image display mode based on a user operation.

In Configuration 2, the selection screen may provide some of the plurality of camera image display modes in a manner selectable by the user, and provide others of the plurality of camera image display modes in a manner not selectable by the user.

In Configuration 2 or 3, the selection screen may be configured to recommend the user one or more camera image display modes among the plurality of camera image display modes based on the designation information.

In any of Configurations 1 to 4, the operations may include causing the running game application to obtain information indicating the selected camera image display mode.

In any of Configurations 1 to 5, the selection processing may include selecting one camera image display mode based on a chat camera image display mode selected in a running chat application and the designation information.

In Configuration 6, the plurality of camera image display modes may be included in a plurality of chat camera image display modes selectable in the running chat application.

In any of Configurations 1 to 7, in the selection processing, when the designation information indicates one camera image display mode and a chat camera image display mode selected in a running chat application matches the indicated camera image display mode, the one camera image display mode indicated by the designation information may be selected without a user operation.

In Configuration 8, the selection processing may include accepting, when the designation information indicates one camera image display mode and the chat camera image display mode selected in the running chat application does not match the indicated camera image display mode, a user operation for selecting a one camera image display mode.

In any of Configurations 1 to 9, one or more chat camera image display modes selectable in a running chat application may be set by a supervisor. The selection processing may include selecting, when the camera image display mode indicated by the designation information is not included in the one or more chat camera image display modes set by the supervisor, the chat camera image display mode selected in the running chat application.

In any of Configurations 1 to 10, the operations may further include causing the running game application to obtain camera image data corresponding to a chat camera image display mode selected in a running chat application. The selection processing may include setting the chat camera image display mode in the running chat application to a mode corresponding to the camera image display mode selected in the selection processing.

Another exemplary embodiment provides a system in which a camera is available, that includes one or more processors and one or more memories having stored therein instructions that, when executed, cause the one or more processors to perform operations that include obtaining from a running game application, designation information that indicates one or more camera image display modes among a plurality of camera image display modes different in degree of visibility of surroundings of a face of a person located within a field of view of the camera, performing selection processing based on the designation information for selecting one camera image display mode, and causing the running game application to obtain camera image data corresponding to the selected camera image display mode.

Another exemplary embodiment provides a method performed by a computer in which a camera is available, that includes obtaining from a running game application, designation information that indicates one or more camera image display modes among a plurality of camera image display modes different in degree of visibility of surroundings of a face of a person located within a field of view of the camera, performing selection processing based on the designation information for selecting one camera image display mode, and causing the running game application to obtain camera image data corresponding to the selected camera image display mode.

The foregoing and other objects, features, aspects and advantages of the present disclosure will become more apparent from the following detailed description of the present disclosure when taken in conjunction with the accompanying drawings.

The present embodiment will be described in detail with reference to the drawings. The same or corresponding elements in the drawings have the same reference characters allotted and description thereof will not be repeated.

Even when data is explained in identical terms, contents of the data do not have to completely match. In an example where both of one piece of data and another piece of data at least convey specific information, they may be regarded as the same data. A name of data is given for the sake of convenience, and does not limit the scope indicated by the data or the technical meaning thereof.

A program that causes a computer to perform processing may be a single program or a program group including a plurality of programs. "A program" in the present disclosure does not have to mean a single program but may include a program group. "A program" does not have to entirely be stored in a single apparatus. "A program" may mean, for example, the entirety of a plurality of programs stored in respective apparatuses included in a computer.

1 FIG. 1 FIG. 1 FIG. 1 100 118 100 1 100 4 100 100 1 100 2 100 3 100 4 Referring to, a systemincludes one or more game devices. Camerais available in at least one of game devices.shows an exemplary configuration of systemincluding four game devicesconnected to a network. When each of a plurality of game devicesshould be specified in the description below, a sub number will be given for distinction (for example, game devices-,-,-, and-shown in).

1 100 100 100 100 10 100 In systemaccording to the present embodiment, a user who uses game devicehas the user's own account and the user's own account is brought in correspondence with each game device. The user who has the account can cause the account brought in correspondence to join one or more chat groups (which are also abbreviated as a "group" below) by providing predetermined input to game device. Game devicecorresponding to the account belonging to at least one group transmits data (which is also referred to as "communication data" below) to be used for communication between users to another game devicecorresponding to another account belonging to the group. Communication between users can thus be realized in the group.

10 100 100 100 100 10 10 10 Communication datamay include, for example, sound data obtained by game device, image data obtained by game device, text data obtained by game device, information on an application running in game device, or the like. All pieces of data do not have to be included in one piece of communication data, and one piece of data may be divided into a plurality of pieces of communication data. One piece of communication datamay include a plurality of pieces of data.

118 100 "Image data" herein encompasses data of moving images and data of one or more still images. For example, image data may be data captured by cameraor the like or data outputted from an application executed in game device. A method of generating image data is not limited.

1 200 300 200 300 10 100 200 300 Systemmay further include a management serverand a relay server. Management serveris responsible for processing for newly forming a group, processing for participation of one or more accounts in a group, or the like. Relay serverrelays communication datato be transmitted or received by one or more game devices. Management serverand relay servermay be implemented at a single physical server.

10 100 100 10 100 300 A scheme to transmit communication datafrom certain game deviceto one or more other game devicesmay be a scheme to directly transmit communication datato one or more other game devices(for example, P2P or the like), in addition to or instead of a scheme to transmit data through one or more relay entities (for example, relay server).

100 2 2 FIGS.A andB An exemplary chat screen generated in game deviceaccording to the present embodiment will be described with reference to.

100 1 100 4 100 1 100 3 100 4 1 FIG. 2 2 FIGS.A andB By way of example, four accounts belong to an identical group and game devices-to-correspond to the four respective accounts as shown in. It is assumed inthat game devices-to-are streaming camera images and game device-is not streaming a camera image by way of example.

2 FIG.A 2 FIG.B 2 2 FIGS.A andB 120 100 1 120 100 4 10 shows an exemplary chat screen shown on a displayof game device-andshows an exemplary chat screen shown on displayof game device-. The chat screens shown inare by way of example and a screen configuration of the chat screen created by using communication datais not limited.

2 FIG.A 100 1 190 1 100 1 100 1 192 1 192 4 100 1 100 4 100 1 192 1 190 1 100 2 100 4 As shown in, the exemplary chat screen of game device-includes a game image-of a game application running in game device-. The exemplary chat screen of game device-includes streaming images-to-transmitted by respective game devices-to-. In this example, game device-transmits streaming image-including game image-to other game devices-to-.

2 FIG.B 2 FIG.A 100 4 190 4 100 4 100 4 192 1 192 4 100 1 100 4 100 1 100 4 192 4 190 4 100 1 100 3 As shown in, the exemplary chat screen of game device-includes a game image-of a game application running in game device-. The exemplary chat screen of game device-includes streaming images-to-transmitted by respective game devices-to-. The order of display of the streaming images may be different from that in the exemplary chat screen of game device-shown in. In this example, game device-is transmitting streaming image-including game image-to other game devices-to-.

194 1 194 3 100 1 100 3 192 1 192 3 100 4 196 4 100 4 192 4 Camera images-to-distributed by game devices-to-are superimposed on streaming images-to-, respectively. Since game device-is not distributing the camera image, on the other hand, an icon image-indicating the account corresponding to game device-, instead of the camera image, is superimposed on streaming image-.

194 1 194 3 100 Each of camera images-to-is an image corresponding to a camera image display mode (which is also abbreviated as a "display mode" below) set in game devicewhich is a source of streaming. Details of the display mode will be described later.

100 100 Game devicewhich is an exemplary information processing apparatus will now be described. The information processing apparatus is not limited to game device, and it may be, for example, a personal computer, a television, a tablet terminal, a smartphone, a wearable terminal, a server, or the like.

100 100 100 100 Game devicescorresponding to a plurality of accounts belonging to an identical group do not have to be identical in hardware configuration. For example, at least one of game devicesmay be a device exclusive for games, and another game devicemay be a personal computer, a television, a tablet terminal, a smartphone, a wearable terminal, a server, or the like capable of executing a game application. Game deviceshould only be a computer capable of executing at least a game application.

The "computer" herein does not necessarily mean a single apparatus but may encompass the entirety in which a plurality of apparatuses are connected by wired connection or wireless connection. In an example where the information processing apparatus is configured with a plurality of apparatuses, each of the plurality of apparatuses may be an exemplary information processing apparatus.

100 100 102 104 106 108 110 116 120 122 124 100 3 FIG. An exemplary hardware configuration of game deviceaccording to the present embodiment will be described with reference to. Game deviceincludes, for example, one or more processors, one or more volatile memories, a communication unit, a camera interface, one or more non-volatile memories, an input unit, a display, a microphone, and a speaker. Each component may be removable from a main body of game device.

102 100 102 102 110 104 Processoris a processing entity for performing processing in game device. Processorincludes, for example, a central processing unit (CPU), a graphics processing unit (GPU), or the like. Processordevelops a program stored in non-volatile memoryon volatile memoryand executes the same.

104 102 Volatile memoryis a volatile storage medium accessible by processor, and it includes, for example, a dynamic random access memory (DRAM), a static random access memory (SRAM), or the like.

110 102 110 100 110 Non-volatile memoryis a non-volatile storage medium accessible by processor, and it includes, for example, a flash memory, a hard disk, or the like. Non-volatile memorymay include, for example, a storage medium attachable to and removable from game device, such as a cartridge or an optical disc. Non-volatile memoryis also referred to as a storage.

112 126 110 For example, one or more programs such as a system programand a game applicationare stored in non-volatile memory.

112 100 112 112 114 System programincludes computer readable instructions for hardware control of game device, provision of a program execution environment, or the like. System programmay include one or more programs or program modules. For example, system programincludes a chat application.

114 10 100 Chat applicationperforms processing relating to transmission and reception of communication databetween a plurality of game devicescorresponding to a plurality of accounts belonging to a group.

126 126 100 126 100 126 112 126 Game applicationincludes computer readable instructions for execution of a game. A plurality of game applicationsmay be installed in game device. Game applicationmay be read from a separate storage medium. Another game deviceor an external resource such as a server may be used for at least a part of execution of a game by game application. System programmay include at least a part of game application.

104 110 The "processor" herein may encompass at least processing circuitry that performs processing in accordance with computer readable instructions, such as a CPU or a GPU and hard-wired circuitry such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The "memory" herein may encompass at least volatile memoryand non-volatile memoryand may include other storage media and storage devices.

100 In game device, a system on chip (SoC) in which functions of the processor, the memory, and the like are integrated may be adopted. In this case, the processor and the memory are located at the same SoC (integrated circuit). Therefore, the "processor" and the "memory" herein may at least encompass both of configurations independent of each other and an integrated configuration.

106 100 200 300 4 106 100 4 4 Communication unittransmits and receives data to and from another game device, management server, relay server, or the like over network. Communication unitmay communicate data with another game deviceor the like over the Internet as exemplary network. Networkmay be a wireless network in conformity with Bluetooth®, ZigBee®, wireless LAN (IEEE 802.11), or the like.

108 118 118 108 118 Camera interfacemediates data transmission to cameraand data reception from camera. Connection of camera interfaceto cameramay be wired connection or wireless connection.

116 116 116 100 Input unitaccepts a user operation. Input unitincludes, for example, a keyboard, a mouse, a game controller, a touch pad, and/or the like. Input unitmay be an interface with an apparatus (for example, a game controller) configured to accept a user operation. In other words, the apparatus configured to accept a user operation may be located outside game device.

120 102 120 120 100 100 120 Displayshows an image or a video image generated as a result of processing by processor. Displayincludes, for example, a liquid crystal display (LCD), an organic EL display, or the like. Displaymay be located outside game device. In this case, game devicemay include an interface circuit with display.

122 100 124 100 122 124 100 Microphoneis arranged at a housing or the like of game deviceand collects sound to generate a sound signal. Speakeris arranged at the housing or the like of game deviceand generates sound from a sound signal. At least one of microphoneand speakermay be located outside game device.

118 100 118 Cameragenerates camera data (moving image data or still image data) resulting from image capture of a subject, in accordance with a command from game deviceor a predetermined condition. Cameraincludes, for example, an image capture element such as a charge-coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor. A lens may be arranged in a stage preceding the image capture element.

118 118 118 100 100 100 118 Cameramay be, for example, a camera for video chat. Cameramay be a dedicated camera connectable only to a specific device or a general-purpose camera connectable to any device. A plurality of camerasmay be connectable to game device. Furthermore, game devicemay use a camera of another information processing apparatus (for example, a smartphone). The configuration for game deviceto use camerais thus not limited.

100 100 112 114 126 4 FIG. An exemplary software configuration of game deviceaccording to the present embodiment will be described with reference to. In game device, system programincluding chat applicationand game applicationare simultaneously executable. "Being simultaneously executable" means that a plurality of applications or programs are executed in parallel and does not limit execution timing or the like.

100 140 130 140 112 102 140 112 130 126 102 130 126 Game deviceincludes a system moduleand a game execution unitby way of example of a software component. System modulemay be implemented by execution of system programby one or more processors. System modulecan also be referred to as running system program. Game execution unitmay be implemented by execution of game applicationby one or more processors. Game execution unitcan also be referred to as running game application.

130 132 134 132 130 131 131 2 2 FIGS.A andB Game execution unitproceeds with a game based on a user operation and outputs game image dataand game audio data. Game image datamay include, for example, a plurality of types of image data different in image quality, resolution, or frame rate. Game execution unitmay include designation informationthat indicates one or more display modes. The one or more display modes indicated by designation informationmay be based on one or more display modes selectable in the chat screens shown inor may be independent of each other.

140 100 140 142 142 114 142 143 158 158 143 System moduleprovides a basic function necessary in game device. System moduleincludes, for example, a chat execution unit. Chat execution unitcan also be referred to as running chat application. Chat execution unitmay include display mode informationindicating a current display mode of showing camera image data. Camera image datacorresponding to the display mode indicated by display mode informationis generated.

112 114 114 112 126 140 142 140 140 142 140 140 142 System programdoes not have to include at least a part of chat application. At least a part of chat applicationmay be an application different from system program, similarly to game application. In the description below, a part or the entirety of processing performed by system modulemay be performed by chat execution unit. Therefore, in a context of processing performed by system module, system modulecan also be read as chat execution unitand system modulecan also be read as system moduleand chat execution unit.

140 144 146 148 150 152 System moduleincludes, for example, a microphone controller, a camera controller, a communication controller, an image processing unit, and a sound processing unit.

144 154 122 Microphone controllergenerates sound databased on sound collected by microphoneor the like.

146 156 118 146 118 118 Camera controllergenerates camera output image databased on an image captured by cameraor the like. Camera controllermay be able to control start and stop or the like of image capture by camera, or to control a condition (a frame rate, white balance, or the like) for image capture by camera.

148 106 100 Communication controllergives a command to communication unitto control data communication with another game deviceor the like.

150 151 151 104 110 150 Image processing unitcan use a storage areafor storage of image data. Storage areamay use, for example, a partial area of one or more volatile memoriesor one or more non-volatile memories. Image processing unitmay be able to perform image processing on one or more pieces of image data.

151 132 156 158 162 164 166 168 Storage areamay include, for example, an area for storing game image data, camera output image data, camera image data, one or more pieces of received streaming image data, one or more pieces of received camera image data, streaming image data, and display image data.

158 156 158 156 118 146 158 Camera image datais generated from camera output image datain accordance with the display mode. Rather than generation of camera image datafrom camera output image data, cameraor camera controllermay generate camera image datain accordance with the display mode.

142 142 Chat execution unitperforms processing for communication between users in the group. For example, chat execution unitmay perform processing for joining or leaving the indicated group in accordance with a user operation.

142 10 154 166 158 166 100 Chat execution unitmay generate and transmit communication databased on at least one of sound data, streaming image data, and camera image dataas processing for streaming. Streaming image dataincludes an image to be distributed to another game device.

142 162 164 10 100 151 142 152 160 10 100 152 124 Chat execution unitmay cause received streaming image data, received camera image data, and the like included in one or more pieces of communication datafrom one or more other game devicesto be stored in storage area, as processing for receiving streaming data. Chat execution unitmay output to sound processing unit, received sound dataincluded in one or more pieces of communication datafrom one or more other game devices, as processing for receiving streaming data. Sound processing unitmay generate a sound signal based on sound data and output the generated sound signal to speaker.

150 168 132 158 162 164 142 168 120 Image processing unitmay generate display image databy using at least one of game image data, camera image data, one or more pieces of received streaming image data, and one or more pieces of received camera image datain accordance with a command from chat execution unit. Display image datais used for showing an image or a video image on displayof the device to which it belongs.

100 114 114 118 In game deviceaccording to the present embodiment, a plurality of display modes may be prepared in running chat application. The user can set or change the display mode, for example, on a setting screen of running chat application. The plurality of display modes may be different, for example, in degree of visibility of surroundings of a face of a person located within a field of view of camera. The surroundings of the face may include a part (for example, a body or the like) under the face. The degree of visibility may include, for example, whether to show an image, a degree of blur, or the like.

100 5 5 FIGS.A-C 5 5 FIGS.A-C An exemplary camera image display mode in game deviceaccording to the present embodiment will be described with reference to.exemplify three display modes by way of example.

5 FIG.A 5 FIG.A 158 156 118 118 118 shows an exemplary image of camera image datain an example where a full-view mode is selected, by way of example of the display mode. The exemplary image shown inis substantially identical to the image (for example, camera output image data) captured by camera. It can also be said that a full view of the image captured by camerais used as it is. In the full-view mode, the surroundings of the face of the person in the image captured by camerais fully shown.

5 FIG.B 5 FIG.B 5 FIG.B 158 118 118 118 shows an exemplary image of camera image datain an example where a cut-out mode is selected, by way of example of the display mode. The exemplary image shown inis such an image that only a person located within the field of view of camerais cut out. In the cut-out mode, a background around the person in the image captured by cameramay be set to a specific color (for example, white) or a transparent color. In the cut-out mode, it can also be said that the background in the surroundings of the face of the person is not shown. The image in the cut-out mode may include the face of the person and at least a part of the upper body (for example, a range above the navel). Though one person is cut out in the exemplary image shown in, in an example where a plurality of persons are located within the field of view of camera, the plurality of persons may be cut out.

5 FIG.C 5 FIG.C 158 118 118 118 shows an exemplary image of camera image datain an example where a face mode is selected, by way of example of the display mode. The exemplary image shown inis extraction of the face and the surroundings of the face of the person located within the field of view of camera. In the face mode, the face and the surroundings of the face of the person in the image captured by cameramay be extracted. The image captured by cameramay be enlarged as necessary. In the face mode, it can also be said that things other than the face of the person are not shown. The image in the face mode can also be paraphrased as including only the face.

In the face mode, the background around the face of the person may be shown as it is or as being blurred away. Alternatively, the background around the face of the person may be set to a specific color (for example, white) or a transparent color. At this time, cut-out processing may be performed along the contour of the face of the person.

2 2 FIGS.A andB 100 1 100 2 100 3 In the chat screens shown indescribed above, the users of game devices-and-have selected the face mode and the user of game device-has selected the cut-out mode.

Though three display modes are exemplified by way of example, the number of display modes is not limited and the display mode to be adopted is not limited either. For example, the display mode may include a mode in which the background in a full-view range is shown as being blurred away. In a modification, in each mode described above, rather than cutting out a quadrangular area, a circular or oval area may be cut out. Image data may include a frame of the cut-out area.

140 158 146 142 150 4 FIG. System modulemay select the display mode based on a user operation. Camera output image datacorresponding to the display mode may be generated by at least one of camera controller, chat execution unit, and image processing unit(see) or by a feature other than that.

112 114 126 126 156 130 151 150 156 156 In an example where system programincluding chat applicationand game applicationare simultaneously running, game applicationmay use camera output image data. For example, game execution unitmay access storage areaof image processing unitto obtain camera output image dataand generate a game image by using obtained camera output image data.

126 126 126 131 130 4 FIG. In an example where a plurality of display modes are selectable by the user, recommended values of the display modes may be set in game application. The recommended values indicate one or more display modes recommended in game application. In game application, selection by the user, of a display mode other than the recommended values may be allowed. Designation information(see) in game execution unitmay indicate the recommended value.

126 126 131 4 FIG. In the example where the plurality of display modes are selectable, allowable values of the display modes may be set in game application. The allowable values indicate one or more display modes selection of which is allowed in game application. Designation information(see) may indicate the allowable value.

126 126 126 126 For example, a developer of game applicationmay set in advance, one or more display modes suitable for execution of game applicationas recommended values, or may set in advance one or more display modes allowed in execution of game applicationas allowable values. In game application, only at least one of the recommended value or the allowable value may be set, or neither of them may be set.

114 126 126 126 126 126 114 The display mode selected by the user for a chat while chat applicationand game applicationare simultaneously running may not match with the recommended values or the allowable values set in game application. By way of example, in an example where game applicationto be executed provides a game to be played by a plurality of users, a game image generated by game applicationmay desirably include images of a plurality of users. At this time, the recommended value or the allowable value set in game applicationmay be the cut-out mode or the full-view mode. In running chat application, on the other hand, the face mode in which only the face of a single user is basically shown may be selected.

140 158 114 114 140 130 158 Therefore, system modulemay perform selection processing as below to select one display mode. As the selection processing is performed, the display mode of showing camera image dataused by chat applicationis changed. In other words, the display mode in running chat applicationis set to the mode corresponding to the display mode selected in the selection processing. System modulecauses game execution unitto obtain camera image datacorresponding to the display mode selected in the selection processing.

100 112 102 6 FIG. 6 FIG. An exemplary processing procedure in the selection processing performed in game deviceaccording to the present embodiment will be described with reference to. Each step shown inmay be performed by execution of system programby one or more processors.

Processing described in the present embodiment may include other types of processing or does not have to include a part of processing. The order of performing processing is by way of example. For example, a plurality of types of processing may be performed in parallel, or some processing may be performed in the order reverse to the order in the description. Though processing is divided in units of steps for the sake of convenience of description, any unit of division may be applicable. A plurality of steps may be integrated, or a single step may be divided into a plurality of steps. This is also similar in the description which will follow.

140 158 130 2 142 4 142 114 100 100 When system modulereceives a request for obtaining camera image datafrom game execution unit(step S), it determines whether or not chat execution unitis operating (step S). Chat execution unitbeing operating may refer, for example, to a state in which chat applicationhas been started up, a state in which an account brought in correspondence with game devicebelongs to at least one group, or a state in which a plurality of accounts including the account brought in correspondence with game devicebelong to at least one group.

142 4 140 114 6 130 158 When chat execution unitis not operating (NO in step S), system modulenotifies the user of necessity to execute chat application(step S). The process is then stopped. When the process is stopped, game execution unitmay proceed with the game without using camera image data, or may stop proceeding with the game (this is also the case when the process below is stopped).

142 4 140 118 8 118 114 118 When chat execution unitis operating (YES in step S), system moduledetermines whether or not use of camerais restricted (step S). Use of cameramay be restricted, for example, in system setting or in setting of chat application. Use of cameraby a certain account may be restricted by another account that supervises the certain account.

118 8 140 118 10 When use of camerais restricted (YES in step S), system modulenotifies the user of restriction of use of camera(step S). The process is then stopped.

118 8 140 118 12 118 12 140 118 14 12 14 When use of camerais not restricted (NO in step S), system moduledetermines whether or not image capture by camerahas been activated (step S). When image capture by camerahas not been activated (NO in step S), system modulenotifies the user to activate image capture by camera(step S). Processing in step Sor later is then repeated. When image capture by camera 118 is not activated after lapse of a predetermined time period after step S, the process may be stopped.

118 12 140 131 130 16 131 143 18 When image capture by camerahas been activated (YES in step S), system moduleobtains designation informationin game execution unit(step S), and determines whether or not the display mode indicated by obtained designation informationand a current display mode (for example, the display mode indicated by display mode information) match with each other (step S).

131 131 131 131 For example, in an example where designation informationindicates one display mode as the recommended value, when the recommended value and the current display mode match with each other, determination as matching may be made. In an example where designation informationindicates a plurality of display modes as recommended values, when the current display mode matches with at least one recommended value, determination as matching may be made. For example, in an example where designation informationindicates one or more display modes as the allowable values, when the current display mode is included in the allowable values, determination as matching may be made. In an example where designation informationincludes the recommended value and the allowable value, when the current display mode does not match with the recommended value but is included in the allowable value, determination as matching or determination as not matching may be made. Processing for determining matching is not limited as above.

131 18 140 20 When the display mode indicated by obtained designation informationmatches with the current display mode (YES in step S), system moduleselects the current display mode (step S). "To select" in this case may mean simply maintaining the state. When the current display mode is maintained, change to the selected display mode does not have to newly be made, although one display mode is selected.

131 142 140 131 140 142 131 When designation informationindicates one display mode as the recommended value and the display mode selected in chat execution unitmatches the indicated display mode, system modulemay thus select the one display mode indicated by designation informationwithout the user operation. In other words, system modulemay select one display mode based on the display mode selected at chat execution unitand designation information.

140 130 130 158 22 158 158 151 130 158 140 System modulethen responds to game execution unit, with information for game execution unitto obtain camera image datacorresponding to the display mode (step S). For example, the information for obtaining camera image datamay include identification information for specifying camera image datastored in storage area. Game execution unitobtains camera image databased on the information from system module.

140 130 140 130 130 9 9 FIGS.A andB System modulemay respond with the selected display mode to game execution unit. In other words, system modulemay cause game execution unitto obtain information indicating the selected display mode. Game execution unitmay perform processing (for example, processing shown inwhich will be described later) in accordance with the selected display mode.

131 18 140 131 When the display mode indicated by obtained designation informationdoes not match with the current display mode (NO in step S), system modulemay accept selection of the display mode based on obtained designation information.

140 131 24 140 131 140 26 22 By way of example, system modulemay have a selection screen for accepting selection of the display mode shown based on the recommended value or the allowable value included in designation information(step S). System modulemay have the selection screen shown even in the absence of designation information. System modulethen selects the display mode in accordance with the user operation (step S) and performs processing in step S.

131 142 140 When designation informationindicates one display mode and the display mode selected at chat execution unitdoes not match the indicated display mode, system modulemay thus accept the user operation for selecting the one display mode.

6 FIG. 140 130 4 130 140 142 130 140 118 140 114 Thoughshows the example where system moduleperforms all processing, at least a part of the processing may be performed, for example, by game execution unit. For example, in step S, game execution unitmay obtain from system module, information on whether or not chat execution unitis operating. For example, based on that information, game execution unitmay then obtain from system module, information as to whether or not use of camerais restricted, or may request system moduleto notify the user of necessity to execute chat application. As described above, the processing may be performed as a series of processing or individually.

131 130 142 140 130 142 140 142 130 The display mode selected based on designation informationor the like in game execution unitis reflected in chat execution unit(or system module). In other words, selection of the display mode at game execution unitis in coordination with selection of the display mode at chat execution unit(or system module). It can also be said that the display mode at chat execution unitis changed based on the request from game execution unit.

24 114 450 451 452 453 114 6 FIG. 7 7 FIGS.A andB 7 7 FIGS.A andB 7 FIG.A An exemplary selection screen shown in step Sinwill be described with reference to. The selection screen is a screen for having the user select one display mode from among the plurality of display modes. The exemplary selection screen shown inmay be the same as or different from the selection screen shown when the display mode is set or changed in chat application. In a selection screenshown in, by way of example, three display modes (for example, a full-view mode, a cut-out mode, and a face mode) selectable in chat applicationare selectable. The number of display modes shown in the selection screen is not limited.

7 FIG.A 126 452 454 455 126 456 450 454 450 131 In, the recommended values are set in game application. In the display mode indicated by the set recommended value (cut-out modein this example), an object(for example, text "recommendation by game") indicating that the display mode is the recommended value may be shown. A radio buttoncorresponding to the recommended value set in game applicationmay be selected as an initial value (initial value). In an example where the plurality of display modes are indicated as the recommended values, in selection screen, a plurality of objectsmay be shown in correspondence with respective display modes. At this time, the initial value of the radio button may be determined in accordance with a predetermined rule or predetermined priority among the plurality of display modes indicated as the recommended values. Selection screenmay thus recommend the user one or more display modes among the plurality of display modes based on designation information.

454 456 455 454 456 Guidance processing for facilitating selection by the user, of the display mode indicated as the recommended value may include, for example, at least one of display of objectindicating that the display mode is the recommended value or initial valueof radio button. By showing objectindicating that the display mode is the recommended value, initial valueof the radio button, or the like, usability for selection of the display mode can be improved.

7 FIG.B 7 FIG.B 7 FIG.B 126 452 453 450 457 451 450 450 In, the recommended value and the allowable value are set in game application. It is assumed, for example, that cut-out modeand face modeare indicated as the allowable values. In selection screenshown in, a radio buttonmay be shown such that full-view modenot included in the allowable values is not selectable. In other words, selection screenshown inincludes also the display mode not selectable by the user. As selection screenincludes the display mode that is not selectable, the user can intuitively know the display mode that is not selectable.

455 458 140 140 455 For example, as the user selects radio buttoncorresponding to the desired display mode and presses an OK button, system moduleaccepts the display mode selected by the user. System moduleselects one display mode based on the user operation. An interface for selection of the display mode is not limited to radio button, and it may be, for example, a pull-down list.

450 7 FIG.B Though the display mode not included in the allowable value is presented in a non-selectable state in selection screenshown in, display thereof per se does not have to be provided. In another modification, for the display mode not included in the allowable values, text or the like indicating that the display mode is not included in the allowable values may be shown.

A manner of display for informing the user of the recommended value or the allowable value is not limited. For example, the display mode indicated as the recommended value may be highlighted by using a color, a font, or the like different from that in another display mode.

18 131 6 FIG. In a modification, processing in step Sinmay be omitted, and regardless of whether or not the display mode indicated by designation informationmatches with the current display mode, selection of the display mode may be accepted by using the selection screen or the like.

131 18 140 158 140 6 FIG. In a modification, when the display mode indicated by designation informationmatches with the current display mode (YES in step Sin), the user may be notified of the fact of matching. System modulemay seek for approval by the user as to use of camera image datacorresponding to the current display mode in a game. When the user desires change of the display mode, system modulemay accept the desire.

131 142 140 142 For example, when the display mode indicated by the recommended value in designation informationdoes not match with the display mode selected at chat execution unit, system modulemay select the display mode selected at chat execution unitas the initial value of the radio button.

18 140 131 140 6 FIG. Instead of step Sand processing thereafter in, system modulemay forcibly change the display mode to the display mode indicated by designation information. At this time, a notification about forced change of the display mode may be or may not be given to seek for approval by the user. In an example where the notification is given, system modulemay change the display mode when it obtains approval by the user and may stop the process when it does not obtain approval by the user.

114 118 118 From a point of view of privacy, protection of minors, or the like, chat applicationmay be permitted to restrict use of camerain accordance with setting by a supervisor or the like. In such a restricted state, for example, permission by the supervisor, entry of a password, or the like may be required for use of camera.

118 8 118 10 6 FIG. For example, when use of camerais restricted in the process in(YES in step S), the user may be notified of restriction of use of camera(step S) and then permission by the supervisor, entry of the password, or the like may be accepted.

118 131 140 142 In addition to or instead of use of camera, the supervisor or the like may be allowed to set one or more display modes to be selectable (for example, a white list) or to set one or more display modes to be not selectable (for example, a black list). In this case, the user is not permitted to select the display mode set to be not selectable. Therefore, when the display mode indicated by designation informationis not included in the one or more selectable display modes set by the supervisor or the like, system modulemay select the display mode selected at chat execution unitwithout the user operation.

Alternatively, in an example where the selection screen for accepting the user operation is shown, the restricted display mode does not have to be shown or the restricted display mode may be shown as the display mode that is not selectable.

24 140 6 FIG. In an example where a specific display mode is restricted, for example, before or after step Sinis performed, the user may be notified of restriction of the specific display mode. In addition, system modulemay accept permission by the supervisor or entry of the password such that use of the restricted display mode is permitted.

140 130 130 140 158 140 158 130 Interaction (for example, a request and a response or the like) between system moduleand game execution unitmay be in accordance with any instruction system. By way of example, the application programming interface (API) may be used. For example, game execution unitmay request system moduleto obtain camera image datain accordance with the instruction system defined in advance as the API. In addition, system modulemay respond with information for obtaining camera image datato game execution unitin accordance with the instruction system defined in advance as the API.

140 158 130 22 130 158 140 158 130 6 FIG. Though one implementation where system moduleresponds with information for obtaining camera image datato game execution unit(for example, step Sin) in the selection processing described above is shown, the method for game execution unitto obtain camera image datais not limited as such. For example, system modulemay respond with camera image dataitself to game execution unit.

140 130 118 146 150 130 130 130 118 146 118 146 140 In another modification, separately from the display mode of system module, a display mode for camera image data that game execution unitis caused to obtain may be set. At least one of camera, camera controller, or image processing unitmay generate camera image data for game execution unitin accordance with the display mode for game execution unit. Game execution unitmay give designation of the display mode to cameraor camera controllerand may obtain the camera image data corresponding to the display mode from cameraor camera controlleror from system module.

126 126 131 140 126 126 Game applicationmay use the camera image including the face of the user (for example, game processing using the camera image as will be described later). At this time, from a point of view of usability or user experiences, there is an appropriate range of image capture in accordance with game application. In such a case, by selecting the display mode based on designation informationin system moduleand causing game applicationto obtain the camera image corresponding to the selected display mode, processing at a side of game applicationor man-hours in development can be reduced.

118 114 140 130 158 For example, in an example where use of cameraor the display mode in chat applicationcan be restricted in system module, game execution unitcan use camera image dataafter such determination.

126 114 450 126 114 114 114 114 126 126 In the embodiment above, when game applicationuses the camera image including the face of the user, the display mode of showing the camera image in chat applicationis changed or selection screenfor the change is shown. Therefore, the user who is executing or attempts to execute game applicationdoes not have to perform such an operation as setting chat applicationas an object to be operated and opening a setting screen for changing the display mode in chat application, and usability is excellent. The user may be permitted to change the display mode of showing the camera image in chat application, with chat applicationbeing set as the object to be operated, while the user is executing game applicationwhere the camera image including the face of the user is used. At this time, in response to the change, the camera image shown in the game image of game applicationis also changed.

100 100 1 100 2 100 1 100 2 8 8 9 9 FIGS.A,B,A, andB 8 8 9 9 FIGS.A,B,A, andB An exemplary game image generated in game deviceaccording to the present embodiment will be described with reference to., show exemplary game images in an example where accounts brought in correspondence at least with game device-and game device-, respectively, belong to an identical group. For example, the user having the account brought in correspondence with game device-and the user having the account brought in correspondence with game device-are assumed as being simultaneously playing an identical game application. The game application may be a communication game.

8 FIG.A 120 100 1 190 1 100 1 100 2 Referring to, for example, on displayof game device-, game image-including a game object (labeled, for example, with "1") operated by the user of game device-and a game object (labeled, for example, with "2") operated by the user of game device-is shown.

130 100 1 158 190 1 100 1 164 100 2 In the state above, game execution unitof game device-can also use camera image datato generate game image-. Game device-can also use received camera image datareceived from game device-.

8 FIG.B 402 100 1 404 100 2 402 158 404 164 100 2 Referring to, for example, a camera imagemay be superimposed at a position proximate to the game object operated by the user of game device-and a camera imagemay be superimposed at a position proximate to the game object operated by the user of game device-. Camera imagemay be based on camera image dataand camera imagemay be based on received camera image datafrom game device-.

8 FIG.B 190 1 158 shows exemplary game image-using camera image datain the example where the face mode is selected as the display mode.

126 190 1 158 190 1 406 158 100 1 9 FIG.A 9 FIG.A In game application, even when the face mode is indicated as the recommended value of the display mode, the user may select a display mode other than the recommended value.shows exemplary game image-using camera image datain an example where the cut-out mode is selected as the display mode. Specifically, in game image-shown in, a camera imagebased on camera image datain accordance with the cut-out mode is superimposed at a position proximate to the game object operated by the user of game device-.

130 140 130 158 130 158 130 404 9 FIG.B When game execution unitobtains the selected display mode from system module, it may generate the camera image to be superimposed in accordance with the obtained display mode. For example, as shown in, game execution unitmay set any background in an area other than the person included in camera image data, based on information indicating that the cut-out mode has been indicated. For example, any background may be colored in accordance with the background of the game that is being executed. In addition, game execution unitmay superimpose a (for example, circular or quadrangular) frame around obtained camera image data. For example, game execution unitmay obtain the camera image in the cut-out mode and generate an image like camera imagein the face mode from that image.

130 158 130 126 9 9 FIGS.A andB Game execution unitmay thus make image processing or display processing on obtained camera image datadifferent in accordance with the obtained display mode. In other words, game execution unitmay perform the image processing or the display processing in accordance with the obtained display mode. Even when at least the recommended value is not set in game application, processing shown incan be performed.

8 8 9 9 FIGS.A,B,A, andB 132 132 126 Though, show the game images on which game image datais superimposed by way of example, exemplary use of game image datain game applicationis not limited as such and the game image data can be used in any method (for example, a game in which collision detection is performed within the area where the person is shown, face recognition, or the like).

142 130 142 130 142 130 130 142 The one or more display modes selectable at chat execution unitdo not have to completely match with the one or more display modes selectable at game execution unitor the former may at least partially match with the latter. For example, three display modes may be selectable at chat execution unitand other three display modes may be selectable at game execution unit. Alternatively, for example, four display modes may be selectable at chat execution unitand three of the four display modes may be selectable at game execution unit. Selectable display modes at game execution unitmay thus be included in the display modes selectable at chat execution unit.

140 142 140 131 In a modification, system modulemay include selection of the display mode as system setting, independently of the display mode at chat execution unit. In this case, system modulemay select one display mode based on the display mode included in the system setting and designation information.

142 140 130 140 131 In another modification, in an example where chat execution unitincludes selection of the display mode and system modulealso includes selection of the display mode as system setting, when game execution unitrefers to the system setting, system modulemay select one display mode based on the display mode included in the system setting and designation information.

158 114 158 Though an example where camera image dataused in running chat applicationis used also in a running game application is shown in the description above, camera image datamay be used in one or more other applications, without being limited to the game application.

Though an example in which a plurality of users are executing the communication game is described for the sake of convenience of description, the present disclosure is applicable also off-line and applicable to an example where a single user is playing a game.

Processing for selecting the display mode may be performed in the game application. In this case, the game application may provide the screen for selecting the display mode and accept selection by the user.

It should be understood that the embodiment disclosed herein is illustrative and non-restrictive in every respect. The scope of the present invention is defined by the terms of the claims rather than the description above and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

While certain example systems, methods, devices and apparatuses have been described herein, it is to be understood that the appended claims are not to be limited to the systems, methods, devices and apparatuses disclosed, but on the contrary, are intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.