Foldable Electronic Device and Method for Operating Screen Thereof

c This application is a continuation application, claiming priority under 35 U.S.C. § 365(), of an International application No. PCT/KR2024/008893, filed on June 26, 2024, which is based on and claims the benefit of a Korean patent application number 10-2023-0096358, filed on July 24, 2023, in the Korean Intellectual Property Office, and of a Korean patent application number 10-2023-0117061, filed on September 4, 2023, in the Korean Intellectual Property Office, the disclosure of each of which is incorporated by reference herein in its entirety.

The disclosure relates to a foldable electronic device and a method of operating a screen thereof.

Electronic devices are evolving into structures that extend displays or improving usability thereof, in order to meet the needs of users who desire newer and more diverse functions. For example, a housing structure in which two housings are folded or unfolded along a folding axis may be applied to an electronic device (e.g., foldable electronic device).

A foldable electronic device may have two or more folding axes, thus, a housing and a screen may be divided into three or more sections. For example, the electronic device may include a first folding axis implemented in an in-folding manner, a second folding axis implemented in an out-folding manner, and a display, and a screen of the display may be divided into a first display area, a second display area, and a third display area by the first folding axis and the second folding axis.

The above information is presented as background information only to assist with an understanding of the disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with regard to the disclosure.

A foldable electronic device having at least two folding axes provide various and improved screen usability to a user, beyond simple extension of a display screen, compared to an electronic device having a bar-type housing structure.

However, the foldable electronic device, despite being capable of providing various extension methods unlike existing devices, provides only uniform usability (or environment) in which a screen size or application content is changed according to a size of a display, regardless of a changed structure of the electronic device.

Embodiments of the disclosure need to support various extension scenarios in a foldable electronic device according to a change in a structure or housing structure of the electronic device. However, the issues to be addressed in the disclosure are not limited to the problems mentioned above, and is extended in various ways without departing from the spirit and scope of the disclosure.

Aspects of the disclosure are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the disclosure is to provide a foldable electronic device and a method of operating a screen thereof.

Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the presented embodiments.

In accordance with an aspect of the disclosure, an electronic device is provided. The electronic device includes a second housing, a first housing foldably coupled to one side of the second housing, and a third housing foldably coupled to the other side of the second housing, display including a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing, a sensing device configured to detect a folding or unfolding state of the first housing, the second housing, and the third housing, memory, including one or more storage media, storing instructions, and at least one processor, communicatively coupled to the display, the sensing device, and the memory, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to control the display to display a first execution screen on the display through the first display area in a first state in which the first housing, the second housing, and the third housing are folded relative to each other, control the display to deactivate the first display area and to display a second execution screen through the second display area and the third display area, in a case that the electronic device recognizes, based on data received from the sensing device, that the first state has switched to a second state in which the first housing and the second housing are folded and in which the second housing and the third housing are unfolded, while a first execution screen is displayed through the first display area in the first state, and control the display to display the first execution screen by extending the first execution screen from the first display area to the second display area and the third display area, in a case that the electronic device recognizes, based on data received from the sensing device, that the first state has switched to a third state in which the first housing, the second housing, and the third housing are all unfolded, while the first execution screen is displayed through the first display area in the first state, and wherein the second execution screen is a screen different from the first execution screen.

In accordance with another aspect of the disclosure, a method of operating a screen of a foldable electronic device is provided. The method includes displaying a first execution screen through a display of a first display area disposed in a first housing in a first state in which the first housing, a second housing, and a third housing are folded relative to each other, deactivating the first display area and displaying a second execution screen through a display of a second display area disposed in the second housing and a third display area disposed in the third housing, in a case that the electronic device recognizes that the first state has switched to a second state in which the first housing and the second housing are folded and in which the second housing and the third housing are unfolded, while the first execution screen is displayed through the first display area in the first state, and displaying the first execution screen through a display of the first display area, the second display area, and the third display area, in a case that the electronic device recognizes that the first state has switched to a third state in which the first housing, the second housing, and the third housing are all unfolded, while the first execution screen is displayed through the first display area in the first state, wherein the second execution screen is a screen different from the first execution screen.

In accordance with another aspect of the disclosure, one or more non-transitory computer-readable storage media storing one or more computer programs including computer-executable instruction that, when executed by one or more processors of a foldable electronic device individually or collectively, cause the foldable electronic device to perform operations are provided. The operations include displaying a first execution screen through a display of a first display area disposed in a first housing in a first state in which the first housing, a second housing, and a third housing are folded relative to each other, deactivating the first display area and displaying a second execution screen through a display of a second display area disposed in the second housing and a third display area disposed in the third housing, in a case that the electronic device recognizes that the first state has switched to a second state in which the first housing and the second housing are folded and in which the second housing and the third housing are unfolded, while the first execution screen is displayed through the first display area in the first state, and displaying the first execution screen through a display of the first display area, the second display area, and the third display area, in a case that the electronic device recognizes that the first state has switched to a third state in which the first housing, the second housing, and the third housing are all unfolded, while the first execution screen is displayed through the first display area in the first state, wherein the second execution screen is another screen different from the first execution screen.

Various embodiments provide an electronic device with improved usability by supporting various extension scenarios according to an electronic device state or a housing structure state in a foldable electronic device.

Various embodiments provide convenience for more efficient use of multi-folding.

Other aspects, advantages, and salient features of the disclosure will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses various embodiments of the disclosure.

The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of various embodiments of the disclosure as defined by the claims and their equivalents. It includes various specific details to assist in that understanding but these are to be regarded as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the various embodiments described herein can be made without departing from the scope and spirit of the disclosure. In addition, descriptions of well-known functions and constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are not limited to the bibliographical meanings, but, are merely used by the inventor to enable a clear and consistent understanding of the disclosure. Accordingly, it should be apparent to those skilled in the art that the following description of various embodiments of the disclosure is provided for illustration purpose only and not for the purpose of limiting the disclosure as defined by the appended claims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the” include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to “a component surface” includes reference to one or more of such surfaces.

It should be appreciated that the blocks in each flowchart and combinations of the flowcharts may be performed by one or more computer programs which include computer-executable instructions. The entirety of the one or more computer programs may be stored in a single memory device or the one or more computer programs may be divided with different portions stored in different multiple memory devices.

TM Any of the functions or operations described herein can be processed by one processor or a combination of processors. The one processor or the combination of processors is circuitry performing processing and includes circuitry like an application processor (AP, e.g., a central processing unit (CPU)), a communication processor (CP, e.g., a modem), a graphical processing unit (GPU), a neural processing unit (NPU) (e.g., an artificial intelligence (AI) chip), a wireless-fidelity (Wi-Fi) chip, a Bluetoothchip, a global positioning system (GPS) chip, a near field communication (NFC) chip, connectivity chips, a sensor controller, a touch controller, a finger-print sensor controller, a display drive integrated circuit (IC), an audio CODEC chip, a universal serial bus (USB) controller, a camera controller, an image processing IC, a microprocessor unit (MPU), a system on chip (SoC), an IC, or the like.

1 FIG. is a block diagram illustrating an electronic device in a network environment according to an embodiment of the disclosure.

1 FIG. 101 100 102 198 104 108 199 101 104 108 101 120 130 150 155 160 170 176 177 178 179 180 188 189 190 196 197 178 101 101 176 180 197 160 Referring to, an electronic devicein a network environmentmay communicate with an external electronic devicevia a first network(e.g., a short-range wireless communication network), or at least one of an external electronic deviceor a servervia a second network(e.g., a long-range wireless communication network). According to an embodiment of the disclosure, the electronic devicemay communicate with the external electronic devicevia the server. According to an embodiment of the disclosure, the electronic devicemay include a processor, memory, an input module, a sound output module, a display module, an audio module, a sensor module, an interface, a connecting terminal, a haptic module, a camera module, a power management module, a battery, a communication module, a subscriber identification module (SIM), or an antenna module. In some embodiments of the disclosure, at least one of the components (e.g., the connecting terminal) may be omitted from the electronic device, or one or more other components may be added in the electronic device. In some embodiments of the disclosure, some of the components (e.g., the sensor module, the camera module, or the antenna module) may be implemented as a single component (e.g., the display module).

120 140 101 120 120 176 190 132 132 134 120 121 123 121 101 121 123 123 121 123 121 The processormay execute, for example, software (e.g., a program) to control at least one other component (e.g., a hardware or software component) of the electronic devicecoupled with the processor, and may perform various data processing or computation. According to one embodiment of the disclosure, as at least part of the data processing or computation, the processormay store a command or data received from another component (e.g., the sensor moduleor the communication module) in volatile memory, process the command or the data stored in the volatile memory, and store resulting data in non-volatile memory. According to an embodiment of the disclosure, the processormay include a main processor(e.g., a central processing unit (CPU) or an application processor (AP)), or an auxiliary processor(e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operable independently from, or in conjunction with, the main processor. For example, when the electronic deviceincludes the main processorand the auxiliary processor, the auxiliary processormay be adapted to consume less power than the main processor, or to be specific to a specified function. The auxiliary processormay be implemented as separate from, or as part of the main processor.

123 160 176 190 101 121 121 121 121 123 180 190 123 123 101 108 The auxiliary processormay control at least some of functions or states related to at least one component (e.g., the display module, the sensor module, or the communication module) among the components of the electronic device, instead of the main processorwhile the main processoris in an inactive (e.g., a sleep) state, or together with the main processorwhile the main processoris in an active state (e.g., executing an application). According to an embodiment of the disclosure, the auxiliary processor(e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera moduleor the communication module) functionally related to the auxiliary processor. According to an embodiment of the disclosure, the auxiliary processor(e.g., the neural processing unit) may include a hardware structure specified for artificial intelligence model processing. An artificial intelligence model may be generated by machine learning. Such learning may be performed, e.g., by the electronic devicewhere the artificial intelligence is performed or via a separate server (e.g., the server). Learning algorithms may include, but are not limited to, e.g., supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model may include a plurality of artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-network or a combination of two or more thereof but is not limited thereto. The artificial intelligence model may, additionally or alternatively, include a software structure other than the hardware structure.

130 120 176 101 140 130 132 134 The memorymay store various data used by at least one component (e.g., the processoror the sensor module) of the electronic device. The various data may include, for example, software (e.g., the program) and input data or output data for a command related thererto. The memorymay include the volatile memoryor the non-volatile memory.

140 130 142 144 146 The programmay be stored in the memoryas software, and may include, for example, an operating system (OS), middleware, or an application.

150 120 101 101 150 The input modulemay receive a command or data to be used by another component (e.g., the processor) of the electronic device, from the outside (e.g., a user) of the electronic device. The input modulemay include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

155 101 155 The sound output modulemay output sound signals to the outside of the electronic device. The sound output modulemay include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as playing multimedia or playing record. The receiver may be used for receiving incoming calls. According to an embodiment of the disclosure, the receiver may be implemented as separate from, or as part of the speaker.

160 101 160 160 The display modulemay visually provide information to the outside (e.g., a user) of the electronic device. The display modulemay include, for example, a display, a hologram device, or a projector and control circuitry to control a corresponding one of the display, hologram device, and projector. According to an embodiment of the disclosure, the display modulemay include a touch sensor adapted to detect a touch, or a pressure sensor adapted to measure the intensity of force incurred by the touch.

170 170 150 155 102 101 The audio modulemay convert a sound into an electrical signal and vice versa. According to an embodiment of the disclosure, the audio modulemay obtain the sound via the input module, or output the sound via the sound output moduleor a headphone of an external electronic device (e.g., the external electronic device) directly (e.g., wiredly) or wirelessly coupled with the electronic device.

176 101 101 176 The sensor modulemay detect an operational state (e.g., power or temperature) of the electronic deviceor an environmental state (e.g., a state of a user) external to the electronic device, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment of the disclosure, the sensor modulemay include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

177 101 102 177 The interfacemay support one or more specified protocols to be used for the electronic deviceto be coupled with the external electronic device (e.g., the external electronic device) directly (e.g., wiredly) or wirelessly. According to an embodiment of the disclosure, the interfacemay include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

178 101 102 178 A connecting terminalmay include a connector via which the electronic devicemay be physically connected with the external electronic device (e.g., the external electronic device). According to an embodiment of the disclosure, the connecting terminalmay include, for example, a HDMI connector, a USB connector, a SD card connector, or an audio connector (e.g., a headphone connector).

179 179 The haptic modulemay convert an electrical signal into a mechanical stimulus (e.g., a vibration or a movement) or electrical stimulus which may be recognized by a user via his tactile sensation or kinesthetic sensation. According to an embodiment of the disclosure, the haptic modulemay include, for example, a motor, a piezoelectric element, or an electric stimulator.

180 180 The camera modulemay capture a still image or moving images. According to an embodiment of the disclosure, the camera modulemay include one or more lenses, image sensors, image signal processors, or flashes.

188 101 188 The power management modulemay manage power supplied to the electronic device. According to one embodiment of the disclosure, the power management modulemay be implemented as at least part of, for example, a power management integrated circuit (PMIC).

189 101 189 The batterymay supply power to at least one component of the electronic device. According to an embodiment of the disclosure, the batterymay include, for example, a primary cell which is not rechargeable, a secondary cell which is rechargeable, or a fuel cell.

190 101 102 104 108 190 120 190 192 194 198 199 192 101 198 199 196 TM The communication modulemay support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic deviceand the external electronic device (e.g., the external electronic device, the external electronic device, or the server) and performing communication via the established communication channel. The communication modulemay include one or more communication processors that are operable independently from the processor(e.g., the application processor (AP)) and supports a direct (e.g., wired) communication or a wireless communication. According to an embodiment of the disclosure, the communication modulemay include a wireless communication module(e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module(e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules may communicate with the external electronic device via the first network(e.g., a short-range communication network, such as Bluetooth, wireless-fidelity (Wi-Fi) direct, or infrared data association (IrDA)) or the second network(e.g., a long-range communication network, such as a legacy cellular network, a fifth generation (5G) network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or wide area network (WAN)). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multi components (e.g., multi chips) separate from each other. The wireless communication modulemay identify and authenticate the electronic devicein a communication network, such as the first networkor the second network, using subscriber information (e.g., international mobile subscriber identity (IMSI)) stored in the subscriber identification module.

192 192 192 192 101 104 199 192 164 bps d ms The wireless communication modulemay support a 5G network, after a fourth generation (4G) network, and next-generation communication technology, e.g., new radio (NR) access technology. The NR access technology may support enhanced mobile broadband (eMBB), massive machine type communications (mMTC), or ultra-reliable and low-latency communications (URLLC). The wireless communication modulemay support a high-frequency band (e.g., the millimeter wave (mmWave) band) to achieve, e.g., a high data transmission rate. The wireless communication modulemay support various technologies for securing performance on a high-frequency band, such as, e.g., beamforming, massive multiple-input and multiple-output (massive MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication modulemay support various requirements specified in the electronic device, an external electronic device (e.g., the external electronic device), or a network system (e.g., the second network). According to an embodiment of the disclosure, the wireless communication modulemay support a peak data rate (e.g., 20Gor more) for implementing eMBB, loss coverage (e.g.,B or less) for implementing mMTC, or U-plane latency (e.g., 0.5ms or less for each of downlink (DL) and uplink (UL), or a round trip of 1or less) for implementing URLLC.

197 101 197 197 198 199 190 192 190 197 The antenna modulemay transmit or receive a signal or power to or from the outside (e.g., the external electronic device) of the electronic device. According to an embodiment of the disclosure, the antenna modulemay include an antenna including a radiating element including a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment of the disclosure, the antenna modulemay include a plurality of antennas (e.g., array antennas). In such a case, at least one antenna appropriate for a communication scheme used in the communication network, such as the first networkor the second network, may be selected, for example, by the communication module(e.g., the wireless communication module) from the plurality of antennas. The signal or the power may then be transmitted or received between the communication moduleand the external electronic device via the selected at least one antenna. According to an embodiment of the disclosure, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as part of the antenna module.

197 According to various embodiments of the disclosure, the antenna modulemay form a mmWave antenna module. According to an embodiment of the disclosure, the mmWave antenna module may include a printed circuit board, a RFIC disposed on a first surface (e.g., the bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a designated high-frequency band (e.g., the mmWave band), and a plurality of antennas (e.g., array antennas) disposed on a second surface (e.g., the top or a side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the designated high-frequency band.

At least some of the above-described components may be coupled mutually and communicate signals (e.g., commands or data) therebetween via an inter-peripheral communication scheme (e.g., a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)).

101 104 108 199 102 104 101 101 102 104 108 101 101 101 101 101 104 108 104 108 199 101 According to an embodiment of the disclosure, commands or data may be transmitted or received between the electronic deviceand the external electronic devicevia the servercoupled with the second network. Each of the external electronic devicesormay be a device of a same type as, or a different type, from the electronic device. According to an embodiment of the disclosure, all or some of operations to be executed at the electronic devicemay be executed at one or more of the external electronic devicesor, or the server. For example, if the electronic deviceshould perform a function or a service automatically, or in response to a request from a user or another device, the electronic device, instead of, or in addition to, executing the function or the service, may request the one or more external electronic devices to perform at least part of the function or the service. The one or more external electronic devices receiving the request may perform the at least part of the function or the service requested, or an additional function or an additional service related to the request, and transfer an outcome of the performing to the electronic device. The electronic devicemay provide the outcome, with or without further processing of the outcome, as at least part of a reply to the request. To that end, a cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic devicemay provide ultra low-latency services using, e.g., distributed computing or mobile edge computing. In another embodiment of the disclosure, the external electronic devicemay include an Internet-of-things (IoT) device. The servermay be an intelligent server using machine learning and/or a neural network. According to an embodiment of the disclosure, the external electronic deviceor the servermay be included in the second network. The electronic devicemay be applied to intelligent services (e.g., a smart home, a smart city, a smart car, or healthcare) based on 5G communication technology or IoT-related technology.

An electronic device according to embodiments disclosed in this document may be implemented in various forms. The electronic device may include, for example, a portable communication device (e.g., smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to embodiments of this document is not limited to the above-described devices.

Hereinafter, the term “state” may refer to a structural form or shape of an electronic device or a component (e.g., display, foldable housing structure) thereof according to an embodiment of the disclosure.

2 2 2 2 FIGS.A,B,C, andD illustrate a structure of a foldable electronic device according to various embodiments of the disclosure.

2 2 2 2 FIGS.A,B,C, andD 1 FIG. 2 2 2 2 FIGS.A,B,C, andD 1 FIG. 201 101 101 101 Referring to, an electronic device(e.g., the electronic deviceof) according to an embodiment of the disclosure may be implemented as a multi-foldable electronic device (e.g., Z-shaped foldable device) including a housing structure of an out-folding manner and an in-folding manner. An electronic deviceillustrated inmay include the constitution and function of the electronic deviceof.

101 210 220 230 240 250 240 210 220 210 220 250 220 230 230 220 240 210 220 250 220 230 The electronic deviceaccording to an embodiment of the disclosure may include a first housing, a second housing, a third housing, a first hinge assembly, and a second hinge assembly. The first hinge assemblymay be configured to couple the first housingand the second housingand allow the first housingto rotate relative to the second housing. The second hinge assemblymay be configured to couple the second housingand the third housingand allow the third housingto rotate relative to the second housing. For example, the first hinge assemblymay be implemented to couple the first housingand the second housingin an out-folding manner, and the second hinge assemblymay be implemented to couple the second housingand the third housingin an in-folding manner.

101 260 210 220 230 260 210 240 220 250 230 260 260 101 According to an embodiment of the disclosure, the electronic devicemay include a displaydisposed within a space formed by the first housing, the second housing, and the third housing. The displaymay be disposed to extend from the first housingto the first hinge assembly, the second housing, the second hinge assembly, and the third housing. For example, in this document, a first surface on which the displayis disposed may be defined as a front surface, and a second surface, which is opposite to the first surface and on which the displayis not disposed, may be defined as a rear surface. Further, a third surface surrounding a space between the first surface and the second surface may be defined as a side surface of the electronic device.

260 The displaymay be flexible at least in part and be implemented as a flexible display.

260 261 210 262 220 263 230 For example, the displaymay include a first display areapositioned in the first housing, a second display areapositioned in the second housing, and a third display areapositioned in the third housing.

260 210 220 250 230 For another example, the displaymay be implemented as a first display positioned in the first housingand a second display positioned from the second housingto the second hinge assemblyand the third housing.

260 210 220 230 As another example, the displaymay be implemented as a first display positioned in the first housing, a second display positioned in the second housing, and a third display positioned in the third housing.

240 210 220 261 262 250 220 230 262 263 The first hinge assemblymay be implemented in an out-folding manner in which the first housingand the second housingare folded about a first folding axis A such that the first display areaand the second display areaface in opposite directions. The second hinge assemblymay be implemented in an in-folding manner in which the second housingand the third housingare folded about a second folding axis B such that the second display areaand the third display areaface each other.

2 FIG.A 210 220 230 101 A structure ofmay be in an intermediate state in a process in which the housings,, andof the electronic deviceare all switched from a folding state to an unfolding state.

2 FIG.B 2 FIG.B 210 220 230 101 261 262 263 260 A structure ofmay be in a state in which the housings,, andof the electronic deviceare all unfolded. In the structure of, the display areas,, andof the displaymay be all exposed to the outside in a first direction ① (or top direction). In this document, the first direction ① may refer to a direction in which a user views the display, and a second direction ② (or bottom direction) may refer to a direction opposite to the first direction ①.

2 2 FIGS.A orB 210 220 230 101 261 262 263 As illustrated in, in the case that all of the housings,, andof the electronic deviceare in an intermediate state or in an unfolded state, an active area may be determined as the first display area, the second display area, and the third display area.

2 FIG.C 2 FIG.B 2 FIG.C 2 FIG.C 220 230 210 220 261 262 263 210 220 230 220 262 263 261 261 A structure ofmay be in a state in which the second housingand the third housingare unfolded and in which the first housingis out-folded with respect to the second housing. When the structure ofis switched to the structure of, the first display areamay be switched from the first direction ① to the second direction ②, and the second display areaand the third display areamay be exposed to the outside in the first direction ①. As illustrated in, in the case that the first housingis in an out-folded state with respect to the second housingand that the third housingis in an intermediate state or an unfolded state with respect to the second housing, the active area may be determined as the second display areaand the third display area, and the first display areamay be switched to a deactivated state (e.g., a screen-off state by stopping power supply to the first display area, a dimming state, a power-saving state, or a touch detection blocking state).

2 FIG.D 2 FIG.D 2 FIG.D 210 220 230 101 261 262 263 261 262 263 262 263 A structure ofmay be in a state in which the housings,, andof the electronic deviceare all folded. In the structure of, the first display areamay be exposed to the outside in the first direction ①, and the second display areaand the third display areamay face each other without being exposed to the outside. In the structure of, the first display areamay be determined as an active area, and the second display areaand the third display areamay be switched to a deactivated state (e.g., a screen-off state by stopping power supply to the second display areaand the third display area, a dimming state, a power-saving state, a sleep mode, or a touch detection blocking state).

3 FIG. is a block diagram illustrating an electronic device according to an embodiment of the disclosure.

3 FIG. 1 FIG. 2 2 2 2 FIGS.A,B,C, andD 2 2 2 2 FIGS.A,B,C, andD 3 FIG. 1 FIG. 101 101 101 101 Referring to, an electronic device (e.g., the electronic deviceof, the electronic deviceof) according to an embodiment is a portable electronic device and may have a housing structure of the multi-foldable electronic device of. An electronic deviceillustrated inmay include at least some of constitutions and functions of the electronic deviceof.

101 310 315 317 320 330 340 350 360 For example, the electronic devicemay include a display, a display controller, a frame buffer, a processor (e.g., a central processor (CPU)), memory, a communication interface, an input device, and a sensing device.

310 320 330 340 350 360 104 108 160 120 130 190 150 176 104 108 370 1 FIG. 1 FIG. 3 FIG. 1 FIG. The display, the processor(e.g., CPU), the memory, the communication interface, the input device, the sensing device, the external electronic device, and the serverare implemented in substantially the same manner as the display module, the processor, the memory, the communication module, the input module, the sensor module, the external electronic device, and the serverof, respectively, so that they may perform the same functions; thus, a redundant description of functions thereof will be omitted, and hereinafter, operations other than the constitutions and functions disclosed inwill be described. The components illustrated inormay transmit and receive (or communicate, exchange) data with each other through a system bus.

315 310 101 320 123 315 360 370 315 317 330 1 FIG. 1 FIG. The display controller(e.g., display driver IC (DDI)) controls the displayand may receive, for example, video information (e.g., video data, or an video control signal corresponding to a command for controlling the video data) from another component of the electronic device. For example, video information may be received from the central processor or processor(e.g., the main processor or the application processor of) or an auxiliary processor (e.g., the auxiliary processorof) (e.g., graphics processor)). The display controllermay communicate with the sensing devicevia the system bus. The display controllermay store at least a portion of video information in the frame bufferor the memory, for example, in units of frames.

315 The display controllermay control the display to output visual information to the display based on video information. The visual information may include graphics, text, icons, videos, images, and combinations thereof.

101 310 310 101 310 261 262 263 101 261 262 263 2 2 2 2 FIGS.A,B,C, andD According to an embodiment of the disclosure, the electronic devicemay control driving of the displaythrough a plurality of display controllers (e.g., display driver ICs (DDIs)). For example, in the case that the displayis implemented as a first display and a second display, the electronic devicemay control the first display through a first DDI, and control the second display through a second DDI. For another example, in the case that the displayincludes a first display area, a second display area, and a third display area, as illustrated in, the electronic devicemay be implemented to control the first display areathrough the first DDI, and to control the second display areaand the third display areathrough the second DDI.

360 210 220 230 361 362 363 364 365 366 101 2 2 2 2 FIGS.A,B,C, andD The sensing devicemay include sensors for generating data necessary for determining a folding/unfolding angle between the housings,, andillustrated inand an electronic device state (or housing structure state), and movement information (e.g., direction, posture, or position) of the electronic device. For example, the sensing device may include a time of flight (TOF) sensor, a folding sensor, a light sensor, a Hall sensor, a motion sensor, and a touch screen panel (TSP) sensor, but these are only examples, and some thereof may be omitted, or may include other sensors for determining the electronic device state (or housing structure state) or the movement of the electronic devicein addition to the illustrated sensors.

360 210 220 230 364 362 320 According to an embodiment of the disclosure, the sensing devicemay sense an angle (e.g., folding angle) between the housings,, andusing the Hall sensorand/or the folding sensor, and deliver sensed angle information to the processor.

362 210 220 230 101 210 220 230 362 210 220 230 362 364 2 2 2 2 FIGS.A,B,C, andD According to an embodiment of the disclosure, the folding sensormay calculate an angle of the housings,, and. For example, in the case that the electronic deviceis implemented as the multi-foldable housing structures,, andof, the folding sensormay calculate an angle between the housings using data representing the movement of the first housing, the second housing, or the third housing. The folding sensormay receive data corresponding to the strength of a magnetic field from the Hall sensorattached to the hinge assembly, and calculate an angle using the received data.

362 101 362 362 The folding sensormay recognize a structural state of the electronic deviceor a housing structural state (e.g., unfolded state, folded state, or intermediate state) based on the calculated angle. For example, the folding sensormay determine the electronic device (or the housing structure) state as a folded state in the case that the calculated angle is between about 0 degrees and about 10 degrees, and determine the electronic device (or the housing structure) state as an unfolded state in the case that the calculated angle is about 180 degrees. The folding sensormay determine the electronic device (or the housing structure) state as an intermediate state in the case that the angle is between about 10 degrees and about 179 degrees.

364 362 320 364 364 According to an embodiment of the disclosure, the Hall sensormay generate data used for calculating a direction in which a force is applied to the housing structure and/or an angle between the housing structures or determining whether the housing structure is open or closed, and output the data to the folding sensoror the processor. For example, the Hall sensormay measure the strength of a magnetic field and generate data corresponding to the measured magnetic field strength. The Hall sensormay be attached to the hinge assembly or disposed in an internal space of the housing.

101 210 220 230 364 240 250 320 364 320 2 2 2 2 FIGS.A,B,C, andD For example, in the case that the electronic deviceis implemented as the multi-foldable housing structures,, andof, the Hall sensormay include a first Hall sensor attached to the first hinge assemblyand a second Hall sensor attached to the second hinge assembly. The processormay determine an angle between the housings based on data received from the Hall sensor. The processormay determine whether the foldable housing structure is open or closed and a state thereof based on the determined angle.

330 320 320 The memorymay store various instructions that may be executed by the processor. Such instructions may include arithmetic and logical operations, data movement, or control commands, such as input/output that may be recognized by the processor.

320 101 The processormay be operatively, functionally, and/or electrically connected to each component of the electronic deviceand be a component that may perform computation or data processing related to control and/or communication of each component.

101 In an embodiment of the disclosure, the hardware of the electronic devicebeing operatively connected may mean that a direct or indirect connection, either wired or wireless, is established between hardware components, such that second hardware is controlled by first hardware among them.

320 101 There is no limitation on computation and data processing functions that the processormay implement on the electronic device, but hereinafter, operations that provide various screen extension scenarios according to changes in the electronic device structure state or housing structure in a foldable electronic device will be described.

320 330 Operations of the processorto be described later may be performed by loading instructions stored in the memory.

101 220 210 220 230 220 The electronic deviceaccording to an embodiment of the disclosure may include a second housing, a first housingfoldably coupled to one side of the second housing, and a third housingfoldably coupled to the other side of the second housing.

101 260 310 261 210 262 220 263 230 The electronic deviceaccording to an embodiment of the disclosure may include displaysandincluding a first display areadisposed in the first housing, a second display areadisposed in the second housing, and a third display areadisposed in the third housing.

101 360 210 220 230 The electronic deviceaccording to an embodiment of the disclosure may include a sensing devicefor detecting a folding or unfolding state of the first housing, the second housing, and the third housing.

101 130 330 120 320 130 330 The electronic deviceaccording to an embodiment of the disclosure may include memoriesandthat store executable instructions and processorsandthat access the memoriesandand execute the instructions.

120 320 210 220 230 According to an embodiment of the disclosure, the processorsandmay be configured to display a first execution screen on the display using a first display area in a first state in which the first housing, the second housing, and the third housingare folded relative to each other.

261 120 320 360 210 220 220 230 120 320 261 262 263 According to an embodiment of the disclosure, while the first execution screen is displayed through the first display areain the first state, in the case that the processorsandrecognize, based on data received from the sensing device, that the first state has switched to a second state in which the first housingand the second housingare folded and the second housingand the third housingare unfolded, the processorsandmay be configured to deactivate the first display areaand display a second execution screen on the display through the second display areaand the third display area.

261 120 320 360 210 220 230 120 320 261 262 263 According to an embodiment of the disclosure, while the first execution screen is displayed through the first display areain the first state, in the case that the processorsandrecognize, based on data received from the sensing device, that the first state has switched to a third state in which the first housing, the second housing, and the third housingare all unfolded, the processorsandmay be configured to display the first execution screen on the display by extending the first execution screen from the first display areato the second display areaand the third display area.

The second execution screen may be characterized as being a different screen from the first execution screen.

101 240 210 220 250 The electronic deviceaccording to an embodiment of the disclosure may further include a first hinge assemblyconfigured such that the first housingis folded in a first direction relative to the second housing, and a second hinge assemblyconfigured such that the third housing is folded in a second direction opposite to the first direction relative to the second housing.

240 210 220 250 220 230 According to an embodiment of the disclosure, the first hinge assemblymay be implemented such that the first display area and the second display area are opposite to each other when the first housingand the second housingare folded in an out-folding manner, and the second hinge assemblymay be implemented such that the second display area and the third display area face each other when the second housingand the third housingare folded in an in-folding manner.

260 310 261 210 262 220 263 230 According to an embodiment of the disclosure, the displaysandmay include a first display including a first display areadisposed in the first housing, and a second display including a second display areadisposed in the second housingand a third display areadisposed in the third housing.

260 310 261 210 262 220 263 230 According to an embodiment of the disclosure, the displaysandmay include a first display including a first display areadisposed in the first housing, a second display including a second display areadisposed in the second housing, and a third display including a third display areadisposed in the third housing.

261 262 263 According to an embodiment of the disclosure, the first state may be a state in which the first display areais exposed to the outside in the first direction, and the second state may be a state in which the first display area is switched in a second direction opposite to the first direction and in which the second display areaand the third display areaare exposed to the outside in the first direction.

120 320 261 262 263 261 262 263 According to an embodiment of the disclosure, the processorsandmay, as an operation of deactivating the first display areaand displaying the second execution screen through the second display areaand the third display area, be further configured to display a preview window corresponding to the first execution screen displayed through the first display areaon at least a portion of the second display areaand the third display areain the first state.

120 320 According to an embodiment of the disclosure, the processorsandmay be configured to display a preview window corresponding to the first execution screen in the form of a notification state window (notification bar or panel) or a picture in picture (PIP) pop-up.

120 320 261 262 263 120 320 261 262 263 According to an embodiment of the disclosure, while the processorsanddeactivate the first display areaand display the second execution screen through the second display areaand the third display areain the second state, and in the case of recognizing, based on data received from the sensing device, that the second state has switched to the third state in which the housings are all unfolded, the processorsandmay be configured to display the first execution screen through the first display areaand display the second execution screen through the second display areaand the third display area.

120 320 According to an embodiment of the disclosure, the processorsandmay be configured to group, by electronic device state, and store information on apps (or applications, hereinafter, App) executed in the first state, information on apps executed in the second state, and information on apps executed in the third state.

120 320 261 262 263 261 According to an embodiment of the disclosure, the processorsandmay, as an operation of displaying the first execution screen on the first display areaand the second execution screen on the second display areaand the third display area, be further configured to display a home screen or a recent task list as the first execution screen while maintaining the second execution screen, in the case that there is no application related to the first display areaand that an application related to the second execution screen is initialized or restarted upon a change in resolution.

120 320 261 262 263 261 262 263 261 According to an embodiment of the disclosure, the processorsandmay, as an operation of displaying the first execution screen on the first display areaand displaying the second execution screen on the second display areaand the third display areain the third state, be further configured to omit display of the first execution screen and to resize and display the second execution screen in a size corresponding to the first display area, the second display area, and the third display area, in the case that there is no application related to the first display areaand that an application related to the second execution screen is not initialized or restarted upon a change in resolution.

According to an embodiment of the disclosure, the home screen or the recent task list displayed on the first display area may be configured to display, overlapping an app object, at least one of a first type indicator that guides an executable electronic device state for each app object, or a second type indicator that guides that the app may be restarted or initialized when switching from a background to a foreground.

120 320 According to an embodiment of the disclosure, the processorsandmay be configured to display applications executed in an electronic device state different from a currently recognized electronic device state in a grouped form when displaying a recent task list on the display.

120 320 According to an embodiment of the disclosure, the processorsandmay be configured to reconstitute a widget screen or recent app search screen with information on apps executed in a currently recognized electronic device state or housing structure state and display the reconstructed widget screen or recent app search screen on the display when displaying the widget screen or recent app search screen on the display.

4 FIG. is a diagram illustrating a module configuration of an electronic device according to an embodiment of the disclosure.

4 FIG. 1 FIG. 2 2 2 2 3 FIGS.A,B,C, andD, and 4 FIG. 1 FIG. 3 FIG. 1 FIG. 3 FIG. 1 FIG. 101 101 120 320 120 130 330 180 Referring to, the electronic device (e.g., the electronic deviceof,) according to an embodiment of the disclosure may be including various software modules. A configuration of an electronic deviceillustrated inmay be understood as a function performed by a processor (e.g., the processorofor the processorof) (or CPU). The processormay execute instructions stored in memory (e.g., the memoryof, the memoryof) so as to implement a software module, and control hardware (e.g., the camera moduleof) associated with the function.

4 FIG. Some of the modules inmay be implemented in hardware, while others may be implemented in software. The modules may be classified into an application layer, a framework layer, a hardware abstraction layer (HAL), a kernel driver layer, and/or a hardware (HW) layer, and at least some of the illustrated components may be changed.

101 410 415 420 421 423 425 426 427 428 430 435 440 445 101 450 455 The electronic devicemay include at least one of an application, a setting manager, a window manager, a view system, a package manager, a folding state manager, a sensor manager, a display manager, an activity manager, an event hub, a surface flinger, a sensor driver, or a display controller(e.g., display driver IC controller). The electronic devicemay further include a sensor controllerand a display panelin the hardware layer.

410 410 1 2 3 101 410 421 The applicationmay be an application(e.g., app, app, app) stored in the memory of the electronic deviceor executable or installed by the processor. Visual information corresponding to the applicationmay be displayed on the display through the view system.

415 The setting managermay determine a layout configuration of the execution screen according to the system policy and the user's configuration.

410 410 The framework layer may provide various functions to the applicationso that functions or information provided from one or more resources of the electronic device may be used by the application.

420 420 455 425 420 101 410 The window managermay manage graphic user interface (GUI) resources using on the screen. The window managermay constitute a window or execution screen to be displayed on the display panelbased on the electronic device state (or housing structure state) delivered from the folding state manager, and provide a function of controlling drawing and viewing for the window. The window managermay deliver information on the display area of the electronic deviceto the application.

421 421 The view systemmay include a set of scalable views used for creating an application user interface. For example, the view systemmay be a program for drawing at least one layer based on the resolution of the display area of the display.

423 The package managermay manage the installation of application packages, or, more simply, applications.

425 420 425 The folding state managermay analyze sensor events delivered through the sensor manager to determine the electronic device state (or housing structure state) and deliver electronic device structure state information to the window manager. The folding state managermay control the application state according to the electronic device structure state.

426 410 426 426 The sensor managermay control the sensor based on the configuration of the application. For example, in that case that a user's touch input occurs, the sensor managermay control the touch sensor to generate touch data. For example, the sensor managermay instruct the sensor to generate touch data corresponding to a touch press (touch press, touch down, touch contact) signal, a touch drag (touch drag or touch movement) signal, and/or a touch release (touch up, touch release) signal in response to the user's touch.

427 The display managermay determine whether to activate or deactivate the display, manage visual information displayed on the display, and define an execution screen (or window) (e.g., as a component at a frame level, which may be referred to as a logical display screen) viewed to the user based on information delivered from the view system.

428 410 The activity managermay control a lifecycle and activity stack of the application.

430 430 101 The event hubmay be an interface module that standardizes events occurring in touch circuits and sensors. The event hubmay be included in an abstraction layer (hardware abstraction layer (HAL)) between a plurality of hardware modules included in the hardware layer and software of the electronic device.

435 435 445 445 The surface flingermay synthesize multiple layers and store synthesized information in a frame buffer. For example, the surface flingermay provide data representing the synthesized multiple layers to the display controller(e.g., DDI). The display controllermay refer to a graphic display controller or a display driving circuit controller.

101 440 450 445 455 The kernel layer may include various drivers for controlling various hardware modules included in the electronic device. For example, the kernel layer may include, but is not limited to, the sensor driverfor controlling the sensor controllerconnected to a sensor, and the display controllerfor controlling the display panel.

440 440 450 The sensor drivermay connect the operating system and the sensor, and include information on a driving method, feature, and/or function of the sensor. The sensor drivermay include an interface module that controls the sensor controllerconnected to the sensor.

445 435 445 455 455 The display controllermay receive data representing multiple layers synthesized by the surface flinger. The display controllermay control the display panelbased on data stored in the frame buffer. Graphic information may be displayed through the display panel.

5 FIG. 2 2 2 2 FIGS.A,B,C, andD 261 210 262 220 263 230 is a diagram illustrating operations for differently operating a screen extension scenario based on a state of a foldable electronic device of an out-folding manner and an in-folding manner according to an embodiment of the disclosure. In the following drawings, a housing in which the first display areais disposed may be understood as the first housingin, a housing in which the second display areais disposed may be understood as the second housing, and a housing in which the third display areais disposed may be understood as the third housing.

5 FIG. 101 Referring to, according to an embodiment of the disclosure, the electronic devicemay support a function of differently applying a screen extension sequence according to an unfolding order or state change order of a multi-housing structure.

501 210 220 230 503 505 507 As illustrated in, the electronic device may be switched from a first state in which the housings,, andare all folded to a second state of, and then to a third state of, or may be switched directly from the first state to a third state of.

101 261 210 510 261 101 510 262 263 In the first state, the electronic devicemay determine the first display areapositioned in the first housingas an active area and display a first execution screenon the first display area. The electronic devicemay render the first execution screento a size corresponding to the first display area (hereinafter, a first size or a first resolution). In the first state, the second display areaand the third display areamay be deactivated (e.g., a screen-off state by stopping power supply, a dimming state, a power-saving state, or a sleep mode).

101 In some cases, when the electronic deviceis in the first state, the first display area may also be operated in a sleep mode in which it is deactivated.

101 501 503 502 101 503 176 360 503 101 261 262 263 101 520 262 263 1 FIG. 3 FIG. As a first screen operation method, the electronic devicemay be changed from the first state ofto the second state ofthrough an intermediate state of. The electronic devicemay recognize that the first state is changed (or switched) to the second state based on data received from the sensing device of(e.g., the sensor moduleof, the sensing deviceof). Based on recognition of the second state of, the electronic devicemay switch the first display areato be deactivated and determine the second display areaand the third display areaas active areas. The electronic devicemay display a second execution screenon the second display areaand the third display areain the second state.

520 510 520 The second execution screenmay refer to a screen defined through a layer/window different from the first execution screen. The second execution screenmay be rendered according to a size (hereinafter, a second size or a second resolution) corresponding to the second display area and the third display area.

503 504 505 101 261 510 261 520 262 263 After being changed to the second state of, the electronic device may be changed from an intermediate state ofto a third state of. The electronic devicemay recognize that the second state has changed to the third state based on data received from the sensing device, determine the first display areaas an active area based on recognition of the third state, and control to display the first execution screenon the first display area, and to display the second execution screenon the second display areaand the third display area.

101 501 507 506 101 501 101 262 263 510 1 510 261 262 263 101 510 1 As a second screen operation method, the electronic devicemay be changed from the first state ofto the third state ofthrough an intermediate state of. The electronic devicemay recognize the change from the first state to the third state based on data received from the sensing device. Based on the change from the first state ofto the third state, the electronic devicemay determine the second display areaand the third display areaas active areas, and display a first execution screen-of the third size (or third resolution) by extending the size of the first execution screento a size suitable for the first display area, the second display area, and the third display area. The electronic devicemay render the first execution screen-according to the third size or the third resolution.

6 FIG. 7 7 7 FIGS.A,B, andC 8 FIG. 7 7 7 FIGS.A,B, andC is a flowchart illustrating a method of operating a screen of a foldable electronic device according to an embodiment of the disclosure.illustrate screens in an order in which an electronic device is changed from a first state to a second state and from the second state to a third state according to various embodiments of the disclosure, andillustrates a screen in an order in which an electronic device is changed from a first state to a third state according to an embodiment of the disclosure. Referring to, a first direction ① may mean a direction in which the user views the display, and a second direction (② or bottom direction) may mean a direction opposite to the first direction ①.

In the following embodiments of the disclosure, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

6 FIG. 1 FIG. 3 FIG. 1 FIG. 3 FIG. 120 320 101 210 220 230 101 176 360 610 Referring to, a processor (e.g.,ofof) of the electronic deviceaccording to an embodiment of the disclosure may recognize a first state in which the housings,, andof the electronic deviceare all folded based on data received from a sensing device (e.g., the sensor moduleof, the sensing deviceof) in operation.

620 120 710 261 101 In operation, the processormay display a first execution screenon the first display areabased on the electronic devicestate or housing structure state being recognized as a first state.

701 210 220 220 230 261 262 263 220 230 2 FIG.D For example, as illustrated in, the first state may be a state in which the first housingand the second housingare out-folded and in which the second housingand the third housingare in-folded. In the first state, the first display areamay be exposed in the first direction (e.g., ① of), and the second display areaand the third display areamay be positioned to face each other due to an in-folding operation of the second housingand the third housing.

120 210 261 220 262 120 101 The processormay calculate an angle (hereinafter, “first angle”) between the first housingin which the first display areais positioned and the second housingin which the second display areais disposed, and an angle (hereinafter, “second angle”) between the second housing in which the second display area is disposed and the third housing in which the third display area is disposed based on data received from the sensing device. The processormay recognize a state of the electronic deviceor a state of the housing structure based on at least one of the first angle or the second angle.

120 261 262 263 262 263 The processormay determine the first display areaas an active area based on recognition of the first state, and deactivate the second display areaand the third display area(e.g., a screen-off state by stopping power supply to the second display areaand the third display areaof the display, a dimming state, a power-saving state, or a touch detection blocking state).

710 261 710 For example, the first execution screenis a screen defined according to the first size (or first resolution) of the first display area, and may be, for example, a home screen or an application execution screen according to the configuration of the electronic device. For example, the first execution screenmay have the first size.

710 101 In an embodiment of the disclosure, the first execution screenmay be provided as the most recently used application execution screen in the foreground when the electronic deviceis in the first state, but is not limited thereto.

7 FIG.A 261 262 263 101 101 262 263 According to an embodiment of the disclosure, in, at least a portion of one display is defined as a first display area, but in some cases, the first display areamay be implemented as a first display, and the second display areaand the third display areamay be implemented as a second display. In the case that the electronic deviceincludes a first display and a second display, when the electronic deviceis in the first state, the first display may be activated, and the second display may be deactivated (e.g., a screen-off state by stopping power supply to the second display or a sleep mode), thereby causing the second display areaand the third display areato be deactivated.

630 120 101 In operation, the processormay determine a structural change of the electronic device(or a change in the state of the electronic device, a change in the state of the display, a change in the structure of the housing).

101 101 101 For example, the electronic devicemay be classified into a case that the state of the electronic deviceor the state of the housing structure changes from a first state to a second state and a case that the state of the electronic deviceor the state of the housing structure changes from the first state to a third state.

640 120 101 In operation, the processormay recognize that the structure of the electronic deviceor the housing is changed from a first state to a second state.

702 120 220 230 210 220 For example, as illustrated in, the processormay recognize that the first state has changed to the second state based on the second angle being changed to a threshold angle value (e.g., about 170 degrees) or more while the first angle is maintained at about 0 degrees to about 10 degrees (or the second housingand the third housingare changed to an unfolded state while out-folding of the first housingand the second housingis maintained).

650 120 261 262 263 120 720 262 263 In operation, the processormay, based on recognition of the second state, deactivate the first display area(e.g., a screen-off state by stopping power supply to at least a part of the display, a dimming state, a power-saving state, or a touch detection blocking state) and determine the second display areaand the third display areaas active areas. The processormay display a second execution screenon the second display areaand the third display areadetermined as active areas.

702 720 The first direction ① ofmay be a direction in which the second execution screenis exposed, which may be a direction in which the user views the electronic device, and the second direction ② may be a direction opposite to the first direction ①, which may be a bottom direction in which the user cannot view the electronic device.

720 710 720 720 262 263 The second execution screenmay refer to a screen defined through a layer/window different from the first execution screen. The second execution screenmay be a home screen or an application execution screen. The second execution screenmay have a second size or second resolution including a second display areaand a third display area.

720 101 In an embodiment of the disclosure, the second execution screenmay be provided as the most recently used application execution screen in the foreground when the electronic deviceis in the second state, but is not limited thereto.

261 701 702 710 As the first display areawhose disposition position is switched from the first direction ① as into the second direction ② as inis deactivated, entry into a dimming mode and touch detection may be blocked, and an application related to the first execution screenmay not be paused and may be executed in the background.

101 703 101 720 262 263 7 FIG.B According to an embodiment of the disclosure, the electronic devicemay support a function of providing a first execution screen as a preview window when the electronic device is in a second state. The preview window may be provided as a part of a notification state window (notification bar or panel), but may also be provided in the form of a pop-up of a picture in picture (PIP). For example, as illustrated inof, the electronic devicemay be operated by displaying the second execution screenon the second display areaand the third display area.

101 720 730 730 720 101 710 730 101 710 The electronic devicemay operate the second execution screenin the second state, and call a notification state windowby overlapping the notification state windowon the second execution screenbased on reception of an input requesting display of the first execution screen (e.g., an input requesting display of a notification state window (notification bar or panel) or an input of dragging from a top direction to a bottom direction of the display). The electronic devicemay provide the first execution screenas a preview window on the notification state window. The electronic devicemay control an application being executed through the first execution screen using the first execution screenprovided as a preview window.

101 710 261 According to an embodiment of the disclosure, the electronic devicemay be configured to maintain a task of an application executed through the first execution screendisplayed on the first display areafor a preconfigured time period after the first display area is deactivated in the second state, and then terminate the task.

101 262 263 261 261 262 263 According to some embodiments of the disclosure, in the case that the electronic devicerecognizes a change from the second state back to the first state, as a display area exposed in the first direction is changed from the second display areaand the third display areaback to the first display area, the electronic device may determine the active area as the first display areaand deactivate the second display areaand the third display area.

660 120 101 In operation, the processormay recognize that the structure of the electronic deviceor the housing is changed from the second state to the third state.

120 220 230 210 220 702 120 220 230 210 220 7 FIG.C For example, the processormay recognize that the second state has switched to the third state based on the first angle being changed to a threshold angle value (e.g., about 170 degrees) or more while the second angle threshold angle value (e.g., about 170 degrees) or more is maintained (or the second housingand the third housingare recognized as being in an unfolded state, and then the first housingand the second housingare changed to an unfolded state). As illustrated inof, the processormay recognize, based on data received from the sensing device, that the second housingand the third housinghave switched to an unfolded (or intermediate) state while maintaining an out-folded state of the first housingand the second housing.

670 120 261 710 261 720 262 263 In operation, the processormay determine the first display areaas an active area based on recognition of the third state, display the first execution screenon the first display area, and display the second execution screenon the second display areaand the third display area.

703 120 710 261 720 262 263 710 720 101 710 261 720 262 263 7 FIG.C As illustrated inof, the processormay display the first execution screenof a first size on the first display area, and display the second execution screenof a second size on the second display areaand the third display area. The first execution screenand the second execution screenmay be operated independently of each other. The electronic devicemay control not only the first execution screenthrough the first display area, but also the second execution screenthrough the second display areaand the third display area.

680 120 120 210 220 230 In operation, the processormay determine that a change is recognized from the first state to the third state, rather than recognition of the second state. For example, the processormay recognize that both the first angle and the second angle are changed to a threshold angle value (e.g., about 170 degrees) or more (or that the first housing, the second housing, and the third housingare all changed to an unfolded state).

690 120 261 262 263 810 810 262 263 In operation, the processormay determine the first display area, the second display area, and the third display areaas active areas based on recognizing a change from the first state to the third state, and display a first execution screenby extending the first execution screento a third size according to sizes of the second display areaand the third display area.

801 120 810 261 210 220 230 101 802 120 810 261 262 263 261 262 263 8 FIG. As illustrated inof, the processormay display a first execution screenof a first size on the first display areain a first state in which the housings,, andof the electronic deviceare all folded according to an embodiment of the disclosure. As illustrated in, the processormay extend the first execution screento a third size (or third resolution) corresponding to all active areas (e.g., the first display area, the second display area, and the third display area) based on the change from the first state to the third state, and display a first execution screen 810-1 of the third size through the first display area, the second display area, and the third display area.

9 FIG. is a screen illustrating a method of operating extension of a screen of an electronic device according to an embodiment of the disclosure.

9 FIG. 101 261 261 Referring to, when an electronic deviceaccording to an embodiment is changed from a first state to a third state or from a second state to a third state, in the case that there is no application executing through the first display area(or there is no execution history of the application through the first display area), the electronic device may provide a different extension layout configuration of the screen according to an application resizing feature.

261 261 The first display areamay be deactivated if there is a history of an application executed through the first display areabefore it is deactivated, or may be deactivated while the home screen is displayed or the screen is turned off.

120 101 261 According to an embodiment of the disclosure, the processormay determine whether an application executing on the electronic deviceexists through the first display area(or whether an execution history of the application exists through the first display area).

261 120 710 261 720 262 263 7 FIG.C According to an embodiment of the disclosure, in the case that there is an application executing through the first display area, the processormay display a first execution screenon the first display areaand display a second execution screenon the second display areaand the third display areawhen changing from the second state to the third state, as illustrated in.

101 261 120 920 According to an embodiment of the disclosure, when the electronic deviceis changed from the second state to the third state, in the case that no application is executed through the first display area, the processormay identify, through a second execution screen, whether an application being executed has a resizing feature or a feature requiring restart when a screen resolution is changed.

261 920 901 120 920 262 263 910 261 920 120 920 For example, in the case that there is no application executing through the first display areaand that an executing application is restarted upon a change in resolution through the second execution screen, as illustrated in, the processormay display a second execution screenof a second size through the second display areaand the third display area, and display a home screen or a recent task list screen as a first execution screenon the first display area. In the case of the second execution screen, by maintaining the current size/resolution (e.g., second size/second resolution), the processormay not restart the executing application through the second execution screen.

930 In this case, the home screen or recent task list screen may include app objects (e.g., app icons)corresponding to applications executable on the electronic device.

940 941 940 941 940 941 The electronic device may include indicatorsandthat guide an executable electronic device state/housing structure state for each app object or guide the app to be restarted to constitute a home screen or a recent task list screen. The indicatorsandmay be displayed to overlap with at least a portion of the app object. For example, the indicatorsandmay be implemented in a shape or form that guides information on an electronic device state/housing structure state last executed the corresponding application and information on an app being restarted in the case that a task of the corresponding application is started, but this is only an example. The user may easily select an app object suitable for the current electronic device state or housing structure state through indicators included in the home screen or the recent task list screen.

902 925 120 925 120 925 261 262 263 925 1 261 262 263 For another example, as illustrated in, in the case that no application is executed through the first display area and that an application executing through a second execution screendoes not restart upon a change in resolution, the processormay resize and display the second execution screenfrom the second size to the third size. The processormay render the second execution screenof the second size to the third size (or third resolution) corresponding to all the display areas,, and, and display a rendered third-size second execution screen-through the first display area, the second display area, and the third display area.

10 10 FIGS.A andB illustrate screens grouping and providing application information according to a state of an electronic device according to various embodiments of the disclosure.

10 10 FIGS.A andB 101 Referring to, the electronic deviceaccording to an embodiment of the disclosure may group, by electronic device state or housing structure state, and store information on apps executed in a first state, information on apps executed in a second state, and information on apps executed in a third state, and provide information on apps grouped by state through various screens.

101 101 For example, at a time when an executing application is switched from a foreground to a background, the electronic devicemay stop the operation of the application and store (or capture) a last execution screen (or display data included in the execution screen) as an execution screen image. The electronic devicemay record or store the electronic device state or housing structure state at the time of application switching. The electronic device may include the stored execution screen image in a recent task list.

101 101 According to an embodiment of the disclosure, in the case that an active area of the display is switched according to a change in the state of the electronic deviceor the state of the housing structure, the electronic devicemay identify a state of applications in which tasks are being executed and identify whether to restart (or re-execute) applications executed in an electronic device state different from the current electronic device state. For example, in the case of Android, whether to restart an application may be identified based on attribute values, such as "screenLayout", "screenSize", and "smallestScreenSize", but this is only an example and is not limited thereto.

101 According to an embodiment of the disclosure, the electronic devicemay display a recent task list of different sizes according to the electronic device state or housing structure state, and visually guide the user through an indicator information on apps executed when the state of the structure is different from the current electronic device state among app objects included in the recent task list.

1001 101 1010 101 101 1030 1020 1020 1010 1001 1030 10 FIG.A In an embodiment of the disclosure, as illustrated inof, the electronic devicemay display a recent task listof a first size in a first state. The electronic devicemay support a function of displaying an indicator that guides app information executed in a state other than the current state in the recent task list. For example, the electronic devicemay display a first indicatorthat guides app information executed in a third state other than the first state among app objects. App objectswithout indicators in the recent task listofmay be applications that have a history executed in the first state. The user may recognize applications that may be executed immediately in the first state without restarting (e.g., app objects that are not displayed by an indicator) and applications that should be executed in the third state (e.g., app objects displayed by the first indicator).

101 1013 1002 1015 1003 101 1031 1032 1040 101 101 101 101 1040 1003 101 1015 1003 101 101 1015 In an embodiment of the disclosure, the electronic devicemay display a recent task listof a second size in a second state, such asor may display a recent task listof a third size in a third state, such as. The electronic devicemay display at least one of a second indicatorthat guides app information executed in the second state, a third indicatorthat guides app information executed in the first state, or a fourth indicatorthat guides app information restarted (or initialized) when switching from the background to the foreground, according to the current electronic device state or housing structure state. For example, in the case that the electronic deviceis in the second state, the electronic devicemay display an indicator indicating the first state or the third state to app objects switched to the background in the first state or the third state in the recent task list, and in the case that the electronic deviceis in the third state, the electronic device may display an indicator indicating the first state or the second state to app objects switched to the background in the first state or the second state. According to an embodiment of the disclosure, in the case that the electronic deviceselects an app object including the fourth indicatorillustrated in, the electronic devicemay display a user interface (UI) window (e.g., pop-up window) (not illustrated) that guides that the selected application may be restarted or that a screen thereof may be initialized upon switching from the background to the foreground and that determine whether the user approves (e.g., approves or rejects). For example, in the case that the user selects an approval item on the UI window in the recent task listof, the electronic devicemay initialize an app execution screen (or application) for the selected application and display the app execution screen in a size corresponding to the current display state. In the case that the user selects a rejection item in the user interface, the electronic devicemay remove the UI window and maintain display of the recent task list.

101 10 FIG.B According to an embodiment of the disclosure, the electronic devicemay provide a function of recommending and displaying an app optimized for each state according to the electronic device state or housing structure state, as illustrated in.

101 1050 1004 1051 1050 1052 1053 In an embodiment of the disclosure, the electronic devicemay group information on apps executed by electronic device state or housing structure state in a recent task list, as illustrated in, and provide grouped information in the recent task list. For example, a first groupdisplayed in the recent task listmay include app objects executed in a first state, a second groupmay include app objects executed in a second state, and a third groupmay include app objects executed in a third state.

101 1060 1005 1061 1060 1062 1063 In an embodiment of the disclosure, the electronic devicemay group information on apps executed by electronic device state or housing structure state and provide grouped information in a quick execution list(e.g., edge bar) provided in at least a portion of the display, as illustrated in. For example, a first groupdisplayed in the quick execution listmay include app objects executed in a first state, a second groupmay include app objects executed in a second state, and a third groupmay include app objects executed in a third state.

101 1070 1006 In an embodiment of the disclosure, the electronic devicemay select and provide app objects included in a recently execution app search screenas apps that match a current electronic device state or housing structure state, as illustrated in.

1007 101 1081 1082 1083 1080 In an embodiment of the disclosure, as illustrated in, the electronic devicemay also provide widgets,, andof various sizes arranged on a widget screenaccording to the electronic device state or housing structure state.

210 220 230 240 210 220 210 250 230 220 230 260 310 261 210 262 220 261 210 220 263 230 262 220 230 360 210 220 230 130 330 120 320 130 330 According to an embodiment of the disclosure, an electronic device may include a first housing, a second housing, a third housing, a first hinge assemblyconfigured to couple the first housingto one side of the second housingand to allow the first housingto rotate, a second hinge assemblyconfigured to couple the third housingto the other side of the second housingand to allow the third housingto rotate, displaysandincluding a first display areadisposed in the first housing, a second display areadisposed in the second housingand facing in a direction opposite to the first display areawhen the first housingand the second housingare folded, and a third display areadisposed in the third housingand facing the second display areawhen the second housingand the third housingare folded, a sensing devicefor detecting a folding or unfolding state of the first housing, the second housing, and the third housing, memoriesandfor storing executable instructions, and processorsandfor accessing the memoriesandand executing the instructions.

120 320 261 210 220 230 261 360 240 220 230 250 120 320 261 262 263 261 210 220 230 240 250 120 320 261 262 263 According to an embodiment of the disclosure, the processorsandmay display a first execution screen using a first display areain a first state in which a first housing, a second housing, and a third housingare folded relative to each other, and, while the first execution screen is displayed through the first display area, in the case of recognizing, based on data received from a sensing device, that the first state has switched to a second state in which a first hinge assemblyis in a fixed state and in which the second housingand the third housingare unfolded from a folded state by rotation of a second hinge assembly, the processorsandmay deactivate the first display areabased on switching from the first state to the second state and display a second execution screen through a second display areaand a third display area, and, while the first execution screen is displayed through the first display area, in the case of recognizing, based on data received from the sensing device, that the first state has switched to the third state in which the first housing, the second housing, and the third housingare all unfolded by rotation of the first hinge assemblyand the second hinge assembly, the processorsandmay control the display to display the first execution screen by extending the first execution screen from the first display areato the second display areaand the third display areabased on switching from the first state to the third state.

120 320 261 262 263 261 262 263 According to an embodiment of the disclosure, the processorsandmay, as an operation of deactivating the first display areaand displaying a second execution screen through the second display areaand the third display area, be further configured to display a preview window corresponding to the first execution screen executed through the deactivated first display areaon at least a portion of the second display areaand the third display area.

120 320 261 262 263 360 120 320 261 262 263 According to an embodiment of the disclosure, while the processorsanddeactivate the first display areaand display the second execution screen through the second display areaand the third display area, in the case of recognizing, based on data received from the sensing device, that the second state has switched to the third state in which the housings are all unfolded, the processorsandmay be configured to display the first execution screen on the first display areaand display the second execution screen on the second display areaand the third display areabased on switching from the second state to the third state.

120 320 261 262 263 261 According to an embodiment of the disclosure, the processorsandmay, as an operation of displaying the first execution screen on the first display areaand displaying the second execution screen on the second display areaand the third display area, be further configured to display a home screen or a recent task list as the first execution screen while maintaining the second execution screen, in the case that there is no application executed through the first display areaand that an app displayed on the second execution screen is initialized or restarted upon a change in resolution.

120 320 261 262 263 261 262 263 261 According to an embodiment of the disclosure, the processorsandmay, as an operation of displaying the first execution screen on the first display areaand displaying the second execution screen on the second display areaand the third display area, be further configured to omit display of the first execution screen and resize and display the second execution screen to a size corresponding to the first display area, the second display area, and the third display area, in the case that there is no application executed through the first display areaand that an app displayed on the second execution screen is not restarted upon a change in resolution.

120 320 According to an embodiment of the disclosure, the processorsandmay be configured to group, by electronic device state or housing structure state, and store information on apps executed in the first state, information on apps executed in the second state, and information on apps executed in the third state, and to reconstitute and display a widget screen, recent app search screen, or recent task list of the electronic device with information on apps executed in the currently recognized electronic device state or housing structure state.

261 210 220 230 According to an embodiment of the disclosure, a method of operating a screen of a foldable electronic device may include displaying a first execution screen on the display using a first display areain a first state in which the first housing, the second housing, and the third housingare folded relative to each other.

261 262 263 360 210 220 220 230 261 According to an embodiment of the disclosure, a method of operating a screen of a foldable electronic device may include deactivating the first display areabased on switching from the first state to the second state, and displaying a second execution screen on the display through the second display areaand the third display area, in the case that the electronic device recognizes, based on data received from the sensing device, that the first state has switched to a second state in which the first housingand the second housingare folded and in which the second housingand the third housingare unfolded, while a first execution screen is displayed through the first display area.

261 262 263 360 210 220 230 261 According to an embodiment of the disclosure, a method of operating a screen of a foldable electronic device may include displaying a first execution screen on a display by extending the first execution screen from the first display areato the second display areaand the third display areabased on switching from a first state to a third state, in the case that the electronic device recognizes, based on data received from the sensing device, that the first state has switched to the third state in which the first housing, the second housing, and the third housingare all unfolded, while the first execution screen is displayed through the first display area.

It should be understood that embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments of the disclosure, but include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. In this document, each of phrases, such as "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" may include any one of or all possible combinations of items listed together in the corresponding one of the phrases. Terms, such as "first" or "second" may be simply used for distinguishing a corresponding component from other corresponding components, and do not limit the corresponding components in other aspects (e.g., importance or order). In the case that one (e.g., first) component is referred to as "coupled" or "connected" to another (e.g., second) component, with or without the terms "functionally" or "communicatively", it means that the one component may be connected to the other component directly (e.g., by wire), wirelessly, or through a third component.

The term “module” used in embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms, such as logic, logic block, component, or circuit. The module may be an integrally formed component, or a minimum unit or a portion of the component that performs one or more functions. For example, according to an embodiment of the disclosure, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

140 136 138 101 120 101 Embodiments of this document may be implemented into software (e.g., the program) including one or more instructions stored in a storage medium (e.g., the internal memoryor the external memory) readable by a machine (e.g., the electronic device). For example, the processor (e.g., the processor) of the device (e.g., the electronic device) may call and execute at least one instruction from one or more instructions stored in a storage medium. This makes it possible for the machine to be operated to perform at least one function according to the called at least one instruction. The one or more instructions may include a code generated by a compiler or a code executable by an interpreter. The machine readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (e.g., electromagnetic wave), and this term does not distinguish the case that data is semi-permanently stored in the storage medium and the case that data is temporarily stored.

According to an embodiment of the disclosure, a method according to embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product may be distributed in the form of a machine readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed (e.g., download or upload) via an application store (e.g., Play Store™) or online or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a part of the computer program product may be at least temporarily stored or temporarily generated in a machine readable storage medium, such as memory of a server of a manufacturer, a server of an application store, or a relay server.

According to embodiments of the disclosure, each component (e.g., module or program) of the above-described components may include a singular entity or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. According to an embodiment of the disclosure, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., module or program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to the functions performed by the corresponding component among the plurality of components prior to the integration. According to an embodiment of the disclosure, operations performed by a module, program, or other component may be executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order, or omitted, or one or more other operations may be added.

It will be appreciated that various embodiments of the disclosure according to the claims and description in the specification can be realized in the form of hardware, software or a combination of hardware and software.

Any such software may be stored in non-transitory computer readable storage media. The non-transitory computer readable storage media store one or more computer programs (software modules), the one or more computer programs include computer-executable instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method of the disclosure.

Any such software may be stored in the form of volatile or non-volatile storage, such as, for example, a storage device like read only memory (ROM), whether erasable or rewritable or not, or in the form of memory, such as, for example, random access memory (RAM), memory chips, device or integrated circuits or on an optically or magnetically readable medium, such as, for example, a compact disk (CD), digital versatile disc (DVD), magnetic disk or magnetic tape or the like. It will be appreciated that the storage devices and storage media are various embodiments of non-transitory machine-readable storage that are suitable for storing a computer program or computer programs comprising instructions that, when executed, implement various embodiments of the disclosure. Accordingly, various embodiments provide a program comprising code for implementing apparatus or a method of any one of the claims of this specification and a non-transitory machine-readable storage storing such a program.

While the disclosure has been shown and described with reference to various embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims and their equivalents.