User Interfaces for Generating Automatically-Generated Content

This application claims the benefit of U.S. Provisional Application No. 63/631,445, filed Apr. 8, 2024, U.S. Provisional Application No. 63/657,971, filed Jun. 9, 2024, U.S. Provisional Application No. 63/658,421, filed Jun. 10, 2024, and U.S. Provisional Application No. 63/709,506, filed Oct. 20, 2024, the contents of which are herein incorporated by reference in their entireties for all purposes.

This disclosure relates generally to an electronic device presenting user interfaces for generating automatically-generated content.

User interaction with electronic devices has increased significantly in recent years. These devices can be devices such as computers, tablet computers, televisions, multimedia devices, or mobile devices. In some circumstances, users may wish to create generative images using reference images. The user may therefore desire efficient ways of generating automatically-generated content and displaying the automatically-generated content.

Providing efficient ways of displaying representations of recognized concepts of a prompt used to generate automatically-generated visual content allows a user to easily and efficiently see the concepts used to generate the generative image, thereby reducing errors in output of the electronic device, and avoiding the need for additional input to correct such errors. Allowing a user to edit previously generated media allows the user to efficiently change recognized concepts of a previously generated media item, thereby reducing computing resources used by the electronic device, and also reduces erroneous inputs to the electronic device.

In some embodiments, an electronic device receives a prompt for generating an automatically-generated visual content. In some embodiments, the electronic device extracts recognized concepts from the prompt to be used to influence the generation of the automatically-generated visual content. In some embodiments, while displaying the user interface including the recognized concepts, the electronic device receives one or more inputs to modify the recognized concepts. In some embodiments, the electronic device generates (e.g., using an AI process or a generative AI process) an automatically-generated visual content using the one or more recognized concepts.

In some embodiments, the electronic device adds an automatically-generated visual content to a content entry field of a first application, different than the automatically-generated visual media application, without opening the automatically-generated visual media application. In some embodiments, the electronic device displays a user interface within the first application including one or more previously generated automatically-generated visual content to be added to the content entry field. In some embodiments, the electronic device edits previously generated automatically-generated visual content and creates new automatically-generated visual content using reference media items while in the first application. In some embodiments, the electronic device detects an event corresponding to a respective functionality that outputs content generated based on an artificial intelligence (AI) model and displays the content with a visual effect that includes a visual characteristic associated with content generated based on an AI model. In some embodiments, the electronic device displays an animation indicative of an AI model content generation information, wherein the animation includes High Dynamic Range (HDR) content.

Displaying a user interface for inserting the automatically-generated visual content into the user interface of the first application allows a user to efficiently insert such visual media into the first application without opening a second application and/or navigating away from the first user interface, thereby reducing inputs needed to insert such visual media. Displaying a user interface for generating the automatically-generated visual content based on a reference media item in the user interface of the first application allows a user to generate an automatically-generated visual content for use with the first application without opening a second application and/or navigating away from the first application, thereby reducing inputs needed to generate such visual media. Displaying a user interface with a visual characteristic and/or animation to indicate that the content is based on AI generated content allows a user to visually assess when content was generated using an AI model.

Displaying a representation of second automatically-generated generative visual content based on a user selected prompt used to automatically generate first automatically-generated generative visual content in response to an input including a movement component provides an intuitive way to display representations of different automatically-generated generative visual content efficient interactions between the user and the electronic device.

Restricting automatically-generated visual content generated in response to user inputs enhances the operability of the device and makes the user-device interface more efficient.

Suggesting prompt components based on previously presented content and/or device context allows the user to easily and efficiently select relevant prompt components to be used to influence the generation of an automatically-generated visual content, thereby reducing the number of inputs needed to generate automatically-generated visual media and reducing erroneous inputs to the electronic device.

Presenting options for personalizing the subject of automatically-generated visual media, including editing subjects and/or creating subjects provides efficient ways of customizing the content of automatically-generated visual media while reducing inputs and user errors.

Providing options to personalize template subjects allows a user to constrain certain appearance characteristics while allowing variability for other appearance characteristics therefore allowing for a broader range of representations of different types of subjects for the automatically-generated visual content.

The full descriptions of the embodiments are provided in the Drawings and the Detailed Description, and it is understood that the Summary provided above does not limit the scope of the disclosure in any way.

It is well understood that the use of personally identifiable information should follow privacy policies and practices that are generally recognized as meeting or exceeding industry or governmental requirements for maintaining the privacy of users. In particular, personally identifiable information data should be managed and handled so as to minimize risks of unintentional or unauthorized access or use, and the nature of authorized use should be clearly indicated to users.

In the following description of embodiments, reference is made to the accompanying drawings which form a part hereof, and in which it is shown by way of illustration specific embodiments that are optionally practiced. It is to be understood that other embodiments are optionally used, and structural changes are optionally made without departing from the scope of the disclosed embodiments.

Providing efficient ways of displaying representations of recognized concepts of a prompt used to generate an automatically-generated visual content allows a user to easily and efficiently see the concepts used to generate the generative image, thereby reducing errors in output of the electronic device, and avoiding the need for additional input to correct such errors. Allowing a user to edit previously generated media allows the user to efficiently change recognized concepts of a previously generated media item, thereby reducing computing resources used by the electronic device, and also reduces erroneous inputs to the electronic device.

In some embodiments, an electronic device receives a prompt for generating an automatically-generated visual content. In some embodiments, the electronic device extracts recognized concepts from the prompt to be used to influence the generation of the automatically-generated visual content. In some embodiments, while displaying the user interface including the recognized concepts, the electronic device receives one or more inputs to modify the recognized concepts. In some embodiments, the electronic device generates (e.g., using an AI process or a generative AI process) an automatically-generated visual content using the one or more recognized concepts.

In some embodiments, the electronic device adds an automatically-generated visual content to a content entry field of a first application, different than the automatically-generated visual media application, without opening the automatically-generated visual media application. In some embodiments, the electronic device displays a user interface within the first application including one or more previously generated automatically-generated visual content to be added to the content entry field. In some embodiments, the electronic device edits previously generated automatically-generated visual content and creates new automatically-generated visual content using reference media items while in the first application.

Displaying a user interface for inserting the automatically-generated visual content into the user interface of the first application allows a user to efficiently insert such visual media into the first application without opening a second application and/or navigating away from the first user interface, thereby reducing inputs needed to insert such visual media. Displaying a user interface for generating the automatically-generated visual content based on a reference media item in the user interface of the first application allows a user to generate an automatically-generated visual content for use with the first application without opening a second application and/or navigating away from the first application, thereby reducing inputs needed to generate such visual media.

Displaying a representation of second automatically-generated generative visual content based on a user selected prompt used to automatically generate first automatically-generated generative visual content in response to an input including a movement component provides an intuitive way to display representations of different automatically-generated generative visual content efficient interactions between the user and the electronic device.

Displaying an animation in which portions of a user interface are displayed with a degree of luminance that is greater than a standard dynamic range of luminance visually emphasizes that operations associated with of an electronic device are ongoing, and reduces input erroneously interrupting such operations.

Restricting automatically-generated visual content generated in response to user inputs enhances the operability of the device and makes the user-device interface more efficient.

Suggesting prompt components based on previously presented content and/or device context allows the user to easily and efficiently select relevant prompt components to be used to influence the generation of an automatically-generated visual content, thereby reducing the number of inputs needed to generate automatically-generated visual media and reducing erroneous inputs to the electronic device.

Presenting options for personalizing the subject of automatically-generated visual media, including editing subjects and/or creating subjects provides efficient ways of customizing the content of automatically-generated visual media while reducing inputs and user errors.

Providing options to personalize template subjects allows a user to constrain certain appearance characteristics while allowing variability for other appearance characteristics therefore allowing for a broader range of representations of different types of subjects for the automatically-generated visual content.

Although the following description uses terms “first,” “second,” etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another. For example, a first touch could be termed a second touch, and, similarly, a second touch could be termed a first touch, without departing from the scope of the various described embodiments. The first touch and the second touch are both touches, but they are not the same touch.

The terminology used in the description of the various described embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various described embodiments and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “includes,” “including,” “comprises,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

The term “if” is, optionally, construed to mean “when” or “upon” or “in response to determining” or “in response to detecting,” depending on the context. Similarly, the phrase “if it is determined” or “if [a stated condition or event] is detected” is, optionally, construed to mean “upon determining” or “in response to determining” or “upon detecting [the stated condition or event]” or “in response to detecting [the stated condition or event],” depending on the context.

Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communications device, such as a mobile telephone, that also contains other functions, such as PDA and/or music player functions. Exemplary embodiments of portable multifunction devices include, without limitation, the iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, California. Other portable electronic devices, such as laptops or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and/or touch pads), are, optionally, used. It should also be understood that, in some embodiments, the device is not a portable communications device, but is a desktop computer or a television with a touch-sensitive surface (e.g., a touch screen display and/or a touch pad). In some embodiments, the device does not have a touch screen display and/or a touch pad, but rather is capable of outputting display information (such as the user interfaces of the disclosure) for display on a separate display device, and capable of receiving input information from a separate input device having one or more input mechanisms (such as one or more buttons, a touch screen display and/or a touch pad). In some embodiments, the device has a display, but is capable of receiving input information from a separate input device having one or more input mechanisms (such as one or more buttons, a touch screen display and/or a touch pad). In some embodiments, the electronic device is a computer system that is in communication (e.g., via wireless communication, via wired communication) with a display generation component (e.g., a display device such as a head-mounted display (HMD), a display, a projector, a touch-sensitive display, or other device or component that presents visual content to a user, for example, on or in the display generation component itself or produced from the display generation component and visible elsewhere). The display generation component is configured to provide visual output, such as display via a CRT display, display via an LED display, or display via image projection. In some embodiments, the display generation component is integrated with the computer system. In some embodiments, the display generation component is separate from the computer system. As used herein, “displaying” content includes causing to display the content (e.g., video data rendered or decoded by display controller) by transmitting, via a wired or wireless connection, data (e.g., image data or video data) to an integrated or external display generation component to visually produce the content.

In the discussion that follows, an electronic device that includes a display and a touch-sensitive surface is described. It should be understood, however, that the electronic device optionally includes one or more other physical user-interface devices, such as a physical keyboard, a mouse and/or a joystick. Further, as described above, it should be understood that the described electronic device, display and touch-sensitive surface are optionally distributed amongst two or more devices. Therefore, as used in this disclosure, information displayed on the electronic device or by the electronic device is optionally used to describe information outputted by the electronic device for display on a separate display device (touch-sensitive or not). Similarly, as used in this disclosure, input received on the electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device) is optionally used to describe input received on a separate input device, from which the electronic device receives input information.

The device typically supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disk authoring application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an e-mail application, an instant messaging application, a workout support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, a television channel browsing application, and/or a digital video player application.

The various applications that are executed on the device optionally use at least one common physical user-interface device, such as the touch-sensitive surface. One or more functions of the touch-sensitive surface as well as corresponding information displayed on the device are, optionally, adjusted and/or varied from one application to the next and/or within a respective application. In this way, a common physical architecture (such as the touch-sensitive surface) of the device optionally supports the variety of applications with user interfaces that are intuitive and transparent to the user.

Attention is now directed toward embodiments of portable or non-portable devices with touch-sensitive displays, though the devices need not include touch-sensitive displays or displays in general, as described above.is a block diagram illustrating portable or non-portable multifunction devicewith touch-sensitive displaysin accordance with some embodiments. Touch-sensitive displayis sometimes called a “touch screen” for convenience, and is sometimes known as or called a touch-sensitive display system. Deviceincludes memory(which optionally includes one or more computer readable storage mediums), memory controller, one or more processing units (CPU's), peripherals interface, RF circuitry, audio circuitry, speaker, microphone, input/output (I/O) subsystem, other input or control devices, and external port. Deviceoptionally includes one or more optical sensors. Deviceoptionally includes one or more contact intensity sensorsfor detecting intensity of contacts on device(e.g., a touch-sensitive surface such as touch-sensitive display systemof device). Deviceoptionally includes one or more tactile output generatorsfor generating tactile outputs on device(e.g., generating tactile outputs on a touch-sensitive surface such as touch-sensitive display systemof deviceor touchpadof device). These components optionally communicate over one or more communication buses or signal lines.

As used in the specification and claims, the term “intensity” of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a substitute (proxy) for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values that includes at least four distinct values and more typically includes hundreds of distinct values (e.g., at least 256). Intensity of a contact is, optionally, determined (or measured) using various approaches and various sensors or combinations of sensors. For example, one or more force sensors underneath or adjacent to the touch-sensitive surface are, optionally, used to measure force at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., a weighted average) to determine an estimated force of a contact. Similarly, a pressure-sensitive tip of a stylus is, optionally, used to determine a pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and/or changes thereto, the capacitance of the touch-sensitive surface proximate to the contact and/or changes thereto, and/or the resistance of the touch-sensitive surface proximate to the contact and/or changes thereto are, optionally, used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some implementations, the substitute measurements for contact force or pressure are used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurements). In some implementations, the substitute measurements for contact force or pressure are converted to an estimated force or pressure and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of a contact as an attribute of a user input allows for user access to additional device functionality that may otherwise not be accessible by the user on a reduced-size device with limited real estate for displaying affordances (e.g., on a touch-sensitive display) and/or receiving user input (e.g., via a touch-sensitive display, a touch-sensitive surface, or a physical/mechanical control such as a knob or a button).

As used in the specification and claims, the term “tactile output” refers to physical displacement of a device relative to a previous position of the device, physical displacement of a component (e.g., a touch-sensitive surface) of a device relative to another component (e.g., housing) of the device, or displacement of the component relative to a center of mass of the device that will be detected by a user with the user's sense of touch. For example, in situations where the device or the component of the device is in contact with a surface of a user that is sensitive to touch (e.g., a finger, palm, or other part of a user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in physical characteristics of the device or the component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is, optionally, interpreted by the user as a “down click” or “up click” of a physical actuator button. In some cases, a user will feel a tactile sensation such as a “down click” or “up click” even when there is no movement of a physical actuator button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's movements. As another example, movement of the touch-sensitive surface is, optionally, interpreted or sensed by the user as “roughness” of the touch-sensitive surface, even when there is no change in smoothness of the touch-sensitive surface. While such interpretations of touch by a user will be subject to the individualized sensory perceptions of the user, there are many sensory perceptions of touch that are common to a large majority of users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., an “up click,” a “down click,” “roughness”), unless otherwise stated, the generated tactile output corresponds to physical displacement of the device or a component thereof that will generate the described sensory perception for a typical (or average) user.

It should be appreciated that deviceis only one example of a portable or non-portable multifunction device, and that deviceoptionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. The various components shown inare implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing and/or application specific integrated circuits. Further, the various components shown inare optionally implemented across two or more devices; for example, a display and audio circuitry on a display device, a touch-sensitive surface on an input device, and remaining components on device. In such an embodiment, deviceoptionally communicates with the display device and/or the input device to facilitate operation of the system, as described in the disclosure, and the various components described herein that relate to display and/or input remain in device, or are optionally included in the display and/or input device, as appropriate.

Memoryoptionally includes high-speed random access memory and optionally also includes non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controlleroptionally controls access to memoryby other components of device.

Peripherals interfacecan be used to couple input and output peripherals of the device to CPUand memory. The one or more processorsrun or execute various software programs and/or sets of instructions stored in memoryto perform various functions for deviceand to process data.

In some embodiments, peripherals interface, CPU, and memory controllerare, optionally, implemented on a single chip, such as chip. In some other embodiments, they are, optionally, implemented on separate chips.

RF (radio frequency) circuitryreceives and sends RF signals, also called electromagnetic signals. RF circuitryconverts electrical signals to/from electromagnetic signals and communicates with communications networks and other communications devices via the electromagnetic signals. RF circuitryoptionally includes well-known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, and so forth. RF circuitryoptionally communicates with networks, such as the Internet, also referred to as the World Wide Web (WWW), an intranet and/or a wireless network, such as a cellular telephone network, a wireless local area network (LAN) and/or a metropolitan area network (MAN), and other devices by wireless communication. The RF circuitryoptionally includes well-known circuitry for detecting near field communication (NFC) fields, such as by a short-range communication radio. The wireless communication optionally uses any of a plurality of communications standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), long term evolution (LTE), near field communication (NFC), wideband code division multiple access (W-CDMA), code division multiple access (CDMA), time division multiple access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, and/or IEEE 802.11ac), voice over Internet Protocol (VOIP), Wi-MAX, a protocol for e-mail (e.g., Internet message access protocol (IMAP) and/or post office protocol (POP)), instant messaging (e.g., extensible messaging and presence protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and/or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.

Audio circuitry, speaker, and microphoneprovide an audio interface between a user and device. Audio circuitryreceives audio data from peripherals interface, converts the audio data to an electrical signal, and transmits the electrical signal to speaker. Speakerconverts the electrical signal to human-audible sound waves. Audio circuitryalso receives electrical signals converted by microphonefrom sound waves. Audio circuitryconverts the electrical signal to audio data and transmits the audio data to peripherals interfacefor processing. Audio data is, optionally, retrieved from and/or transmitted to memoryand/or RF circuitryby peripherals interface. In some embodiments, audio circuitryalso includes a headset jack (e.g.,,). The headset jack provides an interface between audio circuitryand removable audio input/output peripherals, such as output-only headphones or a headset with both output (e.g., a headphone for one or both ears) and input (e.g., a microphone).

I/O subsystemcouples input/output peripherals on device, such as touch screenand other input control devices, to peripherals interface. I/O subsystemoptionally includes display controller, optical sensor controller, intensity sensor controller, haptic feedback controllerand one or more input controllersfor other input or control devices. The one or more input controllersreceive/send electrical signals from/to other input or control devices. The other input control devicesoptionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and so forth. In some alternate embodiments, input controller(s)are, optionally, coupled to any (or none) of the following: a keyboard, infrared port, USB port, and a pointer device such as a mouse. The one or more buttons (e.g.,,) optionally include an up/down button for volume control of speakerand/or microphone. The one or more buttons optionally include a push button (e.g.,,).

A quick press of the push button optionally disengages a lock of touch screenor optionally begins a process that uses gestures on the touch screen to unlock the device, as described in U.S. patent application Ser. No. 11/322,549, “Unlocking a Device by Performing Gestures on an Unlock Image,” filed Dec. 23, 2005, U.S. Pat. No. 7,657,849, which is hereby incorporated by reference in its entirety. A longer press of the push button (e.g.,) optionally turns power to deviceon or off. The functionality of one or more of the buttons are, optionally, user-customizable. Touch screenis used to implement virtual or soft buttons and one or more soft keyboards.

Touch-sensitive displayprovides an input interface and an output interface between the device and a user. As described above, the touch-sensitive operation and the display operation of touch-sensitive displayare optionally separated from each other, such that a display device is used for display purposes and a touch-sensitive surface (whether display or not) is used for input detection purposes, and the described components and functions are modified accordingly. However, for simplicity, the following description is provided with reference to a touch-sensitive display. Display controllerreceives and/or sends electrical signals from/to touch screen. Touch screendisplays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively termed “graphics”). In some embodiments, some or all of the visual output corresponds to user-interface objects.

Touch screenhas a touch-sensitive surface, sensor or set of sensors that accepts input from the user based on haptic and/or tactile contact. Touch screenand display controller(along with any associated modules and/or sets of instructions in memory) detect contact (and any movement or breaking of the contact) on touch screenand convert the detected contact into interaction with user-interface objects (e.g., one or more soft keys, icons, web pages or images) that are displayed on touch screen. In an exemplary embodiment, a point of contact between touch screenand the user corresponds to a finger of the user.

Touch screenoptionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. Touch screenand display controlleroptionally detect contact and any movement or breaking thereof using any of a plurality of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with touch screen. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as that found in the iPhone®, iPod Touch®, and iPad® from Apple Inc. of Cupertino, California.

A touch-sensitive display in some embodiments of touch screenis, optionally, analogous to the multi-touch sensitive touchpads described in the following U.S. Pat. No. 6,323,846 (Westerman et al.), U.S. Pat. No. 6,570,557 (Westerman et al.), and/or U.S. Pat. No. 6,677,932 (Westerman), and/or U.S. Patent Publication 2002/0015024A1, each of which is hereby incorporated by reference in its entirety. However, touch screendisplays visual output from device, whereas touch-sensitive touchpads do not provide visual output.

A touch-sensitive display in some embodiments of touch screenis described in the following applications: (1) U.S. patent application Ser. No. 11/381,313, “Multipoint Touch Surface Controller,” filed May 2, 2006; (2) U.S. patent application Ser. No. 10/840,862, “Multipoint Touchscreen,” filed May 6, 2004; (3) U.S. patent application Ser. No. 10/903,964, “Gestures For Touch Sensitive Input Devices,” filed Jul. 30, 2004; (4) U.S. patent application Ser. No. 11/48,264, “Gestures For Touch Sensitive Input Devices,” filed Jan. 31, 2005; (5) U.S. patent application Ser. No. 11/38,590, “Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices,” filed Jan. 18, 2005; (6) U.S. patent application Ser. No. 11/228,758, “Virtual Input Device Placement On A Touch Screen User Interface,” filed Sep. 16, 2005; (7) U.S. patent application Ser. No. 11/228,700, “Operation Of A Computer With A Touch Screen Interface,” filed Sep. 16, 2005; (8) U.S. patent application Ser. No. 11/228,737, “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard,” filed Sep. 16, 2005; and (9) U.S. patent application Ser. No. 11/367,749, “Multi-Functional Hand-Held Device,” filed Mar. 3, 2006. All of these applications are incorporated by reference herein in their entirety.

Touch screenoptionally has a video resolution in excess of 100 dpi. In some embodiments, the touch screen has a video resolution of approximately 160 dpi. The user optionally makes contact with touch screenusing any suitable object or appendage, such as a stylus, a finger, and so forth. In some embodiments, the user interface is designed to work primarily with finger-based contacts and gestures, which can be less precise than stylus-based input due to the larger area of contact of a finger on the touch screen. In some embodiments, the device translates the rough finger-based input into a precise pointer/cursor position or command for performing the actions desired by the user.

In some embodiments, in addition to the touch screen, deviceoptionally includes a touchpad (not shown) for activating or deactivating particular functions. In some embodiments, the touchpad is a touch-sensitive area of the device that, unlike the touch screen, does not display visual output. The touchpad is, optionally, a touch-sensitive surface that is separate from touch screenor an extension of the touch-sensitive surface formed by the touch screen.