Automatic incident compilation system

The present application is based on and claims the benefit of U.S. Provisional Patent Application Ser. No. 63/336,937, filed Apr. 29, 2022, the content of which is hereby incorporated by reference in its entirety.

Police officers, firemen, security personnel, and other emergency responders are the often the first to respond to various incidents. Their response time is typically measured in minutes and the incident can often be an emergency life or death situation ranging from a traffic accident to confronting an active shooter. During such situations, events may unfold very quickly and it is sometimes difficult to know what happened and when it happened.

With the advent of modern camera technology, emergency personnel often carry body cameras that record the events of an incident. Additionally, many people now carry cellular telephones that are equipped with high-quality cameras. Further, more and more vehicles, including substantially all police cars, are equipped with dash cameras. Adding to that, many of us have cameras on our houses (e.g., doorbell cameras or security cameras) as well as our places of business. Thus, cameras pervade modern life. However, the large number of cameras that may contain information relevant to a particular incident adds significant complexity to the manipulation and storage of such data. Additionally, a particular view of an incident may need to vary based on who is watching it. For example, a view that is suitable for public, including children, may differ significantly from a view that is suitable for a prosecuting attorney or a jury.

Another challenge for compiling incidents is the precise timing of words and/or actions may be very important to a clear understanding of what exactly happened. When different cameras have different base times (i.e., one camera is one minute ahead of the other camera) it can be difficult to know the true chronology of event. Providing a system and method that not only effectively allows ease of interaction with various media files, but also facilitates resolving time differences or provides time normalization will improve general understanding of the recorded incidents.

An automatic incident compilation system includes a media facilitator configured to receive a plurality of media files related to an incident. An application server is communicatively coupled to the media facilitator and includes a processor and memory containing instructions that, when executed, cause the processor to provide a storyboard application to a user. The storyboard application includes a storyboard creation user interface that is configured to allow a user to generate a user-customized display of the incident based on the plurality of media files. The processor is also configured to cause the storyboard application to change time information of one of the plurality of media files based on time information of another of the plurality of media files.

Embodiments described below generally help interested entities, leaders, prosecutors, jurors, et cetera, better understand an incident. The dissemination of information to public defenders and others in need of information related to an incident is also improved. Further, the ability to visualize an incident using spacio-temporal methods and the ability to transcribe and search through video and audio artifacts is also provided. Additionally, discrepancies between various media and written reports are reduced or even eliminated.

Embodiments described below generally provide the ability to utilize individual pieces of media from various sources and in various formats while still maintaining the full media intact. Further, embodiments allow a user to show an audience key parts of a particular incident in a very quick and efficient manner that can easily be replicated. Further still, embodiments also provide the ability to relate or otherwise associate narrative comments to key places on a timeline to easily navigate to those areas through a myriad of media. Additionally, in some embodiments, all media is transcribed, either automatically or manually, in order to provide keyword search functionality over all media associated with a particular incident. Additionally, a user can specify one or more keywords and receive a notification (such as an email) from the system if any transcription associated with a particular incident has the specified word(s) and/or phrases.

is an architectural view of one particular architecture in which embodiments described below may be practiced. Architectureincludes streaming server/media facilitator. While indicated as a single device, streaming server/media facilitatormay comprise any suitable number of computer devices. Streaming server/media facilitatoris communicative coupled to squad mediavia communication link. Squad mediacan include any suitable media sources provided by police dash cameras or other cameras positioned on a police vehicle. Communication linkmay be a network connection or a local databus such as a USB link. As shown in, communication linkmay also communicatively couple bodycam video sourceto streaming server/media facilitator. Bodycam video sourcemay be a computing device configured to interface with one or more police body cameras in order to receive stored video(s) from the body cameras. Communication linkmay also coupled streaming server/media facilitatorto other sources of media, as indicated at reference numeral. These additional sources of media may include other video sources, such as cellular telephone cameras, security cameras, traffic cameras, doorbell cameras, helicopter cameras, et cetera. Additionally, media sources other than video may also be received, such as audio sources like phone calls (e.g., 911 calls), recordings from police radios or scanners, audio from gunshot detection devices (e.g., Shot Spotter Gunshot Detection available from Shot Spotter, Inc.), et cetera.

Streaming server/media facilitatoris coupled to or includes customer storage. Storageis configured to store the various media files. Storagemay include one or more hard drives, optical disks, hard drive cartridge assemblies, tape storage devices, storage servers or any combination thereof.

Streaming server/media facilitatoris communicatively coupled to application server. Application serverreceives one or more video/audio files, or portions thereof, from streaming server/media facilitatorand provides such files/portions in an application that is presented to a user. As shown in, application serveris preferably coupled to a wide area network, such as the internet, so that the application can be presented to a user at a remote location. Thus, a computer executing client software, such as a web browser, may engage with application serverto provide the functions of an incident storyboard web application.

is an architectural view of another architecture in which embodiments described below may be practiced. Architecturebears some similarities to architectureand like components are numbered similarly. As can be seen in, architecturehas streaming server/media facilitatorlocated remote from the “customer environment.” Instead, a media transfer serveris located at the in the customer environment (i.e., on-premise) and communicates with streaming server/media facilitatorvia a data connection using a wide area network, such as internet. Additionally, storageis located away from the customer environment as well. Storagemay include one or more hard drives, optical disks, hard drive cartridge assemblies, tape storage devices, storage servers or any combination thereof. Additionally, any or all of storage, streaming server/media facilitator, and application servercan be cloud computing elements. A cloud computing example of storageis cloud storage provided by a cloud storage provider such as Amazon, Google, or Microsoft. An example of a cloud database that can be employed in various embodiments described herein is Amazon RDS or MySql. A cloud computing example of a computational resource that can support streaming server/media facilitatorand/or application server is an Amazon EC2 resource. Those skilled in the art will recognize that various other resources and providers can be employed for cloud-based implementations.

Cloud computing provides computation, software, data access and storage services that do not require end user knowledge of the physical location or configuration of the system that delivers the services. In various embodiments, cloud computing delivers the services over a wide area network, such as the Internet, using appropriate protocols. For instance, cloud computing providers deliver applications over a wide area network such that they can be accessed through a web browser or other computing component. Software or components of the system as well as the corresponding data can be stored on servers at remote location. The computing resources in cloud computing environments can be consolidated at remote data center locations or they can be dispersed. Cloud computing infrastructures can deliver services through shared data centers, even though they appear as a single point of access for the user. Thus, the components and functions described herein can be provided from a service provider at a remote location using a cloud computing architecture. Alternatively, they can be provided from a conventional server, or they can be installed on client devices directly, or in other ways. Cloud computing provides an important feature for the system described herein; scalability. A cloud computing embodiment can provision one or more cloud resource machines as needed.

is an architectural view of still another architecture in which embodiments described below may be practiced. Architecturebears some similarities to architecturesandand like components are numbered similarly. Architectureis a hybrid architecture in that it includes a number of resources in the customer environment (such as streaming server/media facilitatorand storage) as well as at least one cloud resource (shows application serverlocated away from the customer environment and accessible through internet). Accordingly, considering, embodiments described herein are practicable using a local installation (i.e., at a customer environment), using a cloud implementation, or a hybrid version of the two.

is a diagrammatic screenshot of a main screen that is displayed to a user of an incident storyboard web application when the user has successfully authenticated to the system. In the illustrated example, the user is Peter Johnson as indicated in the upper right-hand cornerof main screen. If the user has administrative rights, such as in the example shown in, an admin panel user interface elementwill display allowing the user to change administrative options and features for the application. Main screenalso includes an organization name indicatorillustrating the name of the organization for which the application is running. In the illustrated example, the organization is ACME, Co. As indicated, there are tabs,, andavailable to the user for interacting with storyboards, inviting other users, or reviewing queues, respectively. Additionally, a search boxis provided that allows the user to enter keywords or text that can be used to search for a particular storyboard having the search text as a title, or other associated metadata, for example. As shown, the search functionality can be enabled or disabled as desired, via status field. Additionally, storyboards can be sorted in any particular order based upon the setting in sorting order window. In the illustrated example, nine different storyboards are shown as well as a user interface elementthat, upon actuation, will allow the user to add a storyboard to the storyboards managed by the application for the organization. Preferably, each individual storyboard includes a title shown at the top of each storyboard tile. Additionally, a unique case number (CN) is also used to identify the storyboards. The case number may refer to an internal police department file system, a court docket number or any other suitable indicator. Additionally, as shown in, each tile preferably indicates the number of media files associated with the particular storyboard and may break the media type down by image, video, and audio. Finally, at the bottom of each storyboard tile, the owner or author of the storyboard is provided as well as the time of creation for the storyboard. When a user selects an individual storyboard tile, such as George Floyd storyboard, the display will transition to a storyboard display.

is a diagrammatic screenshot of a storyboard display that appears to a user when a storyboard tile, such as storyboard tile(shown in), is selected. When the storyboard display is shown, users are able to load all needed digital files (audio, video, or images) of a variety of different file types into the system. As can be appreciated, as media files have larger and larger sizes (for example, 1 minute of a 4 k/60 fps video files may be as large as 750 megabytes) it can become difficult for a software system to manipulate entire files. In accordance with one embodiment, at least some of the media files uploaded into the system (such as video files) are chopped or otherwise broken into a series of smaller files with pointers or some other suitable data structure associated therewith that allows the series of files to be accessed in order to allow the user to play, modify, or otherwise change, the entire video file. However, since the media file is broken into smaller pieces, when the user interacts with the media file (entire media file from the user's perspective) the user may be only interacting with one or more of the file portions. This allows the system to interact with a significant number of media files without overly taxing hardware resources.

Referring to, the user can select the most appropriate media files to be included in the base storyboard. In the illustrated example, there are 12 files that have been selected for the storyboard. The total time of the incident is 01:07:15 as noted in the lower left-hand corner in time window. Additionally, in the storyboard display mode, an indicatoris shown below storyboards tabindicating to the user that the user is currently viewing a storyboard. In the base storyboard view shown in, the user may play the storyboard summary by pressing play button, or may stop the playback by pressing stop button. Additionally, audio may be adjusted by interacting with a speaker button. In one example, buttonis used to simply mute the entire timeline audio. If the user interacts with button, the speed of the playback may be slowed down or increased, as desired. Button, when selected, will hide non-playing video. When so engaged, only playing videos will be shown. If the user selects button, the user will be directed to a display that will allow the user to create a summary. Selecting button, will allow the user to edit or delete an existing summary. Selecting fieldallows the user to play an existing summary, while selecting fieldallows the user to play, edit or delete existing bookmarks. Similarly, engaging elementallows the user to create a bookmark to mark a specific spot on the storyboard timeline.

As set forth above, the system will preferably sequentially load the media files and/or file portions using metadata and using spatial temporal techniques to automatically create a storyboard of the incident starting at the beginning and playing the corresponding files as they progress through the incident. The user can scroll down and see the actual timeline and which videos are playing when. When the user presses play, the incident will play out from multiple viewpoints based on the actual timing of the incident. When this occurs, the display will transition to that shown in.

is a diagrammatic screenshot of a storyboard being played in accordance with one embodiment. As shown in, while the storyboard is being played, an indicator, preferably in the form of a vertical lineshows where the user is within the timeline. In the illustrated example, the user's position on the timeline is shown and the timeline has a total playtime of 1 hour, 7 minutes and 35 seconds. The only video that exists for this particular time, is indicated at rectanglelabeled “store video”, and video tile. The user can also see various comments that have been added (shaded boxes such as box) that correspond with what is happening in the timeline at that particular time. As set forth above, one of the features of embodiments described herein is the ability to hide videos that are not currently playing. Thus, if the user selects button, all non-playing videos will be hidden.

is a diagrammatic screenshot of a storyboard being played where non-playing videos have been hidden. As shown in, buttonhas been modified to show a slash indicating that non-playing videos are currently hidden. Additionally, the timeline has moved forward incompared to that of(:/::). In the illustrated example, three videos are currently playing, a body-worn camera illustrated at video box, a second body-worn camera, and a surveillance video. The selective display of multiple different videos all synchronized to the same time of the incident provides an important configurable perspective for understanding what is happening when in a particular incident. This can provide tremendous insights into the various intricacies of a particular incident.

is a diagrammatic screenshot of storyboard playback illustrating various options/functions available to the user when in the storyboard view. Screenshotshows an option/function panethat becomes available when a user clicks on three dots in the storyboard application, while a storyboard is playing, or otherwise selects options/functions. In the illustrated example, functions include a preview function, layout customization, a spotlight view, the ability to add a comment to the storyboard by selecting user interface element, the ability to edit or add media by selecting user interface elements,, respectively, as well as others. Additionally, as shown, transcription can be engaged for the storyboard by selecting user interface element. Such transcription will preferably automatically transcribe words spoken or otherwise uttered during audio of any media file in the storyboard into text. This is particularly advantageous in that it allows for searching for particular words. Additionally, the transcription is preferably tied to the timeline such that the time a particular word is spoken is also stored or otherwise associated with the word. As shown in, an additional option includes the ability to simply comment on the storyboard as indicated at reference numeral. Further, a folder view can be selected by interacting with user interface element. Audit trails can be viewed by the user by interacting with user interface element. Embodiments described herein also provide the ability to simply play/export the entire storyboard as a single video file that can then be shared. The processing/exporting of the entire storyboard into the single video file can be done as a background process that occurs on-premise, in the cloud, or both.

Media can be synced to the timeline by selecting user interface element. The ability to synchronize the time of a particular media file to another media file is particularly useful when determining precise chronology of events/utterances. In one example, a time marker or position in a source media file can be matched to a user-selected time marker or position in a destination media file where the destination media file will have its time changes such that the destination time marker or position is identical to the time marker or position of the source media file. In another example, a doorbell camera may have a source time and a squad camera that can be seen driving by the doorbell camera at a particular instant can be synchronized to the time of the doorbell camera by using the instant when the squad passes the doorbell camera. Certainly, other types of time synchronization can be utilized in accordance with embodiments described herein. For example, the audio between two files can be matched such that the time of an occurrence of a particular word in one file can be correlated to the occurrence of the particular word in another file to synchronize time of one of the files to the other file. Additionally, metadata, such as date/time can be automatically extracted from on-screen data, such as is commonly provided on commercially available dash cameras or body cameras. This metadata can then be used to automatically place the media properly on the right spot of the timeline.

Referring to, option/function panealso includes a highlighter function that can be used to highlight a particular element or time in the storyboard by selecting user interface element. Finally, the user may view metadata of the storyboard and/or any particular media files associated therewith by selecting user interface element. When the user selects option, the application will transition to a customized layout view.

is a diagrammatic screenshot of a layout customization function of a storyboard application in accordance with one embodiment. Screenshotshows all of the media files associated with the particular timeline, as well as option windowfor selecting a particular layout. In the illustrated example, layouts can include a 2 by 2 layout, a 3 by 3 layout, a 4 by 4 layout, or a custom layout as indicated at reference numeral. In the example shown in, a 3 by 3 grid is shown. However, if the user select's a different value, such as 2 by 2, the storyboard timeline view will switch to that shown inwhich is a 2 by 2 grid of the media files.

The system thus allows the user to create and play a summary of a particular instant. The summary is preferably a single video comprised of specified video clips from various video files to present the most important elements of an incident.

is a diagrammatic screenshot of a summary comprised of user-selected media clips. Screenshotincludes a current video windowas well as a listingof the various clips included in the summary. The listdisplays the clips included in the summary, what videos the clips were taken from, and the duration of each of the clips. The user can preferably download the summary and use the summary as a presentation tool. One of the features of embodiments described herein is the ease with which various summaries can be created.

is a diagrammatic view of a summary creation functionality screen of a storyboard application in accordance with one embodiment. Screenincludes a listingof all files available to be used in the summary. The user may add a custom title screen to the summary, as desired. This title screen may provide context about the summary or any other suitable information relative to the summary or incident. When a user clicks on a particular file in the media list, the display transitions to that shown in.

In, the user has selected video indicated at shaded box. To create a particular snip, the user marks the beginning of the snip by pressing buttonand the goal posts(start),(end) on timeline. When the user clicks buttonagain, the other goal postmarks the end of the snip. The user presses the scissors buttonand the snip can be named and then added to snip list. The user can also add titles to the files playing and determine the length of time that the title is displayed. The user can also play the summary in slow motion or play the summary frame by frame.

Referring back to, if a user selects edit media option, the screen will transition to that shown in, which is a diagrammatic screenshot of an edit media function of a storyboard application in accordance with one embodiment. Screenincludes a listing of all media associated with a particular incident. As shown in screen, a folders listingis provided showing the various folders that contain files or media associated with the incident. Additionally, a search functionality in provided using search window. The search may be based on individual keywords or one or more tags provided in tag window. The search may also employ categories provided in category windowas well as various start or stop times provided in respective windows,, priority, media type, and/or timeline flag. As can be appreciated, the searching can be based on any combination of these various fields. A media display windowlists the various media files associated with the incident. Preferably, a media code is provided at columnas well as a name of the media file at column. Start time and play time are provided at columns, and, respectively. Media type is listed in columnand the size of the media file is listed at column. At column, the upload status of a particular media file is shown. This upload status may indicate that the file has been completely uploaded into the storyboard application, is presently being uploaded into the storyboard application, or has not yet been uploaded into the storyboard application. Additionally, an action columnis also provided that includes a pair of actions. One actionallows the user to delete the particular media file from the timeline. Additionally, user interface elementallows the user to edit the media. When the user selects the edit media user interface elementin screen, the application will transition to that shown in.

is a diagrammatic screenshot of an edit media user interface presented to a user when the user clicks on an edit action(shown in) for a particular media file. In the illustrated example, screenshows that the user has chosen to edit media for a video clip entitled “Minneapolis Mayor calls for officer involved in George Floyd's death to be charged.mp4”. As shown in, the media name can include both a short descriptionas well as full description. An additional windowlets the user set the start date and time of the video. Further, fieldallows the user to set a priority of the media file and fieldallows the user to set a category for the particular media file. Fieldallows the user to enter one or more tags relative to the media, and check boxallows the user to set whether the media file is presented on the base storyboard. When the information has been edited to the user's satisfaction, buttonis pressed by the user and the information is updated for the selected media file. In the event that the user does not wish to update the information, buttoncan be selected to simply close the edit media interface.

is a diagrammatic screenshot of a transcription user interface for a storyboard application in accordance with one embodiment. A listingon the left side of the interfaceshows the media files that have transcriptions available. To create a transcription, the user presses the arrow down symbol next to the file at the left. In, an arrow down symbol for the surveillance video is illustrated at reference numeral. Any file that has a printer and arrow down icon has a transcription available to print or download. When the user selects the create transcription file, all audio from the selected media file will be automatically fed to a speech recognition module to convert utterances to words. As can be appreciated, when all or substantially all of the media files for a particular incident have transcriptions, powerful searching is enabled. Additionally, since automated transcription is not yet 100% error-proof, embodiments described herein provide a transcription editing function that allows the user to manually edit the transcription. When this is done, the system provides a display of the original transcribed text as well as the edited text. The transcribed text can also be overlayed upon a video file similar to close captioning. Additionally, custom subtitles or text can be placed on the video at any desired location (top, bottom, etc.). These custom subtitles are considered custom in that they are generated by the user. They may be placed on the video along with or instead of the transcription text.

is a diagrammatic screenshot of a word search among transcriptions of media files for a particular incident. Screenshotincludes a word search boxin which the user has typed the word “help”. As a result, the search function has identified three media files,, andthat were searched. In the identified media file, the word “help” is identified at particular times in the media file. This can be useful to allow the user to quickly move the video to the location in the video where the utterance is heard.

The present discussion has mentioned processors and servers. In one embodiment, the processors and servers include computer processors with associated memory and timing circuitry, not separately shown. They are functional parts of the systems or devices to which they belong and are activated by, and facilitate the functionality of the other components or items in those systems.

Also, a number of user interface displays have been discussed. They can take a wide variety of different forms and can have a wide variety of different user actuatable input mechanisms disposed thereon. For instance, the user actuatable input mechanisms can be text boxes, check boxes, icons, links, drop-down menus, search boxes, etc. They can also be actuated in a wide variety of different ways. For instance, they can be actuated using a point and click device (such as a track ball or mouse). They can be actuated using hardware buttons, switches, a joystick or keyboard, thumb switches or thumb pads, etc. They can also be actuated using a virtual keyboard or other virtual actuators. In addition, where the screen on which they are displayed is a touch sensitive screen, they can be actuated using touch gestures. Also, where the device that displays them has speech recognition components, they can be actuated using speech commands.

A number of data stores have also been discussed. It will be noted they can each be broken into multiple data stores. All can be local to the systems accessing them, all can be remote, or some can be local while others are remote. All of these configurations are contemplated herein.

Also, the FIGURES show a number of blocks with functionality ascribed to each block. It will be noted that fewer blocks can be used so the functionality is performed by fewer components. Also, more blocks can be used with the functionality distributed among more components.

It will also be noted that the automatic incident compilation system described herein, or portions of it, can be located and/or executed on a wide variety of different devices. Some of these devices include servers, desktop computers, laptop computers, tablet computers, or other mobile devices such as palm top computers, cell phones, smartphones, multi-media players, personal digital assistance, etc.

is a simplified block diagram of one illustrative embodiment of a handheld or mobile computing device that can be used as a user's or client's handheld devicein which the present system (or parts of it) can be deployed.are examples of handheld or mobile devices.

provides a general block diagram of the components of a client devicethat can run components of the automatic incident compilation system and/or which interacts with it. In the device, a communications linkis provided that allows the handheld device to communicate with other computing devices, and under some embodiments, provides a channel for receiving information automatically, such as by scanning. Examples of communications linkinclude an infrared port, a serial/USB port, a cable network port such as an Ethernet port, and a wireless network port allowing communications through one of more communication protocols including General Packet RadioService (GPRS), LTE, HSPA, HSPA+ and other 3G and 4G radio protocols, 1×rtt, and Short Message Service, which are wireless services used to provide cellular access to a network, as well as Wi-Fi protocols, and Bluetooth protocol, which provide local wireless connections to networks.

Under other embodiments, applications or systems are received on a removable Secure Digital (SD) card that is connected to a SD card interface. SD card interfaceand communication linkscommunicate with a processoralong a busthat is also connected to memoryand input/output (I/O) components, as well as clockand location system.

I/O components, in various embodiments, are provided to facilitate input and output operations. I/O componentsof the devicecan include input components such as buttons, touch sensors, multi-touch sensors, optical or video sensors, voice sensors, touch screens, proximity sensors, microphones, tilt sensors, and gravity switches and output components such as a display device, a speaker, and/or a printer port. Other I/O componentscan be used as well.

Clockillustratively comprises a real time clock component that outputs a time and date. It can also, illustratively, provide timing functions for processor.

Location systemillustratively includes a component that outputs a current geographical location of device. This can include, for instance, a global positioning system (GPS) receiver, a LORAN system, a dead reckoning system, a cellular triangulation system, or other positioning system. It can also include, for example, mapping software or navigation software that generates desired maps, navigation routes and other geographic functions.

Memorystores operating system, network settings, applications, application configuration settings, data store, communication drivers, and communication configuration settings. Memorycan include all types of tangible volatile and non-volatile computer-readable memory devices. It can also include computer storage media. Memorystores computer readable instructions that, when executed by processor, cause the processor to perform computer-implemented steps or functions according to the instructions. Devicecan have a client systemwhich can run various video conferencing applications. Processorcan be activated by other components to facilitate their functionality as well.

Examples of the network settingsinclude things such as proxy information, Internet connection information, and mappings. Application configuration settingsinclude settings that tailor the application for a specific enterprise or user. Communication configuration settingsprovide parameters for communicating with other computers and include items such as GPRS parameters, SMS parameters, connection user names and passwords.

Applicationscan be applications that have previously been stored on the deviceor applications that are installed during use, although these can be part of operating system, or hosted external to device, as well.

shows one embodiment in which deviceis a tablet computer. Screencan be a touch screen (so touch gestures from a user's finger can be used to interact with the application) or a pen-enabled interface that receives inputs from a pen or stylus. It can also use an on-screen virtual keyboard. Of course, it might also be attached to a keyboard or other user input device through a suitable attachment mechanism, such as a wireless link or USB port, for instance. Computercan also illustratively receive voice inputs as well.

Tabletmay be useful for a displaying a storyboard or a summary of a storyboard because it is portable and includes a relatively large display that can provide a wealth of information.

Additional examples of devicecan be used as well. Devicecan be a feature phone, smart phone or mobile phone. The phone can include a set of keypads for dialing phone numbers, a display capable of displaying images including application images, icons, web pages, photographs, and video, and control buttons for selecting items shown on the display. The phone can include an antenna for receiving cellular phone signals such as General Packet Radio Service (GPRS) and 1×rtt, and Short Message Service (SMS) signals. In some examples the phone also includes a Secure Digital (SD) card slot that accepts a SD card.

The mobile device can also be a personal digital assistant or a multimedia player or a tablet computing device, etc. (hereinafter referred to as a PDA). The PDA can include an inductive screen that senses the position of a stylus (or other pointers, such as a user's finger) when the stylus is positioned over the screen. This allows the user to select, highlight, and move items on the screen as well as draw and write. The PDA can also include a number of user input keys or buttons which allow the user to scroll through menu options or other display options which are displayed on the display, and allow the user to change applications or select user input functions, without contacting the display. The PDA can also include an internal antenna and an infrared transmitter/receiver that allow for wireless communication with other computers as well as connection ports that allow for hardware connections to other computing devices. Such hardware connections are typically made through a cradle that connects to the other computer through a serial or USB port. As such, these connections are non-network connections.

is similar toexcept that the mobile device is a smart phone. Smart phonehas a touch sensitive displaythat displays icons or tiles or other user input mechanisms. Mechanismscan be used by a user to run applications, make calls, perform data transfer operations, etc. In general, smart phoneis built on a mobile operating system and offers more advanced computing capability and connectivity than a feature phone.