Utilizing text-based input to dynamic select and present specific portions of audiovisual content to user

Over the past few years, the amount of content that is available to a user has grown substantially. Likewise, users are consuming more and more content. Unfortunately, as the amount of content grows, the ability of the user to find or re-experience, or share, previously consumed content is becoming more difficult. It can be challenging for a user to remember the name of specific content that they have consumed. Without remembering the name of the content, users may rely on other information, such as the actors, genre, or a generic description of the content. But the user may not remember this information, or it may not be sufficient to locate the content. This inability to locate previously consumed content can be exaggerated when the user wants to re-experience a small portion of the previously consumed content, such as a specific scene. Many users do not remember where in the content that small portion is located. It is with respect to these and other considerations that the embodiments herein have been made.

Briefly, embodiments descried herein are directed to dynamically selecting and presenting content to a user based on unique string-based identifiers.

Prior to users attempting to select or access specific portions of content, unique identifier/timestamp mappings a determined. A plurality of audiovisual content is accessed and processed for unique identifier/timestamp mappings. For each corresponding content of the plurality of content, an audio portion of the corresponding content is converted into a plurality of text strings. A unique identifier is generated for each corresponding text string. Likewise, a corresponding timestamp is determined for the corresponding text string within the corresponding content. A mapping between the timestamp and the unique identifier for the corresponding text string for the corresponding content is then stored. The unique identifier/timestamp mappings may be stored in a remote database or as metadata of the corresponding content.

At some time after the unique identifier/timestamp mappings are stored for the plurality of content, an input may be received from a user. The input may include manually entered text or it may include an audio input that can be converted to input text. A target unique identifier is determined based on the input. The mappings may be employed to identify a timestamp that is mapped to the target unique identifier. In some embodiments, the timestamp can be used to adjust the playback of current content being presented to the user. In other embodiments, the timestamp can be used to clip a portion of target content, such that the clip is presented to the user.

The following description, along with the accompanying drawings, sets forth certain specific details in order to provide a thorough understanding of various disclosed embodiments. However, one skilled in the relevant art will recognize that the disclosed embodiments may be practiced in various combinations, without one or more of these specific details, or with other methods, components, devices, materials, etc. In other instances, well-known structures or components that are associated with the environment of the present disclosure, including but not limited to the communication systems and networks, have not been shown or described in order to avoid unnecessarily obscuring descriptions of the embodiments. Additionally, the various embodiments may be methods, systems, media, or devices. Accordingly, the various embodiments may be entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware aspects.

Throughout the specification, claims, and drawings, the following terms take the meaning explicitly associated herein, unless the context clearly dictates otherwise. The term “herein” refers to the specification, claims, and drawings associated with the current application. The phrases “in one embodiment,” “in another embodiment,” “in various embodiments,” “in some embodiments,” “in other embodiments,” and other variations thereof refer to one or more features, structures, functions, limitations, or characteristics of the present disclosure, and are not limited to the same or different embodiments unless the context clearly dictates otherwise. As used herein, the term “or” is an inclusive “or” operator, and is equivalent to the phrases “A or B, or both” or “A or B or C, or any combination thereof,” and lists with additional elements are similarly treated. The term “based on” is not exclusive and allows for being based on additional features, functions, aspects, or limitations not described, unless the context clearly dictates otherwise. In addition, throughout the specification, the meaning of “a,” “an,” and “the” include singular and plural references.

References herein to the term “user” refer to a person or persons who is or are accessing content to be displayed on a display device. Accordingly, a “user” more generally refers to a person or persons consuming content. Although embodiments described herein utilize user in describing the details of the various embodiments, embodiments are not so limited. For example, in some implementations, the term “user” may be replaced with the term “viewer” throughout the embodiments described herein.

1 FIG. 100 100 102 124 110 110 124 120 110 illustrates a context diagram of an environmentfor enabling text-based selection and presentation of specific portions of audiovisual content in accordance with embodiments described herein. Environmentincludes remote server, user computing device, and communication network. Communication networkmay be configured to couple various computing devices to transmit content/data from one or more devices to one or more other devices, which enables the user computing deviceto communicate with the remote server. Communication networkmay include one or more wired or wireless networks.

102 124 102 104 106 106 104 124 The remote serveris configured to generate unique identifier/timestamp mappings for a plurality of pieces of audiovisual content and to enable use of those mappings to provide content to a user of the user computing device. The audiovisual content may include movies, sitcoms, reality shows, talk shows, game shows, documentaries, infomercials, news programs, sports programs, songs, audio tracks, albums, podcasts, or the like. The remote servermay include a content clip generation systemand a unique identifier/timestamp mapping system. Briefly, the unique identifier/timestamp mapping systemgenerates unique identifiers for text strings within the audio portion of content and maps those unique identifiers to timestamps of where in the content those text strings occur. And briefly, the content clip generation systemextracts an audiovisual clip from content using the unique identifier/timestamp mappings and target text received from user computing device.

124 102 124 124 124 1 FIG. The user computing deviceis configured to enable a user to input target text and to present content to the user based on the unique identifier/timestamp mappings generated by the remote server. Examples of the user computing devicemay include, but are not limited to, a smartphone, a tablet computer, a set-top box, a cable connection box, a desktop computer, a laptop computer, a television receiver, or other content receivers. In some embodiments, the user computing devicemay include a display device (not illustrated) for presenting content to a user. Such a display device may be any kind of visual content display device, such as, but not limited to a television, monitor, projector, or other display device. Althoughillustrates a single user computing device, embodiments are not so limited and a plurality of user computing devices may be utilized or employed.

124 126 126 104 124 126 The user computing devicemay include a content playback system. In some embodiments, the content playback systemmay communicate with the remote server to receive a clip extracted by the content clip generation systembased on input received from the user of the user computing device. In other embodiments, the content playback systemmay utilize user input and the unique identifier/timestamp mappings to adjust the playback content being currently presented to the user.

2 FIG. 1 FIG. 200 200 102 124 100 102 104 106 218 is a context diagram of a non-limiting embodiment of systemsfor generating unique identifier/timestamp mappings for content for use in dynamically selecting and presenting specific portions of audiovisual content to a user in accordance with embodiments described herein. Systemsincludes a remote serverand a user computing device, similar to environmentin. The remote serverincludes a content clip generation system, a unique identifier/timestamp mapping system, and a content database.

218 106 106 220 The content databasestores, or enables access to, a plurality of pieces of audiovisual content. In some embodiments, the unique identifier/timestamp mapping systemmay modify the metadata of corresponding content to include the unique identifier/timestamp mappings for that corresponding content, as determined by the unique identifier/timestamp mapping system. In other embodiments, the unique identifier/timestamp mappings may be stored separate from the content in the unique identifier/timestamp mappings database.

106 222 224 228 The unique identifier/timestamp mapping systemincludes a speech-to-text module, a unique identifier generation module, and a unique identifier/timestamp mapping module.

228 218 228 228 224 226 224 228 228 220 228 218 The unique identifier/timestamp mapping moduleis configured to access and obtain content from the content database. If a piece of selected content has not been previously processed, as described herein, the unique identifier/timestamp mapping modulemay access the selected content such that unique identifier/timestamp mappings are generated for the selected content. The unique identifier/timestamp mapping moduleprovides the selected content to the unique identifier generation moduleand receives one or more unique identifiers for the selected content in response. In some embodiments, the content management modulemay also receive timestamps associated with each unique identifier from the unique identifier generation module. The unique identifier/timestamp mapping modulegenerates one or more unique identifier/timestamp mappings for the selected content. In some embodiments, the unique identifier/timestamp mapping modulestores the unique identifier/timestamp mappings, along with a mapping to the selected content, in the unique identifier/timestamp mappings database. In other embodiments, the unique identifier/timestamp mapping modulemay store the unique identifier/timestamp mappings in the metadata of the selected content stored by content database.

224 228 222 224 224 224 224 224 228 The unique identifier generation modulereceives the selected content from the unique identifier/timestamp mapping moduleand provides an audio portion of the selected content to the speech-to-text module. The unique identifier generation modulereceives a document identifying the text of the selected content. The unique identifier generation moduleis configured to convert that text into a plurality of text strings. In various embodiments, the unique identifier generation moduleanalyzes the text for pauses, breaks, phrases, or other spoken criteria to identify the plurality of text strings. The unique identifier generation moduleis configured to convert each text string into a unique identifier. In some embodiments, a hash or other mathematical function can be applied to the text strings to generate the unique identifiers. The unique identifier generation modulecan then provide the unique identifiers, along with the corresponding timestamps of the text strings, to the unique identifier/timestamp mapping module.

222 224 222 224 The speech-to-text module, is configured to receive the audio portion of the selected content from the unique identifier generation moduleand to convert the audio portion to text. The speech-to-text modulereturns the text, along with timestamps indicating when the text was uttered in the audio portion of the selected content, to the unique identifier generation module.

104 212 214 The content clip generation systemmay include a clip generation moduleand a unique identifier generation module.

212 124 212 214 214 224 212 220 212 218 212 124 The clip generation moduleis configured to receive target text from the user computing device. The clip generation moduleprovides the target text to the unique identifier generation module. The unique identifier generation modulemay employ embodiments similar to the unique identifier generation moduleto generate a target unique identifier from the target text. The clip generation moduleutilizes this target unique identifier to search the unique identifier/timestamp mappings databasefor content and corresponding timestamps associated with the target unique identifier. The clip generation moduleis configured to use the content and corresponding timestamps for the corresponding target unique identifier to access the content databaseand generate one or more content clips. The content generation modulecan then provide these clips to the user computing devicefor presentation to a user.

124 126 126 234 232 232 234 102 234 220 In various embodiments, the user computing deviceincludes a content playback system. The content playback systemcan include a content presentation moduleand a user input module. The user input modulemay be configured to receive user input that can be converted into target text. In some embodiments, the content presentation modulemay utilize the target text to request one or more clips containing the target text from the remote server. In other embodiments, the content presentation modulemay generate a target unique identifier for the target text, obtain correspondingly mapped timestamps (e.g., by accessing the unique identifier/timestamp mappings databaseor searching metadata of content currently being presented to the user), and adjust the playback of content to the obtained timestamp.

104 106 104 106 222 224 228 212 214 222 224 228 212 214 Although the content clip generation systemand the unique identifier/timestamp mapping systemare illustrated as separate systems, embodiments are not so limited. Rather, a single system or a plurality of systems may be utilized to implement the functionality of the content clip generation systemand the unique identifier/timestamp mapping system. Similarly, although the speech-to-text module, the unique identifier generation module, the unique identifier/timestamp mapping module, the clip generation module, and the unique identifier generation moduleare illustrated separately, embodiments are not so limited. Rather, one module or a plurality of modules may be utilized to implement the functionality of the speech-to-text module, the unique identifier generation module, the unique identifier/timestamp mapping module, the clip generation module, and the unique identifier generation module.

3 5 FIGS.- 3 5 FIGS.- 1 FIG. 300 400 500 102 124 The operation of certain aspects will now be described with respect to. Processes,, anddescribed in conjunction with, respectively, may be implemented individually or collectively by one or more processors or executed individually or collectively via circuitry on one or more specialized computing devices, such as remote serveror user devicein.

3 FIG. 300 illustrates a logical flow diagram showing one embodiment of a processfor mapping unique identifiers and corresponding timestamps for text strings associated with audiovisual content in accordance with embodiments described herein.

300 302 300 Processbegins, after a start block, at block, where a library of audiovisual content is accessed. In various embodiments, the library contains a plurality of separate pieces of audiovisual content. The audiovisual content may include movies, television shows, replays of sporting events, replays of concerts, etc. In some embodiments, the library may be stored by or remotely from the computing device performing process.

300 302 304 Processproceeds after blockto block, where a piece of content is selected from the library. In some embodiments, a user may manually select the content. In other embodiments, the content is selected such that each piece of content in the library may be systematically selected and processed in accordance with embodiments described herein.

300 304 306 Processcontinues after blockat block, where an audio portion of the selected content is converted into a plurality of text strings. One or more audio-to-text mechanism may be employed to convert the audio portion into text. Once converted to text, one or more rule-based mechanisms or machine learning mechanisms may be utilized separate the text into a plurality of text strings. These strings may include sentences, names, catchphrases, etc. One example of a text string is “Bond, James Bond.” In other embodiments, pause points between words or phrases may be used to determine the start and stop of a text string.

300 306 308 306 Processproceeds next after blockto block, where a text string is selected from the plurality of text strings. In some embodiments, a user may manually select the text string. In other embodiments, the text string may be selected such that each text string generated at blockmay be systematically selected and processed in accordance with embodiments described herein.

300 308 310 Processcontinues next after blockat block, where a unique identifier is generated and assigned to the selected text string. In some embodiments, a hash may be applied to the text string to convert it into a unique identifier. In other embodiments, each character or word in the text string may be assigned a value. These values can then be concatenated or otherwise combined to create the unique identifier for that corresponding text string.

300 310 312 Processproceeds after blockto block, where a timestamp within the selected content is determined for the selected text string. The timestamp may be a numerical value or time code identifying a position or point in time in the selected content where the audio version of the selected text string is located. In at least one embodiment, the timestamp may be associated with the first utterance of the first word of the selected text string. In other embodiments, the timestamp may be associated with the last utterance of the last word of the selected text string. In yet other embodiments, the timestamp may be a median time between a start and end of the selected text string.

In some embodiments, the timestamp may also include a time duration indicating an amount of time in which the corresponding audio is presented in the selected content for the corresponding selected text string.

300 312 314 Processcontinues after blockat block, where a mapping between the unique identifier and the timestamp are stored for the selected content. This mapping may be referred to as a unique identifier/timestamp mapping. In some embodiments, the mapping may be stored as metadata withing the selected content. In other embodiments, the mapping may be stored in a database of mappings. In this way, the database includes the unique identifier of the text string along with an identifier of the selected content and the corresponding timestamp.

In some embodiments, the same text string may be identified multiple times within the selected content. In this way, the unique identifier for that text string may be mapped to a plurality of timestamps—where each timestamp indicates a different instance of the same text string in the selected content. Likewise, the same text string may be identified in different pieces of content. In this way, the unique identifier for that text string may also be mapped to each separate piece of content that includes that text string and the corresponding timestamp(s) in that piece of content.

300 314 316 Processproceeds after blockto decision block, where a determination is made whether to select another text string for the selected content. In some embodiments, a user may select another text string. In other embodiments, each text string is systematically selected, and if there is another string yet to be selected, then the next text string is selected.

As noted above, the same text string may be located multiple times within the selected content. Each instance of a text string may be individually selected such that each corresponding timestamp is identified and mapped to the unique identifier for that text string. In other embodiments, a single instance of a text string may be selected and all corresponding timestamps for the text string may be determined and mapped to the unique identifier for that text string.

300 308 300 318 If another text string is to be selected, then processloops to blockto select another text string; otherwise, processflows to decision block.

318 300 304 At decision block, a determination is made whether to select another piece of content. In some embodiments, a user may select another piece of content. In other embodiments, another piece of content may be selected if the library of content is being systematically processed and there is an unselected and unprocessed content remaining in the library. If another piece of content is to be selected, processloops to block; otherwise, process terminates or otherwise returns to a calling process to perform other actions.

4 FIG. 400 illustrates a logical flow diagram showing one embodiment of a processfor adjusting playback of target content using a unique identifier for target text provided by a user in accordance with embodiments described herein.

400 402 Processbegins, after a start block, at block, where presentation and playback of target content to a user is initiated. In some embodiments, the user selects and starts playback of the target content, such that the target content is presented to the user.

400 402 404 Processproceeds after blockto decision block, where a determination is made whether an input containing target text has been received from the user prior to or during playback of the target content. In some embodiments, the user may manually type the target text into a graphical user interface. In other embodiments, the user may speak the target text into a microphone. In this situation, the user device, or another computing device, may convert the audio from the user's speech into the target text.

As one example, the user may be watching the James Bond movie “Dr. No” and may want to view the portion of the movie where the James Bond says “Bond, James Bond.” As such, the user may input the phrase “Bond, James Bond.”

400 406 400 404 If an input is received from the user and that input contains target text, then processflows to block; otherwise, processloops to decision blockto continue presentation of the target content to the user and await user input.

406 406 310 At block, a target unique identifier is generated from the input. In various embodiments, blockmay employ embodiments of blockto generate the target unique identifier from the target text associated with the input. Using the example above, a target unique identifier is generated for the phrase “Bond, James Bond.”

400 406 408 408 314 3 FIG. Processcontinues after blockat block, where unique identifier/timestamp mappings are accessed for the target content being presented to the user. In various embodiments, blockmay access the unique identifier/timestamp mappings generated at blockin. Accordingly, in some embodiments, the unique identifier/timestamp mappings for the target content are stored in a database. The database may be accessed using an identifier of the target content being presented to the user to determine or identify the particular unique identifier/timestamp mappings for that target content. In other embodiments, the unique identifier/timestamp mappings may be stored in metadata of the target content being presented to the user.

400 408 410 Processproceeds next after blockat block, where the mappings are searched for the target unique identifier. In some embodiments, the mappings may be searched for an exact match between the unique identifier of a mapping and the target unique identifier. In other embodiments, the mappings may be searched for a unique identifier of a mapping that is within a threshold difference from the target unique identifier.

Continuing the previous example, all unique identifier/timestamp mappings for the movie “Dr. No” are searched for the target unique identifier associated with the phrase “Bond, James Bond.”

400 410 412 400 414 400 404 Processcontinues next after blockat decision block, where a determination is made whether the target unique identifier is found in the mappings. If the target unique identifier is found in the mappings, by either an exact match or within a similarity threshold, then processflows to block; otherwise, processloops to decision blockto continue presentation of the target content to the user and await additional user input.

406 410 400 412 414 In some embodiments, if there is no match, or similarity, between the target unique identifier and the mappings, then the input text from the user may be separated input multiple sub-text portions. A secondary target unique identifier may be generated for each separate sub-set text portion at block. The mappings can then be searched at blockfor each of these secondary target unique identifiers. If a secondary target unique identifier matches or is within a similarity threshold of a unique identifier of a mapping, then processflows from decision blockto blockfor that secondary target unique identifier.

414 At block, a timestamp that is mapped to the target unique identifier is determined. In various embodiments, the mappings include one or more timestamps that are associated with a corresponding unique identifier. Accordingly, the one or more timestamps associated with the corresponding mapped unique identifier is obtained. The timestamps identify where in the target content the audio of the corresponding text string associated with the unique identifier can be found.

For example, in the movie “Dr. No” the phrase “Bond, James Bond” may be uttered one minute 45 seconds into the film. As a result, the mapping between the unique identifier for “Bond, James Bond” in the movie “Dr. No” may identify the timestamp as 00:01:45.

400 414 416 Processproceeds after blockto block, playback of the target content is adjusted based on the determined timestamp. In some embodiments, the target content is fast forward or rewound to the determined timestamp. In other embodiments, the target content may be fast forward or rewound to a position relative to the determined timestamp, such as two seconds before the determined timestamp.

Continuing the example above, the movie “Dr. No” may be fast forward or rewound, or skipped, to the 00:01:45 position. In this way, the user can watch the iconic scene where James Bond says “Bond, James Bond” for the very first time in the movie “Dr. No.”

In some embodiments, if a plurality of timestamps are determined for the target unique identifier, then the playback of the target content may be further adjusted after a determined amount of time or in response to input from the user. In this way, the user can view each separate portion of the target content that includes the target text input by the user.

416 400 404 After block, processmay loop to decision blockto continue presentation of the target content to the user and await additional user input.

5 FIG. 500 illustrates a logical flow diagram showing one embodiment of a processfor extracting a clip from content using a unique identifier for target text provided by a user in accordance with embodiments described herein.

500 502 Processbegins, after a start block, at block, where target text is received. In various embodiments, a user may input the target text by manually typing the target text into a graphical user interface. In other embodiments, the user may speak the target text into a microphone. In this situation, audio from the user's speech may be converted into the target text.

500 502 504 504 310 Processproceeds after blockto block, where a target unique identifier is generated from the target text. In various embodiments, blockmay employ embodiments of blockto generate the target unique identifier from the target text.

500 504 506 506 314 3 FIG. Processcontinues after blockat block, where unique identifier/timestamp mappings are accessed. In various embodiments, blockmay access the unique identifier/timestamp mappings generated at blockin. Accordingly, in some embodiments, a database of unique identifier/timestamp mappings for a plurality of content may be accessed. In other embodiments, the metadata of a plurality of content may be analyzed to access the unique identifier/timestamp mappings of each piece of content.

500 506 508 508 410 4 FIG. Processproceeds next after blockat block, where the mappings are searched for the target unique identifier. In some embodiments, blockmay employ embodiments of blockinto search the mappings for the target unique identifier.

500 508 510 510 412 500 512 500 518 4 FIG. Processcontinues next after blockat decision block, where a determination is made whether the target unique identifier is found in the mappings. In various embodiments, decision blockmay employ embodiments of blockinto determine if the target unique identifier is found in the mappings. If the target unique identifier is found in the mappings, then processflows to block; otherwise, processflows to block.

518 518 500 At block, a notification is provided to the user indicating that the target text cannot be located in the content. After block, processterminates or otherwise returns to a calling process to perform other actions.

510 500 510 512 510 504 508 500 510 512 If, at decision block, the target unique identifier is found in the mappings, then processflows from decision blockto block. In some embodiments, if there is no match, or similarity, between the target unique identifier and the mappings at decision block, then the target text from the user may be separated input multiple sub-text portions. A secondary target unique identifier may be generated for each separate sub-set text portion at block. The mappings can then be searched at blockfor each of these secondary target unique identifiers. If a secondary target unique identifier matches or is within a similarity threshold of a unique identifier of a mapping, then processflows from decision blockto blockfor that secondary target unique identifier.

512 At block, target content and a corresponding timestamp that are mapped to the target unique identifier are determined. In various embodiments, the target content and the corresponding timestamp are obtained from the mapping that corresponds to the unique identifier.

Similar to the example above, if the user wants to find movie clips where James Bond says “Bond, James Bond,” then the mappings are search for the unique identifier for “Bond, James Bond.” In response, each movie that contains the phrase “Bond, James Bond” is identifier from the mapping, along with one or more timestamps within those movies for when the phrase is uttered.

500 512 514 Processproceeds after blockto block, where an audiovisual clip is extracted from the target content based on the determined timestamp. In some embodiments, the clip may begin at the timestamp. In other embodiments, the clip may begin at a selected amount prior to the timestamp, such as two seconds.

In various embodiments, the length of the clip may be based on a predetermined duration. In other embodiments, the user may input the duration of the clip. In yet other embodiments, the duration may be determined based on the amount of time associated with the text string used to generate the unique identifier of the mapping.

Continuing the example above, an audiovisual clip may be extracted from each identified James Bond movie based on the identified timestamps. In some embodiments, separate audiovisual clips may be generated for each instance the phrase is uttered. In other embodiments, a single audiovisual clip may be generated from a concatenation or combination of each individual clip.

500 514 516 Processcontinues after blockat block, where the extracted audiovisual clip is provided to the user. In some embodiments, the extracted audiovisual clip is provided to a user device of the user, which can then present the clip to the user.

As described herein, the mapping for a specific unique identifier may include one corresponding timestamp or a plurality of timestamps. Likewise, the mapping for a specific unique identifier may include one corresponding target content or a plurality of corresponding target content. Accordingly, a separate audiovisual clip may be extracted for each separate timestamp of each separate target content mapped to the target unique identifier. In this way, the user can be provided a plurality of clips from different content that share the text string used to generate the target unique identifier.

516 500 After block, processterminates or otherwise returns to a calling process to perform other actions.

6 FIG. 1 2 FIGS.and 600 102 124 shows a system diagram that describes one implementation of computing systems for implementing embodiments described herein. Systemincludes remote serverand user computing device, similar to what is described above in conjunction with.

102 102 628 644 648 650 652 As described herein, the remote serveris a computing device that can perform functionality described herein for generating text-based unique identifier/timestamp mappings for content and generating extracted content clips using the mappings and user-provided text. One or more special purpose computing systems may be used to implement the remote server. Accordingly, various embodiments described herein may be implemented in software, hardware, firmware, or in some combination thereof. The remote server includes memory, processor, network interface, input/output (I/O) interfaces, and other computer-readable media.

644 102 644 102 644 644 102 644 102 644 102 644 102 644 Processorincludes one or more processors, one or more processing units, programmable logic, circuitry, or one or more other computing components that are configured to perform embodiments described herein or to execute computer instructions to perform embodiments described herein. In some embodiments, a processor system of the remote servermay include a single processorthat operates individually to perform actions. In other embodiments, a processor system of the remote servermay include a plurality of processorsthat operate to collectively perform actions, such that one or more processorsmay operate to perform some, but not all, of such actions. Reference herein to “a processor system” of the remote serverrefers to one or more processorsthat individually or collectively perform actions. And reference herein to “the processor system” of the remote serverrefers to 1) a subset or all of the one or more processorscomprised by “a processor system” of the remote serverand 2) any combination of the one or more processorscomprised by “a processor system” of the remote serverand one or more other processors.

628 628 628 644 Memorymay include one or more various types of non-volatile or volatile storage technologies. Examples of memoryinclude, but are not limited to, flash memory, hard disk drives, optical drives, solid-state drives, various types of random-access memory (“RAM”), various types of read-only memory (“ROM”), other computer-readable storage media (also referred to as processor-readable storage media), or other memory technologies, or any combination thereof. Memorymay be utilized to store information, including computer-readable instructions that are utilized by a processor system of one or more processorsto perform actions, including at least some embodiments described herein.

628 104 106 106 104 124 124 Memorymay have stored thereon content clip generation systemand content text identifier generation system. The content text identifier generation systemis configured to generate unique identifier/timestamp mappings for a plurality of content, where the unique identifiers are generated from text strings that correspond to audio of the content and the timestamps indicate where in the content that audio occurs. The content clip generation systemis configured to receive target text from user computing device, identify unique identifier/timestamp mappings for the target text, generate an audiovisual clip based on the mappings, and provide the clip to the user computing devicefor presentation to a user.

628 218 220 218 220 218 Memorymay include content databaseand unique identifier/timestamp mappings database. The content databasemay store a plurality of content, as described herein. And the unique identifier/timestamp mappings databasemay store a plurality of mappings between unique identifiers and timestamps for the content in content database, as described herein.

652 124 124 648 652 Network interfaceis configured to communicate with other computing devices, such as to receive input from user computing deviceand to provide target content to the user computing device. I/O interfacesmay include interfaces for various input or output devices, such as USB interfaces, physical buttons, keyboards, haptic interfaces, tactile interfaces, or the like. Other computer-readable mediamay include other types of stationary or removable computer-readable media, such as removable flash drives, external hard drives, or the like.

124 124 124 660 672 678 648 674 As described herein, the user computing deviceis a computing device that can perform functionality described herein for receiving user input that contains target text, presenting content to the user, and adjusting playback of the content based on the user input and the unique identifier/timestamp mappings. One or more special purpose computing systems may be used to implement the user computing device. Accordingly, various embodiments described herein may be implemented in software, hardware, firmware, or in some combination thereof. The user computing deviceincludes memory, processor, network interface, input/output (I/O) interfaces, and other computer-readable media.

672 644 124 672 124 672 644 124 672 124 672 124 672 124 672 Processormay be an embodiment of process. Accordingly, a processor system of the user computing devicemay include a single processorthat operates individually to perform actions. In other embodiments, a processor system of the user computing devicemay include a plurality of processorsthat operate to collectively perform actions, such that one or more processorsmay operate to perform some, but not all, of such actions. Reference herein to “a processor system” of the user computing devicerefers to one or more processorsthat individually or collectively perform actions. And reference herein to “the processor system” of the user computing devicerefers to 1) a subset or all of the one or more processorscomprised by “a processor system” of the user computing deviceand 2) any combination of the one or more processorscomprised by “a processor system” of the user computing deviceand one or more other processors.

660 628 660 672 Memorymay be similar to memory. Memorymay be utilized to store information, including computer-readable instructions that are utilized by a processor system of one or more processorsto perform actions, including at least some embodiments described herein.

660 126 Memorymay have stored thereon content playback system, which is configured to enable a user to provide input and to present or adjust playback of the content based on the input, as described herein.

678 102 676 674 Network interfaceis configured to communicate with other computing devices, such as remote server. I/O interfacesmay include interfaces for various input or output devices, such as USB interfaces, physical buttons, keyboards, haptic interfaces, tactile interfaces, or the like. Other computer-readable mediamay include other types of stationary or removable computer-readable media, such as removable flash drives, external hard drives, or the like.

The following is a summarization of the claims as originally filed.

A method may be summarized as comprising: accessing a plurality of audiovisual content; for each corresponding content of the plurality of content: converting an audio portion of the corresponding content into a plurality of text strings; and for each corresponding text string of the plurality of text strings: generating a unique identifier for the corresponding text string; determining a timestamp for the corresponding text string within the corresponding content; and storing a mapping between the timestamp and the unique identifier for the corresponding text string for the corresponding content; receiving input from a user; determining a target unique identifier based on the input; employing the target unique identifier and the mappings between timestamps and unique identifiers to identify target content for the user; and presenting the target content to the user.

The method may determine the target unique identifier based on the input including: converting the input to target text; and generating the target unique identifier based on the target text.

The method may employ the target unique identifier and the mappings between timestamps and unique identifiers to identify target content for the user including: searching the stored mappings for the target unique identifier; identifying a target timestamp associated with the target unique identifier; and adjusting playback of the target content based on the target timestamp.

The method may employ the target unique identifier and the mappings between timestamps and unique identifiers to identify target content for the user including: searching the stored mappings for the target unique identifier; identifying content and a target timestamp associated with the target unique identifier; and extracting the target content from the identified content based on the target timestamp.

The method may employ the target unique identifier and the mappings between timestamps and unique identifiers to identify target content for the user including: employing the target unique identifier and the mappings between timestamps and unique identifiers to identify second target content for the user; and presenting the second target content to user.

The method may employ the target unique identifier and the mappings between timestamps and unique identifiers to identify target content for the user including: searching the stored mappings for the target unique identifier; identifying a plurality of target content and corresponding target timestamps associated with the target unique identifier for each of the plurality of target content; and extracting a plurality of content clips as the target content from the plurality of target content based on the corresponding target timestamps.

Each text string of the plurality of text strings in the method may include a plurality of words.

The method may convert the audio portion of the corresponding content into the plurality of text strings including: employing audio-to-text mechanism on the audio portion of the corresponding content to generate a plurality of text; identifying pause points within the audio portion; and generating the plurality of text strings from the plurality of text based on the pause points.

The method may store the mapping between the timestamp and the unique identifier for the corresponding text string for the corresponding content including: storing the mapping in metadata of the corresponding content.

The method may store the mapping between the timestamp and the unique identifier for the corresponding text string for the corresponding content including: storing the mapping in a database containing a plurality of mappings between timestamps and unique identifiers for the plurality of content.

A system may be summarized as, comprising: a remote server configured to: convert an audio portion of each corresponding content of a plurality of content into a plurality of text strings; generate unique identifiers for each unique text string of the plurality of text string; determine timestamps and the corresponding content for each unique identifier based on when each unique text string occurs within the plurality of content; and store mappings between the timestamps, the unique identifiers, and the corresponding content for the plurality of text strings; and enable a user device to adjust playback of target content based on user input and the stored mappings.

The system may further comprise: a user device configured to: receive the user input from a user for target content from the plurality of content; determine a target unique identifier based on the input; employ the target unique identifier and the stored mappings to identify target timestamp within the target content; and adjust playback of the target content based on the target timestamp.

The user device of the system may determine the target unique identifier based on the input by being further configured to: convert the input to target text; and generate the target unique identifier based on the target text.

The user device of the system may employ the target unique identifier and the stored mappings to identify target content for the user by being further configured to: employ the target unique identifier and the mappings between timestamps and unique identifiers to identify a second target timestamp within the target content; and adjust playback of the target content based on the second target timestamp.

Each text string of the plurality of text strings may include a plurality of words.

The remote server of the system may convert the audio portion of each corresponding content into the plurality of text strings by being further configured to: employ an audio-to-text mechanism on the audio portion of each corresponding content to generate a plurality of text; identify pause points within the audio portion for each corresponding content; and generate the plurality of text strings from the plurality of text based on the pause points.

Another system may be summarized as comprising: a remote server and a user device. The remote server may be configured to: convert an audio portion of each corresponding content of a plurality of content into a plurality of text strings; generate unique identifiers for each unique text string of the plurality of text string; determine timestamps and the corresponding content for each unique identifier based on when each unique text string occurs within the plurality of content; and store mappings between the timestamps, the unique identifiers, and the corresponding content for the plurality of text strings; receive input from a user; determine a target unique identifier based on the input; employ the target unique identifier and the stored mappings to identify target content from the plurality of content and a target timestamp within the target content; and generate a clip from the target content based on the target timestamp. And the user device may be configured to: receive the input from a user; provide the input to the remote server; receive the clip from the remote server; and present the clip to the user.

The remote server of the system may determine the target unique identifier based on the input by being further configured to: convert the input to target text; and generate the target unique identifier based on the target text.

Each text string of the plurality of text strings may include a plurality of words.

The remote serve of the system may store the mappings between the timestamps, the unique identifiers, and the corresponding content text string for the corresponding content by being further configured to: store the mapping in metadata of the corresponding content.

The remote serve of the system may store the mappings between the timestamps, the unique identifiers, and the corresponding content text string for the corresponding content by being further configured to: store the mappings in a database containing a plurality of mappings for the plurality of content.

The various embodiments described above can be combined to provide further embodiments. These and other changes can be made to the embodiments in light of the above-detailed description. In general, in the following claims, the terms used should not be construed to limit the claims to the specific embodiments disclosed in the specification and the claims, but should be construed to include all possible embodiments along with the full scope of equivalents to which such claims are entitled. Accordingly, the claims are not limited by the disclosure.