Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. In a collaboration session comprising a plurality of collaboration participants, a method for generating a collaboration media stream and a collaboration timeline of the collaboration session, the method comprising: receiving media streams associated with a plurality of collaboration participants during a collaboration session, each collaboration participant collaborating via a corresponding processing device of a plurality of processing devices that are communicatively coupled to one another, the collaboration session comprising a real-time information exchange between the plurality of collaboration participants during the collaboration session; forming a collaboration media stream based on the media streams, the collaboration media stream including a media stream time index; determining that a collaboration application has generated an artifact during the collaboration session, the collaboration application adapted to receive input from at least two of the plurality of collaboration participants; and generating a timeline entry in a collaboration timeline, the timeline entry comprising time information identifying a time associated with the artifact, and a reference to the artifact; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference.
A method for creating a collaboration timeline from a real-time collaboration session with multiple participants, each using a device. The method involves receiving media streams (audio, video) from each participant's device and combining these into a single collaboration media stream, indexed by time. When a collaborative application (accessible by at least two participants) generates a file or data object ("artifact") during the session, a timeline entry is created. This entry contains the time the artifact was created and an external reference (pointer or link) to the artifact's location, separate from the media stream's time index.
2. The method of claim 1 , further comprising generating a plurality of timeline entries in the collaboration timeline, each of the plurality of timeline entries corresponding to one of a plurality of artifacts generated during the collaboration session.
The method for creating a collaboration timeline described in the previous claim further includes generating multiple timeline entries. Each timeline entry corresponds to a different artifact that was created during the real-time collaboration session by a collaborative application accessible by at least two participants. The artifacts are generated during the session, and each entry contains the time of creation and a reference to the artifact's location.
3. The method of claim 1 , wherein the timeline entry further comprises data identifying the collaboration application that generated the artifact.
The method for creating a collaboration timeline described where the collaboration timeline includes time information identifying a time associated with an artifact, and a reference to the artifact; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, includes also including the name or identifier of the application that generated the artifact in the timeline entry itself.
4. The method of claim 1 , further comprising receiving the artifact from the collaboration application.
The method for creating a collaboration timeline described where the collaboration timeline includes time information identifying a time associated with an artifact, and a reference to the artifact; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, includes also receiving the actual artifact data directly from the collaboration application that created it.
5. The method of claim 1 , wherein the reference to the artifact comprises a copy of the artifact as the artifact was rendered on one of the plurality of processing devices.
The method for creating a collaboration timeline described where the collaboration timeline includes time information identifying a time associated with an artifact, and a reference to the artifact; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, uses, as the reference to the artifact, a copy of how the artifact appeared on one of the participant's screens when it was created. This is a snapshot or rendering of the artifact.
6. The method of claim 1 , wherein the reference to the artifact comprises a pointer to a storage location which stores the artifact separately from the collaboration timeline.
The method for creating a collaboration timeline described where the collaboration timeline includes time information identifying a time associated with an artifact, and a reference to the artifact; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, utilizes a pointer or URL to a separate storage location where the artifact is stored independently from the collaboration timeline data.
7. The method of claim 1 , wherein determining that the collaboration application has generated the artifact during the collaboration session further comprises receiving a notification from the collaboration application indicating that the collaboration application has generated the artifact.
The method for creating a collaboration timeline described where the collaboration timeline includes time information identifying a time associated with an artifact, and a reference to the artifact; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, determines an artifact has been created by receiving a notification message directly from the collaboration application, indicating that it has generated a new artifact.
8. The method of claim 1 , wherein the artifact is one of an image and an audio segment.
The method for creating a collaboration timeline described where the collaboration timeline includes time information identifying a time associated with an artifact, and a reference to the artifact; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, specifies that the artifact can be either an image file or a segment of audio recorded during the collaboration session.
9. A media server, comprising: a communications interface adapted to communicate with a network; and a control system comprising a processor and coupled to the communications interface, the control system adapted to: receive a plurality of media streams, each of the plurality of media streams corresponding to a different one of a plurality of processing devices that is involved in a collaboration session, the collaboration session comprises a real-time information exchange between a plurality of collaboration participants during the collaboration session; store a collaboration media stream based on the plurality of media streams, the collaboration media stream including a media stream time index; determine that a collaboration application has been initiated during the collaboration session, the collaboration application adapted to receive input from at least two of the plurality of collaboration participants; determine that the collaboration application has generated an artifact during the collaboration session; and generate a timeline entry in a collaboration timeline, the timeline entry comprising time information identifying a time associated with the artifact, and a reference to the artifact; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference.
A media server system for real-time collaboration, comprising a network interface and a processor. The processor receives media streams from participants' devices during a session, combines them into a collaboration media stream with a time index, and stores it. If a collaborative application accessible to at least two participants is started and creates an artifact (file or data object), the processor creates a timeline entry. The entry contains the artifact's creation time and an external reference to its storage location, which is different from the media stream time index.
10. The media server of claim 9 , wherein the control system is further adapted to generate a plurality of timeline entries in the collaboration timeline, each of the plurality of timeline entries corresponding to one of a plurality of artifacts generated during the collaboration session.
The media server system described in the previous claim that determines that a collaboration application has been initiated during the collaboration session, the collaboration application adapted to receive input from at least two of the plurality of collaboration participants; determine that the collaboration application has generated an artifact during the collaboration session; and generate a timeline entry in a collaboration timeline, the timeline entry comprising time information identifying a time associated with the artifact, and a reference to the artifact; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, also generates multiple timeline entries, each corresponding to a different artifact created by the application during the collaboration session.
11. The media server of claim 9 , wherein the timeline entry further comprises data identifying the collaboration application that generated the artifact.
The media server system described where the media server receives a plurality of media streams, each of the plurality of media streams corresponding to a different one of a plurality of processing devices that is involved in a collaboration session, the collaboration session comprises a real-time information exchange between a plurality of collaboration participants during the collaboration session; store a collaboration media stream based on the plurality of media streams, the collaboration media stream including a media stream time index; determine that a collaboration application has been initiated during the collaboration session, the collaboration application adapted to receive input from at least two of the plurality of collaboration participants; determine that the collaboration application has generated an artifact during the collaboration session; and generate a timeline entry in a collaboration timeline, the timeline entry comprising time information identifying a time associated with the artifact, and a reference to the artifact; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, further includes the application's name or ID in the timeline entry.
12. The media server of claim 9 , wherein the control system is adapted to receive the artifact from the collaboration application.
The media server system described where the media server receives a plurality of media streams, each of the plurality of media streams corresponding to a different one of a plurality of processing devices that is involved in a collaboration session, the collaboration session comprises a real-time information exchange between a plurality of collaboration participants during the collaboration session; store a collaboration media stream based on the plurality of media streams, the collaboration media stream including a media stream time index; determine that a collaboration application has been initiated during the collaboration session, the collaboration application adapted to receive input from at least two of the plurality of collaboration participants; determine that the collaboration application has generated an artifact during the collaboration session; and generate a timeline entry in a collaboration timeline, the timeline entry comprising time information identifying a time associated with the artifact, and a reference to the artifact; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, also receives the actual artifact data directly from the collaboration application.
13. A method for providing information from a collaboration timeline, the method comprising: accessing a collaboration timeline, the collaboration timeline comprising a plurality of timeline entries, each of the plurality of timeline entries comprising time information identifying a time associated with an artifact generated by a collaboration application during a collaboration session, and a reference to the artifact, the collaboration session comprises a real-time information exchange between a plurality of collaboration participants during the collaboration session; accessing a collaboration media stream that corresponds to the collaboration timeline, the collaboration media stream formed from a plurality of media streams of the collaboration session, the collaboration media stream including a media stream time index; receiving a user selection of a particular timeline entry of the plurality of timeline entries; obtaining an artifact associated with the particular timeline entry; determining a begin location within the media stream time index of the collaboration media stream based on the particular timeline entry; and displaying the artifact associated with the particular timeline entry on a display; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference.
A method for displaying information from a collaboration timeline. The method includes accessing a timeline containing entries for artifacts generated by a collaborative application during a real-time session. Each timeline entry holds a timestamp and a reference to the artifact, with the reference being external. The method accesses the collaboration media stream (audio/video) that corresponds to the timeline, where the media stream has a time index. When a user selects a timeline entry, the associated artifact is retrieved. A "begin location" within the media stream's time index is determined based on the selected entry, and the artifact is then displayed.
14. The method of claim 13 , further comprising concurrently playing the collaboration media stream at the begin location while displaying the artifact associated with the particular timeline entry on the display.
The method for providing information from a collaboration timeline accessing a collaboration timeline, the collaboration timeline comprising a plurality of timeline entries, each of the plurality of timeline entries comprising time information identifying a time associated with an artifact generated by a collaboration application during a collaboration session, and a reference to the artifact, the collaboration session comprises a real-time information exchange between a plurality of collaboration participants during the collaboration session; accessing a collaboration media stream that corresponds to the collaboration timeline, the collaboration media stream formed from a plurality of media streams of the collaboration session, the collaboration media stream including a media stream time index; receiving a user selection of a particular timeline entry of the plurality of timeline entries; obtaining an artifact associated with the particular timeline entry; determining a begin location within the media stream time index of the collaboration media stream based on the particular timeline entry; and displaying the artifact associated with the particular timeline entry on a display; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, described above further includes concurrently playing the collaboration media stream, starting from the determined "begin location" in the media, while displaying the associated artifact.
15. The method of claim 13 , further comprising determining that at least one of the plurality of timeline entries further comprises timeline entry indicia identifying the particular timeline entry and displaying the timeline entry indicia on the display.
The method for providing information from a collaboration timeline accessing a collaboration timeline, the collaboration timeline comprising a plurality of timeline entries, each of the plurality of timeline entries comprising time information identifying a time associated with an artifact generated by a collaboration application during a collaboration session, and a reference to the artifact, the collaboration session comprises a real-time information exchange between a plurality of collaboration participants during the collaboration session; accessing a collaboration media stream that corresponds to the collaboration timeline, the collaboration media stream formed from a plurality of media streams of the collaboration session, the collaboration media stream including a media stream time index; receiving a user selection of a particular timeline entry of the plurality of timeline entries; obtaining an artifact associated with the particular timeline entry; determining a begin location within the media stream time index of the collaboration media stream based on the particular timeline entry; and displaying the artifact associated with the particular timeline entry on a display; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, described above further includes displaying indicators/labels associated with each timeline entry. These timeline entry indicators identify the entries on the display.
16. The method of claim 13 , wherein the begin location comprises a time of the media stream time index that corresponds with the time associated with the artifact.
The method for providing information from a collaboration timeline accessing a collaboration timeline, the collaboration timeline comprising a plurality of timeline entries, each of the plurality of timeline entries comprising time information identifying a time associated with an artifact generated by a collaboration application during a collaboration session, and a reference to the artifact, the collaboration session comprises a real-time information exchange between a plurality of collaboration participants during the collaboration session; accessing a collaboration media stream that corresponds to the collaboration timeline, the collaboration media stream formed from a plurality of media streams of the collaboration session, the collaboration media stream including a media stream time index; receiving a user selection of a particular timeline entry of the plurality of timeline entries; obtaining an artifact associated with the particular timeline entry; determining a begin location within the media stream time index of the collaboration media stream based on the particular timeline entry; and displaying the artifact associated with the particular timeline entry on a display; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, where determining the begin location within the media stream utilizes the media stream timestamp that matches the time the artifact was created.
17. The method of claim 13 , wherein the begin location comprises a time of the media stream time index that corresponds to a predetermined period of time prior to the time associated with the artifact.
The method for providing information from a collaboration timeline accessing a collaboration timeline, the collaboration timeline comprising a plurality of timeline entries, each of the plurality of timeline entries comprising time information identifying a time associated with an artifact generated by a collaboration application during a collaboration session, and a reference to the artifact, the collaboration session comprises a real-time information exchange between a plurality of collaboration participants during the collaboration session; accessing a collaboration media stream that corresponds to the collaboration timeline, the collaboration media stream formed from a plurality of media streams of the collaboration session, the collaboration media stream including a media stream time index; receiving a user selection of a particular timeline entry of the plurality of timeline entries; obtaining an artifact associated with the particular timeline entry; determining a begin location within the media stream time index of the collaboration media stream based on the particular timeline entry; and displaying the artifact associated with the particular timeline entry on a display; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, calculates the begin location by subtracting a predefined period of time from the time associated with the artifact’s creation, allowing the user to see the lead-up to the artifact being generated.
18. The method of claim 13 , wherein the begin location comprises a time of the media stream time index that corresponds to a time associated with a timeline entry immediately preceding the particular timeline entry.
The method for providing information from a collaboration timeline accessing a collaboration timeline, the collaboration timeline comprising a plurality of timeline entries, each of the plurality of timeline entries comprising time information identifying a time associated with an artifact generated by a collaboration application during a collaboration session, and a reference to the artifact, the collaboration session comprises a real-time information exchange between a plurality of collaboration participants during the collaboration session; accessing a collaboration media stream that corresponds to the collaboration timeline, the collaboration media stream formed from a plurality of media streams of the collaboration session, the collaboration media stream including a media stream time index; receiving a user selection of a particular timeline entry of the plurality of timeline entries; obtaining an artifact associated with the particular timeline entry; determining a begin location within the media stream time index of the collaboration media stream based on the particular timeline entry; and displaying the artifact associated with the particular timeline entry on a display; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, uses the timestamp of the timeline entry immediately preceding the selected entry as the "begin location" for playback.
19. The method of claim 13 , wherein the artifact is in the collaboration timeline.
The method for providing information from a collaboration timeline, which accesses a collaboration timeline, the collaboration timeline comprises time information identifying a time associated with an artifact, and a reference to the artifact, the collaboration session comprises a real-time information exchange between a plurality of collaboration participants during the collaboration session; accessing a collaboration media stream; receiving a user selection of a particular timeline entry; obtaining an artifact; determining a begin location within the media stream time index; and displaying the artifact, wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, has the artifact directly stored within the collaboration timeline itself, as opposed to an external reference.
20. The method of claim 1 , further comprising generating a phonetic index of the collaboration media stream.
The method for creating a collaboration timeline that creates a collaboration media stream and a collaboration timeline of the collaboration session, the method comprising: receiving media streams; forming a collaboration media stream including a media stream time index; determining that a collaboration application has generated an artifact; and generating a timeline entry in a collaboration timeline, the timeline entry comprising time information identifying a time associated with the artifact, and a reference to the artifact; wherein the timeline entry in the collaboration timeline is different than the media stream time index and the reference to the artifact is an external reference, also involves generating a phonetic index of the collaboration media stream, allowing for searching and navigation based on spoken words.
21. The method of claim 20 , wherein the phonetic index comprises at least one phoneme of a plurality of spoken words in the collaboration media stream.
The method for creating a collaboration timeline and phonetic index of a collaboration media stream where the method receives media streams; forms a collaboration media stream including a media stream time index; determines that a collaboration application has generated an artifact; generates a timeline entry in a collaboration timeline; wherein the timeline entry is different than the media stream time index and the reference to the artifact is an external reference; and generates a phonetic index of the collaboration media stream, specifies that the phonetic index contains at least one phoneme (basic unit of sound) from the spoken words in the collaboration media stream, enabling more granular searching.
22. The method of claim 21 , wherein the phonetic index enables at least one of the plurality of collaboration participants to locate a time in the collaboration media stream in which the at least one phoneme was spoken in the collaboration media stream.
The method for creating a collaboration timeline and phonetic index where the method receives media streams; forms a collaboration media stream including a media stream time index; determines that a collaboration application has generated an artifact; generates a timeline entry in a collaboration timeline; wherein the timeline entry is different than the media stream time index and the reference to the artifact is an external reference; generates a phonetic index of the collaboration media stream that comprises at least one phoneme of a plurality of spoken words in the collaboration media stream, allows users to find specific points in the collaboration media stream based on the presence of particular phonemes or sounds within the recorded audio.
23. The media server of claim 9 , wherein the control system is further adapted to generate a phonetic index of the collaboration media stream.
The media server system that receives media streams; stores a collaboration media stream including a media stream time index; determines that a collaboration application has been initiated; determines that the collaboration application has generated an artifact; and generates a timeline entry in a collaboration timeline; wherein the timeline entry is different than the media stream time index and the reference to the artifact is an external reference, also generates a phonetic index of the collaboration media stream, to enable search functionalities based on spoken content.
24. The media server of claim 23 , wherein the phonetic index comprises at least one phoneme of a plurality of spoken words in the collaboration media stream.
The media server system that receives media streams; stores a collaboration media stream including a media stream time index; determines that a collaboration application has been initiated; determines that the collaboration application has generated an artifact; generates a timeline entry in a collaboration timeline; wherein the timeline entry is different than the media stream time index and the reference to the artifact is an external reference; and generates a phonetic index of the collaboration media stream, specifies that the phonetic index comprises at least one phoneme of a plurality of spoken words in the collaboration media stream.
25. The media server of claim 24 , wherein the control system is further adapted to use the phonetic index to locate a time in the collaboration media stream in which the at least one phoneme was spoken in the collaboration media stream.
This invention relates to media servers used in collaborative environments, such as virtual meetings or remote collaboration sessions, where participants generate media streams (e.g., audio, video) that are processed and shared. The problem addressed is efficiently locating specific spoken phonemes within a collaboration media stream to enable precise navigation, indexing, or search functionality. The media server includes a control system that generates a phonetic index from the collaboration media stream. This index maps phonemes (basic units of sound) to specific time points in the stream, allowing the system to quickly identify where a particular phoneme or sequence of phonemes occurs. The control system uses this index to locate the exact time in the media stream where a specified phoneme was spoken. This enables features such as keyword-based search, time-stamped annotations, or automated transcription alignment. The phonetic index is derived from analyzing the audio portion of the collaboration media stream, breaking it down into phonemes and associating them with timestamps. The control system can then query this index to retrieve the relevant time points, facilitating real-time or post-session navigation to specific spoken content. This improves usability in collaborative applications by allowing users to quickly access or reference spoken information.
26. The method of claim 13 , further comprising accessing a phonetic index of the collaboration media stream.
The method for providing information from a collaboration timeline, the method comprising: accessing a collaboration timeline comprising time information identifying a time associated with an artifact, and a reference to the artifact; accessing a collaboration media stream including a media stream time index; receiving a user selection of a particular timeline entry; obtaining an artifact; determining a begin location within the media stream time index; and displaying the artifact; wherein the timeline entry is different than the media stream time index and the reference to the artifact is an external reference, also includes accessing a phonetic index of the collaboration media stream to enable richer search and navigation capabilities.
27. The method of claim 26 , wherein the phonetic index comprises at least one phoneme of a plurality of spoken words in the collaboration media stream.
The method for providing information from a collaboration timeline; accessing a collaboration timeline; accessing a collaboration media stream including a media stream time index; receiving a user selection; obtaining an artifact; determining a begin location within the media stream time index; displaying the artifact; wherein the timeline entry is different than the media stream time index and the reference to the artifact is an external reference, and accessing a phonetic index of the collaboration media stream, uses a phonetic index that contains at least one phoneme of a plurality of spoken words within the collaboration media stream.
28. The method of claim 27 , wherein the phonetic index provides access to a time in the collaboration media stream in which the at least one phoneme was spoken in the collaboration media stream.
The method for providing information from a collaboration timeline; accessing a collaboration timeline; accessing a collaboration media stream including a media stream time index; receiving a user selection; obtaining an artifact; determining a begin location within the media stream time index; displaying the artifact; wherein the timeline entry is different than the media stream time index and the reference to the artifact is an external reference; and accessing a phonetic index of the collaboration media stream that comprises at least one phoneme of a plurality of spoken words in the collaboration media stream, uses the phonetic index to pinpoint precise moments in the collaboration media stream where those phonemes were spoken.
Unknown
October 21, 2014
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.