Legal claims defining the scope of protection, as filed with the USPTO.
1. A method of providing feedback to an editor of a time-based media composition, wherein the editor is able to edit the time-based media composition using a media composition tool, the method comprising: enabling a reviewer to play back the time-based media composition; while the reviewer is playing back the time-based media composition, capturing imagery of a face of the reviewer; using an artificial intelligence-based system, analyzing the captured imagery to determine a time-based media response characteristic of the reviewer; synchronizing the time-based media response characteristic of the reviewer with the time-based media composition; receiving at the time-based media editing tool the synchronized media response characteristic of the reviewer; displaying within a user interface of the time-based media editing tool a timeline representation of the time-based media composition, wherein the timeline representation includes: a media track representing media of the time-based media composition; and a track representing the time-based media response characteristic of the reviewer that is synchronized with the media track; and wherein the displayed timeline representation enables the editor to edit the time-based media composition so as to elicit a media response characteristic that conforms to a predetermined response characteristic.
2. The method of claim 1 , wherein: the time-based media composition is reviewed by a plurality of reviewers; for each reviewer of the plurality of reviewers: enabling the reviewer to play back the time-based media composition; while the reviewer is playing back the time-based media composition, capturing imagery of a face of the reviewer; using an artificial intelligence-based system, analyzing the captured imagery to determine a time-based media response characteristic of the reviewer; synchronizing the time-based media response characteristic of the reviewer with the time-based media composition; and wherein the displayed timeline representation includes a plurality of synchronized response tracks, each synchronized response track representing the time-based media response characteristic of a corresponding one of the plurality of reviewers.
3. The method of claim 1 , wherein the artificial intelligence-based system analyzes the captured imagery to determine a plurality of different media response characteristics of the reviewer, and further comprising: synchronizing each media response characteristic of the plurality of different media response characteristics with the time-based media composition; and wherein the displayed timeline representation includes a plurality of synchronized response tracks, each synchronized response track of the plurality of different synchronized response tracks representing a corresponding one of the plurality of the media response characteristics of the reviewer.
4. The method of claim 1 , wherein the track representing the time-based media response characteristic of the reviewer represents the media response characteristic as a graph indicating a time-based level to which the media response characteristic is determined to be present.
5. The method of claim 1 , wherein a determination above a threshold confidence that the media response characteristic is present at a given temporal location is represented by a graphical indication corresponding to the media response characteristic at the given temporal location within the media response track.
6. The method of claim 1 , wherein the media response characteristic is a level of attention of the reviewer.
7. The method of claim 1 , wherein the media response characteristic is an emotion of reviewer.
8. The method of claim 7 , wherein the emotion of the reviewer is one of surprise, fear, and disgust.
9. The method of claim 1 , wherein: the time-based media composition is reviewed by a plurality of reviewers; for each reviewer of the plurality of reviewers: enabling the reviewer to play back the time-based media composition; while the reviewer is playing back the time-based media composition, capturing imagery of a face of the reviewer; using an artificial intelligence-based system, analyzing the captured imagery to determine a time-based media response characteristic of the reviewer; and synchronizing the time-based media response characteristic of the reviewer with the time-based media composition; aggregating the media response characteristics from the plurality of reviewers; and wherein the timeline representation includes a at least one synchronized response track representing the aggregated time-based media response characteristic.
10. The method of claim 9 wherein the plurality of reviewers is drawn from a specified demographic and the aggregate media response characteristic is an average time-based media response for reviewers of the specified demographic.
11. The method of claim 10 , wherein the specified demographic is an age group.
12. The method of claim 10 , wherein the specific demographic is an ethnicity.
13. The method of claim 1 , further comprising enabling the editor to compare the time-based media response characteristic of the reviewer with the predetermined media response characteristic.
14. The method of claim 13 , wherein the editor is able to view a graphical representation of the predetermined time-based media response characteristic as a track within the timeline representation of the media composition that is synchronized with the timeline representation of the media composition.
15. The method of claim 13 , wherein the time-based media response characteristic is an emotion comprising one of surprise, fear, and disgust.
16. A computer program product comprising: a non-transitory computer-readable medium with computer-readable instructions encoded thereon, wherein the computer-readable instructions, when processed by a computer system instruct the computer system to perform a method of providing feedback to an editor of a time-based media composition, wherein the editor is able to edit the time-based media composition using a media composition tool, the method comprising: enabling a reviewer to play back the time-based media composition; while the reviewer is playing back the time-based media composition, capturing imagery of a face of the reviewer; using an artificial intelligence-based system, analyzing the captured imagery to determine a time-based media response characteristic of the reviewer; synchronizing the time-based media response characteristic of the reviewer with the time-based media composition; receiving at the time-based media editing tool the synchronized media response characteristic of the reviewer; displaying within a user interface of the time-based media editing tool a timeline representation of the time-based media composition, wherein the timeline representation includes: a media track representing media of the time-based media composition; and a track representing the time-based media response characteristic of the reviewer that is synchronized with the media track; and wherein the displayed timeline representation enables the editor to edit the time-based media composition so as to elicit a media response characteristic that conforms to a predetermined response characteristic.
17. A system comprising: a memory for storing computer-readable instructions; and a processor connected to the memory, wherein the processor, when executing the computer-readable instructions, causes the system to perform a method providing feedback to an editor of a time-based media composition, wherein the editor is able to edit the time-based media composition using a media composition tool, the method comprising: enabling a reviewer to play back the time-based media composition; while the reviewer is playing back the time-based media composition, capturing imagery of a face of the reviewer; using an artificial intelligence-based system, analyzing the captured imagery to determine a time-based media response characteristic of the reviewer; synchronizing the time-based media response characteristic of the reviewer with the time-based media composition; receiving at the time-based media editing tool the synchronized media response characteristic of the reviewer; displaying within a user interface of the time-based media editing tool a timeline representation of the time-based media composition, wherein the timeline representation includes: a media track representing media of the time-based media composition; and a track representing the time-based media response characteristic of the reviewer that is synchronized with the media track; and wherein the displayed timeline representation enables the editor to edit the time-based media composition so as to elicit a media response characteristic that conforms to a predetermined response characteristic.
Unknown
January 4, 2022
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.