Legal claims defining the scope of protection, as filed with the USPTO.
1. A method for generating a three-dimensional visual representation of one or more digital audio files on a display including a time domain temporal aspect and a frequency domain with a temporal plane of playback that during audio video playback highlights the point in the image that corresponds to the audio that is currently playing as the image of the audio dynamically moves across said plane, three-dimensional images resulting from frequency analysis and enhancement processes are committed and stored for reproduction in a non-transitory medium: a) receiving a digital audio file comprising tones; b) decomposing said digital audio file in the temporal domain to produce and sequentially store temporal audio slices for frequency analysis; c) generating timestamps for marking locations of said temporal audio slices in said digital audio file along a time axis; d) analyzing said temporal audio slices in the frequency domain to produce audio frequency spectra of said temporal audio slices with frequency being shown along a frequency axis and amplitude being shown along an amplitude axis; e) applying at least one visual enhancement function to said audio frequency spectra to produce visually enhanced audio frequency spectra; f) organizing said temporal audio slices with said visually enhanced audio frequency spectra along said time axis based on said timestamps and stored sequentially to generate said three-dimensional visual representation of said digital audio file for later playback synchronized with said audio file; g) displaying said three-dimensional visual representation from a predetermined viewpoint to a user while said digital audio file is being played back; h) scrolling a visual playback indicator at a temporal plane of playback of said digital audio file along said time axis and over said three-dimensional visual representation; wherein said three-dimensional visual representation is initially displayed in an orientation where said visual representation moves from the background forward across the temporal plane of playback.
2. The method of claim 1 , wherein said step of applying said at least one visual enhancement function comprises applying said at least one visual enhancement function to at least one component of said spectra.
3. The method of claim 2 , wherein said at least one visual enhancement function is related to at least one signal processing function.
4. The method of claim 3 , wherein said at least one signal processing function is selected from the group of functions consisting of visual distortion and skewing as well as audio signal processes including filtering, equalization, Fourier transformation, Hartley transformation, spectral decomposition, and attenuation.
5. The method of claim 2 , further comprising identifying said at least one component of said spectra with a source of at least one of said tones.
6. The method of claim 5 , wherein said at least one visual enhancement function is applied to at least one component of said spectra identified with said source.
7. The method of claim 1 uses a computer to generate a three-dimensional image of said audio with process instructions and the resulting image stored in memory.
8. The method of claim 1 , further comprising the step of changing said predetermined viewpoint.
9. The method of claim 8 , wherein said step of changing said predetermined viewpoint is controlled by said user.
10. The method of claim 8 , wherein said step of changing of said predetermined viewpoint comprises any change selected from three-dimensional translations and three-dimensional rotations of said predetermined viewpoint.
11. The method of claim 1 , further comprising the step of altering at least one imaging characteristic of said three-dimensional visual representation from said predetermined viewpoint.
12. The method of claim 11 , wherein said at least one imaging characteristic comprises zooming.
13. The method of claim 1 , wherein said at least one visual enhancement function comprises the use of color.
14. The method of claim 1 , wherein said at least one visual enhancement function comprises the use of texture.
15. The method of claim 1 , wherein said at least one visual enhancement function comprises the use of lighting or shading.
16. The method of claim 1 , wherein upcoming audio which is about to play can be displayed, allowing viewers; including musicians, garners, artists, engineers, and others, to anticipate and react to events about to occur.
Unknown
July 11, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.