Method, apparatus, and computer-readable media for virtual positioning one or more remote participants in a sound space includes structure and/or function whereby sound signals are received from a plurality of microphones in the shared space. One or more processors identifies one or more sound sources in the shared space, based on the received sound signals. The processors(s) map respective locations of the sound source(s) in the shared space, based on the received sound signals. The processor(s) receive from the remote participant(s) signals corresponding to respective position placements of the remote participant(s) in the shared space. The processor(s) mix the received sound signals to output corresponding sound signals for each participant based on relationships between (i) the respective locations of the sound source(s) and (ii) the respective position placements of the remote participant(s) in the shared space. The processor(s) then transmit the corresponding sound signals to the remote participant(s).
Legal claims defining the scope of protection, as filed with the USPTO.
1. A method for each one of plural remote participants, who are remote from a shared physical space that has (i) a plurality of physical microphones, and (ii) a desired sound source, to individually configure his/her individual sound field map in the shared physical space, to focus on the desired sound source, comprising: receiving, from the plurality of physical microphones in the shared physical space, sound signals of the shared physical space including (i) positional information and (ii) sound signals of the physical microphones; identifying, by one or more processors, the at least one desired sound source in the shared physical space based on the received sound signals of the physical microphones; defining, by the one or more processors, an array of virtual microphone bubbles in the shared physical space; mapping, by the one or more processors, respective physical locations of the desired sound source in the shared physical space, based on the received sound signals of the physical microphones; receiving, by the one or more processors and from the plurality of remote participants, signals corresponding to his/her respective sound field map parameters in the shared physical space, each remote participant having his/her own audio reproduction equipment, the sound field map parameters including information corresponding to the defined array of virtual microphone bubbles; mixing, by the one or more processors, the received sound signals of the physical microphones from the shared physical space to output corresponding mixed sound signals to each of the remote participants, based on relationships between (i) the respective locations of the desired sound source in the shared physical space and (ii) the respective sound field map parameters of said each remote participant in the shared physical space; and transmitting, by the one or more processors, the corresponding mixed sound signals to each remote participant; wherein each remote participant can independently control his/her sound field map parameters in the shared physical space including sound field map size and/or shape, to focus on the desired sound source.
2. The method according to claim 1 , wherein there are plural sound sources in the shared physical space.
3. The method according to claim 1 , wherein each remote participant has at least one participant processor configured to independently control position parameters in the shared physical space including (i) facing position, and (ii) position, within the shared space.
4. The method according to claim 3 , wherein each remote participant can independently control in real-time his/her position parameters in the shared physical space including (i) sound field size and/or shape, (ii) facing position, and (iii) position, within the shared space.
5. The method according to claim 4 , wherein each remote participant can attenuate his/her reception of sound from a sound source in the shared physical space.
6. The method according to claim 1 , further comprising displaying to each remote participant a plurality of sound sources within the shared physical space.
7. The method according to claim 6 , further comprising displaying to each remote participant indicia of volumes of at least two sound sources within the shared physical space.
8. The method according to claim 1 , wherein each remote participant can independently (i) focus the plurality of physical microphones on a desired sound source in the shared physical space, and (ii) defocus the plurality of physical microphones from an undesired sound source in the shared physical space.
9. The method according to claim 1 , wherein the shared physical space includes an undesired sound source, and wherein each remote participant can independently control his/her sound field map parameters in the shared physical space to unfocus on the undesired sound source.
10. The method according to claim 1 , further comprising tracking a moving desired sound source in the shared physical space.
11. The method according to claim 1 , wherein the remote participant comprises a second shared physical space.
12. The method according to claim 1 , wherein there are multiple sound field maps in the shared physical space.
13. The method according to claim 1 , wherein there are multiple sound field maps for at least one remote participant in the shared physical space.
14. An sound apparatus for each one of plural remote participants, who are remote from a shared physical space that has (i) a plurality of physical microphones, and (ii) a desired sound source, to individually configure his/her individual sound field map in the shared physical space, to focus on the desired sound source, comprising: an interface configured to receive, from a plurality of physical microphones in the shared physical space, (i) positional information and (ii) sound signals of the physical microphones; a network interface configured to receive, from the plural remote participants, respective position parameters in the physical shared space; and one or more processors configured to: identify the desired sound source in the shared physical space based on the received sound signals of the physical microphones; defining an array of virtual microphone bubbles in the shared physical space; map respective physical locations of the desired sound source in the shared physical space, based on the received sound signals of the physical microphones; receive from the plurality of remote participants, signals corresponding to his/her respective sound field map parameters in the shared physical space, each remote participant having his/her own audio reproduction equipment, the sound field map parameters including information corresponding to the defined array of virtual microphone bubbles; mix the received sound signals from the shared physical space to output corresponding sound signals to each of the remote participants based on relationships between (i) the respective locations of the desired sound source in the shared physical space and (ii) the respective sound field map parameters of said each remote participant in the shared physical space; and transmit the corresponding mixed sound signals to each remote participant via the network interface wherein each remote participant can independently control his/her sound field map parameters in the shared physical space including sound field map size and/or shape, to focus on the desired sound source.
15. The apparatus according to claim 14 , wherein there are plural desired sound sources in the shared physical space.
16. The apparatus according to claim 14 , wherein each remote participant has at least one participant processor configured to independently control position parameters in the shared physical space including (i) facing position, and (ii) position, within the shared space.
17. The apparatus according to claim 16 , wherein each remote participant's at least one participant processor is configured to independently control in real-time his/her position parameters in the shared physical space including (i) sound field size and/or shape, (ii) facing position, and (iii) position, within the shared space.
18. The apparatus according to claim 14 , wherein each remote participant's at least one participant processor is configured to attenuate his/her reception of sound from a sound source from the shared physical space.
19. The apparatus according to claim 14 , further comprising one or more remote participant display configured to display to each remote participant a plurality of sound sources within the shared physical space.
20. The apparatus according to claim 19 , wherein the one or more remote participant display is configured to display to each remote participant indicia of volumes of at least two sound sources within the shared physical space.
21. The apparatus according to claim 14 , wherein each remote participant has at least one processor configured to independently (i)focus the plurality of physical microphones on the desired sound source in the shared physical space, and (ii) defocus the plurality of physical microphones from an undesired sound source in the shared physical space.
22. The apparatus according to claim 14 , wherein the shared physical space includes an undesired sound source, and wherein each remote participant can independently control his/her sound field map parameters in the shared physical space to unfocus on the undesired sound source.
23. The apparatus according to claim 14 , wherein the one or more processors tracks a moving desired sound source in the shared physical space.
24. The apparatus according to claim 14 , wherein the remote participant comprises a second shared physical space.
25. The apparatus according to claim 14 , wherein the one or more processors provides multiple sound field maps in the shared physical space.
26. The apparatus according to claim 14 , wherein the one or more processors provides multiple sound field maps for at least one remote participant in the shared physical space.
27. At least one non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by one or more processors, perform a method for each one of plural remote participants, who are remote from a shared physical space that has (i) a plurality of physical microphones, and (ii) a desired sound source, to individually configure his/her individual sound field map in the shared physical space, to focus on the desired sound source, comprising: receiving, from the plurality of physical microphones in the shared physical space, sound signals of the shared physical space including (i) positional information and (ii) sound signals, of the physical microphones; identifying, by one or more processors, the desired sound source in the shared physical space based on the received sound signals; defining, by the one or more processors, an array of virtual microphone bubbles in the shared physical space; mapping respective physical locations of the desired sound source in the shared physical space based on the received sound signals; receiving, from the remote participants, signals corresponding to his/her respective sound field map parameters in the shared physical space, each remote participant having their own audio reproduction equipment, the sound field map parameters including information corresponding to the defined array of virtual microphone bubbles; mixing the received sound signals to output corresponding mixed sound signals from the shared physical space to each remote participant based on (i) relationships between the respective locations of the desired sound source in the shared physical space and (ii) the respective sound field map parameters of said each remote participant in the shared physical space; and transmitting the corresponding mixed sound signals to each remote participant; wherein each remote participant can independently control his/her sound field map parameters in the shared physical space including sound field map size and/or shape, to focus on the desired sound source.
28. The computer readable storage medium according to claim 27 , wherein the instructions, when executed by one or more processors, perform the method where there are plural desired sound sources in the shared physical space.
29. The computer readable storage medium according to claim 27 , wherein the instructions, when executed by one or more processors, perform the method wherein each remote participant can independently control his/her position parameters in the shared physical space including (i) facing position, and (ii) position, within the shared space.
30. The computer readable storage medium according to claim 29 , wherein the instructions, when executed by one or more processors, perform the method wherein each remote participant can independently control in real-time his/her position parameters in the shared physical space including (i) sound field size and/or shape, (ii) facing position, and (iii) position, within the shared space.
31. The computer readable storage medium according to claim 30 , wherein the instructions, when executed by one or more processors, perform the method wherein each remote participant can attenuate his/her reception of sound from a sound source in the shared physical space.
32. The computer readable storage medium according to claim 27 , wherein the instructions, when executed by one or more processors, perform the method of displaying to each remote participant a plurality of sound sources within the shared physical space.
33. The computer readable storage medium according to claim 32 , wherein the instructions, when executed by one or more processors, perform the method of displaying to each remote participant indicia of volumes of at least two sound sources within the shared physical space.
34. The computer readable storage medium according to claim 27 , wherein the instructions, when executed by one or more processors, perform the method wherein each remote participant can independently (i) focus the plurality of microphones on the desired sound source in the shared physical space, and (ii) defocus the plurality of microphones from an undesired sound source in the shared physical space.
35. The computer readable storage medium according to claim 27 , wherein the instructions, when executed by one or more processors, perform the method whereby the shared physical space includes an undesired sound source, and wherein each remote participant can independently control his/her sound field map parameters in the shared physical space to unfocus on the undesired sound source.
36. The computer readable storage medium according to claim 27 , wherein the instructions, when executed by one or more processors, perform the method further comprising tracking a moving desired sound source in the shared physical space.
37. The computer readable storage medium according to claim 27 , wherein the instructions, when executed by one or more processors, perform the method wherein the remote participant comprises a second shared physical space.
38. The computer readable storage medium according to claim 27 , wherein the instructions, when executed by one or more processors, perform the method wherein there are multiple sound field maps in the shared physical space.
39. The computer readable storage medium according to claim 27 , wherein the instructions, when executed by one or more processors, perform the method wherein there are multiple sound field maps for at least one remote participant in the shared physical space.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
June 1, 2017
March 10, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.