Apparatus for and method of transmitting and receiving data streams representing 3-dimensional virtual space

1. An apparatus for transmitting and receiving a plurality of data streams that include representation of 3-dimensional virtual space, the apparatus comprising: a transmitting system; a receiving system; and a transfer system that connects the transmitting system and the receiving system in a bidirectional manner; the transmitting system comprising: a data stream transmitting portion that simultaneously transmits, on a real-time basis in response to a request from the receiving system, the plurality of data streams, comprising a shape data stream representing a shape of a skeletal structure in 3-dimensional computer graphics (3-DCG), a motion data stream representing a motion of the skeletal structure in 3-DCG and an audio data stream representing a sound synchronous with the motion, in accordance with a predetermined format such that the transfer system interactively transfers the plurality of data streams from the transmitting system to the receiving system, the motion data stream comprising time series rotational angle data, time series positional data, and time series vector data; and the receiving system comprising: a data stream receiver portion that receives and discriminates kinds and formats of the plurality of data streams transmitted from the transmitting system via the transfer system on a real-time basis to subject the discriminated streams to respective restoration processing; a 3-dimensional virtual space generating portion that generates the shape of the skeletal structure in the 3-dimensional virtual space based on one of the shape data stream of the plurality of data streams received by the receiving system and preliminarily read 3-dimensional shape data, and moves the shape of the skeletal structure based on the motion data stream of the plurality of data streams; and a sound generating portion that reproduces the sound base on the audio data stream synchronously with the motion data stream.

2. The apparatus as claimed in claim 1 , further comprising a reproducing system; wherein the transmitting system further comprises a discriminating portion that produces discriminatory information for discriminating the shape data stream, the motion data stream and the audio data stream from each other in the plurality of data streams to be transmitted and compresses or divides the data streams, including the discriminatory information, into predetermined divisional units so as to transmit the data streams together with the discriminatory information; wherein the data stream receiver portion comprises a receiver discriminating portion that discriminates the shape data stream, the motion data stream and the audio data stream from each other and a restoring portion that restores the original plurality of data streams by simultaneously coupling the divisional units with each other on the basis of the discriminatory information; wherein the 3-dimensional virtual space generating portion discriminates the shape data stream, the motion data stream and the audio data stream from each other in the restored plurality of data streams; wherein the reproducing system reproduces the shape data stream, the motion data stream and the audio data stream on the basis of the discriminatory information.

3. The apparatus as claimed in claim 1 , further comprising a reproducing system; wherein the transmitting system further comprises a discriminating portion that provides discriminatory information for discriminating the shape data stream, the motion data stream and the audio data stream from each other in the plurality of data streams to be transmitted and compresses or divides the plurality of data streams, including the discriminatory information together with kinds and combinations of the motions, a shape of a corresponding 3-dimensional skeletal structure and reproduction conditions into predetermined divisional units so as to transmit the plurality of data streams together with the discriminatory information; wherein the data stream receiver portion comprises a receiver discriminating portion that discriminates the shape data stream, the motion data stream and the audio data stream from each other restores the original plurality of data streams for the plurality of motions, simultaneously coupling the divisional units with each other on the basis of the kinds and the combinations of the plurality of motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions; wherein the 3-dimensional virtual space generating portion discriminates the shape data stream, the motion data stream and the audio data stream from each other in the restored data stream; and wherein the reproducing system reproduces, for the plurality of motions, motions of the shape of the skeletal structure based on the kinds and the combinations of the motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions.

4. The apparatus as claimed in claim 1 , further comprising a reproducing system; wherein the transmitting system further comprises a discriminating portion that provides discriminatory information for discriminating the shape data stream, the motion data stream and the audio data stream from each other in the plurality of data streams to be transmitted and compresses or divides the plurality of data streams, including the discriminatory information together with kinds and combinations of the motions and the sounds, a shape of a corresponding 3-dimensional skeletal structure and reproduction conditions into predetermined divisional units so as to transmit the plurality of data streams together with the discriminatory information and synchronous information of the motion data stream and the audio data stream; wherein the data stream receiver portion comprises a receiver discriminating portion that discriminates the shape data stream, the motion data stream and the audio data stream from each other and a restoring portion that restores the original plurality of data streams for the plurality of motions and sounds, including simultaneously coupling the divisional units with each other on the basis of the kinds and combinations of the motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions; wherein the 3-dimensional virtual space generating portion discriminates the shape data stream, the motion data stream and the audio data stream from each other in the restored plurality of data streams; and wherein the reproducing system reproduces, for the plurality of motions and sounds, motions of the shape of the skeletal structure based on the kinds and the combinations of the motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions simultaneously with reproducing the sound based on the audio data stream and the motion data stream synchronously with each other.

5. An apparatus for transmitting and receiving a plurality of data streams that include representation of 3-dimensional virtual space, the apparatus comprising: a transmitting system; a plurality of receiving systems; a transmitting setting system; and a transfer system, wherein the transmitting system is connected to the plurality of receiving systems via the transfer system in a bidirectional manner; and the transmitting system comprising: data stream transmitter portion that simultaneously transmits, on a real-time basis in response to a request from at least one of the plurality of receiving systems, the plurality of data streams, comprising a shape data stream representing a shape of a skeletal structure in 3-dimensional computer graphics (3-DCG), a motion data stream representing a motion of the skeletal structure in 3-DCG and an audio data stream representing a sound synchronous with the motion, in accordance with a predetermined format such that the transfer system interactively transfers the plurality of data streams from the transmitting system to the at least one of the plurality of receiving systems, the motion data stream comprising time series rotational angle data, time series positional data, and time series vector data; and the at least one of the plurality of receiving systems comprising: a data stream receiver portion that receives and discriminates kinds and formats of the plurality of data streams transmitted from the transmitting system via the transfer system on a real-time basis; a 3-dimensional virtual space generating portion that generates the shape of the skeletal structure in the 3-dimensional virtual space based on one of the shape data streams of the plurality of data streams received by the at least one of the plurality of receiving systems and preliminarily read 3-dimensional shape data, and moves the shape of the skeletal structure based on the motion data stream of the plurality of data streams; and a sound generating portion that reproduces the sound based on the audio data stream of the plurality of data streams synchronously with the motion data stream; wherein the 3-dimensional virtual space generating portion designates, in response to the request from the at least one of the plurality of receiving systems, a kind and a section of data to be transmitted in the data stream restored by the data stream receiver portion to control the designated data; and wherein the transmitting setting system sets transmission of the controlled designated data to the at least one of the plurality of receiving systems such that the transmitting system transfers the controlled designated data to the at least one of the plurality of receiving systems in response to the request.

6. The apparatus as claimed in claim 5 , further comprising a reproducing system; wherein the transmitting system further comprises a discriminating portion that produces discriminatory information for discriminating the shape data stream, the motion data stream and the audio data stream from each other in the plurality of data streams to be transmitted and compresses or divides the data streams, including the discriminatory information, into predetermined divisional units so as to transmit the data streams together with the discriminatory information; wherein the data stream receiver portion comprises a receiver discriminating portion that discriminates the shape data stream, the motion data stream and the audio data stream from each other and a restoring portion that restores the original plurality of data streams by simultaneously coupling the divisional units with each other on the basis of the discriminatory information; wherein the 3-dimensional virtual space generating portion discriminates the shape data stream, the motion data stream and the audio data stream from each other in the restored plurality of data streams; wherein the reproducing system reproduces the shape data stream, the motion data stream and the audio data stream on the basis of the discriminatory information.

7. The apparatus as claimed in claim 5 , further comprising a reproducing system; wherein the transmitting system further comprises a discriminating portion that provides discriminatory information for discriminating the shape data stream, the motion data stream and the audio data stream from each other in the plurality of data streams to be transmitted and compresses or divides the plurality of data streams, including the discriminatory information together with kinds and combinations of the motions, a shape of a corresponding 3-dimensional skeletal structure and reproduction conditions into predetermined divisional units so as to transmit the plurality of data streams together with the discriminatory information; wherein the data stream receiver portion comprises a receiver discriminating portion that discriminates the shape data stream, the motion data stream and the audio data stream from each other restores the original plurality of data streams for the plurality of motions, simultaneously coupling the divisional units with each other on the basis of the kinds and the combinations of the plurality of motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions; wherein the 3-dimensional virtual space generating portion discriminates the shape data stream, the motion data stream and the audio data stream from each other in the restored data stream; and wherein the reproducing system reproduces, for the plurality of motions, motions of the shape of the skeletal structure based on the kinds and the combinations of the motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions.

8. The apparatus as claimed in claim 5 , further comprising a reproducing system; wherein the transmitting system further comprises a discriminating portion that provides discriminatory information for discriminating the shape data stream, the motion data stream and the audio data stream from each other in the plurality of data streams to be transmitted and compresses or divides the plurality of data streams, including the discriminatory information together with kinds and combinations of the motions and the sounds, a shape of a corresponding 3-dimensional skeletal structure and reproduction conditions into predetermined divisional units so as to transmit the plurality of data streams together with the discriminatory information and synchronous information of the motion data stream and the audio data stream; wherein the data stream receiver portion comprises a receiver discriminating portion that discriminates the shape data stream, the motion data stream and the audio data stream from each other and a restoring portion that restores the original plurality of data streams for the plurality of motions and sounds, including simultaneously coupling the divisional units with each other on the basis of the kinds and combinations of the motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions; wherein the 3-dimensional virtual space generating portion discriminates the shape data stream, the motion data stream and the audio data stream from each other in the restored plurality of data streams; and wherein the reproducing system reproduces, for the plurality of motions and sounds, motions of the shape of the skeletal structure based on the kinds and the combinations of the motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions simultaneously with reproducing the sound based on the audio data stream and the motion data stream synchronously with each other.

9. A method of transmitting and receiving a plurality of data streams representing 3-dimensional virtual space, in which a shape data stream, a motion data stream and an audio data stream, respectively representing a shape and a motion of a skeletal structure in 3-dimensional computer graphics (3-DCG) and a sound synchronous with the motion, are transmitted from a transmitting system to a receiving system such that the receiving system generates the 3-DCG through synchronization of the motion data stream and the audio data stream, the method comprising: simultaneously transmitting, on real-time basis in response to a request from the receiving system, the shape data stream, the motion data stream and the audio data stream synchronous with the motion data stream as the plurality of streams in accordance with a predetermined format, the motion data stream comprising time series rotational angle data, time series positional data, and time series vector data; connecting the transmitting system and the receiving system in a bidirectional manner to transfer the plurality of streams from the transmitting system to the receiving system interactively; receiving the plurality of streams on a real-time basis to discriminate kinds and formats of the received streams and to subject the discriminated streams to respective restoration processings; generating the shape of the skeletal structure in the 3-dimensional virtual space based on one of the restored shape data stream and 3-dimensional shape data read preliminarily, and moving the shape of the skeletal structure based on the restored motion data stream of the plurality of streams; and reproducing the sound synchronously with the motion stream based on the restored audio data stream.

10. The method as claimed in claim 9 , wherein the transmitting comprises producing data stream discriminatory information for discriminating the shape data stream, the motion data stream and the audio data stream from each other and compressing or dividing the data streams, including the discriminatory information, into predetermined divisional units so as to transmit the data streams together with the discriminatory information; wherein the receiving comprises discriminating the shape data stream, the motion data stream and the audio data stream from each other and restoring the original plurality of data streams by simultaneously coupling the divisional units with each other on the basis of the discriminatory information; wherein the generating comprises discriminating the shape data stream, the motion data stream and the audio data stream from each other in the restored plurality of data streams and reproducing the shape data stream, the motion data stream and the audio data stream on the basis of the discriminatory information.

11. The method as claimed in claim 9 , wherein the transmitting comprises producing data stream discriminatory information for discriminating the shape data stream, the motion data stream and the audio data stream from each other and compressing or dividing the data streams, including the discriminatory information together with kinds and combinations of a plurality of motions, a shape of a corresponding 3-dimensional skeletal structure and reproduction conditions, into predetermined divisional units so as to transmit the data streams together with the discriminatory the discrimination information; wherein the receiving comprises discriminating the shape data stream, the motion data stream and the audio data stream from each other and restoring the original plurality of data streams for the plurality of motions including simultaneously coupling the divisional units with each other on the basis of the kinds and the combinations of the plurality of motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions; wherein the generating comprises discriminating the shape data stream, the motion data stream and the audio data stream from each other in the restored plurality of data streams and reproducing, for the plurality of motions, motions of the shape of the skeletal structure based on the kinds and combinations of the plurality of motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions.

12. The method as claimed in claim 9 , wherein the transmitting comprises producing data stream discriminatory information for discriminating the shape data stream, the motion data stream and the audio data stream from each other and compressing or dividing the data streams, including the discriminatory information together with kinds and combinations of a plurality of motions and sounds, a shape of a corresponding 3-dimensional skeletal structure and reproduction conditions, into predetermined divisional units so as to transmit the data streams together with the discriminatory information and synchronous information of the motion data stream and the audio data stream; wherein the receiving comprises discriminating the shape data stream, the motion data stream and the audio data stream from each other and restoring the original plurality of data streams for the plurality of motions and sounds, including simultaneously coupling the divisional units with each other on the basis of the kinds and the combinations of the plurality of motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions; wherein the generating comprises discriminating the shape data stream, the motion data stream and the audio data stream from each other in the restored plurality of data streams and reproducing, for the plurality of motions and sounds, motions of the shape of the skeletal structure designated based on the kinds and combinations of the plurality of motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions and simultaneously reproducing the audio data stream and the motion data stream synchronously with each other.

13. A method of transmitting and receiving a plurality of data streams representing 3-dimensional virtual space, in which a shape data stream, a motion data stream and an audio data stream, respectively representing a shape and a motion of a skeletal structure in 3-dimensional computer graphics (3-DCG) and a sound synchronous with the motion, are transmitted from a transmitting system to a plurality of receiving systems such that the receiving systems generate the 3-DCG through synchronization of the motion data stream and the audio data stream, the method comprising: simultaneously transmitting, on real-time basis in response to a request from at least one of the plurality of receiving systems, the shape data stream, the motion data stream and the audio data stream synchronous with the motion data stream as the plurality of streams in accordance with a predetermined format, the motion data stream comprising time series rotational angle data, time series positional data, and time series vector data; connecting the transmitting system and the at least one receiving system in a bidirectional manner to transfer the plurality of streams from the transmitting system to the at least one receiving system interactively; receiving the plurality of streams on a real-time basis to discriminate kinds and formats of the received streams and to subject the discriminated streams to respective restoration processings; generating the shape of the skeletal structure in the 3-dimensional virtual space based on one of the restored shape data stream and 3-dimensional shape data read preliminarily, and moving the shape of the skeletal structure based on the restored motion data stream of the plurality of streams; and reproducing the sound synchronously with the motion data stream based on the restored audio data stream; wherein the generating comprises designating, in response to a request from the at least one of the plurality of receiving systems, a kind and a section of data to be transmitted, controlling the designated data and setting transmission of the controlled designated data to the at least one receiving system such that the transmitting system transfers the controlled designated data to the at least one receiving system in response to the request.

14. The method as claimed in claim 13 , wherein the transmitting comprises producing data stream discriminatory information for discriminating the shape data stream, the motion data stream and the audio data stream from each other and compressing or dividing the data streams, including the discriminatory information, into predetermined divisional units so as to transmit the data streams together with the discriminatory information; wherein the receiving comprises discriminating the shape data stream, the motion data stream and the audio data stream from each other and restoring the original plurality of data streams by simultaneously coupling the divisional units with each other on the basis of the discriminatory information; wherein the generating comprises discriminating the shape data stream, the motion data stream and the audio data stream from each other in the restored plurality of data streams and reproducing the shape data stream, the motion data stream and the audio data stream on the basis of the discriminatory information.

15. The method as claimed in claim 13 , wherein the transmitting comprises producing data stream discriminatory information for discriminating the shape data stream, the motion data stream and the audio data stream from each other and compressing or dividing the data streams, including the discriminatory information together with kinds and combinations of a plurality of motions, a shape of a corresponding 3-dimensional skeletal structure and reproduction conditions, into predetermined divisional units so as to transmit the data streams together with the discriminatory the discrimination information; wherein the receiving comprises discriminating the shape data stream, the motion data stream and the audio data stream from each other and restoring the original plurality of data streams for the plurality of motions including simultaneously coupling the divisional units with each other on the basis of the kinds and the combinations of the plurality of motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions; wherein the generating comprises discriminating the shape data stream, the motion data stream and the audio data stream from each other in the restored plurality of data streams and reproducing, for the plurality of motions, motions of the shape of the skeletal structure based on the kinds and combinations of the plurality of motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions.

16. The method as claimed in claim 13 , wherein the transmitting comprises producing data stream discriminatory information for discriminating the shape data stream, the motion data stream and the audio data stream from each other and compressing or dividing the data streams, including the discriminatory information together with kinds and combinations of a plurality of motions and sounds, a shape of a corresponding 3-dimensional skeletal structure and reproduction conditions, into predetermined divisional units so as to transmit the data streams together with the discriminatory information and synchronous information of the motion data stream and the audio data stream; wherein the receiving comprises discriminating the shape data stream, the motion data stream and the audio data stream from each other and restoring the original plurality of data streams for the plurality of motions and sounds, including simultaneously coupling the divisional units with each other on the basis of the kinds and the combinations of the plurality of motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions; wherein the generating comprises discriminating the shape data stream, the motion data stream and the audio data stream from each other in the restored plurality of data streams and reproducing, for the plurality of motions and sounds, motions of the shape of the skeletal structure designated based on the kinds and combinations of the plurality of motions, the shape of the corresponding 3-dimensional skeletal structure and the reproduction conditions and simultaneously reproducing the audio data stream and the motion data stream synchronously with each other.

17. A recording medium readable by a computer connectable with the Internet, for recording a program that causes the computer to execute a process of transmitting and receiving a plurality of data streams representing 3-dimensional virtual space, in which a shape data stream, a motion data stream and an audio data stream respectively representing a shape and a motion of a skeletal structure in 3-dimensional computer graphics (3-DCG) and a sound synchronous with the motion, are transmitted from a transmitting system to a receiving system such that the receiving system generates the 3-DCG through synchronization of the motion data stream and the audio data stream, the computer executed process comprising: simultaneously transmitting, on a real-time basis in response to a request from the receiving system, the shape data stream, the motion data stream and the audio data stream synchronous with the motion data stream as the plurality of streams in accordance with a predetermined format, the motion data stream comprising time series rotational angle data, time series positional data, and time series vector data; connecting the transmitting system and the receiving system in a bidirectional manner to transfer the plurality of streams from the transmitting system to the receiving system interactively; receiving the plurality of streams on a real-time basis to discriminate kinds and formats of the received streams and to subject the discriminated streams to respective restoration processings; generating the shape of the skeletal structure in the 3-dimensional virtual space based on one of the restored shape stream and 3-dimensional shape data read preliminarily, and moving the shape of the skeletal structure based on the restored motion stream of the plurality of streams; and reproducing the sound synchronously with the motion data stream based on the restored audio data stream.

18. A transmitting system for use in an apparatus for transmitting and receiving a plurality of data streams representing 3-dimensional virtual space, the apparatus comprising a receiving system and a transfer system, for connecting the transmitting system and the receiving system in a bidirectional manner, wherein a shape data stream, a motion data stream and an audio data stream, respectively representing a shape and a motion of a skeletal structure in 3-dimensional computer graphics (3-DCG) and a sound synchronous with the motion, are transmitted to the receiving system from the transmitting system such that the receiving system generates the 3-DCG through synchronization of the motion data stream and the audio data stream, the transmitting system comprising: a transmitter portion that simultaneously transmits, on real-time basis in response to a request from the receiving system, the plurality of data streams, comprising the shape data stream, the motion data stream and the audio data stream synchronous with the motion data stream, in accordance with a predetermined format, the motion data stream comprising time series rotational angle data, time series positional data, and time series vector data, such that the transfer system interactively transfers the plurality of data streams from the transmitting system to the receiving system.

19. A receiving system for use in an apparatus for transmitting and receiving a plurality of data streams representing 3-dimensional virtual space, the apparatus comprising a transmitting system and a transfer system for connecting the transmitting system and the receiving system in a bidirectional manner, wherein a shape data stream, a motion data stream and an audio data stream, respectively representing a shape and a motion of a skeletal structure in 3-DCG and a sound synchronous with the motion, are transmitted to the receiving system from the transmitting system such that the receiving system generates the 3-DCG through synchronization of the motion data stream and the audio data stream; wherein the transmitting system simultaneously transmits, on a real-time basis in response to a request from the receiving system, the shape data stream, the motion data stream and the audio data stream synchronous with the motion data stream as the plurality of data streams in accordance with a predetermined format, the motion data stream comprising time series rotational angle data, time series positional data, and time series vector data, such that the transfer system interactively transfers the plurality of data steams from the transmitting system to the receiving system; the receiving system comprising: a data stream receiver portion that receives the plurality of data streams transmitted from the transmitting system via the transfer system so as to discriminate kinds and formats of the received plurality of data streams, receiving the plurality of streams as necessary on a real-time basis to subject the discriminated streams to respective restoration processings; a 3-dimensional virtual space generating portion that generates the shape of the skeletal structure in the 3-dimensional virtual space using the shape data stream or 3-dimensional shape data read preliminarily and moves the shape of the skeletal structure using the motion data stream; and a sound generating portion that reproduces the sound using the audio data stream synchronously with the motion data stream.