The present disclosure according to at least one embodiment relates to, in the learning process of a child using smart toys, a method and system for providing an interactive service by using a smart toy, which provide more accurate classified emotional state of the child based on at least one or more sensed data items of an optical image, a thermal image, and voice data of the child, as well as adaptively provide a flexible and versatile interactive service according to classified emotions.
Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A smart toy system, comprising: a smart toy configured to use at least one sensor to collect at least one or more sensed data items of an optical image, a thermal image, and voice data of a child currently in play; a service platform apparatus configured to receive the sensed data items, to generate classified emotion information after classifying a current emotional state of the child, and to extract and provide an interactive service corresponding to the classified emotion information; and a user terminal configured to receive personalized content provided according to the interactive service, wherein the service platform apparatus comprises: a learning model unit configured to provide at least one learning model trained in advance based on a plurality of data for checking the emotional state of the child and extracting the interactive service; and a voice data preprocessing unit configured to extract and collect all or part of voice loudness, voice tremor and language from the voice data as a part of the classified emotion information, wherein the learning model unit is configured to have a model, as one of the learning models trained in advance based on another voice data of a child to perform a normalization of the voice data in tune with a predefined voice frequency of a child, wherein the service platform apparatus is configured to restore the thermal image of lower pixel resolution to an equivalent image of higher pixel resolution with reference to the optical image.
This invention relates to smart toy systems designed to enhance child interaction and engagement. The problem addressed is the need for toys that can understand and respond to a child's emotional state in a personalized and interactive manner. The system comprises a smart toy equipped with sensors to gather data including optical images, thermal images, and voice recordings of a child during play. This collected data is transmitted to a service platform apparatus. The service platform processes this data to classify the child's current emotional state and then generates classified emotion information. Based on this emotion information, the platform extracts and provides a corresponding interactive service. A user terminal receives personalized content tailored to the interactive service. The service platform includes a learning model unit, pre-trained on extensive data related to child emotional states and interactive service extraction. It also features a voice data preprocessing unit that extracts features like voice loudness, tremor, and language from voice data as part of the classified emotion information. Notably, the learning model unit can normalize voice data to match a predefined child voice frequency. Furthermore, the service platform can enhance low-resolution thermal images to a higher resolution by referencing an accompanying optical image.
2. The smart toy system of claim 1 , wherein the service platform apparatus comprises: a service providing unit configured to generate the classified emotion information by using the learning model and to provide the interactive service related to two-way communications between the child and the smart toy; and a content providing unit configured to generate the personalized content corresponding to the classified emotion information and providing the personalized content as the interactive service.
The smart toy system is designed to enhance child engagement through personalized interactive services based on emotion recognition. The system addresses the challenge of providing adaptive and emotionally responsive play experiences for children. The service platform apparatus within the system includes a service providing unit and a content providing unit. The service providing unit utilizes a learning model to classify emotion information derived from child interactions with the smart toy. It facilitates two-way communications between the child and the toy, enabling dynamic engagement. The content providing unit generates personalized content tailored to the classified emotion information, delivering this content as part of the interactive service. This ensures the toy adapts its responses and activities to the child's emotional state, fostering a more immersive and responsive play experience. The system leverages machine learning to analyze and interpret emotional cues, allowing for real-time adjustments in content and interactions. This approach aims to improve child engagement, emotional development, and learning outcomes through adaptive, context-aware play.
3. The smart toy system of claim 1 , wherein the service platform apparatus is configured to generate interactive behavior information including at least one or more of an utterance, a gesture, and an expression of the smart toy based on the classified emotion information, or to interwork with an external device to receive the personalized content corresponding to the classified emotion information and provide the personalized content as the interactive service.
A smart toy system is designed to enhance emotional interaction between a child and a toy by analyzing the child's emotional state and generating appropriate responses. The system includes a smart toy with sensors to detect the child's emotional cues, such as facial expressions, voice tone, or gestures. A service platform processes this data to classify the child's emotions, such as happiness, sadness, or frustration. Based on this classification, the platform generates interactive behavior information for the toy, which may include spoken utterances, physical gestures, or facial expressions that align with the detected emotion. For example, if the child appears sad, the toy might respond with a comforting voice or gesture. Additionally, the system can interoperate with external devices, such as smartphones or tablets, to retrieve personalized content—such as stories, songs, or games—that matches the child's emotional state. This content is then delivered through the toy or the external device to provide a tailored interactive experience. The goal is to create a more engaging and emotionally responsive playtime environment that adapts to the child's needs in real time.
4. The smart toy system of claim 1 , wherein the service platform apparatus is configured to generate, based on the optical image and the thermal image, the classified emotion information by finely classifying the current emotional state of the child based on basic emotion information that is predefined.
A smart toy system includes a service platform apparatus that processes optical and thermal images of a child to determine their emotional state. The system captures visual and thermal data to analyze the child's expressions and physiological responses, such as facial temperature changes, which correlate with emotions. The service platform uses predefined basic emotion categories (e.g., happiness, sadness, anger) and further refines these into more detailed emotional states (e.g., mild frustration vs. intense frustration). This fine classification helps the system tailor interactions, such as adjusting toy behavior or suggesting activities, to better engage the child based on their precise emotional state. The system may also track emotional trends over time to provide insights into the child's well-being. The thermal imaging component enhances accuracy by detecting subtle physiological cues that optical images alone may miss, improving the system's ability to respond appropriately to the child's needs. This approach enables more personalized and adaptive interactions in educational or therapeutic settings.
5. The smart toy system of claim 4 , wherein the service platform apparatus is configured to extract a feature point related to a face of the child out of the optical image and to provide the basic emotion information by primarily classifying current emotional state information of the child based on an extracted feature point.
The smart toy system is designed for child engagement and emotional analysis. It includes a service platform apparatus that processes optical images of a child to extract facial feature points. These feature points are used to classify the child's current emotional state into basic emotion information, such as happiness, sadness, or anger. The system may also include a toy apparatus with a communication module to interact with the service platform, allowing the toy to respond to the child's emotions in real-time. The service platform may further analyze the child's emotional trends over time to provide insights into their emotional development. The toy apparatus may include sensors, such as a microphone or camera, to capture additional data for emotional analysis. The system aims to enhance child engagement by adapting interactions based on detected emotions, improving emotional learning and social development. The service platform may also store and process the emotional data to generate reports or recommendations for caregivers. The system ensures privacy by securely handling and processing the child's data.
6. The smart toy system of claim 4 , wherein the service platform apparatus is configured to perform an emotion refinement and analysis process on the thermal image by measuring heat/temperature at a predefined specific region and quantifying a degree of the basic emotion information based on information on the heat/temperature measured, to generate refined emotion information, and to provide the refined emotion information as the classified emotion information.
This invention relates to a smart toy system that analyzes a child's emotional state using thermal imaging to enhance interactive play. The system addresses the challenge of accurately detecting and responding to a child's emotions during playtime, which is difficult with traditional methods like facial recognition or voice analysis. The system includes a thermal imaging device that captures thermal images of the child's face, focusing on predefined facial regions associated with emotional expression, such as the cheeks or forehead. A service platform processes these images by measuring heat or temperature variations in these regions, which correlate with emotional states like happiness, sadness, or frustration. The platform refines and quantifies this thermal data to generate classified emotion information, allowing the toy to adapt its responses based on the child's detected emotions. This refinement process improves accuracy by filtering out irrelevant thermal noise and focusing on key emotional indicators. The system enables the toy to provide personalized interactions, such as adjusting gameplay difficulty or offering comfort, based on the child's real-time emotional feedback. This approach enhances child engagement and emotional development by creating a responsive and empathetic play environment.
7. The smart toy system of claim 6 , wherein the service platform apparatus is configured to generate a 3D composite image by synthesizing the optical image and the thermal image, and to generate the refined emotion information based on heat/temperature information that underwent a temperature correction in relation to distance between the smart toy and the child based on the 3D composite image.
This invention relates to a smart toy system designed to analyze a child's emotional state using optical and thermal imaging. The system includes a smart toy equipped with optical and thermal cameras to capture images of the child. A service platform apparatus processes these images to generate a 3D composite image by combining the optical and thermal data. The system then refines emotion information by applying temperature corrections to the thermal data based on the distance between the smart toy and the child. This correction accounts for variations in heat detection due to proximity, improving the accuracy of emotional analysis. The refined emotion information is used to assess the child's emotional state, enabling the smart toy to respond appropriately. The system may also include additional features such as facial recognition, gesture detection, and interactive feedback mechanisms to enhance engagement and emotional support. The primary problem addressed is the need for accurate, non-invasive emotional analysis in smart toys to provide personalized and responsive interactions with children.
8. The smart toy system of claim 4 , wherein the service platform apparatus is configured to further classify the current emotional state of the child based on the voice data to generate subtle classified information and to provide the subtle classified information as the classified emotion information.
The smart toy system is designed for interactive play and emotional monitoring of children. The system includes a smart toy with sensors to capture voice data from a child during play, and a service platform apparatus that processes this data. The service platform analyzes the voice data to determine the child's current emotional state, generating classified emotion information. This classification includes identifying subtle emotional nuances, such as variations in tone, pitch, or speech patterns, to refine the emotional assessment. The refined, subtle classified information is then provided as part of the overall classified emotion data. This allows the system to offer more precise emotional insights, which can be used to adapt the toy's responses or provide feedback to caregivers. The system enhances child engagement by dynamically adjusting interactions based on detected emotions, promoting emotional awareness and support. The service platform's advanced classification ensures detailed emotional tracking, improving the toy's ability to respond appropriately to the child's emotional state.
9. The smart toy system of claim 8 , wherein the service platform apparatus is configured to generate the subtle classified information by combining a child's classified emotional state based on the voice data with a child's classified emotional state based on the optical image and the thermal image.
The smart toy system is designed for analyzing and responding to a child's emotional state using voice, optical, and thermal data. The system includes a smart toy apparatus equipped with sensors to capture voice data, optical images, and thermal images of the child. A service platform apparatus processes this data to classify the child's emotional state from each data type. The system then generates subtle classified information by combining the emotional state derived from voice data with the emotional state derived from the optical and thermal images. This combined analysis provides a more accurate and nuanced understanding of the child's emotional state, enabling the system to deliver appropriate responses or interactions. The smart toy apparatus may include a microphone for voice data, a camera for optical images, and a thermal imaging sensor for thermal images. The service platform apparatus processes the data using machine learning or other analytical techniques to classify emotions and generate the combined emotional state information. The system may also include a communication module to transmit data between the smart toy and the service platform. The overall goal is to enhance the toy's ability to engage with the child in a personalized and emotionally responsive manner.
10. The smart toy system of claim 1 , wherein the smart toy is configured to further collect a behavior pattern of the child as the sensed data item, and the service platform apparatus is configured to generate the classified emotion information by further considering a child's emotional state classified based on the behavior pattern.
The smart toy system is designed for interactive play and child development, addressing the need for toys that can adapt to a child's emotional and behavioral states to enhance engagement and learning. The system includes a smart toy equipped with sensors to detect a child's physical and emotional responses, such as facial expressions, voice tones, or movements. The toy collects this data, including behavior patterns, and transmits it to a service platform apparatus. The platform processes the data to classify the child's emotional state, using the behavior patterns alongside other sensed data like facial expressions or voice analysis. By analyzing these patterns, the platform generates classified emotion information, allowing the toy to respond appropriately—such as adjusting gameplay difficulty, offering encouragement, or suggesting activities based on the child's current emotional state. This adaptive interaction aims to improve child engagement, emotional regulation, and learning outcomes through personalized responses. The system may also store historical data to track developmental progress and provide insights to caregivers.
11. A method performed by a smart toy system for providing an interactive service, the method comprising: collecting, by a smart toy utilizing at least one sensor, at least one or more sensed data items of an optical image, a thermal image, and voice data of a child currently in play; child currently in play; receiving, by a service platform apparatus, the sensed data items to generate classified emotion information after classifying a current emotional state of the child, and to extract and provide the interactive service corresponding to the classified emotion information; and receiving, by the smart toy and a user terminal, the interactive service that is provided, wherein the receiving the sensed data items to extract and provide the interactive service further comprising: providing at least one learning model trained in advance based on a plurality of data for checking the emotional state of the child, preprocessing through extracting and collecting all or part of voice loudness, voice tremor and language from the voice data as a part of the classified emotion information, and restoring the thermal image of lower pixel resolution to an equivalent image of higher pixel resolution with reference to the optical image, wherein one of the learning models is a model which trained in advance based on another voice data of a child to perform a normalization of the voice data in tune with a predefined voice frequency of a child.
This invention relates to a smart toy system designed to provide interactive services by analyzing a child's emotional state during play. The system addresses the challenge of creating engaging and responsive play experiences by dynamically adapting to the child's emotions in real-time. The smart toy collects sensory data, including optical images, thermal images, and voice data, from the child. This data is transmitted to a service platform, which processes it to classify the child's emotional state. The platform uses pre-trained learning models to analyze voice characteristics such as loudness, tremor, and language, as well as thermal image data, which is enhanced by restoring lower-resolution images to higher resolution using optical image references. One of the models normalizes voice data to match predefined child voice frequencies. Based on the classified emotional state, the platform extracts and provides an interactive service tailored to the child's current mood. Both the smart toy and a user terminal receive and deliver this service, ensuring a personalized and adaptive play experience. The system leverages advanced machine learning and image processing techniques to create a responsive and emotionally intelligent toy environment.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
November 15, 2019
February 8, 2022
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.