9170649

Audio and tactile feedback based on visual environment

PublishedOctober 27, 2015
Assigneenot available in USPTO data we have
Technical Abstract

Patent Claims
24 claims

Legal claims defining the scope of protection, as filed with the USPTO.

1

1. An apparatus comprising: a housing section; electronic circuitry mounted within the housing section; a touch screen on the housing section, wherein the touch screen is configured to sense a touch at an area of the touch screen, and wherein the electronic circuitry is configured to analyze a feature displayed at the area of the touch screen; and a user sensory feedback system proximate the housing section, wherein the user sensory feedback system is configured to perform a sensory feedback operation based, at least partially, upon a direction of movement of the touch at the area of the touch screen and upon an image analysis of the feature at the area of the touch screen, wherein different directions of movement along the feature displayed at the area generate different user sensory feedback operations, wherein the user sensory feedback system is configured to provide an audio and/or tactile feedback based, at least in part, on the image analysis of the feature at the area of the touch screen, wherein the apparatus is configured to perform a direction analysis relative to the feature and an edge detection corresponding to the feature when the image analysis is performed, and wherein the edge detection comprises an edge detection algorithm configured to detect an edge of a window border proximate the feature, and wherein the feedback is provided via a transducer based on the image analysis identifying at least one of intensity, sharpness, brightness, or contrast of the feature.

2

2. The apparatus of claim 1 wherein the user sensory feedback system is configured to provide the audio and/or tactile feedback to a user at the area of the touch screen.

3

3. The apparatus of claim 1 wherein the touch screen is configured to display a still image, a moving picture, or a video at the area of the touch screen.

4

4. The apparatus of claim 1 wherein the apparatus comprises a portable communication device.

5

5. The apparatus of claim 1 wherein the texture analysis comprises a texture analysis algorithm configured to analyze the roughness in a pre-defined area around each point on the screen.

6

6. The apparatus of claim 1 wherein the edge of the window border is at the feature, and wherein the user sensory feedback system is configured to provide an audio and/or tactile feedback based, at least in part, on the detected edge of the window border.

7

7. The apparatus of claim 6 wherein the edge detection algorithm is configured to covert the area of the touchscreen into a ‘bump map’ corresponding to detected edges at the area of the touchscreen.

8

8. An apparatus comprising: a housing section; electronic circuitry mounted within the housing section; a touch screen on the housing section, wherein the touch screen is configured to sense a touch at an area of the touch screen, wherein the electronic circuitry is configured to determine a first texture direction of a feature displayed at the area of the touch screen, and wherein the electronic circuitry is configured to determine a second different texture direction of the feature displayed at the area of the touch screen, wherein the first texture direction comprises a direction along the area of the touch screen, and wherein the second texture direction comprises another different direction along the area of the touch screen; and a user sensory feedback system proximate the housing section, wherein the user sensory feedback system is configured to operate in a first mode in response to the touch at the area of the touch screen and the first texture direction of the feature displayed at the area of the touch screen, and wherein the user sensory feedback system is configured to operate in a second different mode in response to the touch at the area of the touch screen and the second texture direction of the feature displayed at the area of the touch screen, wherein the user sensory feedback system is configured to perform a sensory feedback operation based, at least partially, upon a direction of movement of the touch at the area of the touch screen and upon an image analysis of the feature at the area of the touch screen, wherein different directions of movement along the feature displayed at the area generate different user sensory feedback operations, wherein the user sensory feedback system is configured to provide an audio and/or tactile feedback based, at least in part, on the image analysis of the feature at the area of the touch screen, wherein the apparatus is configured to perform a direction analysis relative to the feature and an edge detection corresponding to the feature when the image analysis is performed, and wherein the edge detection comprises an edge detection algorithm configured to detect an edge of a window border proximate the feature, and wherein the feedback is provided via a transducer based on the image analysis identifying at least one of intensity, sharpness, brightness, or contrast of the feature.

9

9. The apparatus of claim 8 wherein the user sensory feedback system comprises an electroacoustic transducer and/or an electromechanical transducer and wherein the user sensory feedback system is configured to provide an audio and/or tactile feedback to a user at the area of the touch screen.

10

10. The apparatus of claim 8 wherein the user sensory feedback system comprises a piezoelectric actuator.

11

11. A method comprising: sensing a touch at an area of a touch screen; analyzing a feature displayed at the area of the touch screen; operating a user sensory feedback system in response to the touch at the area of the touch screen and an image analysis of the feature at the area of the touch screen, wherein the user sensory feedback system is configured to operate in response to a direction of movement of the touch at the area of the touch screen, wherein the user sensory feedback system comprises at least one transducer configured to produce an audio and/or tactile feedback output wherein the output is configured based on the direction of movement of the touch; and rendering the at least one transducer inactive in response to a change in movement of the touch at the area of the touchscreen; wherein the user sensory feedback system is configured to perform a sensory feedback operation based, at least partially, upon a direction of movement of the touch at the area of the touch screen and upon the image analysis of the feature at the area of the touch screen, wherein different directions of movement along the feature displayed at the area generate different user sensory feedback operations, wherein the user sensory feedback system is configured to provide an audio and/or tactile feedback based, at least in part, on the image analysis of the feature at the area of the touch screen, wherein a direction analysis relative to the feature and an edge detection corresponding to the feature is performed with the image analysis, and wherein the edge detection comprises an edge detection algorithm configured to detect an edge of a window border proximate the feature, and wherein the feedback is provided via the at least one transducer based on the image analysis identifying at least one of intensity, sharpness, brightness, or contrast of the feature.

12

12. The method of claim 11 wherein the operating the user sensory feedback system further comprises rendering the at least one transducer inactive for a change of the feature.

13

13. The method of claim 11 wherein the user sensory feedback system comprises an electroacoustic transducer and/or an electromechanical transducer.

14

14. The method of claim 11 wherein the operating of the user sensory feedback system further comprises operating the user sensory feedback system in response to a touch at another area of the touch screen.

15

15. The method of claim 11 wherein the operating of the user sensory feedback system further comprises operating the user sensory feedback system in response to the touch at the area of the touch screen, wherein the area comprises at least one border of the touch screen, and wherein the user sensory feedback system provides an audio or tactile feedback.

16

16. A method comprising: sensing a touch at an area of a touch screen; determining a first texture direction of a feature displayed at the area of the touch screen; determining a second different texture direction of the feature displayed at the area of the touch screen; operating a user sensory feedback system in a first mode in response to the touch at the area of the touch screen and the first texture direction of the feature displayed at the area of the touch screen; and operating the user sensory feedback system in a second different mode in response to the touch at the area of the touch screen and the second texture direction of the feature displayed at the area of the touch screen; wherein the user sensory feedback system is configured to perform a sensory feedback operation based, at least partially, upon a direction of movement of the touch at the area of the touch screen and upon an image analysis of the feature at the area of the touch screen, wherein different directions of movement along the feature displayed at the area generate different user sensory feedback operations, wherein the user sensory feedback system is configured to provide an audio and/or tactile feedback based, at least in part, on the image analysis of the feature at the area of the touch screen, wherein a direction analysis relative to the feature and an edge detection corresponding to the feature is performed with the image analysis, and wherein the edge detection comprises an edge detection algorithm configured to detect an edge of a window border proximate the feature, and wherein the feedback is provided via the at least one transducer based on the image analysis identifying at least one of intensity, sharpness, brightness, or contrast of the feature.

17

17. The method of claim 16 wherein the user sensory feedback system comprises an electroacoustic transducer and/or an electromechanical transducer.

18

18. The method of claim 16 wherein the operating of the user sensory feedback system further comprises providing an audio and/or tactile feedback to a user at a moment of the touch on the touch screen, and wherein the image analysis comprises an algorithm configured to be run before the moment of the touch on the touch screen.

19

19. The method of claim 16 wherein the determining of the first and second texture directions of the the feature further comprises determining a color, intensity, sharpness, brightness, and/or contrast of the feature displayed at the area of the touch screen, wherein the first texture direction comprises a direction of movement along the area of the touch screen, and wherein the second texture direction comprises another different direction of movement along the area of the touch screen.

20

20. The method of claim 16 wherein the operating of the user sensory feedback system further comprises providing an audio or tactile feedback at the area of the touch screen in response to an image analysis of a color.

21

21. The method of claim 16 wherein the feature comprises a still image, a moving picture, or a video.

22

22. The method of claim 16 wherein the feature comprises regions, icons, text and/or figures.

23

23. The method of claim 16 wherein the operating of the user sensory feedback system further comprises providing an audio or tactile feedback at the area of the touch screen in response to an image analysis of an intensity, sharpness, or brightness of the feature displayed at the area of the touch screen.

24

24. A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine for performing operations to provide feedback based on a feature displayed on a touch screen, the operations comprising: sensing a touch at an area of the touch screen; analyzing a feature displayed at the area of the touch screen; and operating a user sensory feedback system based, at least partially, upon the sensed touch at the area of the touch screen and upon a determined texture direction and/or or a graphical change, at the analyzed feature displayed at the area of the touch screen, wherein the user sensory feedback system is configured to perform a sensory feedback operation based, at least partially, upon a direction of movement of the touch at the area of the touch screen and upon an image analysis of the feature at the area of the touch screen, wherein different directions of movement along the feature displayed at the area generate different user sensory feedback operations, and wherein the user sensory feedback system is configured to provide an audio and/or tactile feedback based, at least in part, on the image analysis of the feature at the area of the touch screen, wherein a direction analysis relative to the feature and an edge detection corresponding to the feature is performed with the image analysis, and wherein the edge detection comprises an edge detection algorithm configured to detect an edge of a window border proximate the feature, and wherein the feedback is provided via a transducer based on the image analysis identifying at least one of intensity, sharpness, brightness, or contrast of the feature.

Patent Metadata

Filing Date

Unknown

Publication Date

October 27, 2015

Inventors

Sami P. Ronkainen

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “Audio and tactile feedback based on visual environment” (9170649). https://patentable.app/patents/9170649

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.