Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. An apparatus for a user to use to communicate with an electronic device, the apparatus comprising: memory; a processor that receives facial expression (FE) information indicative of one or more facial expressions performed by the user, and that receives body information indicative of motion or position of one or more body parts of the user, said body information being distinct from said FE information; and an inertial motion sensor providing at least a portion of said body information; wherein said processor starts generating first signals to modify an object of interest (OOI) on the electronic device when an active facial expression is detected based on said FE information, said first signals being based on said body information; and wherein said processor stops generating said first signals when said active facial expression is no longer detected.
An apparatus enables a user to communicate with an electronic device. It comprises memory and a processor. The processor receives facial expression (FE) information and body information (motion or position of body parts), where the body information is distinct from the FE information. An inertial motion sensor provides at least part of the body information. When an active facial expression is detected, the processor starts generating first signals (based on the body information) to modify an object of interest (OOI) on the electronic device. The processor stops generating these first signals when the active facial expression is no longer detected.
2. The apparatus of claim 1 , wherein said processor generates a selection signal when said FE information crosses or reaches a first threshold, wherein said selection signal is distinct from said first signals.
The apparatus from the previous communication system generates a selection signal when the facial expression information crosses or reaches a first threshold. This selection signal is distinct from the first signals that modify the object of interest based on body movement. The selection signal happens upon facial expression reaching a threshold.
3. The apparatus of claim 1 , wherein said apparatus further comprises a FE sensor providing at least a portion of said FE information.
The apparatus from the previous communication system further comprises a facial expression (FE) sensor that provides at least a portion of the facial expression (FE) information. This facial expression data is then used alongside body movement information to control an object of interest on the device.
4. The apparatus of claim 3 , wherein said FE sensor comprises a proximity sensor.
The apparatus with facial expression and body tracking includes a proximity sensor as the facial expression (FE) sensor. This sensor provides at least a portion of the facial expression information used by the system.
5. The apparatus of claim 3 , wherein said FE sensor comprises a touch sensor.
The apparatus with facial expression and body tracking includes a touch sensor as the facial expression (FE) sensor. This sensor provides at least a portion of the facial expression information used by the system.
6. The apparatus of claim 3 , wherein said FE sensor comprises a sliding motion sensor.
The apparatus with facial expression and body tracking includes a sliding motion sensor as the facial expression (FE) sensor. This sensor provides at least a portion of the facial expression information used by the system.
7. The apparatus of claim 3 , wherein said FE sensor comprises a body orifice sensor.
The apparatus with facial expression and body tracking includes a body orifice sensor as the facial expression (FE) sensor. This sensor provides at least a portion of the facial expression information used by the system.
8. The apparatus of claim 3 , wherein said FE sensor comprises an image sensor.
The apparatus with facial expression and body tracking includes an image sensor as the facial expression (FE) sensor. This sensor provides at least a portion of the facial expression information used by the system.
9. The apparatus of claim 3 , wherein said FE information is information indicative of touch between said FE sensor and said one or more facial muscles of the user.
In the apparatus with facial expression and body tracking, the facial expression (FE) information is based on touch between the facial expression (FE) sensor and one or more facial muscles of the user.
10. The apparatus of claim 3 , wherein said apparatus is part of a device worn on the user's head.
The apparatus with facial expression and body tracking is part of a device worn on the user's head. This head-worn device incorporates the FE sensor and inertial motion sensor for input.
11. The apparatus of claim 10 , wherein said device worn on the user's head is in the form of eyewear.
The head-worn device with facial expression and body tracking from the previous description is in the form of eyewear. This eyewear incorporates the FE sensor and inertial motion sensor for input.
12. The apparatus of claim 10 , wherein said apparatus further comprises a motion sensor that provides at least a portion of said body information.
The head-worn device with facial expression and body tracking further comprises a motion sensor that provides at least a portion of the body information.
13. The apparatus of claim 10 , wherein said apparatus is integrated into the electronic device.
The apparatus with facial expression and body tracking that is part of a device worn on the user's head is integrated into the electronic device. The communication system is embedded directly within the electronic device.
14. The apparatus of claim 3 , wherein said FE sensor senses at least one of sipping or puffing action performed by the user.
In the apparatus with facial expression and body tracking, the facial expression (FE) sensor senses at least one of sipping or puffing action performed by the user. This provides facial expression information to the system.
15. The apparatus of claim 1 , wherein said apparatus further comprises an image sensor providing a portion of at least one of said FE information and said body information.
The apparatus includes an image sensor that provides a portion of at least one of the facial expression (FE) information or the body information.
16. The apparatus of claim 1 , wherein said apparatus further comprises an eye gaze tracking system generating a portion of at least one of said FE information and said body information.
The apparatus includes an eye gaze tracking system that generates a portion of at least one of the facial expression (FE) information or the body information.
17. The apparatus of claim 1 , wherein said first signals are modified based on said FE information.
The apparatus generates first signals to modify an object of interest on the electronic device based on body information, which are then modified based on the facial expression (FE) information.
18. The apparatus of claim 1 , wherein said first signals modify location of said OOI.
The apparatus generates first signals to modify the location of the object of interest (OOI) on the electronic device, based on body information when a facial expression is detected.
19. The apparatus of claim 1 , wherein said first signals modify visual characteristics of said OOI.
The apparatus generates first signals to modify the visual characteristics of the object of interest (OOI) on the electronic device, based on body information when a facial expression is detected.
20. The apparatus of claim 1 , wherein said first signals cause a different object on said electronic device to be designated as said OOI.
The apparatus generates first signals that cause a different object on the electronic device to be designated as the object of interest (OOI), based on body information when a facial expression is detected.
21. The apparatus of claim 1 , wherein said OOI is invisible to human eyes.
The object of interest (OOI) being modified by the apparatus' signals is invisible to human eyes.
22. The apparatus of claim 1 , wherein said processor generates second signals based on said FE information, wherein said second signals are distinct from said first signals.
The apparatus also generates second signals based on the facial expression (FE) information. These second signals are distinct from the first signals generated based on body information to modify an object of interest.
23. The apparatus of claim 1 , wherein said processor uses a different gain curve to generate said first signals based on a type of said first signals being generated.
The processor uses a different gain curve to generate the first signals based on the type of first signals being generated (i.e. movement vs. selection), based on body information when a facial expression is detected.
24. The apparatus of claim 1 , wherein said processor saves a portion of at least one of said FE information, said body information and information indicative of said first signals in said memory or on the electronic device.
The apparatus saves a portion of at least one of the facial expression (FE) information, the body information, and information indicative of the first signals in memory or on the electronic device.
25. The apparatus of claim 1 , wherein said FE information is based on position of one or more facial muscles of the user.
The facial expression (FE) information is based on the position of one or more facial muscles of the user.
26. The apparatus of claim 25 , wherein said one or more facial muscles of the user comprises at least one of the muscles of the user's cheek.
The facial expression (FE) information is based on the position of one or more facial muscles, including at least one of the muscles of the user's cheek.
27. The apparatus of claim 25 , wherein said one or more facial muscles of the user comprises at least one of the muscles of the user's mouth.
The facial expression (FE) information is based on the position of one or more facial muscles, including at least one of the muscles of the user's mouth.
28. The apparatus of claim 25 , wherein said one or more facial muscles of the user comprises at least one muscle of the user's eye brow.
The facial expression (FE) information is based on the position of one or more facial muscles, including at least one muscle of the user's eyebrow.
29. The apparatus of claim 25 , wherein one or more facial muscles of the user comprises at least one muscle of the user's eye lid.
The facial expression (FE) information is based on the position of one or more facial muscles, including at least one muscle of the user's eyelid.
30. The apparatus of claim 1 , wherein said apparatus further comprises at least one of a touch sensor, a proximity sensor, a pressure sensor, an EMG sensor, an ultrasonic sensor or a radar sensor that provides at least a portion of said FE information.
The apparatus includes at least one of a touch sensor, a proximity sensor, a pressure sensor, an EMG sensor, an ultrasonic sensor, or a radar sensor that provides at least a portion of the facial expression (FE) information.
31. The apparatus of claim 1 , wherein said one or more body parts of the user comprises the user's head.
The one or more body parts of the user used for body information includes the user's head.
32. The apparatus of claim 1 , wherein said one or more body parts of the user comprises one or more of the user's eye balls.
The one or more body parts of the user used for body information includes one or more of the user's eyeballs.
33. The apparatus of claim 1 , wherein said apparatus is included in the electronic device.
The apparatus with facial expression and body tracking is included directly in the electronic device.
34. The apparatus of claim 1 , wherein said processor suppresses generation of a first portion of said first signals for a first time duration starting immediately after said active facial expression is detected based on said FE information.
The processor suppresses generation of a first portion of the first signals for a first time duration starting immediately after the active facial expression is detected based on the facial expression (FE) information.
35. The apparatus of claim 34 , wherein said processor suppresses or resumes generation of a second portion of said first signals based on a rate of change of said FE information.
The processor suppresses or resumes generation of a second portion of the first signals based on a rate of change of the facial expression (FE) information. This controls the responsiveness of the system.
36. A computer-implemented method for a user to communicate with an electronic device, said computer-implemented method comprising: receiving facial expression (FE) information indicative of one or more facial expressions performed by the user, wherein said FE information is provided by a FE sensor; receiving body information indicative of motion or position of one or more body parts of the user, said body information being distinct from said FE information and wherein said body information is provided by a motion sensor; generating first signals to modify an object of interest (OOI) on the electronic device when an active facial expression is detected based on said FE information, said first signals being based on said body information; and ending generation of said first signals when said active facial expression is no longer detected.
A computer-implemented method allows a user to communicate with an electronic device. It involves: receiving facial expression (FE) information from a FE sensor; receiving body information (motion or position) from a motion sensor, distinct from the FE information; generating first signals to modify an object of interest (OOI) on the electronic device based on body information when an active facial expression is detected; and ending generation of the first signals when the active facial expression is no longer detected.
37. The computer-implemented method of claim 36 , wherein said computer-implemented method further comprises generating selection signals when FE information crosses or reaches a third FE level.
The computer-implemented method from the previous communication system further comprises generating selection signals when facial expression (FE) information crosses or reaches a third FE level.
38. The computer-implemented method of claim 37 , wherein said selection signals comprise mouse signals.
In the computer-implemented method, the selection signals generated based on facial expressions comprise mouse signals.
39. The computer-implemented method of claim 36 , wherein said first signals modify location of said OOI.
In the computer-implemented method, the first signals modify the location of the object of interest (OOI).
40. The computer-implemented method of claim 36 , wherein said first signals modify visual characteristics of said OOI.
In the computer-implemented method, the first signals modify the visual characteristics of the object of interest (OOI).
41. The computer-implemented method of claim 36 , wherein said motion sensor comprises an image sensor.
In the computer-implemented method, the motion sensor that provides body information comprises an image sensor.
42. The computer-implemented method of claim 36 , wherein said motion sensor comprises an inertial motion sensor.
In the computer-implemented method, the motion sensor that provides body information comprises an inertial motion sensor.
43. The computer-implemented method of claim 36 , wherein said FE sensor comprises an image sensor.
In the computer-implemented method, the facial expression (FE) sensor that provides facial expression information comprises an image sensor.
44. The computer-implemented method of claim 36 , wherein said FE sensor comprises a proximity sensor.
In the computer-implemented method, the facial expression (FE) sensor that provides facial expression information comprises a proximity sensor.
45. The computer-implemented method of claim 36 , wherein said FE sensor comprises a touch sensor.
In the computer-implemented method, the facial expression (FE) sensor that provides facial expression information comprises a touch sensor.
46. The computer-implemented method of claim 36 , wherein said FE sensor comprises at least one of an EMG sensor, a pressure sensor, a strain sensor, a sonar sensor, an ultrasonic sensor and a radar sensor.
This invention relates to a computer-implemented method for monitoring and analyzing physiological or environmental data using a front-end (FE) sensor system. The method addresses the challenge of accurately detecting and processing signals from various sensor types to derive meaningful insights, such as muscle activity, pressure changes, or environmental conditions. The FE sensor system includes at least one sensor selected from electromyography (EMG) sensors, pressure sensors, strain sensors, sonar sensors, ultrasonic sensors, or radar sensors. These sensors capture raw data, which is then processed to extract relevant information. For example, EMG sensors detect electrical activity in muscles, pressure sensors measure force or deformation, and sonar/ultrasonic/radar sensors detect distance or movement. The method ensures compatibility with multiple sensor types, allowing flexible deployment in applications like medical monitoring, industrial automation, or environmental sensing. The system processes the sensor data to filter noise, normalize signals, and generate actionable outputs, such as alerts or control signals. This approach enhances accuracy and reliability in diverse sensing applications.
47. A non-transitory computer readable medium comprising one or more programs configured to be executed by one or more processors to enable a user to communicate with an electronic device, said one or more programs causing performance of a method comprising: receiving facial expression (FE) information indicative of one or more facial expressions performed by the user, said FE information being provided by a FE sensor; receiving body information indicative of motion or position of one or more body parts of the user, said body information being distinct from said FE information, said body information provided by a motion sensor; generating first signals to communicate with the electronic device when an active facial expression is detected based on said FE information, said first signals being based on said body information; and ending generation of said first signals when said active facial expression is no longer detected.
A non-transitory computer readable medium contains programs to enable a user to communicate with an electronic device. The programs, when executed, perform the following: receive facial expression (FE) information from a FE sensor; receive body information (motion or position) from a motion sensor, distinct from the FE information; generate first signals to communicate with the electronic device based on body information when an active facial expression is detected; and end generation of the first signals when the active facial expression is no longer detected.
48. The non-transitory computer readable medium of claim 47 , wherein said first signals modify an object of interest (OOI) on the electronic device.
The non-transitory computer readable medium's first signals modify an object of interest (OOI) on the electronic device. Body movement controls the object when a facial expression is active.
49. The non-transitory computer readable medium of claim 48 , wherein said first signals comprise one or more signals to modify the location of said OOI on the electronic device.
The non-transitory computer readable medium's first signals comprise one or more signals to modify the location of the object of interest (OOI) on the electronic device.
50. The non-transitory computer readable medium of claim 49 , wherein said OOI comprises a graphical object on a display screen of the electronic device.
The non-transitory computer readable medium's object of interest (OOI) comprises a graphical object on a display screen of the electronic device.
51. The non-transitory computer readable medium of claim 50 , wherein said graphical object comprises a mouse pointer.
The non-transitory computer readable medium's graphical object comprises a mouse pointer.
52. The non-transitory computer readable medium of claim 50 , wherein said active facial expression is detected when said FE information reaches or crosses a first FE level.
The non-transitory computer readable medium's active facial expression is detected when the facial expression (FE) information reaches or crosses a first FE level.
53. The non-transitory computer readable medium of claim 48 , wherein said first signals comprise one or more signals to modify the magnitude of said OOI on the electronic device.
The non-transitory computer readable medium's first signals comprise one or more signals to modify the magnitude of the object of interest (OOI) on the electronic device.
54. The non-transitory computer readable medium of claim 48 , wherein said first signals comprise one or more second signals, said one or more second signals configured to modify the selection state of said OOI on the electronic device.
The non-transitory computer readable medium's first signals comprise one or more second signals that are configured to modify the selection state of the object of interest (OOI) on the electronic device.
55. The non-transitory computer readable medium of claim 54 , wherein said one or more second signals comprise mouse button signals.
The non-transitory computer readable medium's one or more second signals comprise mouse button signals.
56. The non-transitory computer readable medium of claim 47 , wherein said first signals comprise one or more signals for modification of an Object of Interest (OOI) on the electronic device.
The non-transitory computer readable medium's first signals comprise one or more signals for modification of an object of interest (OOI) on the electronic device.
57. The non-transitory computer readable medium of claim 56 , wherein said OOI comprises a graphical object on a display screen of the electronic device.
The non-transitory computer readable medium's object of interest (OOI) comprises a graphical object on a display screen of the electronic device.
58. The non-transitory computer readable medium of claim 57 , wherein said active facial expression is detected when said FE information reaches or crosses a second FE level.
The non-transitory computer readable medium's active facial expression is detected when the facial expression (FE) information reaches or crosses a second FE level.
59. The non-transitory computer readable medium of claim 47 , wherein said first signals comprise one or more signals for selection of an Object of Interest (OOI) on the electronic device.
The non-transitory computer readable medium's first signals comprise one or more signals for selection of an object of interest (OOI) on the electronic device.
60. The non-transitory computer readable medium of claim 47 , wherein said first signals comprise one or more signals for a click and drag command on the electronic device.
The non-transitory computer readable medium's first signals comprise one or more signals for a click and drag command on the electronic device.
Unknown
October 10, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.