Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A system comprising: a stereoscopic device; a programmable processor; memory including a set of instructions which, if executed by the programmable processor, cause the programmable processor to detect movement of an object; and logic to: detect a change in a light level of one or more pixels; assemble only edges of the object based on the change in the light level of the one or more pixels, the edges of the object including one or more of a leading edge and a trailing edge of the object; determine the one or more of a leading edge and a trailing edge of the object; and segment the object into expected gestures or control commands, wherein the stereoscopic device is mounted on a head mounted display, wherein the stereoscopic device includes one or more pairs of dynamic vision sensors, wherein a temporal and spatial correspondence between the one or more pairs of dynamic vision sensors allows for a correlation of one or more features within the object, and wherein an interrupt is to be generated with corresponding time, pixel address, and state.
2. The system of claim 1 , wherein the dynamic vision sensors enable a motion tracking function.
A system for motion tracking using dynamic vision sensors is disclosed. The system addresses the challenge of accurately detecting and tracking moving objects in real-time environments, where traditional cameras may struggle with high-speed motion or varying lighting conditions. Dynamic vision sensors, which asynchronously capture pixel-level changes in brightness, provide high temporal resolution and low latency, making them well-suited for motion tracking applications. The system leverages these sensors to detect and track objects by analyzing changes in pixel intensity over time, enabling precise motion estimation even in dynamic scenes. The motion tracking function processes the asynchronous event data from the sensors to determine the position, velocity, and trajectory of objects in the field of view. This allows for applications in robotics, autonomous navigation, human-computer interaction, and surveillance, where real-time motion analysis is critical. The system may also integrate additional processing modules to filter noise, reduce computational overhead, and improve tracking accuracy. By utilizing dynamic vision sensors, the system achieves robust motion tracking with minimal latency, overcoming limitations of conventional frame-based cameras.
3. The system of claim 1 , wherein the dynamic vision sensors enable a gesture control function.
Dynamic vision sensors are used in systems to enable gesture control functionality. These sensors detect and process visual information in real-time, allowing users to interact with devices or systems through hand movements or other gestures. The technology addresses the need for intuitive, hands-free control in applications such as virtual reality, augmented reality, robotics, and smart environments. By capturing rapid changes in light intensity, dynamic vision sensors provide high temporal resolution, making them effective for tracking fast-moving gestures. The system integrates these sensors with processing units that interpret gestures and translate them into commands for controlling devices or software. This eliminates the need for physical input devices like keyboards or touchscreens, enhancing user experience and accessibility. The sensors may also include noise reduction and motion filtering to improve accuracy in varying lighting conditions. The overall system enables seamless interaction between users and technology, particularly in environments where traditional input methods are impractical or inconvenient.
4. An apparatus comprising: fixed functionality logic to detect movement of an object based on input from a stereoscopic device; and a programmable processor to: detect a change in a light level of one or more pixels; assemble only edges of the object based on the change in a light level of one or more pixels, the edges of the object including one or more of a leading edge and a trailing edge of the object; determine the one or more of a leading edge and a trailing edge of the object; and segment the object into expected gestures or control commands, wherein the stereoscopic device is mounted on a head mounted display, wherein the stereoscopic device includes one or more pairs of dynamic vision sensors, wherein a temporal and spatial correspondence between the one or more pairs of dynamic vision sensors allows for a correlation of one or more features within the object, and wherein an interrupt is to be generated with corresponding time, pixel address, and state.
This invention relates to an apparatus for detecting and interpreting object movement using a stereoscopic device, particularly for gesture recognition in head-mounted displays (HMDs). The apparatus addresses the challenge of accurately tracking and segmenting object motion in real-time, which is critical for intuitive user interaction in augmented or virtual reality environments. The apparatus includes fixed functionality logic to detect object movement based on input from a stereoscopic device, which is mounted on an HMD. The stereoscopic device comprises one or more pairs of dynamic vision sensors that capture temporal and spatial data, enabling feature correlation within the object. A programmable processor processes this input by detecting changes in pixel light levels, assembling only the edges of the object (including leading and trailing edges), and determining their positions. The processor then segments the object into predefined gestures or control commands, allowing for intuitive interaction. The dynamic vision sensors provide high-resolution temporal and spatial correspondence, ensuring accurate feature tracking. An interrupt mechanism generates signals with time, pixel address, and state data, enabling efficient real-time processing. This approach enhances gesture recognition accuracy and responsiveness, making it suitable for applications requiring precise motion tracking, such as gaming, navigation, or industrial control in HMD environments.
5. The apparatus of claim 4 , wherein the dynamic vision sensors enable a motion tracking function.
This technology relates to computer vision and robotics, specifically to apparatus that use specialized image sensors for motion detection. The problem addressed is the need for efficient and low-latency motion tracking in visual systems. The apparatus includes dynamic vision sensors that are configured to perform a motion tracking function. These sensors are designed to detect changes in a scene rather than capturing full frames, allowing for high temporal resolution and reduced data output. By leveraging the event-based nature of dynamic vision sensors, the apparatus can effectively track the movement of objects or the camera itself. This motion tracking function enables the apparatus to understand and react to dynamic changes in its environment.
6. The apparatus of claim 4 , wherein the dynamic vision sensors enable a gesture control function.
Image sensing apparatus and gesture control. This invention relates to systems that capture visual information and interpret user movements. The problem addressed is enabling intuitive and responsive control of electronic devices through hand or body gestures. The apparatus incorporates dynamic vision sensors. These sensors are distinct from traditional frame-based cameras in that they report changes in pixel intensity asynchronously. This event-driven nature allows for high temporal resolution and efficient data transmission, focusing only on movement. Specifically, the dynamic vision sensors are configured to enable a gesture control function. This means the data generated by these sensors, representing movement and changes in the visual scene, is processed to recognize and interpret specific human gestures. These recognized gestures can then be translated into commands for controlling an electronic system or device. The apparatus therefore facilitates interaction where users can manipulate or command systems using dynamic, real-time visual cues rather than physical buttons or traditional input methods.
7. A method comprising: detecting movement of an object based on input from a stereoscopic device; detecting a change in a light level of one or more pixels; assembling only edges of the object based on the change in the light level of the one or more pixels, the edges of the object including one or more of a leading edge and a trailing edge of the object; determining the one or more of a leading edge and a trailing edge of the object; and segmenting the object into expected gestures or control commands, wherein the stereoscopic device is mounted on a head mounted display, wherein the stereoscopic device includes one or more pairs of dynamic vision sensors, wherein the method further comprises correlating one or more features within the object based on a temporal and spatial correspondence between the one or more pairs of dynamic vision sensors, and wherein an interrupt is generated with corresponding time, pixel address, and state.
This invention relates to gesture recognition and control using a stereoscopic device mounted on a head-mounted display (HMD). The technology addresses the challenge of accurately detecting and interpreting user gestures in real-time for interactive applications. The method involves detecting movement of an object, such as a hand, using input from a stereoscopic device equipped with dynamic vision sensors (DVS). These sensors capture changes in light levels at individual pixels, enabling the system to assemble only the edges of the moving object, including its leading and trailing edges. The edges are then analyzed to determine their positions and characteristics. The object is segmented into predefined gestures or control commands based on these edges. The stereoscopic device includes multiple pairs of dynamic vision sensors, which correlate features within the object by analyzing temporal and spatial correspondences between the sensors. This correlation improves accuracy in tracking and recognizing gestures. Additionally, the system generates interrupts with timestamps, pixel addresses, and state information to facilitate real-time processing. The approach enhances gesture recognition efficiency by focusing on edge detection and leveraging stereoscopic vision for precise spatial and temporal analysis.
8. The method of claim 7 , further comprising enabling a motion tracking function.
A system and method for enhancing user interaction with a device through motion tracking. The technology addresses the problem of limited user input options in devices, particularly in scenarios where traditional input methods like touchscreens or buttons are impractical or unavailable. The invention provides a motion tracking function that allows a device to detect and interpret user movements, enabling intuitive and hands-free control. This function can be integrated into a device that already includes a display and a processor, where the processor is configured to execute instructions for processing input signals. The motion tracking function captures user movements via sensors, such as cameras or accelerometers, and translates these movements into commands or actions within the device. The system may also include a communication interface for transmitting data related to the motion tracking function to other devices or systems. The motion tracking function can be selectively enabled or disabled based on user preferences or environmental conditions, ensuring flexibility in its application. This technology improves accessibility and usability by providing an alternative input method that does not rely on physical contact with the device.
9. The method of claim 7 , further comprising enabling a gesture control function.
A system and method for enhancing user interaction with electronic devices through gesture control. The technology addresses the problem of limited input methods in electronic devices, particularly in scenarios where traditional input methods like keyboards or touchscreens are impractical or unavailable. The invention provides a gesture control function that allows users to interact with devices using hand or body movements, detected by sensors such as cameras or motion detectors. This function enables intuitive and hands-free operation, improving accessibility and usability in various environments. The gesture control function is integrated into a device that includes a display and a processor, where the processor executes instructions to process sensor data and interpret gestures into commands. The system may also include calibration steps to adapt to different users or lighting conditions, ensuring accurate gesture recognition. The method further involves mapping recognized gestures to specific device functions, such as navigation, selection, or input, and executing those functions in response to the detected gestures. This approach enhances user experience by providing a more natural and flexible interaction method, particularly in applications like gaming, virtual reality, or assistive technologies.
Unknown
April 28, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.