Disclosed are a 3D human-machine interaction method and system. An electronic tag with an ID is configured for a hand; a Radio Frequency (RF) electromagnetic field containing a 3D virtual human-machine interface imaging space is configured; after the hand enters the RF electromagnetic field, information on the electronic tag on the hand is acquired; information on locations, moving velocities, moving directions, and moving tracks of each finger and a palm in the 3D virtual human-machine interface imaging space is acquired according to the acquired information on the electronic tag; the information on the locations is matched to a control or hot spot displayed in the 3D virtual human-machine interface imaging space; it is determined whether a movement of a finger and/or the palm matches a movement defined for touch control of the control or hot spot in the 3D virtual human-machine interface imaging space; and operation of the control or hot spot in the 3D virtual human-machine interface imaging space is triggered. According to the disclosure, naked-eye 3D human-machine interaction with accurate touch control may be implemented.
Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A 3D human-machine interaction method, comprising steps of: configuring an electronic tag with an ID for a hand; configuring a Radio Frequency (RF) electromagnetic field containing a 3D virtual human-machine interface imaging space; after the hand enters the RF electromagnetic field, acquiring information on the electronic tag on the hand; acquiring coordinates, moving velocities, moving directions, and moving tracks of a finger and/or a palm part in the 3D virtual human-machine interface imaging space according to the acquired information on the electronic tag; matching the coordinates to a control or hot spot displayed in the 3D virtual human-machine interface imaging space; determining whether a movement of the finger and/or the palm part matches a movement defined for touch control of the control or hot spot in the 3D virtual human-machine interface imaging space; and when the movement of the finger and/or the palm part matches the movement defined for touch control of the control or hot spot, triggering operation of the control or hot spot in the 3D virtual human-machine interface imaging space, wherein the step of acquiring information on the electronic tag on the hand comprises steps of: performing contactless RF signal coupling of a Radio Frequency Identification (RFID) read-write module in a terminal and the electronic tag through a coupling element; transferring energy and exchanging data between the RFID read-write module and the electronic tag within a coupling channel; and after the data exchange, acquiring, by the terminal, the information on the electronic tag on the hand, wherein the step of acquiring, by the terminal, the information on the electronic tag on the hand comprises steps of: when the contactless RF signal coupling of the RFID read-write module and the electronic tag is performed inductively, converting a change in a distance between an antenna of the RFID read-write module and an antenna of the electronic tag into a change in an antenna voltage or an antenna current; and acquiring the information on the electronic tag by: modulating, by a processing module of the terminal, the antenna voltage of the electronic tag and demodulating the antenna voltage of the RFID read-write module according to resistive load modulated data information transfer.
A 3D human-machine interaction method uses an electronic tag with a unique ID attached to a hand. An RF electromagnetic field creates a 3D virtual interface. When the hand enters this field, the system reads the tag's ID. It then determines the coordinates, speed, direction, and path of the finger or palm. The system matches these coordinates to a control or hot spot within the 3D interface. If the finger or palm movement matches a defined gesture for that control, the system activates the control. The tag is read using contactless RF signal coupling via an RFID module that transfers energy and exchanges data. Distance changes between antennas during coupling are converted to voltage or current changes, which are then processed to acquire the tag's information.
2. The method according to claim 1 , wherein the step of configuring an electronic tag with an ID for a hand comprises steps of: configuring an electronic tag with an ID respectively for a finger and/or a palm part of a human body, and saving a relation mapping a finger and/or a palm part to the ID of an electronic tag in a storage module of a terminal.
In the 3D human-machine interaction method, instead of a single tag, each finger and/or palm part of the hand has its own electronic tag with a unique ID. The system stores a mapping between each finger/palm and its respective tag ID in a storage module, allowing it to identify which finger or palm is interacting with the 3D interface.
3. The method according to claim 2 , wherein the electronic tag is a passive Radio Frequency Identification (RFID) electronic tag or an active RFID electronic tag; and an electronic tag with an ID is configured for a hand by: configuring an electronic tag on a finger and/or a palm part directly by adhering, painting, wearing, or implantation; or configuring an electronic tag on a finger and/or a palm part indirectly.
In the 3D human-machine interaction method where each finger and/or palm has a tag, the electronic tags can be passive or active RFID tags. The tags are attached to the fingers/palms either directly through adhesion, painting, wearable tech, or even implantation, or indirectly via some attachment method.
4. The method according to claim 3 , wherein when the electronic tag is a passive RFID electronic tag, the terminal acquires the information on the electronic tag on the hand by: after the hand enters the RF electromagnetic field, receiving, by the electronic tag, an RF signal transmitted by an RFID read-write module in the terminal through an antenna, and sending the information on the electronic tag stored in a chip of the electronic tag to the RFID read-write module using a resulting induced current as a working current; and reading and then decoding, by the RFID read-write module, the information on the electronic tag, and sending the decoded information on the electronic tag to a processing module of the terminal for data processing.
In the 3D human-machine interaction method using passive RFID tags on the hand, when the hand enters the RF field, the tag receives a signal from an RFID reader in the terminal. The tag uses the induced current to power its chip and send its stored information back to the reader. The reader then decodes the information and sends it to the processing module for data processing.
5. The method according to claim 3 , wherein when the electronic tag is an active RFID electronic tag, the terminal acquires the information on the electronic tag on the hand by: after the hand enters the RF electromagnetic field, actively sending, by the electronic tag, the information on the electronic tag stored in a local chip to an RFID read-write module through a signal of a frequency; and reading and then decoding, by the RFID read-write module, the information on the electronic tag, and sending the decoded information on the electronic tag to a processing module of the terminal for data processing.
In the 3D human-machine interaction method using active RFID tags on the hand, when the hand enters the RF field, the tag actively sends its stored information at a specific frequency to an RFID reader. The reader decodes this information and sends it to a processing module for data processing.
6. The method according to claim 3 , comprising steps of: increasing or reducing the 3D virtual human-machine interface imaging space; and increasing or reducing the RF electromagnetic field with the 3D virtual human-machine interface imaging space.
The 3D human-machine interaction method with RFID tags on fingers and/or palm parts includes the ability to adjust the size of the 3D virtual interface and the corresponding RF electromagnetic field. This involves increasing or decreasing both the imaging space and the field containing it.
7. The method according to claim 2 , comprising steps of: increasing or reducing the 3D virtual human-machine interface imaging space; and increasing or reducing the RF electromagnetic field with the 3D virtual human-machine interface imaging space.
The 3D human-machine interaction method where each finger and/or palm has its own tag includes the ability to adjust the size of the 3D virtual interface and the corresponding RF electromagnetic field. This involves increasing or decreasing both the imaging space and the field containing it.
8. The method according to claim 1 , wherein the step of configuring an RF electromagnetic field containing a 3D virtual human-machine interface imaging space comprises a step of: regulating a scope of the RF electromagnetic field by adjusting an RF output power or an antenna working frequency of a Radio Frequency Identification (RFID) read-write module in a terminal, such that the RF electromagnetic field contains the 3D virtual human-machine interface imaging space.
In the 3D human-machine interaction method, the RF electromagnetic field containing the 3D virtual interface is created by adjusting the RF output power or antenna frequency of an RFID reader. This regulation ensures the field's scope contains the entire 3D virtual interface.
9. The method according to claim 8 , comprising steps of: increasing or reducing the 3D virtual human-machine interface imaging space; and increasing or reducing the RF electromagnetic field with the 3D virtual human-machine interface imaging space.
The 3D human-machine interaction method that configures the RF field by adjusting RF output power and frequency, includes the ability to adjust the size of the 3D virtual interface and the corresponding RF electromagnetic field. This involves increasing or decreasing both the imaging space and the field containing it.
10. The method according to claim 1 , comprising steps of: increasing or reducing the 3D virtual human-machine interface imaging space; and increasing or reducing the RF electromagnetic field with the 3D virtual human-machine interface imaging space.
The 3D human-machine interaction method includes the ability to adjust the size of the 3D virtual interface and the corresponding RF electromagnetic field. This involves increasing or decreasing both the imaging space and the field containing it.
11. The method according to claim 1 , wherein the step of acquiring coordinates, moving velocities, moving directions, and moving tracks of a finger and/or a palm part in the 3D virtual human-machine interface imaging space comprises steps of: after acquiring the information on the electronic tag of the hand, determining, by the RFID read-write module in the terminal, a specific palm part and/or a specific finger moving in the RF electromagnetic field according to the ID of the electronic tag in the information on the electronic tag, as well as a relation mapping a finger and/or a palm part to the ID of an electronic tag saved in a storage module in the terminal; acquiring, according to a strength of an RF signal between the RFID read-write module and the electronic tag on the hand, the coordinates of the finger and/or the palm part in the 3D virtual human-machine interface imaging space; calculating the moving velocity, the moving direction, and the moving track of the finger and/or the palm part according to a series of successive coordinate of the finger and/or the palm part acquired respectively by a series of successive acquiring operations.
In the 3D human-machine interaction method, after reading the electronic tag on the hand, the system determines which specific finger or palm is moving within the RF field. This is done by referencing the tag ID against a stored mapping of fingers/palms to tag IDs. The system then calculates the finger/palm's coordinates in 3D space based on the RF signal strength. Finally, it calculates the finger/palm's speed, direction, and path based on a series of successive coordinate readings.
12. The method according to claim 11 , further comprising steps of: generating, by a processing module, a data file according to the coordinates, the moving velocities, the moving directions, and the moving tracks, and saving the data file in the RFID read-write module or the storage module of the terminal.
The 3D human-machine interaction method that tracks finger/palm movement generates a data file containing the coordinates, speed, direction, and path information. This data file is then stored in either the RFID reader module or the terminal's storage module for later use or analysis.
13. The method according to claim 1 , wherein the step of matching the coordinates to a control or hot spot displayed in the 3D virtual human-machine interface imaging space comprises a step of: determining, according to the coordinates of the finger and/or the palm part in the 3D virtual human-machine interface imaging space, whether the coordinates of the finger and/or the palm part in the 3D virtual human-machine interface imaging space fall within a spatial range of the control or hot spot displayed in the 3D virtual human-machine interface imaging space; and when the coordinates of the finger and/or the palm part fall within the spatial range, determining that the control or hot spot is touched by the finger and/or the palm part.
In the 3D human-machine interaction method, matching the finger/palm coordinates to a control or hot spot involves checking if the finger/palm's coordinates fall within the spatial boundaries of a control displayed in the 3D interface. If the coordinates are within the boundaries, the system registers a "touch" event on that control.
14. The method according to claim 1 , wherein the step of determining whether a movement of the finger and/or the palm part matches a movement defined for touch control of the control or hot spot in the 3D virtual human-machine interface imaging space comprises a step of: determining, by a processing module, whether the movement of the finger and/or the palm part matches the movement defined for touch control of the control or hot spot in the 3D virtual human-machine interface imaging space according to the coordinates, the moving velocities, the moving directions, and the moving tracks of the finger and/or the palm part.
In the 3D human-machine interaction method, determining if a finger/palm movement matches a defined gesture is performed by a processing module. The module analyzes the finger/palm's coordinates, speed, direction, and path to see if they correspond to a predefined movement pattern for the selected control.
15. A 3D human-machine interaction method, comprising steps of: configuring an electronic tag with an ID for a hand; configuring a Radio Frequency (RF) electromagnetic field containing a 3D virtual human-machine interface imaging space; after the hand enters the RF electromagnetic field, acquiring information on the electronic tag on the hand; acquiring coordinates, moving velocities, moving directions, and moving tracks of a finger and/or a palm part in the 3D virtual human-machine interface imaging space according to the acquired information on the electronic tag; matching the coordinates to a control or hot spot displayed in the 3D virtual human-machine interface imaging space; determining whether a movement of the finger and/or the palm part matches a movement defined for touch control of the control or hot spot in the 3D virtual human-machine interface imaging space; and when the movement of the finger and/or the palm part matches the movement defined for touch control of the control or hot spot, triggering operation of the control or hot spot in the 3D virtual human-machine interface imaging space, wherein the step of acquiring information on the electronic tag on the hand comprises steps of: performing contactless RF signal coupling of a Radio Frequency Identification (RFID) read-write module in a terminal and the electronic tag through a coupling element; transferring energy and exchanging data between the RFID read-write module and the electronic tag within a coupling channel; and after the data exchange, acquiring, by the terminal, the information on the electronic tag on the hand, wherein the step of acquiring the information on the electronic tag on the hand comprises a step of: when the contactless RF signal coupling of the RFID read-write module and the electronic tag is performed through electromagnetic backscattering, bringing back, by an RF signal transmitted by an antenna of the RFID read-write module and reflected by the electronic tag, the information on the electronic tag of a finger and/or a palm part according to radar positioning, wherein the step of acquiring coordinates, moving velocities, moving directions, and moving tracks of a finger and/or a palm part in the 3D virtual human-machine interface imaging space comprises steps of: after acquiring the information on the electronic tag of the hand, determining, by the RFID read-write module in the terminal, a specific palm part and/or a specific finger moving in the RF electromagnetic field according to the ID of the electronic tag in the information on the electronic tag, as well as a relation mapping a finger and/or a palm part to the ID of an electronic tag saved in a storage module in the terminal; acquiring, using radar positioning, information on a distance and an angle of a finger and/or a palm part according to a transmission duration and an angle between the transmitted RF signal and an echo signal of the transmitted RF signal; acquiring the coordinates of the finger and/or the palm part in the 3D virtual human-machine interface imaging space according to the information on the distance and the angle of a finger and/or a palm part; and calculating the moving velocity, the moving direction, and the moving track of the finger and/or the palm part according to a series of successive coordinate of the finger and/or the palm part acquired respectively by a series of successive acquiring operations.
A 3D human-machine interaction method uses an electronic tag with a unique ID attached to a hand. An RF electromagnetic field creates a 3D virtual interface. When the hand enters this field, the system reads the tag's ID. It then determines the coordinates, speed, direction, and path of the finger or palm. The system matches these coordinates to a control or hot spot within the 3D interface. If the finger or palm movement matches a defined gesture for that control, the system activates the control. Tag information is acquired through electromagnetic backscattering, where the reflected RF signal from the tag carries the tag's data. The system uses radar positioning to get the finger/palm's distance and angle, and thus coordinates. Speed, direction and path are then calculated.
16. The method according to claim 15 , further comprising steps of: generating, by a processing module, a data file according to the coordinates, the moving velocities, the moving directions, and the moving tracks, and saving the data file in the RFID read-write module or the storage module of the terminal.
The 3D human-machine interaction method using radar positioning to track finger/palm movement generates a data file containing the coordinates, speed, direction, and path information. This data file is then stored in either the RFID reader module or the terminal's storage module for later use or analysis.
17. A 3D human-machine interaction system, comprising: a first configuration module configured for: configuring an electronic tag with an ID for a hand; a second configuration module configured for: configuring a Radio Frequency (RF) electromagnetic field containing a 3D virtual human-machine interface imaging space; a Radio Frequency Identification (RFID) read-write module configured for: after the hand enters the RF electromagnetic field, acquiring information on the electronic tag on the hand; and a processing module configured for: acquiring coordinates, moving velocities, moving directions, and moving tracks of a finger and/or a palm part in the 3D virtual human-machine interface imaging space according to the acquired information on the electronic tag; matching the coordinates to a control or hot spot displayed in the 3D virtual human-machine interface imaging space; determining whether a movement of the finger and/or the palm part matches a movement defined for touch control of the control or hot spot in the 3D virtual human-machine interface imaging space; and when the movement of the finger and/or the palm part matches the movement defined for touch control of the control or hot spot, triggering operation of the control or hot spot in the 3D virtual human-machine interface imaging space, wherein the RFID read-write module is configured for: performing contactless RF signal coupling of the RFID read-write module and the electronic tag through a coupling element; transferring energy and exchanging data between the RFID read-write module and the electronic tag within a coupling channel; and after the data exchange, acquiring the information on the electronic tag on the hand, wherein the RFID read-write module is configured for: when the contactless RF signal coupling of the RFID read-write module and the electronic tag is performed inductively, converting a change in a distance between an antenna of the RFID read-write module and an antenna of the electronic tag into a change in an antenna voltage or an antenna current, wherein the processing module is configured for: modulating the antenna voltage of the electronic tag and demodulating the antenna voltage of the RFID read-write module according to resistive load modulated data information transfer.
A 3D human-machine interaction system includes modules for: attaching electronic tags with unique IDs to a hand; generating an RF electromagnetic field that forms a 3D virtual interface; reading tag information after the hand enters the field; and processing the tag data to calculate finger/palm coordinates, speed, direction and path. It matches these to controls within the 3D interface, determines if gestures are correct, and triggers actions. The RFID module reads tag info via contactless RF coupling, converting distance changes to voltage/current changes. A processing module then modulates/demodulates the antenna voltage to get tag data.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
July 23, 2013
March 21, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.