A multi-user medical robotic system for collaboration or training in minimally invasive surgical procedures includes first and second master input devices, a first slave robotic mechanism, and at least one processor configured to generate a first slave command for the first slave robotic mechanism by switchably using one or both of a first command indicative of manipulation of the first master input device by a first user and a second command indicative of manipulation of the second master input device by a second user. To facilitate the collaboration or training, both first and second users communicate with each other through an audio system and see the minimally invasive surgery site on first and second displays respectively viewable by the first and second users.
Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A multi-user medical robotic system for training in minimally invasive surgical procedures, comprising: mentor and trainee master input devices respectively manipulatable by a mentor and a trainee; a first slave robotic mechanism; a switch mechanism operable by the mentor for selectively associating the first slave robotic mechanism with the mentor master input device and the trainee master input device so that either or both the mentor or the trainee may control operation of the first slave robotic mechanism to perform a minimally invasive surgical procedure; and a mentor microphone proximate to the mentor and a trainee hearing device proximate to the trainee so that mentor may speak to the trainee while the mentor is performing the minimally invasive surgical procedure.
A medical robotic system enables minimally invasive surgery training with two users: a mentor and a trainee. Each has their own master input device (joysticks or similar) to control a shared surgical robot arm (slave robotic mechanism). A switch, controlled by the mentor, assigns control of the robot arm to either the mentor's or the trainee's input device, or both. The mentor uses a microphone, and the trainee uses a hearing device (e.g. earpiece) to communicate during the procedure. This facilitates real-time instruction and guidance within the surgical environment.
2. The multi-user medical robotic system according to claim 1 , wherein forces associated with the first slave robotic mechanism are reflected back to the trainee master input device when the first slave robotic mechanism is selectively associated with the mentor master input device so that the trainee master input device tracks movement of the mentor master input device.
Building on the multi-user medical robotic system where a mentor and trainee share control of a surgical robot arm, the system provides haptic feedback. When the mentor controls the robot arm, the forces experienced by the robot arm during surgery are reflected back to the trainee's master input device. This allows the trainee to "feel" what the mentor is doing and experience the resistance and forces involved in the procedure, even when not directly controlling the robot. The trainee's master input device mirrors the mentor's movements via force feedback.
3. The multi-user medical robotic system according to claim 2 , further comprising: first and second headsets respectively worn by the mentor and the trainee so that they may communicate with each while the mentor is performing the minimally invasive surgical procedure.
Expanding on the system where the trainee experiences force feedback from the mentor's robot arm control, both mentor and trainee wear headsets. These headsets enable two-way voice communication, allowing for clearer and more private conversation compared to using a microphone and earpiece alone. This enhanced communication supports effective instruction and collaborative decision-making during the minimally invasive surgical procedure.
4. The multi-user medical robotic system according to claim 2 , further comprising: first and second displays respectively viewable by the mentor and the trainee so that they may each view the surgical site while the mentor is performing the minimally invasive surgical procedure.
In addition to the haptic feedback for the trainee, the mentor and trainee both view the surgical site on separate displays. This allows both users to see the surgical area during the procedure. The mentor is performing the surgery, while the trainee can observe the visual details alongside feeling the forces, creating a multi-sensory learning experience.
5. The multi-user medical robotic system according to claim 1 , wherein forces associated with the first slave robotic mechanism are reflected back to the mentor master input device when the first slave robotic mechanism is selectively associated with the trainee master input device so that the mentor master input device tracks movement of the trainee master input device.
Similar to the setup where the trainee feels the mentor's actions, this configuration allows the mentor to feel the trainee's actions. When the trainee controls the surgical robot arm, the forces experienced by the robot arm are reflected back to the mentor's master input device. The mentor's master input device then tracks the movement of the trainee's master input device. The mentor can thus supervise and guide the trainee through haptic feedback.
6. The multi-user medical robotic system according to claim 5 , further comprising: a trainee microphone proximate to the trainee and a mentor hearing device proximate to the mentor so that trainee may speak to the mentor while the trainee is performing the minimally invasive surgical procedure.
Complementing the haptic feedback for the mentor when the trainee controls the robot, the trainee now uses a microphone, and the mentor uses a hearing device (earpiece). This allows the trainee to verbally communicate instructions or ask questions to the mentor while the trainee is actively controlling the robot. This creates a bidirectional communication pathway synchronized with haptic feedback.
7. The multi-user medical robotic system according to claim 5 , further comprising: first and second headsets respectively worn by the mentor and the trainee so that they may communicate with each while the trainee is performing the minimally invasive surgical procedure.
To improve communication when the trainee controls the surgical robot arm and provides force feedback to the mentor, both mentor and trainee wear headsets. This provides clear two-way communication while the trainee is performing the minimally invasive surgical procedure, allowing for real-time instruction and collaborative decision making.
8. The multi-user medical robotic system according to claim 5 , further comprising: first and second displays respectively viewable by the mentor and the trainee so that they may each view the surgical site while the trainee is performing the minimally invasive surgical procedure.
When the trainee controls the surgical robot arm and provides force feedback to the mentor, the mentor and trainee both view the surgical site on separate displays. The trainee is performing the surgery while the mentor is supervising. This provides the mentor with visual and haptic feedback, allowing them to guide the trainee in real-time.
9. The multi-user medical robotic system according to claim 1 , further comprising: a second slave robotic mechanism, wherein the second slave robotic mechanism is selectively associated with the mentor master input device when the first slave robotic mechanism is selectively associated with the trainee master input device, and the second slave robotic mechanism is selectively associated with the trainee master input device when the first slave robotic mechanism is selectively associated with the mentor master input device.
The multi-user surgical robot system now includes a *second* robot arm (slave robotic mechanism). The control scheme is linked: When the mentor controls the first robot arm, the trainee controls the second robot arm, and vice versa. This allows for collaborative surgeries where each user controls a different instrument, or for more advanced training scenarios where the trainee learns to assist the mentor.
10. The multi-user medical robotic system according to claim 9 , wherein the first slave robotic mechanism is selectively associated with the mentor master input device, and first forces associated with the first slave robotic mechanism are reflected back to the trainee master input device so that the first forces may be sensed by the trainee.
Expanding on the dual-robot arm system, when the mentor controls the first robot arm, the forces experienced by that arm are reflected back to the trainee's master input device. This allows the trainee to feel the resistance encountered by the mentor's instrument. The trainee is still controlling the second robot arm while experiencing this haptic feedback from the first.
11. The multi-user medical robotic system according to claim 10 , wherein second forces associated with the second slave robotic mechanism are reflected back to the mentor master input device so that they may be sensed by the mentor.
Building on the previous claim where the trainee feels the forces from the mentor's robot arm, the forces experienced by the second robot arm (controlled by the trainee) are reflected back to the mentor's master input device. Now, both users experience the forces from the robot arm they *aren't* directly controlling, enhancing the collaborative or training experience.
12. The multi-user medical robotic system according to claim 11 , wherein the second slave robotic mechanism includes at least one motor responding to movement of the mentor master input to cause movement of the second slave robotic mechanism in a corresponding fashion.
Focusing on the second robot arm (controlled by the trainee while the mentor controls the first), the robot arm includes motors that respond directly to the movement of the mentor's master input device. This means that the second robot arm mimics the movements of the mentor's master input device. This mirroring can be part of a training exercise or to allow for coordinated movements.
13. The multi-user medical robotic system according to claim 11 , wherein the second slave robotic mechanism includes a computer model for simulating at least one motor responding to movement of the mentor master input to simulate movement of the second slave robotic mechanism in a corresponding fashion.
Instead of physically moving, the second robot arm includes a computer model that *simulates* its movement in response to the mentor's master input. This simulation provides visual feedback to the trainee, demonstrating the effect of the mentor's actions without requiring the second robot arm to physically move. This provides a lower-cost, safer alternative for training.
14. The multi-user medical robotic system according to claim 1 , wherein the switch mechanism is a button pressable by a thumb of the first operator.
The switch mechanism that assigns control of the robot arm between mentor and trainee is a button that can be pressed with the thumb. This provides a simple and quick way for the mentor to transfer control, allowing for seamless transitions during the procedure.
15. The multi-user medical robotic system according to claim 1 , wherein the switch mechanism is a foot pedal pressable by a foot of the first operator.
The switch mechanism is a foot pedal that can be pressed by the first operator's foot. This allows the mentor to switch control without needing to use their hands, which may be occupied with the master input devices.
16. The multi-user medical robotic system according to claim 1 , wherein the switch mechanism is voice activated by the first operator.
The switch is activated by voice commands from the first operator. This offers a hands-free method to switch control of the robot arm, improving workflow and convenience.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
January 26, 2016
May 30, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.