A control system, method and computer program product cooperate to assist control for an autonomous robot. An interface receives recognition information from an autonomous robot, said recognition information including candidate target objects to interact with the autonomous robot. A display control unit causes a display image to be displayed on a display of candidate target objects, wherein at least two of the candidate target objects are displayed with an associated indication of a target object score.
Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A control device for a movable apparatus that includes at least one driving motor to move the movable apparatus, the control device comprising: circuitry configured to generate a control signal to control the movable apparatus, and control a display to display (i) an image on a first sub-region of the display, the image corresponding to a captured image captured by a camera attached on the movable apparatus, and display (ii) an overhead map, including a position of the movable apparatus, on a second sub-region of the display, wherein a marker for identifying position of the movable apparatus is displayed on the second sub-region in relation to the overhead map, wherein the image and the overhead map are concurrently displayed in a non-overlapping manner.
A control device for a movable apparatus (like a robot) with motors has circuitry to control the apparatus and a display. The display shows a live camera feed from the robot in one area and an overhead map with the robot's position in another area. The camera image and map are shown at the same time without overlapping. The robot's location is marked on the overhead map.
2. The control device according to claim 1 , wherein the circuitry is configured to control the display to simultaneously display the captured image and the overhead map.
The control device from the previous description displays the live camera feed and the overhead map showing the robot's position simultaneously.
3. The control device according to claim 1 , wherein the circuitry is configured to control the display to display the captured image in a first sub-region of the display and to display the overhead map in a second sub-region of the display, the first sub-region being distinct and separate from the second sub-region.
The control device from the description of a control device for a movable apparatus (like a robot) with motors having circuitry to control the apparatus and a display displaying a live camera feed from the robot in one area and an overhead map with the robot's position in another area. The camera image and map are shown at the same time without overlapping and the robot's location is marked on the overhead map, displaying the camera image in one distinct area of the screen, and the overhead map in a separate, distinct area of the screen.
4. The control device according to claim 1 , wherein the circuitry is configured to control to the display to superimpose a marker to identify the position of the movable apparatus.
The control device from the description of a control device for a movable apparatus (like a robot) with motors having circuitry to control the apparatus and a display displaying a live camera feed from the robot in one area and an overhead map with the robot's position in another area. The camera image and map are shown at the same time without overlapping and the robot's location is marked on the overhead map, displaying a marker directly on the overhead map to indicate the exact location of the movable apparatus.
5. The control device according to claim 1 , wherein the circuitry is configured to control the display to display path information on the overhead map, the path information indicating a movement of the movable apparatus.
The control device from the description of a control device for a movable apparatus (like a robot) with motors having circuitry to control the apparatus and a display displaying a live camera feed from the robot in one area and an overhead map with the robot's position in another area. The camera image and map are shown at the same time without overlapping and the robot's location is marked on the overhead map, displaying the robot's path as a line on the overhead map, showing where the robot has moved.
6. The control device according to claim 1 , wherein the captured image includes a target object, and position information of the target object is displayed on the overhead map.
The control device from the description of a control device for a movable apparatus (like a robot) with motors having circuitry to control the apparatus and a display displaying a live camera feed from the robot in one area and an overhead map with the robot's position in another area. The camera image and map are shown at the same time without overlapping and the robot's location is marked on the overhead map, when the camera sees something interesting (a "target object"), the location of that object is also shown on the overhead map.
7. The control device according to claim 1 , wherein the circuitry is configured to control to the display to superimpose a marker to identify a position of the control device.
The control device from the description of a control device for a movable apparatus (like a robot) with motors having circuitry to control the apparatus and a display displaying a live camera feed from the robot in one area and an overhead map with the robot's position in another area. The camera image and map are shown at the same time without overlapping and the robot's location is marked on the overhead map, also displays a marker indicating the position of the *control device* itself (presumably separate from the robot).
8. The control device according to claim 5 , wherein the path information indicates the movement of the movable apparatus towards a target object that is displayed on the overhead map.
The control device from the description that includes path information indicating the movement of the movable apparatus, the robot's path displayed on the overhead map shows the robot moving towards a specific target object that's also shown on the map.
9. The con device according to claim 6 , wherein the circuitry is further configured to obtain a recognition information of the target object, and control the display to display an indication of the recognition information associated with the target object.
The control device from the description of when a target object is visible in the camera feed, its location is displayed on the overhead map, and it also gets information about the target object (recognition information) and displays that information alongside the object.
10. The control device according to claim 9 , wherein the indication of the recognition information is a marker that is superimposed on the captured image and that is disposed adjacently to the target object.
The control device from the description including recognition information about a target object and displays that information alongside the object, displays this "recognition information" as a marker that appears next to the target object in the live camera view.
11. The control device according to claim 1 , wherein the generated control signal restricts a movement of the movable apparatus to be within a predetermined area.
The control device from the description of a control device for a movable apparatus (like a robot) with motors having circuitry to control the apparatus and a display displaying a live camera feed from the robot in one area and an overhead map with the robot's position in another area. The camera image and map are shown at the same time without overlapping and the robot's location is marked on the overhead map, can limit the robot's movement to a specific area.
12. The control device according to claim 9 , wherein the circuitry is further configured to perform a recognition process on the target object to generate the recognition information of the target object.
The control device from the description including recognition information about a target object and displays that information alongside the object, it actively analyzes the target object to determine its recognition information using image processing or other analysis techniques.
13. The control device according to claim 11 , wherein the predetermined area is determined based on position information of the movable apparatus and position information of the control device.
The control device from the description that the generated control signal restricts a movement of the movable apparatus to be within a predetermined area, calculates the allowed movement area based on the robot's location and the control device's location.
14. The control device according to claim 11 , wherein the predetermined area is determined based on an input from an interface of the control device.
The control device from the description that the generated control signal restricts a movement of the movable apparatus to be within a predetermined area, defines the allowed movement area based on input received from the control device's interface.
15. The control device according to claim 14 , wherein the interface is a touch panel integrally arranged with the display, and the predetermined area is determined based on a designation of an area on the captured image or the overhead map displayed on the display.
The control device from the description that the generated control signal restricts a movement of the movable apparatus to be within a predetermined area based on an input from an interface of the control device, has a touchscreen interface where the allowed movement area can be defined by drawing directly on the camera image or the overhead map.
16. The control device according to claim 1 , wherein the captured image is compressed it size prior to being displayed on the display.
The control device from the description of a control device for a movable apparatus (like a robot) with motors having circuitry to control the apparatus and a display displaying a live camera feed from the robot in one area and an overhead map with the robot's position in another area. The camera image and map are shown at the same time without overlapping and the robot's location is marked on the overhead map, shrinks the live camera feed before displaying it.
17. The control device according to claim 1 , wherein the captured image is compressed in size prior to being transmitted from the camera.
The control device from the description of a control device for a movable apparatus (like a robot) with motors having circuitry to control the apparatus and a display displaying a live camera feed from the robot in one area and an overhead map with the robot's position in another area. The camera image and map are shown at the same time without overlapping and the robot's location is marked on the overhead map, shrinks the live camera feed *before* it's sent from the camera to the control device.
18. The control device according to claim 17 , wherein the captured image is compressed by performing image compression process on only a part of the captured image.
The control device from the description that captured image is compressed in size prior to being transmitted from the camera, only compresses part of the camera image to reduce bandwidth.
19. The control device according to claim 1 , further comprising: an interface, the interface being implemented by a touch panel that is integrally arranged with the display.
The control device from the description of a control device for a movable apparatus (like a robot) with motors having circuitry to control the apparatus and a display displaying a live camera feed from the robot in one area and an overhead map with the robot's position in another area. The camera image and map are shown at the same time without overlapping and the robot's location is marked on the overhead map, includes a touchscreen interface built directly into the display.
20. A non-transitory computer readable medium having a computer program recorded thereon, the computer program configured to perform a method when executed on a computer, the method comprising: generating a control signal to control the movable apparatus; and controlling a display to (i) display an image on a first sub-region of the display, the image corresponding to a captured image captured by a camera attached on the movable apparatus, and (ii) display an overhead map, including a position of the movable apparatus, on a second sub-region of the display, wherein a marker for identifying position of the movable apparatus is displayed on the second sub-region in relation to the overhead map, wherein the image and the overhead map are concurrently displayed in a non-overlapping manner.
A computer program stored on a drive which, when run, makes a control device control a robot. The program makes the control device show the robot's camera feed in one area of the screen and an overhead map with the robot's position in another area. The camera image and map are shown at the same time without overlapping. The robot's location is marked on the overhead map.
21. A method for controlling a movable apparatus that includes at least one actuator to move the movable apparatus, the method comprising: generating a control signal to control the movable apparatus; and controlling a display to (i) display an image on a first sub-region of the display, the image corresponding to a captured image captured by a camera attached on the movable apparatus, and (ii) display an overhead map, including a position of the movable apparatus, on a second sub-region of the display, wherein a marker for identifying position of the movable apparatus is displayed on the second sub-region in relation to the overhead map, wherein the image and the overhead map are concurrently displayed in a non-overlapping manner.
A method for controlling a movable apparatus (like a robot) with motors, comprising generating a control signal to control the movable apparatus, and controlling a display to show the robot's camera feed in one area of the screen and an overhead map with the robot's position in another area. The camera image and map are shown at the same time without overlapping. The robot's location is marked on the overhead map.
22. The control device according to claim 1 , wherein the first sub-region and the second sub region are independent non-overlapping portions of the display.
The control device from the description of a control device for a movable apparatus (like a robot) with motors having circuitry to control the apparatus and a display displaying a live camera feed from the robot in one area and an overhead map with the robot's position in another area. The camera image and map are shown at the same time without overlapping and the robot's location is marked on the overhead map, the regions of the display showing the camera image and the overhead map are separate and do not overlap each other.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
November 30, 2015
November 14, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.