A method includes generating, at an electronic device, a three-dimensional model of an object based on a sequence of images captured by an image capture device associated with the electronic device. The method further includes displaying the three-dimensional model via a display device associated with the electronic device. The method also includes, based on detecting that the three-dimensional model includes an anomaly, presenting, via the display device, one or more selectable options to enable correction of the anomaly.
Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A method comprising: capturing images by an image capture device; estimating image capture device positions based on the images; calculating, based on the image capture device positions and timestamps of the images, a speed associated with movement of the image capture device relative to an object depicted in the images; determining a bounding box for the object; generating a three-dimensional model of the object based on the images and the bounding box; detecting an anomaly in the three-dimensional model; generating a notification based on a comparison of the speed to a speed threshold; outputting the notification via an output interface; and presenting, via a display device, one or more selectable options to enable correction of the anomaly.
A method for creating 3D models involves capturing images using a camera and estimating the camera's position from these images. It calculates the camera's speed relative to the object being imaged using the camera positions and image timestamps. A bounding box is determined for the object, and a 3D model is generated from the images and bounding box. The system detects anomalies in the 3D model, compares the camera speed to a speed threshold, and generates a notification if the threshold is exceeded. Finally, the system presents options on a display for correcting the detected anomalies.
2. The method of claim 1 , further comprising: detecting the anomaly in the three-dimensional model based on identifying one or more portions of the three-dimensional model that are incomplete; displaying via the display device an indicator that identifies a location of the anomaly in the three-dimensional model; capturing additional images, by the image capture device, corresponding to the one or more portions of the three-dimensional model that are incomplete; and generating, at the image capture device, an updated three-dimensional model based on the additional images in response to capturing additional images.
Building upon the method for creating 3D models, this improvement focuses on anomaly detection and correction. The method detects anomalies in the 3D model by identifying incomplete portions. An indicator is displayed on the screen to highlight the location of the anomaly. The camera captures additional images of the incomplete portions of the model. In response to capturing these additional images, the system generates an updated 3D model that incorporates the new image data to fill in the missing parts, fixing the anomaly.
3. The method of claim 1 , further comprising: detecting the anomaly in the three-dimensional model based on identifying one or more portions of the three-dimensional model that are incomplete; receiving a selected option from the one or more selectable options, presented via the display device, to correct the anomaly; and in response to receiving the selected option, generating an updated three-dimensional model based on fill data.
Expanding on the method for creating 3D models, this improvement allows using fill data to correct anomalies. The method detects anomalies in the 3D model by identifying incomplete portions. The user is presented with selectable options to correct the anomaly, and the method receives a selected option. In response to receiving the selected option, the system generates an updated 3D model using "fill data." This fill data could be generated by algorithms designed to intelligently fill in missing portions of the 3D model.
4. The method of claim 1 , further comprising: detecting the anomaly in the three-dimensional model based on identifying one or more portions of the three-dimensional model that are incomplete; receiving a selection of a particular selectable option of the one or more selectable options; and correcting the anomaly by performing an action corresponding to the selection.
This enhancement of the method for creating 3D models provides interactive anomaly correction. The method detects anomalies in the 3D model by identifying incomplete portions. The user selects a particular option from the displayed selectable options. The system then corrects the anomaly by performing a specific action that corresponds to the selected option. This allows for different correction methods to be applied based on the type and location of the anomaly.
5. The method of claim 1 , further comprising: before generating the three-dimensional model, receiving a selection of the object depicted in the images via a graphical user interface on the display device; depicting, via the graphical user interface, at least a portion of the three-dimensional model; and presenting, via the graphical user interface, two or more selectable options to enable correction of the anomaly.
This improvement to the method for creating 3D models introduces a user interface for object selection and anomaly correction. Before generating the 3D model, the user selects the object to be modeled via a graphical user interface. The GUI displays at least a portion of the 3D model. The GUI presents two or more selectable options that allow the user to correct any detected anomalies. This provides a user-friendly way to guide the 3D model generation and correction process.
6. The method of claim 5 , wherein one of the selectable options includes an option to capture additional images.
Expanding on the method where a user interface provides object selection and anomaly correction, one of the selectable options presented to the user includes an option to capture additional images. This lets the user address anomalies by directly acquiring more data, guiding the system to focus on areas of the object needing more detail for accurate 3D model reconstruction.
7. An apparatus comprising: an image capture device configured to capture images associated with a scene; and a processor configured to: receive a selection of an object depicted in an image; determine a bounding box associated with the object; generate, based on the bounding box, a three-dimensional model of the object during capture by the image capture device of the images; estimate image capture device positions relative to the object based on the images; calculate, based on the image capture device positions and timestamps of the images, a speed associated with movement of the image capture device relative to the object; compare the speed to a speed threshold; generate, based on comparing the speed to the speed threshold, a notification to be output via an output interface; detect an anomaly in the three-dimensional model; and present, via a display device, one or more selectable options to enable correction of the anomaly.
An apparatus for creating 3D models includes a camera to capture images and a processor. The processor selects an object in an image and determines a bounding box for it. It generates a 3D model of the object based on the bounding box as images are captured. The processor estimates camera positions relative to the object based on the images, calculates the camera's speed relative to the object, and compares the speed to a threshold. Based on this comparison, a notification is generated and sent to an output. The processor also detects anomalies in the 3D model and presents options for correcting these anomalies on a display.
8. The apparatus of claim 7 , wherein the processor is further configured to: during generation of the three-dimensional model, adjust a value of a size parameter of the bounding box based on tracking the object within the bounding box; and modify the bounding box based on the value of the size parameter.
In the 3D modeling apparatus, the processor dynamically adjusts the bounding box size during 3D model generation. While creating the 3D model, the processor tracks the object within the bounding box and adjusts a size parameter of the bounding box based on this tracking. The bounding box is then modified based on the updated size parameter, allowing it to better fit the object as it's being scanned.
9. The apparatus of claim 8 , wherein the value is adjusted based on determining that the object is larger than the bounding box.
In the 3D modeling apparatus with a dynamic bounding box, the bounding box size increases if the object is larger than the current bounding box. The processor adjusts the size parameter because it determines that the object extends beyond the boundaries of the current bounding box, ensuring that the entire object is contained within the bounding box for accurate 3D modeling.
10. The apparatus of claim 7 , wherein the processor is further configured to adjust a value of a position parameter of the bounding box based on tracking the object within the bounding box from one image frame to subsequent image frames.
In the 3D modeling apparatus, the processor adjusts the bounding box position based on object tracking. The processor tracks the object within the bounding box from one image frame to the next and adjusts a position parameter of the bounding box accordingly. This allows the bounding box to follow the object's movement and maintain focus on the desired area.
11. The apparatus of claim 10 , wherein tracking the object includes identifying movement of the object relative to the scene.
Within the 3D modeling apparatus with dynamic bounding box positioning, tracking the object involves identifying movement of the object relative to the scene. The system analyzes the image sequence to detect changes in the object's position within the images, which represents its movement relative to the static background or scene captured by the camera.
12. The apparatus of claim 10 , wherein the value of the position parameter is adjusted based on a relative position of the object in the images.
In the 3D modeling apparatus with dynamic bounding box positioning, the position of the bounding box is adjusted based on the relative position of the object in the images. The system analyzes the object's location within each image frame and updates the position parameter of the bounding box to keep it centered on the object as it moves.
13. The apparatus of claim 12 , wherein the bounding box contains a region corresponding to the object after the value of the position parameter is adjusted.
Expanding on the 3D modeling apparatus with dynamic bounding box positioning, after the position parameter is adjusted, the bounding box contains a region corresponding to the object. This ensures that the object remains entirely within the bounding box, even as its position changes, maintaining proper focus for the 3D model generation process.
14. The apparatus of claim 10 , wherein the selection of the object is received via detection of user input.
In the 3D modeling apparatus, the selection of the object is received via user input. This means the user can manually specify the object of interest, likely through a touch screen or mouse click, allowing the system to focus on the chosen object for 3D modeling.
15. The apparatus of claim 10 , wherein the processor is further configured to refine the three-dimensional model based on detecting the anomaly in the three-dimensional model and correcting the anomaly.
In the 3D modeling apparatus, the 3D model is refined by detecting and correcting anomalies. The processor identifies errors or incomplete areas in the initial 3D model and then applies correction techniques to improve the model's accuracy and completeness.
16. The apparatus of claim 15 , wherein the processor is further configured to adjust a value of a size parameter of the bounding box based on tracking the object within the bounding box.
In the 3D modeling apparatus that refines the 3D model by detecting and correcting anomalies, the size of the bounding box is adjusted based on tracking the object within the bounding box. This enables dynamic adaptation of the bounding box to the object's size changes, facilitating accurate and refined 3D model generation.
17. The apparatus of claim 7 , wherein the processor is further configured to: detect the anomaly based on identifying one or more portions of the three-dimensional model that are incomplete; display via a graphical user interface an indicator that identifies a location of the anomaly in the three-dimensional model, wherein the anomaly includes a portion of the three-dimensional model that is incomplete; and generate an updated three-dimensional model, in response to selection of an option to capture additional images from the one or more selectable options.
In the 3D modeling apparatus, anomaly detection and correction are enhanced with a GUI. The processor detects anomalies by identifying incomplete portions, then displays an indicator on a GUI showing the anomaly's location. When the user selects the option to capture more images, the processor generates an updated 3D model that uses the new image data to fix the identified incomplete portion.
18. The apparatus of claim 7 , wherein the processor is further configured to generate an updated three-dimensional model based on fill data, in response to an option to generate the fill data based on a hole filing algorithm being enabled from the one or more selectable options to enable correction of the anomaly.
In the 3D modeling apparatus, the system utilizes fill data to correct anomalies. When the user enables the hole filling algorithm (via the selectable options), the processor generates an updated 3D model using fill data. This fill data is generated by a hole-filling algorithm that automatically attempts to complete the missing parts of the 3D model.
19. The apparatus of claim 7 , wherein the processor is further configured to: enable a selection of a particular selectable option of the one or more selectable options; and correct the anomaly by performing an action corresponding to the particular selectable option.
In the 3D modeling apparatus, the user chooses how to correct anomalies. The processor enables the user to select a particular correction option, and then corrects the anomaly by performing the action associated with that chosen option. This allows the user to guide the correction process and choose the most appropriate fix for each specific anomaly.
20. The apparatus of claim 7 , wherein the processor is further configured to: generate the notification in response to the speed being equal to or greater than the speed threshold.
In the 3D modeling apparatus, the notification about camera speed is triggered when the speed exceeds the threshold. Specifically, the processor generates the notification in response to the calculated camera speed being equal to or greater than the defined speed threshold.
21. The apparatus of claim 7 , wherein the processor is further configured to: depict the anomaly in relation to the three-dimensional model via a graphical user interface; present at least a portion of the three-dimensional model via the graphical user interface; and based on the anomaly, present, via the graphical user interface, two or more selectable options to enable correction of the anomaly.
In the 3D modeling apparatus, the user interacts with the model and correction options through a GUI. The processor displays the anomaly in relation to the 3D model on the GUI, presents at least a portion of the 3D model on the GUI, and presents correction options on the GUI based on the detected anomaly. This provides a visual and interactive way for the user to understand and address problems in the 3D model.
22. An apparatus comprising: means for capturing images; means for estimating positions of the means for capturing the images based on the images; means for calculating, based on the positions and timestamps of the images, a speed associated with movement of the means for capturing relative to an object depicted in the images; means for outputting a notification based on a comparison of the speed to a speed threshold; means for determining a bounding box associated with the object; means for generating a three-dimensional model of the object based on the images and the bounding box; means for detecting an anomaly in the three-dimensional model; and means for presenting one or more selectable options to enable correction of the anomaly.
An apparatus for creating 3D models employs various means: a means for capturing images, a means for estimating camera positions from the images, a means for calculating camera speed relative to the object based on positions and timestamps, a means for outputting a notification based on a speed threshold comparison, a means for determining a bounding box for the object, a means for generating a 3D model based on the images and bounding box, a means for detecting anomalies, and a means for presenting options to correct these anomalies.
23. The apparatus of claim 22 , further comprising: means for receiving a selection of the object in the images; and means for depicting at least a portion of the three-dimensional model.
Building on the apparatus described with "means for" components, this improvement incorporates a means for receiving user selection of the object in the images and a means for displaying at least a portion of the generated 3D model. This enhancement provides the user with the ability to select the object of interest and visualize the resulting 3D model during the process.
24. The apparatus of claim 23 , wherein the speed satisfies the speed threshold when the speed is greater than or equal to the speed threshold.
Within the apparatus, including "means for" components, the camera speed satisfies the speed threshold when the calculated speed is greater than or equal to the pre-defined speed threshold. This condition triggers subsequent actions, such as generating a notification.
25. The apparatus of claim 23 , wherein, when the speed is determined to satisfy the speed threshold, the means for capturing the images is paused or stopped.
Expanding on the apparatus with "means for" components, when the calculated camera speed satisfies the speed threshold (meaning it is too high), the means for capturing images is either paused or completely stopped. This prevents blur or distortion caused by excessive camera movement.
26. The apparatus of claim 22 , wherein the notification comprises a visual notification.
In the apparatus described with "means for" components, the notification that is generated when the camera speed exceeds the threshold is a visual notification. This could be a message displayed on a screen, an icon, or any other visual indicator alerting the user to the issue.
27. A non-transitory computer-readable medium comprising instructions that, when executed by a computer, cause the computer to: obtain images; estimate positions based on the images; calculate, based on the positions and timestamps of the images, a speed associated with movement relative to an object depicted in the images; output a notification based on a comparison of the speed to a speed threshold; determine a bounding box associated with the object; generate a three-dimensional model of the object based on the images; detect an anomaly in the three-dimensional model; and present, via a display device, one or more selectable options to enable correction of the anomaly.
A non-transitory computer-readable medium contains instructions to create 3D models. These instructions, when executed, cause the computer to: obtain images, estimate camera positions based on the images, calculate camera speed relative to an object based on position and timestamps, output a notification if speed exceeds a threshold, determine a bounding box for the object, generate a 3D model from images, detect anomalies, and present options for anomaly correction via a display device.
28. The non-transitory computer-readable medium of claim 27 , wherein the instructions further cause the computer to: present at least a portion of the three-dimensional model via a graphical user interface; and present, via the graphical user interface, two or more selectable options to enable correction of the anomaly.
Building on the computer-readable medium with 3D modeling instructions, additional instructions cause the computer to display at least a portion of the 3D model via a graphical user interface and present two or more selectable options via the GUI for enabling correction of detected anomalies. This provides a visual and interactive way for users to review the model and choose how to fix any problems.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
August 26, 2014
March 7, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.