Patentable/Patents/US-11282248
US-11282248

Information display by overlay on an object

PublishedMarch 22, 2022
Assigneenot available in USPTO data we have
Inventorsnot available in USPTO data we have
Technical Abstract

A computer system detects an object in a field-of-view (FOV) using at least one sensor coupled to the computer system and determines a shape of the object using a processor of the computer system. An overlay element having the shape and a changeable characteristic is created and a value of a parameter is obtained. A representation of the overlay element is rendered with the changeable characteristic set based on a value of the parameter and presented on a display of the computer system to at least partially occlude the object.

Patent Claims
20 claims

Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.

Claim 1

Original Legal Text

1. A method for display in a computer system, the method comprising: detecting an object in a field-of-view (FOV) using at least one sensor coupled to the computer system; determining a shape of the object using a processor of the computer system; creating an overlay element having the shape of the object and a changeable characteristic; obtaining a value of a parameter, wherein the parameter is related to a temperature of the object, a pressure in the object, a hazard level of the object, an expected time remaining to an action by the object, or a fuel level of the object; rendering a representation of the overlay element with the changeable characteristic set based on the value of the parameter; and presenting the representation of the overlay element on a display of the computer system to at least partially occlude the object.

Plain English Translation

This invention relates to a computer vision system that enhances object visualization by dynamically overlaying shape-matched graphical elements with variable characteristics based on real-time parameter data. The system detects objects within a sensor's field-of-view and analyzes their shapes using image processing techniques. For each detected object, a customizable overlay element is generated that precisely matches the object's shape. The overlay incorporates a modifiable visual property (e.g., color, transparency, or pattern) that encodes real-time parameter data such as temperature, pressure, hazard level, time-to-action, or fuel level. The system continuously updates the overlay's appearance based on incoming sensor measurements, creating an intuitive visual representation of the object's state. The overlay is then displayed over the object in the user's view, partially obscuring it while providing contextual information. This approach enables enhanced situational awareness by combining spatial recognition with dynamic data visualization, particularly useful in applications like industrial monitoring, vehicle systems, or augmented reality interfaces. The system automatically adapts to different object shapes and parameter types without requiring pre-configured templates.

Claim 2

Original Legal Text

2. The method of claim 1 , wherein the value of the parameter is related to the temperature of the object.

Plain English Translation

A system and method for monitoring and controlling a process involving an object, such as a manufacturing or industrial process, addresses the challenge of accurately tracking and adjusting process parameters to maintain optimal conditions. The invention involves measuring a parameter associated with the object and dynamically adjusting the process based on this parameter to ensure consistency and efficiency. A key aspect of the invention is the ability to relate the measured parameter to the temperature of the object, allowing for precise temperature-dependent adjustments. This relationship enables real-time feedback and control, improving process accuracy and reducing waste. The system may include sensors to detect the parameter, a processing unit to analyze the data, and actuators to modify the process conditions accordingly. By linking the parameter to temperature, the invention ensures that temperature variations are accounted for, enhancing product quality and operational reliability. The method is applicable in various industries, including manufacturing, chemical processing, and material handling, where temperature control is critical. The invention provides a robust solution for maintaining process stability by dynamically responding to temperature changes, thereby optimizing performance and reducing errors.

Claim 3

Original Legal Text

3. The method of claim 1 , wherein the value of the parameter is related to the pressure in the object.

Plain English Translation

A system and method for monitoring and analyzing parameters within an object, such as a container or industrial equipment, to detect and prevent potential failures or leaks. The invention addresses the challenge of accurately measuring and interpreting physical parameters, such as pressure, temperature, or structural integrity, in real-time to ensure operational safety and efficiency. The method involves sensing a parameter within the object, such as pressure, and processing the sensed data to determine its value. The value of the parameter is then correlated with the pressure inside the object, allowing for precise monitoring and control. This correlation helps in identifying deviations from expected pressure levels, which may indicate leaks, structural weaknesses, or other operational issues. The system may include sensors, data processing units, and feedback mechanisms to adjust operations based on the analyzed data. By continuously monitoring and analyzing the parameter in relation to pressure, the invention enables early detection of potential failures, reducing downtime and maintenance costs while enhancing safety. The method can be applied in various industries, including manufacturing, energy, and transportation, where accurate pressure monitoring is critical.

Claim 4

Original Legal Text

4. The method of claim 1 , wherein the value of the parameter is related to the hazard level of the object.

Plain English Translation

This invention relates to systems for detecting and assessing hazards in an environment, particularly for autonomous vehicles or robotic systems. The technology addresses the challenge of accurately identifying and evaluating potential hazards to ensure safe navigation and operation. The method involves detecting an object in the environment and determining a parameter associated with that object. The parameter's value is then adjusted based on the hazard level of the object, allowing the system to prioritize responses according to the severity of the threat. For example, a high-hazard object, such as a moving vehicle, would trigger a more immediate and aggressive avoidance maneuver compared to a low-hazard object, like a stationary barrier. The system may use sensors such as cameras, lidar, or radar to detect objects and analyze their characteristics, including speed, distance, and trajectory, to assess hazard levels. The method ensures that the system's reaction is proportional to the actual risk, improving safety and efficiency in dynamic environments. This approach is particularly useful in autonomous driving, where quick and accurate hazard assessment is critical for collision avoidance and safe operation.

Claim 5

Original Legal Text

5. The method of claim 1 , wherein the value of the parameter is related to the expected time remaining to an action by the object.

Plain English Translation

A system and method for predicting the timing of an action by an object, such as a vehicle or a robotic device, involves determining a parameter value that correlates with the expected time remaining until the object performs a specific action. The method includes monitoring the object's behavior, collecting data related to its movement or operational state, and analyzing this data to estimate the likelihood and timing of the impending action. The parameter value is derived from historical data, real-time sensor inputs, or predictive models that assess the object's current conditions and environmental factors. The system may use machine learning algorithms or statistical analysis to refine the accuracy of the prediction. The output is a quantitative or qualitative assessment of the remaining time before the action occurs, which can be used for collision avoidance, scheduling, or automated decision-making. The method ensures timely and reliable predictions by continuously updating the parameter value based on new data, allowing for adaptive responses to changing conditions. This approach is particularly useful in autonomous systems, traffic management, and industrial automation, where precise timing predictions enhance safety and efficiency.

Claim 6

Original Legal Text

6. The method of claim 1 , wherein the value of the parameter is related to the fuel level of the object.

Plain English Translation

A system and method for monitoring and managing fuel levels in a vehicle or other fuel-consuming object. The invention addresses the need for accurate, real-time fuel level tracking to optimize fuel consumption, prevent fuel shortages, and improve operational efficiency. The system includes sensors to detect fuel levels and a processing unit that calculates and adjusts operational parameters based on the detected fuel level. The method involves continuously monitoring the fuel level and dynamically adjusting one or more operational parameters of the object in response to changes in the fuel level. The parameter being adjusted is directly related to the fuel level, ensuring that the system responds appropriately to fuel consumption rates and availability. This may include modifying engine performance, fuel injection rates, or other operational settings to maintain optimal efficiency and safety. The system may also provide alerts or notifications when fuel levels fall below a predetermined threshold, allowing for timely refueling or maintenance. The invention is particularly useful in vehicles, industrial machinery, and other applications where precise fuel management is critical.

Claim 7

Original Legal Text

7. The method of claim 1 , wherein the display of the computer system comprises a head-mounted display (HMD) and at least a portion of the FOV is visible to a user through a transparent portion of the HMD.

Plain English Translation

This invention relates to augmented reality (AR) systems, specifically methods for displaying virtual content in a user's field of view (FOV) using a head-mounted display (HMD). The problem addressed is the need to integrate virtual objects seamlessly into a user's real-world environment while ensuring visibility and proper alignment with the physical surroundings. The method involves using an HMD with a transparent portion that allows the user to see the real world while virtual content is overlaid. The system determines the user's FOV and dynamically adjusts the display of virtual objects to ensure they appear correctly positioned within the real-world view. This includes compensating for head movements and environmental factors to maintain accurate spatial alignment. The HMD may also incorporate sensors to track the user's gaze or head position, further refining the placement of virtual content. The invention ensures that virtual objects remain visible and properly aligned with the real world, enhancing the user experience in AR applications. This is particularly useful in scenarios where precise spatial awareness is critical, such as navigation, training, or interactive simulations. The system dynamically adapts to changes in the user's environment, ensuring consistent and accurate visualization of virtual content.

Claim 8

Original Legal Text

8. The method of claim 1 , wherein the object comprises a plurality of items in the FOV and the shape of the object is a convex polygon with a shortest perimeter encompassing individual shapes of the plurality of items.

Plain English Translation

This invention relates to computer vision and object detection, specifically improving the accuracy of identifying and bounding objects in a field of view (FOV) when the object consists of multiple distinct items. The problem addressed is the challenge of accurately defining the shape of an object composed of multiple separate items, where traditional bounding techniques may either exclude parts of the object or include irrelevant background elements. The method involves analyzing a field of view containing multiple items that collectively form a single object. Instead of using a simple rectangular or circular bounding box, the system determines the shape of the object as a convex polygon. This polygon is defined as the smallest perimeter that can fully enclose all the individual shapes of the items within the object. By using a convex hull approach, the method ensures that the bounding shape tightly fits around the object without unnecessary extensions or gaps, improving detection accuracy in cluttered environments. The technique is particularly useful in applications such as autonomous navigation, robotic vision, and surveillance, where distinguishing between multiple items and accurately defining their collective shape is critical. The convex polygon approach minimizes errors caused by irregularly shaped objects or overlapping items, providing a more precise representation of the object's spatial extent.

Claim 9

Original Legal Text

9. The method of claim 1 , further comprising: obtaining a series of values of the parameter over a period of time, the series of values including said value; tracking positions and shapes of the object over the period of time in the FOV; and rendering multiple representations of the overlay element with the changeable characteristic changed based on the series of values of the parameter and shapes of the object over the period of time; serially presenting the multiple representations of the overlay element over the period of time on the display of the computer system using the positions of the object over the period of time to determine positions for the multiple representations of the overlay element on the display over the period of time.

Plain English Translation

This invention relates to a system for dynamically rendering and displaying overlay elements in a field of view (FOV) of a computer system, particularly for tracking and visualizing changes in a parameter associated with an object over time. The system addresses the challenge of providing real-time, context-aware visual feedback by continuously monitoring a parameter and adjusting an overlay element's appearance based on its values and the object's movement. The method involves capturing a series of parameter values over time, where each value corresponds to a specific state of the object. The system tracks the object's position and shape within the FOV throughout this period. Based on the parameter values and the object's changing shapes, the system generates multiple representations of an overlay element, modifying a changeable characteristic (e.g., color, size, or transparency) to reflect variations in the parameter. These representations are then displayed sequentially on the computer system's display, with their positions aligned to the object's tracked positions over time. This ensures that the overlay element remains dynamically linked to the object, providing a coherent visual representation of the parameter's evolution. The approach enhances situational awareness by integrating temporal data with spatial tracking, enabling users to observe trends and correlations in real-time.

Claim 10

Original Legal Text

10. The method of claim 1 , wherein the changeable characteristic comprises a transparency or a fill amount.

Plain English Translation

A system and method for dynamically adjusting visual characteristics of graphical elements in a user interface to enhance user experience and accessibility. The invention addresses the problem of static graphical elements that do not adapt to user preferences, environmental conditions, or device capabilities, leading to poor readability, usability, or aesthetic issues. The method involves modifying at least one changeable characteristic of a graphical element, such as transparency or fill amount, in response to user input, system conditions, or predefined rules. Transparency adjustments allow for better layering and visibility of overlapping elements, while fill amount modifications control the density or coverage of graphical fills, improving contrast and clarity. The system may automatically adjust these characteristics based on factors like ambient lighting, user accessibility settings, or application context, ensuring optimal display quality. The invention also includes mechanisms to preserve the integrity of the graphical elements while dynamically altering their appearance, maintaining design consistency and functionality. This approach enhances user interaction by providing adaptable visual elements that respond to real-time conditions and user needs.

Claim 11

Original Legal Text

11. The method of claim 1 , wherein the changeable characteristic comprises a color or a rate of a pulsating effect.

Plain English Translation

A method for modifying visual characteristics of a display involves adjusting a changeable characteristic of a visual element, such as a color or the rate of a pulsating effect. The visual element is part of a graphical user interface (GUI) displayed on a device, and the adjustment is based on user input or system conditions. The method includes detecting a trigger event, such as a user interaction or a system state change, and dynamically altering the visual characteristic in response. For example, the color of an icon or the speed of a pulsating animation may change to indicate a notification, status update, or user preference. The adjustment can be temporary or persistent, depending on the application. This technique enhances user engagement and provides visual feedback in interactive systems. The method may also involve storing user preferences for the visual characteristics to personalize the display. The system may include a processor, memory, and a display interface to execute the adjustments in real-time. The approach is applicable in mobile devices, wearables, and other electronic displays where dynamic visual feedback improves usability.

Claim 12

Original Legal Text

12. The method of claim 1 , further comprising: determining a range of distances to portions of the object; and filling portions of the overlay element based on both a distance to a corresponding portion of the object as a percentage of the range of distances and a value of the series values of the parameter to create a three-dimensional fill of the overlay element.

Plain English Translation

This invention relates to visualizing data in three dimensions by overlaying a fill effect on an object based on both distance and parameter values. The method addresses the challenge of representing complex data distributions in a way that is both intuitive and visually informative. The system first determines a range of distances to various portions of an object, which may be a physical or digital representation. It then calculates the distance of each portion relative to this range, expressed as a percentage. Additionally, the method evaluates a series of parameter values associated with the object. The overlay element is filled in a three-dimensional manner, where the fill intensity or pattern varies based on two factors: the normalized distance of each portion and the corresponding parameter value. This creates a dynamic visualization that highlights spatial relationships and data variations simultaneously. The technique is particularly useful in fields like medical imaging, engineering simulations, or scientific data analysis, where understanding both geometric and parametric variations is critical. The three-dimensional fill enhances depth perception and makes it easier to interpret multi-dimensional datasets.

Claim 13

Original Legal Text

13. A method for display in a computer system, the method comprising: detecting an object in a field-of-view (FOV) using at least one sensor coupled to the computer system; determining a shape of the object using a processor of the computer system; creating an overlay element having the shape of the object and a changeable characteristic; obtaining a value of a parameter, wherein the parameter is related to an attribute of an ambient environment shown in the FOV; rendering a representation of the overlay element with the changeable characteristic set based on the value of the parameter; and presenting the representation of the overlay element on a display of the computer system to at least partially occlude the object.

Plain English Translation

This invention relates to computer vision and augmented reality systems that enhance visual displays by dynamically overlaying context-aware graphical elements. The problem addressed is the lack of adaptive visual feedback in augmented reality (AR) applications, where static overlays fail to reflect real-time environmental conditions or object attributes. The method involves detecting an object within a camera's field-of-view using sensors such as cameras or depth sensors. A processor analyzes the object's shape and generates a corresponding overlay element that matches this shape. The overlay has a modifiable visual property, such as color, transparency, or texture, which changes based on an environmental parameter. This parameter could be ambient light levels, temperature, or other measurable attributes of the surroundings. The system continuously monitors this parameter and adjusts the overlay's appearance accordingly. The modified overlay is then rendered and displayed, partially obscuring the original object while providing dynamic visual feedback about the environment. This approach improves situational awareness in AR applications by making overlays responsive to real-world conditions.

Claim 14

Original Legal Text

14. The method of claim 13 , wherein the attribute of the ambient environment is not determined by an attribute of the object.

Plain English Translation

The invention relates to systems and methods for analyzing ambient environments to detect and respond to objects, particularly in scenarios where the object's attributes do not influence the determination of ambient environmental attributes. The technology addresses challenges in environments where traditional object-based detection methods may fail, such as in low-visibility conditions or when objects lack distinguishable features. The method involves capturing data from sensors, such as cameras or lidar, to monitor an ambient environment. The system processes this data to identify objects within the environment, such as vehicles, pedestrians, or obstacles. Unlike conventional approaches that rely on object attributes (e.g., size, shape, or movement patterns) to infer environmental conditions, this method independently assesses ambient attributes (e.g., lighting, temperature, or atmospheric conditions) without being influenced by the object's characteristics. This ensures accurate environmental analysis even when objects are indistinct or partially obscured. The system may use machine learning models or rule-based algorithms to classify environmental conditions and adjust operations accordingly. For example, in autonomous driving, the method could detect poor visibility due to fog or rain and trigger adaptive responses, such as slowing down or activating additional sensors, without relying on object-specific data. The approach improves reliability in dynamic environments where environmental factors significantly impact detection accuracy.

Claim 15

Original Legal Text

15. The method of claim 13 , wherein the display of the computer system comprises a head-mounted display (HMD) and at least a portion of the FOV is visible to a user through a transparent portion of the HMD.

Plain English Translation

This invention relates to augmented reality (AR) systems, specifically improving user interaction with digital content in a mixed reality environment. The problem addressed is the difficulty of seamlessly integrating virtual objects with the real-world view in AR systems, particularly when using head-mounted displays (HMDs) that may obstruct part of the user's field of view (FOV). The method involves displaying virtual content through an HMD, where the display includes a transparent portion allowing the user to see the real-world environment. The system dynamically adjusts the display of virtual objects based on the user's gaze or head movements to ensure they remain visible and properly aligned with the real world. This includes tracking the user's FOV and modifying the position, orientation, or visibility of virtual objects to maintain a coherent mixed reality experience. The system may also prioritize certain virtual objects based on their relevance or the user's interaction history, ensuring important content remains accessible even if partially obscured by the HMD's physical structure. The method enhances situational awareness by reducing visual clutter and improving the alignment of virtual and real-world elements, making AR applications more intuitive and effective.

Claim 16

Original Legal Text

16. The method of claim 13 , further comprising: obtaining a series of values of the parameter over a period of time, the series of values including said value; tracking positions and shapes of the object over the period of time in the FOV; and rendering multiple representations of the overlay element with the changeable characteristic changed based on the series of values of the parameter and shapes of the object over the period of time; serially presenting the multiple representations of the overlay element over the period of time on the display of the computer system using the positions of the object over the period of time to determine positions for the multiple representations of the overlay element on the display over the period of time.

Plain English Translation

This invention relates to a system for dynamically rendering and displaying overlay elements in a field of view (FOV) of a computer system, particularly for tracking and visualizing changes in a parameter associated with an object over time. The system addresses the challenge of providing real-time, contextually relevant visual feedback by dynamically adjusting the appearance of overlay elements based on time-varying data. The method involves obtaining a series of values for a parameter over a defined period, where these values include a specific value of interest. The system tracks the positions and shapes of the object within the FOV during this period. Based on the series of parameter values and the object's changing shapes, the system generates multiple representations of an overlay element, each with a characteristic that varies according to the parameter's values and the object's shape at different times. These representations are then displayed sequentially on the computer system's display, with their positions determined by the object's tracked positions over time. This ensures that the overlay elements remain accurately aligned with the object as it moves or changes shape, providing a coherent and informative visualization of the parameter's evolution. The approach enhances situational awareness by dynamically linking visual feedback to both spatial and temporal variations in the parameter and the object.

Claim 17

Original Legal Text

17. The method of claim 13 , wherein the changeable characteristic comprises a color.

Plain English Translation

A system and method for dynamically adjusting visual characteristics of a display device to enhance user experience and reduce eye strain. The invention addresses the problem of static display settings that do not adapt to varying environmental conditions or user preferences, leading to discomfort and reduced visual performance. The method involves detecting changes in ambient lighting conditions or user input and modifying a changeable characteristic of the display, such as color, brightness, or contrast, in response. The system includes sensors to monitor environmental factors and a processing unit to analyze the data and adjust the display accordingly. The color adjustment feature allows the display to shift between different color temperatures or hues based on predefined settings or real-time conditions, improving readability and reducing eye fatigue. The method may also incorporate user preferences, time-based schedules, or application-specific profiles to further customize the display output. By dynamically adapting the display characteristics, the invention provides a more comfortable and efficient viewing experience across different environments and use cases.

Claim 18

Original Legal Text

18. The method of claim 13 , wherein the changeable characteristic comprises a transparency.

Plain English Translation

A system and method for dynamically adjusting visual properties of a display device to enhance user experience and energy efficiency. The invention addresses the problem of static display configurations that fail to adapt to varying environmental conditions, user preferences, or power constraints. The system includes a display device with adjustable characteristics, such as transparency, brightness, or color, controlled by a processing unit. The processing unit monitors environmental factors (e.g., ambient light, user proximity) and adjusts the display properties in real-time to optimize visibility, reduce power consumption, or provide privacy. For example, the transparency of the display can be modified to allow partial visibility of background elements while maintaining content clarity. The system may also incorporate user input to manually override automatic adjustments. The method involves detecting a change in environmental conditions or user preferences, determining an optimal display characteristic (e.g., transparency level), and applying the adjustment to the display. This dynamic adaptation improves usability in diverse settings, such as outdoor environments or shared workspaces, while conserving energy. The invention is applicable to electronic devices with displays, including smartphones, tablets, and digital signage.

Claim 19

Original Legal Text

19. The method of claim 13 , wherein the changeable characteristic comprises a fill amount.

Plain English Translation

A system and method for adjusting a fill amount in a container or reservoir to optimize performance or functionality. The invention addresses the need for precise control over fluid or material levels in various applications, such as medical devices, industrial processes, or consumer products, where maintaining an accurate fill amount is critical for safety, efficiency, or operational reliability. The method involves dynamically monitoring and adjusting the fill amount based on real-time data, environmental conditions, or user inputs to ensure optimal performance. This may include automated refilling, draining, or leveling mechanisms that respond to detected changes in the fill amount. The system may incorporate sensors, actuators, and control algorithms to maintain the desired fill level within specified tolerances. The invention is particularly useful in applications where fluctuations in fill amount could lead to malfunctions, inefficiencies, or safety hazards, such as in medical infusion pumps, fuel tanks, or chemical processing systems. The method ensures consistent and reliable operation by continuously adapting the fill amount to changing conditions or requirements.

Claim 20

Original Legal Text

20. The method of claim 13 , wherein the changeable characteristic comprises a rate of a pulsating effect.

Plain English Translation

A method for adjusting a pulsating effect in a device or system involves modifying the rate of the pulsating effect to achieve a desired output. The pulsating effect may be generated by a mechanical, electrical, or optical mechanism, and the rate of pulsation can be adjusted to control parameters such as frequency, intensity, or duration of the pulses. This adjustment can be used in various applications, including medical devices, lighting systems, or industrial processes, where precise control of pulsation is necessary. The method may involve using a controller or feedback mechanism to dynamically alter the pulsation rate in response to input signals or environmental conditions. The adjustment can be performed automatically or manually, depending on the application requirements. The invention provides a way to fine-tune the pulsating effect to optimize performance, efficiency, or user experience in the target system.

Classification Codes (CPC)

Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.

Patent Metadata

Filing Date

September 23, 2019

Publication Date

March 22, 2022

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, FAQs, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “Information display by overlay on an object” (US-11282248). https://patentable.app/patents/US-11282248

© 2026 Nomic Interactive Technology LLC. Machine-readable context available at /api/llm-context/US-11282248. See llms.txt for full attribution policy.