Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A computer-implemented method, comprising: determining, by a computing module, a viewing location of a user with respect to a computing device, the viewing location including a viewing distance and a viewing angle of the user with respect to the computing device; determining, by the computing module, that a physical input device is physically coupled to and positioned on a display of the computing device; in response to determining that the physical input device is physically coupled to and positioned on the display of the computing device, identifying, by the computing module, a non-visible portion of a graphical user interface (GUI) presented by the display of the computing device based on the viewing distance, the viewing angle, and the position of the physical input device on the display of the computing device; determining, by the computing module, that a graphical object is included by the non-visible portion of the GUI; and in response to determining that the graphical object is included by the non-visible portion of the GUI, adjusting, by the computing module, display dimensions of the GUI such that an updated location of the graphical object is included by a visible portion of the GUI.
This invention relates to enhancing user interaction with computing devices by dynamically adjusting graphical user interfaces (GUIs) based on the user's viewing position and the presence of physical input devices on the display. The problem addressed is the obstruction of GUI elements by physical input devices (e.g., keyboards, touchpads) or the user's viewing angle, which can make parts of the interface inaccessible or invisible. The solution involves a computing module that tracks the user's viewing location, including distance and angle relative to the device, and detects when a physical input device is attached to and positioned on the display. Based on this data, the system identifies which portions of the GUI are obscured or outside the user's field of view. If a graphical object (e.g., a button, menu, or window) is in the non-visible portion, the system automatically adjusts the GUI's display dimensions to reposition the object into the visible area, ensuring uninterrupted access. This dynamic adjustment improves usability by compensating for physical obstructions and viewing constraints without manual intervention.
2. The computer-implemented method of claim 1 , further comprising: determining, by the computing module, a new viewing location of the user with respect to the computing device, the new viewing location including a new viewing distance and a new viewing angle of the user with respect to the computing device; identifying, by the computing module, an updated non-visible portion of the GUI based on the new viewing distance, the new viewing angle, and the positioning of the physical input device on the display of the computing device; determining, by the computing module, that the graphical object is included by the updated non-visible portion of the GUI; and in response to determining that the graphical object is included by the updated non-visible portion of the GUI, re-adjusting, by the computing module, display dimensions of the GUI such that a further updated location of the graphical object is included by the updated visible portion of the GUI.
This invention relates to dynamic graphical user interface (GUI) adjustments in computing systems to maintain visibility of key elements as a user's viewing position changes. The problem addressed is the loss of visibility of important GUI elements when a user moves, altering their viewing distance and angle relative to the display. The system includes a computing module that tracks the user's viewing location, including distance and angle, and identifies non-visible portions of the GUI based on this data. If a graphical object (e.g., a button, icon, or notification) falls into the non-visible area, the system automatically adjusts the GUI's display dimensions to ensure the object remains visible. This adjustment may involve resizing, repositioning, or otherwise modifying the GUI layout. The system also accounts for the physical positioning of input devices (e.g., a keyboard or mouse) on the display to avoid obscuring the GUI. The invention ensures critical GUI elements remain accessible regardless of the user's movement, improving usability in dynamic environments.
3. The computer-implemented method of claim 2 , wherein determining the viewing location of the user with respect to the computing device further comprises obtaining, by the computing module, camera-based data indicating the viewing location of the user, and wherein determining the new viewing location of the user with respect to the computing device further comprises obtaining, by the computing module, infrared time-of-flight data indicating the new viewing location of the user.
This invention relates to a computer-implemented method for tracking a user's viewing location relative to a computing device, particularly for adjusting content display based on the user's position. The method addresses the challenge of dynamically adapting digital content to ensure optimal viewing experiences as the user moves, which is critical for applications like augmented reality, virtual reality, and interactive displays. The method involves a computing module that determines the user's initial viewing location using camera-based data, such as visual tracking from a front-facing camera. This data captures the user's position, orientation, or gaze direction relative to the device. When the user moves, the system updates the viewing location by obtaining infrared time-of-flight data, which measures distance and depth using infrared signals to precisely track changes in the user's position. The system then adjusts the displayed content in real-time to align with the new viewing location, ensuring the content remains properly oriented and visible. By combining camera-based and infrared time-of-flight data, the method provides a robust solution for accurate and responsive tracking, improving user interaction with digital content across various applications.
4. The computer-implemented method of claim 2 , wherein determining the viewing location of the user with respect to the computing device further comprises obtaining, by the computing module, eye-gaze-based data indicating the viewing location of the user, and wherein determining the new viewing location of the user with respect to the computing device further comprises obtaining, by the computing module, infrared time-of-flight data indicating the new viewing location of the user.
A system determines a user's viewing location relative to a computing device using multiple sensing techniques. The system first obtains eye-gaze-based data, such as eye-tracking information, to identify the user's initial viewing position. This data may be captured using cameras or sensors that track the user's gaze direction. The system then updates the user's viewing location by acquiring infrared time-of-flight data, which measures the distance between the user and the device by analyzing the time it takes for infrared signals to reflect back. This dual-sensor approach improves accuracy by combining gaze tracking with precise distance measurement. The system may adjust display content, such as focus areas or privacy settings, based on the updated viewing location. This method is useful in applications requiring dynamic user interaction, such as augmented reality, security systems, or adaptive user interfaces. The combination of eye-gaze and time-of-flight data ensures reliable tracking even in varying lighting conditions or when the user moves.
5. The computer-implemented method of claim 2 , wherein determining the viewing location of the user with respect to the computing device further comprises obtaining, by the computing module, camera-based data indicating the viewing location of the user, and wherein determining the new viewing location of the user with respect to the computing device further comprises obtaining, by the computing module, camera-based data indicating the new viewing location of the user.
A computer-implemented method tracks a user's viewing location relative to a computing device using camera-based data. The method involves capturing images or video of the user to determine their initial viewing position and subsequently detecting changes in that position as the user moves. The system processes the camera-based data to identify the user's gaze direction, head position, or body orientation, enabling real-time adjustments to the device's display or content based on the user's movement. This approach enhances user interaction by dynamically adapting to the user's perspective, improving accessibility and engagement. The method may be integrated into devices with built-in or external cameras, such as smartphones, tablets, or augmented reality systems, to provide a more intuitive and responsive user experience. The camera-based tracking ensures accurate and continuous monitoring of the user's position, allowing the system to maintain optimal content visibility and interaction. This technology addresses challenges in maintaining seamless user-device interaction in dynamic environments where the user's viewing angle or distance may change frequently.
6. The computer-implemented method of claim 1 , wherein adjusting the display dimensions further comprises: determining, by the computing module, that an adjustment of the display dimensions is less than a threshold; and in response to determining that the adjustment of the display dimensions is less than the threshold, foregoing adjusting display dimensions of the GUI.
This invention relates to a computer-implemented method for dynamically adjusting display dimensions of a graphical user interface (GUI) in response to user interactions or system conditions. The method addresses the problem of unnecessary or excessive adjustments to GUI dimensions, which can disrupt user experience by causing frequent resizing or layout changes. The solution involves a computing module that evaluates whether an adjustment to the display dimensions is necessary before applying it. Specifically, the module determines if the proposed adjustment is less than a predefined threshold. If the adjustment is below this threshold, the system foregoes resizing the GUI, thereby maintaining stability and preventing minor or imperceptible changes from affecting the display. This approach ensures that only meaningful adjustments are applied, improving usability and reducing visual distractions. The method may be part of a larger system for optimizing GUI performance, where the computing module also handles other display-related functions, such as scaling or repositioning elements. The threshold value can be set based on user preferences, system capabilities, or application requirements to balance responsiveness with stability. This technique is particularly useful in applications where precise display control is critical, such as design tools, medical imaging, or high-precision data visualization.
7. The computer-implemented method of claim 1 , further comprising: determining, by the computing module, a hinge angle of the computing device, wherein the graphical object is determined to be included by the non-visible portion of the GUI further based on the hinge angle of the computing device.
A computer-implemented method for managing graphical user interface (GUI) elements in a computing device with a hinge mechanism, such as a foldable or dual-screen device. The method addresses the challenge of dynamically adjusting GUI content visibility based on the device's physical configuration, particularly when the device is partially folded or closed, obscuring part of the display. The method involves a computing module that monitors the device's hinge angle to determine the extent of display occlusion. When the hinge angle indicates that a portion of the GUI is non-visible due to the device's physical state, the computing module excludes graphical objects from that obscured area. This ensures that interactive elements remain accessible only within the visible display region, preventing user confusion or unintended interactions with hidden content. The hinge angle is continuously or periodically assessed to dynamically update the GUI layout as the device's configuration changes, maintaining usability across different hinge positions. The method may also involve adjusting the placement or scaling of visible GUI elements to optimize the remaining display space. This approach enhances user experience by adapting the interface to the device's physical constraints in real-time.
8. The computer-implemented method of claim 1 , wherein the computing device is a dual-display computing device, with each display of the dual-display computing device are within respective planes, the method further comprising: determining, by the computing module, an orientation of the computing device; and identifying, by the computing module and based on the orientation of the computing device, a particular display of the dual-display computing device that the physical input device is physically coupled to.
A dual-display computing device with a physical input device, such as a keyboard or trackpad, often faces challenges in determining which display the input device is intended to interact with, especially when the device's orientation changes. This can lead to confusion in input targeting, particularly in portable or foldable devices where displays may be positioned at different angles. The invention addresses this by providing a method to identify which display the input device is physically coupled to based on the device's orientation. The computing device includes a computing module that detects the device's orientation and uses this information to determine the correct display for input targeting. This ensures that user inputs are directed to the intended display, improving usability and reducing errors in multi-display environments. The method dynamically adjusts to changes in orientation, maintaining accurate input mapping regardless of how the device is positioned. This solution is particularly useful for dual-display devices where displays are in separate planes, such as foldable or hinged devices, ensuring seamless interaction across both screens.
9. A computing device, comprising: a display device; a physical input device; a processor having access to memory media storing operations executable by the processor to: determine a viewing location of a user with respect to the computing device, the viewing location including a viewing distance and a viewing angle of the user with respect to the computing device; determine that the physical input device is physically coupled to and positioned on the display device; in response to determining that the physical input device is physically coupled to and positioned on the display device, identify a non-visible portion of a graphical user interface (GUI) presented by the display device based on the viewing distance, the viewing angle, and the position of the physical input device on the display of the computing device; determine that a graphical object is included by the non-visible portion of the GUI; and in response to determining that the graphical object is included by the non-visible portion of the GUI, adjust display dimensions of the GUI such that an updated location of the graphical object is included by a visible portion of the GUI.
A computing device includes a display and a physical input device, such as a keyboard or mouse, coupled to the display. The device determines a user's viewing location relative to the display, including the distance and angle from which the user is observing the screen. If the input device is physically attached to the display, the device identifies portions of the graphical user interface (GUI) that are not visible to the user based on their viewing position and the input device's placement. If a graphical object, such as an icon or window, is located in the non-visible area, the device adjusts the GUI's display dimensions to reposition the object into a visible area of the screen. This ensures critical interface elements remain accessible regardless of the user's viewing perspective or the input device's position. The system dynamically optimizes the GUI layout to maintain usability in different viewing conditions.
10. The computing device of claim 9 , wherein the physical input device is a keyboard.
A computing device includes a physical input device, such as a keyboard, that generates input signals in response to user interactions. The device also includes a processor and a memory storing instructions that, when executed by the processor, cause the device to detect a user interaction with the physical input device, determine whether the interaction is a predefined input pattern, and perform a predefined action in response to detecting the predefined input pattern. The predefined input pattern may involve specific key sequences, timing, or combinations of inputs. The predefined action could include launching an application, executing a command, or triggering a system function. The system may also include a learning module that adapts the predefined input patterns and actions based on user behavior over time. The device may further include a display for providing feedback or instructions related to the input patterns. This technology addresses the need for efficient, customizable input methods in computing systems, allowing users to perform complex tasks with simple, memorizable key sequences.
11. The computing device of claim 9 , the operations further comprising: determine a new viewing location of the user with respect to the computing device, the new viewing location including a new viewing distance and a new viewing angle of the user with respect to the computing device; identify an updated non-visible portion of the GUI based on the new viewing distance, new viewing angle, and the positioning of the physical input device on the display of the computing device; determine that the graphical object is included by the non-visible portion of the GUI; and in response to determining that the graphical object is included by the non-visible portion of the GUI, re-adjust display dimensions of the GUI such that a further updated location of the graphical object is included by the visible portion of the GUI.
This invention relates to computing devices with graphical user interfaces (GUIs) that adapt to a user's viewing position. The problem addressed is maintaining visibility of important graphical objects when a user moves, ensuring critical information remains accessible without manual adjustments. The system tracks the user's viewing location, including distance and angle relative to the device, and identifies portions of the GUI that become non-visible due to the user's movement. If a graphical object falls into the non-visible area, the system automatically re-adjusts the GUI's display dimensions to reposition the object into the visible portion. This dynamic adjustment ensures continuous visibility of key elements, improving usability in scenarios where the user's position changes frequently. The solution integrates with physical input devices positioned on the display, accounting for their placement when determining visibility and re-adjusting the GUI. The system prioritizes seamless interaction by automatically compensating for positional changes, reducing the need for manual corrections.
12. The computing device of claim 11 , further comprising: a camera module; and an infrared module, wherein the viewing location of the user is based on data provided by the camera module, and the new viewing location of the user is based on data provided by the infrared module.
This invention relates to computing devices equipped with user tracking capabilities, particularly for determining and updating a user's viewing location. The technology addresses the challenge of accurately tracking a user's position and gaze direction in real-time, which is essential for applications such as augmented reality, interactive displays, and adaptive user interfaces. The computing device includes a camera module and an infrared module. The camera module captures visual data to determine the user's initial viewing location, providing a baseline for tracking. The infrared module then detects changes in the user's position or gaze direction, enabling real-time updates to the viewing location. This dual-module approach enhances accuracy by combining visual and infrared data, reducing errors from environmental factors like lighting conditions or occlusions. The system dynamically adjusts the viewing location based on the infrared module's data, ensuring continuous and precise tracking. This allows the computing device to adapt its output, such as adjusting displayed content or interface elements, in response to the user's movements. The integration of both modules improves reliability and responsiveness, making the device suitable for applications requiring high-fidelity user interaction tracking.
13. The computing device of claim 11 , further comprising: a camera module, wherein the viewing location of the user is based on data provided by the camera module, and the new viewing location of the user is based on data provided by the camera module.
A computing device includes a camera module that tracks a user's viewing location and updates it based on data from the camera module. The device determines the user's initial viewing location using the camera module and adjusts to a new viewing location as the user moves, also relying on camera data. The camera module captures visual information to detect the user's position, orientation, or gaze direction, enabling the device to dynamically adjust content display or interactions based on the user's real-time viewing position. This system enhances user experience by ensuring content remains aligned with the user's perspective, particularly in applications requiring spatial awareness, such as augmented reality, virtual reality, or interactive displays. The camera module may use techniques like facial recognition, eye tracking, or depth sensing to accurately determine the user's viewing location. The device may further process the camera data to filter noise, compensate for environmental factors, or improve tracking precision. This approach ensures seamless interaction by continuously updating the viewing location without manual input, improving usability in dynamic environments.
14. The computing device of claim 9 , wherein adjusting the display dimensions further comprises: determining that an adjustment of the display dimensions is less than a threshold; and in response to determining that the adjustment of the display dimensions is less than the threshold, foregoing adjusting display dimensions of the GUI.
A computing device dynamically adjusts the display dimensions of a graphical user interface (GUI) based on user interaction or system conditions. The device monitors changes in display parameters, such as screen resolution, window size, or orientation, and calculates the required adjustments to maintain optimal GUI usability. If the calculated adjustment falls below a predefined threshold, the device skips the adjustment to avoid unnecessary processing or visual disruptions. This ensures smooth performance while preserving the intended layout and readability of the GUI. The system may also consider user preferences or application-specific requirements when determining whether to apply adjustments. By selectively applying changes only when significant, the device reduces computational overhead and enhances user experience. The invention is particularly useful in environments where display conditions frequently change, such as mobile devices or multi-monitor setups, where maintaining consistent GUI dimensions is critical for usability.
15. The computing device of claim 9 , the operations further comprising: determining a hinge angle of the computing device, wherein the graphical object is determined to be included by the non-visible portion of the GUI further based on the hinge angle of the computing device.
A computing device with a hinge mechanism adjusts graphical user interface (GUI) content visibility based on the device's hinge angle. The device includes a display, a hinge assembly, and a processor that renders a GUI with visible and non-visible portions. The processor determines whether a graphical object should be included in the non-visible portion of the GUI based on the hinge angle. This ensures that when the device is in a folded or partially folded state, certain graphical objects are hidden from view, optimizing screen real estate and user experience. The hinge angle is measured by sensors or mechanical feedback mechanisms integrated into the hinge assembly. The processor dynamically adjusts the GUI layout in response to changes in the hinge angle, ensuring seamless transitions between different display configurations. This feature is particularly useful for foldable or dual-screen devices, where the display area changes as the hinge angle varies. The system improves usability by preventing clutter and ensuring that only relevant content is displayed in the visible portion of the GUI.
16. The computing device of claim 9 , wherein the computing device further includes an additional display, wherein each display is within a respective plane, the operations further comprising: determining an orientation of the computing device; and identifying, based on the orientation of the computing device, a particular display that the physical input device is physically coupled to.
This invention relates to computing devices with multiple displays and a method for determining which display a physical input device is coupled to based on the device's orientation. The technology addresses the challenge of managing input interactions in multi-display systems where a user may interact with different displays in various orientations, such as in foldable or modular computing devices. The computing device includes at least two displays, each positioned in its own plane, and a physical input device (e.g., a keyboard, trackpad, or stylus) that can be coupled to one of the displays. The device determines its orientation using sensors (e.g., accelerometers, gyroscopes) and identifies which display the input device is physically connected to based on this orientation. This ensures that input commands are correctly routed to the intended display, improving usability in dynamic or multi-configuration setups. The system may also include additional features such as adjusting display content or input mappings based on the identified display, ensuring seamless interaction across multiple screens. The orientation-based detection allows the device to adapt to different usage scenarios, such as when the device is folded, unfolded, or rotated, without requiring manual user input. This enhances efficiency and reduces errors in multi-display environments.
17. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising: determining a viewing location of a user with respect to a computing device, the viewing location including a viewing distance and a viewing angle of the user with respect to the computing device; determining that a physical input device is physically coupled to and positioned on a display of the computing device; in response to determining that the physical input device is physically coupled to and positioned on the display of the computing device, identify a non-visible portion of a graphical user interface (GUI) presented by the display of the computing device based on the viewing distance, the viewing angle, and the position of the physical input device on the display of the computing device; determining that a graphical object is included by the non-visible portion of the GUI; and in response to determining that the graphical object is included by the non-visible portion of the GUI, adjusting display dimensions of the visible portion of the GUI such that an updated location of the graphical object is included by the visible portion of the GUI.
The invention relates to optimizing the display of graphical user interfaces (GUIs) on computing devices based on a user's viewing position and the presence of physical input devices. The problem addressed is ensuring that critical graphical objects remain visible to the user when part of the GUI is obscured by a physical input device, such as a keyboard or stylus, attached to the display. The system determines the user's viewing location, including distance and angle relative to the computing device, and detects whether a physical input device is physically coupled to and positioned on the display. If such a device is detected, the system identifies a non-visible portion of the GUI that is obscured by the input device, based on the viewing parameters and the device's position. If a graphical object is found in the non-visible portion, the system adjusts the display dimensions of the visible portion to ensure the object remains visible. This dynamic adjustment enhances usability by preventing important interface elements from being hidden behind physical input devices, thereby improving user interaction with the computing device.
18. The non-transitory computer-readable medium of claim 17 , further comprising: determining a new viewing location of the user with respect to the computing device, the new viewing location including a new viewing distance and a new viewing angle of the user with respect to the computing device; identifying an updated non-visible portion of the GUI based on the new viewing distance, the new viewing angle, and the positioning of the physical input device on the display of the computing device; determining that the graphical object is included by the non-visible portion of the GUI; and in response to determining that the graphical object is included by the non-visible portion of the GUI, re-adjusting display dimensions of the visible portion of the GUI such that a further updated location of the graphical object is included by the visible portion of the GUI.
This invention relates to adaptive graphical user interfaces (GUIs) for computing devices, addressing the problem of maintaining visibility of important graphical objects when a user's viewing position changes. The system dynamically adjusts the visible portion of a GUI based on the user's viewing distance, angle, and the physical input device's position on the display. When the user moves, the system determines a new viewing location, including distance and angle, and identifies which parts of the GUI are no longer visible due to this change. If a critical graphical object (e.g., a button, icon, or text) becomes obscured, the system automatically re-adjusts the display dimensions of the visible portion of the GUI to ensure the object remains visible. This adjustment may involve resizing, repositioning, or scrolling the GUI elements to maintain usability. The solution ensures that essential interface elements remain accessible regardless of the user's movement, improving interaction consistency and reducing frustration. The system may also account for the physical input device's placement to optimize visibility and interaction efficiency.
19. The non-transitory computer-readable medium of claim 17 , wherein adjusting the display dimensions further comprises: determining that an adjustment of the display dimensions is less than a threshold; and in response to determining that the adjustment of the display dimensions is less than the threshold, foregoing adjusting display dimensions of the visible portion of the GUI.
This invention relates to graphical user interface (GUI) display adjustments in computing systems. The problem addressed is optimizing display performance by selectively adjusting GUI dimensions based on the magnitude of required changes. The system monitors display adjustments and applies changes only when they exceed a predefined threshold, avoiding unnecessary processing for minor adjustments. This improves efficiency by reducing computational overhead and minimizing visual disruptions for small changes. The invention involves a non-transitory computer-readable medium storing instructions that, when executed, perform these operations. The system first determines whether an adjustment to the display dimensions is less than a specified threshold. If the adjustment is below the threshold, the system skips adjusting the visible portion of the GUI, preserving the current display state. This selective adjustment mechanism ensures that only significant changes trigger display updates, enhancing performance and user experience. The invention builds on a broader system for dynamically adjusting GUI elements, where the threshold-based approach refines the adjustment logic to avoid unnecessary rendering operations. The solution is particularly useful in applications requiring frequent display updates, such as real-time data visualization or interactive interfaces, where minimizing redundant processing is critical.
20. The non-transitory computer-readable medium of claim 17 , the operations further comprising: determining a hinge angle of the computing device, wherein the graphical object is determined to be included by the non-visible portion of the GUI further based on the hinge angle of the computing device.
A computing device with a hinge mechanism, such as a foldable or dual-display device, may experience challenges in managing graphical user interface (GUI) elements when the device is in different hinge configurations. Specifically, when the device is partially folded or adjusted, certain GUI elements may become obscured or non-visible due to the hinge angle, leading to usability issues. This invention addresses the problem by dynamically determining whether a graphical object should be included in a non-visible portion of the GUI based on the hinge angle of the device. The system detects the current hinge angle and uses this information to adjust the display of graphical objects, ensuring that only relevant or visible elements are rendered. This improves user experience by preventing unnecessary rendering of obscured elements and optimizing system resources. The solution involves a non-transitory computer-readable medium storing instructions that, when executed, perform operations including determining the hinge angle and adjusting the GUI display accordingly. The hinge angle is a critical factor in determining whether a graphical object is included in the non-visible portion of the GUI, ensuring that the display adapts seamlessly to different hinge positions. This approach enhances functionality in foldable or multi-display devices by dynamically managing GUI elements based on physical device configuration.
Unknown
December 1, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.