Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A method comprising: capturing, by a camera of a device, an image of a physical webpage mockup, the physical webpage mockup including at least a first physical object and a second physical object, the first physical object including a first visual indicator and the second physical object including a second visual indicator, the first visual indicator being different than the second visual indicator; storing, in a memory of the device, the image of the physical webpage mockup; accessing, from the memory of the device, the image of the physical webpage mockup; determining, based on the first visual indicator, a first virtual object represented by the first physical object; determining, based on the second visual indicator, a second virtual object represented by the second physical object, wherein the first virtual object and the second virtual object are visually presentable user interface elements; converting the physical webpage mockup captured in the image into a webpage based on the first physical object and the second physical object included in the image of the physical webpage mockup, the webpage including the first virtual object represented by the first physical object and the second virtual object represented by the second physical object, the first virtual object and the second virtual object arranged in the webpage in a layout corresponding to positions of the first physical object and the second physical object in the physical webpage mockup; searching, based on the first visual indicator and the second visual indicator, a database of predetermined visual indicators and corresponding interactive functions, yielding a search; determining, based on the search, that the first visual indicator corresponds to a first user interactive function, and the second visual indicator corresponds to a second user interactive function that is different than the first user interactive function; and applying the first user interactive function to the first virtual object in the webpage, and the second user interactive function to the second virtual object in the webpage.
This invention relates to a system for converting physical webpage mockups into interactive digital webpages. The technology addresses the challenge of rapidly prototyping and testing webpage designs by allowing designers to create physical mockups using tangible objects, which are then digitized and transformed into functional webpages. A camera captures an image of a physical webpage mockup composed of at least two physical objects, each marked with distinct visual indicators. These indicators differentiate the objects and define their corresponding virtual counterparts in the digital webpage. The system processes the image, identifies the objects based on their visual indicators, and maps them to specific virtual user interface elements. The virtual objects are then arranged in the webpage according to their positions in the physical mockup. The system further searches a database of predefined visual indicators to determine the interactive functions associated with each object. For example, one object may represent a button with a click function, while another may represent a text field with input capabilities. The system applies these functions to the corresponding virtual objects, resulting in a fully interactive webpage that mirrors the layout and functionality of the original physical mockup. This approach streamlines the design process by enabling quick iteration and testing of webpage prototypes without manual coding.
2. The method of claim 1 , wherein the first physical object is a physical cutout representative of at least one of: a menu bar, a text box, an image box, or a scroll bar.
This invention relates to user interface design, specifically methods for enhancing digital interfaces by incorporating physical cutouts that represent common interface elements. The problem addressed is the lack of tactile feedback and intuitive interaction in digital interfaces, which can reduce user efficiency and satisfaction. The solution involves using physical cutouts that correspond to digital interface elements like menu bars, text boxes, image boxes, or scroll bars. These cutouts provide a tangible reference point for users, improving navigation and interaction accuracy. The physical cutouts are designed to align with their digital counterparts, ensuring seamless integration between the physical and digital environments. This approach enhances user experience by bridging the gap between physical and digital interactions, making interfaces more intuitive and accessible. The method is particularly useful in applications where precise input or frequent interaction with specific interface elements is required, such as in design software, data entry systems, or interactive displays. By providing a physical representation of digital elements, the invention reduces cognitive load and minimizes errors, leading to more efficient and satisfying user experiences.
3. The method of claim 1 , wherein the first physical object is a magnetized object representative of at least one of: a menu bar, a text box, an image box, or a scroll bar.
This invention relates to interactive graphical user interfaces (GUIs) that use magnetized physical objects to represent and manipulate digital interface elements. The problem addressed is the lack of tactile feedback and physical interaction in traditional touchscreen or mouse-based interfaces, which can reduce user engagement and accessibility. The invention involves a system where physical objects, such as magnets, are used to interact with a digital display. These objects are magnetized and correspond to specific GUI elements like menu bars, text boxes, image boxes, or scroll bars. When a user moves or positions the magnetized object near or on a touch-sensitive or magnetically responsive display, the system detects its presence and adjusts the digital interface accordingly. For example, moving a magnetized object representing a scroll bar could scroll the screen, while placing a magnetized object representing a text box could activate a text input field. The magnetized objects provide tactile feedback, allowing users to physically manipulate digital elements, enhancing usability for tasks requiring precision or accessibility. The system may also include sensors to track the position and orientation of the magnetized objects, enabling dynamic interaction with the GUI. This approach bridges the gap between physical and digital interfaces, improving user experience in applications like design software, educational tools, or accessibility aids.
4. The method of claim 1 , wherein the first visual indicator is a first color pattern on the first physical object, and the second visual indicator is a second color pattern on the second physical object.
The invention relates to a system for identifying and distinguishing physical objects using visual indicators. The problem addressed is the need for a reliable and easily recognizable method to differentiate between multiple physical objects, particularly in environments where objects may be similar in appearance or function. The solution involves using distinct visual indicators, such as color patterns, applied to the surfaces of the objects to enable quick and accurate identification. The method includes a first physical object with a first color pattern and a second physical object with a second color pattern. The color patterns are designed to be visually distinct, allowing users or automated systems to quickly recognize and differentiate between the objects. The color patterns may include specific hues, gradients, or arrangements of colors that are easily distinguishable from one another. This approach ensures that even in low-light conditions or when objects are partially obscured, the visual indicators remain effective for identification purposes. The system may also include additional features, such as the use of contrasting colors or patterns that are resistant to fading or environmental degradation. The color patterns can be applied using various techniques, including printing, painting, or embedding, depending on the material and intended use of the objects. This method is particularly useful in industrial, medical, or logistical settings where quick and accurate object identification is critical.
5. The method of claim 1 , wherein the first visual indicator is a first shape associated with the first physical object, and the second visual indicator is a second shape associated with the second physical object.
This invention relates to a system for visually distinguishing physical objects in a shared environment, such as a workspace or collaborative setting. The problem addressed is the difficulty in quickly identifying and differentiating between multiple physical objects, especially when they are similar in appearance or when users need to track their status or ownership. The system uses visual indicators, such as shapes, to uniquely associate each physical object with a distinct marker. For example, a first physical object is linked to a first shape, while a second physical object is linked to a second shape. These shapes serve as clear, recognizable identifiers that help users quickly locate and distinguish between objects. The shapes may be displayed on a screen, projected onto the objects, or embedded in a digital interface that overlays the physical environment. The system may also include additional features, such as assigning different colors or patterns to further enhance visual differentiation. The shapes and other visual indicators can be dynamically updated based on changes in the environment, such as object movement or user interactions. This ensures that the visual markers remain accurate and useful in real-time scenarios. By providing a standardized and easily recognizable visual language, the system improves efficiency in environments where multiple objects must be managed, such as in manufacturing, logistics, or collaborative workspaces. The use of shapes as indicators ensures that the system is intuitive and requires minimal training for users to adopt.
6. The method of claim 1 , wherein converting the image into the webpage comprises: visually recognizing the first physical object and the second physical object in the image as corresponding to the first virtual object and the second virtual object; and automatically generating the first virtual object and the second virtual object in the layout of the webpage, the first virtual object and the second virtual object having positions in the layout of the webpage based on the positions of the first physical object and the second physical object in the image.
This invention relates to converting physical objects in an image into virtual objects within a webpage layout. The technology addresses the challenge of integrating real-world objects into digital interfaces by automating the recognition and placement of these objects in a webpage. The method involves capturing an image containing at least two physical objects. The system visually recognizes these objects and identifies them as corresponding to predefined virtual objects. The recognized objects are then automatically generated within the webpage layout, maintaining their relative positions from the original image. This ensures that the virtual objects appear in the webpage exactly where their physical counterparts were located in the image. The approach eliminates manual placement, streamlining the process of creating interactive or visually consistent webpages based on real-world references. The system may also include additional features such as adjusting object properties like size or orientation to optimize display within the webpage. This method is particularly useful in applications like augmented reality, e-commerce product displays, or interactive design tools where physical and digital elements must align seamlessly.
7. A computing device comprising: one or more computer processors; and one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the computing device to perform operations comprising: capturing, by a camera of the computing device, an image of a physical webpage mockup, the physical webpage mockup including at least a first physical object and a second physical object, the first physical object including a first visual indicator and the second physical object including a second visual indicator, the first visual indicator being different than the second visual indicator; storing the image of the physical webpage mockup; accessing the image of the physical webpage mockup; determining, based on the first visual indicator, a first virtual object represented by the first physical object; determining, based on the second visual indicator, a second virtual object represented by the second physical object, wherein the first virtual object and the second virtual object are visually presentable user interface elements; converting the physical webpage mockup captured in the image into a webpage based on the first physical object and the second physical object included in the image of the physical webpage mockup, the webpage including the first virtual object represented by the first physical object and the second virtual object represented by the second physical object, the first virtual object and the second virtual object arranged in the webpage in a layout corresponding to positions of the first physical object and the second physical object in the physical webpage mockup; searching, based on the first visual indicator and the second visual indicator, a database of predetermined visual indicators and corresponding interactive functions, yielding a search; determining, based on the search, that the first visual indicator corresponds to a first user interactive function, and the second visual indicator corresponds to a second user interactive function that is different than the first user interactive function; and applying the first user interactive function to the first virtual object in the webpage, and the second user interactive function to the second virtual object in the webpage.
This invention relates to a computing device that converts physical webpage mockups into interactive digital webpages. The technology addresses the challenge of rapidly prototyping and digitizing physical designs of webpages, which often require manual translation into digital formats. The system captures an image of a physical webpage mockup containing at least two physical objects, each marked with distinct visual indicators. These indicators differentiate the objects and their intended functions. The computing device processes the image, identifies the objects based on their visual indicators, and maps them to corresponding virtual user interface elements. The system then generates a digital webpage with these elements arranged according to their positions in the physical mockup. Additionally, the device searches a database to determine the interactive functions associated with each visual indicator, such as buttons, links, or input fields, and applies these functions to the respective virtual objects in the webpage. This automation streamlines the transition from physical design to functional digital prototypes, reducing development time and effort.
8. The computing device of claim 7 , wherein the first physical object is a physical cutout representative of at least one of: a menu bar, a text box, an image box, or a scroll bar.
This invention relates to computing devices with interactive physical interfaces, specifically those incorporating physical cutouts that represent user interface elements. The technology addresses the challenge of providing tactile feedback and intuitive interaction in digital systems by integrating physical components that correspond to on-screen elements. The computing device includes a display and a physical cutout that serves as a tangible representation of common user interface components such as menu bars, text boxes, image boxes, or scroll bars. The physical cutout is positioned relative to the display to align with the corresponding digital element, allowing users to interact with the physical cutout to manipulate the on-screen element. This approach enhances usability by providing a tactile reference point, reducing reliance on visual cues alone, and improving accessibility for users with visual impairments. The physical cutout may be movable or adjustable to accommodate different display configurations or user preferences. The system may also include sensors or actuators to detect and respond to user interactions with the physical cutout, enabling dynamic adjustments to the display or interface behavior. This invention aims to bridge the gap between physical and digital interactions, making computing devices more intuitive and user-friendly.
9. The computing device of claim 7 , wherein the first physical object is a magnetized object representative of at least one of; a menu bar, a text box, an image box, or a scroll bar.
This invention relates to computing devices that use magnetized physical objects to represent and interact with digital user interface elements. The technology addresses the challenge of providing intuitive, tactile control over digital interfaces, particularly in environments where traditional touchscreens or keyboards may be impractical or inefficient. The system includes a computing device with a sensor array capable of detecting the position and orientation of magnetized objects placed on or near its surface. These objects serve as physical representations of digital interface elements, such as menu bars, text boxes, image boxes, or scroll bars. When a user manipulates the magnetized object, the sensor array tracks its movement and translates it into corresponding actions within the digital interface. For example, moving a magnetized object representing a scroll bar would scroll the on-screen content. The system may also include a display that visually aligns with the physical objects to provide feedback, ensuring users can see the direct correlation between their physical actions and digital outcomes. This approach enhances accessibility and usability by bridging the gap between physical and digital interactions.
10. The computing device of claim 7 , wherein the first visual indicator is a first color pattern on the first physical object, and the second visual indicator is a second color pattern on the second physical object.
This invention relates to computing devices that interact with physical objects using visual indicators. The problem addressed is the need for computing devices to accurately identify and distinguish between multiple physical objects in a shared environment, such as augmented reality (AR) or robotics applications. The solution involves using distinct visual indicators on the objects to enable precise tracking and interaction. The computing device includes a camera system to capture images of the environment and a processor to analyze the visual indicators. The first physical object has a first color pattern, and the second physical object has a second color pattern. These patterns are visually distinct, allowing the computing device to differentiate between the objects. The processor processes the captured images to detect and recognize the color patterns, enabling the device to identify each object and determine their relative positions. This allows the computing device to perform actions based on the identified objects, such as manipulating them in an AR environment or guiding a robotic arm to interact with the correct object. The use of color patterns as visual indicators provides a simple yet effective way to distinguish objects, improving accuracy in object recognition and interaction. This approach is particularly useful in environments where multiple objects are present, ensuring reliable identification and interaction.
11. The computing device of claim 7 , wherein the first visual indicator is a first shape associated with the first physical object, and the second visual indicator is a second shape associated with the second physical object.
This invention relates to computing devices that visually represent physical objects in a digital environment. The problem addressed is the need for clear and intuitive visual distinctions between different physical objects when displayed on a computing device. The solution involves using distinct shapes as visual indicators to represent different physical objects, ensuring users can easily identify and differentiate them. The computing device includes a display and a processor configured to generate visual indicators for physical objects. The first visual indicator is a first shape associated with a first physical object, and the second visual indicator is a second shape associated with a second physical object. These shapes are displayed on the device to visually distinguish the objects. The shapes may be selected based on predefined associations or user preferences to enhance recognition. The system ensures that the shapes are distinct enough to avoid confusion, improving user interaction with the digital representation of physical objects. This approach is particularly useful in applications where multiple objects must be tracked or managed simultaneously, such as in augmented reality, inventory management, or smart home systems. The use of shapes as visual indicators provides a simple yet effective way to convey information without relying on text or complex graphics.
12. The computing device of claim 7 , wherein converting the image into the webpage comprises: visually recognizing the first physical object and the second physical object in the image as corresponding to the first virtual object and the second virtual object; and automatically generating the first virtual object and the second virtual object in the layout of the webpage, the first virtual object and the second virtual object having positions in the layout of the webpage based on the positions of the first physical object and the second physical object in the image.
A computing device processes an image to convert it into a webpage by recognizing physical objects in the image and generating corresponding virtual objects in the webpage layout. The device identifies a first physical object and a second physical object within the image and determines their positions. It then creates a first virtual object and a second virtual object in the webpage, placing them in positions that mirror the locations of the physical objects in the original image. This allows the webpage to visually replicate the arrangement of objects from the image, maintaining spatial relationships between them. The system automates the conversion process, eliminating manual placement of virtual objects. This technology is useful for applications where physical objects need to be digitally represented in a webpage while preserving their relative positions, such as in augmented reality, e-commerce product displays, or interactive design tools. The approach ensures accurate and efficient translation of physical layouts into digital formats.
13. A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processors of a computing device, cause the computing device to perform operations comprising: capturing, by a camera of the computing device, an image of a physical webpage mockup, the physical webpage mockup including at least a first physical object and a second physical object, the first physical object including a first visual indicator and the second physical object including a second visual indicator, the first visual indicator being different than the second visual indicator; storing the image of the physical webpage mockup; accessing the image of the physical webpage mockup; determining, based on the first visual indicator, a first virtual object represented by the first physical object; determining, based on the second visual indicator, a second virtual object represented by the second physical object, wherein the first virtual object and the second virtual object are visually presentable user interface elements; converting the physical webpage mockup captured in the image into a webpage based on the first physical object and the second physical object included in the image of the physical webpage mockup, the webpage including the first virtual object represented by the first physical object and the second virtual object represented by the second physical object, the first virtual object and the second virtual object arranged in the webpage in a layout corresponding to positions of the first physical object and the second physical object in the physical webpage mockup; searching, based on the first visual indicator and the second visual indicator, a database of predetermined visual indicators and corresponding interactive functions, yielding a search; determining, based on the search, that the first visual indicator corresponds to a first user interactive function, and the second visual indicator corresponds to a second user interactive function that is different than the first user interactive function; and applying the first user interactive function to the first virtual object in the webpage, and the second user interactive function to the second virtual object in the webpage.
This invention relates to a system for converting physical webpage mockups into interactive digital webpages using visual indicators. The problem addressed is the manual and time-consuming process of translating physical design mockups into functional digital interfaces. The solution involves capturing an image of a physical webpage mockup containing at least two physical objects, each marked with distinct visual indicators. These indicators are used to identify corresponding virtual objects and their interactive functions. The system processes the image to determine the layout of the virtual objects based on the positions of the physical objects in the mockup. It then searches a database to match the visual indicators with predefined interactive functions, such as buttons, links, or form fields. The system applies these functions to the virtual objects, creating a fully interactive webpage that mirrors the physical mockup's layout and functionality. This approach streamlines the transition from physical design to digital implementation, reducing development time and improving accuracy.
14. The non-transitory computer-readable medium of claim 13 , wherein the first physical object is a physical cutout representative of at least one of: a menu bar, a text box, an image box, or a scroll bar.
This invention relates to computer interfaces and the representation of physical objects in digital environments. The problem addressed is the need for intuitive, tactile interaction with digital interfaces, particularly in augmented or virtual reality systems where users may benefit from physical representations of digital elements. The invention involves a non-transitory computer-readable medium storing instructions that, when executed, cause a computing device to display a first physical object in a physical environment. This object is a tangible cutout that represents at least one of a menu bar, text box, image box, or scroll bar. The physical cutout is designed to be manipulated by a user, allowing for direct interaction with digital interface elements through physical means. The system may also display a second physical object, which could be a physical representation of a cursor or pointer, enabling precise control over the first object. The interaction between these objects allows users to perform actions such as selecting, dragging, or scrolling within a digital interface using physical gestures. The system may further include sensors or cameras to track the position and movement of the physical objects, ensuring accurate translation of physical actions into digital commands. This approach enhances user experience by bridging the gap between physical and digital interactions, making digital interfaces more accessible and intuitive.
15. The non-transitory computer-readable medium of claim 13 , wherein the first physical object is a magnetized object representative of at least one of; a menu bar, a text box, an image box, or a scroll bar.
This invention relates to a computer-implemented system for interacting with graphical user interface (GUI) elements using magnetized physical objects. The technology addresses the challenge of providing intuitive, tactile control over digital interfaces, particularly for users who may struggle with traditional input methods like touchscreens or keyboards. The system involves a non-transitory computer-readable medium storing instructions that, when executed, enable a computing device to recognize and respond to the movement of magnetized physical objects in proximity to a display. These objects represent specific GUI elements, such as menu bars, text boxes, image boxes, or scroll bars. When a magnetized object is moved near the display, the system detects its position and orientation, translating these into corresponding actions within the GUI. For example, moving a magnetized object vertically could scroll a page, while positioning it near a text box could activate input mode. The system leverages magnetic sensors or cameras to track the objects' movements, ensuring precise interaction without direct contact with the screen. This approach enhances accessibility, allowing users to manipulate digital interfaces through physical gestures, which can be particularly beneficial for individuals with motor impairments or those working in environments where touch input is impractical. The invention improves upon prior art by providing a more versatile and user-friendly method of interfacing with digital content.
16. The non-transitory computer-readable medium of claim 13 , wherein the first visual indicator is a first color pattern on the first physical object, and the second visual indicator is a second color pattern on the second physical object.
This invention relates to a system for visually distinguishing physical objects using color patterns. The problem addressed is the need for a clear and reliable method to identify and differentiate between multiple physical objects in a shared environment, such as in industrial, medical, or logistical settings where misidentification can lead to errors or inefficiencies. The system involves a non-transitory computer-readable medium storing instructions that, when executed, cause a processor to detect and analyze visual indicators on physical objects. Specifically, the first physical object is marked with a first color pattern, and the second physical object is marked with a second color pattern. These color patterns serve as unique identifiers, allowing the system to distinguish between the objects based on their visual characteristics. The system may further include a camera or imaging device to capture images of the objects and a processing unit to analyze the color patterns and determine the identity or status of each object. The color patterns may be designed to be easily distinguishable by both human operators and automated systems, ensuring accuracy in identification. This approach eliminates the need for complex labeling or electronic tracking methods, providing a simple yet effective solution for object differentiation. The system can be integrated into various applications, such as inventory management, assembly line monitoring, or medical device tracking, where quick and reliable object identification is critical.
17. The non-transitory computer-readable medium of claim 13 , wherein the first visual indicator is a first shape associated with the first physical object, and the second visual indicator is a second shape associated with the second physical object.
This invention relates to a system for visually distinguishing physical objects in an augmented reality (AR) environment. The problem addressed is the difficulty in identifying and differentiating multiple physical objects in AR displays, where overlapping or similar objects can cause confusion. The solution involves using distinct visual indicators, such as shapes, to represent different physical objects in the AR view. Each physical object is associated with a unique shape, allowing users to quickly recognize and track objects in real time. The system dynamically generates these visual indicators based on object detection and tracking data, ensuring accurate and persistent identification. The shapes are rendered in the AR display to overlay the corresponding physical objects, enhancing visual clarity and user interaction. The invention also includes methods for adjusting the visual indicators based on environmental factors, such as lighting conditions or object movement, to maintain visibility and usability. This approach improves object recognition in AR applications, particularly in scenarios involving multiple objects or complex environments.
18. The non-transitory computer-readable medium of claim 13 , wherein converting the image into the webpage comprises: visually recognizing the first physical object and the second physical object in the image as corresponding to the first virtual object and the second virtual object; and automatically generating the first virtual object and the second virtual object in the layout of the webpage, the first virtual object and the second virtual object having positions in the layout of the webpage based on the positions of the first physical object and the second physical object in the image.
This invention relates to computer vision and augmented reality systems for converting physical objects in an image into virtual objects in a webpage layout. The technology addresses the challenge of integrating real-world objects into digital interfaces by automating the recognition and placement of physical items within a webpage design. The system captures an image containing at least two physical objects and processes the image to identify these objects. Using visual recognition techniques, the system matches the physical objects to corresponding virtual objects stored in a database. The system then generates a webpage layout where the virtual objects are positioned based on the spatial arrangement of the physical objects in the original image. This ensures that the virtual objects appear in the same relative positions as their physical counterparts, maintaining visual consistency between the real and digital representations. The solution eliminates the need for manual placement of virtual objects in webpage design, streamlining the process of creating augmented reality or interactive web content. By automating object recognition and layout generation, the system enhances efficiency and accuracy in digital content creation. The technology is particularly useful for applications in e-commerce, virtual showrooms, and interactive advertising, where physical objects must be seamlessly integrated into digital environments.
Unknown
March 17, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.