Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A system comprising: at least one processor; and memory coupled to the at least one processor, the memory comprising computer executable instructions that, when executed by the at least one processor, performs a method comprising: receiving a selection of an element of a user interface; in response to receiving the selection, automatically activating a plurality of input receiving modes associated with the element, wherein the plurality of input receiving modes includes a microphone mode and at least one of a hardware keyboard mode or a touchscreen keyboard mode; displaying, by the user interface, an example input for at least one of the plurality of input receiving modes; and when speech input is received using at least one of the plurality of input receiving modes, removing the example input from the user interface.
This invention relates to user interface interaction and specifically addresses the problem of efficiently capturing diverse input types for a selected user interface element. The system includes a processor and memory containing instructions. When executed, these instructions enable the user interface to receive a selection of an element. Upon selection, the system automatically activates multiple input receiving modes for that element. These modes include a microphone mode for voice input and at least one of a hardware keyboard mode or a touchscreen keyboard mode for text input. The user interface then displays an example input relevant to at least one of these activated modes. Once speech input is received through any of the activated input receiving modes, the displayed example input is removed from the user interface. This streamlines the input process by proactively offering relevant input methods and dynamically updating the display based on user interaction.
2. The system of claim 1 , the method further comprising: identifying a type of the selected element.
A system and method for analyzing and processing elements within a digital environment, such as a document, image, or software interface, to improve user interaction and automation. The system addresses the challenge of efficiently categorizing and handling diverse elements, such as text, images, or interactive components, to enhance functionality and user experience. The method involves selecting an element from a digital interface and further includes identifying the type of the selected element, such as distinguishing between text, an image, a button, or another interactive component. This classification enables the system to apply appropriate processing techniques, such as optical character recognition (OCR) for text, image recognition for visual elements, or action triggers for interactive components. By accurately identifying element types, the system can automate tasks, improve accessibility, and streamline workflows in applications like document processing, user interface automation, or data extraction. The method ensures that each element is processed according to its specific characteristics, enhancing the system's adaptability and efficiency in handling varied digital content.
3. The system of claim 2 , wherein the plurality of input receiving modes is based on the type of the selected element.
A system for user interaction with digital interfaces improves input handling by dynamically adjusting input modes based on the type of selected interface elements. The system operates in the domain of human-computer interaction, addressing inefficiencies in traditional input methods that require users to manually switch between different input modes (e.g., text entry, selection, or gesture-based commands). The system automatically selects an appropriate input mode based on the type of element a user interacts with, such as text fields, buttons, or interactive graphics, reducing user effort and improving workflow efficiency. The system includes a user interface with multiple selectable elements, each having a predefined type (e.g., text input, checkbox, or drag-and-drop target). When a user selects an element, the system identifies its type and activates a corresponding input mode. For example, selecting a text field may trigger a keyboard input mode, while selecting a draggable object may enable gesture-based movement controls. The system may also support multiple input modes simultaneously, allowing users to switch between them seamlessly based on context. This adaptive approach minimizes errors and streamlines interactions, particularly in complex applications where users frequently switch between different tasks. The system enhances usability by reducing cognitive load and improving response time, making it suitable for applications in software interfaces, mobile devices, and interactive displays.
4. The system of claim 2 , wherein the example displayed is based on the type of the selected element.
A system for displaying examples in a user interface is designed to enhance user interaction by providing contextually relevant examples. The system operates within a software development or configuration environment where users select elements such as code snippets, UI components, or configuration parameters. When a user selects an element, the system dynamically generates and displays an example that is tailored to the type of the selected element. For instance, if the user selects a programming function, the system may display a code example demonstrating how to use that function. If the user selects a UI component, the system may display a visual example of how that component appears in a user interface. The system improves usability by reducing the need for users to search for or guess how to use a selected element, thereby accelerating development and configuration tasks. The examples are generated based on predefined templates or dynamically constructed from existing data, ensuring relevance and accuracy. This approach minimizes errors and enhances productivity by providing immediate, context-specific guidance.
5. The system of claim 1 , wherein the microphone mode includes a full dictation mode and a keyword identification mode.
A system for audio processing includes a microphone configured to operate in multiple modes to capture and process audio signals. The microphone modes include a full dictation mode, which records continuous speech for transcription or voice command processing, and a keyword identification mode, which selectively captures specific spoken keywords or phrases while ignoring other audio. The system may also include a processor that analyzes the captured audio to identify keywords or convert speech to text, depending on the active mode. The microphone may switch between modes automatically based on detected audio patterns or user input, optimizing power consumption and processing efficiency. The system can be integrated into devices such as smartphones, smart speakers, or wearable devices to enhance voice interaction capabilities. The keyword identification mode reduces unnecessary processing by focusing on relevant audio segments, while the full dictation mode ensures comprehensive capture for tasks requiring full transcription. The system may further include noise suppression and beamforming techniques to improve audio clarity in both modes.
6. The system of claim 1 , wherein activating the plurality of input receiving modes comprises displaying, on the user interface, one or more indications of an activated input receiving mode.
A system for enhancing user interaction with a device includes a user interface and a processor configured to activate multiple input receiving modes. These modes allow the device to process different types of user inputs, such as touch, gesture, or voice commands. The system dynamically adjusts the input modes based on context, such as the application being used or environmental conditions. For example, in a noisy environment, the system may prioritize touch or gesture inputs over voice commands. The processor also monitors user behavior to predict and pre-activate the most likely input modes, improving responsiveness. To inform the user, the system displays visual indicators on the user interface, such as icons or highlights, to show which input modes are currently active. This ensures the user knows how to interact with the device at any given time. The system may also include feedback mechanisms, such as haptic or auditory signals, to confirm input mode changes. The goal is to provide a seamless and intuitive user experience by adapting to different usage scenarios while keeping the user informed of available input options.
7. The system of claim 6 , wherein one or more indications comprise at least one of: a touchscreen keyboard, an animation, or a microphone icon.
A system for enhancing user interaction with a computing device addresses the problem of inefficient or unclear input methods, particularly in environments where traditional input mechanisms are impractical or confusing. The system provides a user interface that includes one or more visual or auditory indications to guide input actions. These indications may take the form of a touchscreen keyboard, an animation, or a microphone icon, each serving as a distinct input method. The touchscreen keyboard allows for direct text entry via on-screen keys, while animations provide dynamic visual feedback to assist users in understanding available actions. The microphone icon enables voice-based input, allowing users to interact with the device hands-free. These indications are integrated into the interface to improve usability, accessibility, and efficiency, particularly in scenarios where physical keyboards or other input devices are unavailable or inconvenient. The system dynamically adapts to user preferences and environmental conditions, ensuring optimal input methods are presented based on context. This approach reduces user frustration and enhances overall interaction quality.
8. The system of claim 7 , wherein a visual effect is applied to the one or more indications when the input is received.
A system for user interface interaction includes a display device and a processor. The system generates one or more indications on the display device, where each indication corresponds to a selectable element. The system detects an input, such as a touch or gesture, and determines whether the input is associated with one of the indications. When the input is received, a visual effect is applied to the one or more indications to provide feedback to the user. The visual effect may include changes in color, size, opacity, or other visual properties to highlight the selected indication or group of indications. The system may also adjust the visual effect based on the type or duration of the input, enhancing user interaction by dynamically modifying the display in response to user actions. This improves user experience by providing clear, real-time feedback during interaction with the interface.
9. The system of claim 6 , wherein, when the input is received using at least one of the plurality of input receiving modes, an unused input receiving mode of the plurality of input receiving modes is deactivated.
A system is provided for managing multiple input receiving modes in a computing device. The system addresses the problem of inefficient resource usage when multiple input modes (e.g., touch, voice, gesture, or keyboard) are active simultaneously, leading to unnecessary power consumption and processing overhead. The system dynamically deactivates unused input modes when an input is received via one of the active modes, optimizing system performance. For example, if a user provides input via a touchscreen, the system may deactivate voice recognition or gesture detection to conserve resources. The system includes a controller that monitors input activity and selectively disables inactive modes based on predefined criteria, such as user preferences or system load. This ensures that only the necessary input modes remain active, reducing energy consumption and improving responsiveness. The system may also reactivate deactivated modes when needed, such as when a different input mode is required or when the user switches tasks. The solution is particularly useful in portable devices where power efficiency is critical.
10. The system of claim 9 , wherein deactivating the unused input receiving mode comprises removing, from the user interface, at least one of the one or more indications.
A system for managing input modes in a user interface reduces unnecessary visual clutter by dynamically adjusting displayed indications based on usage. The system operates in a computing environment where multiple input modes (e.g., keyboard, touch, voice) are available but not all are actively used. The system monitors which input modes are currently in use and deactivates unused modes by removing their corresponding visual indicators from the user interface. This ensures that only relevant input options are displayed, improving user experience by minimizing distractions and streamlining the interface. The system may also restore the removed indications when the unused input modes are reactivated, ensuring seamless transitions between modes. This approach is particularly useful in applications where input methods frequently change, such as in multimedia editing or accessibility tools, where reducing visual noise enhances usability. The system dynamically adapts the interface to the user's current needs, optimizing both functionality and aesthetics.
11. The system of claim 1 , the method further comprising: processing the received input, wherein the processing may comprise providing the received input to a recognition service; receiving, from the recognition service, a response; and displaying, by the user interface, the response.
This invention relates to a system for processing and displaying input data, particularly in applications involving user interaction with a recognition service. The system addresses the challenge of efficiently handling user-provided input, such as text, speech, or other forms of data, and generating a meaningful response through automated recognition and analysis. The system includes a user interface for receiving input from a user, which may be in various forms such as typed text, spoken words, or other input modalities. The received input is then processed by providing it to a recognition service, which analyzes the input to extract relevant information or perform a specific task. The recognition service may involve natural language processing, speech recognition, image recognition, or other forms of automated analysis. After processing, the recognition service generates a response, which is then transmitted back to the system. The system subsequently displays this response through the user interface, allowing the user to view or interact with the processed information. The system may also include additional components, such as a data storage module for retaining input or response data, a communication interface for transmitting data to external services, and a processing unit for managing the overall workflow. The recognition service may be integrated within the system or accessed as an external service via an application programming interface (API). The displayed response can be formatted or presented in a user-friendly manner, depending on the type of input and the capabilities of the recognition service. This system enhances user interaction by automating the processing of input data and providing timely, accurate responses.
12. A device comprising: at least one processor; and memory coupled to the at least one processor, the memory comprising computer executable instructions that, when executed by the at least one processor, performs a method comprising: receiving, by a user interface of the device, a selection of a user interface element; in response to receiving the selection, automatically activating a plurality of input receiving modes associated with the user interface element, wherein the plurality of input receiving modes includes a microphone mode and at least one of a gesture detection mode or a touchscreen mode; displaying, by the user interface, an example input for at least one of the plurality of input receiving modes; and when speech input is received using at least one of the plurality of input receiving modes, removing the example input from the user interface.
This invention relates to a device with a user interface that supports multiple input modes for interacting with user interface elements. The device includes at least one processor and memory storing executable instructions. When a user selects a user interface element, the device automatically activates multiple input modes, including microphone mode for voice input and at least one of gesture detection or touchscreen mode for physical input. The user interface displays example inputs to guide the user, such as a sample voice command or gesture. If the user provides speech input through any of the activated modes, the example input is removed from the interface. This system enhances user interaction by dynamically adapting to different input methods, reducing ambiguity and improving accessibility. The device may be a smartphone, tablet, or other computing system with a touchscreen or gesture recognition capabilities. The invention addresses the challenge of providing flexible and intuitive input methods for users, particularly in scenarios where traditional touch or keyboard input may be inconvenient or impractical.
13. The device of claim 12 , further comprising: identifying a type of the selected user interface element.
A system for enhancing user interface interactions includes a device that detects user input directed at a user interface element, such as a button, text field, or menu. The device analyzes the input to determine its characteristics, such as duration, pressure, or gesture type, and processes this data to generate a response. The response may include modifying the user interface element's appearance, triggering an action, or providing feedback. The device also identifies the type of the selected user interface element to tailor the response accordingly. For example, selecting a button may trigger a function, while selecting a text field may activate a keyboard. The system improves user experience by dynamically adapting to different input types and interface elements, reducing errors and increasing efficiency. The device may operate on various platforms, including mobile devices, desktops, or embedded systems, and supports multi-modal inputs like touch, voice, or gestures. The invention addresses the problem of generic input handling in user interfaces, which often leads to inconsistent or unintuitive interactions. By dynamically adjusting responses based on input characteristics and element type, the system provides a more responsive and personalized user experience.
14. The device of claim 13 , wherein the plurality of input receiving modes selected for activation is based on the type of the selected user interface element.
A system for dynamically adjusting input receiving modes in a user interface device is disclosed. The device includes a display for presenting a user interface with multiple selectable elements, such as buttons, sliders, or text fields. The device also includes an input detection module that identifies user interactions with these elements, such as touch, gesture, or voice commands. The system further includes a mode selection module that activates one or more input receiving modes based on the type of the selected user interface element. For example, a button may activate a touch-based mode, while a text field may activate a keyboard or voice input mode. The device also includes a feedback module that provides visual, auditory, or haptic feedback to confirm the selected input mode. The system ensures that the appropriate input method is available for each user interface element, improving usability and reducing errors. The device may also include a learning module that adapts the input modes over time based on user behavior, further optimizing the interaction experience. This approach enhances accessibility and efficiency in user interface interactions.
15. The device of claim 13 , wherein the example displayed is at least one of input previously entered by a user of the device or input commonly entered for the type of the selected user interface element.
This invention relates to user interface (UI) design tools that assist users in creating or modifying digital interfaces. The problem addressed is the difficulty users face in designing UI elements, such as text fields, buttons, or dropdown menus, without clear guidance on appropriate input formats or examples. The invention provides a device that dynamically displays relevant examples to guide users when interacting with UI elements. These examples are either previously entered by the user or commonly used inputs for the selected UI element type. The device includes a display for showing the UI element and the example, an input interface for user interaction, and a processor that determines the appropriate example based on the user's selection. The system enhances usability by reducing errors and improving efficiency in UI design by providing contextually relevant input suggestions. The invention is particularly useful in software development environments, design tools, and applications where user input is required for UI customization. The dynamic example display adapts to the user's actions, ensuring the suggestions remain relevant throughout the design process.
16. The device of claim 12 , wherein activating the plurality of input receiving modes comprises displaying, on the user interface, one or more indications of an activated input receiving mode.
A device is disclosed for enhancing user interaction with a touch-sensitive display. The device includes a touch-sensitive display configured to detect touch inputs and a processor coupled to the display. The processor is configured to activate multiple input receiving modes, such as touch, gesture, or stylus input modes, based on user preferences or contextual conditions. When a mode is activated, the device displays visual indicators on the user interface to inform the user of the active mode. These indicators may include icons, labels, or other visual cues that correspond to the specific input mode in use. The device may also adjust display settings, such as sensitivity or response thresholds, to optimize performance for the selected input mode. The system ensures users are aware of the current input mode, reducing errors and improving interaction efficiency. The invention addresses the need for clear feedback in multi-modal input systems, particularly in environments where different input methods are frequently switched.
17. A method comprising: receiving a selection of an element of a user interface; in response to receiving the selection, automatically activating a plurality of input receiving modes associated with the element, wherein the plurality of input receiving modes includes a microphone mode and at least one of a image detection mode or a gesture detection mode; displaying, by the user interface, an example input for at least one of the plurality of input receiving modes; and when speech input is received using at least one of the plurality of input receiving modes, removing the example input from the user interface.
The invention relates to user interface systems that enhance input flexibility by automatically activating multiple input modes upon selecting an element. The problem addressed is the inefficiency of requiring users to manually switch between different input methods (e.g., voice, image, or gesture) when interacting with a user interface. The solution involves a method where selecting an interface element triggers the simultaneous activation of multiple input modes, including microphone mode and at least one of image detection or gesture detection. The system displays example inputs for these modes to guide the user, and when speech input is detected, the example inputs are removed to streamline the interface. This approach reduces user effort by eliminating the need to manually configure input methods, improving interaction efficiency. The invention is applicable in applications requiring versatile input handling, such as virtual assistants, multimedia editing, or accessibility tools.
18. The method of claim 17 , the method further comprising: identifying a type of the selected element.
A system and method for analyzing and processing elements within a digital document or data structure involves selecting an element from a set of elements, where the elements may include text, images, or other data objects. The method further includes identifying the type of the selected element, such as distinguishing between text, an image, a hyperlink, or another data type. This classification allows for tailored processing based on the element's characteristics. For example, text elements may undergo natural language processing, while image elements may be analyzed for visual features. The method may also involve extracting metadata or attributes associated with the element, such as formatting, size, or source information, to enhance further analysis or manipulation. The system may apply rules or algorithms specific to the identified type to optimize processing efficiency and accuracy. This approach improves the handling of diverse digital content by dynamically adapting to the nature of each element, ensuring more precise and context-aware operations. The method is particularly useful in applications like document parsing, data extraction, and automated content management, where accurate element classification is critical for downstream tasks.
19. The method of claim 17 , wherein a visual effect is applied to the user interface when the input is received by at least one of the plurality of input receiving modes.
A method for enhancing user interaction with a user interface involves applying a visual effect when input is received through one or more input modes. The user interface is designed to receive input from multiple input modes, such as touch, gesture, voice, or other forms of interaction. When input is detected by any of these modes, a visual effect is triggered to provide feedback to the user. This visual effect may include animations, color changes, or other graphical enhancements that indicate the system has recognized the input. The method ensures that users receive immediate and clear feedback, improving the responsiveness and intuitiveness of the interface. By applying the visual effect in response to input from any of the supported modes, the system maintains consistency in user experience across different interaction methods. This approach helps users understand the system's state and confirms their actions, reducing errors and enhancing usability. The visual effect can be customized based on the type of input or the context of the interaction, further refining the user experience.
20. The method of claim 17 , the method further comprising: providing the received input to an input recognition service; receiving, from the input recognition service, a response; and displaying, by the user interface, the response.
This invention relates to a system for processing and displaying user input, particularly in environments where input recognition is required. The problem addressed is the need for efficient and accurate handling of user-provided input, such as text or voice commands, to generate and display relevant responses. The method involves receiving input from a user through a user interface, which may include a graphical or voice-based interface. The input is then provided to an input recognition service, which processes the input to generate a meaningful response. The recognition service may involve natural language processing, speech recognition, or other forms of input interpretation. The processed response is then received and displayed back to the user through the same or a different user interface, ensuring the user receives timely and accurate feedback. The system may also include additional steps, such as validating the input before processing, formatting the response for display, or integrating the response with other system functions. The method ensures seamless interaction between the user and the system, improving usability and efficiency in applications like virtual assistants, chatbots, or automated customer service platforms. The invention enhances user experience by reducing latency and improving the accuracy of input recognition and response generation.
Unknown
December 15, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.