Patentable/Patents/US-12100215
US-12100215

IP security camera combining both infrared and visible light illumination plus sensor fusion to achieve color imaging in zero and low light situations

Published
September 24, 2024
Technical Abstract

An apparatus includes a first light source, a second light source, an image sensor circuit, and a processing circuit. The first light source is generally capable of emitting infrared light. The second light source is generally capable of emitting visible light. The image sensor circuit is generally responsive to both the infrared light and the visible light. The processing circuit is generally coupled to the image sensor circuit and configured to generate an image comprising both infrared information and color information.

Patent Claims
15 claims

Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.

Claim 2

Original Legal Text

2. The apparatus according to claim 1, wherein said processing circuit is further configured to control turn on of said infrared light source and said visible light source.

Plain English Translation

This invention relates to an apparatus for controlling light sources, specifically infrared and visible light sources, to address challenges in lighting systems where coordinated activation of different light types is needed. The apparatus includes a processing circuit that manages the operation of both light sources, ensuring synchronized or independent control as required. The processing circuit is configured to regulate the power supply to the infrared and visible light sources, enabling precise activation and deactivation. This control may be used in applications such as imaging systems, security lighting, or environmental monitoring, where coordinated illumination is essential. The apparatus ensures efficient energy use and reliable performance by dynamically adjusting the light sources based on environmental conditions or user inputs. The processing circuit may also incorporate additional features, such as timing mechanisms or sensor feedback, to optimize light source operation. This invention improves upon existing systems by providing a unified control mechanism for multiple light sources, enhancing functionality and reducing complexity in lighting applications.

Claim 4

Original Legal Text

4. The apparatus according to claim 1, wherein said apparatus is configured as at least one of a doorbell camera, an exterior security camera, and an interior security camera.

Plain English Translation

This invention relates to a surveillance apparatus designed for monitoring and security applications. The apparatus includes a camera module for capturing video footage, a processing unit for analyzing the captured data, and a communication interface for transmitting the data to a remote device. The apparatus is specifically configured to function as a doorbell camera, an exterior security camera, or an interior security camera, depending on its deployment. The camera module may include features such as night vision, motion detection, and high-resolution imaging to enhance surveillance capabilities. The processing unit is capable of performing real-time analysis, such as detecting motion or recognizing faces, to trigger alerts or record events. The communication interface supports wireless or wired connectivity to ensure seamless data transmission to a monitoring system or user device. The apparatus may also include additional components like microphones for audio capture, speakers for two-way communication, and lighting for improved visibility. The design ensures versatility, allowing the apparatus to be installed in various locations for comprehensive security coverage. The invention addresses the need for reliable, multi-functional surveillance solutions that integrate seamlessly into residential or commercial security systems.

Claim 5

Original Legal Text

5. The apparatus according to claim 1, wherein said apparatus is configured as one or more of an interior monitoring camera configured to monitor a vehicle passenger compartment, an external short range camera configured to provide around vehicle monitoring, an automatic parking assistance camera, and a rear view camera.

Plain English Translation

This invention relates to a vehicle monitoring apparatus designed to enhance situational awareness and safety by providing visual data from multiple perspectives. The apparatus includes one or more cameras configured for different monitoring functions. One configuration is an interior monitoring camera that observes the vehicle passenger compartment, enabling features such as driver monitoring, occupant detection, or child presence alerts. Another configuration is an external short-range camera that provides around-vehicle monitoring, useful for detecting obstacles, pedestrians, or other hazards in close proximity to the vehicle. The apparatus may also function as an automatic parking assistance camera, aiding in parking maneuvers by providing real-time visual feedback to the driver or an automated parking system. Additionally, the apparatus can serve as a rear view camera, replacing or supplementing traditional rearview mirrors to improve visibility when reversing or changing lanes. The system integrates these camera functions into a unified apparatus, reducing complexity while expanding monitoring capabilities. This design supports advanced driver assistance systems (ADAS) and autonomous driving features by providing comprehensive visual data from multiple vantage points.

Claim 6

Original Legal Text

6. The apparatus according to claim 1, wherein said processing circuit is part of a camera system on chip.

Plain English Translation

A camera system on chip integrates a processing circuit designed to enhance image capture and processing capabilities. The processing circuit is configured to perform operations such as image signal processing, noise reduction, and image enhancement, all within a compact, single-chip architecture. This integration reduces the need for external components, improving efficiency and reducing power consumption. The system is particularly useful in applications requiring high-performance imaging in constrained environments, such as mobile devices, drones, and automotive cameras. By consolidating processing functions on a single chip, the system achieves faster data throughput and lower latency, enabling real-time image processing. The design also supports advanced features like high dynamic range (HDR) imaging, low-light enhancement, and computational photography techniques. The processing circuit may include specialized hardware accelerators for tasks like edge detection, object recognition, and image stabilization, further optimizing performance. This architecture simplifies system design, reduces manufacturing costs, and enhances reliability by minimizing interconnect complexity. The camera system on chip is adaptable to various imaging applications, from consumer electronics to industrial automation, where compact, high-performance imaging solutions are required.

Claim 7

Original Legal Text

7. The apparatus according to claim 1, further comprising a motion detection circuit coupled to said processing circuit and configured to activate said processing circuit in response to detecting motion in the monitored field of view.

Plain English Translation

This invention relates to an apparatus for monitoring a field of view, particularly for detecting and analyzing motion within that field. The apparatus includes a processing circuit that receives input from one or more sensors, such as cameras or other imaging devices, to analyze the monitored area. The processing circuit is configured to detect and track objects or changes within the field of view, enabling applications such as surveillance, security, or environmental monitoring. A key feature of the apparatus is a motion detection circuit that is coupled to the processing circuit. This motion detection circuit continuously monitors the field of view and triggers the processing circuit only when motion is detected. By activating the processing circuit in response to motion, the apparatus conserves power and computational resources, as the processing circuit remains idle when no activity is present. This selective activation ensures efficient operation, particularly in battery-powered or low-power applications. The motion detection circuit may use various techniques, such as frame differencing, background subtraction, or optical flow, to identify motion within the field of view. Once motion is detected, the processing circuit is activated to perform further analysis, such as object recognition, tracking, or alert generation. The apparatus may also include additional components, such as communication interfaces, to transmit alerts or data to external systems when motion is detected. This invention improves upon existing monitoring systems by reducing unnecessary processing and power consumption, making it suitable for long-term, unattended operation in security, automation, or environmental monitoring applications.

Claim 8

Original Legal Text

8. The apparatus according to claim 7, wherein said motion detection circuit comprises a passive infrared (PIR) sensor.

Plain English Translation

A motion detection apparatus is designed to monitor movement within a defined area, addressing the need for reliable and energy-efficient surveillance in security, automation, or environmental monitoring applications. The apparatus includes a motion detection circuit that identifies movement by detecting changes in infrared radiation, which is a passive and non-intrusive method of sensing. The motion detection circuit specifically incorporates a passive infrared (PIR) sensor, which is sensitive to variations in heat signatures caused by moving objects. The PIR sensor operates by comparing infrared radiation levels across multiple detection zones, triggering an output signal when significant changes are detected. This design allows for accurate motion detection without requiring active illumination or complex processing, making it suitable for low-power and cost-effective implementations. The apparatus may also include additional components, such as signal processing circuitry, to filter or amplify the sensor output, ensuring reliable detection under varying environmental conditions. The use of a PIR sensor provides advantages such as low power consumption, resistance to false triggers from ambient light, and the ability to detect motion over a wide area. This technology is particularly useful in applications where energy efficiency and simplicity are critical, such as battery-powered security systems or smart home devices.

Claim 9

Original Legal Text

9. The apparatus according to claim 1, wherein said apparatus is configured as a battery-powered camera.

Plain English Translation

A battery-powered camera system is designed to capture and transmit images or video wirelessly. The camera includes an imaging sensor to capture visual data, a wireless communication module to transmit the captured data to a remote device, and a battery to power the system. The camera may also include a motion detection sensor to trigger image capture when movement is detected, reducing power consumption by avoiding continuous operation. The wireless communication module may use protocols such as Wi-Fi, Bluetooth, or cellular networks to send data to a receiver, which could be a smartphone, computer, or cloud server. The battery is rechargeable and may include power-saving features to extend operational time. The camera may also incorporate a housing designed for outdoor use, with weather-resistant materials to protect against environmental conditions. The system may further include a local storage option to store images or video when wireless transmission is unavailable. The camera may be configured to operate in a low-power standby mode when not actively capturing or transmitting data, conserving battery life. The wireless communication module may also support two-way communication, allowing remote configuration or firmware updates. The camera may include a user interface, such as buttons or a touchscreen, for local control and setup. The system may be used for surveillance, wildlife monitoring, or remote inspection in environments where wired power or communication is impractical.

Claim 10

Original Legal Text

10. The apparatus according to claim 1, wherein said video processing pipeline of said processing circuit further comprises a facial analysis module configured to determine whether said object detected in said area of interest is a face and whether the face is a person matching one of a plurality of user profiles stored in a database of known faces.

Plain English Translation

This invention relates to video processing systems that analyze detected objects in a video frame to identify faces and match them against a database of known individuals. The system includes a processing circuit with a video processing pipeline that detects objects in an area of interest within a video frame. A facial analysis module within the pipeline determines whether the detected object is a face and then compares the face against stored user profiles in a database of known faces. The system is designed to enhance security, surveillance, or personalized user interactions by accurately identifying individuals in real-time video streams. The facial analysis module performs face detection and recognition, enabling the system to verify whether the detected face matches any of the pre-stored profiles. This allows for automated authentication, access control, or personalized responses based on recognized individuals. The invention improves upon existing systems by integrating face recognition directly into the video processing pipeline, reducing latency and improving accuracy in identifying known individuals. The database of known faces contains user profiles that include facial features and identifiers, enabling the system to perform rapid comparisons and confirm matches. This technology is particularly useful in applications requiring real-time face recognition, such as smart security systems, personalized digital assistants, or automated customer service kiosks.

Claim 11

Original Legal Text

11. The apparatus according to claim 10, wherein said processing circuit is further configured to determine a distance between said object and an RGB-IR image sensor generating said video surveillance data by applying one or more image processing operations on said video surveillance data.

Plain English Translation

This invention relates to video surveillance systems that use RGB-IR (Red-Green-Blue-Infrared) image sensors to monitor objects in a scene. The problem addressed is accurately determining the distance between an object and the surveillance sensor, which is crucial for applications like intrusion detection, perimeter security, and object tracking. Traditional methods often rely on separate depth-sensing hardware, increasing cost and complexity. The apparatus includes an RGB-IR image sensor that captures video surveillance data of a monitored area. A processing circuit analyzes this data using image processing techniques to estimate the distance between the object and the sensor. The processing circuit may apply operations such as stereo vision, depth estimation from monocular images, or infrared-based distance calculation. These techniques leverage the combined RGB and infrared data to improve accuracy without requiring additional hardware. The system can dynamically adjust surveillance parameters, such as focus or zoom, based on the computed distance, enhancing monitoring efficiency. This approach reduces reliance on external depth sensors while maintaining precise distance measurements, making it suitable for cost-effective and scalable surveillance solutions.

Claim 12

Original Legal Text

12. The apparatus according to claim 11, wherein said processing circuit is further configured to turn on said infrared light source in response to detection of said object in said monitored field of view and determine whether said object detected in said monitored field of view is closer than a predefined distance from said RGB-IR image sensor.

Plain English Translation

This invention relates to an apparatus for object detection and distance measurement using an infrared light source and an RGB-IR image sensor. The apparatus addresses the problem of accurately detecting objects within a monitored field of view and determining their proximity to the sensor. The apparatus includes an infrared light source and an RGB-IR image sensor configured to capture images of the monitored field of view. A processing circuit is included to analyze the captured images and detect objects within the field of view. The processing circuit is further configured to activate the infrared light source in response to detecting an object, enhancing visibility in low-light conditions. The apparatus then determines whether the detected object is closer than a predefined distance from the sensor, enabling applications such as security monitoring, proximity sensing, or automated systems requiring distance-based object detection. The system may also include a housing to protect the components and a power supply to provide necessary electrical power. The apparatus ensures reliable object detection and distance measurement, improving accuracy in various environmental conditions.

Claim 13

Original Legal Text

13. The apparatus according to claim 12, wherein said processing circuit is further configured to turn on said visible light source in response to said object detected in said monitored field of view being closer than said predefined distance from said RGB-IR image sensor.

Plain English Translation

This invention relates to an apparatus for object detection and visible light activation in a monitored field of view. The apparatus includes an RGB-IR image sensor that captures both visible and infrared images, an infrared light source for illuminating the field of view, and a visible light source. A processing circuit analyzes the sensor data to detect objects within the monitored area. When an object is detected within a predefined distance threshold from the sensor, the processing circuit activates the visible light source. The apparatus may also include a housing to enclose the components and a mounting mechanism for positioning the apparatus in a desired location. The system is designed to enhance visibility or alert users when objects approach within a specific proximity, which can be useful in security, automation, or safety applications. The predefined distance threshold can be adjusted based on application requirements, allowing flexibility in determining when the visible light should be triggered. The infrared light source ensures consistent illumination for accurate object detection, even in low-light conditions. The visible light activation provides a clear indication of detected objects, improving situational awareness.

Claim 14

Original Legal Text

14. The apparatus according to claim 13, wherein said processing circuit is further configured to turn on said visible light source to illuminate at least one of the face, a key pad, a touch pad, and a touch screen.

Plain English Translation

This invention relates to an apparatus for enhancing user interaction with electronic devices, particularly in low-light conditions. The apparatus includes a visible light source and a processing circuit. The processing circuit is configured to detect user proximity or activity, such as facial recognition, keypad input, touchpad interaction, or touchscreen engagement. Upon detecting such activity, the processing circuit activates the visible light source to illuminate the relevant interface component, such as the user's face, keypad, touchpad, or touchscreen. This illumination improves visibility and usability in dark environments, ensuring accurate input and interaction. The apparatus may also include additional sensors or circuits to optimize lighting conditions based on ambient light levels or user preferences. The invention addresses the problem of poor visibility in low-light scenarios, enhancing user experience and device functionality.

Claim 15

Original Legal Text

15. The apparatus according to claim 13, wherein said processing circuit is further configured to (i) perform video operations to increase resolution and zoom in on the area of interest, (ii) crop out a portion of the area of interest containing said face, (iii) generate a color image of the face, and (iv) perform face recognition operations on said color image.

Plain English Translation

This invention relates to video processing systems for enhancing and analyzing facial images within a video stream. The system addresses the challenge of accurately identifying faces in low-resolution or zoomed-out video footage, where facial features may be difficult to discern. The apparatus includes a processing circuit that performs several key operations to improve face recognition accuracy. First, the system increases the resolution of a specific area of interest within the video frame, allowing for a closer examination of the subject. Next, it crops out a portion of this area containing the face, isolating it from surrounding elements. The system then generates a high-quality color image of the face, ensuring that details such as skin tone, facial structure, and other distinguishing features are preserved. Finally, the apparatus performs face recognition operations on this enhanced color image, comparing it against a database of known faces to identify the individual. This process enables reliable face recognition even in challenging video conditions, improving security and surveillance applications. The system may also include additional components, such as a camera and a display, to capture and present the video stream.

Claim 16

Original Legal Text

16. The apparatus according to claim 15, wherein said processing circuit is further configured to determine access privileges of said person based upon said face recognition operations on said color image.

Plain English Translation

The invention relates to an apparatus for controlling access based on facial recognition. The apparatus includes a camera system that captures a color image of a person attempting to access a restricted area. A processing circuit analyzes the color image to perform face recognition operations, comparing the detected facial features against a database of authorized individuals. The processing circuit then determines the access privileges of the person based on the recognition results, granting or denying entry accordingly. The system may also include additional components such as a display for user interaction, a communication interface for transmitting access data, and a memory for storing facial recognition templates. The apparatus is designed to enhance security by automating access control through real-time facial recognition, reducing reliance on manual verification and improving accuracy. The use of color imaging ensures better feature detection compared to monochrome systems, particularly in varying lighting conditions. The invention addresses the need for secure, efficient, and scalable access control solutions in environments where identity verification is critical.

Claim 20

Original Legal Text

20. The method according to claim 19, further comprising determining access privileges of said person based upon said face recognition operations on said color image.

Plain English Translation

A system and method for facial recognition and access control involves capturing a color image of a person using a camera, processing the image to detect facial features, and performing face recognition operations to identify the person. The system then determines access privileges for the person based on the recognition results. This may include verifying identity against a database of authorized individuals, comparing facial features to stored templates, or analyzing facial expressions or other biometric data. The method can be used in security systems, authentication processes, or surveillance applications to grant or restrict access based on recognized identity. The system may also include additional steps such as adjusting camera settings, enhancing image quality, or integrating with external databases to improve recognition accuracy. The overall goal is to provide a secure and automated way to control access to physical or digital resources based on facial recognition.

Classification Codes (CPC)

Cooperative Patent Classification codes for this invention.

H04N
G06T
G06V
G06V
G06V
G06V
H04N
H04N
H04N
H04N
H04N
H04N
H04N
H04N
H04N
G06V
G06V
Patent Metadata

Filing Date

June 29, 2023

Publication Date

September 24, 2024

Want to Explore More Patents?

Discover thousands of AI-analyzed patents with comprehensive breakdowns, multimedia content, and expert insights.

IP security camera combining both infrared and visible light illumination plus sensor fusion to achieve color imaging in zero and low light situations