Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A frame rate conversion apparatus comprising: a detection unit configured to detect a degree of motion by comparing pixels in an image frame with pixels in another image frame; a generation unit configured to generate first and second sub-frames corresponding to the image frame such that the first sub-frame having a higher luminance is generated in a case where a first degree of motion smaller than a second degree of motion is detected in comparison with a case where the second degree of motion is detected, and the second sub-frame having a higher luminance than the first sub-frame is generated based on the difference between the first sub-frame and the image frame; and an output unit configured to output the first and second sub-frames generated by the generation unit.
Video processing. This invention addresses the problem of generating intermediate frames for smoother video playback when the original video has a lower frame rate than the display's capability. The apparatus includes a detection unit that analyzes consecutive image frames to determine the extent of motion between them. This motion detection is performed by comparing pixels across the frames. A generation unit then uses this motion information to create two new sub-frames. If a smaller degree of motion is detected, a first sub-frame with a higher luminance is generated. Conversely, if a larger degree of motion is detected, a different first sub-frame with a lower luminance is generated. Additionally, a second sub-frame is created based on the difference between the first sub-frame and the original image frame, and this second sub-frame has a higher luminance than the first sub-frame. Finally, an output unit transmits these generated first and second sub-frames. The differing luminance characteristics of the sub-frames, based on the detected motion, are intended to improve the visual quality of the converted frame rate video.
2. The apparatus according to claim 1 , wherein the detection unit acquires the difference between the pixel values in the image frame and the pixel values in the another image frame by the comparing and detects the degree of motion of the image frame, based on a total number of pixels having the difference exceeding a threshold.
The frame rate conversion apparatus described previously detects motion by comparing pixel values between consecutive image frames. The motion detection unit calculates the absolute difference between corresponding pixel values. The total number of pixels where this difference exceeds a predetermined threshold is used to determine the degree of motion. Higher counts of pixels exceeding the threshold mean more motion is present.
3. The apparatus according to claim 1 , wherein the detection unit acquires the difference between the pixel values in the image frame and pixel values in the another image frame by the comparing and detects the degree of motion of the image frame, based on a sum of difference values having the differences exceeding a threshold.
The frame rate conversion apparatus calculates motion by comparing pixel values between consecutive image frames. The motion detection unit calculates the absolute difference between corresponding pixel values. The sum of these difference values, but only for pixels where the difference exceeds a predetermined threshold, is used to determine the degree of motion. A higher sum indicates more motion.
4. The apparatus according to claim 1 , wherein when the degree of motion detected by the detection unit is smaller than the first degree of motion, the generation unit generates the first sub-frame having higher luminance than when the degree of motion detected by the detection unit is the first degree of motion.
In the frame rate conversion apparatus, the brightness of the first sub-frame adapts based on the amount of motion detected. When the motion detection unit detects very little motion (less than a predefined "first degree of motion"), the first sub-frame is made even brighter than it would be if just the "first degree of motion" were detected. This further accentuates brightness for very still images.
5. The apparatus according to claim 1 , wherein the output unit outputs the first sub-frame after outputting the second sub-frame.
In the frame rate conversion apparatus, the first and second sub-frames are outputted in a specific order: the second sub-frame is outputted before the first sub-frame. This output order helps manage the perceived changes in brightness and smooth the frame rate conversion result.
6. The apparatus according to claim 1 , further comprising: a determination unit configured to determine a coefficient in accordance with the degree of motion detected by the detection unit, wherein the determination unit determines a higher coefficient in a case where the detection unit detects the first degree of motion smaller than the second degree of motion in comparison with a case where the detection unit detects the second degree of motion, and wherein the generation unit generates the first sub-frame based on the coefficient determined by the determination unit.
The frame rate conversion apparatus incorporates a coefficient determination unit. This unit determines a scaling factor (coefficient) based on the degree of motion detected. Less motion results in a higher coefficient. The sub-frame generation unit then uses this coefficient to generate the first sub-frame. Higher coefficients for lower motion results in a brighter first sub-frame, contributing to the frame rate conversion process.
7. A frame rate conversion method comprising the steps of: detecting a degree of motion by comparing pixels in an image frame with pixels in another image frame; generating first and second sub-frames corresponding to the image frame such that the first sub-frame having higher luminance is generated in a case where a first degree of motion smaller than a second degree of motion is detected in comparison with a case where the second degree of motion is detected, and the second sub-frame having a higher luminance than the first sub-frame is generated based on the difference between the first sub-frame and the image frame; and outputting the first and second sub-frames generated by the generating step.
A frame rate conversion method for adjusting video frame rates works by first detecting motion. This involves comparing pixels in consecutive image frames. Two sub-frames are then generated. When less motion is detected, the first sub-frame is made brighter. The second sub-frame compensates for the difference in luminance between the first sub-frame and original frame. These two sub-frames are then output.
8. The method according to claim 7 , further comprising: determining a coefficient in accordance with the degree of motion detected by the detecting step, wherein the determining step determines a higher coefficient in a case where the detecting step detects the first degree of motion smaller than the second degree of motion in comparison with a case where the detecting step detects the second degree of motion, and wherein the generating step generates the first sub-frame based on the coefficient determined by the determining step.
The frame rate conversion method also uses a coefficient to adjust brightness based on motion. A coefficient is determined based on the degree of motion detected, so less motion will result in a higher coefficient. The first sub-frame is generated based on this coefficient. The coefficient is used to scale the brightness of the first sub-frame.
9. The method according to claim 7 , wherein the detecting step acquires difference between the pixel values in the image frame and the pixel values in the another image frame by the comparing, and detects the degree of motion of the image frame based on a total number of pixels having the difference exceeding a threshold.
The frame rate conversion method detects motion by comparing pixel values between consecutive frames. It calculates the absolute difference in pixel values, and if that difference exceeds a set threshold, it's counted towards determining motion. The total number of pixels exceeding the threshold is used to estimate motion; a higher count indicates more motion.
10. The method according to claim 7 , wherein the detecting step acquires the difference between the pixel values in the image frame and the pixel values in the another image frame by the comparing, and detects the degree of motion of the image frame based on a sum of difference values of pixels having the differences exceeding a threshold.
The frame rate conversion method detects motion by comparing pixel values between consecutive frames. It calculates the absolute difference in pixel values and sums these differences only for pixels where the difference exceeds a set threshold. This sum is then used to determine the degree of motion, with larger sums representing higher motion.
11. A non-transitory computer-readable storage medium storing a computer program of causing a computer incorporated in a frame rate conversion apparatus to function as: a motion detection unit configured to detect a degree of motion by comparing pixels in the image frame with pixels in another image frame, a generation unit configured to generate first and second sub-frames corresponding to the image frame such that the first sub-frame having higher luminance is generated in a case where a first degree of motion smaller than a second degree of motion is detected in comparison with in a case where the second degree of motion is detected, and the second sub-frame having a higher luminance than the first sub-frame is generated based on the difference between the first sub-frame and the image frame; and an output unit configured to output the first and second sub-frames generated by the generation unit.
A computer-readable storage medium (like a USB drive or hard drive) contains instructions that, when executed by a computer in a frame rate converter, performs these actions: Detecting motion between consecutive image frames by comparing pixels, generating two sub-frames, where the first sub-frame is brighter when there is less motion, and the second sub-frame makes up the brightness difference. The generated sub-frames are then output.
Unknown
September 23, 2014
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.