Optimized Histogram Computation for Adaptive Back Light Algorithm During Camera Preview and Video Playback

Content Provider	The Lens
Abstract	Methods, systems, and devices for image processing are described. Generally, the described techniques provide for capturing, at a sensor of a device, an image frame including frame composition data, generating histogram metadata for the image frame, encoding the histogram metadata as supplemental enhancement information (SEI) for the image frame, receiving, at a display post-processing module of the device, the image frame and the histogram metadata, computing, by the display post-processing module of the device, a target display setting for the image frame based at least in part on the histogram metadata; and outputting the image frame to a display based at least in part on the computed display setting.
Related Links	https://www.lens.org/lens/patent/011-545-245-256-610/frontpage
Language	English
Publisher Date	2019-07-30
Access Restriction	Open
Content Type	Text
Resource Type	Patent
Jurisdiction	United States of America
Date Applied	2018-08-01
Agent	Holland & Hart Llp
Applicant	Qualcomm Inc
Application No.	201816052167
Claim	A method for image processing at a device, comprising: capturing, at a sensor of the device, an image frame including frame composition data; generating histogram metadata for the image frame; encoding the histogram metadata as supplemental enhancement information (SEI) for the image frame; receiving, at a display post-processing module of the device, the image frame and the histogram metadata; computing, by the display post-processing module of the device, a target display setting for the image frame based at least in part on the histogram metadata; and outputting the image frame to a display based at least in part on the computed display setting. The method of claim 1 , wherein receiving the image frame and the histogram metadata further comprises: receiving a buffer handle indicating a buffer including a preview path for the image frame, the buffer handle including the histogram metadata. The method of claim 1 , wherein receiving the image frame and the histogram metadata further comprises: receiving a camera preview video buffer or a recording buffer, the camera preview video buffer or the recording buffer including the histogram metadata. The method of claim 1 , wherein encoding the histogram metadata as SEI further comprises: embedding the histogram metadata in a user data SEI network abstraction layer (NAL) of an encoded bit stream for a camera video record mode. The method of claim 4 , further comprising: playing media from the encoded bit stream; wherein receiving the image frame and the histogram metadata further comprises extracting, by a video decoder, the histogram metadata from the user data SEI NAL of the encoded bit stream. The method of claim 1 , wherein the target display setting is one or more of: a backlight setting, a pixel tone mapping setting, or a brightness setting. The method of claim 1 , wherein the image frame is one of a set of consecutive frames in a camera preview during a camcorder recording. The method of claim 1 , wherein the image frame is one of a set of consecutive frames in a video playback of a recorded clip. An apparatus for image processing at a device, comprising: a processor, memory in electronic communication with the processor; and instructions stored in the memory and executable by the processor to cause the apparatus to: capture, at a sensor of the device, an image frame including frame composition data; generate histogram metadata for the image frame; encode the histogram metadata as supplemental enhancement information (SEI) for the image frame; receive, at a display post-processing module of the device, the image frame and the histogram metadata; compute, by the display post-processing module of the device, a target display setting for the image frame based at least in part on the histogram metadata; and output the image frame to a display based at least in part on the computed display setting. The apparatus of claim 9 , wherein the instructions to receive the image frame and the histogram metadata further are executable by the processor to cause the apparatus to: receive a buffer handle indicating a buffer including a preview path for the image frame, the buffer handle including the histogram metadata. The apparatus of claim 9 , wherein the instructions to receive the image frame and the histogram metadata further are executable by the processor to cause the apparatus to: receive a camera preview video buffer or a recording buffer, the camera preview video buffer or the recording buffer including the histogram metadata. The apparatus of claim 9 , wherein the instructions to encode the histogram metadata as SEI further are executable by the processor to cause the apparatus to: embed the histogram metadata in a user data SEI network abstraction layer (NAL) of an encoded bit stream for a camera video record mode. The apparatus of claim 12 , wherein the instructions are further executable by the processor to cause the apparatus to: play media from the encoded bit stream; wherein receiving the image frame and the histogram metadata further comprises extracting, by a video decoder, the histogram metadata from the user data SEI NAL of the encoded bit stream. The apparatus of claim 9 , wherein the target display setting is one or more of a backlight setting, a pixel tone mapping setting, or a brightness setting. The apparatus of claim 9 , wherein the image frame is one of a set of consecutive frames in a camera preview during a camcorder recording. The apparatus of claim 9 , wherein the image frame is one of a set of consecutive frames in a video playback of a recorded clip. A non-transitory computer-readable medium storing code for image processing at a device, the code comprising instructions executable by a processor to: capture, at a sensor of the device, an image frame including frame composition data; generate histogram metadata for the image frame; encode the histogram metadata as supplemental enhancement information (SEI) for the image frame; receive, at a display post-processing module of the device, the image frame and the histogram metadata; compute, by the display post-processing module of the device, a target display setting for the image frame based at least in part on the histogram metadata; and output the image frame to a display based at least in part on the computed display setting. The non-transitory computer-readable medium of claim 17 , wherein the instructions to receive the image frame and the histogram metadata further are executable to: receive a buffer handle indicating a buffer including a preview path for the image frame, the buffer handle including the histogram metadata. The non-transitory computer-readable medium of claim 17 , wherein the instructions to receive the image frame and the histogram metadata further are executable to: receive a camera preview video buffer or a recording buffer, the camera preview video buffer or the recording buffer including the histogram metadata. The non-transitory computer-readable medium of claim 17 , wherein the instructions to encode the histogram metadata as SEI further are executable to: embed the histogram metadata in a user data SEI network abstraction layer (NAL) of an encoded bit stream for a camera video record mode.
CPC Classification	PICTORIAL COMMUNICATION; e.g. TELEVISION
Examiner	Robert Chevalier
Extended Family	011-545-245-256-610
Patent ID	10368030
Inventor/Author	Kurapaty Rajeshwar Deepala Venkata Nagarjuna Sravan Kumar Gorle Srinu
IPC	H04N9/80 H04N5/77 H04N5/775 H04N5/92
Status	Inactive
Owner	Qualcomm Incorporated
Simple Family	011-545-245-256-610
CPC (with Group)	H04N5/772 H04N9/8205 H04N5/9201 H04N5/77 H04N5/775
Issuing Authority	United States Patent and Trademark Office (USPTO)
Kind	Patent/Patent 1st level of publication/Inventor's certificate