Vehicle Vision System with Adjustable Computation and Data Compression

Content Provider	The Lens
Abstract	A vision system for a vehicle includes a camera having a camera processor operable to process image data captured by the camera. A central processor is disposed remote from the camera and is operable to process image data captured by the camera. The camera processor processes compressed image data and uncompressed image data and compares ROC curves for a given frame of image data to determine if the compression of that frame of image data has impact on processing of the image data. Responsive to determination that the compression of the frame has impact, the camera processor processes uncompressed data of that frame for a driver assist function and communicates a signal for the driver assist function. Responsive to determination that compression of the frame does not have impact, the vision system communicates compressed data of that frame for processing by the central processor for the driver assist function.
Related Links	https://www.lens.org/lens/patent/009-516-258-160-808/frontpage
Language	English
Publisher Date	2019-10-22
Access Restriction	Open
Content Type	Text
Resource Type	Patent
Jurisdiction	United States of America
Date Applied	2017-12-19
Agent	Honigman Llp
Applicant	Magna Electronics Inc
Application No.	201715846260
Claim	A vision system for a vehicle, said vision system comprising: a camera configured to be disposed at a vehicle so as to have, when disposed at the vehicle, a field of view exterior of the vehicle, wherein said camera comprises a camera processor operable to process image data captured by said camera; a central processor of the vehicle that, with said camera disposed at the vehicle, is disposed in the vehicle at a location separate from and remote from said camera and that is operable to process frames of image data captured by said camera; wherein image data captured by said camera and processed by said camera processor comprises compressed image data and uncompressed image data; wherein said camera processor processes compressed image data and uncompressed image data and generates respective receiver operating characteristic (ROC) curves; wherein said camera processor compares the ROC curves of the compressed image data and the uncompressed image data for a given frame of captured image data to determine if compression of image data of that frame of captured image data has impact on processing of captured image data, and wherein the impact is determined when a difference between the compared ROC curves of the compressed image data and uncompressed image data for the given frame of image data is greater than a threshold level; wherein, responsive to determination that compression of image data of the frame of captured image data has impact on the processing of image data, said camera processor processes the uncompressed image data of that frame of image data for a driver assist function and communicates a signal to said central processor for the driver assist function; and wherein, responsive to determination that compression of image data of the frame of captured image data does not have impact on the processing of image data, said vision system communicates compressed image data of that frame of image data to said central processor for processing by said central processor for the driver assist function. The vision system of claim 1 , wherein said vision system comprises multiple cameras. The vision system of claim 2 , wherein each of said cameras of said multiple cameras comprises a respective camera processor, and wherein each of said camera processors compares ROC curves of the compressed image data and uncompressed image data for a given frame of image data captured by that camera to determine if the compression of image data of that frame of image data has impact on processing of captured image data. The vision system of claim 3 , wherein, responsive to determination that compression of image data of the frame of image data captured by that respective camera does not have impact on processing of captured image data, said vision system communicates compressed image data of that frame of image data captured by that camera of said multiple cameras to said central processor for processing by said central processor for the driver assist function. The vision system of claim 1 , wherein said processors process captured image data via one or more algorithms. The vision system of claim 5 , wherein multiple algorithms are applied to image data captured by said camera by said camera processor and said central processor. The vision system of claim 6 , wherein said vision system comprises dynamic balancing of processing load when applying the algorithms. The vision system of claim 1 , wherein said vision system comprises dynamic balancing of the processing loads of said camera processor and said central processor. The vision system of claim 1 , wherein, responsive to determination that compression of image data of the frame of captured image data has impact on processing of captured image data, said vision system communicates compressed image data of that frame of image data to said central processor for further processing by said central processor for the driver assist function. The vision system of claim 9 , wherein the further processing by said central processor is done after processing of uncompressed image data of that frame of image data by said camera processor. A vision system for a vehicle, said vision system comprising: a camera configured to be disposed at a vehicle so as to have, when disposed at the vehicle, a field of view exterior of the vehicle, wherein said camera comprises a camera processor operable to process image data captured by said camera; a central processor of the vehicle that, with said camera disposed at the vehicle, is disposed in the vehicle at a location separate from and remote from said camera and that is operable to process frames of image data captured by said camera; wherein said vision system comprises dynamic balancing of processing load of said camera processor and said central processor; wherein each of said camera processor and said central processor processes captured image data via one or more algorithms; wherein image data captured by said camera and processed by said camera processor comprises compressed image data and uncompressed image data; wherein said camera processor processes compressed image data and uncompressed image data and generates respective receiver operating characteristic (ROC) curves; wherein said camera processor compares the ROC curves of the compressed image data and the uncompressed image data for a given frame of captured image data to determine if compression of image data of that frame of captured image data has impact on processing of captured image data, and wherein the impact is determined when a difference between the compared ROC curves of the compressed image data and uncompressed image data for the given frame of image data is greater than a threshold level; wherein, responsive to determination that compression of image data of the frame of captured image data has impact on the processing of image data, said camera processor processes the uncompressed image data of that frame of image data for a driver assist function and communicates a signal to said central processor for the driver assist function; and wherein, responsive to determination that compression of image data of the frame of captured image data does not have impact on the processing of image data, said vision system communicates compressed image data of that frame of image data to said central processor for processing by said central processor for the driver assist function. The vision system of claim 11 , wherein said vision system comprises multiple cameras. The vision system of claim 12 , wherein each of said cameras of said multiple cameras comprises a respective camera processor, and wherein each of said camera processors compares ROC curves of the compressed image data and uncompressed image data for a given frame of image data captured by that camera to determine if the compression of image data of that frame of image data has impact on processing of captured image data. The vision system of claim 13 , wherein, responsive to determination that compression of image data of the frame of image data captured by that respective camera does not have impact on processing of captured image data, said vision system communicates compressed image data of that frame of image data captured by that camera of said multiple cameras to said central processor for processing by said central processor for the driver assist function. A vision system for a vehicle, said vision system comprising: a camera configured to be disposed at a vehicle so as to have, when disposed at the vehicle, a field of view exterior of the vehicle, wherein said camera comprises a camera processor operable to process image data captured by said camera; a central processor of the vehicle that, with said camera disposed at the vehicle, is disposed in the vehicle at a location separate from and remote from said camera and that is operable to process frames of image data captured by said camera; wherein said vision system comprises dynamic balancing of the processing loads of said camera processor and said central processor; wherein image data captured by said camera and processed by said camera processor comprises compressed image data and uncompressed image data; wherein said camera processor processes compressed image data and uncompressed image data and generates respective receiver operating characteristic (ROC) curves; wherein said camera processor compares the ROC curves of the compressed image data and the uncompressed image data for a given frame of captured image data to determine if compression of image data of that frame of captured image data has impact on processing of captured image data, and wherein the impact is determined when a difference between the compared ROC curves of the compressed image data and uncompressed image data for the given frame of image data is greater than a threshold level; wherein, responsive to determination that compression of image data of the frame of captured image data has impact on the processing of image data, said camera processor (i) processes the uncompressed image data of that frame of image data for a driver assist function, (ii) communicates a signal to said central processor for the driver assist function, and (iii) communicates the compressed image data of that frame of image data to said central processor for further processing by said central processor for the driver assist function; and wherein, responsive to determination that compression of image data of the frame of captured image data does not have impact on the processing of image data, said vision system communicates compressed image data of that frame of image data to said central processor for processing by said central processor for the driver assist function. The vision system of claim 15 , wherein the further processing by said central processor is done after processing of uncompressed image data of that frame of image data by said camera processor. The vision system of claim 16 , wherein said processors process captured image data via one or more algorithms. The vision system of claim 15 , wherein said vision system comprises multiple cameras. The vision system of claim 18 , wherein each of said cameras of said multiple cameras comprises a respective camera processor, and wherein each of said camera processors compares ROC curves of the compressed image data and uncompressed image data for a given frame of image data captured by that camera to determine if the compression of image data of that frame of image data has impact on processing of captured image data. The vision system of claim 19 , wherein, responsive to determination that compression of image data of the frame of image data captured by that respective camera does not have impact on processing of captured image data, said vision system communicates compressed image data of that frame of image data captured by that camera of said multiple cameras to said central processor for processing by said central processor for the driver assist function.
CPC Classification	IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING Vehicles; Vehicle Fittings; Or Vehicle Parts; Not Otherwise Provided For Conjoint Control Of Vehicle Sub-Units Of Different Type Or Different Function;Control Systems Specially Adapted For Hybrid Vehicles;Road Vehicle Drive Control Systems For Purposes Not Related To The Control Of A Particular Sub-Unit Radio Direction-Finding;Radio Navigation;Determining Distance Or Velocity By Use Of Radio Waves;Locating Or Presence-Detecting By Use Of The Reflection Or Reradiation Of Radio Waves;Analogous Arrangements Using Other Waves SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES PICTORIAL COMMUNICATION; e.g. TELEVISION
Examiner	Xin Jia
Extended Family	006-647-201-372-683 009-516-258-160-808
Patent ID	10452076
Inventor/Author	May Benjamin Ihlenburg Joern Shulkin Boris
IPC	G06K9/00 B60R1/12 G01S17/86 G05D1/02 G06K9/03 H04N13/243
Status	Active
Owner	Magna Electronics Inc
Simple Family	006-647-201-372-683 009-516-258-160-808
CPC (with Group)	G06V20/56 G06V10/96 G06V10/993 B60R2001/1253 B60W30/00 G01S17/86 G05D1/0246 H04N13/243
Issuing Authority	United States Patent and Trademark Office (USPTO)
Kind	Patent/New European patent specification (amended specification after opposition procedure)