# IMX377 M12 Sensor Over saturated on G channel

Source: https://forum.modalai.com/topic/40/imx377-m12-sensor-over-saturated-on-g-channel
Category: ESCs, Sensors and Accessories (https://forum.modalai.com/category/15/escs-sensors-and-accessories)
Tags: image-sensor
Posted: 2020-11-04 17:04:46 UTC by Bobby Bukovec
Replies: 20 · Views: 6353

## Bobby Bukovec · 2020-11-04 17:04:46 UTC

Hello,

We have used all three of Modal AI's Hires sensors:

4k High-resolution Sensor for VOXL (10x10x16mm)
4k High-resolution Sensor for VOXL (8x8x5.8mm)
4k High-resolution Sensor for VOXL (IMX377 M12-style Lens)
All of these are plug-and-play, but the IMX377 sensor seems to be way more saturated on the green channel. We have two IMX377 sensors and both have the same saturation issue.

Has anyone else had this problem before/ know how to easily fix this?

Please let me know!

## Reply by Chad Sweet (ModalAI staff) · 2020-11-04 17:15:52 UTC

We will look into it, it's definitely not an easy fix. What is the application? Maybe we can find a quicker workaround

## Reply by Bobby Bukovec · 2020-11-04 17:29:05 UTC

Chad, 

I appreciate the quick response!

I guess I do not understand why the sensor would be sold like this? What is the application of such an oversaturated sensor? If this would be easier to talk about over the phone, I would be open to a conversation.

We would like to use this sensor to test several different focal length Arducam lenses. Out of the three ModalAI Hires Sensors, this one allows the most flexibility with lenses.

## Reply by Chad Sweet (ModalAI staff) · 2020-11-05 00:58:15 UTC

The auto white balance is likely reacting to something funny in your environment. Are you in a lab with LED lighting? LED lighting can often cause a problem.

## Reply by Alex Kushleyev (ModalAI staff) · 2020-11-05 05:28:28 UTC

Hello Bobby,

I have done a quick comparison of IMX377 camera with Iphone X. In this test I took a picture of a color wheel using both cameras in the same lighting conditions. Please see images below - I believe the color quality is comparable, though IMX377 image is a bit brighter overall and not focused very well. It does not look like there is too much green. I used the following pattern for testing : https://www.amazon.com/gp/product/B00F1YEEHA -- I suggest that you do similar comparison and see if the colors look acceptable.

Let us know if you have additional questions.

Alex

----

IMX377
![imx377_color_wheel.jpg](https://forum.modalai.com/assets/uploads/files/1604553949063-imx377_color_wheel.jpg) 

Iphone X
![iphone_x_color_wheel.jpg](https://forum.modalai.com/assets/uploads/files/1604553971277-iphone_x_color_wheel-resized.jpg)

## Reply by Bobby Bukovec · 2020-11-05 16:41:50 UTC (in reply to Chad Sweet)

@Chad-Sweet said in [IMX377 M12 Sensor Over saturated on G channel](/post/99):
> ronmen

Hi Chad, 

Both in an office space and when outside we have the same saturation issue.

## Reply by Bobby Bukovec · 2020-11-05 16:52:33 UTC (in reply to Alex Kushleyev)

@Alex-Kushleyev 

Thank you for this input. I am slightly confused. This is an image from a video taken outdoors flight testing. ![2020-11-05_10-44-41.png](https://forum.modalai.com/assets/uploads/files/1604594756059-2020-11-05_10-44-41.png)

Where as this second image is from the same day roughly 10 minutes apart using 4k High-resolution Sensor for VOXL (10x10x16mm). 

![2020-11-05_10-50-37.png](https://forum.modalai.com/assets/uploads/files/1604595069382-2020-11-05_10-50-37.png) 

Please excuse the under exposure, it was a cloudy day and we did not have the exposure set correctly. 
Maybe this is not just a saturation issue? Let me know your thoughts.

Best,
Bobby

## Reply by Alex Kushleyev (ModalAI staff) · 2020-11-06 05:07:27 UTC

What software are you using to record the video? Can you please try testing with auto exposure and auto white balance enabled? I believe the AE and AWB work together in some sense, so if you have AE disabled, AWB may not kick in if the right conditions are not met (e.g. too dark, like it seems in both of your tests)

## Reply by Bobby Bukovec · 2020-11-06 15:37:44 UTC (in reply to Alex Kushleyev)

@Alex-Kushleyev 

We are using rosbag to record the video.

How exactly can we enable AE and AWB with voxl_cam_ros, found here https://docs.modalai.com/voxl-cam-ros/

I was not aware this was something we can just turn on?

## Reply by Alex Kushleyev (ModalAI staff) · 2020-11-06 18:31:42 UTC

Please try using voxl-rtsp tool which can record a video and will have AE and AWB enabled by default (-h for help). voxl-rtsp comes with the software bundle, also found here : https://gitlab.com/voxl-public/voxl-rtsp

## Reply by Alex Kushleyev (ModalAI staff) · 2020-11-06 18:36:19 UTC

If you want voxl-cam-ros to use auto exposure, you should comment out these two lines here : https://gitlab.com/voxl-public/voxl-cam-manager/-/blob/master/src/SnapdragonCameraManager.cpp#L188

params_.setManualExposure(exposure_setting_);
params_.setManualGain(gain_setting_);

The default setting is auto exposure. The auto white balance should be enabled by default, but like I said previously it may not kick in unless the right image brightness conditions are met (using auto exposure).

## Reply by Chad Sweet (ModalAI staff) · 2020-11-06 19:10:51 UTC

FYI, docs updated here: https://docs.modalai.com/voxl-cam-ros/

## Reply by Bobby Bukovec · 2020-11-09 21:58:43 UTC

@Alex-Kushleyev  @Chad-Sweet 

Hey guys, so good news. With your support we are able to turn on both AWB and AE on both the IMX214 Sensor and the IMX377 sensor. 

The IMX377 sensor is still more saturated than the other sensor. Please see the pictures below. 

All settings are exactly the same for both the IMX 377 and IMX 214 sensors

IMX 377 Color Wheel
![target-imx377.png](https://forum.modalai.com/assets/uploads/files/1604955416607-target-imx377.png) 

IMX 214 Color Wheel
![target-imx214.png](https://forum.modalai.com/assets/uploads/files/1604955475543-target-imx214.png) 

IMX 377 Outdoors
![outside-imx377.png](https://forum.modalai.com/assets/uploads/files/1604955510923-outside-imx377.png) 

IMX 214 Outdoors
![outside-imx214.png](https://forum.modalai.com/assets/uploads/files/1604955545309-outside-imx214.png) 

Any thoughts?

## Reply by Alex Kushleyev (ModalAI staff) · 2020-11-10 18:19:58 UTC

Nice, some progress..

I do see the colors being off in the image. The indoor image (IMX377) with the color wheel looks too "warm".

Did you try using voxl-rtsp to record the video? please try, just to double check that you get the same results. Since you are using a ros node, which converts from YUV format to RGB (before encoding as a video), it is possible that the format conversion is not accurate. voxl-rtsp will record the video natively using the built-in hardware video encoder.

Also, just to double check, are you using a lens with IR cut filter? If there is no IR cut filter, the image sensor can get saturated with ambient IR light across all colors (not necessarily equally).

## Reply by Chad Sweet (ModalAI staff) · 2020-11-11 15:50:25 UTC

I just checked with our supplier, there is a 650nm IR FILTER

## Reply by Alex Kushleyev (ModalAI staff) · 2020-11-11 17:23:19 UTC

Is the filter inside the lens holder or in the lens itself? I think different lenses might be tested here.

## Reply by Alex Kushleyev (ModalAI staff) · 2020-11-17 20:18:17 UTC

Hi Bobby, 

I did some more testing and it seems i can get the IMX377 camera to produce green-ish shades under some lighting conditions. I believe that this is due to AWB somehow incorrectly detecting the scene / lighting type. Let me play with this, I think the solution can be to force a particular scene type so that AWB does not try to guess.

In my tests, I pointed the camera at a light gray wall and depending on the angle, it would show up as gray or sometimes a bit green-ish.

I will follow up soon..

Alex

## Reply by JP Drone · 2022-08-23 03:06:55 UTC

Hello,
I have the same green-ish problem of IMX377.
It's also happened in voxl-camera-server v1.1.3 with AWB enabled.
Are there any plans to improve it in the future?

## Reply by JP Drone · 2022-08-23 03:58:01 UTC

When the Gain drop, image turn to Green-ish.
Do you have plan to release WB setting feature?
It would be very useful to be able to change WB from config setting file without changing the source.

![image1.png](https://forum.modalai.com/assets/uploads/files/1661226787206-image1.png)
 ![image2.png](https://forum.modalai.com/assets/uploads/files/1661226791934-image2.png)

## Reply by Alex Kushleyev (ModalAI staff) · 2022-09-07 22:00:38 UTC

Hello @JP-Drone , thank you for bringing this to our attention (again).

I have been looking at improving AWB control some time ago but did not finish. I do agree there is an issue and it arises from the ISP configuration not tuned well for the specific camera. The tuning process is complicated and there is no open source API, but I am hoping that I can make a simple configuration or expose a few parameters to control AWB settings. 

Please note that to complicate things even further, the AWB performance / tuning is currently dependent on the image brightness -- there are ISP tuning parameters for color normalization, etc across different gain ranges.

Just to help me a little bit, can you please provide the exact camera part number and gain values you used for the two images?

I will bump this up in priority a bit and will try to address soon.

## Reply by JP Drone · 2022-09-09 01:55:01 UTC (in reply to Alex Kushleyev)

@Alex-Kushleyev 
Thank you for your reply.
I used MSU-M0026-1-01.
When changing to Green-ish, the gain becomes 69 (sorry, no snapshot).
I have a few other snapshots.
![786fdb6c-da16-4177-a18b-147b99df3493-image.png](https://forum.modalai.com/assets/uploads/files/1662688247773-786fdb6c-da16-4177-a18b-147b99df3493-image.png) 
![7b8f9d28-eba0-4764-b840-f295ceae19c1-image.png](https://forum.modalai.com/assets/uploads/files/1662688265282-7b8f9d28-eba0-4764-b840-f295ceae19c1-image.png)