# IMX412 Colour Source: https://forum.modalai.com/topic/4169/imx412-colour Category: General Questions (https://forum.modalai.com/category/2/general-questions) Posted: 2025-02-11 21:53:31 UTC by jcai Replies: 9 · Views: 1311 ## jcai · 2025-02-11 21:53:31 UTC Hi, I have a single IMX412 connected to M0173 J5 on a VOXL2. `com.qti.sensormodule.imx412_fpv_2.bin` is the only sensormodule file I have in `/usr/lib/camera`. This is my camera server config file: ``` /** * voxl-camera-server Configuration File * * Each camera has configurations for up to 4 HAL3 streams: * - `preview` stream for raw unprocessed images from CV cameras * - `small_video` 720p (ish) h264/h265 compressed for fpv video streaming * - `large_video` 4k (ish) h264/h265 for onboard video recording to disk * - `snapshot` ISP-processed JPG snapshots that get saved to disk * * on QRB5165 platforms (VOXL2 and VOXL2 mini) you can only have 3 of the 4 enabled * * This file is generated from default values by voxl-configure-cameras. * Do not expect arbitrary resolutions to work, the ISP and video compression * pipelines only support very specific resolutions. * * The default video compression mode is cqp or Constant Quantization Parameter * * * */ { "version": 0.1, "fsync_en": true, "fsync_gpio": 109, "cameras": [{ "type": "imx412", "name": "hires_front", "enabled": true, "camera_id": 0, "fps": 30, "en_preview": false, "preview_width": 640, "preview_height": 480, "en_raw_preview": false, "en_small_video": true, "small_video_width": 640, "small_video_height": 480, "small_venc_mode": "h265", "small_venc_br_ctrl": "cqp", "small_venc_Qfixed": 30, "small_venc_Qmin": 15, "small_venc_Qmax": 40, "small_venc_nPframes": 9, "small_venc_mbps": 2, "en_large_video": false, "large_video_width": 4056, "large_video_height": 3040, "large_venc_mode": "h265", "large_venc_br_ctrl": "cqp", "large_venc_Qfixed": 38, "large_venc_Qmin": 15, "large_venc_Qmax": 50, "large_venc_nPframes": 29, "large_venc_mbps": 30, "en_snapshot": false, "en_snapshot_width": 4056, "en_snapshot_height": 3040, "exif_focal_length": 3.0999999046325684, "exif_focal_length_in_35mm_format": 17, "exif_fnumber": 1.2400000095367432, "ae_mode": "isp" }] } ``` The issue I'm having has to do with the colour of the video. Indoors, the image looks fine but outdoors, there's a red tint that I can't seem to get rid of. I'm using `isp` currently, but I've also played around with `lme_msv`, to not much improvement. Is this behaviour normal? ![Screenshot 2025-02-11 105120.png](https://forum.modalai.com/assets/uploads/files/1739310669608-screenshot-2025-02-11-105120.png) ![Screenshot 2025-02-11 105919.png](https://forum.modalai.com/assets/uploads/files/1739310755446-screenshot-2025-02-11-105919.png) ## Reply by Alex Kushleyev (ModalAI staff) · 2025-02-12 17:59:35 UTC @jcai , can you please try the following: remove `com.qti.sensormodule.imx412_fpv_2.bin` (or rename to `com.qti.sensormodule.imx412_fpv_2.bin.bak` and copy the following to `/usr/lib/camera`: `cp /usr/share/modalai/chi-cdk/imx412/com.qti.sensormodule.imx412_2.bin /usr/lib/camera/` then restart camera server. This other sensormodule driver will use another tuning file for image processing. Let me know if that works better for you, I can explain more details about what's going on. Alex ## Reply by Alex Kushleyev (ModalAI staff) · 2025-02-12 18:00:44 UTC (in reply to Alex Kushleyev) Another thing to check.. does your IMX412 camera have IR filter installed or not? You should know this based on the part number of IMX412 that you purchased. If there is no IR filter, it is possible that you will see more red tint in the image. If this is the case, we can discuss how to fix it. Alex ## Reply by jcai · 2025-02-12 20:14:13 UTC (in reply to Alex Kushleyev) @Alex-Kushleyev I've tried the other driver, and the result looks largely the same. It's a bit brighter. (Cropped for file size) My sensor indeed doesn't have the IR filter. ![Screenshot 2025-02-12 143348-2.png](https://forum.modalai.com/assets/uploads/files/1739391189175-screenshot-2025-02-12-143348-2.png) ![Screenshot 2025-02-12 143348.png](https://forum.modalai.com/assets/uploads/files/1739391248832-screenshot-2025-02-12-143348.png) ## Reply by Alex Kushleyev (ModalAI staff) · 2025-02-12 21:31:25 UTC (in reply to jcai) @jcai , thank you for trying. The issue here is that the tuning files we have for the Qualcomm ISP assume that the camera has a IR filter, so the AWB (auto white balance) algorithm in the camera pipeline is not able to compensate the significant difference in RGB levels with the IR filter removed. The tuning file is pretty much a black box for the end user, deviating from the original camera parameters / lens specs (which were used for the tuning) can leave to image degradation or color variations. We have been working on our own processing pipeline (MISP) which bypasses the ISP and performs debayering, color balance, etc. I will need to document a few steps so that you can try it out. Does your use case require the full frame resolution, or what output resolution are you looking for? Alex ## Reply by jcai · 2025-02-13 20:53:33 UTC (in reply to Alex Kushleyev) @Alex-Kushleyev Thanks for the info. For now, we're going to swap the sensor for one with the filter to see how it performs. I'll be updating results here ## Reply by jcai · 2025-02-27 17:01:29 UTC (in reply to jcai) Update: the filter was absolutely the difference maker ![25427486-6567-4848-a3ad-b4992ec64ffb-image.png](https://forum.modalai.com/assets/uploads/files/1740675666707-25427486-6567-4848-a3ad-b4992ec64ffb-image.png) ## Reply by dirizarry · 2025-11-06 15:20:59 UTC @Alex-Kushleyev - Did the MISP pipeline get published yet? We have the same issue with the IR filter compensations and tried to run the binary switch that you noted above. After restarting the voxl-camera-server it stated that it could no longer find the cameras so I switched back to the old imx412_0.bin that was already there. ## Reply by Alex Kushleyev (ModalAI staff) · 2025-11-07 03:48:57 UTC (in reply to dirizarry) @dirizarry , If your lens does not have an IR filter, the colors will be distorted. Please take a look at sample images : https://docs.modalai.com/M0161/#image-samples-for-sensor You could replace the lens with another lens that has an IR filter. If you do want to keep the lens without IR filter, please follow the steps below. My best suggestion is to download the latest IMX412 drivers from [here](https://storage.googleapis.com/modalai_public/temp/imx412_test_bins/20250919/imx412_fpv_eis_20250919_drivers.zip) Extract the archive and select the sensormodule with the correct id (matching the ID that you have already been using). back up existing imx412 sensormodules and copy the new one to `/usr/lib/camera/` Then, edit `/etc/modalai/voxl-camera-server.conf` - i will just provide a minimal config for a single IMX412 camera (you will need to check the camera id in the config file). If you use voxl-portal, you should be able to see `hires_misp_color` and h264 encoded stream `hires_misp_encoded`. ``` { "version": 0.1, "fsync_en": true, "fsync_gpio": 109, "cameras": [ { "type": "imx412", "name": "hires", "enabled": true, "camera_id": 0, "fps": 30, "en_preview": true, "en_raw_preview": true, "en_misp": true, "preview_width": 3840, "preview_height": 2160, "misp_width": 1920, "misp_height": 1080, "misp_zoom": 1, "misp_gamma": 1, "misp_awb": "auto", "ae_mode": "lme_msv", "gain_min": 100, "gain_max": 32000, "ae_desired_msv": 100, "misp_venc_enable": true, "misp_venc_mode": "h264", "misp_venc_br_ctrl":"cbr", "misp_venc_mbps": 5, "en_small_video": false, "en_large_video": false, "en_snapshot": false } ] } ``` Please note that after you start `voxl-camera-server`, the config file will be auto-populated with some more default parameters for this camera. When viewing `hires_misp_color` stream in `voxl-portal`, if you see any flickering, please try to set voxl2 cpu mode to perf : `voxl-set-cpu-mode perf` as well as reduce the jpeg quality that is used to display this stream (which is YUV converted to jpeg in the back-end). The mjpeg quality can be changed by enabling the advanced controls in `voxl-portal` (click the tiny check box in the bottom left corner of the page) and reduce the Quality slider. ![7fde50a8-0c94-49e3-b053-2db0a8f76ee6-image.png](https://forum.modalai.com/assets/uploads/files/1762487432807-7fde50a8-0c94-49e3-b053-2db0a8f76ee6-image.png) Using MISP should help with reducing the IR effects, but it won't be perfect due to really strong IR light that can be present durig day time outdoors. Alex ## Reply by Alex Kushleyev (ModalAI staff) · 2025-11-07 21:30:22 UTC (in reply to Alex Kushleyev) Also, a quick note.. regarding what preview resolution to use with IMX412 camera with MISP enabled.. For best quality (non-EIS applications, where the output is 16:9 aspect ratio, such as `3840x2160`, `1920x1080`, `1280x720`), you should select `3840x2160` as the preview resolution. For EIS applications, the full frame `4040x3040` resolution should be used because it will allow more stabilization margin. selecting `3840x2160` will tell the camera to crop this region from the full frame `4040x3040`, since we don't need the rest of the image. For low latency applications, you can use input resolution of `1936x1080`. Note that this is slightly non-standard (as opposed to `1920x1080` because the `1936x1080` resolution allows faster processing. So you could have input resolution of `1936x1080` and output resolution of `1920x1080`, `1280x720`, etc. Alex