@Alex-Kushleyev Thanks!

This is what I'm seeing with voxl-camera-server set to the following:

                        "en_misp":      true,
                        "preview_width":        4040,
                        "preview_height":       3040,
                        "misp_width":   2020,
                        "misp_height":  1520,
                        "misp_awb":     "auto",
                        "misp_zoom":    1.,
                        "en_eis":       false,
                        "eis_mode":     "full-follow",
                        "eis_view":     "eis-only",
                        "eis_follow_rate":      0.01,
                        "en_large_video":       false,
                        "en_small_video":       true,

I'll keep debugging why this is happening. Will EIS accept an intrinsics file calibrated from hires_small_grey setting the width and height to 2020x1520?

@Alex-Kushleyev I'm looking at hires_misp_grey. I know I've been looking at the misp streams all along because they haven't been fisheye, like the hires_small_grey stream.
Also, just checked out the zoom slider in voxl-portal, it doesn't seem to work

@Alex-Kushleyev No, it doesn't change. Let me try adjusting in voxl-portal.

@Alex-Kushleyev I tried 1.0 as well, it didn't make a difference.

Hi! When I follow the instructions on here to calibrate at half resolution for EIS, I'm noticing that the output video is zoomed in. Even setting misp_zoom to 0, and resolution to 4040x3040 for an imx412 camera is not giving me the full camera view.

I'm using voxl-camera-server_2.2.4
Here is my voxl-camera-server.conf file:

{
                        "type": "imx412",
                        "name": "hires",
                        "enabled":      true,
                        "camera_id":    1,
                        "fps":  10,
                        "en_preview":   true,
                        "en_raw_preview":       true,
                        "en_misp":      true,
                        "preview_width":        4040,
                        "preview_height":       3040,
                        "misp_width":   2020,
                        "misp_height":  1520,
                        "misp_awb":     "auto",
                        "misp_zoom":    0,
                        "en_eis":       false,
                        "eis_mode":     "full-follow",
                        "eis_view":     "eis-only",
                        "eis_follow_rate":      0.01,
                        "en_large_video":       false,
                        "en_small_video":       true,
                        "en_snapshot":  false,
                        "ae_mode":      "lme_msv",
                        "en_rotate":    false,
                        "misp_venc_enable":     true,
                        "misp_venc_mode":       "h264",
                        "misp_venc_br_ctrl":    "cbr",
                        "misp_venc_Qfixed":     30,
                        "misp_venc_Qmin":       15,
                        "misp_venc_Qmax":       51,
                        "misp_venc_nPframes":   29,
                        "misp_venc_mbps":       3,
                        "ae_desired_msv":       100,
                        "exposure_min_us":      25,
                        "exposure_max_us":      5000,
                        "gain_min":     100,
                        "gain_max":     32000,
                        "exposure_soft_min_us": 5000,
                        "snapshot_jpeg_quality":        75,
                        "small_video_width":    1024,
                        "small_video_height":   768,
                        "small_venc_mode":      "h264",
                        "small_venc_br_ctrl":   "cqp",
                        "small_venc_Qfixed":    30,
                        "small_venc_Qmin":      15,
                        "small_venc_Qmax":      40,
                        "small_venc_nPframes":  9,
                        "small_venc_mbps":      2,
                        "small_venc_osd":       false,
                        "large_video_width":    4056,
                        "large_video_height":   3040,
                        "large_venc_mode":      "h264",
                        "large_venc_br_ctrl":   "cqp",
                        "large_venc_Qfixed":    40,
                        "large_venc_Qmin":      15,
                        "large_venc_Qmax":      50,
                        "large_venc_nPframes":  29,
                        "large_venc_mbps":      40,
                        "large_venc_osd":       false,
                        "en_snapshot_width":    4056,
                        "en_snapshot_height":   3040,
                        "exif_focal_length":    3.0999999046325684,
                        "exif_focal_length_in_35mm_format":     17,
                        "exif_fnumber": 1.2400000095367432,
                        "misp_venc_osd":        false,
                        "misp_gamma":   1.6,
                        "ae_filter_alpha":      0.600000023841858,
                        "ae_ignore_fraction":   0.20000000298023224,
                        "ae_slope":     0.05000000074505806,
                        "ae_exposure_period":   1,
                        "ae_gain_period":       1
                }

Hey @Alex-Kushleyev! To answer your questions:

• Yes, with the latest SDK, RTSP streaming works in VLC as long as the cache is not set to 0 ms. I’ve seen stable playback once the cache is increased (around ~300 ms).

• I’m using VLC to test playback, but I also tested using ffmpeg and was able to successfully record video from the RTSP stream even with 0ms cache. This led me to think that frames are being transmitted correctly, but there’s likely a timing / timestamp issue in the RTSP stream that ffmpeg is tolerant of, but causes VLC to freeze. I don't remember the exact command I used but it was similar to:

ffmpeg \
  -rtsp_transport tcp \
  -fflags nobuffer \
  -flags low_delay \
  -an \
  -i rtsp://<voxl-ip>:8900/live \
  -t 10 \
  -c copy \
  out.mp4

• Yes, '''hires_misp_color''' has been available when I've tested this. When I set VLC to 0ms cache, I always only receive one frame before the stream freezes.

Following up on this, @Alex-Kushleyev do you have any initial leads that might help me - thanks!

Hi! I need to be able to network stream to VLC with caching set to 0ms. It seems like older SDKs stream just fine with 0ms cache, but SDK 1.6.0 does not.

Using SDK 1.4.0, I'm able to stream with no problems. The voxl-streamer version is 0.7.5, and I also switched over to voxl-streamer 0.8.0 (from SDK1.6) to narrow down the root cause of the problem, but noticed that streaming worked in this configuration too.

Then, I flashed the voxl to SDK 1.6.0, and tried both versions of voxl-streamer (0.7.5 and 0.8.0) and neither of them were able to stream with 0ms cache.

Where should I look to solve this problem? Thanks!

For reference, here's my voxl-streamer.conf:

voxl2-mini-test-fixture (TF-M0104):/$ cat etc/modalai/voxl-streamer.conf
{
        "input-pipe":   "hires_misp_color",
        "bitrate":      3000000,
        "rotation":     0,
        "decimator":    1,
        "encoder":      "h264",
        "port":         8900
}

@Alex-Kushleyev I verified that I used the correct drivers and had already updated maxRAWSizes on /vendor/etc/camera/camxoverridesettings.txt. I just went through the updated EIS docs and I am still seeing the same errors. Let me know if there's anything else I can check!

After upgrading to sdk 1.6.0 things are working well and the transform is incorporated correctly. Thanks for your help! If you know how I can get it working on sdk 1.5.0 I'd still be interested in knowing how.