ModalAI Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Dual IMX412 connected to VOXL 2

    VOXL 2
    6
    21
    1452
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ?
      A Former User
      last edited by

      Hi,

      Mentioned here:

      Your camera server configuration file /etc/modalai/voxl-camera-server.conf for only two imx412 sensors connected would look as such:

      You'll need to customize your camera server config file manually because this is not a standard supported arrangement.

      If these are the only 2 cameras plugged in then they will be ID 0 and 1

      1 Reply Last reply Reply Quote 0
      • V
        vipul.kadam
        last edited by

        @Alex-Gardner Thank you for the clarification, pls refer following screenshot of the updated voxl-camera-serve.conf file from the VOXL2 module.

        {
                "version":      0.1,
                "cameras":      [{
                                "name": "hires1",
                                "enabled":      true,
                                "frame_rate":   30,
                                "type": "imx214",
                                "camera_id":    0,
                                "preview_width":        640,
                                "preview_height":       480,
                                "snapshot_width":       640,
                                "snapshot_height":      480
                        }, {
                                "name": "hires2",
                                "enabled":      true,
                                "frame_rate":   30,
                                "type": "imx214",
                                "camera_id":    1,
                                "preview_width":        640,
                                "preview_height":       480,
                                "snapshot_width":       640,
                                "snapshot_height":      480
                        }]
        }
        

        Once the above file as updated we carried out the suggested steps by providing the command
        voxl-configure-cameras, as stated in my earlier post there are variety of options which pop-up once the command is executed, can you please let us know which is the appropriate configuration id to be selected from the following drop down:

        available camera configurations are as follows:
        
        0  None
        1  Tracking + Stereo(OV7251)
        2  Tracking Only
        3  Hires + Stereo(OV7251) + Tracking
        4  Hires + Tracking
        5  TOF + Tracking
        6  Hires + TOF + Tracking
        7  TOF + Stereo(OV7251) + Tracking
        8  Hires Only
        9  TOF Only
        10 Stereo(OV7251) only
        11 Tracking + Hires + Dual Stereo(OV7251) Pairs
        12 Stereo(OV9782) only
        13 Hires + Stereo(OV7251)
        

        We have already tried out the following all camera configurations option so far and only in camera configuration id 8 we are able to get video but the video is only from 1 IMX412 sensor.

        1 Reply Last reply Reply Quote 0
        • V
          vipul.kadam
          last edited by

          To add to the above point the voxl-camera-server.conf file goes back to the default setting once the module is power cycled, refer following snapshot of the same file post power cycling.

          voxl2:/etc/modalai$ cat voxl-camera-server.conf
          {
                  "version":      0.1,
                  "cameras":      [{
                                  "name": "tracking",
                                  "enabled":      true,
                                  "frame_rate":   30,
                                  "type": "ov7251",
                                  "camera_id":    2,
                                  "ae_desired_msv":       60,
                                  "ae_filter_alpha":      0.600000023841858,
                                  "ae_ignore_fraction":   0.20000000298023224,
                                  "ae_slope":     0.05000000074505806,
                                  "ae_exposure_period":   1,
                                  "ae_gain_period":       1
                          }, {
                                  "name": "hires",
                                  "enabled":      true,
                                  "frame_rate":   30,
                                  "type": "imx214",
                                  "camera_id":    3,
                                  "preview_width":        640,
                                  "preview_height":       480,
                                  "snapshot_width":       3840,
                                  "snapshot_height":      2160
                          }, {
                                  "name": "stereo_front",
                                  "enabled":      true,
                                  "frame_rate":   30,
                                  "type": "ov7251",
                                  "camera_id":    0,
                                  "camera_id_second":     1,
                                  "independent_exposure": false,
                                  "ae_desired_msv":       60,
                                  "ae_filter_alpha":      0.600000023841858,
                                  "ae_ignore_fraction":   0.20000000298023224,
                                  "ae_slope":     0.05000000074505806,
                                  "ae_exposure_period":   1,
                                  "ae_gain_period":       1
                          }, {
                                  "name": "stereo_rear",
                                  "enabled":      true,
                                  "frame_rate":   30,
                                  "type": "ov7251",
                                  "camera_id":    5,
                                  "camera_id_second":     4,
                                  "independent_exposure": false,
                                  "ae_desired_msv":       60,
                                  "ae_filter_alpha":      0.600000023841858,
                                  "ae_ignore_fraction":   0.20000000298023224,
                                  "ae_slope":     0.05000000074505806,
                                  "ae_exposure_period":   1,
                                  "ae_gain_period":       1
                          }]
          
          1 Reply Last reply Reply Quote 0
          • V
            vipul.kadam
            last edited by

            Hi @Alex-Gardner I guess the voxl-configure-camera was overwriting the voxl-camera-server file, bypassing that allowed us to get streams from both the IMX412 camera via the voxl-portal command.

            Refer Following image:

            0a9b0915-8b9e-4c82-bc13-377c048102a9-image.png ![alt text](image url)

            The required part of getting two parallel streams from 2 IMX412 camera onthe VOXL2 board seem to be achieved. I case of any further doubts on this activity will open a new thread. Thanks for your support.

            1 Reply Last reply Reply Quote 0
            • V
              vipul.kadam
              last edited by

              @Hector-Nevarez @Chad-Sweet @Alex-Gardner by editing the voxl-camera-server.conf file we were able to get a video stream from 640X480 @ 30fps up to (1920X1080) FHD @ 30 fps resolution for both the IMX412 camera, as seen from the datasheet the IMX412 sensor is a 12.3 Megapixel sensor and we would like to acquire highest possible resolution video stream from the sensor at 30fps as well as 60fps. Can you please let us know how this can be achieved.

              P.S. In the above mentioned conf file if we provide any resolution over and above 1920X1080 the video pile line crashes.

              1 Reply Last reply Reply Quote 0
              • modaltbM
                modaltb ModalAI Team
                last edited by

                @vipul-kadam ,

                OK starting off with FPS, I perhaps stumbled into a fix that was preventing higher FPS from being used in the camera pipeline... I've tested this on a single imx412 only (what I have with me at the moment to try) but I'm able to get 1920x1080 at 60FPS after this mod:

                Can you add a new line with this:
                defaultMaxFPS=120
                at the end of this file?
                /vendor/etc/camera/camxoverridesettings.txt

                I believe this will allow higher FPS.

                1 Reply Last reply Reply Quote 0
                • V
                  vipul.kadam
                  last edited by

                  Hi @modaltb by doing so the voxl-camera-serve and the voxl-portal pumps data over ethernet but on the web portal we are not able to see any vide0 from the IMX412 camera, pls note we are using the same voxl-camera-server.conf file which @Alex-Gardner have suggested to use.

                  1 Reply Last reply Reply Quote 0
                  • modaltbM
                    modaltb ModalAI Team
                    last edited by

                    OK thanks for the info, we've not tested portal much with this new tweak above so it will take a little time to propagate the updates to support these, we'll update as it becomes available.

                    1 Reply Last reply Reply Quote 0
                    • V
                      vipul.kadam
                      last edited by

                      @modaltb meanwhile the update becomes available, is there any other method to get a video streamed at FHD@60fps from the voxl2 module over the ethernet interface?

                      1 Reply Last reply Reply Quote 0
                      • modaltbM
                        modaltb ModalAI Team
                        last edited by

                        Have you tried voxl-streamer instead of trying to visualize using voxl-portal? I've not tried this myself but I would next try voxl-streamer.

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post
                        Powered by NodeBB | Contributors