ModalAI Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Starling 2: TOF sensor not recognized by VOXL Portal

    Starling & Starling 2
    3
    20
    164
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Alex KushleyevA
      Alex Kushleyev ModalAI Team @Hector Gutierrez
      last edited by

      @Hector-Gutierrez ,

      When you were looking for cameras in voxl-portal - was the voxl-camera-server actually running? you need to make sure that it's running (either as a background service, which normally starts up using systemd right after boot, or manually if you are running the camera server in a terminal in the foreground).

      It does look like the 3 AR0144 and 1 IMX412 were detected, so lets first make sure you can view those corresponding streams first.

      Alex

      Hector GutierrezH 1 Reply Last reply Reply Quote 0
      • Hector GutierrezH
        Hector Gutierrez @Alex Kushleyev
        last edited by

        @Alex-Kushleyev

        Yes, voxl-camera-server was running. In fact I stopped it and started it again to be sure it was running.
        I also checked with voxl-inspect-services and it showed the camera server was running. And yet I cannot open any of the cameras on voxl Portal - the portal starts properly but there are no cameras. And also the IMU plots look empty.
        And the ToF sensor is not being detected ...
        Please let me know what to try next.

        Thanks, Hector

        Alex KushleyevA 1 Reply Last reply Reply Quote 0
        • Alex KushleyevA
          Alex Kushleyev ModalAI Team @Hector Gutierrez
          last edited by

          @Hector-Gutierrez , with the voxl-camera-server running on the foreground, please run the following and monitor the output of voxl-camera-server as well:

          voxl-inspect-cam -a
          

          This test should connect to ALL the camera streams generated by the voxl-camera-server and print out the stats.

          Alex

          Hector GutierrezH 1 Reply Last reply Reply Quote 0
          • Hector GutierrezH
            Hector Gutierrez @Alex Kushleyev
            last edited by

            @Alex-Kushleyev
            Thanks for the prompt reply. I receive the following output:
            Pipe Name | bytes | wide | hgt |exp(ms)| gain | frame id |latency(ms)| fps | mbpt
            | hires_large_color |18495360 | 4056 | 3040 | 16.67 | 747 | 1880 | 93.2 | 30.0 | 44422
            | hires_large_encoded | 2064 | 4056 | 3040 | 16.67 | 747 | 1879 | 100.0 | 30.0 | 0
            | hires_large_grey |12330240 | 4056 | 3040 | 16.67 | 747 | 1880 | 72.2 | 30.0 | 29618
            | hires_small_color | 1179648 | 1024 | 768 | 16.67 | 747 | 1880 | 50.4 | 30.0 | 2832
            | hires_small_encoded | 256 | 1024 | 768 | 16.67 | 747 | 1880 | 61.6 | 30.0 | 0
            | hires_small_grey | 786432 | 1024 | 768 | 16.67 | 747 | 1881 | 48.4 | 30.0 | 1888
            | hires_snapshot |
            | ov_overlay | 3235840 | 1280 | 2528 | 6.81 | 614 | 1640 | 84.2 | 4.7 | 1228
            | tracking_down | 1024000 | 1280 | 800 | 6.90 | 614 | 1647 | 34.1 | 30.0 | 2458
            | tracking_down_bayer | 1024000 | 1280 | 800 | 6.90 | 614 | 1647 | 33.7 | 30.0 | 2458
            | tracking_down_misp_grey | 1024000 | 1280 | 800 | 6.73 | 570 | 1648 | 33.3 | 30.0 | 2458
            | tracking_down_misp_norm | 1024000 | 1280 | 800 | 6.73 | 570 | 1648 | 36.3 | 30.0 | 2458
            | tracking_front | 1024000 | 1280 | 800 | 5.63 | 307 | 1648 | 33.5 | 30.0 | 2458
            | tracking_front_bayer | 1024000 | 1280 | 800 | 5.63 | 307 | 1648 | 33.7 | 30.0 | 2458
            | tracking_front_misp_grey | 1024000 | 1280 | 800 | 5.63 | 307 | 1648 | 30.2 | 30.0 | 2458
            | tracking_front_misp_norm | 1024000 | 1280 | 800 | 5.63 | 307 | 1648 | 35.5 | 30.0 | 2458
            | tracking_rear | 1024000 | 1280 | 800 | 5.32 | 192 | 1649 | 33.9 | 30.0 | 2458
            | tracking_rear_bayer | 1024000 | 1280 | 800 | 5.32 | 192 | 1649 | 33.1 | 30.0 | 2458
            | tracking_rear_misp_grey | 1024000 | 1280 | 800 | 5.32 | 192 | 1649 | 31.5 | 30.0 | 2458
            | tracking_rear_misp_norm | 1024000 | 1280 | 800 | 5.32 | 192 | 1649 | 35.1 | 30.0 | 2458

            Still dont see the ToF sensor ... Please advise
            Thanks, Hector

            Alex KushleyevA 1 Reply Last reply Reply Quote 0
            • Alex KushleyevA
              Alex Kushleyev ModalAI Team @Hector Gutierrez
              last edited by

              @Hector-Gutierrez ,
              OK, so it looks like that the 4 detected cameras are actually streaming data.

              I am not sure why voxl-portal is not showing any cameras. When you access the voxl-portal via browser, do you see the actual portal (with green menu bar at the top), but no cameras are listed in the Cameras section?

              How are you connected to the drone? (wifi, adb, etc).

              Regarding the TOF sensor, since voxl-camera-server -l did not show that the TOF sensor is detected, the stream is not available.

              Please double check that com.qti.sensormodule.irs2975c* file is in /usr/lib/camera/ directory - please provide the exact name or let me know if it's missing.

              Also, can you please take a picture of your cameras plugged into the M0173 camera front end? I just want to make sure the TOF sensor is plugged in correctly.

              Alex

              Hector GutierrezH 1 Reply Last reply Reply Quote 0
              • Hector GutierrezH
                Hector Gutierrez @Alex Kushleyev
                last edited by

                @Alex-Kushleyev
                Hi Alex, I disassembled and reassembled the camera board and now I get 4 cameras in VOXL Portal ! I did reconnect the ToF sensor as well to the camera board, it seems properly connected.
                The cameras working well are hires_large_color, and all three tracking cameras. I still dont see the ToF sensor , and the view of the hires camera is blurry (out of focus). The hires camera was recently replaced, so how to get it into focus is another question.
                I listed the files on /usr/lib/camera and found this file: com.qti.sensormodule.irs2975c_3.bin
                So now we are down to the ToF sensor (and to put the hires camera in focus). Let me know what to try next !
                thanks, Hector

                Alex KushleyevA Hector GutierrezH 2 Replies Last reply Reply Quote 0
                • Alex KushleyevA
                  Alex Kushleyev ModalAI Team @Hector Gutierrez
                  last edited by

                  @Hector-Gutierrez , in order to focus the hires camera (I am assuming IMX412), you can twist the lens in the M12 lens holder. Normally we do focus the hires cameras to a norminal focus distance, but maybe you had one from earlier batch which was not focused. Also, focus of the camera depends on the application, so it is recommended for users to double check and correct the focus for their needs. If there is some sealant on the threads, it is not permanent and can be removed using tweezers - loosening it up a bit should allow you to twist the lens inside the holder.

                  Regarding the PMD TOF, not sure yet. Has it worked before?

                  Alex

                  1 Reply Last reply Reply Quote 0
                  • Hector GutierrezH
                    Hector Gutierrez @Hector Gutierrez
                    last edited by

                    @Hector-Gutierrez
                    Hi Alex - As you suggested, the focus issue was resolved by twisting the lens until good focus at 3 m. was achieved.
                    The TOF sensor remains a problem. I've tried detaching and reconnecting its cable (on both ends) but no luck so far.
                    Both VOXL Portal and voxl-camera-server -l only see 4 cameras.
                    We didnt use the TOF sensor before so I didnt notice if it was working previously or not.
                    Please let me know what to try next - thanks, Hector

                    Alex KushleyevA 1 Reply Last reply Reply Quote 0
                    • Alex KushleyevA
                      Alex Kushleyev ModalAI Team @Hector Gutierrez
                      last edited by

                      @Hector-Gutierrez , can you please send a picture of the TOF sensor connected to M0173? Just to make sure the connections are correct.

                      Hector GutierrezH 1 Reply Last reply Reply Quote 0
                      • Hector GutierrezH
                        Hector Gutierrez @Alex Kushleyev
                        last edited by

                        @Alex-Kushleyev
                        Hi Alex - attached are some pictures of the connection. Something odd is happening. The connector engages its socket in two different locations relative to the hole for the screw. In the centered location (where it should be!) the TOF sensor causes a power short and the drone wont boot (see picture with red LED). In the off-center location there is no short and the drone boots, but I only get 4 cameras and the TOF is not visible.
                        ![centered.jpg](Request Entity Too Large) ![off-center1.jpg](Request Entity Too Large) ![off-center2.jpg](Request Entity Too Large) ![power-short.jpg](Request Entity Too Large)

                        Hector GutierrezH 1 Reply Last reply Reply Quote 0
                        • Hector GutierrezH
                          Hector Gutierrez @Hector Gutierrez
                          last edited by

                          @Hector-Gutierrez
                          Download link for the pictures in case they did not attach to previous message:
                          https://quickconnect.to/asapstorage/d/s/13iMi9oRZUxhkQYoW2DCHtZ7nI9HgYJx/bj3PLF8EXd5pKdKgwphVqcbD7VaaMBQX-V7WAgk58WAw

                          Hector GutierrezH 1 Reply Last reply Reply Quote 0
                          • Hector GutierrezH
                            Hector Gutierrez @Hector Gutierrez
                            last edited by

                            @Hector-Gutierrez
                            Update from my previous post. I install the TOF connector in the centered location and fully attach the screws (including the one that secures the TOF ribbon cable). There is no short, the drone start normally, and I get 4 cameras on VOXL portal, but no TOF. Also voxl-camera-server -l only see 4 cameras. So TOF connection is definitely Ok, but sensor not present.

                            Alex KushleyevA 1 Reply Last reply Reply Quote 0
                            • Alex KushleyevA
                              Alex Kushleyev ModalAI Team @Hector Gutierrez
                              last edited by

                              @Hector-Gutierrez , I am sorry, i was not able to access the image you shared. Can you please just resize / crop the image so that it fits into the forum? Just please make sure the details are still easy to see.

                              Thank you!

                              Alex

                              Hector GutierrezH 1 Reply Last reply Reply Quote 0
                              • Hector GutierrezH
                                Hector Gutierrez @Alex Kushleyev
                                last edited by

                                @Alex-Kushleyev
                                Hi Alex - attached are the pictures. centered.jpg off-center1.jpg

                                After installing the TOF connector in the centered location and fully attach all the screws (including the one that secures the TOF ribbon cable), there is no short and the drone starts normally. I get 4 cameras on VOXL portal, but no TOF. Also voxl-camera-server -l only see 4 cameras. So TOF connection seems definitely Ok, but sensor not present. Seems to me like a bad TOF sensor - let me know your thoughts.

                                Hector GutierrezH 1 Reply Last reply Reply Quote 0
                                • Hector GutierrezH
                                  Hector Gutierrez @Hector Gutierrez
                                  last edited by

                                  @Hector-Gutierrez Clarification on the pictures. The top picture is the centered position of the TOF ribbon cable. The bottom picture can be disregarded. The connection is done on the centered position (top picture). Thanks.

                                  1 Reply Last reply Reply Quote 0
                                  • First post
                                    Last post
                                  Powered by NodeBB | Contributors