ModalAI Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Starling 2: TOF sensor not recognized by VOXL Portal

    Starling & Starling 2
    3
    20
    170
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Hector GutierrezH
      Hector Gutierrez @Alex Kushleyev
      last edited by

      @Alex-Kushleyev

      Yes, voxl-camera-server was running. In fact I stopped it and started it again to be sure it was running.
      I also checked with voxl-inspect-services and it showed the camera server was running. And yet I cannot open any of the cameras on voxl Portal - the portal starts properly but there are no cameras. And also the IMU plots look empty.
      And the ToF sensor is not being detected ...
      Please let me know what to try next.

      Thanks, Hector

      Alex KushleyevA 1 Reply Last reply Reply Quote 0
      • Alex KushleyevA
        Alex Kushleyev ModalAI Team @Hector Gutierrez
        last edited by

        @Hector-Gutierrez , with the voxl-camera-server running on the foreground, please run the following and monitor the output of voxl-camera-server as well:

        voxl-inspect-cam -a
        

        This test should connect to ALL the camera streams generated by the voxl-camera-server and print out the stats.

        Alex

        Hector GutierrezH 1 Reply Last reply Reply Quote 0
        • Hector GutierrezH
          Hector Gutierrez @Alex Kushleyev
          last edited by

          @Alex-Kushleyev
          Thanks for the prompt reply. I receive the following output:
          Pipe Name | bytes | wide | hgt |exp(ms)| gain | frame id |latency(ms)| fps | mbpt
          | hires_large_color |18495360 | 4056 | 3040 | 16.67 | 747 | 1880 | 93.2 | 30.0 | 44422
          | hires_large_encoded | 2064 | 4056 | 3040 | 16.67 | 747 | 1879 | 100.0 | 30.0 | 0
          | hires_large_grey |12330240 | 4056 | 3040 | 16.67 | 747 | 1880 | 72.2 | 30.0 | 29618
          | hires_small_color | 1179648 | 1024 | 768 | 16.67 | 747 | 1880 | 50.4 | 30.0 | 2832
          | hires_small_encoded | 256 | 1024 | 768 | 16.67 | 747 | 1880 | 61.6 | 30.0 | 0
          | hires_small_grey | 786432 | 1024 | 768 | 16.67 | 747 | 1881 | 48.4 | 30.0 | 1888
          | hires_snapshot |
          | ov_overlay | 3235840 | 1280 | 2528 | 6.81 | 614 | 1640 | 84.2 | 4.7 | 1228
          | tracking_down | 1024000 | 1280 | 800 | 6.90 | 614 | 1647 | 34.1 | 30.0 | 2458
          | tracking_down_bayer | 1024000 | 1280 | 800 | 6.90 | 614 | 1647 | 33.7 | 30.0 | 2458
          | tracking_down_misp_grey | 1024000 | 1280 | 800 | 6.73 | 570 | 1648 | 33.3 | 30.0 | 2458
          | tracking_down_misp_norm | 1024000 | 1280 | 800 | 6.73 | 570 | 1648 | 36.3 | 30.0 | 2458
          | tracking_front | 1024000 | 1280 | 800 | 5.63 | 307 | 1648 | 33.5 | 30.0 | 2458
          | tracking_front_bayer | 1024000 | 1280 | 800 | 5.63 | 307 | 1648 | 33.7 | 30.0 | 2458
          | tracking_front_misp_grey | 1024000 | 1280 | 800 | 5.63 | 307 | 1648 | 30.2 | 30.0 | 2458
          | tracking_front_misp_norm | 1024000 | 1280 | 800 | 5.63 | 307 | 1648 | 35.5 | 30.0 | 2458
          | tracking_rear | 1024000 | 1280 | 800 | 5.32 | 192 | 1649 | 33.9 | 30.0 | 2458
          | tracking_rear_bayer | 1024000 | 1280 | 800 | 5.32 | 192 | 1649 | 33.1 | 30.0 | 2458
          | tracking_rear_misp_grey | 1024000 | 1280 | 800 | 5.32 | 192 | 1649 | 31.5 | 30.0 | 2458
          | tracking_rear_misp_norm | 1024000 | 1280 | 800 | 5.32 | 192 | 1649 | 35.1 | 30.0 | 2458

          Still dont see the ToF sensor ... Please advise
          Thanks, Hector

          Alex KushleyevA 1 Reply Last reply Reply Quote 0
          • Alex KushleyevA
            Alex Kushleyev ModalAI Team @Hector Gutierrez
            last edited by

            @Hector-Gutierrez ,
            OK, so it looks like that the 4 detected cameras are actually streaming data.

            I am not sure why voxl-portal is not showing any cameras. When you access the voxl-portal via browser, do you see the actual portal (with green menu bar at the top), but no cameras are listed in the Cameras section?

            How are you connected to the drone? (wifi, adb, etc).

            Regarding the TOF sensor, since voxl-camera-server -l did not show that the TOF sensor is detected, the stream is not available.

            Please double check that com.qti.sensormodule.irs2975c* file is in /usr/lib/camera/ directory - please provide the exact name or let me know if it's missing.

            Also, can you please take a picture of your cameras plugged into the M0173 camera front end? I just want to make sure the TOF sensor is plugged in correctly.

            Alex

            Hector GutierrezH 1 Reply Last reply Reply Quote 0
            • Hector GutierrezH
              Hector Gutierrez @Alex Kushleyev
              last edited by

              @Alex-Kushleyev
              Hi Alex, I disassembled and reassembled the camera board and now I get 4 cameras in VOXL Portal ! I did reconnect the ToF sensor as well to the camera board, it seems properly connected.
              The cameras working well are hires_large_color, and all three tracking cameras. I still dont see the ToF sensor , and the view of the hires camera is blurry (out of focus). The hires camera was recently replaced, so how to get it into focus is another question.
              I listed the files on /usr/lib/camera and found this file: com.qti.sensormodule.irs2975c_3.bin
              So now we are down to the ToF sensor (and to put the hires camera in focus). Let me know what to try next !
              thanks, Hector

              Alex KushleyevA Hector GutierrezH 2 Replies Last reply Reply Quote 0
              • Alex KushleyevA
                Alex Kushleyev ModalAI Team @Hector Gutierrez
                last edited by

                @Hector-Gutierrez , in order to focus the hires camera (I am assuming IMX412), you can twist the lens in the M12 lens holder. Normally we do focus the hires cameras to a norminal focus distance, but maybe you had one from earlier batch which was not focused. Also, focus of the camera depends on the application, so it is recommended for users to double check and correct the focus for their needs. If there is some sealant on the threads, it is not permanent and can be removed using tweezers - loosening it up a bit should allow you to twist the lens inside the holder.

                Regarding the PMD TOF, not sure yet. Has it worked before?

                Alex

                1 Reply Last reply Reply Quote 0
                • Hector GutierrezH
                  Hector Gutierrez @Hector Gutierrez
                  last edited by

                  @Hector-Gutierrez
                  Hi Alex - As you suggested, the focus issue was resolved by twisting the lens until good focus at 3 m. was achieved.
                  The TOF sensor remains a problem. I've tried detaching and reconnecting its cable (on both ends) but no luck so far.
                  Both VOXL Portal and voxl-camera-server -l only see 4 cameras.
                  We didnt use the TOF sensor before so I didnt notice if it was working previously or not.
                  Please let me know what to try next - thanks, Hector

                  Alex KushleyevA 1 Reply Last reply Reply Quote 0
                  • Alex KushleyevA
                    Alex Kushleyev ModalAI Team @Hector Gutierrez
                    last edited by

                    @Hector-Gutierrez , can you please send a picture of the TOF sensor connected to M0173? Just to make sure the connections are correct.

                    Hector GutierrezH 1 Reply Last reply Reply Quote 0
                    • Hector GutierrezH
                      Hector Gutierrez @Alex Kushleyev
                      last edited by

                      @Alex-Kushleyev
                      Hi Alex - attached are some pictures of the connection. Something odd is happening. The connector engages its socket in two different locations relative to the hole for the screw. In the centered location (where it should be!) the TOF sensor causes a power short and the drone wont boot (see picture with red LED). In the off-center location there is no short and the drone boots, but I only get 4 cameras and the TOF is not visible.
                      ![centered.jpg](Request Entity Too Large) ![off-center1.jpg](Request Entity Too Large) ![off-center2.jpg](Request Entity Too Large) ![power-short.jpg](Request Entity Too Large)

                      Hector GutierrezH 1 Reply Last reply Reply Quote 0
                      • Hector GutierrezH
                        Hector Gutierrez @Hector Gutierrez
                        last edited by

                        @Hector-Gutierrez
                        Download link for the pictures in case they did not attach to previous message:
                        https://quickconnect.to/asapstorage/d/s/13iMi9oRZUxhkQYoW2DCHtZ7nI9HgYJx/bj3PLF8EXd5pKdKgwphVqcbD7VaaMBQX-V7WAgk58WAw

                        Hector GutierrezH 1 Reply Last reply Reply Quote 0
                        • Hector GutierrezH
                          Hector Gutierrez @Hector Gutierrez
                          last edited by

                          @Hector-Gutierrez
                          Update from my previous post. I install the TOF connector in the centered location and fully attach the screws (including the one that secures the TOF ribbon cable). There is no short, the drone start normally, and I get 4 cameras on VOXL portal, but no TOF. Also voxl-camera-server -l only see 4 cameras. So TOF connection is definitely Ok, but sensor not present.

                          Alex KushleyevA 1 Reply Last reply Reply Quote 0
                          • Alex KushleyevA
                            Alex Kushleyev ModalAI Team @Hector Gutierrez
                            last edited by

                            @Hector-Gutierrez , I am sorry, i was not able to access the image you shared. Can you please just resize / crop the image so that it fits into the forum? Just please make sure the details are still easy to see.

                            Thank you!

                            Alex

                            Hector GutierrezH 1 Reply Last reply Reply Quote 0
                            • Hector GutierrezH
                              Hector Gutierrez @Alex Kushleyev
                              last edited by

                              @Alex-Kushleyev
                              Hi Alex - attached are the pictures. centered.jpg off-center1.jpg

                              After installing the TOF connector in the centered location and fully attach all the screws (including the one that secures the TOF ribbon cable), there is no short and the drone starts normally. I get 4 cameras on VOXL portal, but no TOF. Also voxl-camera-server -l only see 4 cameras. So TOF connection seems definitely Ok, but sensor not present. Seems to me like a bad TOF sensor - let me know your thoughts.

                              Hector GutierrezH 1 Reply Last reply Reply Quote 0
                              • Hector GutierrezH
                                Hector Gutierrez @Hector Gutierrez
                                last edited by

                                @Hector-Gutierrez Clarification on the pictures. The top picture is the centered position of the TOF ribbon cable. The bottom picture can be disregarded. The connection is done on the centered position (top picture). Thanks.

                                1 Reply Last reply Reply Quote 0
                                • First post
                                  Last post
                                Powered by NodeBB | Contributors