ModalAI Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Starling 2: TOF sensor not recognized by VOXL Portal

    Starling & Starling 2
    3
    21
    429
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Hector GutierrezH
      Hector Gutierrez @Alex Kushleyev
      last edited by

      @Alex-Kushleyev
      Thanks for the prompt reply. I receive the following output:
      Pipe Name | bytes | wide | hgt |exp(ms)| gain | frame id |latency(ms)| fps | mbpt
      | hires_large_color |18495360 | 4056 | 3040 | 16.67 | 747 | 1880 | 93.2 | 30.0 | 44422
      | hires_large_encoded | 2064 | 4056 | 3040 | 16.67 | 747 | 1879 | 100.0 | 30.0 | 0
      | hires_large_grey |12330240 | 4056 | 3040 | 16.67 | 747 | 1880 | 72.2 | 30.0 | 29618
      | hires_small_color | 1179648 | 1024 | 768 | 16.67 | 747 | 1880 | 50.4 | 30.0 | 2832
      | hires_small_encoded | 256 | 1024 | 768 | 16.67 | 747 | 1880 | 61.6 | 30.0 | 0
      | hires_small_grey | 786432 | 1024 | 768 | 16.67 | 747 | 1881 | 48.4 | 30.0 | 1888
      | hires_snapshot |
      | ov_overlay | 3235840 | 1280 | 2528 | 6.81 | 614 | 1640 | 84.2 | 4.7 | 1228
      | tracking_down | 1024000 | 1280 | 800 | 6.90 | 614 | 1647 | 34.1 | 30.0 | 2458
      | tracking_down_bayer | 1024000 | 1280 | 800 | 6.90 | 614 | 1647 | 33.7 | 30.0 | 2458
      | tracking_down_misp_grey | 1024000 | 1280 | 800 | 6.73 | 570 | 1648 | 33.3 | 30.0 | 2458
      | tracking_down_misp_norm | 1024000 | 1280 | 800 | 6.73 | 570 | 1648 | 36.3 | 30.0 | 2458
      | tracking_front | 1024000 | 1280 | 800 | 5.63 | 307 | 1648 | 33.5 | 30.0 | 2458
      | tracking_front_bayer | 1024000 | 1280 | 800 | 5.63 | 307 | 1648 | 33.7 | 30.0 | 2458
      | tracking_front_misp_grey | 1024000 | 1280 | 800 | 5.63 | 307 | 1648 | 30.2 | 30.0 | 2458
      | tracking_front_misp_norm | 1024000 | 1280 | 800 | 5.63 | 307 | 1648 | 35.5 | 30.0 | 2458
      | tracking_rear | 1024000 | 1280 | 800 | 5.32 | 192 | 1649 | 33.9 | 30.0 | 2458
      | tracking_rear_bayer | 1024000 | 1280 | 800 | 5.32 | 192 | 1649 | 33.1 | 30.0 | 2458
      | tracking_rear_misp_grey | 1024000 | 1280 | 800 | 5.32 | 192 | 1649 | 31.5 | 30.0 | 2458
      | tracking_rear_misp_norm | 1024000 | 1280 | 800 | 5.32 | 192 | 1649 | 35.1 | 30.0 | 2458

      Still dont see the ToF sensor ... Please advise
      Thanks, Hector

      Alex KushleyevA 1 Reply Last reply Reply Quote 0
      • Alex KushleyevA
        Alex Kushleyev ModalAI Team @Hector Gutierrez
        last edited by

        @Hector-Gutierrez ,
        OK, so it looks like that the 4 detected cameras are actually streaming data.

        I am not sure why voxl-portal is not showing any cameras. When you access the voxl-portal via browser, do you see the actual portal (with green menu bar at the top), but no cameras are listed in the Cameras section?

        How are you connected to the drone? (wifi, adb, etc).

        Regarding the TOF sensor, since voxl-camera-server -l did not show that the TOF sensor is detected, the stream is not available.

        Please double check that com.qti.sensormodule.irs2975c* file is in /usr/lib/camera/ directory - please provide the exact name or let me know if it's missing.

        Also, can you please take a picture of your cameras plugged into the M0173 camera front end? I just want to make sure the TOF sensor is plugged in correctly.

        Alex

        Hector GutierrezH 1 Reply Last reply Reply Quote 0
        • Hector GutierrezH
          Hector Gutierrez @Alex Kushleyev
          last edited by

          @Alex-Kushleyev
          Hi Alex, I disassembled and reassembled the camera board and now I get 4 cameras in VOXL Portal ! I did reconnect the ToF sensor as well to the camera board, it seems properly connected.
          The cameras working well are hires_large_color, and all three tracking cameras. I still dont see the ToF sensor , and the view of the hires camera is blurry (out of focus). The hires camera was recently replaced, so how to get it into focus is another question.
          I listed the files on /usr/lib/camera and found this file: com.qti.sensormodule.irs2975c_3.bin
          So now we are down to the ToF sensor (and to put the hires camera in focus). Let me know what to try next !
          thanks, Hector

          Alex KushleyevA Hector GutierrezH 2 Replies Last reply Reply Quote 0
          • Alex KushleyevA
            Alex Kushleyev ModalAI Team @Hector Gutierrez
            last edited by

            @Hector-Gutierrez , in order to focus the hires camera (I am assuming IMX412), you can twist the lens in the M12 lens holder. Normally we do focus the hires cameras to a norminal focus distance, but maybe you had one from earlier batch which was not focused. Also, focus of the camera depends on the application, so it is recommended for users to double check and correct the focus for their needs. If there is some sealant on the threads, it is not permanent and can be removed using tweezers - loosening it up a bit should allow you to twist the lens inside the holder.

            Regarding the PMD TOF, not sure yet. Has it worked before?

            Alex

            1 Reply Last reply Reply Quote 0
            • Hector GutierrezH
              Hector Gutierrez @Hector Gutierrez
              last edited by

              @Hector-Gutierrez
              Hi Alex - As you suggested, the focus issue was resolved by twisting the lens until good focus at 3 m. was achieved.
              The TOF sensor remains a problem. I've tried detaching and reconnecting its cable (on both ends) but no luck so far.
              Both VOXL Portal and voxl-camera-server -l only see 4 cameras.
              We didnt use the TOF sensor before so I didnt notice if it was working previously or not.
              Please let me know what to try next - thanks, Hector

              Alex KushleyevA 1 Reply Last reply Reply Quote 0
              • Alex KushleyevA
                Alex Kushleyev ModalAI Team @Hector Gutierrez
                last edited by

                @Hector-Gutierrez , can you please send a picture of the TOF sensor connected to M0173? Just to make sure the connections are correct.

                Hector GutierrezH 1 Reply Last reply Reply Quote 0
                • Hector GutierrezH
                  Hector Gutierrez @Alex Kushleyev
                  last edited by

                  @Alex-Kushleyev
                  Hi Alex - attached are some pictures of the connection. Something odd is happening. The connector engages its socket in two different locations relative to the hole for the screw. In the centered location (where it should be!) the TOF sensor causes a power short and the drone wont boot (see picture with red LED). In the off-center location there is no short and the drone boots, but I only get 4 cameras and the TOF is not visible.
                  ![centered.jpg](Request Entity Too Large) ![off-center1.jpg](Request Entity Too Large) ![off-center2.jpg](Request Entity Too Large) ![power-short.jpg](Request Entity Too Large)

                  Hector GutierrezH 1 Reply Last reply Reply Quote 0
                  • Hector GutierrezH
                    Hector Gutierrez @Hector Gutierrez
                    last edited by

                    @Hector-Gutierrez
                    Download link for the pictures in case they did not attach to previous message:
                    https://quickconnect.to/asapstorage/d/s/13iMi9oRZUxhkQYoW2DCHtZ7nI9HgYJx/bj3PLF8EXd5pKdKgwphVqcbD7VaaMBQX-V7WAgk58WAw

                    Hector GutierrezH 1 Reply Last reply Reply Quote 0
                    • Hector GutierrezH
                      Hector Gutierrez @Hector Gutierrez
                      last edited by

                      @Hector-Gutierrez
                      Update from my previous post. I install the TOF connector in the centered location and fully attach the screws (including the one that secures the TOF ribbon cable). There is no short, the drone start normally, and I get 4 cameras on VOXL portal, but no TOF. Also voxl-camera-server -l only see 4 cameras. So TOF connection is definitely Ok, but sensor not present.

                      Alex KushleyevA 1 Reply Last reply Reply Quote 0
                      • Alex KushleyevA
                        Alex Kushleyev ModalAI Team @Hector Gutierrez
                        last edited by

                        @Hector-Gutierrez , I am sorry, i was not able to access the image you shared. Can you please just resize / crop the image so that it fits into the forum? Just please make sure the details are still easy to see.

                        Thank you!

                        Alex

                        Hector GutierrezH 2 Replies Last reply Reply Quote 0
                        • Hector GutierrezH
                          Hector Gutierrez @Alex Kushleyev
                          last edited by

                          @Alex-Kushleyev
                          Hi Alex - attached are the pictures. centered.jpg off-center1.jpg

                          After installing the TOF connector in the centered location and fully attach all the screws (including the one that secures the TOF ribbon cable), there is no short and the drone starts normally. I get 4 cameras on VOXL portal, but no TOF. Also voxl-camera-server -l only see 4 cameras. So TOF connection seems definitely Ok, but sensor not present. Seems to me like a bad TOF sensor - let me know your thoughts.

                          Hector GutierrezH 1 Reply Last reply Reply Quote 0
                          • Hector GutierrezH
                            Hector Gutierrez @Hector Gutierrez
                            last edited by

                            @Hector-Gutierrez Clarification on the pictures. The top picture is the centered position of the TOF ribbon cable. The bottom picture can be disregarded. The connection is done on the centered position (top picture). Thanks.

                            1 Reply Last reply Reply Quote 0
                            • Hector GutierrezH
                              Hector Gutierrez @Alex Kushleyev
                              last edited by

                              @Alex-Kushleyev - Any updates on this thread ? Let me know if there is anything else I could try or if you consider this a hardware problem with the PMD sensor itself. Thanks, Hector

                              1 Reply Last reply Reply Quote 0
                              • First post
                                Last post
                              Powered by NodeBB | Contributors