ModalAI Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Starling Hires camera extrinsics

    Starling & Starling 2
    2
    18
    1127
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Darshit DesaiD
      Darshit Desai @Darshit Desai
      last edited by

      @Moderator According to the CAD it is this values which I think should be hires camera extrinsics

      {
                              "parent": "body",
                              "child":  "rgbcamera",
                              "T_child_wrt_parent": [0.068, 0.012, -0.015],
                              "RPY_parent_to_child":    Not sure
                      },
      

      af61aa8f-e831-4028-b7e6-26d5dc28a545-image.png

      Alex KushleyevA 1 Reply Last reply Reply Quote 0
      • Alex KushleyevA
        Alex Kushleyev ModalAI Team @Darshit Desai
        last edited by

        @Darshit-Desai , have you checked this video? i think it will be helpful : https://www.youtube.com/watch?v=-P20LV2AB4Y

        Darshit DesaiD 1 Reply Last reply Reply Quote 0
        • Darshit DesaiD
          Darshit Desai @Alex Kushleyev
          last edited by Darshit Desai

          @Alex-Kushleyev Yes I checked this video and I basically don't have digital vernier calipers so, i was taking a reference from the cad model, I assumed that the RPY would be the same as the body to tof frame. The only thing not shown in the video is what constitutes a body frame, the video talks about imus and other stuff but it doesn't talk about body frame. So I took an approximate mid point of the starling drone as body frames coordinate axes

          Alex KushleyevA 1 Reply Last reply Reply Quote 0
          • Alex KushleyevA
            Alex Kushleyev ModalAI Team @Darshit Desai
            last edited by

            @Darshit-Desai , yes you should get the xyz offsets from the cad.

            The RPY rotation should be [0,90,90]. It is similar to the tracking camera rotation in the video, but instead of 45 degree rotation about Y axis, you need to go full 90, so that Z axis looks straight out, as the Z axis of hires camera does.

            Darshit DesaiD 1 Reply Last reply Reply Quote 0
            • Darshit DesaiD
              Darshit Desai @Alex Kushleyev
              last edited by Darshit Desai

              @Alex-Kushleyev Ok thanks I was confused about orientation and considered the RPY vector for hires to be the same as ToF {0, 90 ,180]

              But is my assumption of the body frame coordinate axes at the centroid of the drone correct? Because what I need is the transformation from body to hires. I actually want to transform the point cloud from ToF's frame of reference to the body frame of reference and back to the RGB camera's frame of reference

              Alex KushleyevA 1 Reply Last reply Reply Quote 0
              • Alex KushleyevA
                Alex Kushleyev ModalAI Team @Darshit Desai
                last edited by

                @Darshit-Desai, TOF has a rotation of 180 because it is actually oriented vertically inside the front of the vehicle

                Darshit DesaiD Alex KushleyevA 3 Replies Last reply Reply Quote 0
                • Darshit DesaiD
                  Darshit Desai @Alex Kushleyev
                  last edited by Darshit Desai

                  @Alex-Kushleyev And how about the body frame's location? As per my measurements from the CAD for the translations of ToF and hires it should be at centroid of the drone, is it the same?

                  1 Reply Last reply Reply Quote 0
                  • Alex KushleyevA
                    Alex Kushleyev ModalAI Team @Alex Kushleyev
                    last edited by Alex Kushleyev

                    Yes coordinates wrt to body should be measured wrt to center of the drone with x=forward, y=right and z= down. So your camera will be in front (that is x will be positive).. and so on (similar how TOF translation works). It seems the body to tof translation for TOF above (0.1,0,0) is approximate based on numbers being exactly zero 🙂

                    Alex KushleyevA 1 Reply Last reply Reply Quote 0
                    • Alex KushleyevA
                      Alex Kushleyev ModalAI Team @Alex Kushleyev
                      last edited by

                      You should get the translation from CAD between the center of the body (which can be estimated by an intersection of lines connecting two motor pairs) and the center of the hires camera module. You will get the 3 numbers and make sure you apply them correctly using the XYZ convention that the body uses (which may be different from the convention used in CAD viewer)

                      1 Reply Last reply Reply Quote 0
                      • Darshit DesaiD
                        Darshit Desai @Darshit Desai
                        last edited by

                        @Darshit-Desai said in Starling Hires camera extrinsics:

                        }, {
                        "parent": "body",
                        "child": "tof",
                        "T_child_wrt_parent": [0.068, -0.0116, -0.0168],
                        "RPY_parent_to_child": [0, 90, 180]

                        Actually @Alex-Kushleyev you saw the wrong file, I later found this inisde voxlextrinsics conf in voxl2 starling its not exactly zero its some value. Based on that I measured using the coordinate convention you mentioned and figured that the centroid of the drone frame would be the origin of the body frame's coordinate axis

                        Alex KushleyevA 1 Reply Last reply Reply Quote 0
                        • Alex KushleyevA
                          Alex Kushleyev ModalAI Team @Darshit Desai
                          last edited by

                          @Darshit-Desai OK, so is it clear now?

                          1 Reply Last reply Reply Quote 0
                          • Darshit DesaiD
                            Darshit Desai @Alex Kushleyev
                            last edited by

                            @Alex-Kushleyev said in Starling Hires camera extrinsics:

                            actually oriented vertically inside the front of the vehicle

                            What does this mean? Is it rotated somehow by 90 degrees along the z axis?

                            Alex KushleyevA 1 Reply Last reply Reply Quote 0
                            • Alex KushleyevA
                              Alex Kushleyev ModalAI Team @Darshit Desai
                              last edited by

                              @Darshit-Desai , the TOF sensor looks like this https://www.modalai.com/products/voxl-dk-tof, it is shown in horizontal (normal) orientation. You can see in Starling that it is in vertial orientation (https://docs.modalai.com/starling-v2/)

                              Darshit DesaiD 1 Reply Last reply Reply Quote 0
                              • Darshit DesaiD
                                Darshit Desai @Alex Kushleyev
                                last edited by

                                @Alex-Kushleyev Oh yes now I got it thanks

                                Darshit DesaiD 1 Reply Last reply Reply Quote 0
                                • Darshit DesaiD
                                  Darshit Desai @Darshit Desai
                                  last edited by Darshit Desai

                                  @Alex-Kushleyev just a sanity check for my understanding in the below markup I have considered MAVROS FLU (I've not considered the PX4 frame since I will be using mavros) frame as the reference frame and the rest of the tof and hires frames are shown below, is the tof frame represented correctly?

                                  ToF frame is the smaller axes i.e., one on the top right side and hires is on the bottom left

                                  7fd032e7-e1f7-41a7-ab79-be3b3a9c625d-image.png

                                  Alex KushleyevA 1 Reply Last reply Reply Quote 0
                                  • Alex KushleyevA
                                    Alex Kushleyev ModalAI Team @Darshit Desai
                                    last edited by

                                    @Darshit-Desai , yes i believe you are showing the TOF and Hires camera local frames correctly.

                                    As for the vehicle, the convention we normally use is FRD, but since you mentioned that you are assuming FLU in your case, that also looks correct.

                                    1 Reply Last reply Reply Quote 0
                                    • First post
                                      Last post
                                    Powered by NodeBB | Contributors