Starling Hires camera extrinsics

[Darshit Desai]

@Moderator According to the CAD it is this values which I think should be hires camera extrinsics

{
                        "parent": "body",
                        "child":  "rgbcamera",
                        "T_child_wrt_parent": [0.068, 0.012, -0.015],
                        "RPY_parent_to_child":    Not sure
                },

[Alex Kushleyev]

@Darshit-Desai , have you checked this video? i think it will be helpful : https://www.youtube.com/watch?v=-P20LV2AB4Y

[Darshit Desai]

@Alex-Kushleyev Yes I checked this video and I basically don't have digital vernier calipers so, i was taking a reference from the cad model, I assumed that the RPY would be the same as the body to tof frame. The only thing not shown in the video is what constitutes a body frame, the video talks about imus and other stuff but it doesn't talk about body frame. So I took an approximate mid point of the starling drone as body frames coordinate axes

[Alex Kushleyev]

@Darshit-Desai , yes you should get the xyz offsets from the cad.

The RPY rotation should be [0,90,90]. It is similar to the tracking camera rotation in the video, but instead of 45 degree rotation about Y axis, you need to go full 90, so that Z axis looks straight out, as the Z axis of hires camera does.

[Darshit Desai]

@Alex-Kushleyev Ok thanks I was confused about orientation and considered the RPY vector for hires to be the same as ToF {0, 90 ,180]

But is my assumption of the body frame coordinate axes at the centroid of the drone correct? Because what I need is the transformation from body to hires. I actually want to transform the point cloud from ToF's frame of reference to the body frame of reference and back to the RGB camera's frame of reference

[Alex Kushleyev]

@Darshit-Desai, TOF has a rotation of 180 because it is actually oriented vertically inside the front of the vehicle

[Darshit Desai]

@Alex-Kushleyev And how about the body frame's location? As per my measurements from the CAD for the translations of ToF and hires it should be at centroid of the drone, is it the same?

[Alex Kushleyev]

Yes coordinates wrt to body should be measured wrt to center of the drone with x=forward, y=right and z= down. So your camera will be in front (that is x will be positive).. and so on (similar how TOF translation works). It seems the body to tof translation for TOF above (0.1,0,0) is approximate based on numbers being exactly zero

[Alex Kushleyev]

You should get the translation from CAD between the center of the body (which can be estimated by an intersection of lines connecting two motor pairs) and the center of the hires camera module. You will get the 3 numbers and make sure you apply them correctly using the XYZ convention that the body uses (which may be different from the convention used in CAD viewer)

[Darshit Desai]

@Darshit-Desai said in Starling Hires camera extrinsics:

}, {
"parent": "body",
"child": "tof",
"T_child_wrt_parent": [0.068, -0.0116, -0.0168],
"RPY_parent_to_child": [0, 90, 180]

Actually @Alex-Kushleyev you saw the wrong file, I later found this inisde voxlextrinsics conf in voxl2 starling its not exactly zero its some value. Based on that I measured using the coordinate convention you mentioned and figured that the centroid of the drone frame would be the origin of the body frame's coordinate axis

[Alex Kushleyev]

@Darshit-Desai OK, so is it clear now?

[Darshit Desai]

@Alex-Kushleyev said in Starling Hires camera extrinsics:

actually oriented vertically inside the front of the vehicle

What does this mean? Is it rotated somehow by 90 degrees along the z axis?

[Alex Kushleyev]

@Darshit-Desai , the TOF sensor looks like this https://www.modalai.com/products/voxl-dk-tof, it is shown in horizontal (normal) orientation. You can see in Starling that it is in vertial orientation (https://docs.modalai.com/starling-v2/)

[Darshit Desai]

@Alex-Kushleyev Oh yes now I got it thanks

[Darshit Desai]

@Alex-Kushleyev just a sanity check for my understanding in the below markup I have considered MAVROS FLU (I've not considered the PX4 frame since I will be using mavros) frame as the reference frame and the rest of the tof and hires frames are shown below, is the tof frame represented correctly?

ToF frame is the smaller axes i.e., one on the top right side and hires is on the bottom left

[Alex Kushleyev]

@Darshit-Desai , yes i believe you are showing the TOF and Hires camera local frames correctly.

As for the vehicle, the convention we normally use is FRD, but since you mentioned that you are assuming FLU in your case, that also looks correct.