Hires With AprilTags

[jacob yaacubov]

Hi guys i have a hires IMX412 mounted on my drone , my camera is looking to the right side of the drone (Positive y axis on the local frame)

I have configured the tag rotation matrix from tag to fixed correctly my tag is hanged on the wall.

but seems the drone rotating 90 degrees CCW, I guess its doing this since it assumes the camera which is catching the tag, is mounted at the front
hence, when right side camera sees the tag it rotates to the left (ccw) to "fix" this!

I tried to add extrinsics to extrinsics.conf both from IMU to hires and from body to hires with the correct camera name (which used in voxl-camera-server)
but it has no effect
any one had this issue ? any suggestions ? does the voxl code is really taking into account that tags are seen only in front of the drone (X axis)

Thanks

[jacob yaacubov]

@jacob-yaacubov the picture describes TOP VIEW the tag is attached to a wall

[Alex Kushleyev]

@jacob-yaacubov , it seems the voxl tag detector sends out the tag info with respect to the camera (not drone) frame : https://gitlab.com/voxl-public/voxl-sdk/services/voxl-tag-detector/-/blob/master/server/main.cpp

You can check the consumer of the tag data to see what transforms it is using to put the tag in the global frame.

Alex

[jacob yaacubov]

@Alex-Kushleyev
basically the consumer is the vision hub
specifically [https://gitlab.com/voxl-public/voxl-sdk/services/voxl-vision-hub/-/blob/v1.7.3/src/geometry.c?ref_type=tags](link url)
as far as i understood
and i am trying to fix the right part

the issue lies in this transformation i marked red .. i think i need to change the cam_wrt_to_imu since it looks like
the code assumes my hires in looking forward of the drone while its actually mounted on the right side ( Local frames Y axis)
so tag works well and detection of my tag on fixed is Ok but when afterwards drown is moving with just qvio without tag the axis are flipped

voxl-vision-hub -g output
example

y can see that fixed_wrt_local x=-0.83 while it corresponds to the local_wrt_fixed y= 0.83 so the frames i get from both arrow in the pic above are not the same do you have suggestions where should i start with , should i modify the geometry.c?

[Alex Kushleyev]

@jacob-yaacubov , I am not 100% sure but it looks like the code assumes that the tags are being detected by the same camera that is doing vio (tracking camera). In your case this assumption is not true, because you are using Hires camera for the tag detection.

I need to check with @James-Strawson about this, but he is out of office. I will ask around.

Alex

[jacob yaacubov]

@Alex-Kushleyev yes seems like it, thank you!