Offboard mode not working

Jetson Nano

Thanks a lot for helping me with the integration of my VOXL2 with Cube Orange. It is working well. I am also using it with the ToF, HighRes, and tracking camera from ModalAI.
Position hold using VIO and Semi-Autonomous (VOA) are also working well.

Now, I am facing an issue with the offboard mode. The moment I switch to offboard, the drone aggressively moves and crashes. (in both "figure_eight and "trajectory"). [In the offboard mode = "off", I am not able to switch to offboard. ]

There are no error messages in QGC or otherwise. Except offboard everything else works.
Could please help with this issue?
I'm working on this as a priority, so any suggestion will be quickly tested. I hope to hear from you.

Thank you