ModalAI Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login
    1. Home
    2. eric
    3. Topics
    E
    • Profile
    • Following 0
    • Followers 0
    • Topics 5
    • Posts 25
    • Best 1
    • Controversial 0
    • Groups 0

    Topics created by eric

    • E

      Voxl2 Docker (Ubuntu 22) with OpenCL/Adreno

      Ask your questions right here!
      • • • eric
      16
      0
      Votes
      16
      Posts
      1480
      Views

      E

      @Alex-Kushleyev Awesome! Thanks again for all your help with this!

    • E

      voxl-dfs-server: stereo pointcloud coordinate frame

      Ask your questions right here!
      • • • eric
      4
      0
      Votes
      4
      Posts
      320
      Views

      James StrawsonJ

      Hi Eric,

      The stereo camera pair intrinsics and extrinsics are saved to /data/modalai/opencv_stereo_intrinsics.yaml and /data/modalai/opencv_stereo_extrinsics.yaml

      We then use the following opencv calls to generate the rectification maps for each left and right image

      cv::Mat R1, P1, R2, P2; cv::Mat map11, map12, map21, map22; cv::Mat Q; // Output 4×4 disparity-to-depth mapping matrix, to be used later double alpha = -1; // default scaling, similar to our "zoom" parameter cv::stereoRectify(M1, D1, M2, D2, img_size, R, T, R1, R2, P1, P2, Q, cv::CALIB_ZERO_DISPARITY, alpha, img_size); // make sure this uses CV_32_FC2 map format so we can read it and convert to our own // MCV undistortion map format, map12 and 22 are empty/unused!! cv::initUndistortRectifyMap(M1, D1, R1, P1, img_size, CV_32FC2, map11, map12); cv::initUndistortRectifyMap(M2, D2, R2, P2, img_size, CV_32FC2, map21, map22);

      Those maps then get converted into a format that can be used by the Qualcomm hardware acceleration blocks for image dewarping, but the fundamental matrices and undistortion coefficients stay the same. I think the above lines is what you are after.

      You are correct that the disparity map is centered about the left camera, I believe this is typical in OpenCV land too.

      Note that we do not do a precise calibration between the Stereo and Hires Cameras from the factory, depending on how precise you need to alignment to be you may need to use a tool like Kalibr to do that.

    • E

      Are SELECT_TF_OPS supported on VOXL2?

      Ask your questions right here!
      • tflite tflite-server voxl2 • • eric
      2
      0
      Votes
      2
      Posts
      195
      Views

      ?

      @eric

      Sorry for the late response on this!!

      Your best bet would be to just try it out, I can't say without trying it myself. It's possible it works, it's possible something fails. I've never had to deal with this so I can't say for certain.

      It's also worth pointing out that voxl-tflite-server is more meant to be an example of how TFLite models can be run on VOXL and not an in-depth ML framework for deploying custom models. If voxl-tflite-server doesn't support it, by all means fork the repository and build out the functionality to be able to. Even better, make a pull request with that functionality and I'll test and approve it!

      Hope this helps,

      Thomas Patton

    • E

      RB5 System Clock Issues

      Qualcomm Flight RB5 5G Drone
      • rb5 steady clock system clock synchronization linux • • eric
      4
      0
      Votes
      4
      Posts
      482
      Views

      E

      FWIW, we are not seeing this issue on the VOXL2 flightdeck (which does not use voxl-px4-imu-server)

      @Moderator Is there someone else I should tag for this issue if you are unable to provide support?

    • E

      ROS IMU timing quality issues on RB5

      Qualcomm Flight RB5 5G Drone
      • voxl-mpa-tools voxl-mpa-to-ros rb5 imu synchronization • • eric
      13
      0
      Votes
      13
      Posts
      1056
      Views

      E

      @Moderator Unfortunately, there is not a way to configure ROS1 to use steady_clock instead of system_clock. In ROS2, it seems that this is configurable, but ModalAI does not support ROS2.