• Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Groups
  • Register
  • Login
ModalAI Forum
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Groups
    • Register
    • Login

    voxl-open-vins-server How to Use, Overall Questions, ROS/ROS2 Findings

    Ask your questions right here!
    5
    11
    1.4k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • M
      Moderator ModalAI Team @zauberflote1
      last edited by Moderator 21 Mar 2024, 15:06 21 Mar 2024, 15:05

      @zauberflote1 Hi, that open-vins package is in early alpha stages. So, it's completely undocumented and we aren't supporting it at this point. We'll look into your question though and see if we can find something

      Z 1 Reply Last reply 21 Mar 2024, 16:36 Reply Quote 0
      • Z
        zauberflote1 ModalAI Team @Moderator
        last edited by 21 Mar 2024, 16:36

        @Moderator Thanks,
        a Gitlab repo link would suffice in case documentation is not available.

        1 Reply Last reply Reply Quote 0
        • C
          Cliff Wong ModalAI Team
          last edited by 22 Mar 2024, 20:40

          Hi there, yes, unfortunately the repo for OpenVINS is still under construction as it's under active development by the ModalAI team. We'll have it available soon

          voxl-open-vins-server does a similar process to the ROS implementation when using camera data--in order to sync frames, data comes in a stereo-type packet. During camera calibration, instead of Kalibr, we are using our own voxl-calibrate-camera implementation that comes with the SDK. And as needed, one can turn off the stereo output in voxl-camera-server and calibrate each camera individually. That would be best on the ROS side as well where you can use split the images from camera-server like this before publishing to Kalibr (where 2 topics work best for openvins), then calibrate independently.

          You could try voxl-calibrate-camera instead and yes it will output opencv-format intrinsics where you can copy the needed values into the ROS launch file. We create extrinsics using mechanical design. In both cases, OpenVINS will refine them at runtime during the first few seconds of operation.

          You can upgrade to the latest dev version via editing your /etc/apt/sources.list.d/modalai.list on voxl2 to point to the dev repo. Then run apt update && apt upgrade voxl-open-vins-server. Looking at the /etc/modalai/voxl-open-server.conf may give you some ideas on how the roslaunch file can be setup as well.

          Z 2 Replies Last reply 28 Mar 2024, 15:42 Reply Quote 0
          • Z
            zauberflote1 ModalAI Team @Cliff Wong
            last edited by 28 Mar 2024, 15:42

            @Cliff-Wong Hey Cliff,
            Thanks for your reply! I have solved the issue. It's a bit of a long solve, but I'll outline the main steps.
            For proper calibration IMU-Cam calibration, we cannot have a burst of measurements like we have when running the IMU in FIFO mode. Therefore, the best way to get around this is to use IMU in basic read mode. Also, I was able to achieve good VINS results running the IMU at 500Hz and 200Hz. I opted to remodel the IMU server to have it "fully" in ROS without the need for MPA, while maintaining the FIFO scheduler for "RT". This decision reduced the sampling jitter by a lot (about 50%). Still, jitter is present, while looking at the core load distribution, I noticed that sometimes all the processes get allocated to core 7 until it bounces back to another favorable core distribution, creating a tiny lag on the system and, consequently, causing the jitter -- of course, this is a hypothesis. I was wondering if you had faced the same situation and if you or your teammates have thought of the possibility of restricting specific cores for real-time operations, which would avoid this weird allocation.
            Here are the results:
            BasicReadServerMPA.png FIFOSERVERMPA.png 500IMUROS.png 200IMUROS.png

            Best,
            --ZBFT

            C 1 Reply Last reply 13 Sept 2024, 03:38 Reply Quote 0
            • Z
              zauberflote1 ModalAI Team @Cliff Wong
              last edited by 28 Mar 2024, 15:45

              @Cliff-Wong
              Image Description:
              1)BsicRead Server Using MPA-ROS
              2)Classic Server and MPA-ROS
              3)IMU ROS ~500Hz
              4)IMU ROS ~200Hz

              Z 1 Reply Last reply 28 Mar 2024, 15:54 Reply Quote 0
              • Z
                zauberflote1 ModalAI Team @zauberflote1
                last edited by 28 Mar 2024, 15:54

                @zauberflote1
                Forgot to mention that a way to reduce jitter is also by checking if the interrupt DTA Rdy is true before reading, avoiding reading past info from the registers.
                Sorry for the many messages

                T 1 Reply Last reply 2 Sept 2024, 06:56 Reply Quote 0
                • T
                  tiralonghipol @zauberflote1
                  last edited by 2 Sept 2024, 06:56

                  @zauberflote1 hei! we are facing a similar issue, do you have a link for your implementation? thanks!

                  Z 1 Reply Last reply 13 Sept 2024, 02:37 Reply Quote 0
                  • Z
                    zauberflote1 ModalAI Team @tiralonghipol
                    last edited by 13 Sept 2024, 02:37

                    @tiralonghipol and community
                    Here it is,
                    https://github.com/zauberflote1/voxlSyncVINS

                    T 1 Reply Last reply 13 Sept 2024, 03:27 Reply Quote 2
                    • T
                      tiralonghipol @zauberflote1
                      last edited by 13 Sept 2024, 03:27

                      @zauberflote1 amazing, thank you

                      1 Reply Last reply Reply Quote 0
                      • C
                        coreyazion @zauberflote1
                        last edited by 13 Sept 2024, 03:38

                        @zauberflote1 said in voxl-open-vins-server How to Use, Overall Questions, ROS/ROS2 Findings:

                        decision reduced the sampling jitter b

                        Thank you for sharing your insights and great work!

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post
                        Powered by NodeBB | Contributors