• Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Groups
  • Register
  • Login
ModalAI Forum
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Groups
    • Register
    • Login
    1. Home
    2. Software Development
    3. Video and Image Sensors
    Log in to post
    • Newest to Oldest
    • Oldest to Newest
    • Most Posts
    • Most Votes
    • Most Views
    • M

      Accessing the PMD TOF Data Programmatically

      • 21 Feb 2025, 17:19 • Moderator 21 Feb 2025, 21:01
      3
      0
      Votes
      3
      Posts
      157
      Views

      A 21 Feb 2025, 21:01

      and also a simple example here : https://gitlab.com/voxl-public/voxl-sdk/utilities/voxl-mpa-tools/-/blob/master/tools/voxl-inspect-tof.c?ref_type=heads

    • S

      Stereo Image sensor selection

      • 17 Mar 2025, 17:11 • SKA 18 Mar 2025, 02:11
      2
      0
      Votes
      2
      Posts
      129
      Views

      A 18 Mar 2025, 02:11

      Hello @SKA,

      The replacement for OV7251 in DFS use case (Depth From Stereo) will be AR0144 which is a 1280x800 resolution global shutter sensor, compared to 640x480 OV7251. The AR0144 camera is already available and we use for VIO (tracking) cameras.

      You would probably want to use the micro-coax version of AR0144 (M0166) because it will be much more flexible in terms of getting the wiring connected to VOXL2 (so M0166 + M0173 (Starling Camera Front End). Different cable lengths are available to support different base lines.

      Take a look at some camera bundle options : https://docs.modalai.com/voxl2-coax-camera-bundles/

      We are working on testing this configuration of dual AR0144 in DFS application and updating the DFS server to optimize performance. I expect to have an update in the next 1-2 weeks regarding the DFS performance.

      Alex

    • S

      DFS undistort issue

      • 4 Apr 2025, 00:48 • SKA 4 Apr 2025, 03:10
      2
      0
      Votes
      2
      Posts
      112
      Views

      A 4 Apr 2025, 03:10

      @SKA , this is most likely due to the max disparity value being too large - for 1280x800 resolution the maximum value is 32.

      the max disparity parameter limit is as follows:

      width <= 640 : max disparity = 64 (or less, in steps of 4) 640 < width <= 1280 : max disparity 32 (or less in steps of 4) 1280 < width <= 1920: 16, 12,8, or 4

      So in your case, you should update your max disparity parameter to 32 or less.

      I have been testing AR0144 DFS recently and i also found that i needed to increase the min_threshold and cost_threshold from the default of 10 that was used for OV7251. I found that values in the range of 50-80 produced good results.

      Here is some additional information regarding DFS:

      min_threshold:
      Lower bound for adjusting occlusion cost threshold.
      When set to < cost_threshold, the occlusion penalty
      is varied linearly from this minimum value from the first row
      to the last row.
      The last row takes cost_threshold.
      Range: 0 to 100
      Recommended range: 50 to 75
      min_threshold <= cost_threshold

      cost_threshold:
      Occlusion cost threshold.
      The higher the value, more smoothness is enforced.
      Range: 0 to 100
      Recommended range: 50 to 75

      Alex

    • N

      TOF Sensor on Starling 2 Sample Data, Application, & Specs

      • 24 Feb 2025, 19:05 • newdroneflyer 9 Apr 2025, 03:29
      2
      1
      Votes
      2
      Posts
      143
      Views

      A 9 Apr 2025, 03:29

      @newdroneflyer

      The different operating TOF modes (for the TOF V2 sensor on Starling 2) are described here in terms of power usage and fps : https://docs.modalai.com/M0178/#irs2975-operating-modes . We do not have exact information, but the different modes emit different amount of IR power and using different modulation schemes. The operating modes are tuned for the different ranges as stated (ultra short, short, mid long), which means depending on your application, you can choose one or the other.

      The number of sampling points per frame is the same for each mode, but FPS can be chosen based on what you need and it has to be within the provided specs (short range allows you to use higher fps).

      We have not done specific studies to measure the performance of the sensor to the detail that you are asking about.

      I can collect some data for you if you need. What format? There are also some tuning parameters, that can be tuned (can be found here with some comments : https://gitlab.com/voxl-public/voxl-sdk/services/voxl-camera-server/-/blob/master/src/tof_interface.cpp?ref_type=heads#L1033) . You would probably need to experiment yourself if you wanted to get the best performance out of the sensor.

      Alex

    • E

      Camera Issues, Missing Pipes, Lots of fun.

      • 25 Apr 2025, 15:35 • Evan Palmisano 25 Apr 2025, 18:50
      10
      0
      Votes
      10
      Posts
      233
      Views

      E 25 Apr 2025, 18:50

      @Alex-Kushleyev Yeah it was the cable. Getting hires feed now.

    • M

      Low Latency IMX412 Driver

      • 21 Apr 2025, 17:26 • Matthew Wellner 28 Apr 2025, 15:52
      32
      0
      Votes
      32
      Posts
      1.5k
      Views

      A 28 Apr 2025, 15:52

      @Matthew-Wellner , I am glad you got it working! When you used M0076 single camera interposer connected to VOXL2 J7, actually you were connecting to the "lower" camera slot, so that would be J7L, meaning slot ID 2, not 3. That is why your camera was not detected in that case.

      Regarding your M0084 not working, it could be a hardware issue in the flex cable or it's connectors. In order to figure this out, some more testing would be needed. Also, typically we suggest avoiding daisy chaining flex cables, so M0076 / M0135 allows you to do just that. It is possible that a combination of M0084 and another extension cable create sufficient signal distortion of the MIPI lines to cause CRC errors.

      Alex

    • h3roboticsH

      Single camera config

      • 27 Apr 2025, 01:28 • h3robotics 28 Apr 2025, 17:01
      3
      0
      Votes
      3
      Posts
      127
      Views

      h3roboticsH 28 Apr 2025, 17:01

      @Alex-Kushleyev Thank you for your reply. I want to set up a single IMX412 camera (with same settings to start with) for live video streaming. I also want EIS and found a recent topic with your comments which I will follow.

      For initial testing, I will be using the Starling 2 Adapter M0173 with one IMX412 camera. Once I purchase the single adapter (MDK-M0155-1), then I will use that instead.

      I will try out what you proposed. Will reach out if there are any issues 🙂

      Thank you.

      Regards.

    • S

      Micro-coax dual interposer board for M0166 cameras

      • 5 May 2025, 14:34 • SKA 6 May 2025, 04:14
      3
      0
      Votes
      3
      Posts
      133
      Views

      VinnyV 6 May 2025, 04:14

      Hi @SKA
      Alex's instincts are correct, we do not have a smaller plug in board for just tracking in a synce'd config. We only had an M0155 for one image sensor for a while, so your best bet is what Alex said and get the new M0188 for VOXL 2 Mini (VOXL 2 uses M0173, whereas VOXL 2 Mini uses M0188)
      It's quite cost competitive for what it does!!
      https://www.modalai.com/collections/all/products/m0188

    • Rowan DempsterR

      Do "tracking" cameras (e.g. ar0144) support the snapshot command?

      • 6 May 2025, 14:55 • Rowan Dempster 6 May 2025, 14:55
      1
      0
      Votes
      1
      Posts
      82
      Views

      No one has replied

    • V

      Hires image sensors and FPV goggles

      • 8 May 2025, 16:22 • victochen 9 May 2025, 14:43
      3
      0
      Votes
      3
      Posts
      159
      Views

      V 9 May 2025, 14:43

      @Moderator That's exciting, I'll be on the lookout. Thanks!

    • Rowan DempsterR

      Camera server: Preview stream stops when Large video activated

      • 7 May 2025, 20:43 • Rowan Dempster 14 May 2025, 13:40
      11
      0
      Votes
      11
      Posts
      339
      Views

      Rowan DempsterR 14 May 2025, 13:40

      @Alex-Kushleyev Gotcha, thanks for the info Alex and your help resolving this issue!

    • A

      Adding a new camera sensor

      • 12 May 2025, 06:33 • anttukoski 15 May 2025, 20:41
      8
      0
      Votes
      8
      Posts
      244
      Views

      A 15 May 2025, 20:41

      @anttukoski , yes I think you are right. I will work with your team via email to provide what you need. I believe we already have a thread.

      Alex

    • Kerry SnyderK

      Boson 640 MIPI M0153: 16-bit Pre-AGC

      • 22 May 2025, 17:38 • Kerry Snyder 12 Jun 2025, 18:31
      3
      0
      Votes
      3
      Posts
      128
      Views

      Kerry SnyderK 12 Jun 2025, 18:31

      @Alex-Kushleyev Thank you! For the moment we have decided to stick with USB since we can fit that into the current electrical architecture, but I appreciate the offer and may take you up on it at some point in the future if our design changes.

      Thanks,
      Kerry

    • D

      voxl-camera-server behaving differently

      • 19 days ago • dvz 19 days ago
      5
      0
      Votes
      5
      Posts
      108
      Views

      tomT 19 days ago

      @dvz https://gitlab.com/WondesenB/voxl-tag-detector

    • Idan FikselI

      Camera not being identified on J7U

      • 21 days ago • Idan Fiksel 18 days ago
      7
      0
      Votes
      7
      Posts
      140
      Views

      A 18 days ago

      @Idan-Fiksel , it looks like it worked since your machine variant is now 1.0.0 . I assume it was 1.0.1. Sorry the numbering in the name of the kernel is 00.0 vs 00.1…

    • T

      Rotate imx412 stream

      • 18 days ago • TomP 14 days ago
      10
      0
      Votes
      10
      Posts
      155
      Views

      A 14 days ago

      @TomP , oh yeah, my bad.. you found the right one 🙂

    • Idan FikselI

      video streaming with herelink 1.1

      • 5 days ago • Idan Fiksel 3 days ago
      3
      0
      Votes
      3
      Posts
      30
      Views

      Q 3 days ago

      @Riley-Dove would you have any insight on this? Thanks!

    Powered by NodeBB | Contributors