ModalAI Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login
    1. Home
    2. jameskuesel
    3. Topics
    J
    • Profile
    • Following 0
    • Followers 0
    • Topics 10
    • Posts 20
    • Best 0
    • Controversial 0
    • Groups 0

    Topics created by jameskuesel

    • J

      Image Stabilization calibration and pipe size clarification

      Ask your questions right here!
      • • • jameskuesel
      8
      0
      Votes
      8
      Posts
      437
      Views

      Alex KushleyevA

      hi @jameskuesel , nice to hear from you

      Please note that we recently added new functionality to voxl-record-raw-image to save to jpeg using the software jpeg encoder (turbojpeg, similarly to how it's done in voxl-portal for sending the images to the browser):

      voxl-record-raw-image -h Record a raw image from an MPA pipe to disk This is typically used for inspecting raw or YUV image data formatting or for loading into something like MATLAB or OpenCV for post-processing. Optional arguments are: -d, --dir {dir} directory to save output files in (default: /data/raw-images/) -h, --help print this help message -j, --jpeg convert to JPEG before saving (supports NV12, NV21, RGB, RAW8 formats) -q, --jpeg-quality JPEG quality for compression (1-100, default: 90) -n, --num-images {n} number of images to save from the pipe (default 1) -m, --meta save metadata in file name (timestamp (us), exposure (us), gain) -s, --skip {n} skip n frames before saving a new frame

      VOXL2 should be able to encode up to 4x 4K30 streams (video encoder can do 8K30). So there is no limitations to encode two 4K30 streams (if the stream is larger than 4K, such as 4040x3040, still two of them should be fine). Since MISP supports up to 4 output channels, that should be ok, but it seems that youre issue is that you want to have different zoom on different channels. This is a feature we have also been discussing internally and should be easy to add a param that would behave like this: either shared zoom for all misp channels or individual zoom (via config and controlled via the control pipe). Is that something that would work for you? We could add this pretty quick.

      The latest IMX412 driver ( which is here : https://storage.googleapis.com/modalai_public/temp/imx412_test_bins/20250919/imx412_fpv_eis_20250919_drivers.zip) has been optimized to get the following:

      various custom resolutions, as mentioned here : https://docs.modalai.com/camera-video/low-latency-video-streaming/#imx412-operating-modes maximize throughput in order to reduce rolling shutter skew (also enable 4040x3040 @60 fps, allowing 4K60 EIS output!) BTW, there has also been quite a bit of headache over IMX412 camera interference with GPS, we are going to release updated IMX412 drivers very soon. see https://forum.modalai.com/topic/5116/gnss-emi-mitigation-guidelines https://docs.modalai.com/emi-mitigation-for-gnss/

      Once we release the new IMX412 drivers that do not affect GPS, we will provide better documentation of the existing drivers and difference.. but for now you should just use the "eis" driver for imx412, as i linked above.

      Alex

    • J

      voxl-send-command exit status implementation request

      Feature Requests
      • • • jameskuesel
      4
      0
      Votes
      4
      Posts
      371
      Views

      Eric KatzfeyE

      @jameskuesel Thanks! Merged

    • J

      Status of Image Stabilization and Potentially Zoom?

      Ask your questions right here!
      • • • jameskuesel
      7
      0
      Votes
      7
      Posts
      796
      Views

      Alex KushleyevA

      @jameskuesel , it looks like EIS was merged to the main branch shortly after SDK 1.5.0 was released.

      If you have not updated you camera server, please do so : https://docs.modalai.com/camera-video/electronic-image-stabilization/#latest-source-code . You may also need to update libmodal-pipe library.

      Alex

    • J

      GPS performance with IMX412 Hires Camera EMI and Mitigation Techniques

      Ask your questions right here!
      • • • jameskuesel
      3
      0
      Votes
      3
      Posts
      508
      Views

      Alex KushleyevA

      @jameskuesel ,

      Can you please provide a bit more detail about your test -- when you enable M0161, how exactly do you test it? Do you view the images using voxl-portal? and if so, how is your starling2 connected to the network? If you are using the wifi dongle, then we have noticed that moving the wifi dongle away from the GPS antenna helps reduce interference. You can test if the interference is still present by unplugging the wifi dongle completely from usb port and use voxl-inspect-cam test application to make sure the camera is running (inspect the same camera stream that you were previously viewing).

      Also, please let me know what resolution / FPS you are testing the camera at.

      Regarding the MIPI clock rates, i would need to double check, but i believe the IMX412 driver uses 1.5Gbps MIPI bit rate, which is close to GPS L1, but not really close that it would cause interference. We can definitely try different bit rates to see if it helps reduce EMI (if that is indeed the case), but let's first rule out the potential wifi dongle issue. We have ability to change the MIPI clock rate in quite a wide range, but this will require a different sensormodule driver for the camera, which I would need to provide to you.

      Another thing, we recently found that the Starling Front End M0173 board may cause GPS interference via the Lepton connection, so if you have that plugged in, please unplug and see if that helps with GPS signal. Lepton needs 25Mhz clock, so one of the harmonics could hit exactly GPS L1 at 1575Mhz.

      Alex

    • J

      IMX412 Poor performance vs IMX214?

      Ask your questions right here!
      • • • jameskuesel
      12
      0
      Votes
      12
      Posts
      1550
      Views

      Alex KushleyevA

      @jameskuesel , thank you for letting me know about the focus issue. It seems we had a few cameras shipped out without being properly focused - we will make sure to take care of it in the future. Sorry about that.

      Regarding the image quality, after adjusting the lens focus, are you satisfied with the image resolution / quality? Also i believe the color balance outdoors should look better under natural light.

      Alex

    • J

      TOF rate only 5 or 15

      Ask your questions right here!
      • • • jameskuesel
      2
      0
      Votes
      2
      Posts
      327
      Views

      tomT

      @jameskuesel Support for more framerates was added in voxl-camera-server v1.9.3

      Here is the commit it was added: https://gitlab.com/voxl-public/voxl-sdk/services/voxl-camera-server/-/commit/9a3f042ad607b968d452303dd108ced3cf2c4328

      I recommend you update to the latest SDK

    • J

      VOXL2 OV9782 and other camera supported frame rates. +QVIO

      Ask your questions right here!
      • • • jameskuesel
      2
      0
      Votes
      2
      Posts
      540
      Views

      ModeratorM

      @jameskuesel 30FPS currently. The AR0144 modules will outperform OV9782 modules as they have a better sensor and better lens

    • J

      voxl_i2c_read() function discards first byte from buffer

      VOXL
      • i2c voxl • • jameskuesel
      4
      0
      Votes
      4
      Posts
      922
      Views

      James StrawsonJ

      hmmm, There is a similar (but not exactly the same) behavior with SPI on APQ8096 where all reads are preceded by a single random byte meaning libvoxl-io needs to read one extra byte than expected and then discard the first dummy byte. However this happens under the hood here:

      https://gitlab.com/voxl-public/voxl-sdk/core-libs/libapq8096-io/-/blob/master/lib/sdsp/io_rpc_spi.c#L254

      I've not seen such a thing with I2C. Have you looked at our VL53L1X driver for APQ8096? It might just work with your newer VL53L1CB sensors with small changes.

      https://gitlab.com/voxl-public/voxl-sdk/services/apq8096-rangefinder-server