Evaluation of Starling 2 Max for Custom Onboard CV Project (4K MIPI, Onboard Inference, Zoom & Range Requirements)

[sebastianp]

Hi ModalAI Team,

We are currently evaluating off-the-shelf development platforms for an upcoming computer vision project. We are looking closely at the Starling 2 Max (and/or custom VOXL 2-based platforms) and would love to verify feasibility against our core requirements.

Project Overview & Requirements

Our pipeline runs a custom C++ algorithm combined with deep learning model inference onboard the aircraft, alongside manual flight control.

Here are our primary hardware and software requirements:

1 High-Res Video & Uncompressed/Raw Access:
◦ Resolution: Minimum 4K native video resolution (8K capability preferred).
◦ Data Pipeline: We require direct, low-latency access to uncompressed / raw frame buffers (or near to it)
◦ Optics (optional): Ability to support continuous optical zoom (at least 4x).

2 Onboard AI Compute & Performance:
◦ Our models are currently built/optimized for PyTorch and NVIDIA TensorRT.
◦ What real-world FPS / latency can we expect for standard object detection models (e.g., YOLO variants) ?

3 Flight Range, Autonomy & Control:
◦ Full manual flight control capabilities for the pilot.

Key Questions for the ModalAI Team

1. Camera & Zoom Integration: * The Starling 2 Max standard setup features IMX412 (12MP) sensors. Can we stream full 4K uncompressed raw frames via MIPI into custom C++ code seamlessly?
2. Custom C++ & Library Support: How simple is it to compile and run external static/dynamic C++ libraries directly within the VOXL SDK runtime environment?
3. Companion Compute Option: If our inference workloads heavily rely on NVIDIA TensorRT, is it feasible to mount a secondary compute payload (e.g., NVIDIA Jetson Orin Nano/NX) onto the Starling 2 Max frame using VOXL 2 Ethernet/USB3 expander boards, and what would be the impact on payload capacity (~500g limit) and flight time?

Looking forward to your guidance

Thank you so much for your attention and participation.

Sebastian

[sebastianp]

Our team at Sodyo is preparing to order a Starling 2 Max platform for R&D and deployment in Israel.

We have a few technical and regulatory questions regarding the radio configuration and ground station setup:
1 1 km Video Stream & Telemetry Link: Our primary operational requirement is to maintain a stable, real-time HD video stream and full QGroundControl telemetry over a range of at least 1 km. Standard Wi-Fi will not cover this distance.
What is the recommended radio/datalink configuration for the Starling 2 Max to reliably achieve 1 km live video streaming?
2 Israel Spectrum Compliance (2.4 GHz vs. 915 MHz):
Due to Israeli Ministry of Communications (MoC) regulations, sub-1GHz operations on 915 MHz are restricted (Israel utilizes 868 MHz for sub-1GHz ISM, making 915 MHz subject to customs detention).
◦ On your order page, the Microhard pMDDL2450 (which operates on 2.4 GHz and is legal in Israel) is bundled with an ELRS 915MHz receiver.
◦ Is it possible to order the Starling 2 Max configured with the Microhard pMDDL2450 modem paired with a 2.4 GHz R/C link (e.g., 2.4 GHz ELRS or Ghost Atto 2.4 GHz) so the entire RF package complies with 2.4 GHz regulations in Israel?
3 Ground Controller / GCS Hardware:
If we select the order option that includes the battery pack and controller (Kit option with Controller), which specific remote controller model is supplied with the Starling 2 Max?
Additionally, does that controller come pre-installed/configured with the corresponding ground unit receiver/modem (e.g., Microhard ground unit / ELRS module) for out-of-the-box streaming and control?

thank you in advance

[Alex Kushleyev]

@sebastianp , sorry for the delay. There a lots of questions, let me start with what I can answer right away and will go from there.

1. Hires Video

Resolution:

• Starling 2 Max comes with dual IMX412 cameras (front, down-facing). IMX412 maximum resolution is 4056x3040, which is larger than 4K. 8K is not supported on Starling Max. In general, we do have support for one 8K camera (OV64B), which has maximum resolution of 9248x6944 and that resolution is supported only at 10FPS. The only way to get that camera right now is part of a Flir Hadron combo (Boson + Color camera), which is probably not what you are looking for. So the best bet for Starling 2 Max is to use the provided IMX412 camera.
• you can see some details regarding operating modes of IMX412 camera here : https://docs.modalai.com/camera-video/low-latency-video-streaming/#imx412-operating-modes

Data Pipeline:

• our camera server application (voxl-camera-server) can publish processed YUV images via shared ION buffers (zero copy) and the user application can receive those buffers for processing without any cpu overhead for doing inter process communication to send the image data.
• you can also publish raw Bayer data (the exact data that comes from the camera) if that's what you mean by "raw"

Optics:

• no optical zoom is supported on any of our cameras, only digital

2. Onboard AI Compute and Performance

• I will need to check with colleagues and follow up.

3. Flight Range, Autonomy & Control

• Starling 2 Max used PX4 as flight controller, so all the standard flight modes are supported

Answers to additional questions

• Camera and Zoom integration: yes, raw and yuv frames can be shared with customer's C/C++ applications via shared buffers (or regular buffers via named pipes, which will have a lot of overhead for duplicating the data). No optical zoom is supported. Examples are available upon request
• We provide voxl-cross docker image which can be used to build the projects for VOXL2. Majority of ModalAI packages that run on VOXL2 are built using this cross-complier environment and can serve as examples how to build your own applications (you can find most packages here : https://gitlab.com/voxl-public/voxl-sdk)
• you can mount more hardware on Starling 2 Max, see the following thread regarding flight time : https://forum.modalai.com/topic/3732/starling-2-max-payload-capacity-and-flight-time-impact

Frequency selection

• when you configure your starling 2 max (https://www.modalai.com/products/starling-2-max) , you can select several options and the SKU will change accordingly. The page also has explanation for the different SKU options, so it sounds like you will need:
• MRB-D0012-4-V4-C28-M11-T9-K2
• C28 : dual tracking and dual hi-res cameras
• M11-T9 : Microhard and Microhard pMDDL2450 and Ghost Atto (2.4Ghz)
• it seems that this would be a custom SKU that you would need to request a quote for : https://www.modalai.com/pages/contact-us

Ground Controller:

• If the drone ships with an RC transmitter, it should be already bound to the receiver.
• the controller and receive depends on the selection, see above regarding SKU and the shop page for more description
• note that the RC controller has no ability to display video, so there is no out-of-the-box ability to stream video without additional setup, such as external computer, display / goggles, etc.

I hope that answered a lot of your questions, please let us know additional questions or need clarification regarding anything else.

Alex