ModalAI Forum

if no internet is available onboard llm+NPU can help repairing-agent to fix the issue or provide reason of failure.

Is anyone working on this capability:->

GPS turns red mid-flight
↓
self_improving_agent.py detects /mavros/gps/fix
fix_type drops to 0
↓
Automatically runs this diagnostic
↓
Claude Code finds: "indoors, 0 satellites,
VIO active, EKF2_HGT_REF=3, safe to continue"
↓
Stores result in Qdrant flight_memory
↓
Continues mission on VIO alone
↓
Post-flight: GPS health trend visible in dashboard

Thanks.
suvasis

hi,
Has anyone tried Qwen2-0.5B for the VOXL 2?

Here's are some requirements and compatibility:

1. RAM Requirements for Qwen2-0.5B

Base model (FP16): ~1GB of RAM
Quantized to INT8: ~500MB of RAM
Quantized to INT4: ~250MB of RAM

VOXL 2 Specifications

The VOXL 2 has approximately 4GB of RAM available
It uses a Qualcomm QRB5165 processor
Has AI acceleration capabilities via the Hexagon DSP
Primarily designed for computer vision tasks

Compatibility Assessment
Qwen2-0.5B could potentially run on the VOXL 2 with quantization to INT4 or INT8, the memory footprint would be manageable.

Inference speed would likely be slow, perhaps 1-2 seconds per token

Question:

Has ModalAI explored using TensorFlow Lite with the Hexagon delegate to run compact language models like Qwen2-0.5B on the VOXL 2 platform? I'm interested in whether you've experimented with leveraging the Qualcomm GPU for language model inference, even though I understand the VOXL 2 is primarily optimized for computer vision workloads. Have you conducted any experiments or performance testing with small LLMs on this hardware?
Thanks.
suvasis

@Suvasis-M This will help in pure plug and play experience for drone users. No soldering will be required.

@Alex-Kushleyev

Please Ref the attached diagram.
FMU like CubePilot has droneCAN support. So can I use just the onboard computing of VOX2 (also mini) to work with the FMU? I understand voxl2 is tightly integrated with flight controller. This will increase the cost a little but voxl2 wouldn't require a hardware upgrade in terms of CAN support.

Vertiq actuator is tightly integrated with ESC which supports droneCAN, also CubePilot's GPS supports droneCAN and many other components, I believe.

Thanks.
suvasis

hi,

I want to integrate https://www.modalai.com/collections/ready-to-mount/products/voxl-2-flight-deck?variant=40503626039347 with Veritq's https://www.vertiq.co/23-06-g1. The motor is integrated with ESC. It supports MESSAGING PROTOCOLS IQUART, DroneCAN, CANOpen, Hobby Protocols (https://iqmotion.readthedocs.io/en/latest/communication_protocols/hobby_protocol.html).

Does voxl-2 support any of the messaging protocols?

Thanks.
suvasis

hi,

I am trying to order couple of VOXL 2 Flight Decks. What is the difference between these 2 offerings:

1. VOXL 2 Flight Deck price $2100
   and
2. VOXL 2 $1,199.99 USD

What is the delta between these two?

The price difference is about $1000.

Thanks.
suvasis

@tom to customize the payload to say 2-5kg, is it possible to customize or reconfigure another drone with voxl2 and 5g modem etc?

hi,

How much weight can it carry?

Thanks you
suvasis

Sorry it's mikrobus.

hi

in VOXL series drone development board, Are you planning to support makroBUS interface?

Thanks.
suvasis

hi,
I am wondering if px4 based flightcore can be attached to iPhone 13 or 14 as it has IMU gps and everything and control the drone?

object detection/object avoidance/object tracking and many more algorithms can be part of iPhone's s/w stack.

Thanks.
suvasis

@Vinny

Thanks for more clarifications.

I was comparing:
https://github.com/PX4/PX4-Autopilot/blob/main/boards/holybro/pix32v5/src/board_config.h

and
https://github.com/PX4/PX4-Autopilot/blob/main/boards/modalai/fc-v2/src/board_config.h

table comparing the hardware features
I will appreciate if you can share.

The Modalai flight core is tiny compared to pixhawk5x, I wanted to mix and match flight core with voxl(which is essentially snapdragon) or Nvidia Jetson processors for drones or robot.

Thanks.
suvasis

hi,

What are main differences between Holybro Pixhawk 5X and px4 based flightcore?

Filght core looks very small compared to Pixhawk 5X. Are they comparable. I checked the

board of modal and holybro's pixhawk5, there are some differences, can you pls elaborate the difference?

Thanks.
suvasis

@modaltb

hi,

Where is the DSP code? Is it exposed?

Thanks
suvasis

@modaltb said in Using VOXL ESCs with PX4:

PX4/Nuttx related calls,

hi,

Which are the PX4/Nuttx related calls from the actuator?

Thanks.
suvasis

hi,

I have Jetson AGX orin processor, it has UART on M.2 KeyE. Ok then, looks like I can port the driver. Is there any ubuntu OS specifics? I have 20.04 version.

Thanks.
suvasis

hi

I am building my drone, I want to use "VOXL ESCs with PX4" for my drone. Is there any documentation on how to use VOXL ESCs with Nvidia processors.e, the los setup?

Thanks.
suvasis