Streaming 4K video from Qualcomm RB5 drone

kitkatSG

I see another thread streaming 4k video from voxl, but I suspect we can stream 4K video without using voxl as the other thread.
I also see the example in Gstreamer- streaming. I tried this gstreamer approach, and can stream all camera in low resolution, which is similar to the other thread on streaming video to QGC.

I would like to create this thread dedicated to streaming 4K video from QRB5.

Could DevTeam or anyone please help show how to stream the high-resolution camera from QRB5?
Thank you.

kitkatSG

I have followed the Github samples Qualcomm, and I found quite few devices under v4l2-ctl, but none of them can be a source of video streaming.

Instead of using src of v4l2, I used source under qtiqmmfsrc camera=2 then can stream with gstreamer. But so far, I cannot obtain a 4K video source properly.

@DevTeam: Please let me know how to obtain correctly the 4K video source? Thank you.

Cody Graham

I am interested in this as well. I'm actually interested in recording as opposed to streaming at the short term, but both are going to be useful. I've been recording with gstreamer using the following command:

gst-launch-1.0 -e qtiqmmfsrc camera=3 name=tracker ! video/x-h264,format=NV12,width=640,height=480,framerate=30/1 ! queue ! h264parse ! mp4mux ! filesink location=output.mp4

While that has worked, it's only recording 640x480. But if I try to record any higher of a resolution, the program ends very quickly, and no frames are recorded. I'm unsure why a resolution higher than 640x480 is causing any issues.

Eric Katzfey

@Cody-David-Graham Yes, we also see this issue and are working to come up with a solution ASAP.

kitkatSG

Hi DevTeam, Is there any update on streaming 4K video from QRB5? Thank you.

Eric Katzfey

@kitkatSG Yes, we have enabled most resolutions in that sensor now and are preparing a release to address this issue.

mrawding

@Eric-Katzfey Hi Eric, any update on this release?

This post is deleted!

kitkatSG

Hi @Eric-Katzfey,
Is there any update from Dev Team on streaming 4K video from QRB5 drone?
Thank you.

Eric Katzfey

@kitkatSG Sorry for the delay. We continue to find issues with the release and are all working diligently to resolve them as soon as possible. Thank you for your patience!

kitkatSG

As a backup solution, we mount a 4K USB camera and successfully stream 4K video via GStreamer to QGC. But the video is shaky when flying drone (streaming video is OK with a stationary drone). @Eric-Katzfey Do the Tech Team have any suggestions on:

Stabilizing the 4K streaming video with GStreamer via software?
Any suggested 3-axes gimbal that we can buy and mount on the QRB5 Drone in order to stabilize the camera?

Thank you.

Eric Katzfey

@kitkatSG There's generally a couple of different possible video distortions. One is due to the vibration from the motors. If you mount the camera on rubber dampeners you can remove most of this type of distortion. But of course the drone is moving and that causes motion as well. We don't have a recommendation on gimbal but would love to hear if you are able to find something that works well for you. And we have not tried any GStreamer stabilization software so cannot comment on that, but would love to hear if you find a software stabilization solution that works.