# Streaming 4K video from Qualcomm RB5 drone

Source: https://forum.modalai.com/topic/1042/streaming-4k-video-from-qualcomm-rb5-drone
Category: Development Drones (https://forum.modalai.com/category/44/development-drones)
Tags: rb5
Posted: 2022-06-20 23:36:04 UTC by kitkatSG
Replies: 10 · Views: 3501

## kitkatSG · 2022-06-20 23:36:04 UTC

I see another thread [streaming 4k video from voxl](https://forum.modalai.com/topic/728/streaming-4k-video-from-voxl), but I suspect we can stream 4K video without using voxl as the other thread. 
I also see the example in [Gstreamer- streaming]( https://github.com/quic/sample-apps-for-Qualcomm-Robotics-RB5-platform/tree/master/Gstreamer-Applications/gst_streaming). I tried this gstreamer approach, and can stream all camera in low resolution, which is similar to the [other thread on streaming video to QGC](https://forum.modalai.com/topic/1017/rb5-video-streaming-does-not-show-up-on-qgc). 

I would like to create this thread dedicated to streaming 4K video from QRB5. 

Could DevTeam or anyone please help show how to stream the high-resolution camera from QRB5? 
Thank you.

## Reply by kitkatSG · 2022-06-21 03:22:31 UTC

I have followed the [Github samples Qualcomm](https://github.com/quic/sample-apps-for-Qualcomm-Robotics-RB5-platform/tree/master/gst-python-samples), and I found quite few devices under `v4l2-ctl`, but none of them can be a source of video streaming. 

![55549baf-c5fd-4359-bba8-5698713afa5b-image.png](https://forum.modalai.com/assets/uploads/files/1655777882283-55549baf-c5fd-4359-bba8-5698713afa5b-image.png) 

Instead of using src of v4l2, I used source under `qtiqmmfsrc camera=2` then can stream with gstreamer. But so far, I cannot obtain a 4K video source properly. 

@DevTeam: Please let me know how to obtain correctly the 4K video source? Thank you.

## Reply by Cody Graham · 2022-06-21 18:24:20 UTC

I am interested in this as well. I'm actually interested in recording as opposed to streaming at the short term, but both are going to be useful. I've been recording with gstreamer using the following command:
```
gst-launch-1.0 -e qtiqmmfsrc camera=3 name=tracker ! video/x-h264,format=NV12,width=640,height=480,framerate=30/1 ! queue ! h264parse ! mp4mux ! filesink location=output.mp4
```

While that has worked, it's only recording 640x480. But if I try to record any higher of a resolution, the program ends very quickly, and no frames are recorded. I'm unsure why a resolution higher than 640x480 is causing any issues.

## Reply by Eric Katzfey (ModalAI staff) · 2022-06-21 21:51:47 UTC (in reply to Cody Graham)

@Cody-David-Graham Yes, we also see this issue and are working to come up with a solution ASAP.

## Reply by kitkatSG · 2022-06-27 00:08:34 UTC

Hi DevTeam, Is there any update on streaming 4K video from QRB5? Thank you.

## Reply by Eric Katzfey (ModalAI staff) · 2022-06-27 17:21:10 UTC (in reply to kitkatSG)

@kitkatSG Yes, we have enabled most resolutions in that sensor now and are preparing a release to address this issue.

## Reply by mrawding · 2022-07-18 14:57:14 UTC (in reply to Eric Katzfey)

@Eric-Katzfey Hi Eric, any update on this release?

## Reply by kitkatSG · 2022-07-28 22:39:42 UTC (in reply to Eric Katzfey)

Hi @Eric-Katzfey, 
Is there any update from Dev Team on streaming 4K video from QRB5 drone? 
Thank you.

## Reply by Eric Katzfey (ModalAI staff) · 2022-07-28 22:53:17 UTC (in reply to kitkatSG)

@kitkatSG Sorry for the delay. We continue to find issues with the release and are all working diligently to resolve them as soon as possible. Thank you for your patience!

## Reply by kitkatSG · 2022-08-03 13:19:07 UTC (in reply to Eric Katzfey)

As a backup solution, we mount a 4K USB camera and successfully stream 4K video via GStreamer to QGC. But the video is shaky when flying drone (streaming video is OK with a stationary drone). @Eric-Katzfey  Do the Tech Team have any suggestions on:
- Stabilizing the 4K streaming video with GStreamer via software?
- Any suggested 3-axes gimbal that we can buy and mount on the QRB5 Drone in order to stabilize the camera? 

Thank you.

## Reply by Eric Katzfey (ModalAI staff) · 2022-08-03 14:44:38 UTC (in reply to kitkatSG)

@kitkatSG There's generally a couple of different possible video distortions. One is due to the vibration from the motors. If you mount the camera on rubber dampeners you can remove most of this type of distortion. But of course the drone is moving and that causes motion as well. We don't have a recommendation on gimbal but would love to hear if you are able to find something that works well for you. And we have not tried any GStreamer stabilization software so cannot comment on that, but would love to hear if you find a software stabilization solution that works.