ModalAI Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    uvc_get_stream_ctrl_format_size failed

    Ask your questions right here!
    3
    39
    2864
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • tomT
      tom admin
      last edited by

      @Kris Apologies, I'm not sure if that will work on VOXL1. Do you have a hires mipi sensor on your VOXL? It would allow you to avoid a lot of trouble

      KrisK 3 Replies Last reply Reply Quote 0
      • KrisK
        Kris @tom
        last edited by Kris

        @tom
        No, I dont have a hires mipi sensor on my VOXL. I am using the TOF, Stereo, and Tracking sensors specifically for indoor flights.
        I am just trying to record frames or video from a connected uvc camera while in flight.
        I am also trying to set one of my stereo cameras as the QVIO instead of the tracking camera. Again this is just for indoor flights. I have also asked about this QVIO setup in this thread, but have not received a response other than pointing to the extrinsics ModalAi page.

        1 Reply Last reply Reply Quote 0
        • KrisK
          Kris @tom
          last edited by Kris

          @tom
          The command you sent me earlier this week did not work on the VOXL platform. I tried variations on both our e-CAM83 and Aruducam IMX335 uvc camera modules.

          Could you please point me to a uvc camera that will work with the voxl-uvc-server?
          Our main goal is to connect a uvc camera to the Seeker and be able to capture frames or video (streaming is not necessary) and send them to an onboard SD card (possibly using voxl-logger.

          Would this Blue Robotics uvc module work? Meaning, is it capable of connecting to the voxl-uvc-server and be able to send frames and/or video to the onboard SD card using voxl-logger on the VOXL1 Seeker Dev Drone?

          1 Reply Last reply Reply Quote 0
          • KrisK
            Kris @tom
            last edited by

            @tom
            I have also noticed that when I updated my platform to 0.9 the streamer.conf has changed.
            Now our Arducam IMX335 is not even working (it had no problems streaming before).

            0.9 streamer.conf

            {
                    "input-pipe":   "hires",
                    "bitrate":      1000000,
                    "decimator":    2,
                    "port": 8900,
                    "rotation":     0
            }
            

            3.8.0-0.7 streamer.conf

            {
                "conf-version":"1.3",
                "configuration": "hires",
                "uvc-generic": {
                    "input": {
                        "interface": "mpa",
                        "mpa-camera": "uvc" },
                    "output": {
                        "stream": {
                            "rotation": 0,
                            "width": 640,
                            "height": 480,
                            "decimator": 1,
                            "bitrate": 1000000 } }
                },
                "uvc-flir-boson": {
                    "input": {
                        "interface": "mpa",
                        "mpa-camera": "uvc" },
                    "output": {
                        "stream": {
                            "rotation": 0,
                            "width": 640,
                            "height": 512,
                            "decimator": 2,
                            "bitrate": 1000000 } }
                },
                "uvc-flir-lepton": {
                    "input": {
                        "interface": "mpa",
                        "mpa-camera": "uvc" },
                    "output": {
                        "stream": {
                            "rotation": 0,
                            "width": 160,
                            "height": 120,        
                            "bitrate": 500000 } } 
                },                                
                "hires": {                        
                    "input": {                    
                        "interface": "mpa",       
                        "mpa-camera": "hires" },  
                    "output": {                   
                        "stream": {               
                            "rotation": 0,        
                            "width": 640,         
                            "height": 480,        
                            "decimator": 2,       
                            "bitrate": 1000000 } }
                },                                
                "hires-logo": {                   
                    "input": {                    
                        "interface": "mpa",       
                        "mpa-camera": "hires" },  
                    "output": {                   
                        "stream": {               
                            "rotation": 0,        
                            "width": 640,         
                            "height": 480,        
                            "decimator": 2,       
                            "bitrate": 1000000 } },
                    "overlay": {                   
                        "location": "/etc/modalai/modalai.png",
                        "offset_x": -1,                        
                        "offset_y": -1 }                       
                },                                             
                "stereo": {                                    
                    "input": {                                 
                        "interface": "mpa",                    
                        "mpa-camera": "stereo" },              
                    "output": {                                
                        "stream": {                            
                            "width": 640,                      
                            "height": 960,                     
                            "decimator": 2,                    
                            "bitrate": 1000000 } }             
                },                                             
                "tracking": {                                  
                    "input": {                                 
                        "interface": "mpa",                    
                        "mpa-camera": "tracking" },            
                    "output": {                                
                        "stream": {                            
                            "width": 640,                      
                            "height": 480,                     
                            "decimator": 2,                    
                            "bitrate": 1000000 } }             
                },                                             
                "dfs-disparity": {                             
                    "input": {                                 
                        "interface": "mpa",                    
                        "mpa-camera": "dfs_disparity" },       
                    "output": {                                
                        "stream": {                            
                            "width": 640,                      
                            "height": 480,                     
                            "decimator": 2,                    
                            "bitrate": 1000000 } }             
                },                                             
                "qvio-overlay": {                              
                    "input": {                                 
                        "interface": "mpa",                    
                        "mpa-camera": "qvio_overlay" },        
                    "output": {                                
                        "stream": {                            
                            "width": 640,                      
                            "height": 544,                     
                            "decimator": 2,                    
                            "bitrate": 1000000 } }             
                },                                             
                "tflite-overlay": {                            
                    "input": {                                 
                        "interface": "mpa",                    
                        "mpa-camera": "tflite" },              
                    "output": {                                
                        "stream": {                            
                            "width": 640,                      
                            "height": 480,                     
                            "decimator": 2,                    
                            "bitrate": 1000000 } }             
                },                                             
                "hdmi-mpa": {                                  
                    "input": {                                 
                        "interface": "mpa",                    
                        "mpa-camera": "v4l2" },                
                    "output": {                                
                        "stream": {                            
                            "width": 640,                      
                            "height": 360,                     
                            "decimator": 2,                    
                            "bitrate": 1000000 } }             
                },                                             
                "gphoto2-mpa": {                               
                    "input": {                                 
                        "interface": "mpa",                    
                        "mpa-camera": "gphoto2" },             
                    "output": {                                
                        "stream": {                            
                            "width": 640,                      
                            "height": 360,                     
                            "decimator": 2,                    
                            "bitrate": 1000000 } }             
                },                                             
                "video-test": {                                
                    "input": {                                 
                        "interface": "test",                   
                        "frame": {                             
                            "width": 640,                      
                            "height": 480,                     
                            "format": "yuv420" } },            
                    "output": {                                
                        "stream": {                            
                            "rotation": 0,                     
                            "width": 640,                      
                            "height": 480,                     
                            "rate": 30,                        
                            "bitrate": 1000000 } }             
                },                                             
                "uvc-video": {                                 
                    "input": {                                 
                        "interface": "uvc",                    
                        "device": "/dev/video0" },             
                    "output": {                                
                        "stream": {                            
                            "rotation": 0,                     
                            "width": 640,                      
                            "height": 360,                     
                            "rate": 15,                        
                            "bitrate": 1000000 } }             
                }                                              
                                                               
            }                           
            
            1 Reply Last reply Reply Quote 0
            • KrisK
              Kris @tom
              last edited by

              @tom
              Do you happen to know some Gstreamer commands for the Logitech C270 uvc camera?
              I am trying to get either a streaming or recording command to work on the Seeker, with no luck so far.

              1 Reply Last reply Reply Quote 0
              • tomT
                tom admin
                last edited by tom

                @Kris I don't have that specific webcam or a VOXL1 but with a different one and a VOXL2, all I have to do is run voxl-uvc-server, see output below:

                voxl2:/$ voxl-uvc-server 
                loading config file
                Creating new config file: /etc/modalai/voxl-uvc-server.conf
                =================================================================
                width:                            640
                height:                           480
                fps:                              30
                pipe_name:                        uvc
                =================================================================
                

                I'm able to pull up the stream using voxl-portal (going to IP of my VOXL2 in browser)

                8ff0d084-6556-4947-8dcb-9e8137d10ae1-image.png

                Then alternatively I'm able to use this gstreamer command:

                gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-raw,format=YUY2 ! videoconvert ! x264enc speed-preset=ultrafast tune=zerolatency ! rtph264pay name=pay0 ! udpsink host=192.168.1.124 port=8554
                

                to pull up the video stream in QGC

                KrisK 1 Reply Last reply Reply Quote 0
                • tomT
                  tom admin
                  last edited by

                  642ce503-f6b1-4999-9cf2-ba5ac5b8e504-image.png

                  1 Reply Last reply Reply Quote 0
                  • KrisK
                    Kris @tom
                    last edited by

                    @tom
                    Thank you for your examples.

                    I was asking about the C270 camera because @Eric-Katzfey had mentioned that he starts his camera testings with this model in order to locate where issues are coming from on other camera models.

                    I do appreciate your support.
                    I will continue to try different Gstreamer commands.

                    1 Reply Last reply Reply Quote 0
                    • tomT
                      tom admin
                      last edited by

                      @Kris I understand, your solution will likely be similar to what I posted above

                      KrisK 1 Reply Last reply Reply Quote 0
                      • KrisK
                        Kris @tom
                        last edited by Kris

                        @tom
                        I was able to stream the video from voxl-portal,

                        voxl:~$ voxl-uvc-server -d
                        Enabling debug messages
                        voxl-uvc-server starting
                        Image resolution 640x480, 30 fps chosen
                        UVC initialized
                        Device found
                        Device opened
                        uvc_get_stream_ctrl_format_size succeeded for format YUYV
                        Streaming starting
                        Got frame callback! frame_format = 3, width = 640, height = 480, length = 614400, ptr = (nil)
                         * got image 30
                         * got image 60
                         * got image 90
                         * got image 120
                         * got image 150
                        

                        but I cannot get the Gstreamer to work for QGC.

                        Here is my ERROR;

                        voxl:~$ gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-raw,format=YUY2 ! videoconvert ! omxh264enc ! rtph264pay name=pay0 ! udpsink host=192.168.110.152 port=8554
                        Setting pipeline to PAUSED ...
                        Pipeline is live and does not need PREROLL ...
                        Setting pipeline to PLAYING ...
                        New clock: GstSystemClock
                        **
                        ERROR:/opt/workspace/build/apq8096-le-1-0-1_ap_standard_oem.git/apps_proc/poky/build/tmp-glibc/work/armv7a-vfp-neon-oemllib32-linux-gnueabi/lib32-gstreamer1.0-omx/1.10.4-r0/gst-omx-1.10.4/omx/gstomxh264enc.c:532:gst_omx_h264_enc_get_caps: code should not be reached
                        Aborted
                        

                        Maybe its a CAPS issue?

                        I had to change x264 to omxh264, and had to completely remove speed-preset=ultrafast tune=zerolatency from the command because it wasnt playing well with VOXL1.

                        1 Reply Last reply Reply Quote 0
                        • tomT
                          tom admin
                          last edited by

                          @Kris Well now that you have voxl-uvc-server working you should be able to use voxl-streamer on top of that to get a stream going

                          KrisK 1 Reply Last reply Reply Quote 0
                          • KrisK
                            Kris @tom
                            last edited by Kris

                            @tom
                            Yes, I am able to get the stream working with the voxl-streamer -i uvc command,
                            but I am trying to get a Gstreamer command working so that I can build a pipeline to record the frames.

                            voxl:~$ voxl-streamer -i uvc
                            ERROR: object missing input-pipe
                            WARNING: Failed to get default pipe name from configuration file
                            ERROR: object missing bitrate
                            WARNING: Failed to get default bitrate from configuration file
                            Camera server Connected
                            Stream available at rtsp://127.0.0.1:8900/live
                            

                            Gstreamer;

                            voxl:~$ show-video-device-info.sh
                            /dev/video2: UVC Camera (046d:0825) 046d:0825
                            voxl:~$ sudo gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-raw,width=640,height=480,format=YUY2 ! videoconvert ! omxh264enc ! rtph264pay name=pay0 ! udpsink host=192.168.110.152 port=8554
                            Setting pipeline to PAUSED ...
                            Pipeline is live and does not need PREROLL ...
                            Setting pipeline to PLAYING ...
                            New clock: GstSystemClock
                            **
                            ERROR:/opt/workspace/build/apq8096-le-1-0-1_ap_standard_oem.git/apps_proc/poky/build/tmp-glibc/work/armv7a-vfp-neon-oemllib32-linux-gnueabi/lib32-gstreamer1.0-omx/1.10.4-r0/gst-omx-1.10.4/omx/gstomxh264enc.c:532:gst_omx_h264_enc_get_caps: code should not be reached
                            

                            or without width & height;

                            voxl:~$ show-video-device-info.sh
                            /dev/video2: UVC Camera (046d:0825) 046d:0825
                            voxl:~$ sudo gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-raw,format=YUY2 ! videoconvert ! omxh264enc ! rtph264pay name=pay0 ! udpsink host=192.168.110.152 port=8554
                            Setting pipeline to PAUSED ...
                            Pipeline is live and does not need PREROLL ...
                            Setting pipeline to PLAYING ...
                            New clock: GstSystemClock
                            **
                            ERROR:/opt/workspace/build/apq8096-le-1-0-1_ap_standard_oem.git/apps_proc/poky/build/tmp-glibc/work/armv7a-vfp-neon-oemllib32-linux-gnueabi/lib32-gstreamer1.0-omx/1.10.4-r0/gst-omx-1.10.4/omx/gstomxh264enc.c:532:gst_omx_h264_enc_get_caps: code should not be reached
                            
                            Eric KatzfeyE 1 Reply Last reply Reply Quote 0
                            • Eric KatzfeyE
                              Eric Katzfey ModalAI Team @Kris
                              last edited by

                              @Kris The intention with the Logitech camera was to use it with voxl-uvc-streamer as Tom pointed out. That way you have a complete working setup and then you can start changing one thing at a time to get to what you want. If you want to switch to a different camera then you can see the differences in the new camera from the Logitech camera and try to debug that way. If you want to add a record feature with GStreamer then you can fork our voxl-streamer code and add the functionality into that. If you want to do it with a gst-launch-1.0 command line pipeline then you are farther away from anything we currently support and it's going to be hard for us to offer much help. I do think that what you are trying to do should be possible.

                              1 Reply Last reply Reply Quote 0
                              • First post
                                Last post
                              Powered by NodeBB | Contributors