# uvc_get_stream_ctrl_format_size failed Source: https://forum.modalai.com/topic/1881/uvc_get_stream_ctrl_format_size-failed Category: General Questions (https://forum.modalai.com/category/2/general-questions) Posted: 2023-02-28 05:20:39 UTC by Kris Replies: 38 · Views: 22335 ## Kris · 2023-02-28 05:20:39 UTC Re: [voxl-streamer client repetitive connect/disconnect](/topic/550/voxl-streamer-client-repetitive-connect-disconnect) I am having the same issue that @wilkinsaf was having. I am using a different H.264 camera but the errors are the same ``` uvc_get_stream_ctrl_format_size failed ```and the guidFormat is the same ```59555932-0000-1000-8000-00aa00389b71```. I tried to download the ipk that was posted in this [thread](http://voxl-packages.modalai.com/dev/libuvc_1.0.2_202112182223.ipk), but it is no longer available. Could I have the new link for this http://voxl-packages.modalai.com/dev/libuvc_1.0.2_202112182223.ipk please? FYI, this is my camera information and I am trying to use it on the Seeker. ``` voxl:~$ voxl-version -------------------------------------------------------------------------------- system-image: 3.8.0 kernel: #1 SMP PREEMPT Tue Apr 26 18:08:39 UTC 2022 3.18.71-perf -------------------------------------------------------------------------------- hw version: VOXL -------------------------------------------------------------------------------- voxl-suite: 0.7.0 -------------------------------------------------------------------------------- ``` ``` Service Name | Version | Enabled | Running | CPU Usage --------------------------------------------------------------------------- docker-autorun | 1.2.4 | Disabled | Not Running | docker-daemon | 1.2.4 | Disabled | Not Running | modallink-relink | 0.15.1 | Disabled | Not Running | voxl-camera-server | 0.9.1 | Enabled | Running | 18.7 voxl-cpu-monitor | 0.2.5 | Enabled | Running | 0.0 voxl-dfs-server | 0.2.6 | Enabled | Running | 4.1 voxl-imu-server | 1.0.1 | Enabled | Running | 0.0 voxl-mavlink-server | 0.1.1 | Enabled | Running | 2.0 voxl-modem | 0.15.1 | Disabled | Not Running | voxl-portal | 0.2.6 | Enabled | Running | 0.0 voxl-qvio-server | 0.4.6 | Enabled | Running | 8.3 voxl-streamer | 0.3.1 | Disabled | Not Running | voxl-tag-detector | 0.0.4 | Disabled | Not Running | voxl-tflite-server | 0.2.3 | Disabled | Not Running | voxl-time-sync | 1.1.1 | Disabled | Not Running | voxl-vision-px4 | 1.0.5 | Enabled | Running | 2.0 voxl-wait-for-fs | 1.1.1 | Enabled | Completed | ``` ``` voxl:~$ opkg list-installed | grep "voxl" libvoxl-cutils - 0.1.1 voxl-camera-calibration - 0.1.5 voxl-cpu-monitor - 0.2.5 voxl-docker-support - 1.2.4 voxl-gphoto2-server - 0.0.10 voxl-jpeg-turbo - 2.1.3-4 voxl-libgphoto2 - 0.0.4 voxl-libuvc - 1.0.6 voxl-logger - 0.1.2 voxl-mavlink - 0.0.7 voxl-mavlink-server - 0.1.1 voxl-modem - 0.15.1 voxl-mongoose - 7.6.0 voxl-mpa-to-ros - 0.3.2 voxl-mpa-tools - 0.6.3 voxl-opencv - 4.5.5-1 voxl-portal - 0.2.6 voxl-qvio-server - 0.4.6 voxl-streamer - 0.3.1 voxl-suite - 0.7.0 voxl-tag-detector - 0.0.4 voxl-tflite-server - 0.2.3 voxl-utils - 1.1.1 voxl-uvc-server - 0.1.1 voxl-vision-px4 - 1.0.5 voxl-vpn - 0.0.6 ``` ``` voxl:~$ opkg list-installed | grep "modal" libmodal-cv - 0.0.5 libmodal-exposure - 0.0.7 libmodal-json - 0.4.2 libmodal-pipe - 2.1.7 ``` ``` voxl:~$ lsusb Bus 001 Device 003: ID 2560:c184 Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub Bus 001 Device 002: ID 0424:2514 Standard Microsystems Corp. USB 2.0 Hub Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub ``` ``` voxl:~$ voxl-uvc-server -s *** START DEVICE LIST *** Found device 1 Got device descriptor for 2560:c184 (null) Found device 2560:c184 uvc_open failed, Return code: No such device (-4) *** END DEVICE LIST *** ``` ``` voxl:~$ lsusb -v -d 2560:c184 Bus 001 Device 006: ID 2560:c184 Device Descriptor: bLength 18 bDescriptorType 1 bcdUSB 2.00 bDeviceClass 239 Miscellaneous Device bDeviceSubClass 2 bDeviceProtocol 1 Interface Association bMaxPacketSize0 64 idVendor 0x2560 idProduct 0xc184 bcdDevice 1.00 iManufacturer 1 e-ConSystems iProduct 2 e-CAM83_USB iSerial 3 00.00.01 bNumConfigurations 1 Configuration Descriptor: bLength 9 bDescriptorType 2 wTotalLength 601 bNumInterfaces 3 bConfigurationValue 1 iConfiguration 0 bmAttributes 0xc0 Self Powered MaxPower 100mA Interface Association: bLength 8 bDescriptorType 11 bFirstInterface 0 bInterfaceCount 3 bFunctionClass 14 Video bFunctionSubClass 3 Video Interface Collection bFunctionProtocol 0 iFunction 0 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 0 bAlternateSetting 0 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 1 Video Control bInterfaceProtocol 0 iInterface 0 VideoControl Interface Descriptor: bLength 14 bDescriptorType 36 bDescriptorSubtype 1 (HEADER) bcdUVC 1.00 wTotalLength 90 dwClockFrequency 48.000000MHz bInCollection 2 baInterfaceNr( 0) 1 baInterfaceNr( 1) 2 VideoControl Interface Descriptor: bLength 18 bDescriptorType 36 bDescriptorSubtype 2 (INPUT_TERMINAL) bTerminalID 1 wTerminalType 0x0201 Camera Sensor bAssocTerminal 0 iTerminal 0 wObjectiveFocalLengthMin 0 wObjectiveFocalLengthMax 0 wOcularFocalLength 0 bControlSize 3 bmControls 0x00008a0a Auto-Exposure Mode Exposure Time (Absolute) Zoom (Absolute) PanTilt (Absolute) Reserved VideoControl Interface Descriptor: bLength 11 bDescriptorType 36 bDescriptorSubtype 5 (PROCESSING_UNIT) Warning: Descriptor too short bUnitID 2 bSourceID 1 wMaxMultiplier 0 bControlSize 2 bmControls 0x00001753 Brightness Contrast Sharpness White Balance Temperature Backlight Compensation Gain Power Line Frequency White Balance Temperature, Auto iProcessing 0 bmVideoStandards 0x1d None PAL - 625/50 SECAM - 625/50 NTSC - 625/50 VideoControl Interface Descriptor: bLength 29 bDescriptorType 36 bDescriptorSubtype 6 (EXTENSION_UNIT) bUnitID 3 guidExtensionCode {82066163-7050-ab49-b8cc-b3855e8d221d} bNumControl 0 bNrPins 1 baSourceID( 0) 2 bControlSize 4 bmControls( 0) 0xff bmControls( 1) 0xff bmControls( 2) 0xff bmControls( 3) 0xff iExtension 0 VideoControl Interface Descriptor: bLength 9 bDescriptorType 36 bDescriptorSubtype 3 (OUTPUT_TERMINAL) bTerminalID 4 wTerminalType 0x0101 USB Streaming bAssocTerminal 0 bSourceID 3 iTerminal 0 VideoControl Interface Descriptor: bLength 9 bDescriptorType 36 bDescriptorSubtype 3 (OUTPUT_TERMINAL) bTerminalID 5 wTerminalType 0x0101 USB Streaming bAssocTerminal 0 bSourceID 3 iTerminal 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x87 EP 7 IN bmAttributes 3 Transfer Type Interrupt Synch Type None Usage Type Data wMaxPacketSize 0x0020 1x 32 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 1 bAlternateSetting 0 bNumEndpoints 0 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 VideoStreaming Interface Descriptor: bLength 14 bDescriptorType 36 bDescriptorSubtype 1 (INPUT_HEADER) bNumFormats 1 wTotalLength 106 bEndPointAddress 129 bmInfo 0 bTerminalLink 4 bStillCaptureMethod 1 bTriggerSupport 0 bTriggerUsage 0 bControlSize 1 bmaControls( 0) 28 VideoStreaming Interface Descriptor: bLength 28 bDescriptorType 36 bDescriptorSubtype 16 (FORMAT_FRAME_BASED) bFormatIndex 1 bNumFrameDescriptors 2 guidFormat {48323634-0000-1000-8000-00aa00389b71} bBitsPerPixel 16 bDefaultFrameIndex 1 bAspectRatioX 0 bAspectRatioY 0 bmInterlaceFlags 0x00 Interlaced stream or variable: No Fields per frame: 2 fields Field 1 first: No Field pattern: Field 1 only bCopyProtect 0 bVariableSize 1 VideoStreaming Interface Descriptor: bLength 34 bDescriptorType 36 bDescriptorSubtype 17 (FRAME_FRAME_BASED) bFrameIndex 1 bmCapabilities 0x00 Still image unsupported wWidth 3840 wHeight 2160 dwMinBitRate 165888000 dwMaxBitRate 995328000 dwDefaultFrameInterval 666666 bFrameIntervalType 2 dwBytesPerLine 0 dwFrameInterval( 0) 333333 dwFrameInterval( 1) 666666 VideoStreaming Interface Descriptor: bLength 30 bDescriptorType 36 bDescriptorSubtype 17 (FRAME_FRAME_BASED) bFrameIndex 2 bmCapabilities 0x00 Still image unsupported wWidth 1920 wHeight 1080 dwMinBitRate 165888000 dwMaxBitRate 995328000 dwDefaultFrameInterval 333333 bFrameIntervalType 1 dwBytesPerLine 0 dwFrameInterval( 0) 333333 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 1 bAlternateSetting 1 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x81 EP 1 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0080 1x 128 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 1 bAlternateSetting 2 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x81 EP 1 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0180 1x 384 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 1 bAlternateSetting 3 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x81 EP 1 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0200 1x 512 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 1 bAlternateSetting 4 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x81 EP 1 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0a80 2x 640 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 1 bAlternateSetting 5 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x81 EP 1 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0b00 2x 768 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 1 bAlternateSetting 6 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x81 EP 1 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0b80 2x 896 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 1 bAlternateSetting 7 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x81 EP 1 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0bfc 2x 1020 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 2 bAlternateSetting 0 bNumEndpoints 0 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 VideoStreaming Interface Descriptor: bLength 15 bDescriptorType 36 bDescriptorSubtype 1 (INPUT_HEADER) bNumFormats 2 wTotalLength 125 bEndPointAddress 136 bmInfo 0 bTerminalLink 5 bStillCaptureMethod 1 bTriggerSupport 0 bTriggerUsage 0 bControlSize 1 bmaControls( 0) 27 bmaControls( 1) 27 VideoStreaming Interface Descriptor: bLength 27 bDescriptorType 36 bDescriptorSubtype 4 (FORMAT_UNCOMPRESSED) bFormatIndex 1 bNumFrameDescriptors 1 guidFormat {59555932-0000-1000-8000-00aa00389b71} bBitsPerPixel 16 bDefaultFrameIndex 1 bAspectRatioX 0 bAspectRatioY 0 bmInterlaceFlags 0x00 Interlaced stream or variable: No Fields per frame: 2 fields Field 1 first: No Field pattern: Field 1 only bCopyProtect 0 VideoStreaming Interface Descriptor: bLength 30 bDescriptorType 36 bDescriptorSubtype 5 (FRAME_UNCOMPRESSED) bFrameIndex 1 bmCapabilities 0x00 Still image unsupported wWidth 640 wHeight 480 dwMinBitRate 24576000 dwMaxBitRate 147456000 dwMaxVideoFrameBufferSize 614400 dwDefaultFrameInterval 666666 bFrameIntervalType 1 dwFrameInterval( 0) 666666 VideoStreaming Interface Descriptor: bLength 6 bDescriptorType 36 bDescriptorSubtype 13 (COLORFORMAT) bColorPrimaries 1 (BT.709,sRGB) bTransferCharacteristics 1 (BT.709) bMatrixCoefficients 4 (SMPTE 170M (BT.601)) VideoStreaming Interface Descriptor: bLength 11 bDescriptorType 36 bDescriptorSubtype 6 (FORMAT_MJPEG) bFormatIndex 2 bNumFrameDescriptors 1 bFlags 1 Fixed-size samples: Yes bDefaultFrameIndex 1 bAspectRatioX 0 bAspectRatioY 0 bmInterlaceFlags 0x00 Interlaced stream or variable: No Fields per frame: 1 fields Field 1 first: No Field pattern: Field 1 only bCopyProtect 0 VideoStreaming Interface Descriptor: bLength 30 bDescriptorType 36 bDescriptorSubtype 7 (FRAME_MJPEG) bFrameIndex 1 bmCapabilities 0x00 Still image unsupported wWidth 1920 wHeight 1080 dwMinBitRate 24576000 dwMaxBitRate 147456000 dwMaxVideoFrameBufferSize 614400 dwDefaultFrameInterval 333333 bFrameIntervalType 1 dwFrameInterval( 0) 333333 VideoStreaming Interface Descriptor: bLength 6 bDescriptorType 36 bDescriptorSubtype 13 (COLORFORMAT) bColorPrimaries 1 (BT.709,sRGB) bTransferCharacteristics 1 (BT.709) bMatrixCoefficients 4 (SMPTE 170M (BT.601)) Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 2 bAlternateSetting 1 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x88 EP 8 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0080 1x 128 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 2 bAlternateSetting 2 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x88 EP 8 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0180 1x 384 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 2 bAlternateSetting 3 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x88 EP 8 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0200 1x 512 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 2 bAlternateSetting 4 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x88 EP 8 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0a80 2x 640 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 2 bAlternateSetting 5 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x81 EP 1 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0b00 2x 768 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 2 bAlternateSetting 6 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x88 EP 8 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0b80 2x 896 bytes bInterval 1 Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 2 bAlternateSetting 7 bNumEndpoints 1 bInterfaceClass 14 Video bInterfaceSubClass 2 Video Streaming bInterfaceProtocol 0 iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x88 EP 8 IN bmAttributes 5 Transfer Type Isochronous Synch Type Asynchronous Usage Type Data wMaxPacketSize 0x0bfc 2x 1020 bytes bInterval 1 Device Qualifier (for other device speed): bLength 10 bDescriptorType 6 bcdUSB 2.00 bDeviceClass 239 Miscellaneous Device bDeviceSubClass 2 bDeviceProtocol 1 Interface Association bMaxPacketSize0 64 bNumConfigurations 1 can't get debug descriptor: Resource temporarily unavailable Device Status: 0x0001 Self Powered ``` ## Reply by Kris · 2023-02-28 05:22:45 UTC Below are the errors that I am getting. ``` voxl:~$ voxl-uvc-server uvc_open failed voxl:~$ voxl-uvc-server uvc_open failed voxl:~$ voxl-uvc-server uvc_get_stream_ctrl_format_size failed ``` ``` voxl:~$ voxl-streamer -c uvc-generic -d Using configuration uvc-generic Enabling debug messages Using configuration file /etc/modalai/voxl-streamer.conf MPA interface chosen Input pipe name /run/mpa/uvc/ Output stream width 640 Output stream height 480 Output stream bitrate 1000000 Output stream rotation 0 Output frame decimator 2 No image overlay specified Camera server Connected First frame timestamp: 3202206494106 Second frame timestamp: 3203206232991 Calculated frame delta in ns: 999738885 Calculated frame delta in 100us: 9997 Calculated input frame rate is: 1 Output frame rate will be: 0 ERROR: Frame size mismatch 614400 12441600 ERROR: Timeout on input parameter initialization ``` Below is my streamer.conf file ``` { "conf-version":"1.3", "configuration": "hires", "uvc-generic": { "input": { "interface": "mpa", "mpa-camera": "uvc" }, "output": { "stream": { "rotation": 0, "width": 640, "height": 480, "decimator": 2, "bitrate": 1000000 } } }, "uvc-flir-boson": { "input": { "interface": "mpa", "mpa-camera": "uvc" }, "output": { "stream": { "rotation": 0, "width": 640, "height": 512, "decimator": 2, "bitrate": 1000000 } } }, "uvc-flir-lepton": { "input": { "interface": "mpa", "mpa-camera": "uvc" }, "output": { "stream": { "rotation": 0, "width": 160, "height": 120, "bitrate": 500000 } } }, "hires": { "input": { "interface": "mpa", "mpa-camera": "hires" }, "output": { "stream": { "rotation": 0, "width": 640, "height": 480, "decimator": 2, "bitrate": 1000000 } } }, "hires-logo": { "input": { "interface": "mpa", "mpa-camera": "hires" }, "output": { "stream": { "rotation": 0, "width": 640, "height": 480, "decimator": 2, "bitrate": 1000000 } }, "overlay": { "location": "/etc/modalai/modalai.png", "offset_x": -1, "offset_y": -1 } }, "stereo": { "input": { "interface": "mpa", "mpa-camera": "stereo" }, "output": { "stream": { "width": 640, "height": 960, "decimator": 2, "bitrate": 1000000 } } }, "tracking": { "input": { "interface": "mpa", "mpa-camera": "tracking" }, "output": { "stream": { "width": 640, "height": 480, "decimator": 2, "bitrate": 1000000 } } }, "dfs-disparity": { "input": { "interface": "mpa", "mpa-camera": "dfs_disparity" }, "output": { "stream": { "width": 640, "height": 480, "decimator": 2, "bitrate": 1000000 } } }, "qvio-overlay": { "input": { "interface": "mpa", "mpa-camera": "qvio_overlay" }, "output": { "stream": { "width": 640, "height": 544, "decimator": 2, "bitrate": 1000000 } } }, "tflite-overlay": { "input": { "interface": "mpa", "mpa-camera": "tflite" }, "output": { "stream": { "width": 640, "height": 480, "decimator": 2, "bitrate": 1000000 } } }, "hdmi-mpa": { "input": { "interface": "mpa", "mpa-camera": "v4l2" }, "output": { "stream": { "width": 640, "height": 360, "decimator": 2, "bitrate": 1000000 } } }, "gphoto2-mpa": { "input": { "interface": "mpa", "mpa-camera": "gphoto2" }, "output": { "stream": { "width": 640, "height": 360, "decimator": 2, "bitrate": 1000000 } } }, "video-test": { "input": { "interface": "test", "frame": { "width": 640, "height": 480, "format": "yuv420" } }, "output": { "stream": { "rotation": 0, "width": 640, "height": 480, "rate": 30, "bitrate": 1000000 } } }, "uvc-video": { "input": { "interface": "uvc", "device": "/dev/video0" }, "output": { "stream": { "rotation": 0, "width": 640, "height": 360, "rate": 15, "bitrate": 1000000 } } } } ``` So, it looks like I am running into the same problem that @wilkinsaf had, but I could be wrong. Please let me know what you think. Thank you ## Reply by Kris · 2023-02-28 07:41:58 UTC (in reply to Kris) I had also tried “decimator”: 1, for the UVC generic in the streamer.conf file, and that did not work either. ``` { "conf-version":"1.3", "configuration": "hires", "uvc-generic": { "input": { "interface": "mpa", "mpa-camera": "uvc" }, "output": { "stream": { "rotation": 0, "width": 640, "height": 480, "decimator": 1, "bitrate": 1000000 } } ``` ## Reply by Kris · 2023-02-28 07:44:36 UTC (in reply to Kris) The ```Frame size mismatch 614400 12441600``` is always the same. ## Reply by tom (ModalAI staff) · 2023-02-28 16:28:16 UTC @Kris You're on a pretty old platform release, I would start by updating to 0.9: https://developer.modalai.com/asset/view/115 ## Reply by Kris · 2023-03-01 00:57:42 UTC (in reply to tom) @tom Ok, thank you. I will try that first. ## Reply by Kris · 2023-03-07 00:49:44 UTC (in reply to tom) @tom I've updated my platform to 0.9 and I am still unable to successfully open the uvc camera. ``` voxl:~$ lsusb Bus 001 Device 008: ID 2560:c184 Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub Bus 001 Device 002: ID 0424:2514 Standard Microsystems Corp. USB 2.0 Hub Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub ``` ``` voxl:~$ voxl-uvc-server -p c184 uvc_open failed voxl:~$ voxl-uvc-server -v 2560 uvc_open failed voxl:~$ voxl-uvc-server -d Enabling debug messages voxl-uvc-server starting Image resolution 640x480, 30 fps chosen UVC initialized Device found uvc_open failed UVC exited voxl-uvc-server ending ``` ## Reply by tom (ModalAI staff) · 2023-03-07 00:55:47 UTC @Kris Are you sure that your UVC camera is 640x480 resolution? ## Reply by Kris · 2023-03-07 01:03:11 UTC (in reply to tom) @tom Yes, in the debug messages, it says that it is 640x480. Is there another way to check the resolution? ## Reply by tom (ModalAI staff) · 2023-03-07 01:10:36 UTC @Kris Yeah that's just the default that `voxl-uvc-server` uses if not explicitly specified otherwise with the `-r` flag. You can use `show-video-device-info.sh` and that may provide some clues. What is the part number or make and model of the UVC camera you're using? It's possible it's supported image formats don't match up with those supported by `voxl-uvc-server` ## Reply by Kris · 2023-03-07 01:18:37 UTC (in reply to tom) @tom Ok, Thank you I will try that now. Here are some details of my UVC 2.0 camera. ![e-CAM83.png](https://forum.modalai.com/assets/uploads/files/1678151914539-e-cam83.png) ## Reply by Kris · 2023-03-07 01:21:36 UTC (in reply to tom) @tom This is all the information I get from ``` show-video-device-info.sh``` ``` voxl:~$ show-video-device-info.sh /dev/video2: e-CAM83_USB 2560:c184 /dev/video3: e-CAM83_USB 2560:c184 ``` ## Reply by Kris · 2023-03-07 01:23:42 UTC Is there any chance I can get 1920 x 1080 @30 fps using h264 in the voxl-uvc-server? Or is 640 x 480 the only option in the voxl-uvc-server? ## Reply by Kris · 2023-03-07 01:27:05 UTC The rest of the information about my current uvc camera is [here.](https://www.e-consystems.com/usb-cameras/4k-sony-imx317-8mp-usb-camera.asp) ## Reply by Kris · 2023-03-07 01:41:57 UTC Additional information; ![e-CAM83-1.png](https://forum.modalai.com/assets/uploads/files/1678153298225-e-cam83-1.png) ![e-CAM83-2.png](https://forum.modalai.com/assets/uploads/files/1678153311931-e-cam83-2.png) ## Reply by Kris · 2023-03-07 01:49:50 UTC (in reply to tom) @tom I gave this a try, but no luck. ``` voxl:~$ voxl-uvc-server -d -r 1920x1080 -f 30 Enabling debug messages voxl-uvc-server starting Image resolution 1920x1080, 30 fps chosen UVC initialized Device found uvc_open failed UVC exited voxl-uvc-server ending ``` ## Reply by Kris · 2023-03-07 03:29:25 UTC (in reply to tom) @tom ``` voxl:~$ show-video-device-info.sh /dev/video2: e-CAM83_USB 2560:c184 /dev/video3: e-CAM83_USB 2560:c184 ``` /dev/video2: is h264 /dev/video3: is MJPG & YUY2 ## Reply by Kris · 2023-03-07 03:35:55 UTC ``` voxl:~$ voxl-uvc-server -l *** START DEVICE LIST *** Found device 0 Got device descriptor for 2560:c184 (null) Found device 2560:c184 uvc_open failed, Return code: I/O error (-1) Found device 0 Got device descriptor for 2560:c184 (null) Found device 2560:c184 uvc_open failed, Return code: No such device (-4) Found device 0 Got device descriptor for 2560:c184 (null) uvc_find_device failed, Return code: No such device (-4) Got device descriptor for 2560:c184 (null) Found device 2560:c184 DEVICE CONFIGURATION (2560:c184/00.00.01) --- Status: idle VideoControl: bcdUVC: 0x0100 VideoStreaming(1): bEndpointAddress: 129 Formats: FrameFormat(1) bits per pixel: 16 GUID: 4832363400001000800000aa00389b71 (H264) default frame: 1 aspect ratio: 0x0 interlace flags: 00 copy protect: 00 FrameDescriptor(1) capabilities: 00 size: 3840x2160 bit rate: 165888000-995328000 max frame size: 0 default interval: 1/15 interval[0]: 1/30 interval[1]: 1/15 FrameDescriptor(2) capabilities: 00 size: 1920x1080 bit rate: 165888000-995328000 max frame size: 0 default interval: 1/30 interval[0]: 1/30 VideoStreaming(2): bEndpointAddress: 136 Formats: UncompressedFormat(1) bits per pixel: 16 GUID: 5955593200001000800000aa00389b71 (YUY2) default frame: 1 aspect ratio: 0x0 interlace flags: 00 copy protect: 00 FrameDescriptor(1) capabilities: 00 size: 640x480 bit rate: 24576000-147456000 max frame size: 614400 default interval: 1/15 interval[0]: 1/15 MJPEGFormat(2) bits per pixel: 0 GUID: 4d4a5047000000000000000000000000 (MJPG) default frame: 1 aspect ratio: 0x0 interlace flags: 00 copy protect: 00 FrameDescriptor(1) capabilities: 00 size: 1920x1080 bit rate: 24576000-147456000 max frame size: 614400 default interval: 1/30 interval[0]: 1/30 END DEVICE CONFIGURATION *** END DEVICE LIST *** ``` ## Reply by Kris · 2023-03-07 07:22:38 UTC (in reply to tom) @tom May I ask what image formats the ```voxl-uvc-server```supports? ## Reply by Kris · 2023-03-07 10:25:20 UTC I have a feeling that maybe the problem is deriving from my camera’s GUID Format. Does the voxl-uvc-server accept ```GUID: 4832363400001000800000aa00389b71``` for h264 format? How would I go about correcting the guidFormat to match up with the voxl-uvc-server? ## Reply by tom (ModalAI staff) · 2023-03-07 18:39:52 UTC @Kris You can see supported format info here: https://gitlab.com/voxl-public/voxl-sdk/services/voxl-uvc-server/-/blob/master/src/main.c#L64 Another thing to try out is using gstreamer instead of voxl-uvc-server + voxl-streamer with a pipeline similar to the following: `gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-raw,format=YUY2 ! videoconvert ! x264enc speed-preset=ultrafast tune=zerolatency ! rtph264pay name=pay0 ! udpsink host=192.168.1.97 port=8554` The pipeline may need to be tweaked slightly but it's one I've used before for other UVC cameras that voxl-uvc-server was unhappy with ## Reply by Kris · 2023-03-07 23:08:04 UTC (in reply to tom) @tom Thank you, I will give this a try. I am trying to use H.264 on this camera. This is the second UVC camera that I’ve purchased because I am trying to log the frames from voxl-logger. From what I understand, H.264 output is the format that can do this. Is there a way to call for only the /dev/video2 to start with the voxl-uvc-server or gstreamer? Does the voxl-uvc-server accept h264 1920x1080 @30fps? ## Reply by Kris · 2023-03-08 01:09:02 UTC (in reply to tom) @tom Do I paste this in the voxl terminal? ``` gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-raw,format=YUY2 ! videoconvert ! x264enc speed-preset=ultrafast tune=zerolatency ! rtph264pay name=pay0 ! udpsink host=192.168.1.97 port=8554 ``` Does this have uvc frame or video capture capabilities? ## Reply by Kris · 2023-03-08 01:22:56 UTC (in reply to tom) @tom Sorry to bother you again, but I am not seeing the h264 format supported in the main.c script you provided for the voxl-uvc-server. Is it possible to edit the voxl-uvc-server main.c script to accept h264 format at 1920x1080 @30fps? ## Reply by tom (ModalAI staff) · 2023-03-08 01:33:25 UTC @Kris You can read more about how gstreamer and the `gst-launch-1.0` command works here: https://gstreamer.freedesktop.org/documentation/tools/gst-launch.html?gi-language=c Yes, you would run that command on VOXL2. That specific command pulls frames from `/dev/video22` (the UVC camera), it tells it to expect YUY2 formatted frames (you can change this to your liking) and then it converts it to an RTSP video stream. You could modify the pipeline to instead write to a file instead of streaming. There is a ton of documentation on gstreamer out there that can help you out with tailoring the pipeline. ## Reply by Kris · 2023-03-08 01:35:36 UTC (in reply to tom) @tom Ok, thank you for the explanation. I will read up on gstreamer and try to figure this out. You mentioned that I would run this on VOXL2. I dont have a VOXL2. Does this work on VOXL for the Seeker? ## Reply by tom (ModalAI staff) · 2023-03-08 01:48:00 UTC @Kris Apologies, I'm not sure if that will work on VOXL1. Do you have a hires mipi sensor on your VOXL? It would allow you to avoid a lot of trouble ## Reply by Kris · 2023-03-08 01:57:49 UTC (in reply to tom) @tom No, I dont have a hires mipi sensor on my VOXL. I am using the TOF, Stereo, and Tracking sensors specifically for indoor flights. I am just trying to record frames or video from a connected uvc camera while in flight. I am also trying to set one of my stereo cameras as the QVIO instead of the tracking camera. Again this is just for indoor flights. I have also asked about this QVIO setup in this [thread](https://forum.modalai.com/topic/1863/reconfiguring-vio), but have not received a response other than pointing to the extrinsics ModalAi page. ## Reply by Kris · 2023-03-09 23:02:06 UTC (in reply to tom) @tom The command you sent me earlier this week did not work on the VOXL platform. I tried variations on both our e-CAM83 and Aruducam IMX335 uvc camera modules. Could you please point me to a uvc camera that will work with the ```voxl-uvc-server```? Our main goal is to connect a uvc camera to the Seeker and be able to capture frames or video (streaming is not necessary) and send them to an onboard SD card (possibly using ```voxl-logger```. Would this [Blue Robotics](https://bluerobotics.com/store/sensors-sonars-cameras/cameras/cam-usb-low-light-r1/) uvc module work? Meaning, is it capable of connecting to the ``` voxl-uvc-server``` and be able to send frames and/or video to the onboard SD card using ``` voxl-logger``` on the VOXL1 Seeker Dev Drone? ## Reply by Kris · 2023-03-09 23:21:40 UTC (in reply to tom) @tom I have also noticed that when I updated my platform to 0.9 the streamer.conf has changed. Now our Arducam IMX335 is not even working (it had no problems streaming before). 0.9 streamer.conf ``` { "input-pipe": "hires", "bitrate": 1000000, "decimator": 2, "port": 8900, "rotation": 0 } ``` 3.8.0-0.7 streamer.conf ``` { "conf-version":"1.3", "configuration": "hires", "uvc-generic": { "input": { "interface": "mpa", "mpa-camera": "uvc" }, "output": { "stream": { "rotation": 0, "width": 640, "height": 480, "decimator": 1, "bitrate": 1000000 } } }, "uvc-flir-boson": { "input": { "interface": "mpa", "mpa-camera": "uvc" }, "output": { "stream": { "rotation": 0, "width": 640, "height": 512, "decimator": 2, "bitrate": 1000000 } } }, "uvc-flir-lepton": { "input": { "interface": "mpa", "mpa-camera": "uvc" }, "output": { "stream": { "rotation": 0, "width": 160, "height": 120, "bitrate": 500000 } } }, "hires": { "input": { "interface": "mpa", "mpa-camera": "hires" }, "output": { "stream": { "rotation": 0, "width": 640, "height": 480, "decimator": 2, "bitrate": 1000000 } } }, "hires-logo": { "input": { "interface": "mpa", "mpa-camera": "hires" }, "output": { "stream": { "rotation": 0, "width": 640, "height": 480, "decimator": 2, "bitrate": 1000000 } }, "overlay": { "location": "/etc/modalai/modalai.png", "offset_x": -1, "offset_y": -1 } }, "stereo": { "input": { "interface": "mpa", "mpa-camera": "stereo" }, "output": { "stream": { "width": 640, "height": 960, "decimator": 2, "bitrate": 1000000 } } }, "tracking": { "input": { "interface": "mpa", "mpa-camera": "tracking" }, "output": { "stream": { "width": 640, "height": 480, "decimator": 2, "bitrate": 1000000 } } }, "dfs-disparity": { "input": { "interface": "mpa", "mpa-camera": "dfs_disparity" }, "output": { "stream": { "width": 640, "height": 480, "decimator": 2, "bitrate": 1000000 } } }, "qvio-overlay": { "input": { "interface": "mpa", "mpa-camera": "qvio_overlay" }, "output": { "stream": { "width": 640, "height": 544, "decimator": 2, "bitrate": 1000000 } } }, "tflite-overlay": { "input": { "interface": "mpa", "mpa-camera": "tflite" }, "output": { "stream": { "width": 640, "height": 480, "decimator": 2, "bitrate": 1000000 } } }, "hdmi-mpa": { "input": { "interface": "mpa", "mpa-camera": "v4l2" }, "output": { "stream": { "width": 640, "height": 360, "decimator": 2, "bitrate": 1000000 } } }, "gphoto2-mpa": { "input": { "interface": "mpa", "mpa-camera": "gphoto2" }, "output": { "stream": { "width": 640, "height": 360, "decimator": 2, "bitrate": 1000000 } } }, "video-test": { "input": { "interface": "test", "frame": { "width": 640, "height": 480, "format": "yuv420" } }, "output": { "stream": { "rotation": 0, "width": 640, "height": 480, "rate": 30, "bitrate": 1000000 } } }, "uvc-video": { "input": { "interface": "uvc", "device": "/dev/video0" }, "output": { "stream": { "rotation": 0, "width": 640, "height": 360, "rate": 15, "bitrate": 1000000 } } } } ``` ## Reply by Kris · 2023-04-11 23:23:11 UTC (in reply to tom) @tom Do you happen to know some Gstreamer commands for the Logitech C270 uvc camera? I am trying to get either a streaming or recording command to work on the Seeker, with no luck so far. ## Reply by tom (ModalAI staff) · 2023-04-11 23:33:57 UTC @Kris I don't have that specific webcam or a VOXL1 but with a different one and a VOXL2, all I have to do is run `voxl-uvc-server`, see output below: ``` voxl2:/$ voxl-uvc-server loading config file Creating new config file: /etc/modalai/voxl-uvc-server.conf ================================================================= width: 640 height: 480 fps: 30 pipe_name: uvc ================================================================= ``` I'm able to pull up the stream using voxl-portal (going to IP of my VOXL2 in browser) ![8ff0d084-6556-4947-8dcb-9e8137d10ae1-image.png](https://forum.modalai.com/assets/uploads/files/1681255793019-8ff0d084-6556-4947-8dcb-9e8137d10ae1-image.png) Then alternatively I'm able to use this gstreamer command: ``` gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-raw,format=YUY2 ! videoconvert ! x264enc speed-preset=ultrafast tune=zerolatency ! rtph264pay name=pay0 ! udpsink host=192.168.1.124 port=8554 ``` to pull up the video stream in QGC ## Reply by tom (ModalAI staff) · 2023-04-11 23:35:28 UTC ![642ce503-f6b1-4999-9cf2-ba5ac5b8e504-image.png](https://forum.modalai.com/assets/uploads/files/1681256126392-642ce503-f6b1-4999-9cf2-ba5ac5b8e504-image.png) ## Reply by Kris · 2023-04-11 23:51:40 UTC (in reply to tom) @tom Thank you for your examples. I was asking about the C270 camera because @Eric-Katzfey had [mentioned](https://forum.modalai.com/topic/2011/voxl-camera-configuration/29) that he starts his camera testings with this model in order to locate where issues are coming from on other camera models. I do appreciate your support. I will continue to try different Gstreamer commands. ## Reply by tom (ModalAI staff) · 2023-04-11 23:52:42 UTC @Kris I understand, your solution will likely be similar to what I posted above ## Reply by Kris · 2023-04-12 00:03:41 UTC (in reply to tom) @tom I was able to stream the video from voxl-portal, ``` voxl:~$ voxl-uvc-server -d Enabling debug messages voxl-uvc-server starting Image resolution 640x480, 30 fps chosen UVC initialized Device found Device opened uvc_get_stream_ctrl_format_size succeeded for format YUYV Streaming starting Got frame callback! frame_format = 3, width = 640, height = 480, length = 614400, ptr = (nil) * got image 30 * got image 60 * got image 90 * got image 120 * got image 150 ``` but I cannot get the Gstreamer to work for QGC. Here is my ERROR; ``` voxl:~$ gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-raw,format=YUY2 ! videoconvert ! omxh264enc ! rtph264pay name=pay0 ! udpsink host=192.168.110.152 port=8554 Setting pipeline to PAUSED ... Pipeline is live and does not need PREROLL ... Setting pipeline to PLAYING ... New clock: GstSystemClock ** ERROR:/opt/workspace/build/apq8096-le-1-0-1_ap_standard_oem.git/apps_proc/poky/build/tmp-glibc/work/armv7a-vfp-neon-oemllib32-linux-gnueabi/lib32-gstreamer1.0-omx/1.10.4-r0/gst-omx-1.10.4/omx/gstomxh264enc.c:532:gst_omx_h264_enc_get_caps: code should not be reached Aborted ``` Maybe its a CAPS issue? I had to change x264 to omxh264, and had to completely remove ```speed-preset=ultrafast tune=zerolatency``` from the command because it wasnt playing well with VOXL1. ## Reply by tom (ModalAI staff) · 2023-04-12 00:10:38 UTC @Kris Well now that you have `voxl-uvc-server` working you should be able to use voxl-streamer on top of that to get a stream going ## Reply by Kris · 2023-04-12 00:14:54 UTC (in reply to tom) @tom Yes, I am able to get the stream working with the ```voxl-streamer -i uvc``` command, but I am trying to get a Gstreamer command working so that I can build a pipeline to record the frames. ``` voxl:~$ voxl-streamer -i uvc ERROR: object missing input-pipe WARNING: Failed to get default pipe name from configuration file ERROR: object missing bitrate WARNING: Failed to get default bitrate from configuration file Camera server Connected Stream available at rtsp://127.0.0.1:8900/live ``` Gstreamer; ``` voxl:~$ show-video-device-info.sh /dev/video2: UVC Camera (046d:0825) 046d:0825 voxl:~$ sudo gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-raw,width=640,height=480,format=YUY2 ! videoconvert ! omxh264enc ! rtph264pay name=pay0 ! udpsink host=192.168.110.152 port=8554 Setting pipeline to PAUSED ... Pipeline is live and does not need PREROLL ... Setting pipeline to PLAYING ... New clock: GstSystemClock ** ERROR:/opt/workspace/build/apq8096-le-1-0-1_ap_standard_oem.git/apps_proc/poky/build/tmp-glibc/work/armv7a-vfp-neon-oemllib32-linux-gnueabi/lib32-gstreamer1.0-omx/1.10.4-r0/gst-omx-1.10.4/omx/gstomxh264enc.c:532:gst_omx_h264_enc_get_caps: code should not be reached ``` or without width & height; ``` voxl:~$ show-video-device-info.sh /dev/video2: UVC Camera (046d:0825) 046d:0825 voxl:~$ sudo gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-raw,format=YUY2 ! videoconvert ! omxh264enc ! rtph264pay name=pay0 ! udpsink host=192.168.110.152 port=8554 Setting pipeline to PAUSED ... Pipeline is live and does not need PREROLL ... Setting pipeline to PLAYING ... New clock: GstSystemClock ** ERROR:/opt/workspace/build/apq8096-le-1-0-1_ap_standard_oem.git/apps_proc/poky/build/tmp-glibc/work/armv7a-vfp-neon-oemllib32-linux-gnueabi/lib32-gstreamer1.0-omx/1.10.4-r0/gst-omx-1.10.4/omx/gstomxh264enc.c:532:gst_omx_h264_enc_get_caps: code should not be reached ``` ## Reply by Eric Katzfey (ModalAI staff) · 2023-04-12 16:00:54 UTC (in reply to Kris) @Kris The intention with the Logitech camera was to use it with voxl-uvc-streamer as Tom pointed out. That way you have a complete working setup and then you can start changing one thing at a time to get to what you want. If you want to switch to a different camera then you can see the differences in the new camera from the Logitech camera and try to debug that way. If you want to add a record feature with GStreamer then you can fork our voxl-streamer code and add the functionality into that. If you want to do it with a gst-launch-1.0 command line pipeline then you are farther away from anything we currently support and it's going to be hard for us to offer much help. I do think that what you are trying to do should be possible.