digital image stabilisation as a gimbal alternative
-
Hello everyone,
is it possible to digitally stabilise the video image in real time with the VOXL2?
I am aware that image information is lost at the edges. One idea is to stabilise a 4k video image and then only transmit a stabilised HD video section from the centre.
Here you can see what I mean:
https://github.com/AdamSpannbauer/python_video_stabI just wanted to show with the link what I mean. You would probably need other software that can also use hardware acceleration on the VOXL2.
Best regards
Tom -
Hello everyone,
is it possible to digitally stabilise the video image in real time with the VOXL2?
I am aware that image information is lost at the edges. One idea is to stabilise a 4k video image and then only transmit a stabilised HD video section from the centre.
Here you can see what I mean:
https://github.com/AdamSpannbauer/python_video_stabI just wanted to show with the link what I mean. You would probably need other software that can also use hardware acceleration on the VOXL2.
Best regards
TomHello @TomP ,
The digital image stabilization is on our road map, but we don't have any official dates at this time.
The GPU on Voxl is very powerful and we are working on some features that make use of zero-copy approaches and optimized OpenCL functions (for Adreno GPU) for manipulating / transforming pixels in an image, filtering, undistortion, etc. We also hope to provide some examples of optimized image manipulation on GPU sooner rather than later.
VOXL2 is powerful enough to do full 4K30 (at least) stabilization in real-time. In order to achieve that, we can select the full frame resolution on the camera, which is 4056x3040 (for IMX412 camera) and we have a little wiggle room horizontally and a lot of wiggle room vertically (margin for stabilization). However, the margin can be increased by applying digital zoom, so the output image would be automatically up-sampled to 4K from a slightly smaller stabilized region (let's say 80% smaller). A smaller resolution image (lets say 2K or 1080p) can also easily be generated (the zoom / scale factor does not have to be an integer).
The stabilization algorithm will also make use of the available IMU on VOXL2.
Are you interesting in developing your own digital stabilization solution or using our (future) solution?
Alex
-
Hello @TomP ,
The digital image stabilization is on our road map, but we don't have any official dates at this time.
The GPU on Voxl is very powerful and we are working on some features that make use of zero-copy approaches and optimized OpenCL functions (for Adreno GPU) for manipulating / transforming pixels in an image, filtering, undistortion, etc. We also hope to provide some examples of optimized image manipulation on GPU sooner rather than later.
VOXL2 is powerful enough to do full 4K30 (at least) stabilization in real-time. In order to achieve that, we can select the full frame resolution on the camera, which is 4056x3040 (for IMX412 camera) and we have a little wiggle room horizontally and a lot of wiggle room vertically (margin for stabilization). However, the margin can be increased by applying digital zoom, so the output image would be automatically up-sampled to 4K from a slightly smaller stabilized region (let's say 80% smaller). A smaller resolution image (lets say 2K or 1080p) can also easily be generated (the zoom / scale factor does not have to be an integer).
The stabilization algorithm will also make use of the available IMU on VOXL2.
Are you interesting in developing your own digital stabilization solution or using our (future) solution?
Alex
@Alex-Kushleyev That sounds excellent. I would like to use your stabilisation as soon as it is available.
-
Hello @TomP ,
The digital image stabilization is on our road map, but we don't have any official dates at this time.
The GPU on Voxl is very powerful and we are working on some features that make use of zero-copy approaches and optimized OpenCL functions (for Adreno GPU) for manipulating / transforming pixels in an image, filtering, undistortion, etc. We also hope to provide some examples of optimized image manipulation on GPU sooner rather than later.
VOXL2 is powerful enough to do full 4K30 (at least) stabilization in real-time. In order to achieve that, we can select the full frame resolution on the camera, which is 4056x3040 (for IMX412 camera) and we have a little wiggle room horizontally and a lot of wiggle room vertically (margin for stabilization). However, the margin can be increased by applying digital zoom, so the output image would be automatically up-sampled to 4K from a slightly smaller stabilized region (let's say 80% smaller). A smaller resolution image (lets say 2K or 1080p) can also easily be generated (the zoom / scale factor does not have to be an integer).
The stabilization algorithm will also make use of the available IMU on VOXL2.
Are you interesting in developing your own digital stabilization solution or using our (future) solution?
Alex
@Alex-Kushleyev , we would love to use this feature too. Please keep us posted, and feel free to reach out if you need beta testers!
-
@Alex-Kushleyev , we would love to use this feature too. Please keep us posted, and feel free to reach out if you need beta testers!
@david-moro and @TomP ,
I am curious about your requirements for digital image stabilization, since there are a few approaches, as you know some use IMU, some dont.. some support large stabilization range, others only remove shakiness (for example smartphones, which use optical and digital stabilization vs a really wide field of view camera that is able to perform stabilization in the full flight envelope).
Also, image stabilization for FPV is different than for recording pretty videos - not only the range of motion may be different, but also latency, etc.
It would help if you (and anyone else) let us know what (roughly) you are looking for in digital image stabilization, so that we can consider that use case as we are designing the new feature.
As we get closer to a beta release, we will definitely welcome beta testing and feedback. Thanks!
Alex
-
@david-moro and @TomP ,
I am curious about your requirements for digital image stabilization, since there are a few approaches, as you know some use IMU, some dont.. some support large stabilization range, others only remove shakiness (for example smartphones, which use optical and digital stabilization vs a really wide field of view camera that is able to perform stabilization in the full flight envelope).
Also, image stabilization for FPV is different than for recording pretty videos - not only the range of motion may be different, but also latency, etc.
It would help if you (and anyone else) let us know what (roughly) you are looking for in digital image stabilization, so that we can consider that use case as we are designing the new feature.
As we get closer to a beta release, we will definitely welcome beta testing and feedback. Thanks!
Alex
@Alex-Kushleyev, no need for super low-latency FPV, just using a higher megapixel sensor to stabilize down to what we can consistently stream down the radio link. Some form of digital gimbal would be great too, where we can steer the field of view to a specific region
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login