Understanding ToF data post processing
-
Hi, I've been working with the ToF sensor under version 0.8.1 of the camera server. I understand that there is some post-processing being done on the ToF data, what I am mainly interested in is the logic that throws away some of the data (the zeroed points in the point cloud).
Looking at the code, is RoyaleDataDone the first function that get's called in ModalAI's codebase, and does all of the post processing happen inside closed source PMD libraries? Or is the mentioned "TOF bridge" that does the post-processing also ModalAI's code that I can look at to understand the post-processing procedure?
-
After some digging it looks like control passes out of open source at TOFProcessRAW16 and passes back into open source at RoyaleDataDone. In between these calls I assume that "PMD closed source post processing" is being performed which uses anywhere between 5% and 25% of CPU on the VOXL depending on the ToF FPS.
-
yes, that sounds correct
-
@Chad-Sweet Any idea if 25% CPU is the minimum achievable for 30FPS? I want to run the ToF at the highest FPU possible, but using 1/4 of the CPU to process a sensor is prohibitory.
-
@Chad-Sweet Is
royale-331-spectre-4-7 - 0.0.3the latest version of the PMD SDK? If not, is it possible to update to the latest version to get any efficiency improvements released by PMD? -
No, it is not the latest.
It's a few months of work on our end to update the SDK. We may try it later this year, but no formal plans to do so