Probing Intel Realsense LIDAR with voxl-mapper

[Zachary Lowell 0]

Hi!

I currently have some code written that pipes some lidar data from an intel realsense to voxl-mapper. AKA all the pipes that the modal TOF camera uses in voxl-camera-server, I am writing to as well. I am able to see the point cloud and tof ir image and depth image in voxl-portal, but when I run voxl-mapper I immediately am hit with:

ERROR in pipe_server_write_point_cloud, received NULL data pointer
ERROR in pipe_server_write_point_cloud, received NULL data pointer
ERROR in pipe_server_write_point_cloud, received NULL data pointer
ERROR in pipe_server_write_point_cloud, received NULL data pointer
ERROR in pipe_server_write_point_cloud, received NULL data pointer
ERROR in pipe_server_write_point_cloud, received NULL data pointer

I am printing data on both ends and what is going from the intel realsense is clearly making it to voxl-mapper, but unsure why I am getting this error since I am writing the point cloud from my custom code. Is voxl-mapper also trying to probe the realsense?

Thanks!
Zach

[admin]

Hey @Zachary-Lowell-0 ,

So you have a custom driver for realsense going right? We don't have anything going for realsense so we aren't trying to probe anything (assuming you mean access the interface (not sure if it's UART/USB/I2C etc) but portal definitely isn't going to be interacting with devices like that.

[modaltb]

Oops, wrong login on last response

[wilkinsaf]

@modaltb Wanted to reply here. We figured out the issue. We needed to pipe over additional information to voxl-mapper. Zach has more details in case anyone is curious

[robertshmurda]

@Zachary-Lowell-0 Hi, this is a reply out of nowhere but our project also involves integrating a LiDAR (not the RealSense) with the VOXL2. We have not yet started the process, but I was wondering if your project involved the replacement of the TOF sensors or just piping the LiDAR data to voxl-mapper and bypassing the data sent by the built-in sensors. I also want to ask about the code you used and problems you encountered if it's no trouble to you, it would be substantially helpful for our project.

[Zachary Lowell 0]

@robertshmurda this has been done by myself by piping the point cloud directly into the MPA.

You can grab the point cloud from whatever api/sdk exists for your lidar and as long as you can get it into the correct struct to pass through the MPA, you can do that and stream it directly to voxl-mapper.

If you have more questions - feel free to email me zachary.lowell@ascendengineer.com and we can hop on a call or something.

[robertshmurda]

@Zachary-Lowell-0 Thanks Zach, went ahead and sent you an email.

[K.Stute]

Hi @Zachary-Lowell-0,
sorry to reactivate this old topic but I'm stuck trying to get a real-sense D455 to work over the USB-port of the voxl2. Since apparently the real-sense products are not support by modalai I'd like to know how you got the camera connected and working.
Thanks in advance!

[wilkinsaf]

@K-Stute we had to write a customer driver to handle it

[K.Stute]

@wilkinsaf any chance that this driver is open source? Would save me some time^^

[wilkinsaf]

@K-Stute I wish, but it is not.