Build LIDAR capabilities in AirSim

[shrimalmadhur]

I'll be adding LIDAR capabilities.
ETA: 12/4 TBD

[mitchellspryn]

@shrimalmadhur Did you mean 12/4? It's currently 11/19...

[shrimalmadhur]

Thanks. Updated!

[sytelus]

Thanks. It would be great if you can summarize/outline your design.

[shrimalmadhur]

I saw your comments in some other Issue that says to extend the SensorBase class the same way other Sensors have extended it. And then I can use the Raycasting function which is already there in UAirBluePrintLib. I am planning to do it in the same way.

[tejaskhot]

Would this not be available for use with the drone?

[sytelus]

@tejaskhot yes. All AirSim sensors are reusable across vehicle types.

[nnayeer]

Any updates? Eagerly awaiting this.

[shrimalmadhur]

Got caught up in other stuff. Will update the issue once I have some update.

[realdealneil]

I am particularly interested in adding a laser altimeter to the simulator (or at least having ground truth for height-above-terrain). I'm guessing that's a subset of what you're planning to do?

[tejaskhot]

Is there any update on this?

[benasena]

I have most of the pieces of this working. I did the ray trace in VehiclePawnWrapper, then passed it through MultiRotorConnector to a variable added to Environment to get it in a distance sensor class based on the barometer implementation. I added the necessary reporters and MAVLink handlers, and can see the measurement in QGroundControl in the analyze widget and if I run "listener distance_sensor" in nsh it all looks good. I set EKF2_HGT_MODE=2 and it flies well in all modes.

For some reason it still doesn't seem to follow terrain, though. Am I missing parameters or is there something about the HIL firmware that ignores distance sensors? I believe I correctly implemented the members of the DISTANCE_SENSOR MAVLink message (http://mavlink.org/messages/common). My units are all centimeters there and I get meters when I run the nsh command. I did use Unix epoch time instead of boot time. Could that be it? Is there a good way to get an appropriate value for that in AirSim?

[nnayeer]

I work mainly on ROS, but I've managed to get a pointmap stream using depthperspective images (passing it through the appropriate conversions and ros_perception/depth_image_proc). This feels good for ground truth data but maybe some filters and noise would make it more like an actual lidar? Would be especially handy if I could spawn 4 cameras at the same point (rotated 90 degrees) and get a 360 degree pointcloud.

[benasena]

Hm, so when I set the output of the distance sensor to constant 0 and had EKF2_HGT_MODE set to use it, it seemed to fall back on the barometer so I'm not convinced it was ever using the distance sensor. I'll have to check the PX4 firmware code to see how this needs to be integrated I guess.

Interestingly, if I set it to computer vision height mode, it just rejected altitude control instead of falling back.