Skip to content

Collect, store 3D data persistently while running #14

@nickswalker

Description

@nickswalker

There are two possible "first-whacks" at picking and placing.

One is doing perception from scratch whenever we need it:

  • Drive to table
  • Collect several point clouds, aggregate, filter, segment
  • Grasp a segmented cloud
  • Throw away all perception data, move to cupboard

The advantage is that the robot is well localized with respect to the point cloud; it hasn't moved since it gathered the data.
The disadvantage is that it takes multiple seconds to repeat this perception and processing each time it approaches the table.

The alternative is to keep a coarse octomap running and integrating point clouds constantly, and to rely on being localized enough :

  • Drive to table
  • Pull out chunk of octomap corresponding to area in front of robot, segment
  • Grasp a segmented cloud
  • Move to cupboard

In practice, the time constraints of tasks mean that it's highly advantageous to avoid re perceiving. It is an open question how well the octomap performs given our sensors and compute. The octomap will probably be based on realsense point clouds, so it'll run on the xavier to avoid transmitting that data to the main computer. We'll need the bringup and launch files to be in place already (homeskies/uw_fetch#7). We also need the realsense to be well calibrated before we try this (homeskies/uw_fetch#4)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions