ed_sensor_integration
Tools

image saver

  • ed_image_saver: Shows RGBD image stream and allows to save images. Example usage (N.B.: use robot name as a namespace):
rosrun ed_sensor_integration ed_image_saver __ns:=hero

and once you see an image in a CV window popping up, press the space bar to save it. The tool will write a json and rgbd file to the current folder with a timestamp as filename.

fitter

  • ed_fitter_live: Shows RGB image stream and a visualization to show the fitting process. Example usage (N.B.: use robot name as a namespace):
rosrun ed_sensor_integration ed_fitter_live <worldmodel_name> <entity_id> <rgbd_topic>

This visualises an image like the one below. With the original pose of the entity in blue and the newly fitted pose in yellow. The data used to fit the object is shown in purple.

RGB image shown during fitter Visualisation of the fitting

  • ed_fitter_data: Similar to the above if one wishes to visualise the fitting using a saved rgbd image. Iterates over snapshots in a directory, performs a Fit and displays the result. To run:
rosrun ed_sensor_integration ed_fitter_data <stamp>.json <worldmodel_name> <entity_id>

segmenter

  • ed_segmenter: Iterates over snapshots in a directory, performs a Kinect update and displays the result. To run:
rosrun ed_sensor_integration ed_segmenter <stamp>.json [worldmodel name] [entity to segment on]

This includes the entire 'update' sequence, including (but not limited to):

  • Updating entity position
  • Updating sensor pose
  • Removing the background
  • Clearing convex hulls that are no longer there
  • Clustering
  • Merging overlapping convex hulls
  • Associate and update entities
  • Removing entities that are not associated