nbv_sim/README.md

active_grasp

Setup

While the policies are hardware-agnostic, the experiments are designed to work with a Franka Emika Panda and an Intel Realsense D435 attached to the wrist of the robot.

The code was developed and tested on Ubuntu 20.04 with ROS Noetic. It depends on the following external packages:

• MoveIt
• TRAC-IK
• VGN
• franka_ros and realsense2_camera (only required for hardware experiments)

Additional Python dependencies can be installed with

pip install -r requirements.txt

Finally, run catkin build active_grasp to build the package.

Experiments

Start a roscore.

roscore

To run simulation experiments.

# Start the simulation environment
roslaunch active_grasp env.launch sim:=true

# Run the experiment
python3 scripts/run.py nbv

To run real world experiments.

# Start the hardware drivers
roslaunch active_grasp hw.launch

# Launch the hw environment
roslaunch active_grasp env.launch sim:=false

# Run the experiment
python3 scripts/run.py nbv --wait-for-input