Framework for Efficient Robotic Manipulation

FERM is a framework that enables robots to learn tasks within an hour of real time training. Project Page: https://sites.google.com/view/efficient-robotic-manipulation.

The project and this codebase are joint work by Albert Zhan*, Ruihan (Philip) Zhao*, Lerrel Pinto, Pieter Abbeel, Misha Laskin. The implementation is based off of RAD.

Getting Started

Create a conda environment, and install the necessary packages.

conda create -n ferm python=3.7
pip install -r requirements.txt

Running Experiments

Sample scripts are included in the scripts folder. This includes training, evaluating, as well as behavior cloning baselines. To launch the experiments, navigate the project root folder and run

./scripts/script_name.sh

Robotic Experiments

To run robotic experiments, create your gym environment interface with your robotic setup, and substitute the --domain_name flag with your registered environment name.

Using Demonstrations

Real world demonstrations

To use demonstrations, save the (obs, next_obs, actions, rewards, not_dones) demonstration tuple (a tuple of X length lists) into 0_X.pt, where X is the number of entries saved. Include the --replay_buffer_load_dir=work_directory_path/0_X.pt

Sim demonstrations

Our sim experiments use large amounts of demonstrations, which are generated on the fly through an expert policy that uses state input. Include the tags --demo_model_dir=path_to_expert --demo_model_step=X, where the expert policy is saved as path_to_expert/model/actor_X.pt and path_to_expert/model/critic_X.pt.