IEEE RA-L'23 Human-in-the-loop Embodied Intelligence with Interactive Simulation Environment for Surgical Robot Learning
ICRA'23 Demonstration-Guided Reinforcement Learning with Efficient Exploration for Task Automation of Surgical Robot
ISMR'22 Integrating artificial intelligence and augmented reality in robotic surgery: An initial dVRK study using a surgical education scenario
IROS'21 SurRoL: An open-source reinforcement learning centered and dVRK compatible platform for surgical robot learning

• dVRK compatible robots.
• Gym style API for reinforcement learning.
• Ten surgical-related tasks.
• Various object assets.
• Based on PyBullet for physics simulation.

The project is built on Ubuntu with Python 3.7, PyBullet, Gym 0.15.6, and evaluated with Baselines, TensorFlow 1.14.

1. Create a conda virtual environment and activate it.

   conda create -n surrol python=3.7 -y
   conda activate surrol

2. Install gym (slightly modified), tensorflow-gpu==1.14, baselines (modified).

git clone https://github.com/med-air/SurRoL.git
cd SurRoL
pip install -e .

The robot control API follows dVRK (before "crtk"), which is compatible with the real-world dVRK robots.

You may have a look at the jupyter notebooks in tests. There are some test files for PSM and ECM, that contains the basic procedures to start the environment, load the robot, and test the kinematics.

We also provide some run files to evaluate the environments using baselines.

If you find the paper or the code helpful to your research, please cite the project.

@inproceedings{xu2021surrol,
  title={SurRoL: An Open-source Reinforcement Learning Centered and dVRK Compatible Platform for Surgical Robot Learning},
  author={Xu, Jiaqi and Li, Bin and Lu, Bo and Liu, Yun-Hui and Dou, Qi and Heng, Pheng-Ann},
  booktitle={2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
  year={2021},
  organization={IEEE}
}

SurRoL is released under the MIT license.

The code is built with the reference of dVRK, AMBF, dVRL, RLBench, Decentralized-MultiArm, Ravens, etc.

For any questions, please feel free to email qidou@cuhk.edu.hk