Bridging the Sim-to-Real Gap with Dynamic Compliance Tuning for Industrial Insertion

ICRA 2024

1University of California, Berkeley, 2Autodesk Research

We achieve zero-shot sim-to-real transfer and generalization to a variety of real-world industrial insertion tasks.

Abstract

Contact-rich manipulation tasks often exhibit a large sim-to-real gap. For instance, industrial assembly tasks frequently involve tight insertions where the clearance is less than 0.1 mm and can even be negative when dealing with a deformable receptacle. This narrow clearance leads to complex contact dynamics that are difficult to model accurately in simulation, making it challenging to transfer simulation-learned policies to physical robots.

We propose a novel framework for robustly learning manipulation skills for real-world tasks using simulated data only. Our framework consists of two main components: the “Force Planner” and the “Gain Tuner”. The Force Planner plans both the robot motion and desired contact force, while the Gain Tuner dynamically adjusts the compliance control gains to track the desired contact force during task execution. The key insight of this work is that by adaptively adjusting the robot’s compliance control gains, we can explicitly modulate the contact force in the new environment, thereby generating trajectories similar to those trained in simulation and narrowing the sim-to-real gap.

Experimental results show that our method, trained in simulation on a generic square peg-and-hole task, can generalize to a variety of real-world insertion tasks involving narrow or even negative clearances, all without requiring any fine-tuning.

Method

In simulation, we collect data with an RL agent to offline train both the Force Planner and the Gain Tuner:



During real-world deployment, the Force Planner plans both the robot motion and desired contact force. The Gain Tuner dynamically adjusts the compliance control gains to track the desired contact force:



Experiments

Rectangular 0.05mm

Rectangular 0.02mm

The clearance is so tight that it can't be unplugged!

Round 0.05mm

Round 0.02mm

The clearance is so tight that it can't be unplugged!


Ethernet connector

Waterproof connector

Hanger -0.21mm

Kingpin -0.21mm


Success rate comparison: our proposed method outperforms baseline methods for all tasks.

Video


BibTeX

@article{zhang2024dynamic
 	author    = {Zhang, Xiang and Tomizuka, Masayoshi and Li, Hui},
 	title     = {Bridging the Sim-to-Real Gap with Dynamic Compliance Tuning for Industrial Insertion},
 	journal   = {ICRA},
 	year      = {2024},
}