PhD-manipulation

Learning-based slip detection for adaptive grasp control in robotic manipulation

PhD Thesis Project — Théo Ayral
CEA (Leti & List) · Université Paris-Saclay


CONTEXT: TraceBot Project

Robotic manipulation in critical environements.

TraceBot is an EU project developing robotic systems that can verify and trace manipulation actions (“audit trail”) for regulated environments, with a focus on handling sterile medical products.

Gripper morphism / project overview
TraceBot logo

TraceBot / manipulation platform

Hardware

Multifingered gripper & actuation
Gripper: hardware, digital twin, kinematic chain
Backdrivable tendon actuation
  • Four-fingered, 14-DoF gripper
  • Backdrivable tendon actuation enabling haptic interaction
  • Designed for multi-contact grasping and internal force control
Piezoelectric tactile sensing (PzE) — slip detection
Piezoelectric tactile sensor structure PzE vibration signal

Piezoelectric sensors capture high-frequency dynamics, enabling detection of dynamic tactile events and incipient slip.

  • Piezoelectric PVDF–TrFE tactile transducers
  • High-bandwidth sensing: 10 kHz sampling (30 Hz – 2.5 kHz effective)
  • Captures friction-induced vibrations and dynamic slip events

Project page for slip detection using spectro-temporal learning

Piezoresistive tactile arrays (PzR) — contact estimation
Piezoresistive array structure PzR pressure/contact visualization

Piezoresistive arrays provide pressure distribution and contact localization, supporting grasp modeling and internal force coordination.

  • Piezoresistive polymer (Velostat™) tactile arrays
  • 8×8 taxel matrix from orthogonal electrode sheets
  • Provides pressure distribution, contact area, and CoP estimation

Project page for internal-force control


Contributions

The contributions build on each other, following the narrative flow of the thesis:

Thesis contribution flow: slip detection → robustness → reactive slip control

C1 — Early slip detection from tactile vibrations

Detect incipient slip from high-bandwidth tactile vibrations using learning-based spectro-temporal analysis, in real time (100 Hz).

Related publications

Project page

C2 — Data-driven robustness to manipulation perturbations

Improve robustness to transient events and actuation noise through perturbation-aware training and haptic data fusion, reducing false alarms while preserving low detection latency.

Related publications

C3 — Closed-loop adaptation of grasp forces

Stabilize multi-fingered grasps by injecting internal forces based on tactile feedback, without relying on explicit friction models.

Related publications

Project page


Code & Resources

Slides

Contact

Théo AYRAL