Learning Robotic Manipulation of Challenging Objects through Differentiable Physics

01 November 2020 → 31 October 2024
Research Foundation - Flanders (FWO)
Research disciplines
  • Natural sciences
    • Machine learning and decision making
  • Engineering and technology
    • Automation, feedback control and robotics
    • Modelling and simulation
differentiable programming machine learning robotics
Project description

In this project, we will teach a robotic arm to manipulate objects of various challenging materials. To this end, we will develop differentiable physical models of the robots, the objects and the interaction between them. These differentiable models can be improved by learning form data. They integrate seamlessly with deep learning techniques and can be jointly optimized through gradient descent. This approach offers an interesting possibility of combining built-in prior knowledge and data-driven learning. Learning will help overcome model inaccuracies while the built-in prior knowledge can dramatically improve data-efficiency over fully black-box techniques, which have seen limited success in real-world applications for this reason.