Estimating unknown dynamics and cost as a bilinear system with Koopman-based Inverse Optimal Control

Abstract

In this work, we address the challenge of approximating unknown system dynamics and costs by representing them as a bilinear system using Koopman-based Inverse Optimal Control (IOC). Using optimal trajectories, we construct a bilinear control system in transformed state variables through a modified Extended Dynamic Mode Decomposition with control (EDMDc) that maintains exact dynamical equivalence with the original nonlinear system. We derive Pontryagin’s Maximum Principle (PMP) optimality conditions for this system, which closely resemble those of the inverse Linear Quadratic Regulator (LQR) problem due to the consistent control input and state independence from the control. This similarity allows us to apply modified inverse LQR theory, offering a more tractable and robust alternative to nonlinear Inverse Optimal Control methods, especially when dealing with unknown dynamics. Our approach also benefits from the extensive analytical properties of bilinear control systems, providing a solid foundation for further analysis and application. We demonstrate the effectiveness of the proposed method through theoretical analysis, simulation studies and a robotic experiment, highlighting its potential for broader applications in the approximation and design of control systems.

Media

Picture of the robot used and recorded trajectories for prediction.

BibTex

@misc{fernandezayala2025estimatingunknowndynamicscost,
      title={Estimating unknown dynamics and cost as a bilinear system with Koopman-based Inverse Optimal Control}, 
      author={Victor Nan Fernandez-Ayala and Shankar A. Deka and Dimos V. Dimarogonas},
      year={2025},
      eprint={2501.18318},
      archivePrefix={arXiv},
      primaryClass={eess.SY},
      url={https://arxiv.org/abs/2501.18318}, 
}