Skip to main navigation Skip to search Skip to main content

Towards Safety Assured End-to-End Vision-Based Control for Autonomous Racing

  • Dvij Kalaria
  • , Qin Lin
  • , John M. Dolan
  • The Robotics Institute
  • Cleveland State University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Scopus citations

Abstract

Autonomous car racing is a challenging task, as it requires precise applications of control while the vehicle is operating at cornering speeds. Traditional autonomous pipelines require accurate pre-mapping, localization, and planning, which make the task computationally expensive and environment-dependent. Recent works propose use of imitation and reinforcement learning to train end-to-end deep neural networks and have shown promising results for high-speed racing. However, the end-to-end models may be dangerous to be deployed on real systems, as the neural networks are treated as black-box models devoid of any provable safety guarantees. In this work we propose a decoupled approach where an optimal end-to-end controller and a state prediction end-to-end model are learned together, and the predicted state of the vehicle is used to formulate a control barrier function for safeguarding the vehicle to stay within lane boundaries. We validate our algorithm both on a high-fidelity Carla driving simulator and a 1/10-scale RC car on a real track. The evaluation results suggest that using an explicit safety controller helps to learn the task safely with fewer iterations and makes it possible to safely navigate the vehicle on the track along the more challenging racing line.
Original languageEnglish
Title of host publicationIFAC-PapersOnLine
EditorsHideaki Ishii, Yoshio Ebihara, Jun-ichi Imura, Masaki Yamakita
Place of Publicationnld
PublisherElsevier B.V.
Pages2767-2773
Number of pages7
Volume56
ISBN (Electronic)9781713872344
DOIs
StatePublished - Jul 1 2023
Event22nd IFAC World Congress - Yokohama, Japan
Duration: Jul 9 2023 → Jul 14 2023

Conference

Conference22nd IFAC World Congress
Country/TerritoryJapan
CityYokohama
Period07/9/23 → 07/14/23

Keywords

  • autonomous racing
  • control barrier functions
  • end-to-end control
  • imitation learning
  • uncertainty awareness
  • vision-based control

Cite this