Sora for Hierarchical Parallel Motion Planner: A Safe End-to-End Method Against OOD Events

Siyu Teng, Ran Yan, Xiaotong Zhang, Yuchen Li, Xingxia Wang, Yutong Wang, Yonglin Tian, Hui Yu, Lingxi Li, Long Chen*, Fei Yue Wang

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

4 Citations (Scopus)

Abstract

End-to-end motion planners have shown great potential for enabling fully autonomous driving. However, when facing out-of-distribution (OOD) events, these planners might not guarantee the optimal prediction of control commands. To better enhance safety, an end-to-end method that benefits robust and general policy learning from potential OOD events is urgently desirable. In this perspective, Sore4PMP, a hierarchical parallel motion planner, is presented as a suitable solution. Based on raw perception data and descriptive prompts, Sore4PMP can first leverage the advanced generative capabilities of Sora to generate virtual OOD events, and then integrate these events into the decision-making process, thereby enhancing the robustness and generalization of autonomous vehicles (AVs) in emergency scenarios. With a comprehensive outlook, this perspective aims to provide a potential direction for the development of foundation models coupled with autonomous driving and finally promote the safety, efficiency, reliability, and sustainability of AVs.

Original languageEnglish
Pages (from-to)4573-4576
Number of pages4
JournalIEEE Transactions on Intelligent Vehicles
Volume9
Issue number4
DOIs
Publication statusPublished - Apr 1 2024
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2016 IEEE.

ASJC Scopus Subject Areas

  • Automotive Engineering
  • Control and Optimization
  • Artificial Intelligence

Keywords

  • end-to-end planning
  • interpretable imitation learning
  • safety motion planning
  • Sora

Fingerprint

Dive into the research topics of 'Sora for Hierarchical Parallel Motion Planner: A Safe End-to-End Method Against OOD Events'. Together they form a unique fingerprint.

Cite this