Traffic Accident Detection via Self-Supervised Consistency Learning in Driving Scenarios

  • Jianwu Fang
  • , Jiahuan Qiao
  • , Jie Bai
  • , Hongkai Yu
  • , Jianru Xue

Research output: Contribution to journalArticlepeer-review

68 Scopus citations

Abstract

With the rapid progress of autonomous driving and advanced driver assistance systems, there are growing efforts to promote their safety in natural driving scenarios, especially for the detection of the traffic accidents. However, because of the dynamic camera motion and complex scene in driving situations, traffic accident detection is still challenging. In this work, we aim to give the ability of Traffic Accident Detection for driving systems by proposing a Self-Supervised Consistency learning framework, termed as SSC-TAD, that involves the appearance, motion, and context consistency learning. The key formulation is to find the inconsistency of video frames, object locations and the spatial relation structure of scene temporally between different frames captured by the dashcam videos. Within this field, different from the previous works which concentrate on predicting the future object locations or frames, we further focus on predicting the visual scene context in driving scenarios and detecting the traffic accident by considering the temporal frame consistency, temporal object location consistency, and the spatial-temporal relation consistency of road participants. In this work, this formulation is fulfilled by a collaborative multi-task consistency learning network and the visual scene context feature is represented by a graph convolution network. The superiority to the state-of-the-art is verified by exhaustive evaluations on two large scale datasets, i.e., the AnAn Accident Detection (A3D) dataset and DADA-2000 dataset collected recently.
Original languageEnglish
Pages (from-to)9601-9614
Number of pages14
JournalIEEE Transactions on Intelligent Transportation Systems
Volume23
Issue number7
DOIs
StatePublished - Jul 1 2022

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 3 - Good Health and Well-being
    SDG 3 Good Health and Well-being

Keywords

  • adversarial learning
  • frame and location prediction
  • scene context
  • Traffic accident detection

Cite this