Event-based optical flow: Method categorisation and review of techniques that leverage deep learning

Robert Guamán-Rivera*, Jose Delpiano, Rodrigo Verschae

*Corresponding author for this work

Research output: Contribution to journalShort surveypeer-review

Abstract

Developing new convolutional neural network architectures and event-based camera representations could play a crucial role in autonomous navigation, pose estimation, and visual odometry applications. This study explores the potential of event cameras in optical flow estimation using convolutional neural networks. We provide a detailed description of the principles of operation and the software available for extracting and processing information from event cameras, along with the various event representation methods offered by this technology. Likewise, we identify four method categories to estimate optical flow using event cameras: gradient-based, frequency-based, correlation-based and neural network models. We report on these categories, including their latest developments, current status and challenges. We provide information on existing datasets and identify the appropriate dataset to evaluate deep learning-based optical flow estimation methods. We evaluate the accuracy of the implemented methods using the average endpoint error metric; meanwhile, the efficiency of the algorithms is evaluated as a function of execution time. Finally, we discuss research directions that promise future advances in this field.

Original languageEnglish
Article number129899
JournalNeurocomputing
Volume635
DOIs
StatePublished - 28 Jun 2025

Bibliographical note

Publisher Copyright:
© 2025

Keywords

  • Computer vision
  • Deep learning
  • Event camera
  • Neural networks
  • Optical flow
  • Robotics

Fingerprint

Dive into the research topics of 'Event-based optical flow: Method categorisation and review of techniques that leverage deep learning'. Together they form a unique fingerprint.

Cite this