Awesome-Event-Imaging

January 10, 2025 ยท View on GitHub

Welcome to Awesome-Event-Imaging, a curated list of papers, projects, and resources related to event-based imaging. Event cameras have revolutionized the way we capture high-speed, high-dynamic-range, and low-latency visual information, and this repository serves as a comprehensive guide to the cutting-edge research and developments in this field.

This collection is designed to be a valuable resource for anyone interested in event-based imaging, whether you're a researcher, practitioner, or enthusiast. It includes works across various domains such as image reconstruction, super-resolution, motion deblurring, HDR imaging, and more. Whether you're just starting out or looking to dive deeper into the subject, you will find relevant papers, methodologies, and tools here.

Google Drive

You can explore and contribute to this list directly via the following Google Drive link: Event Imaging Paper List

The Google Drive contains the most up-to-date papers, including important references, summaries, and highlights.

Table of Contents

The list is categorized into the following topics for better navigation:

  • 3D Gaussian Splitting
  • Deblurring
  • Event Super-Resolution (Event-SR)
  • Light Field Imaging
  • High Dynamic Range Imaging (HDR)
  • Event-to-Image Reconstruction
  • Event Denoising
  • Low-Light Enhancement
  • Motion Estimation and Flow
  • ISR (Image Super-Resolution)
  • Focal Stack and Depth Perception

How to Use

  1. Browse Topics: Each topic section contains a list of relevant papers and methods. You can easily find high-impact papers related to your research area.
  2. Contribute: If you know of any papers or resources that are missing, feel free to open an issue or submit a pull request to update this list.
  3. Stay Updated: The list is regularly updated with new papers and findings. Be sure to check back for the latest in event imaging research.

Contributing

Contributions are welcome! To contribute to this repository, please follow these steps:

  1. Fork this repository.
  2. Add any missing papers or resources to the appropriate section.
  3. Submit a pull request with a brief description of the changes.

Event to Video

YearPublicationTitleHighlight
2024TPAMIFast Window-Based Event Denoising with Spatiotemporal Correlation EnhancementProposes a fast window-based method for event denoising by enhancing spatiotemporal correlations.
2024ArxivEvent-Stream Super Resolution using Sigma-Delta Neural NetworkPresents a method for event-stream super-resolution using a Sigma-Delta neural network.
2024ArxivEvent-based Continuous Color Video Decompression from Single FramesFocuses on continuous color video decompression using event data from single frames.
2023ICCVUnsupervised Video Deraining with an Event CameraIntroduces an unsupervised video deraining approach using event cameras.
2023ICCVGeneralizing Event-based Motion Deblurring in Real-world ScenariosFocuses on generalizing event-based motion deblurring for diverse real-world scenarios.
2023IJCVDeblurring Low-light Images with EventsUses event data to enhance low-light image deblurring.
2022TPAMIFormulating Event-Based Image Reconstruction as a Linear Inverse Problem With Deep Regularization Using Optical FlowProposes a formulation for event-based image reconstruction as a linear inverse problem using optical flow and deep regularization.
2022ECCVEvent-based Fusion for Motion Deblurring with Cross-modal AttentionExplores cross-modal attention for event-based fusion in motion deblurring.
2022ECCVEvent-guided Deblurring of Unknown Exposure Time VideosFocuses on event-guided deblurring for videos with unknown exposure times.
2021CVPREventZoom: Learning to Denoise and Super Resolve Neuromorphic EventsProposes EventZoom for denoising and super-resolution of neuromorphic events.
2021CVPRBack to Event Basics: Self-supervised Learning of Image Reconstruction for Event Cameras via Photometric ConstancyIntroduces self-supervised learning for image reconstruction from event cameras based on photometric constancy.
2021CVPRImage Reconstruction from Neuromorphic Event Cameras Using Laplacian-Prediction and Poisson Integration with Spiking and Artificial Neural NetworksCombines laplacian-prediction and Poisson integration for image reconstruction from event cameras using neural networks.
2021ICCVEventGAN: Leveraging Large Scale Image Datasets for Event CamerasUses large-scale image datasets for training EventGAN to enhance event camera image reconstruction.
2020CVPRLearning to Super Resolve Intensity Images from EventsFocuses on super-resolution of intensity images from events.
2020ECCVReducing the Sim-to-Real Gap for Event CamerasProposes methods to reduce the simulation-to-reality gap for event cameras.
2020ICIPEvent-based High Frame-rate Video Reconstruction with a Novel Cycle-Event NetworkIntroduces a cycle-event network for high frame-rate video reconstruction from event data.
2020WACVFast Image Reconstruction with an Event CameraA fast approach to image reconstruction using event cameras.
2018IJCVReal-time Intensity-Image Reconstruction for Event Cameras Using Manifold RegularisationProposes real-time intensity-image reconstruction for event cameras using manifold regularization.

Video Frame Interpolation

TopicYearPublicationTitleHighlight
VFI2024AAAIVideo Frame Prediction from a Single Image and Events
VFI2024ArxivEvent-based Continuous Color Video Decompression from Single Frames
VFI2024ArxivEvent-Enhanced Snapshot Compressive Videography at 10K FPS
VFI2024CVPRTTA-EVF: Test-Time Adaptation for Event-based Video Frame Interpolation via Reliable Pixel and Sample Estimation
VFI2024CVPRVideo Frame Interpolation via Direct Synthesis with the Event-based ReferenceVideo Frame Interpolation via Direct Synthesis with the Event-based Reference
VFI2024TMMVideo Frame Interpolation With Stereo Event and Intensity Cameras
VFI2023AAAISVFI: spiking-based video frame interpolation for high-speed motion
VFI2023ArxivIDO-VFI: Identifying Dynamics via Optical Flow Guidance for Video Frame Interpolation with Events
VFI2023ArxivMAEVI: Motion Aware Event-Based Video Frame Interpolation
VFI2023CVPR1000 FPS HDR Video With a Spike-RGB Hybrid Camera
VFI2023CVPREvent-based video frame interpolation with cross-modal asymmetric bidirectional motion fields
VFI2023ICRAE-VFIA: Event-Based video frame interpolation with attention
VFI2023IROSRevisiting Event-based Video Frame Interpolation
VFI2022CVPRTime lens++: Event-based frame interpolation with parametric non-linear flow and multi-scale fusion
VFI2022CVPRTimereplayer: Unlocking the potential of event cameras for video interpolation
VFI2022ECCVVideo interpolation by event-driven anisotropic adjustment of optical flow
VFI2021ICCVTraining weakly supervised video frame interpolation with events
VFI;Dataset2021CVPREfi-net: Video frame interpolation from fusion of events and frames
VFI;Dataset2021CVPRTime lens: Event-based video frame interpolation
VFI;Deblurring2024CVPRLatency Correction for Event-guided Deblurring and Frame Interpolation
VFI;Deblurring2023CVPREvent-based blurry frame interpolation under blind exposure
VFI;Deblurring2023CVPREvent-based frame interpolation with ad-hoc deblurring
VFI;Deblurring2022CVPRE-cir: Event-enhanced continuous intensity recovery
VFI;Deblurring2022CVPRUnifying motion deblurring and frame interpolation with events
VFI;Deblurring2020ECCVLearning event-driven video deblurring and interpolation
VFI;Deblurring2019CVPRBringing a blurry frame alive at high frame-rate with an event camera
VFI;Deblurring;RSC2024CVIUNeural image re-exposure
VFI;Deblurring;RSC2024ECCVUniINR: Event-Guided Unified Rolling Shutter Correction, Deblurring, and Interpolation
VFI;HDR2019CVPREvent-based high dynamic range image and very high frame rate video generation using conditional generative adversarial networks
VFI;HDR2019TPAMIHigh speed and high dynamic range video with an event camera
VFI;LowLightEnhancement2024SIGRAPH AISAFrom Sim-to-Real: Toward General Event-based Low-light Frame Interpolation with Per-scene Optimization
VFI;RSC2024ArxivSelf-supervised Learning of Event-guided Video Frame Interpolation for Rolling Shutter Frames
VFI;VSR2024ArxivHR-INR: Continuous Space-Time Video Super-Resolution via Event Camera
VFI;VSR;Deblurring;RSC;HDR;Benchmarking2024TPAMIEventAid: Benchmarking Event-aided Image/Video Enhancement Algorithms with Real-captured Hybrid Dataset

Deblurring

YearPublicationTitleHighlight
2024ACMMMColor4E: Event Demosaicing for Full-color Event Guided Image DeblurringFocuses on color restoration in event-guided image deblurring by fusing mosaic color events to avoid color bleeding artifacts. Proposes Color4E network for enhancing color restoration and deblurring quality.
2024CVPRFrequency-aware Event-based Video Deblurring for Real-World Motion BlurAddresses video deblurring by restoring sharp frames from blurred clips, using event cameras to capture motion information asynchronously.
2024ECCVTowards Real-world Event-guided Low-light Video Enhancement and DeblurringProposes a framework for event-guided low-light video enhancement and deblurring in real-world scenarios.
2023ICCVGeneralizing Event-based Motion Deblurring in Real-world ScenariosFocuses on generalizing event-based motion deblurring to handle various real-world scenarios.
2023ICCVNon-coaxial Event-guided Motion Deblurring with Spatial AlignmentExplores non-coaxial event-guided motion deblurring by incorporating spatial alignment for enhanced accuracy.
2023IJCVDeblurring Low-light Images with EventsUses event-based data to enhance low-light image deblurring in challenging conditions.
2022ECCVEvent-based Fusion for Motion Deblurring with Cross-modal AttentionIntroduces event-based fusion for motion deblurring, leveraging cross-modal attention mechanisms to improve deblurring accuracy.
2022ECCVEvent-guided Deblurring of Unknown Exposure Time VideosFocuses on event-guided deblurring for videos with unknown exposure times.
2021ICCVBringing Events into Video Deblurring with Non-consecutively Blurry FramesDiscusses integrating events into video deblurring using non-consecutive blurry frames.
2021ICCVMotion Deblurring with Real EventsExplores the use of real event data for motion deblurring.
2020CVPRLearning Event-based Motion DeblurringProposes a learning-based approach to event-based motion deblurring.

Rolling Shutter Currection

TopicYearPublicationTitleHighlight
RSC;Deblurring2023CVPREvshutter: Transforming events for unconstrained rolling shutter correction
RSC;Deblurring2022CVPREvunroll: Neuromorphic events based rolling shutter image correction

Video Super-resolution

TopicYearPublicationTitleHighlight
VSR2024ECCVEvent-Adapted Video Super-Resolution
VSR2024ICMLEvTexture: Event-driven Texture Enhancement for Video Super-Resolution
VSR2023CVPRLearning spatial-temporal implicit neural representations for event-guided video super-resolution
VSR2023ICIPVideo Super-Resolution Via Event-Driven Temporal Alignment
VSR2021CVPRTurning Frequency to Resolution: Video Super-resolution via Event Cameras
VSR;Deblurring;Denoising2020CVPRJoint filtering of intensity images and neuromorphic events for high-resolution noise-robust imaging
VSR;Deblurring;Denoising2020ECCVEvent enhanced high-quality image recovery

Low-light Enhancement

TopicYearPublicationTitleHighlight
LowLightEnhancement2024ACMMMExploring in Extremely Dark: Low-Light Video Enhancement with Real Events
LowLightEnhancement2024ArxivEvLight++: Low-Light Video Enhancement with an Event Camera: A Large-Scale Real-World Dataset, Novel Method, and More
LowLightEnhancement2024ArxivHUE Dataset: High-Resolution Event and Frame Sequences for Low-Light Vision
LowLightEnhancement2024CVPRSeeing Motion at Nighttime with an Event Camera
LowLightEnhancement2024CVPRTowards Robust Event-guided Low-Light Image Enhancement: A Large-Scale Real-World Event-Image Dataset and Novel Approach
LowLightEnhancement2023AAAILow-Light Video Enhancement with Synthetic Event Guidance
LowLightEnhancement2023ICCVCoherent event guided low-light video enhancement
LowLightEnhancement2023IJCNNEvent-Guided Attention Network for Low Light Image Enhancement
LowLightEnhancement2023JVCIREvent-guided low light image enhancement via a dual branch GAN
LowLightEnhancement2023TMMEvent-Based Low-Illumination Image Enhancement

HDR Imaging

YearPublicationTitleHighlight
2024ACCVEvent-based Image Enhancement Under High Dynamic Range ScenariosFocuses on event-based image enhancement for HDR scenarios.
2024ArxivEvent-based Asynchronous HDR Imaging by Temporal Incident Light ModulationProposes a method for asynchronous HDR imaging using temporal light modulation with event cameras.
2024ArxivHDR Imaging for Dynamic Scenes with EventsDiscusses HDR imaging techniques for dynamic scenes using event cameras.
2024ECCVTemporal-Mapping Photography for Event CamerasExplores temporal-mapping photography for event cameras to improve HDR imaging.
2024NeurocomputingGeneralizing Event-based HDR Imaging to Various ExposuresGeneralizes event-based HDR imaging for handling various exposures in dynamic scenes.
2024Remote SensingERS-HDRI: Event-Based Remote Sensing HDR ImagingIntroduces an event-based HDR imaging method for remote sensing applications.
2023CVPRLearning Event Guided High Dynamic Range Video ReconstructionFocuses on event-guided high dynamic range video reconstruction.
2023TPAMIEventHDR: From Event to High-Speed HDR Videos and BeyondPresents a framework for HDR video generation using event cameras and extends to high-speed videos.
2022CVPRMulti-Bracket High Dynamic Range Imaging With Event CamerasProposes multi-bracket HDR imaging with event cameras for enhanced dynamic range.
2021ICCVAn Asynchronous Kalman Filter for Hybrid Event CamerasIntroduces an asynchronous Kalman filter for hybrid event cameras in HDR imaging.
2020CVPRNeuromorphic Camera Guided High Dynamic Range ImagingFocuses on HDR imaging using neuromorphic cameras for enhanced dynamic range.

3D Gaussian Splitting

YearPublicationTitleHighlight
2024ACM-MMSpikeGS: 3D Gaussian Splatting from Spike Streams with High-Speed Camera MotionThis paper explores 3D Gaussian splatting using spike stream data captured from high-speed camera motion.
2024MLSPEv-GS: Event-based Gaussian Splatting for Efficient and Accurate Radiance Field RenderingIntroduces an efficient and accurate event-based Gaussian splatting method for radiance field rendering.
2024ArxivE-3DGS: Gaussian Splatting with Exposure and Motion EventsDiscusses the integration of exposure and motion events in 3D Gaussian splatting.
2024ArxivEaDeblur-GS: Event-Assisted 3D Deblur Reconstruction with Gaussian SplattingProposes a 3D deblurring reconstruction method with event-based assistance.
2024ArxivEF-3DGS: Event-Aided Free-Trajectory 3D Gaussian SplattingDescribes free-trajectory 3D Gaussian splatting aided by event data.
2024ArxivElite-EvGS: Learning Event-Based 3D Gaussian Splatting by Distilling Event-to-Video PriorsIntroduces a method of learning event-to-video priors to optimize event-driven 3D Gaussian splatting.
2024ArxivEvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry ImagesUses event stream data to assist in Gaussian splatting from blurry images.
2024ArxivEvent-Boosted Deformable 3D Gaussians for Fast Dynamic Scene ReconstructionPresents an event-boosted deformable 3D Gaussian method for fast dynamic scene reconstruction.
2024ArxivGS-EVT: Cross-Modal Event Camera Tracking Based on Gaussian SplattingExplores cross-modal event camera tracking using Gaussian splatting techniques.
2024ArxivINCEVENTGS: Pose-Free Gaussian Splatting from a Single Event CameraIntroduces pose-free Gaussian splatting using data from a single event camera.
2024CORLEvent3DGS: Event-Based 3D Gaussian Splatting for High-Speed Robot EgomotionFocuses on event-based 3D Gaussian splatting for high-speed robot egomotion.
2024ICIPE2GS: Event Enhanced Gaussian SplattingExplores event-enhanced Gaussian splatting techniques for improved performance.
2024ICMLEvGGS: A Collaborative Learning Framework for Event-Based Generalizable Gaussian SplattingProposes a collaborative learning framework for generalizable event-based Gaussian splatting.
2024MLSP WorkshopEV-GS: Event-Based Gaussian SplattingDiscusses the application of event-based Gaussian splatting in various contexts.

NeRF

TopicYearPublicationTitle
NeRF2024CVPRMitigating motion blur in neural radiance fields with events and frames
NeRF2024ICCVDeformable neural radiance fields using rgb and event cameras
NeRF2023CVPREventnerf: Neural radiance fields from a single colour event camera
NeRF2023ICCVE2nerf: Event enhanced neural radiance fields from blurry images
NeRF2023ICCVRobust e-nerf: Nerf from sparse & noisy events under non-uniform motion
NeRF2023RALE-nerf: Neural radiance fields from a moving event camera

Light Field Imaging

TopicYearPublicationTitleHighlight
Light Field2024CVPRTime-Efficient Light-Field Acquisition Using Coded Aperture and Events
Light Field2024IEEE VF VRWEvent Synthesis for Light Field Videos using Recurrent Neural Networks
Light Field2024Nature Light S&AEventLFM: event camera integrated Fourier light field microscopy for ultrafast 3D imaging
Light Field2024ArxivEvent fields: Capturing light fields at high speed, resolution, and dynamic range
Light Field2023TVCGEV-LFV: Synthesizing Light Field Event Streams from an Event Camera and Multiple RGB Cameras

Optical Flow

TopicYearPublicationTitleHighlight
OpticalFlow2024CVPREfficient Meshflow and Optical Flow Estimation from Event Cameras
OpticalFlow2024ICCVLearning optical flow from event camera with rendered dataset
OpticalFlow2023CVPRLive Demonstration: Tangentially Elongated Gaussian Belief Propagation for Event-based Incremental Optical Flow Estimation
OpticalFlow2023ICCVEvent-based temporally dense optical flow estimation with sequential learning
OpticalFlow2023ICCVRpeflow: Multimodal fusion of rgb-pointcloud-event for joint optical flow and scene flow estimation
OpticalFlow2023ICCVTaming contrast maximization for learning sequential, low-latency, event-based optical flow
OpticalFlow2023ICCVTMA: Temporal motion aggregation for event-based optical flow
OpticalFlow2023ICRAAdaptive-spikenet: event-based optical flow estimation using spiking neural networks with learnable neuronal dynamics
OpticalFlow2022ECCVSecrets of event-based optical flow
OpticalFlow2020CVPRSingle image optical flow estimation with an event camera
OpticalFlow2020ECCVSpike-flownet: event-based optical flow estimation with energy-efficient hybrid neural networks
OpticalFlow2019CVPRFocus is all you need: Loss functions for event-based vision
OpticalFlow2018CVPRA unifying contrast maximization framework for event cameras, with applications to motion, depth, and optical flow estimation

Focal Stack

YearPublicationTitleHighlight
2023CVPRAll-in-focus Imaging from Event Focal StackIntroduces an all-in-focus imaging approach using an event focal stack for improved depth-of-field.

Photometric

TopicYearPublicationTitleHighlight
Photometric Bundle Adjustment2024PAMIEvent-3DGS: Event-based 3D Reconstruction Using 3D Gaussian Splatting
Photometric stereo2024CVPREventPS: Real-Time Photometric Stereo Using an Event Camera
Photometric stereo2023ArxivEvent Fusion Photometric Stereo Network
Photometric stereo2021ICCVEvent-based Bispectral Photometry using Temporally Modulated Illumination

License

This project is licensed under the MIT License - see the LICENSE file for details.