Awesome Image Rectification

April 22, 2021 · View on GitHub

A curated list of image rectification (distortion correction) and camera calibration papers.

Table of Contents

  • Deep Learning Based Methods
  • Traditional Methods
  • Datasets
  • Material
  • Related Papers on Camera Calibration
  • Related Libraries

Deep Learning Based

★ means that it is recommended for reading.

PaperSupervisedLinkConferenceNotes
Blind Geometric Distortion Correction on Images Through Deep Learning ★YesLinkCVPR '19Parameterized distortions (barrel, pincushion, and etc)
ESIR: End-to-end Scene Text Recognition via Iterative Image RectificationLinkCVPR '19Scene text distortion
Arbitrary Shape Scene Text Detection with Adaptive Text Region RepresentationLinkCVPR '19Scene text recognition
Towards Robust Curve Text Detection with Conditional Spatial ExpansionLinkCVPR '19Scene text recognition
Learning to Calibrate Straight Lines for Fisheye Image Rectification ★LinkCVPR '19Fish eye distortion, straight line calibration
Learning Structure-And-Motion-Aware Rolling Shutter CorrectionYesLinkCVPR '19Rolling shutter distortion
Symmetry-constrained Rectification Network for Scene Text RecognitionLinkICCV '19Scene text distortion
DR-GAN: Automatic Radial Distortion Rectification Using Conditional GAN in Real-TimeYesLinkIEEE Transactions on Circuits and Systems for Video Technology'19Conditional GAN.Learn the mapping between distorted and clean images.No hand-crafted technique.
FishEyeRecNet: A Multi-Context Collaborative Deep Network for Fisheye Image Rectification ★YesLinkECCV '18Fish eye distortion, predicts camera model parameters
MORAN: A Multi-Object Rectified Attention Network for Scene Text RecognitionLinkScene text distortion
GridFace: Face Rectification via Learning Local Homography TransformationsLinkECCV '18Face rectification
Semantic Segmentation of Fisheye ImagesLinkECCV '18 WorkshopSementic segmentation for fish-eye images
Distortion-aware CNNs for Spherical ImagesLinkIJCAI '18Spherical distortion
Fingerprint Distortion Rectification using Deep Convolutional Neural NetworksLinkICB '18Fingerprint distortion
CNN-based Fisheye Image Real-Time Semantic SegmentationLinkIEEE Intelligent Vehicles Symposium (IV) '18Sementic segmentation on fish-eye images
Deep View MorphingLinkCVPR '173D view morphing
Robust Scene Text Recognition with Automatic RectificationLinkCVPR '16Scene text distortion
Radial Lens Distortion Correction Using Convolutional Neural Networks Trained with Synthesized ImagesLinkACCV '16Radial lens distortion

Traditional

PaperLinkConferenceNotes
A Robust Method for Strong Rolling Shutter Effects Correction Using Lines with Automatic Feature SelectionLinkCVPR '19Rolling shutter distortion
Distortion-Free Wide-Angle Portraits on Camera PhonesLinkSIGGRAPH '19Wide-angle camera, fish eye distortion
Restoration of Non-rigidly Distorted Underwater Images using a Combination of Compressive Sensing and Local Polynomial Image RepresentationsLinkICCV '19Underwater image distortion
Rolling-Shutter-Aware Differential SfM and Image RectificationLinkICCV '17Rolling shutter artifact correction
From Bows to Arrows: Rolling Shutter Rectification of Urban ScenesLinkCVPR '16Rolling shutter artifact correction
Line-Based Multi-Label Energy Optimization for Fisheye Image Rectification and CalibrationLinkCVPR '15Fish eye distortion
Radial lens distortion correction using cascaded one-parameter division modelLinkICIP '15Radial distortion
Lens Distortion Rectification using Triangulation based InterpolationLinkISVC '15Lens distortion
Radial distortion correction from a single image of a planar calibration pattern using convex optimizationLinkICIP '14Radial distortion
Unsupervised Intrinsic Calibration from a Single Frame Using a "Plumb-Line" ApproachLinkICCV '13Line detection approach
Radially-Distorted Conjugate TranslationsLinkRadial distortion
Pixel-variant Local Homography for Fisheye Stereo Rectification Minimizing Resampling DistortionLinkRadial Distortion
Rectification from Radially-Distorted ScalesLinkRadial distortion
Auto- matic lens distortion correction using one-parameter division modelsLinkRadial distortion
Automatic Radial Distortion Estimation from a Single ImageLinkRadial Distortion

Datasets

PaperPaper LinkDataset LinkSynthesizedAnnotations
Parameterized Synthetic Image Data Set for Fisheye LensLinkLinkYes
Learning to Calibrate Straight Lines for Fisheye Image RectificationLinkNoDistortion parameters and distorted lines

Material

NameCourse LinkNote
CS 131 Computer Vision: Foundations and Applications (Fall 2015-2016)LinkCover the basic concept of camera model.
Review of Geometric Distortion Compensation in Fish-Eye CamerasLinkAn overview of common fish eye models.

Papers on Camera Calibration

PaperLinkConferenceNote
Deep Single Image Camera Calibration with Radial DistortionLinkCVPR '19Reduce parameters from 6 to 4. Predict parameters by Simple CNN.
Parameter-free Lens Distortion Calibration of Central CamerasLinkICCV '17
Unsupervised Vanishing Point Detection and Camera Calibration from a Single Manhattan Image with Radial DistortionLinkCVPR '17
LibraryLinkNotes
AugmentorLinkImage data augmentation by distortion

Contributing

PR me related papers!