[](https://github.com/FORARTfe/HyMPS#-1 "VIDEO section") [](https://github.com/FORARTfe/HyMPS/blob/main/Video/AI-based.md#-- "AI-based page")

July 14, 2026 · View on GitHub

Aligning/Synching - Editing - Enhancers - Mixing - Restoring - Denoisers - Deblurrers - Artifacts reduction - Colorization - Compression - Stabilizers - Upscalers - Misc - Other resources

Warning

$\color{orange}\textsf{{SORTING: Language (a>z) > License (openness) > Repository (a>z)}}$

Aligning/Synching ⌂

Resource	Short description	Language	License	Last commit
AV-Align	Unsupervised Audio-Visual feature alignment: audio and visual features embedding onto the same latent space for downstream tasks

Editing ⌂

Resource	Short description	Language	License	Last commit
AIVideoEditor	An all-in-one collaborative AI audio and video editing application that is as simple to use as editing a Google Doc based on text extracted from transcription
ai_video_editor	A yolov7 based, human aware video editor for real time video manipulation
Automatic Video Editor for Reportages Assisted by Unsupervised Machine Learning	Code for Automatic Video Editor for Reportages Assisted by Unsupervised Machine Learning paper
videdit	A Deep Learning based automatic video editor
AutomEditor	A video editor that helps video bloggers to remove bloopers automatically
Framester	An AI driven Video manipulation toolkit
VideoEditor	AI assisted video editor based on motion difference between the frames of given videos
folioviz.ai	Video Editor driven by Ai
ClipIQ	AI-powered video editor
speech-separation	Use Deep Learning to automatically edit multicam videos
Video Mashup	Uses Video Intelligence to analyse and edit a video based on a given sentence.
soundblast-fe	Frontend for AI powered video editor backend
TopView.ai	Just provide your raw materials and ideas; AI does the rest, from scriptwriting to selecting shots, editing, narrating, and beautifying your video
Turn-Movie-Clips-to-Narration-Videos	Automatically extracts dialogue, identifies characters, generates commentary based on the plot, separates background noise, and aligns audio/video

Enhancers ⌂

Resource	Short description	Language	License	Last commit
vs-mlrt	Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet and more!)
InterUpTool	GUI Tool for control, queue and automate video enhancing process, provided by FFMPEG video encoder, Real-ESRGAN image upscaler and RIFE/DAIN video frame interpolators
enhancr	An elegant and easy to use GUI for Video Frame Interpolation and Video Upscaling which takes advantage of artificial intelligence
flowframes	Windows GUI for video interpolation using DAIN (NCNN) or RIFE (CUDA/NCNN)
PRINCIPI	Fully customizable video frame rate up-conversion and video resolution upscaling with sharpening and denoising editor with GUI
QualityScaler	A Windows app powered by AI to enhance, upscale and de-noise photographs and videos
RealScaler	A Windows app powered by RealESRGAN AI to enhance, upscale and de-noise photos and videos
VSGAN-tensorrt-docker	Fastest (TensorRT) inference code to use super resolution and video frame interpolation models
MoMo	Implementation of "Disentangled Motion Modeling for Video Frame Interpolation" paper

Mixing ⌂

Resource	Short description	Language	License	Last commit
Automatic Mixing of Audio and Video	Proposing a comprehensive method for assisting video editing tasks using neural networks

Restoring ⌂

Resource	Short description	Language	License	Last commit
DeFlicker PRISM	Samsung PRISM project: removing flickering in high fps videos
Samsung_Deflicker	A machine learning solution to remove flickering in high-speed videos
TOFlow	Video Enhancement with Task-Oriented Flow IJCV publication implementation
DeepRemaster	PyTorch implementation for the "DeepRemaster: Temporal Source-Reference Attention Networks for Comprehensive Video Enhancement" paper
EMA-VFI-WebUI	Advanced AI-Based Video Renovation UI Using EMA-VFI & Real-ESRGAN
All-In-One-Deflicker	Code for Blind Video Deflickering by Neural Filtering with a Flawed Atlas paper
BasicSR	Open Source Image and Video Restoration Toolbox for Super-resolution, Denoise, Deblurring, etc

Denoisers ⌂

Resource	Short description	Language	License	Last commit
Model-Blind Video Denoising Via Frame-to-frame Training	Model-blind Video Denoising Via Frame-to-frame Training implementation
Non-local Bayesian Video Denoising	A C/C++ implementation of the Video Denoising via Empirical Bayesian Estimation of Space-Time Patches paper
RNLF	Image noise estimation and RNL image and video denoising
VIDOSAT video denoising	A video denoising framework based on online 3D spatio-temporal sparsifying transform learning
SALT based Video Denoising	A video denoising method, based on a novel Sparse And Low-rank Tensor (SALT) model
vnlnet	A Video denoising CNN with Non-locality information
FastDVDnet	A state-of-the-art, simple and fast network for Deep Video Denoising which uses no motion compensation
MaskDnGAN	This is the official implementation of "Multi-Stage Raw Video Denoising with Adversarial Loss and Gradient Mask" paper
ViDeNN	Deep Blind Video Denoising implementation
Deformable-Kernels-For-Video-Denoising	An implement of paper Learning Deformable Kernels for Image and Video Denoising in PyTorch
PaCNet	This is the official implementation of "Patch Craft: Video Denoising by Deep Modeling and Patch Matching" paper
STBN	The official implementation for the Spatiotemporal Blind-Spot Network with Calibrated Flow Alignment for Self-Supervised Video Denoising paper
STPAN	This is the official implementation of "Learning Spatial and Spatio-Temporal Pixel Aggregations for Image and Video Denoising" paper
RViDeNet	This is the official implementation of "Supervised Raw Video Denoising with a Benchmark Dataset on Dynamic Scenes paper

Deblurrers ⌂

Resource	Short description	Language	License	Last commit
Motion Deblur Kernel Estimation	Code for Blind Deblurring with motion blur kernel estimation by parallel diffusion models paper
Deep Video Deblurring for Hand-held Cameras	This is the demo code for "Deep Video Deblurring for Hand-held Cameras" paper
PVDNet	Official PyTorch Implementation for "Recurrent Video Deblurring with Blur-Invariant Motion Estimation and Pixel Volumes"paper
CDVD-TSP	Official implementation of "Cascaded Deep Video Deblurring Using Temporal Sharpness Prior" paper
ESTRNN & BSD	This work presents an efficient RNN-based model and the first real-world dataset for image/video deblurring
STDANetPP	Implementation of "Patch-Based Spatio-Temporal Deformable Attention BiRNN for Video Deblurring" paper
STFAN	Code repo for the "Spatio-Temporal Filter Adaptive Network for Video Deblurring" paper
BSSTNet	Implementation of "Blur-aware Spatio-temporal Sparse Transformer for Video Deblurring" paper
Video_deblurring	The Attention-Based Video Deblurring project leverages an attention mechanism and advanced neural network architectures to restore blurry frames in videos

Artifacts reduction ⌂

Resource	Short description	Language	License	Last commit
MFQE 2.0	Official repository of "MFQE 2.0: A New Approach for Multi-frame Quality Enhancement on Compressed Video" paper
STDF	PyTorch implementation of Spatio-Temporal Deformable Convolution for Compressed Video Quality Enhancement paper
NL-ConvLSTM	Non-Local ConvLSTM for Video Compression Artifact Reduction implementation
QG-ConvLSTM	Project page of "Quality-Gated Convolutional LSTM for Enhancing Compressed Video" paper

Colorization ⌂

Resource	Short description	Language	License	Last commit
Deep Exemplar-based Video Colorization	PyTorch implementation for the Deep Exemplar-based Video Colorization paper
DeOldify	A Deep Learning based project for colorizing and restoring old images (and video!)
Fully Automatic Video Colorization	Tensorflow implementation for the "Fully Automatic Video Colorization with Self-Regularization and Diversity" paper
SVCNet	PyTorch implementation of the "SVCNet: Scribble-based Video Colorization Network with Temporal Aggregation" paper
DDColor	Official PyTorch implementation of the "DDColor: Towards Photo-Realistic Image Colorization via Dual Decoders" paper

Compression ⌂

Resource	Short description	Language	License	Last commit
Deep-Video-Compression	Video compression using deep neural networks
Deep_Learning_Video_compression	Used deep learning for video compression
Neural Video Compression	An implementation of the "Learning Binary Residual Representations for Domain-specific Video Streaming" paper
neural-video-compress	Video compression using neural networks
Video compression	Experimental project for neural image and video compression
Video-Compression-Net	A new approach to video compression by refining the shortcomings of conventional approach and substituting each traditional component with their neural network counterpart
Spacevid	A neural net based tool for transcoding large videos to fit a specified file size with minimal adjustment to the bitrate
HiNeRV	Code for "HiNeRV: Video Compression with Hierarchical Encoding-based Neural Representation" paper
Hier-Video-Compression	Codebase for Hierarchical Autoregressive Modeling for Neural Video Compression
Ureca-Deep-neural-network-based-video-compression	Investigate methodologies that combine neural networks and video compression
video-compression-dnn	Video compression using deep convolutional neural networks and autoencoders

Stabilizers ⌂

Resource	Short description	Language	License	Last commit
Trajectory Optimization based Video Stabilization	A custom MeshFlow implementation
Deep3D Stabilizer	3D Video Stabilization with Depth Estimation by CNN-based Optimization
DIFRINT	Test code reference implementation of "Deep Iterative Frame Interpolation for Full-frame Video Stabilization", using PyTorch
DUT	Pytorch implementation of "DUT: Learning Video Stabilization by Simply Watching Unstable Videos"
FuSta	Hybrid Neural Fusion for Full-frame Video Stabilization
Real-Time Selfie Video Stabilization	Official implementation of paper "Real-Time Selfie Video Stabilization"

Upscalers ⌂

Resource	Short description	Language	License	Last commit
Intel® Library for Video Super Resolution	Native C and C++ implementation of RAISR: Rapid and Accurate Image Super Resolution paper
vs-NNVISR	Neural Network Video Interpolation / Super Resolution Filter for VapourSynth
Fast-SRGAN	A Fast Deep Learning Model to Upsample Low Resolution Videos to High Resolution at 30fps
FMA-Net	Official repository for "Flow-Guided Dynamic Filtering and Iterative Feature Refinement with Multi-Attention for Joint Video Super-Resolution and Deblurring" paper
IART	Enhancing Video Super-Resolution via Implicit Resampling-based Alignment
RealViformer	The Official Code for "Investigating Attention for Real-World Video Super-Resolution" paper
ST-AVSR	Arbitrary-Scale Video Super-Resolution with Structural and Textural Priors
StableVSR	Enhancing Perceptual Quality in Video Super-Resolution through Temporally-Consistent Detail Synthesis using Diffusion Models
BasicVSR++	Improving Video Super-Resolution with Enhanced Propagation and Alignment
EvTexture	Event-driven Texture Enhancement for Video Super-Resolution
MIA-VSR	Video Super-Resolution Transformer with Masked Inter&Intra-Frame Attention
PP-MSVSR	Multi-Stage Video Super-Resolution (part of PaddlePaddle GAN library)
RealBasicVSR	Official repository for "Investigating Tradeoffs in Real-World Video Super-Resolution" paper
AnimeSR	Codes for "Learning Real-World Super-Resolution Models for Animation Videos" paper
KEEP	Kalman-Inspired Feature Propagation for Video Face Super-Resolution
MGLD-VSR	Code for "Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolution" paper
INR-Event-VSR	Learning Spatial-Temporal Implicit Neural Representations for Event-Guided Video Super-Resolution
STDO-CVPR2023	Towards High-Quality and Efficient Video Super-Resolution via Spatial-Temporal Data Overfitting
ControlNetVSR	Video Super-Resolution using Latent Diffusion Models

Misc ⌂

Resource	Short description	Language	License	Last commit
usv-playpen	GUI to control experiments w/ multichannel audio, neural and video recordings, conduct data processing, analyses and make visualizations.

Other resources ⌂