mocogan-chainer

Chainer implementation of MoCoGAN

This repository contains an Chainer implementation of MoCoGAN.

Paper: MoCoGAN: Decomposing Motion and Content for Video Generation by Sergey Tulyakov, Ming-Yu Liu, Xiaodong Yang, Jan Kautz.

Result

Generated samples (300 epoch)

MUG Facial Expression Database

normal ( not using label )	infogan (during the experiment)

Summary

Dataset

MoCoGAN is one of GAN architectures for video generation. I used MUG Facial Expression Database to train the model. The dataset consisted of 86 subjects(51 male and 34 female) performing various facial expressins. Each video conststed of 50 to 160 frames.

In my experiment, the dataset converted to short video clips like shape of(video_len, channel, height, width) = (16, 3, 64, 64).

Architecture

The model architecture is shown below.

MoCoGAN Architecture

Loss Function

Requirements

• Python >= 3.4
• OpenCV
• ffmpeg

Plese refer requirements.txt for required python packages.

pip install -r requirements.txt

Getting started

TODO