pTV

August 17, 2018 · View on GitHub

pTVreg is the deformable image registration (alignment) toolbox. It provides the following functionality:

Implemented image dissimilarity metrics:

  • local correlation coefficient (LCC)
    DLCC=1gσ(IJ)(gσI)(gσJ)gσI2(gσI)2+εgσJ2(gσJ)2+ε`D_{LCC}=1 - \frac{g_\sigma * (I\cdot J) - (g_\sigma*I)\cdot(g_\sigma*J)}{\sqrt{g_\sigma*I^2 - (g_\sigma*I)^2+\varepsilon }\,\sqrt{g_\sigma*J^2 - (g_\sigma*J)^2+\varepsilon }}`
  • nuclear (PCA) groupwise metric
    Dnuclear=  [I1T(k1),...,INT(kN)]  `D_{nuclear} =\|\; [\, I_1\circ T(k_1),\quad ..., \quad I_N\circ T(k_N)\, ]\; \|_\ast`
  • sum of squared differences (SSD)
  • sum of absolute differences (SAD)
  • normalized gradient fields (NGF)

Implemented regularizations:

  • temporal regularization
  • transformation Jacobian regularization
  • sparse and nonconvex spatial regularizations based on first- and second- order finite differences

The method works on CT, MRI, US and natural images. It is reported to be successful for registering breathing motion.

The method performs multiresolution (pyramidal) registration approach. On each resolution level it solves unconstrained optimization problem of the following form:

minkD(J,  IT(k))+λTV(k)`\min_{k} D(J,\; I\circ T(k) ) + \lambda \text{TV}(k)`,

using LBFGS.

A Few Registration Examples

Figure: input images; registered images; tracking animation;

Figure: input images; registered images; tracking animation;

Figure: input images; registered images; tracking animation;

Figure: overlayed initial images; overlayed registered images;

Figure: registered images; tracking animation;

CT Lung Registration

We achieve state-of-the art registration result in DIR and COPD challenges.

4DCT 14DCT 24DCT 34DCT 44DCT 54DCT 64DCT 74DCT 84DCT 94DCT 10Mean TREMean Time (sec.)
0.770.750.931.261.070.830.801.010.910.840.92130
COPD 1COPD 2COPD 3COPD 4COPD 5COPD 6COPD 7COPD 8COPD 9COPD 10Mean TREMean Time (sec.)
0.711.910.770.670.710.660.750.780.640.850.8461442

For details on lung registration please see examples and DIR and COPDgene pages.

pTV

If you decide to use our registration toolbox please consider referring to this repository or the following paper:

@article{vishnevskiy2017isotropic,
  title={Isotropic total variation regularization of displacements in parametric image registration},
  author={Vishnevskiy, Valery and Gass, Tobias and Szekely, Gabor and Tanner, Christine and Goksel, Orcun},
  journal={IEEE transactions on medical imaging},
  volume={36},
  number={2},
  pages={385--395},
  year={2017},
  publisher={IEEE}
}

The code is developed by Dr. Valery Vishnevskiy valera.vishnevskiy@yandex.ru, Cardiac Magnetic Resonance group, Institute for Biomedical Engineering, ETH Zurich, University of Zurich, Computer-assisted Applications in Medicine, Computer Vision Laboratory, ETH Zurich.

ETHZurich ETHZurich