Torch Examples, Guides and Resources

This page presents a repository including beginner-friendly as well as advanced Torch examples, a template for implementing custom Torch modules in C/CUDA and multiple variants of variational auto-encoders as well as an implementation of PointNet. The code is accompanies by a series of blog articles:

Torch Examples

This part of the repository includes examples for getting started with Torch, ranging from training simple auto-encoders, to fine-tuning, handling weight initialization and saving/loading models:

Torch Examples on GitHub

Custom Torch Modules

Torch can easily be extended using custom modules implemented in C/CUDA. This part of the repository includes a simple example and template for implementing custom modules:

C/CUDA Torch Module Template on GitHub

Variational Auto-Encoders

This part of the repository includes implementations of variational auto-encoders (VAEs) [1], denoising VAEs [2] and categorical/Bernoulli VAEs [3,4]:

C/CUDA Torch Module Template on GitHub


This part includes an implementation of PointNet, inspired by [5,6]:

C/CUDA Torch Module Template on GitHub

Volumetric Nearest Neighbor Upsampling

A torch module for volumetric nearest neighbor upsampling for 3D neural networks:

Volumetric NN Upsampling on GitHub
  • [1] D. P. Kingma, S. Mohamed, D. J. Rezende, and M. Welling. Semisupervised learning with deep generative models. In Advances in Neural Information Processing Systems, pages 3581–3589, 2014.
  • [2] D. J. Im, S. Ahn, R. Memisevic, and Y. Bengio. Denoising criterion for variational auto-encoding framework. In AAAI Conference on Artificial Intelligence, pages 2059–2065, 2017.
  • [3] E. Jang, S. Gu, and B. Poole. Categorical reparameterization with gumbel-softmax. CoRR, abs/1611.01144, 2016.
  • [4] C. J. Maddison, A. Mnih, and Y. W. Teh. The concrete distribution: A continuous relaxation of discrete random variables. CoRR, abs/1611.00712, 2016.
  • [5] Charles Ruizhongtai Qi, Hao Su, Kaichun Mo, Leonidas J. Guibas: PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. CoRR abs/1612.00593 (2016)
  • [6] Haoqiang Fan, Hao Su, Leonidas J. Guibas: A Point Set Generation Network for 3D Object Reconstruction from a Single Image. CoRR abs/1612.00603 (2016)