IAM

TAG»TENSORFLOW«

ARTICLE

Monitoring PyTorch Training using Tensorboard

Tensorboard is a great tool to monitor and debugg deep neural network training. Originally developed for TensorFlow, Tensorboard is now also supported by other libraries such as PyTorch. While the integration in PyTorch was shaky in the beginning, it got better and better with more recent releases. In this article, I want to discuss how to use Tensorboard for monitoring training with PyTorch. The article’s code is available on GitHub.

More ...

ARTICLE

Some TensorFlow Experiments on MNIST

As part of the online course Creative Applications of Deep Learning with TensorFlow, and to get started with TensorFlow, I implemented some experiments on MNIST. Specifically, I tested different architectures, activation functions and initialization schemes. While these experiments are not systematic enough for reliable results, they can be useful as an introduction to TensorFlow. In this article, I want to share the code and the corresponding presentation.

More ...

ARTICLE

A Note on Extending Tensorflow, PyTorch, Theano and Torch for Deep Learning on Custom Data Structures

Many recent deep learning frameworks such as Tensorflow, PyTorch, Theano or Torch are based on dense tensors. However, deep learning on non-tensor data structures is also interesting – especially for sparse, three-dimensional data. This article summarizes some of my experiences regarding deep learning on custom data structures in the mentioned libraries.

More ...

ARTICLE

Inspecting Tensorflow’s Tensors using C++ and Bazel

Currently it is difficult to successfully link C++ projects with Tensorflow. However, to compile and run smaller code snippets based on Tensorflow, it might be convenient to put the code inside the tensorflow code base and compile an individual executable using Bazel.

More ...

ARTICLE

Implementing Tensorflow Operations in C++ — Including Gradients

In this article, I discuss a simple Tensorflow operation implemented in C++. While the example mostly builds upon the official documentation, it includes trainable parameters and the gradient computation is implemented in C++, as well. As such, the example is slightly more complex compared to the simple ZeroOut operation discussed in the documentation.

More ...

ARTICLE

Upgrading CUDA and Installing CuDNN for Caffe and Tensorflow

Recently, I started working with Tensorflow — a deep learning library developed by Google. Unfortunately, Tensorflow did not work with the installed Version of CUDA. Therefore, I decided to upgrade to CUDA 8.0 and also install CuDNN. This article describes the installation process.

More ...