IAM

RESEARCH

Key Contributions

Image Provenance — SynthID

Keeping track of generated images using watermarking.

Image Provenance — SynthID
Monte Carlo Conformal Prediction

Conformal calibration with uncertain ground truth.

Monte Carlo Conformal Prediction
Ground Truth Uncertainty

Evaluating AI models with uncertain ground truth.

Ground Truth Uncertainty
PhD Thesis: Uncertainty and Robustness

PhD thesis on uncertainty estimation and (adversarial) robustness in deep learning.

PhD Thesis: Uncertainty and Robustness
Conformal Training

End-to-end training of deep neural networks and conformal predictors to reduce confidence set size and optimizer application-specific objectives.

Conformal Training
Robust Generalization and Flatness

Robust generalization and overfitting linked to flatness of robust loss surface in weight space.

Robust Generalization and Flatness
Random and Adversarial Bit Robustness

Random and adversarial bit error robustness of DNNs for energy-efficient and secure DNN accelerators.

Random and Adversarial Bit Robustness Random Bit Error Robustness
Confidence-Calibrated Adversarial Training

Confidence calibration of adversarial training for "generalizable" robustness.

Confidence-Calibrated Adversarial Training
Adversarial Robustness and Generalization

Disentangling the relationship between adversarial robustness and generalization.

Adversarial Robustness and Generalization
Improved Shape Completion

Learning 3D shape completion under weak supervision; on ShapeNet, ModelNet, KITTI and Kinect data; published at CVPR and on ArXiv.

Improved Shape Completion Shape Completion
Superpixel Benchmark (2016)

A comprehensive comparison and evaluation of 28 superpixel algorithms on 5 different datasets; published in CVIU and GCPR.

Superpixel Benchmark (2016) Superpixel Benchmark (2014)
Superpixel Algorithms

Revised C++ implementations of two popular superpixel algorithms, SEEDS and FH, which are shown to outperform the original implementations.

Superpixel Algorithms
Video Segmentation

Efficient C++ implementation for hierarchical graph-based image segmentation.

Video Segmentation
Non-Convex Optimization

Efficient C++ implementation of iPiano, a proximal algorithm with inertial force for non-convex and non-smooth optimization; including applications to image segmentation.

Non-Convex Optimization

RESEARCH

Selected Collaborations

Fair and Accurate Differential Privacy

Achieving accuracy, fair and private image classification.

Fair and Accurate Differential Privacy
PhDNet Survey Report 2020

Report of the 2020 Max Planck PhDNet survey results.

PhDNet Survey Report 2020
Subset Adversarial Training

Adversarial training on a subset of (difficult) examples to improve efficiency.

Subset Adversarial Training
Calibrated Lipschitz Margin Loss

Introducing slack control to improve accuracy and certified robustness with Lipschitz regularization.

Calibrated Lipschitz Margin Loss
Robust Token Attention

Robustifying token attention for vision transformers.

Robust Token Attention
Transformer Patch Robustness

Improve patch robustness of vision transformers.

Transformer Patch Robustness
Enhancing Weak Subnets

Improving corruption and adversarial robustness by enhancing weak sub-networks.

Enhancing Weak Subnets
Adversarial Patch Training

Adversarial training on location-optimized adversarial patches.

Adversarial Patch Training

OPEN SOURCE

Machine Learning and Computer Vision

Adversarial Robustness in PyTorch Article Series

Series of articles discussing adversarial robustness and adversarial training in PyTorch.

Adversarial Robustness in PyTorch Article Series
PyTorch C/CUDA Module Template

A template for extending PyTorch using C/CUDA operations.

PyTorch C/CUDA Module Template
Mesh Fusion, Voxelization & Evaluation

3D mesh fusion, voxelization and evaluation for computer vision research.

Mesh Fusion, Voxelization & Evaluation
OctNet Batch Normalization

Torch/CUDA implementation of batch normalization for OctNets.

OctNet Batch Normalization
Torch Examples, Guides and Resources

Basic and advanced torch examples, template for implementing custom C/CUDA modules and implementations of variational auto-encoders.

Torch Examples, Guides and Resources
Custom Tensorflow Operations in C++

An example of a custom TensorFlow operation implemented in C++.

Custom Tensorflow Operations in C++
pyCaffe Tools, Examples and Resources

Examples, tools and resources for using Caffe's Python interface pyCaffe.

pyCaffe Tools, Examples and Resources
Probabilistic PCA

Python implementation of probabilistic principal component analysis (PPCA).

Probabilistic PCA
Density Forests in C++

A C++ implementation of density forests.

Density Forests in C++
Extended Berkeley Segmentation Benchmark

The Berkeley Segmentation Benchmark extended by superpixel metrics.

Extended Berkeley Segmentation Benchmark
NYU Depth v2 Segmentation Tools

Tools to pre-process the NYU Depth v2 segmentations for evaluation.

NYU Depth v2 Segmentation Tools

OPEN SOURCE

Web Development

Twitter Bootstrap Plugins

Some plugins for Twitter Bootstrap and jQuery; including a multiselect plugin and a password strength meter.

Twitter Bootstrap Plugins
Kohana Modules

Modules for the HMVC framework Kohana; including modules for user authentication, access control, form generation and validation, CSS and JS assets and more.

Kohana Modules
CMSimple Plugins and Themes

Plugins for CMSimple XH, a lightweight content management system; including, among others, news article, image gallery and YouTube plugins.

CMSimple Plugins and Themes
Wordpress Plugins and Themes

Experimental Wordpress plugins and themes; including this theme and plugins for author biographies and live data from GitHub.

Wordpress Plugins and Themes

COMMERCIAL

Web Development

MISC

Educational

LaTeX Resources and Examples

A repository with LaTeX examples, templates and tricks.

LaTeX Resources and Examples
(Convolutional) Neural Network Tutorials

Tutorials for (deep convolutional) neural networks.

(Convolutional) Neural Network Tutorials
MatLab Two-Layer Perceptron

A two-layer perceptron for digit classification on MNIST implemented in MatLab.

MatLab Two-Layer Perceptron
Image Processing Exercises in MatLab/C++

Several mathematical impage processing exercises implemented in C++ and MatLab.

Image Processing Exercises in MatLab/C++
PHP Matrix Decompositions

Common matrix decompositions, including LU, Cholesky and QR decompositions, implemented in PHP; also includes an interactive application to demonstrate and explain the material.

PHP Matrix Decompositions
PHP Simplex

The Simplex algorithm for solving linear programs implemented in PHP.

PHP Simplex
Functional Dependencies
PHP

Relational databases can be described in terms of functional dependencies; this project implements functional dependencies as well as second and third normal form in PHP.

Functional Dependencies