Tutorials & Demos

Visual computing is a fast evolving field with a lot of real-world use cases. Especially, the synthesis of photo-realistic content and the modelling of digital humans raised a lot of attention. It is important for us to teach the broad public and to sensitize the people to possible image and video manipulations. We showed demonstrations of our methods at countless exhibitions and conferences, and also in TV reports and shows. Besides the demonstrations, we are also giving tutorials in our research field.

2023


Cyber and the City

Synthetic Media can be an opportunity, but also a thread. In an exhibition at the Schloss Museum in Tübingen, vistors were able to try out recent facial reenactment methods and learn more about spotting manipulated media.

[Video] 


2022


CLIPme if you can!

CLIP is a powerful tool to match images to text descriptions. It can be used for classification of ImageNet classes as shown in the original paper, but it can also be used to assign names of (famous) people to images.



2021


3DV 2021 - Tutorial on the Advances in Neural Rendering

In this tutorial, we will talk about the advances in neural rendering, especially the underlying 2D and 3D representations that allow for novel viewpoint synthesis, controllability and editability. Specifically, we will discuss neural rendering methods based on 2D GANs, techniques using 3D Neural Radiance Fields or learnable sphere proxies. Besides methods that handle static content, we will talk about dynamic content as well.

[Video] 

SIGGRAPH 2021 - Course on the Advances in Neural Rendering

This course covers the advances in neural rendering over the years 2020-2021.

[Video]  [Bibtex] 


2020


BIDT: Echt oder?

What is the impact of DeepFakes on our society? How does it change our view on digital media? Is the technology a danger or a chance?

CVPR 2020 - Tutorial on Neural Rendering

Neural rendering is a new and rapidly emerging field that combines generative machine learning techniques with physical knowledge from computer graphics, e.g., by the integration of differentiable rendering into network training. This state-of-the-art report summarizes the recent trends and applications of neural rendering.

[Paper]  [Video]  [Bibtex] 

CVPR 2020 - Workshop on Media Forensics

This CVPR workshop covers the advances on all fronts of media forensics: from detection of manipulations, biometric implications, misrepresentation/spoofing, etc.



2019




2018


Eurographics 2018: State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications

This state-of-the-art report session summarizes recent trends in monocular facial performance capture and discusses its applications, which range from performance-based animation to real-time facial reenactment. We focus on methods where the central task is to recover and track a three dimensional model of the human face using optimization-based reconstruction algorithms.

[Paper]  [Bibtex] 


2017


SIGGRAPH Emerging Technologies: Demo of FaceVR

We present a novel method for the interactive markerless reconstruction of human heads using a single commodity RGB‐D sensor. Our entire reconstruction pipeline is implemented on the graphics processing unit and allows to obtain high‐quality reconstructions of the human head using an interactive and intuitive reconstruction paradigm.

[Paper]  [Video]  [Bibtex] 


2016


SIGGRAPH Emerging Technologies: Real-time Face Capture and Reenactment of RGB Videos

We show a demo for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). Our goal is to animate the facial expressions of a target video by a source actor and re-render the manipulated output video in a photo-realistic fashion.

[Paper]  [Video]  [Bibtex]