Generative modeling and it's theoretical foundations

Simon Damm (Ph.D. Student)

Generative modeling is a fundamental yet complex task in machine and deep learning. This project aims to investigate and broaden our understanding of the theoretical foundations of (deep) generative models. Our interest is twofold. First, we are interested in theoretical properties of the optimization and training dynamics, e.g., provable convergence, and how such properties transfer from theoretical abstractions to practical implementations. Following a complementary viewpoint, we study alternative characterizations of optimality in generative models, e.g., how learning objectives (at optimality) could be expressed via entropies reflecting fundamental model specifications. Such reformulations could serve as theoretically grounded guidelines to (re-)design (parts of) the model. Both lines of research include to rethink and improve upon existing techniques as well as to design novel approaches in order to support successful and meaningful generative learning.

Primary Host:	Asja Fischer (Ruhr University Bochum)
Exchange Host:	Arthur Gretton (University College London)
PhD Duration:	01 July 2021 - 30 June 2024
Exchange Duration:	01 June 2022 - 31 August 2022 01 June 2023 - 31 August 2023