Mr. Sun will explore novel and neural algorithms and representations, which in conjunction with new datasets will allow to synthesize novel motions and interactions with objects in the scene. In contrast to classical computer animation, one goal of his thesis is to simplify the user input to enable the usage by non-experts while achieving realistic looking skeletal motions. Moreover, he will also explore how a joint reasoning of the human and the scene can further benefit the tracking of a dense surface when only a single RGB video of the human and the scene is given.