One of the fundamental questions of computer science is about understanding how machines can best serve people. My research focuses on answering the question of how automated systems can achieve this by being aware of people as social beings. So much of our lives revolve around face-to-face communication. It affects our relationships with others, the influence they have over us, and how this can ultimately transform into decisions that affect a single person or many more people. However, we know relatively little about how to automate the perception of social behaviour and recent research findings only touch the tip of the iceberg.
Specifically, my research focusses on devising models to automatically interpret face-to-face human social behaviour using cameras, microphones, and wearable sensors.