Cyber Security Seminar by Dr. Anderson Rocha : Finding the Arrow of Time: how to chronologically sort images to understand real-world events with NO meta-data or time stamps involved

13 December 2019 11:15 till 12:00 - Location: FACULTY EEMCS-BUILDING 28, SOCIAL DATA LAB (GROUND FLOOR)

Inferring the chronological order of a group of pictures with the same semantic context --- i.e., representing the same event, object or person of interest --- is an important task to various areas of study. The number of available pictures and videos has increased exponentially in the last decade --- with recent advances in image capturing devices (surveillance cameras and smartphones) and the ever-growing content sharing through social networks, such as Facebook and Flicker. Every event --- from social gatherings to terrorist attempts --- is massively captured by multiple cameras and instantly uploaded to the Internet. Consider, as an example, the Boston Marathon Bombing case, in which, as soon as the bombs exploded, social media was flooded with pictures and observations from the incident. In cases like this, although several of such images might have timestamps embedded into their metadata, they are not always correct --- due to misregistration or even alteration --- nor trustworthy to infer time information. Nonetheless, in a forensic investigation, it is still indispensable to mine temporal information to fully understand and reconstruct an event like this. Furthermore, temporal knowledge is also valuable in an investigation to fact-check and organize the flood of information regarding an incident. In this talk, we will discuss current research machine learning and computer vision efforts in our team to find the arrow of time in digital images and chronologically sort pictures of an event so that further forensic investigations can take place. 


Anderson Rocha is an Associate Professor at the Institute of Computing, University of Campinas, Brazil since 2009. His main interests include Digital Forensics, Reasoning for Complex Data and Machine Intelligence. 

He has actively worked as a program committee member in several important Computer Vision, Pattern Recognition, and Digital Forensics events and is an associate editor of important international journals such as the IEEE Transactions on Information Forensics and Security (T.IFS), Elsevier Journal of Visual Communication and Image Representation (JVCI), the EURASIP/Springer Journal on Image and Video Processing (JIVP) and the IEEE Security & Privacy Magazine. He is an elected affiliate member of the Brazilian Academy of Sciences (ABC) and the Brazilian Academy of Forensic Sciences (ABC). He is a two-term elected member of the IEEE Information Forensics and Security Technical Committee (IFS-TC) and currently its chair for the 2019-2021 term. He is a Microsoft Research and a Google Research Faculty Fellow, important academic recognitions given to researchers by Microsoft Research and Google, respectively. In addition, in 2016, he has been awarded the Tan Chin Tuan (TCT) Fellowship, a recognition promoted by the Tan Chin Tuan Foundation in Singapore. 

He has been the principal investigator of a number of research projects in partnership with public funding agencies in Brazil and abroad as well as national and multi-national companies having already deposited and licensed several patents. Since March 2019, he has been the Associate Dean of the Institute of Computing, University of Campinas (Unicamp).