Multimedia Computing Group

The Multimedia Computing (MMC) Group develops algorithms for enriching, accessing, and searching large quantities of data. Such algorithms lie at the core of tomorrows’ search engines and large-scale recommender systems. The group sets its focus on developing systems that are oriented to the needs of users, and that solve the challenges faced by large-scale online content and service providers. Multimedia data analytics also has applications in the full range of fields that benefit from data science, including health, telecom, and geosciences.

The group has a track record of developing technologies that make possible optimized interaction with large collections of multimedia data (e.g., images, video, and music) in real-world contexts (e.g., within social networks). Our work requires a combination of mathematical models, machine learning techniques, and practical skills in algorithm development and evaluation. The members of the MMC group share expertise in multimedia information retrieval, recommender systems, multimedia signal processing, social network analysis, human computation (crowdsourcing) and quality of experience. Collaborations include joint work with researchers from Yahoo Labs, Telefónica Research, Microsoft Research and Google.

     

The work being carried out in the MMC Group encompasses a broad palette of research directions including:

  • Multimedia content analysis and search
    • Semantics extraction from multimedia data
    • Multi-modal query expansion
    • Multi-source search result reranking
  • Multimedia information retrieval in a social network context
    • Modeling information propagation and relationships in social networks
    • Collaborative recommender systems
    • Social recommendation
  • Interaction with multimedia content
    • (Affective) User profiling
    • User (search/uploader) intent
    • Query failure prediction
    • Quality of multimedia experience
  • Multimedia content management
    • Multimedia databases and dataspaces
    • Entity retrieval

More information about the research directions and activities of the MMC Group can be found under research projects or on the sites of group members.

     

News

26 november 2019

Odette Scharenborg keynote speaker at Speech Technology Deep Dive

On Wednesday November 27, 2019, Odette Scharenborg is a keynote speaker and discussant at the Speech Technology Deep Dive of the Dutch ministries of Justice and Internal Affairs. During TechNovember, which lasts the entire month of November, 12 so-called "deepdives" take place. In such a deep dive, a scientist by name and fame always plunges into depth with the participants from both departments.

26 november 2019

Door mijn Siri-schaamte heb ik voorlopig geen butler in mijn broekzak

A digital assistant who arranges things for you if you ask. It sounds like an ideal world in which you always carry a help, but in reality you constantly end up in a Babylonian confusion of words. Odette Scharenborg was interviewed for a background article on speech technology for the Dutch news website NU.nl.

10 november 2019

Article in IEEE Transactions on Signal Processing by Elvin Isufi

Article in IEEE Transactions on Signal Processing: Controllability of Bandlimited Graph Processes Over Random Time-Varying Graphs by E. Isufi

15 september 2019

Best paper award for Jaeyoung Choi

Jaeyoung Choi PhD –student in INSY’s MMC group/ICSI, California, won best paper award at the IEEE 5th International Conference on Multimedia Big Data (Singapore).

12 september 2019

Forecasting Time Series with VARMA Recursions on Graphs

Recent development in signal processing and network science has brought new tools for processing time series. However, it was not yet clear on how to exploit the structure of a network for predicting the evolution of time series.