RECOD Lab. has been awarded two Fapesp Thematic Projects recently. This is an AMAZING achievement for our lab. and for IC/Unicamp, especially during this tough financial moment in our country. The two projects, entitled “DéjàVu: Feature-space-time coherence from heterogeneous data for media integrity analytics and interpretation of events” — coordinated by Prof. Anderson Rocha — and “The secret of playing football: Brazil versus the Netherlands” — coordinated by Prof. Ricardo Torres are starting this semester. Details about each project are given below.
DéjàVu: Feature-Space-Time Coherence from Heterogeneous Data for Media Integrity Analytics and Interpretation of Events
FAPESP Thematic Project 2017/12646-3, from December 2017 through November 2022
In this research project, we focus on synchronizing specific events in space and time (X-coherence), fact-checking, and mining persons, objects and contents of interest from various and heterogeneous sources including — but not limited to — the internet, social media and surveillance imagery. For that, we seek to harness information from various media sources and synchronize the multiple textual and visual information pieces around the position of an event or object as well as order them so as to allow a better understanding about what happened before, during, and shortly after the event. After automatically organizing the data and understanding the order of the facts, we can devise and deploy solutions for mining persons or objects of interest for suspect analysis/tracking, fact-checking, or even understanding the nature of the said event. Additionally, by exploring the possible existing links among different pieces of information, we aim at further designing and developing media integrity analytics tools to hint at existing forgeries, sensitive content (e.g., violent content, child pornography), and spreading patterns of multimedia objects online. With demanding and sophisticated crimes and terrorist threats becoming ever more pervasive, allied with the advent and spread of fake news, our objective is to use the developed solutions to help us answering the four most important questions in forensics regarding an event: “who”, “in what circumstances”, “why”, and “how”, thus identifying the characteristics and circumstances in which an event has taken place.
Hélio Pedrini, Co-PI (Unicamp), André C.P.L.F. de Carvalho, Co-PI (USP), Adam Czajka (Warsaw Univ. of Technology, Poland), Alex Kot (Nanyang Technological University, Singapore), C.-C. Jay Kuo (Univ. of Southern California, USA), Edward Delp (Purdue Univ., USA), Kevin Bowyer (Univ. of Notre Dame, USA), Patrick Flynn, (Univ. of Notre Dame, USA), Stefano Tubaro (Politecnico di Milano, Italy), Paolo Bestagini (Politecnico di Milano, Italy), Walter J. Scheirer (Univ. of Notre Dame, USA), Alexandre Ferreira (UNICAMP), Adin Ramirez Rivera(UNICAMP), Eduardo Valle, (UNICAMP), Fernanda Alcântara Andaló (UNICAMP), Jacques Wainer (UNICAMP), Lin Tzy Li (UNICAMP), Sandra Avila (UNICAMP), Zanoni Dias (UNICAMP), Marcos André Gonçalves (UFMG), William Schwartz (UFMG).
The Secret of Playing Football: Brazil versus the Netherlands
FAPESP Thematic Project 2016/50250-1 from August 2017 through July 2021
The scientific challenge is about unraveling the secret of Brazilian and Dutch soccer by capturing successful elements of game play of both countries, combining expertise from data science, computer science, and sport science. Suggested features from literature, as well as several novel ones, will be considered and filtered on how they capture success in soccer. A manageable set of features will then be obtained from various available Dutch datasets (focusing on the successful play). Subsequently, the same features will be used to compare playing styles between both countries. Features of game play will be approached from two different angles. The first angle (spearheaded by the Brazilian computer science partner) concerns features that capture the dynamics of game play and characterize aspects of formation on the pitch. The second angle (lead by the Dutch data science partner) will focus on how an attack is built up, and how key events (shots on goal, transitions from defenders to midfielders, etc.) can help to characterize this. For the comparison between countries data will be collected in four different age categories in Brazil and the Netherlands during official games, in order to compare (the development of) game play between both countries. Data will be collected by means of the Local Position Measurement System, for reasons of accuracy and consistency. The applied science part of this proposal is focusing on bridging the gap between fundamental science and soccer practice, i.e. coaches, trainers, clubs, and federations. The outcomes of the fundamental part will be implemented in a coach-cockpit, a software application which trainers and coaches can use to (1) decide upon their strategy before a game, (2) analyze player and team behaviour during a game enabling to adjust the strategy accordingly, and (3) choose and/or design training forms to improve player and team behaviour.
Claudio Alexandre Gobatto (UNICAMP), Sergio Augusto Cunha (UNICAMP), Ricardo Oliveira Anido (UNICAMP), Luiz Eduardo Barreto Martins (UNICAMP), Ricardo Machado Leite de Barros (UNICAMP), Felipe Arruda Moura (UEL) e Paulo Roberto Pereira Santiago (USP), Koen A. P. M. Lemmink (University of Groningen), Johan Pion (HAN University), Marije T. Elferink-Gemser (University of Groningen), Joost N. Kok (Leiden University), e Arno Knobbe (Leiden University).