2018-00789 - Joint PhD Offer in collaboration with Microsoft: Animation Synthesis

Contrat renouvelable : Oui

Niveau de diplôme exigé : Bac + 5 ou équivalent

Fonction : Doctorant

A propos du centre ou de la direction fonctionnelle

Le centre de recherche Inria Grenoble Rhône-Alpes regroupe un peu moins de 800 personnes réparties au sein de 35 équipes de recherche et 9 services support à la recherche.

Ses effectifs sont distribués sur 5 campus à Grenoble et à Lyon, en lien étroit avec les laboratoires et les établissements de recherche et d'enseignement supérieur de Grenoble et Lyon, mais aussi avec les acteurs économiques de ces territoires.

Présent dans les domaines du logiciel, du calcul haute performance, de l'internet des objets, de l'image et des données, mais aussi de la simulation en océanographie et en biologie, il participe au meilleur niveau à la vie scientifique internationale par les résultats obtenus et les collaborations tant en Europe que dans le reste du monde.

Contexte et atouts du poste

The Morpheo INRIA team and Microsoft are setting up a collaboration on the capture and modelling of moving shapes using multiple videos. This PhD proposal is part of this collaboration with the objective to develop tools for animation synthesis and 4D content generation based on captured 4D sequences with multi-view videos. The PhD will take place at Inria Grenoble Rhône-Alpes and will involve regular visits and stays at Microsoft in Redmond (USA) and Cambridge (UK).

Mission confiée

Recent 4D shape capture system  have the ability to model dynamic scenes in a precise and realistic ways,hence providing a  meaningful way to produce contents for VAR applications. Besides the  properties of the 4D Models, e.g. its precision, that can still be improved, an interesting issue is  how to recombinerecorded 4D models in order to produce new animations and with respect to constraints, e.g. interactivesystems or motion transfer.  In addition to broaden creative possibilities with 4D models, this also reduces the need for exhaustive acquisitions when large datasets or complex dynamic scenes (e.g. a crowd) are targeted. While some preliminary works have already investigated the concatenation or the motion transfer between 4D models there are still many directions to explore:

  • How to recombine, morph or transfer information in a hierarchical way between body subjects and between their body parts, in both the geometry and appearance domains.
  • Time re-basing of sequences, time speed alteration
  • Retrieve style characteristics of captured humans and use for improvement of synthesis
  • How to design interactive systems where animations are produced in real-time.
  • How to model the motion  and appearance information of  dynamic shapes in order to enable interpolation (e.g pose spaces for motion).
  • How to create complex scenes with interacting shapes, e.g. crowds.
  • How to preserve individual style when creating or reproducing a given motion.

We propose to explore some of the above issues with  a particular emphasize on interactive setups for VR or AR experiences with HMD and to take advantage of the Kinovis platform to produce data for that purpose.

Principales activités

For a better knowledge of the proposed position, please consult the full job offer at :

https://team.inria.fr/morpheo/microsoft-animation-synthesis/

Compétences

The PhD candidate should hold a master’s degree in computer science. Very good background in computer vision, 3D vision, and/or machine learning are expected.  The candidate will be co-supervised by Jean-Sébastien Franco and Edmond Boyer at Inria Grenoble, France, with the involvement of Steve Sullivan, Andrew Fitzgibbon, Jamie Shotton and Marta Wilczkowiak at Microsoft.

Avantages sociaux

  • Restauration subventionnée
  • Transports publics remboursés partiellement
  • Sécurité sociale
  • Congés payés
  • Aménagement du temps de travail
  • Installations sportives

Rémunération

1982€ gross the first 2 years , then 2085€ gross the 3rd year