2018-00762 - 4D Video-Based Rendering
Le descriptif de l’offre ci-dessous est en Anglais

Type de contrat : CDD de la fonction publique

Niveau de diplôme exigé : Thèse ou équivalent

Fonction : Post-Doctorant

Niveau d'expérience souhaité : De 3 à 5 ans

A propos du centre ou de la direction fonctionnelle

The Inria Sophia Antipolis - Méditerranée center counts 37 research teams and 9 support departments. The center's staff (about 600 people including 400 Inria employees) is composed of scientists of different nationalities (250 foreigners of 50 nationalities), engineers, technicians and administrators. 1/3 of the staff are civil servants, the others are contractual. The majority of the research teams at the center are located in Sophia Antipolis and Nice in the Alpes-Maritimes. Six teams are based in Montpellier and a team is hosted by the computer science department of the University of Bologna in Italy. The Center is a member of the University and Institution Community (ComUE) "Université Côte d'Azur (UCA)".

Contexte et atouts du poste

This project is within the context of the Inria-funded IPL AVATAR (in collaboration with the Inria research groups HYBRID, MIMETIC), and the ERC Advanced Grant FUNGRAPH. Two Inria groups are involved GRAPHDECO at Inria Sophia-Antipolis and MORPHEO at Inria Grenoble.

The postdoctoral fellow will be based with GRAPHDECO at INRIA Sophia-Antipolis, but will perform regular long-term (several weeks) visits to MORPHEO at Inria Grenoble.
 

 

Mission confiée

Video-based capture of human motion has made impressive advances in recent years [Microsoft, 4dviews, 8i]. In most cases, the capture process generates textured meshes that are used for display in computer graphics or virtual reality applications. In this project, we are particularly interested in the case of human capture of a self-avatar, and the realistic display of this avatar as part of the coordinated Inria Action IPL AVATAR. The postdoctoral fellowship will involve two Inria groups, MORPHEO in Grenoble that is a leader in human motion capture [Tsiminaki 2014, Leroy 2017] and GRAPHDECO in Sophia-Antipolis that has extensive experience in image-based rendering [Chaurasia 2013, Hedman 2016]. The main focus of the research will be to investigate the continuum between texture-map based solutions and their corresponding (potentially temporal) compression and temporal image-based rendering solutions. This is an exciting and very novel research area which has not been investigated before, involving the development of novel 4D representations, possibly building on surface light fields but also more recent view-dependent free-viewpoint methods. The project will benefit from one of the most advanced motion capture platforms in Europe [Kinovis], designed  and maintained by MORPHEO. In the context of this project, specific capture configurations will be developed for the case of self-avatar sequences, supported by engineering staff at Inria Grenoble, allowing the postdoctoral fellow to concentrate on the development of novel algorithmic solutions.

 

References:

Microsoft, https://www.microsoft.com/en-us/mixed-reality/capture-studios 

4dviews, https://www.4dviews.com

8i, https://8i.com

Kinovis, https://kinovis.inria.fr

Tsiminaki, V., Franco, J. S., & Boyer, E. (2014). High resolution 3D shape texture from multiple videos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(pp. 1502-1509).


Vincent Leroy, Jean-Sébastien Franco, Edmond Boyer (2017).”Multi-View Dynamic Shape Refinement Using Local Temporal Integration.”  In Proceedings of the IEEE International Conference on Computer Vision. 

Chaurasia, G., Duchene, S., Sorkine-Hornung, O., & Drettakis, G. (2013). Depth synthesis and local warps for plausible image-based navigation. ACM Transactions on Graphics (TOG), 32(3), 30.
Hedman, P., Ritschel, T., Drettakis, G., & Brostow, G. (2016). Scalable inside-out image-based rendering. ACM Transactions on Graphics (TOG), 35(6), 231.

Collaboration:
The recruited person will be collaborating with Ph.D. students, other postdoctoral fellows, permanent researchers and engineers of the two groups (GRAPHDECO and MORPHEO).


Steering/Management:
The person recruited will potentially supervise Masters students and collaborate on Ph.D. student projects.

Principales activités

The main activity will be performing excellent research leading to top-notch international publications, with emphasis on the research topics outlined above. There will be some work related to the use of the capture platform in Grenoble.

Compétences

Extensive knowledge of the theory of computer graphics or computer vision is required, as well as aptitude for programming (typically C++/OpenGL, but other skills such as CUDA, python, Unity3D etc are a welcome bonus). The ideal candidate will be competent in both areas. Knowledge of machine learning and corresponding programming skills are also welcome.

Languages: Excellent knowledge of English, spoken and written are a must.

Relational skills: Excellent presentation skills are also required.

 

Avantages sociaux

  • Subsidised catering service
  • Partially-reimbursed public transport
  • Social security
  • Paid leave
  • Flexible working hours
  • Sports facilities

Rémunération

2653€ gross salary