Research Intern

Contract type : Internship

Level of qualifications required : Graduate degree or equivalent

Fonction : Internship Research

About the research centre or Inria department

The Inria Saclay-Île-de-France Research Centre was established in 2008. It has developed as part of the Saclay site in partnership with Paris-Saclay University and with the Institut Polytechnique de Paris .

The centre has 40 project teams , 32 of which operate jointly with Paris-Saclay University and the Institut Polytechnique de Paris; Its activities occupy over 600 people, scientists and research and innovation support staff, including 44 different nationalities.

Assignment

With the help of Etienne Boursier, the recruited intern will study the theory of two-layer ReLU neural networks. In particular, the intern should focus on the impact of the stochasticity due to the use of SGD on the training dynamics.

Main activities

Main activities:

  • establish a bibliographical state of the art
  • run numerical experiments (Python, pytorch) for neural networks on toy examples
  • mathematical proofs and arguments, using mostly non-convex optimization and SDEs tools

Skills

Neural networks theory

Reading scientific articles

Coding (Python, pytorch)

Non-convex optimization

Stochastic differential equations