Engineer F/M: Benchmarking of applications'I/O behavior and storage systems (performance and energy consumption)

Contract type : Fixed-term contract

Renewable contract : Yes

Level of qualifications required : Graduate degree or equivalent

Fonction : Temporary scientific engineer

Level of experience : Up to 3 years

About the research centre or Inria department

The Inria center at the University of Bordeaux is one of the nine Inria centers in France and has about twenty research teams.. The Inria centre is a major and recognized player in the field of digital sciences. It is at the heart of a rich R&D and innovation ecosystem: highly innovative SMEs, large industrial groups, competitiveness clusters, research and higher education players, laboratories of excellence, technological research institute...

Context

Within the framework of a Numpex project called Exadost, in collaboration with Inria Rennes, La Maison de la Simulation, the CEA-DAM, and DDN.

This project aims at building the I/O infrastructure of next-generation HPC machines.

Assignment

The recruited person will be responsible for characterizing the I/O behavior of applications that have been chosen as representative of the French HPC workload. This characterization will be done by using profiling tools such as Darshan and Tau, tracing tools such as Recorder, and by inspecting the source code of the applications. We are interested in developping I/O kernels, which are codes that mimic the I/O activities (accesses to persistent data) of the applications and can be used to more easily evaluate them on different platforms.

In addition to that, the person will be responsible for performing experiments on different I/O infrastructures to characterize their behavior and how they are affected by different characteristics of the accesses. For that, existing benchmarks such as IOR and mdtest will be used at first, but new benchmarks may need to be developed.

The selection of benchmarks and access pattern will involve the study of research papers.

Finally, the expected results are a suite of benchmarks that can be easily applied to new platforms, the I/O kernels, a database of obtained results, and a report.

 

For more information on the proposed research subject:

Examples of similar work conducted in the same research team:

https://hal.inria.fr/hal-03753813

https://hal.inria.fr/hal-03808833/

Main activities

Main activities:

  • Studying papers about workload of real large HPC machines and imposed by known classes of applications (for example, machine learning);
  • Running applications and benchmarks on HPC systems using scripts, treating and plotting results;
  • Studying large HPC applications (usually written in C/C++ or Fortran) to understand their I/O behavior;
  • Development of I/O kernels and benchmarks in C/C++ using MPI-IO;
  • Statistical analysis of results and modeling (Python or R).

Additional activities:

  • Writing reports and research papers (Latex)

Skills

Technical skills and level required:

  • C/C++;
  • scripting (Bash, Python,etc);
  • Unix: command line, ssh, etc;
  • a plus (not mandatory): using HPC systems, slurm, etc;
  • experience in research, especially in HPC, would also be a plus.

 

Benefits package

  • Subsidized meals
  • Partial reimbursement of public transport costs
  • Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.)
  • Possibility of partial teleworking and flexible organization of working hours
  • Professional equipment available (videoconferencing, loan of computer equipment, etc.)
  • Social, cultural and sports events and activities

Remuneration

Remuneration according to diplomas and professional experiences :

from 2692 euros to 3085 euros gross monthly