M2R Scientific Methodology and Performance Evaluation

Table of Contents


---> misc
| ---> 2016
| ---> 2015
| ---> 2014
| ---> 2013
| ---> 2012
`--> Agenda

Scientific Methodology and Performance Evaluation

General Informations

The coordinator for these lectures is Jean-Marc Vincent . The lecturers are Jean-Marc Vincent and Arnaud Legrand .

This year, this lecture is part of the Embedded Systems lecture.

Lectures take place on Wednesday afternoon from 2PM to 5PM, generally in H104.

Here is a map of the campus for those who do not know where the rooms are.

The planning with lecture rooms is available at the ADE website (look for PDES and then for Embedded Systems).

The whole content of the lecture including the slides, the sources of the slides, references, and helps on how to use R is available at https://github.com/alegrand/SMPE.


The aim of this course is to provide the fundamental basis for sound scientific methodology of performance evaluation of computer systems. This lecture emphasize on methodological aspects of measurement and on the statistics needed to analyze computer systems. We first sensibilize the audience to the importance of experiment and analysis reproducibility in particular in computer science. Then we present tools that help answering the analysis problem and may also reveal useful for managing the experimental process through notebooks. The audience will be given the basis of probabilities and statistics required to develop sound experiment designs. Unlike some other lectures, our goal is not to provide analysis recipes that people can readily apply but to make the audience truly understand some simple statistical tools on which they can build further.

Here are links to the previous editions of this lecture: 2011-2012, 2012-2013, 2013-2014, 2014-2015.

Program and expected schedule

See https://github.com/alegrand/SMPE for details of the lectures and additional resources.

  • 7 October 2015 (14:00 - 17:00): Arnaud Legrand, H104 Introduction to reproducible research and litterate programming.
  • 14 October 2015 (8:00 - 11:00): Jean-Marc Vincent, H202 Data visualizationin in action with R.
  • 18 November 2015 (14:00 - 17:00): Arnaud Legrand, H104 Introduction to probabilities and statistics.
  • 25 November 2015 (14:00 - 17:00): Arnaud Legrand, D213 The linear model.
  • 16 December 2015 (14:00 - 17:00): Arnaud Legrand, H104 Design of Experiments
  • 13 January 2016 (14:00 - 17:00): Arnaud Legrand and Jean-Marc Vincent, H104 Mini-projects' defense.