Interested to participate?

Conducting Experiments in Software Industry

 

JOIN US

Join your hands with us and participate in experiments to identify the variables that play a vital role in software development and understand the connections between these variables.

ESEIL research project aims to create an Experimental Software Engineering Industrial Laboratory (ESEIL). ESEIL applies an unprecedented experimental approach at companies in order to gain an understanding of the software development process and the software produced in industry. Analyses of the experimental results will determine the effect of improvements on methods and techniques applied by companies.

The ESEIL project conducts controlled experiments to gather knowledge about the behavior of different software development methods and techniques in different environments. The experimental results will lead to findings about the above software technologies and their application contexts. Additionally, it will help organizations to learn more about the variables influencing their software development process and control the identified variables to improve their process and make them more predictable.

 

OUR TEAM

Markku Oivo


Scientific Director

Natalia Juristo


Fidipro professor & Project Manager

Oscar
Dieste


Senior Researcher

Sira
Vegas


Senior Researcher

Burak
Turhan


Senior Researcher

Ayse
Tosun


Assistant Researcher

Davide
Fucci


Assistant Researcher

Patricia
Riofrío


PhD Student

Fernando
Uyaguari


PhD Student

Adrián
Santos


PhD Student

 

OUR GOAL

Our scientific goals leading to advances in the state of the knowledge on SE controlled experiments are:

  • Conduct controlled experiments in industry
  • Replicate controlled experiments in different industrial settings
  • Gain evidence about the software technologies on which experiments have been run
  • Create industrial laboratory packages for replication.

Our practical goals that should improve the quality of software built in industry are:

  • Identify variables on a set of software technologies in order to improve the control industry has on software development.
  • Package findings gained from the results of the experiments to ease industry use.
  • Transfer findings gained from the results of the experiments to partner organizations for use in their software development process.

 

OUR EXPERIMENTS

INDUSTRY EXPERIMENTS

  • Ericsson (04/2015 – Helsinki, Finland – 20 Practitioners)
  • Fsecure:
    • (02/2014 – Helsinki, Finland- 6 Practitioners)
    • (12/2013 – Kuala Lumpur, Malaysia – 11 Practitioners)
    • (10/2013 – Oulu, Finland – 24 Practitioners)
  • Bittium (02/2014 – Kajaani, Finland – 9 Practitioners)
  • Mapfre (2015 – Madrid, Spain – 14 Practitioners)
  • Playtech (04/2014 – Tartu,Estonia – 17 Practitioners)

ACADEMIC EXPERIMENTS

  • University of Oulu:
    • (10/2015 – Oulu,Finland – 48 M.Sc. Students)
    • (10/2012 – Oulu, Finland – 68 M.Sc. Students)
    • (10/2011 – Oulu, Finland – 53 M.Sc. Students)
  • UPM University (03/2014 – Madrid, Spain – 16 M.Sc. Students)
  • University of Southern Denmark (11/2015 – Odense, Denmark – 71 Practitioners)
  • UPV University (05/2014 – Valencia, Spain – 31 B.Sc. Students)
  • Basilicata University (04/2014 – Polnta, Italy – 21 B.Sc. Students)

 

KEY NOTES

IASESE

In-vivo experimentation in software engineering. [ Part 1 AND Part 2 ]
Event: Need for speed (N4S 2015)
Keynote Speaker: Natalia Juristo

N4S

Conducting Experiments in Software Industry
Event: Need for speed (N4S 2015)
Keynote Speaker: Natalia Juristo

cibse-logo

Is It Possible to Build General, Empirically-Backed Knowledge in Software Engineering?
Event: Iberoamerican Congress of Software Engineering (CIBSE 2016)
Keynote Speaker: Oscar Dieste

cesi

Experiences conducting experiments in industry: The ESEIL FiDiPro project
Event: CESI @ International Conference on Software Engineering (ICSE 2016)
Keynote Speaker: Natalia Juristo

 

DISSEMINATION

Dissecting the Test-Driven Development Process: A Quasi-Experiment in Industry
Authors: Fucci, Turhan, Juristo, Erdogmus,Oivo
Journal: IEEE Transactions on SE. 2016

Empirical Evaluation of the Effects of Experience on Code Quality and Developer Productivity: An Exploratory Study Empirical SE
Authors: Dieste, Aranda, Uyaguari, Turhan, Tosun, Fucci, Oivo, Juristo.
Journal: Empirical SE Journal

An Industry Experiment on the Effects of Test-Driven Development on External Quality and Productivity(Submitted)
Authors: Tosun, Dieste, Fucci, Vegas, Turhan, Erdogmus, Santos, Oivo, Toro, Jarvinen, Juristo.
Journal: Empirical SE Journal

Towards an Operationalization of Test-driven Development Skills: An Industrial Empirical Study.
Authors: Fucci, Turhan, Juristo, Dieste, Tosun, Oivo
Journal: Information and Software Technology

Are Students Representatives of Professionals in Software Engineering Experiments.
Authors: Salman,Misirli, Juristo
Conference: 37th International Conference on Software Engineering(ICSE 2015)

An External Replication on the Effects of Test-driven Development Using a Multi-site Blind Analysis Approach. Best Paper Award
Authors: Fucci, Scanniello, Romano, Shepperd, Sigweni, Uyaguari, Turhan, Juristo and Oivo.
Conference: 10th International Symposium on Empirical Software Engineering and Measurement (ESEM 2016)

Results from an Ethnographically-informed Study in the Context of test Driven development.
Authors: Romano, Fucci, Scanniello, Turhan, Juristo, Oivo
Conference: 20th International Conference on Evaluation and Assessment in Software Engineering (EASE 2016)

Difficulties in Running Experiments in the Software Industry: Experiences from the Trenches.
Authors: Vegas,Dieste, Juristo
Conference: 3rd International Workshop on Conducting Empirical Studies in Industry (CESI 2015)

Joint Analysis of Families of SE Experiments.
Authors: AS Parrilla
Conference: 13th International Doctoral Symposium on Empirical Software Engineering (IDOESE 2015 )

Topic Selection in Industry Experiments
Authors: Tosun, Erdogmus, Juristo, Dieste
Conference: 2nd International Workshop on Conducting Empirical Studies in Industry (CESI 2014)

Conformance Factor in Test-driven Development: Initial Results from an Enhanced Replication.
Authors: Fucci, Turhan, Oivo.
Conference: 18th International Conference on Evaluation and Assessment in Software Engineering (EASE 2014)

Impact of Process Conformance on the Effects of Test-driven Development.
Authors: Fucci, Turhan, Oivo.
Conference: 8th International Symposium on Empirical Software Engineering and Measurement(ESEM 2014)

Software Industry Experiments: A Systematic Literature Review
Authors: Dieste, Juristo, Martínez.
Conference: 1st international Workshop on Conducting Empirical Studies in Industry (CESI 2013)

Understanding the Dynamics of Test-Driven Development.
Davide Fucci.
PhD Thesis. Oulu University

 

OUR PARTICIPANTS

Industry Participants

ericsson
playtech
fsecure
mapfre
bittium
paf
invenco

Academic Participants

oulu-uni
upm
upv
sdu
espe
basilicata

 

Contact

Natalia Juristo

University Oulu
Pentti Kaiteran 1
90014 Oulu – Finland

Email: natalia.juristo@oulu.fi

Natalia Juristo

Universidad Politécnica de Madrid
Campus de Montegancedo
28660 Boadilla del Monte (Madrid) – Spain

Email: natalia@fi.upm.es