5.2. Reproducibility

• Reproducibility is achieved when an analysis can be repeated using the same data, yielding the same results.

• Replicability occurs when an analysis with different data on the same study subject leads to the same conclusions.

We focus on a strict interpretation of reproducibility: The same implementation of a method applied to the exact same data must produce the same result.

• This approach is common in computer science and can be supported by tools like and related remote services.

Attention

Some products require strict certification processes, such as the ASME VVUQ standard. For example, medical devices must comply with the ASME V&V 40 standard where reproducibility is part of the verification and validation process.