Short Name: TraCIM, Project Number: NEW06

Traceability for computationally-intensive metrology

Improving confidence in new software

Coordinator: Alistair Forbes (NPL)

Complex software and statistical modelling dominates all aspects of business and much of our daily lives. It is nearly impossible to confirm that computer programs running numerous statistical analyses, with multiple subroutines are generating the correct answers. Small errors in the code can cause problems that are very hard to spot. New and improved independent methods are needed to give both programmers and their customer’s confidence that software provides the correct result every time.


The EMRP project Traceability for computationally-intensive metrology (TraCIM) developed the TraCIM system - a new approach to software validation. This on-line system provides users with reference test data, and compares the results generated with those from an ‘ideal’ data set leading to a software validation test report. The project:


  • Developed a web-based searchable database containing standardised mathematical language to specificy calculations needed for co-ordinate measurement machine software.
  • Developed an assessment method for evaluating the performance of user software based on ‘ideal’ reference input data and corresponding ‘ideal’ reference results.
  • Developed a method to combine multiple data set uncertainties to generate a single ‘figure of merit’ for the software under test. This can be used as an estimation of the software uncertainty component during the calculation of overall combined measurement uncertainties.


Confidence in the ongoing performance of software for QA and demonstrating that new software produces accurate results are important in many diverse applications from safety assessment of structures such as fuel storage tanks to quality control assessments of intricately shaped 3D components vital in precision engineering. Results generated by complex software can contain errors. Rounding approximations are assumed to be insignificant, or iterative analysis processes stop too soon failing to generate optimised convergence value are two sources of errors that are difficult for programmers to spot.


The project’s TraCIM system has been used to verify applications where safety critical or very extensive data sets require complex modelling and multistage computer programs to generate results. A follow on EMPIR Support for Impact project Validation of software development and analysis tools is extending this project’s TraCIM system for use with the popular Mathlab software tool. This will enable greater access to this software validation tool and broaden its uptake by industries with complex data and software manipulation requirements.


EMPIR project 15SIP06 ValTraC builds on this work.

Participating EURAMET NMIs and DIs

CMI (Czech Republic)

INRIM (Italy)

MIRS/UM-FS/LTM (Slovenia)

NPL (United Kingdom)

PTB (Germany)

VSL (Netherlands)

Other Participants

Carl Zeiss Industrielle Messtechnik GmbH (Germany)
Hexagon Metrology PTS GmbH (Germany)
Mitutoyo CTL Germany GmbH (Germany)
Werth Messtechnik GmbH (Germany)


New Technologies
2012 - 2015
Researcher Grants
Project website

Automatization of acceptance tests for metrology algorithms

Proc. 13th International Conference on Software Engineering Research and Practice, July 27-30, 2015

Online validation of comparison algorithms using the TraCIM system

Journal of mechanical Engineering and Automation

Approaches for assigning numerical uncertainty to reference data pairs for software validation

Advanced Mathematical and Computational Tools in Metrology and Testing X

Validation of CMM evaluation software using TraCIM

Advanced Mathematical and Computational Tools in Metrology and Testing X

Estimation of test uncertainty for TraCIM reference pairs

Advanced Mathematical and Computational Tools in Metrology and Testing X

Overview of EMRP Joint Research Project NEW06 "Traceability for computationally-intensive metrology"

Advanced Mathematical and Computational Tools in Metrology and Testing X

Generation of numerical artefacts for geometric form and tolerance assessment

International Journal of Metrology and Quality Engineering

Uncertainty associated with form assessment in coordinate metrology

International Journal of Metrology and Quality Engineering