Login
Engineering projects – from the world’s tallest skyscrapers to new transport infrastructure – use complex 3D models to assess safety, efficiency and cost effectiveness. Running millions of survey data points through complex computational simulations to create these models introduces opportunity for error. To provide the confidence needed by such safety critical industries, 3D simulation software needs a standardised method for checking their accuracy.
Challenge
Computer simulations are an essential part of engineering projects. From predicting how a new building will fit into a city’s skyline, to having confidence in the structural integrity of walls and containers, reliable 3D models are needed for critical decisions can be made on safety, appearance, and investment.
“There is no coherent framework for testing measurement software – developers must rely on ad hoc approaches”
Computer simulations turn millions of survey data points, collected from measuring these structures, into reliable models. These models rely on many different and complex subroutines. Users making decisions based on these models must trust that the programmes correctly interpret and process the input data. Mistakes can be very costly in these industries, so users need confidence that these models are performing correctly.
Developers often send their software for third party testing. Whilst this increases chances of programing errors being spotted, there is no coherent framework for testing measurement software – developers must rely on ad hoc approaches, their own or others, with no way of demonstrating that such methods provide fit for purpose results.
An independently validated, standardised method to demonstrate performance of modelling software would reduce errors in such software, and give confidence to the many engineers and manufacturers who rely on 3D structural models.
Solution
The EMRP project Traceability for computationally-intensive metrology has developed a validation process to prove the correctness of calculations with complex, numerical algorithms implemented in measurement software. 3D simulation software is a typical target for this approach.
This project applies the calibration approach used for measurement instruments – using a well understood reference object – to software calibration, with the reference object being replaced by data sets.
The project developed a range of ‘golden data sets’ – standardised data sets and routines. These were created by back calculations using results to generate data sets that match the required accuracy needed for software conformance testing. The project’s TraCIM system evaluates and compares the results from the software being tested to idealised values, providing a performance certification process to confirm that test software runs properly and does not produce errors. The system is cloud based and so can be used by the software developer on their own system, making it quicker than previous third party approaches, as well as more reliable.
Impact
Technodigit, part of Hexagon AB, specialises in surface 3D modelling for structural engineering, rapid prototyping and medical applications. The company has validated a new software model as a result of the project, creating a more efficient way to check the integrity of fuel or oil storage tanks at ports and airports.
“With the TraCIM system, Technodigit has been able to check its software algorithms and receive a test report confirming these are fit for purpose”
Technodigit’s 3DReshaper is used to ensure site safety through fuel tank storage integrity checking. This process currently requires two days of manual measurements and data manipulation. Recognising the frustrations in this process, Technodigit developed a new software module which can automatically generate the test report in two hours with minimal human intervention.
Demonstrating that the data points have been correctly analysed has been difficult, undermining confidence in a product, which customers are otherwise keen to embrace. With the TraCIM system, Technodigit has been able to check its software algorithms and receive a test report confirming these are fit for purpose.
This gives Technodigit’s customers’ confidence in the results and that the inspection has been appropriately carried out, speeding take-up of the software. The TraCIM system is also being used to continually assess its own in-house testing systems and software components, making it a key part of Technodigit’s new product development and ensuring confidence from day one.
