The ever-increasing number of novel functions in modern vehicles continuously expands with the application of cognitive information technology, creating a new need for testing during market introduction. As the virtual test environment evolves, the need for real tests conducted on the road continuously decreases, saving time and cost while maximizing quality indicators. This article presents a new type of automatic monitoring system created in a fully virtual test environment. The automated assessment during dynamometer testing (ADT) method automatically evaluates the values measured on the engine dynamometer at predefined intervals, compares them to reference data, and provides feedback on the correctness of the current test. The present paper discusses the monitoring methodology and its application on an engine dynamometer, and it presents the results of the method applied during a real engine test.