Regression Tests

This tests are implemented to guarantee the historical consistency of yadism results.

Todo

Regression tests are not running yet.

Description

A set of results is produced at a given time and stored separately from the package code. Thus, we can consider the produced as generated from an external program at a different point in time.

The regression runner will run the same calculation with the same settings of the previously generated results, fetch these ones and compare the new with the stored to ensure that nothing has been changed.

Slicing (1-hot)

Since it is not possible to test the full matrix of combinations, because of its exponential complexity in the features number, a one-hot strategy has been adopted.

1-hot

It means that if multiple features can be toggle a single one is chosen and activated, keeping all the others off. Then iterate over all the possible selection (we borrowed this name from the well-known One-hot encoding).

This means that all the features are controlled one at a time by the regression tests, but not all the combinations.