Skip to content

Commit bc59e38

Browse files
Output consistency tests: extended README regarding exclusions
1 parent 36be18d commit bc59e38

File tree

1 file changed

+9
-0
lines changed

1 file changed

+9
-0
lines changed

test/output-consistency/README.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -49,6 +49,15 @@ division by zero)
4949
* Generate expressions with aggregation functions
5050
* Generate nested expressions
5151

52+
## Handle test failures
53+
If there are any failures, validate them and create a ticket if appropriate.
54+
55+
Then, until the ticket is resolved, you can
56+
* add ignores for inconsistencies in `misc/python/materialize/output_consistency/ignore_filter/inconsistency_ignore_filter.py`
57+
* normalize error messages in `misc/python/materialize/output_consistency/validation/error_message_normalizer.py`
58+
59+
Mention ignored entries or normalizations in the ticket so that they can be reverted when the ticket is resolved.
60+
5261
## Implementation
5362

5463
### UML Overview

0 commit comments

Comments
 (0)