Hanifi Gunes created DRILL-3205: ----------------------------------- Summary: Test framework should report actual values in case of failures Key: DRILL-3205 URL: https://issues.apache.org/jira/browse/DRILL-3205 Project: Apache Drill Issue Type: Bug Components: Tools, Build & Test Affects Versions: 1.0.0 Reporter: Hanifi Gunes Assignee: Steven Phillips
Test framework seems to report expected results alone. This makes it particularly hard to investigate and reason about the problem. Even in case where test result matcher is un-ordered we can report actual results if returned number of rows & columns is manageable (say r x c ≤ 100) {code:title=Sample test failure that reports expected result but not the actual value} Tests run: 43, Failures: 0, Errors: 1, Skipped: 3, Time elapsed: 30.168 sec <<< FAILURE! - in org.apache.drill.TestFunctionsQuery testToCharFunction(org.apache.drill.TestFunctionsQuery) Time elapsed: 0.112 sec <<< ERROR! java.lang.Exception: Did not find expected record in result set: `DEC28_1` : 12,345,678,912,345,678,912.5567, `DEC38_1` : 999999999999999999999999999.5, `DEC9_1` : 1,234.56, `DEC18_1` : 99999912399.9567, `FLOAT8_1` : 1,234.56, `FLOAT8_2` : $1,234.50, at org.apache.drill.DrillTestWrapper.compareResults(DrillTestWrapper.java:541) at org.apache.drill.DrillTestWrapper.compareUnorderedResults(DrillTestWrapper.java:295) at org.apache.drill.DrillTestWrapper.run(DrillTestWrapper.java:119) at org.apache.drill.TestBuilder.go(TestBuilder.java:125) at org.apache.drill.TestFunctionsQuery.testToCharFunction(TestFunctionsQuery.java:517) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)