Hanifi Gunes created DRILL-3205:
-----------------------------------

             Summary: Test framework should report actual values in case of 
failures
                 Key: DRILL-3205
                 URL: https://issues.apache.org/jira/browse/DRILL-3205
             Project: Apache Drill
          Issue Type: Bug
          Components: Tools, Build & Test
    Affects Versions: 1.0.0
            Reporter: Hanifi Gunes
            Assignee: Steven Phillips


Test framework seems to report expected results alone. This makes it 
particularly hard to investigate and reason about the problem. Even in case 
where test result matcher is un-ordered we can report actual results if 
returned number of rows & columns is manageable (say r x c ≤ 100)

{code:title=Sample test failure that reports expected result but not the actual 
value}
Tests run: 43, Failures: 0, Errors: 1, Skipped: 3, Time elapsed: 30.168 sec <<< 
FAILURE! - in org.apache.drill.TestFunctionsQuery
testToCharFunction(org.apache.drill.TestFunctionsQuery)  Time elapsed: 0.112 
sec  <<< ERROR!
java.lang.Exception: Did not find expected record in result set: `DEC28_1` : 
12,345,678,912,345,678,912.5567, `DEC38_1` : 999999999999999999999999999.5, 
`DEC9_1` : 1,234.56, `DEC18_1` : 99999912399.9567, `FLOAT8_1` : 1,234.56, 
`FLOAT8_2` : $1,234.50, 

        at 
org.apache.drill.DrillTestWrapper.compareResults(DrillTestWrapper.java:541)
        at 
org.apache.drill.DrillTestWrapper.compareUnorderedResults(DrillTestWrapper.java:295)
        at org.apache.drill.DrillTestWrapper.run(DrillTestWrapper.java:119)
        at org.apache.drill.TestBuilder.go(TestBuilder.java:125)
        at 
org.apache.drill.TestFunctionsQuery.testToCharFunction(TestFunctionsQuery.java:517)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to