[ https://issues.apache.org/jira/browse/DRILL-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15094633#comment-15094633 ]
Victoria Markman commented on DRILL-4259: ----------------------------------------- This would work. If we do it this way, the only difference would be: these "permutations" are not going to be part of the test suite. > Add new functional tests to ensure that failures can be detected independent > of the testing environment > ------------------------------------------------------------------------------------------------------- > > Key: DRILL-4259 > URL: https://issues.apache.org/jira/browse/DRILL-4259 > Project: Apache Drill > Issue Type: Test > Reporter: Jason Altekruse > > In DRILL-4243 an out of memory issue was fixed after a change to the memory > allocator made memory limits more strict. While the regression tests had been > run by the team at Dremio prior to merging the patch, running the tests on a > cluster with more cores changed the memory limits on the queries and caused > several tests to fail. > While changes of this magnitude are not going to be common, we should have a > test suite that reliably fails independent of the environment it is run > (assuming that there are sufficient resources for the tests to run). > It would be good to at least try to reproduce this failure on a few different > setups (cores, nodes in cluster) by adjusting available configuration options > and adding tests with those different configurations so that the tests will > fail in different environments. -- This message was sent by Atlassian JIRA (v6.3.4#6332)