[jira] [Commented] (DRILL-6139) Travis CI hangs on TestVariableWidthWriter#testRestartRow
[ https://issues.apache.org/jira/browse/DRILL-6139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16357662#comment-16357662 ] Paul Rogers commented on DRILL-6139: [~timothyfarkas], if you see tests that have unclosed allocators, please file one or more JIRA entries. In general, the test *should* fail with an exception about an unclosed allocator. When I see these, the individual test cases pass, but the test itself fails, due to an exception in the test wrap-up block. At first glance, it is not clear how memory could impact these tests since they generally allocate only one large vector, and the whole point of the code under test is to ensure that such vectors don't exceed 16 MB. But, given that we run many test cases in the same JVM under Maven (and thus Travis), perhaps there is some cumulative effect that we need to figure out. > Travis CI hangs on TestVariableWidthWriter#testRestartRow > - > > Key: DRILL-6139 > URL: https://issues.apache.org/jira/browse/DRILL-6139 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.12.0 >Reporter: Boaz Ben-Zvi >Assignee: Paul Rogers >Priority: Major > > The Travis CI fails (probably hangs, then times out) in the following test: > {code:java} > Running org.apache.drill.test.rowSet.test.DummyWriterTest Running > org.apache.drill.test.rowSet.test.DummyWriterTest#testDummyScalar Running > org.apache.drill.test.rowSet.test.DummyWriterTest#testDummyMap Tests run: 2, > Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.109 sec - in > org.apache.drill.test.rowSet.test.DummyWriterTest Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testSkipNulls > Running org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testWrite > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testFillEmpties > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testRollover > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testSizeLimit > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testRolloverWithEmpties > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testRestartRow > Killed > > Results : > Tests run: 1554, Failures: 0, Errors: 0, Skipped: 66{code} > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (DRILL-6139) Travis CI hangs on TestVariableWidthWriter#testRestartRow
[ https://issues.apache.org/jira/browse/DRILL-6139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16357522#comment-16357522 ] Timothy Farkas commented on DRILL-6139: --- [~Paul.Rogers] Didn't know there was already a jira for this. I also created https://issues.apache.org/jira/browse/DRILL-6144 for unit test hangs. But I observed that the hangs were occurring in unit tests other than this one and not just on Travis. After I increased direct memory to 5gb on jenkins and 4.6gb on travis, the issue disappeared. I am going to open a PR with the increase in memory. Perhaps if you find something during your investigation and have a fix we can reduce the memory on our builds once the fix goes in. Also as a side note, I noticed some unit tests where allocators are created and never closed. I'm a bit hazy on the details but I believe MiniPlanUnitTestBase is one of these offending test classes. > Travis CI hangs on TestVariableWidthWriter#testRestartRow > - > > Key: DRILL-6139 > URL: https://issues.apache.org/jira/browse/DRILL-6139 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.12.0 >Reporter: Boaz Ben-Zvi >Assignee: Paul Rogers >Priority: Major > > The Travis CI fails (probably hangs, then times out) in the following test: > {code:java} > Running org.apache.drill.test.rowSet.test.DummyWriterTest Running > org.apache.drill.test.rowSet.test.DummyWriterTest#testDummyScalar Running > org.apache.drill.test.rowSet.test.DummyWriterTest#testDummyMap Tests run: 2, > Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.109 sec - in > org.apache.drill.test.rowSet.test.DummyWriterTest Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testSkipNulls > Running org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testWrite > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testFillEmpties > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testRollover > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testSizeLimit > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testRolloverWithEmpties > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testRestartRow > Killed > > Results : > Tests run: 1554, Failures: 0, Errors: 0, Skipped: 66{code} > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (DRILL-6139) Travis CI hangs on TestVariableWidthWriter#testRestartRow
[ https://issues.apache.org/jira/browse/DRILL-6139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16354194#comment-16354194 ] Paul Rogers commented on DRILL-6139: This is in my code; I'll take a look. The test did not fail last time I ran the developer unit tests. This bit of code is a bit tricky, so I'll need to poke around a bit. > Travis CI hangs on TestVariableWidthWriter#testRestartRow > - > > Key: DRILL-6139 > URL: https://issues.apache.org/jira/browse/DRILL-6139 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.12.0 >Reporter: Boaz Ben-Zvi >Assignee: Paul Rogers >Priority: Major > > The Travis CI fails (probably hangs, then times out) in the following test: > {code:java} > Running org.apache.drill.test.rowSet.test.DummyWriterTest Running > org.apache.drill.test.rowSet.test.DummyWriterTest#testDummyScalar Running > org.apache.drill.test.rowSet.test.DummyWriterTest#testDummyMap Tests run: 2, > Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.109 sec - in > org.apache.drill.test.rowSet.test.DummyWriterTest Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testSkipNulls > Running org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testWrite > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testFillEmpties > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testRollover > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testSizeLimit > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testRolloverWithEmpties > Running > org.apache.drill.test.rowSet.test.TestVariableWidthWriter#testRestartRow > Killed > > Results : > Tests run: 1554, Failures: 0, Errors: 0, Skipped: 66{code} > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)