pvary commented on pull request #1495:
URL: https://github.com/apache/iceberg/pull/1495#issuecomment-704562595
> > I reran to see if the tests were flaky and it failed.
>
> Yeah, seen those before too - some flaky stuff I have to investigate. 😢
> This is the one on my list 😄
I was able to repro one failure on my machine. Here is what I have found:
```
2020-10-06 20:59:58,935 WARN [Thread-1171] mapred.LocalJobRunner
(LocalJobRunner.java:run(560)) - job_local1088664218_0010
java.lang.Exception: java.lang.OutOfMemoryError: Java heap space
at
org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.lang.OutOfMemoryError: Java heap space
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init(MapTask.java:986)
at
org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:402)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:442)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
```
Hope that this fix helps, since it is clear that on my machine the tests are
rarely failing, but the failure happens more often on travis. @rdblue: Is there
a way to rerun flaky tests to see if they are fixed or not?
Thanks,
Peter
PS: Also added `iceberg.engine.hive.enabled` to the
`TestHiveIcebergStorageHandlerWithHiveCatalog` tests since that seems like a
more often used scenario.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
