[
https://issues.apache.org/jira/browse/HIVE-28402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869282#comment-17869282
]
Stamatis Zampetakis commented on HIVE-28402:
--------------------------------------------
Many thanks for working on this [~dengzh]. Can you please add a few details
here about the root cause and the proposed solution for future reference.
> Precommit tests fail with OOM when running split-19
> ---------------------------------------------------
>
> Key: HIVE-28402
> URL: https://issues.apache.org/jira/browse/HIVE-28402
> Project: Hive
> Issue Type: Task
> Components: Testing Infrastructure
> Reporter: Stamatis Zampetakis
> Assignee: Zhihua Deng
> Priority: Major
> Labels: pull-request-available
>
> The last 3 runs in master all fail with OOM when running split-19:
> *
> [https://ci.hive.apache.org/blue/organizations/jenkins/hive-precommit/detail/master/2233/pipeline]
> *
> [https://ci.hive.apache.org/blue/organizations/jenkins/hive-precommit/detail/master/2234/pipeline]
> *
> [https://ci.hive.apache.org/blue/organizations/jenkins/hive-precommit/detail/master/2235/pipeline]
> {noformat}
> [2024-07-25T05:57:46.816Z] [INFO] Running
> org.apache.hadoop.hive.metastore.client.TestGetPartitions
> [2024-07-25T06:00:23.926Z] Exception in thread "Thread-46"
> java.lang.OutOfMemoryError: GC overhead limit exceeded
> [2024-07-25T06:00:23.926Z] at
> java.util.Arrays.copyOfRange(Arrays.java:3664)
> [2024-07-25T06:00:23.926Z] at java.lang.String.<init>(String.java:207)
> [2024-07-25T06:00:23.926Z] at
> java.io.BufferedReader.readLine(BufferedReader.java:356)
> [2024-07-25T06:00:24.907Z] at
> java.io.BufferedReader.readLine(BufferedReader.java:389)
> [2024-07-25T06:00:24.907Z] at
> org.apache.maven.surefire.shade.common.org.apache.maven.shared.utils.cli.StreamPumper.run(StreamPumper.java:89)
> [2024-07-25T06:01:46.664Z] [WARNING] ForkStarter IOException: GC overhead
> limit exceeded. See the dump file
> /home/jenkins/agent/workspace/hive-precommit_master/standalone-metastore/metastore-server/target/surefire-reports/2024-07-25T05-50-11_022-jvmRun1.dumpstream
> [2024-07-25T06:01:55.003Z] [INFO] Running
> org.apache.hadoop.hive.metastore.TestFilterHooks
> [2024-07-25T06:02:21.747Z]
> [2024-07-25T06:02:21.748Z] Exception: java.lang.OutOfMemoryError thrown from
> the UncaughtExceptionHandler in thread "Thread-49"
> [2024-07-25T06:03:08.707Z] [WARNING] ForkStarter IOException: GC overhead
> limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded
> [2024-07-25T06:03:08.707Z] GC overhead limit exceeded. See the dump file
> /home/jenkins/agent/workspace/hive-precommit_master/standalone-metastore/metastore-server/target/surefire-reports/2024-07-25T05-50-11_022-jvmRun1.dumpstream
> [2024-07-25T06:03:15.362Z] [ERROR] Error closing test event listener:
> [2024-07-25T06:03:15.362Z] java.util.concurrent.CompletionException:
> java.lang.OutOfMemoryError: GC overhead limit exceeded
> [2024-07-25T06:03:15.362Z] at
> java.util.concurrent.CompletableFuture.encodeThrowable
> (CompletableFuture.java:273)
> [2024-07-25T06:03:15.362Z] at
> java.util.concurrent.CompletableFuture.completeThrowable
> (CompletableFuture.java:280)
> [2024-07-25T06:03:15.362Z] at
> java.util.concurrent.CompletableFuture$AsyncRun.run
> (CompletableFuture.java:1643)
> [2024-07-25T06:03:15.362Z] at
> java.util.concurrent.ThreadPoolExecutor.runWorker
> (ThreadPoolExecutor.java:1149)
> [2024-07-25T06:03:15.362Z] at
> java.util.concurrent.ThreadPoolExecutor$Worker.run
> (ThreadPoolExecutor.java:624)
> [2024-07-25T06:03:15.362Z] at java.lang.Thread.run (Thread.java:748)
> [2024-07-25T06:03:15.362Z] Caused by: java.lang.OutOfMemoryError: GC overhead
> limit exceeded
> [2024-07-25T06:03:15.363Z] [ERROR] GC overhead limit exceeded -> [Help 1]
> {noformat}
> The OOM is also affecting PR runs.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
