[GitHub] [spark] dongjoon-hyun edited a comment on pull request #33405: [SPARK-36195][BUILD] Set MaxMetaspaceSize JVM option to 2g
dongjoon-hyun edited a comment on pull request #33405: URL: https://github.com/apache/spark/pull/33405#issuecomment-882242140 ~FYI, `Scala 2.13` daily test GitHub Action job passed with this. Now, Apache Spark community have a regular Scala 2.13 test coverage.~ - https://github.com/apache/spark/actions/runs/1043910113 Thank you all, @gengliangwang , @srowen , @HyukjinKwon , @sarutak . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun edited a comment on pull request #33405: [SPARK-36195][BUILD] Set MaxMetaspaceSize JVM option to 2g
dongjoon-hyun edited a comment on pull request #33405: URL: https://github.com/apache/spark/pull/33405#issuecomment-882075828 @gengliangwang . Historically, I saw some of OOM from GitHub Action with exit code 137. And, currently, the my main focus job is this daily job. Please see the log. The native memory leakage is killing the daily Hive job consistently because there is only a single Hive job in daily job. - https://github.com/apache/spark/actions/workflows/build_and_test_scala213_daily.yml ``` sbt.ForkMain 34105 failed with exit code 137 [warn] In the last 6451 seconds, 17.585 (0.3%) were spent in GC. [Heap: 3.38GB free of 3.95GB, max 3.95GB] Consider increasing the JVM heap using `-Xmx` or try a different collector, e.g. `-XX:+UseG1GC`, for better performance. [error] (hive / Test / test) sbt.TestsFailedException: Tests unsuccessful ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun edited a comment on pull request #33405: [SPARK-36195][BUILD] Set MaxMetaspaceSize JVM option to 2g
dongjoon-hyun edited a comment on pull request #33405: URL: https://github.com/apache/spark/pull/33405#issuecomment-882075828 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
