EnricoMi commented on PR #43538: URL: https://github.com/apache/spark/pull/43538#issuecomment-1782580570
The mem statistics with `2g` are MiB Mem : 6922.0 total, 579.9 free, 5634.8 used, 707.2 buff/cache MiB Swap: 4096.0 total, 2069.7 free, 2026.2 used. 976.4 avail Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 2494 runner 20 0 16.4g 5.1g 23040 S 118.8 75.5 103:16.37 java So even with `2g`, memory usage is still quite high but significantly better than with `12g`, there is headroom of 2g free swap and 500m free mem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org