Hi there, I'm using PySpark on a Hadoop cluster and I could not find the info about the executor memory model with Python.
I know that the Python memory (spark.python.worker.memory) does not overlap the JVM Heap (spark.executor.memory). However, does the Python Memory overlap the Executor Memory Overhead or not ? Thank you very much, -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/In-an-executor-are-the-Python-worker-memory-and-the-MemoryOverhead-overlapping-tp28610.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe e-mail: [email protected]
