[jira] [Commented] (SPARK-3178) setting SPARK_WORKER_MEMORY to a value without a label (m or g) sets the worker memory limit to zero
[ https://issues.apache.org/jira/browse/SPARK-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14124744#comment-14124744 ] Apache Spark commented on SPARK-3178: - User 'bbejeck' has created a pull request for this issue: https://github.com/apache/spark/pull/2309 > setting SPARK_WORKER_MEMORY to a value without a label (m or g) sets the > worker memory limit to zero > > > Key: SPARK-3178 > URL: https://issues.apache.org/jira/browse/SPARK-3178 > Project: Spark > Issue Type: Bug > Environment: osx >Reporter: Jon Haddad >Assignee: Bill Bejeck > Labels: starter > > This should either default to m or just completely fail. Starting a worker > with zero memory isn't very helpful. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3178) setting SPARK_WORKER_MEMORY to a value without a label (m or g) sets the worker memory limit to zero
[ https://issues.apache.org/jira/browse/SPARK-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117350#comment-14117350 ] Apache Spark commented on SPARK-3178: - User 'bbejeck' has created a pull request for this issue: https://github.com/apache/spark/pull/2227 > setting SPARK_WORKER_MEMORY to a value without a label (m or g) sets the > worker memory limit to zero > > > Key: SPARK-3178 > URL: https://issues.apache.org/jira/browse/SPARK-3178 > Project: Spark > Issue Type: Bug > Environment: osx >Reporter: Jon Haddad >Assignee: Bill Bejeck > Labels: starter > > This should either default to m or just completely fail. Starting a worker > with zero memory isn't very helpful. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3178) setting SPARK_WORKER_MEMORY to a value without a label (m or g) sets the worker memory limit to zero
[ https://issues.apache.org/jira/browse/SPARK-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110116#comment-14110116 ] Helena Edelson commented on SPARK-3178: --- +1 it doesn't look like the input data is validated to fail fast if mb/g is not noted > setting SPARK_WORKER_MEMORY to a value without a label (m or g) sets the > worker memory limit to zero > > > Key: SPARK-3178 > URL: https://issues.apache.org/jira/browse/SPARK-3178 > Project: Spark > Issue Type: Bug > Environment: osx >Reporter: Jon Haddad > > This should either default to m or just completely fail. Starting a worker > with zero memory isn't very helpful. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
