[jira] [Commented] (SPARK-33043) RowMatrix is incompatible with spark.driver.maxResultSize=0
[ https://issues.apache.org/jira/browse/SPARK-33043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209229#comment-17209229 ] Sean R. Owen commented on SPARK-33043: -- My unofficial guess is December, just based on previous maintenance release cadences. > RowMatrix is incompatible with spark.driver.maxResultSize=0 > --- > > Key: SPARK-33043 > URL: https://issues.apache.org/jira/browse/SPARK-33043 > Project: Spark > Issue Type: Bug > Components: MLlib >Affects Versions: 3.0.0, 3.0.1 >Reporter: Karen Feng >Assignee: Sean R. Owen >Priority: Minor > Fix For: 3.0.2, 3.1.0 > > > RowMatrix does not work if spark.driver.maxResultSize=0, as this requirement > breaks: > > {code:java} > require(maxDriverResultSizeInBytes > aggregatedObjectSizeInBytes, > s"Cannot aggregate object of size $aggregatedObjectSizeInBytes Bytes, " > + s"as it's bigger than maxResultSize ($maxDriverResultSizeInBytes Bytes)") > {code} > > [https://github.com/apache/spark/blob/master/mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/RowMatrix.scala#L795.] > > This check should likely only happen if maxDriverResultSizeInBytes > 0. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-33043) RowMatrix is incompatible with spark.driver.maxResultSize=0
[ https://issues.apache.org/jira/browse/SPARK-33043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209221#comment-17209221 ] Karen Feng commented on SPARK-33043: When can we anticipate a 3.0.2 release with the fix? > RowMatrix is incompatible with spark.driver.maxResultSize=0 > --- > > Key: SPARK-33043 > URL: https://issues.apache.org/jira/browse/SPARK-33043 > Project: Spark > Issue Type: Bug > Components: MLlib >Affects Versions: 3.0.0, 3.0.1 >Reporter: Karen Feng >Assignee: Sean R. Owen >Priority: Minor > Fix For: 3.0.2, 3.1.0 > > > RowMatrix does not work if spark.driver.maxResultSize=0, as this requirement > breaks: > > {code:java} > require(maxDriverResultSizeInBytes > aggregatedObjectSizeInBytes, > s"Cannot aggregate object of size $aggregatedObjectSizeInBytes Bytes, " > + s"as it's bigger than maxResultSize ($maxDriverResultSizeInBytes Bytes)") > {code} > > [https://github.com/apache/spark/blob/master/mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/RowMatrix.scala#L795.] > > This check should likely only happen if maxDriverResultSizeInBytes > 0. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-33043) RowMatrix is incompatible with spark.driver.maxResultSize=0
[ https://issues.apache.org/jira/browse/SPARK-33043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17205772#comment-17205772 ] Apache Spark commented on SPARK-33043: -- User 'srowen' has created a pull request for this issue: https://github.com/apache/spark/pull/29925 > RowMatrix is incompatible with spark.driver.maxResultSize=0 > --- > > Key: SPARK-33043 > URL: https://issues.apache.org/jira/browse/SPARK-33043 > Project: Spark > Issue Type: Bug > Components: MLlib >Affects Versions: 3.0.0, 3.0.1 >Reporter: Karen Feng >Priority: Minor > > RowMatrix does not work if spark.driver.maxResultSize=0, as this requirement > breaks: > > {code:java} > require(maxDriverResultSizeInBytes > aggregatedObjectSizeInBytes, > s"Cannot aggregate object of size $aggregatedObjectSizeInBytes Bytes, " > + s"as it's bigger than maxResultSize ($maxDriverResultSizeInBytes Bytes)") > {code} > > [https://github.com/apache/spark/blob/master/mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/RowMatrix.scala#L795.] > > This check should likely only happen if maxDriverResultSizeInBytes > 0. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-33043) RowMatrix is incompatible with spark.driver.maxResultSize=0
[ https://issues.apache.org/jira/browse/SPARK-33043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17205771#comment-17205771 ] Apache Spark commented on SPARK-33043: -- User 'srowen' has created a pull request for this issue: https://github.com/apache/spark/pull/29925 > RowMatrix is incompatible with spark.driver.maxResultSize=0 > --- > > Key: SPARK-33043 > URL: https://issues.apache.org/jira/browse/SPARK-33043 > Project: Spark > Issue Type: Bug > Components: MLlib >Affects Versions: 3.0.0, 3.0.1 >Reporter: Karen Feng >Priority: Minor > > RowMatrix does not work if spark.driver.maxResultSize=0, as this requirement > breaks: > > {code:java} > require(maxDriverResultSizeInBytes > aggregatedObjectSizeInBytes, > s"Cannot aggregate object of size $aggregatedObjectSizeInBytes Bytes, " > + s"as it's bigger than maxResultSize ($maxDriverResultSizeInBytes Bytes)") > {code} > > [https://github.com/apache/spark/blob/master/mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/RowMatrix.scala#L795.] > > This check should likely only happen if maxDriverResultSizeInBytes > 0. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org