[jira] [Commented] (SPARK-27780) Shuffle server & client should be versioned to enable smoother upgrade

[ https://issues.apache.org/jira/browse/SPARK-27780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149083#comment-17149083 ] Jason Moore commented on SPARK-27780: - I encounter this on 3.0.0 running with a much older shuffle

[jira] [Commented] (SPARK-32136) Spark producing incorrect groupBy results when key is a struct with nullable properties

[ https://issues.apache.org/jira/browse/SPARK-32136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149073#comment-17149073 ] Jason Moore commented on SPARK-32136: - Here is a similar test, and why it's a problem for what I'm

[jira] [Updated] (SPARK-32136) Spark producing incorrect groupBy results when key is a struct with nullable properties

[ https://issues.apache.org/jira/browse/SPARK-32136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Moore updated SPARK-32136: Description: I'm in the process of migrating from Spark 2.4.x to Spark 3.0.0 and I'm noticing a

[jira] [Created] (SPARK-32136) Spark producing incorrect groupBy results when key is a struct with nullable properties

Jason Moore created SPARK-32136: --- Summary: Spark producing incorrect groupBy results when key is a struct with nullable properties Key: SPARK-32136 URL: https://issues.apache.org/jira/browse/SPARK-32136

[jira] [Comment Edited] (SPARK-26027) Unable to build Spark for Scala 2.12 with Maven script provided

[ https://issues.apache.org/jira/browse/SPARK-26027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688957#comment-16688957 ] Jason Moore edited comment on SPARK-26027 at 11/16/18 3:10 AM: --- I was

[jira] [Commented] (SPARK-26027) Unable to build Spark for Scala 2.12 with Maven script provided

[ https://issues.apache.org/jira/browse/SPARK-26027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688957#comment-16688957 ] Jason Moore commented on SPARK-26027: - I was originally going to withdraw the ticket when I

[jira] [Comment Edited] (SPARK-26027) Unable to build Spark for Scala 2.12 with Maven script provided

[ https://issues.apache.org/jira/browse/SPARK-26027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684567#comment-16684567 ] Jason Moore edited comment on SPARK-26027 at 11/13/18 12:49 AM:

[jira] [Commented] (SPARK-26027) Unable to build Spark for Scala 2.12 with Maven script provided

[ https://issues.apache.org/jira/browse/SPARK-26027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684567#comment-16684567 ] Jason Moore commented on SPARK-26027: - Actually, the fact that scala-library 2.11.12 is downloaded

[jira] [Updated] (SPARK-26027) Unable to build Spark for Scala 2.12 with Maven script provided

[ https://issues.apache.org/jira/browse/SPARK-26027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Moore updated SPARK-26027: Priority: Minor (was: Major) > Unable to build Spark for Scala 2.12 with Maven script provided >

[jira] [Updated] (SPARK-26027) Unable to build Spark for Scala 2.12 with Maven script provided

[ https://issues.apache.org/jira/browse/SPARK-26027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Moore updated SPARK-26027: Description: In ./build/mvn, from pom.xml is used to determine which Scala library to fetch but

[jira] [Updated] (SPARK-26027) Unable to build Spark for Scala 2.12 with Maven script provided

[ https://issues.apache.org/jira/browse/SPARK-26027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Moore updated SPARK-26027: Description: In ./build/mvn, from pom.xml is used to determine which Scala library to fetch but

[jira] [Created] (SPARK-26027) Unable to build Spark for Scala 2.12 with Maven script provided

Jason Moore created SPARK-26027: --- Summary: Unable to build Spark for Scala 2.12 with Maven script provided Key: SPARK-26027 URL: https://issues.apache.org/jira/browse/SPARK-26027 Project: Spark

[jira] [Commented] (SPARK-20411) New features for expression.scalalang.typed

[ https://issues.apache.org/jira/browse/SPARK-20411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992517#comment-15992517 ] Jason Moore commented on SPARK-20411: - And, ideally, anything else within

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875115#comment-15875115 ] Jason Moore commented on SPARK-18105: - I've hit the same using a very recent build from branch-2.1

[jira] [Commented] (SPARK-17436) dataframe.write sometimes does not keep sorting

[ https://issues.apache.org/jira/browse/SPARK-17436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836847#comment-15836847 ] Jason Moore commented on SPARK-17436: - Ahh, I think you are correct. The issue on the write seems to

[jira] [Commented] (SPARK-17436) dataframe.write sometimes does not keep sorting

[ https://issues.apache.org/jira/browse/SPARK-17436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830889#comment-15830889 ] Jason Moore commented on SPARK-17436: - Hi [~ran.h...@optimalplus.com], [~srowen], How sure are we

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453801#comment-15453801 ] Jason Moore commented on SPARK-17195: - That's right, and I totally agree that's where the fix needs

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432314#comment-15432314 ] Jason Moore commented on SPARK-17195: - That's right. The JDBC API has ResultSetMetaData.isNullable

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432285#comment-15432285 ] Jason Moore commented on SPARK-17195: - Correct, currently Spark doesn't allow us to override what the

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432129#comment-15432129 ] Jason Moore commented on SPARK-17195: - > I think it might be sensible to support this by implementing

[jira] [Created] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

Jason Moore created SPARK-17195: --- Summary: Dealing with JDBC column nullability when it is not reliable Key: SPARK-17195 URL: https://issues.apache.org/jira/browse/SPARK-17195 Project: Spark

[jira] [Commented] (SPARK-17022) Potential deadlock in driver handling message

[ https://issues.apache.org/jira/browse/SPARK-17022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15418470#comment-15418470 ] Jason Moore commented on SPARK-17022: - This one is maybe related to SPARK-16533 and/or SPARK-16702,

[jira] [Updated] (SPARK-14915) Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job to never complete

[ https://issues.apache.org/jira/browse/SPARK-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Moore updated SPARK-14915: Affects Version/s: 2.0.0 1.5.3 > Tasks that fail due to

[jira] [Commented] (SPARK-14915) Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job to never complete

[ https://issues.apache.org/jira/browse/SPARK-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15261252#comment-15261252 ] Jason Moore commented on SPARK-14915: - That's exactly my current thinking too. But even if keep

[jira] [Commented] (SPARK-14915) Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job to never complete

[ https://issues.apache.org/jira/browse/SPARK-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259920#comment-15259920 ] Jason Moore commented on SPARK-14915: - Could I get thoughts on this: at

[jira] [Created] (SPARK-14915) Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job to never complete

Jason Moore created SPARK-14915: --- Summary: Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job to never complete Key: SPARK-14915 URL:

[jira] [Resolved] (SPARK-14357) Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-14357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Moore resolved SPARK-14357. - Resolution: Fixed Issue resolved by pull request 12228

[jira] [Updated] (SPARK-14357) Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-14357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Moore updated SPARK-14357: Component/s: Spark Core > Tasks that fail due to CommitDeniedException (a side-effect of

[jira] [Created] (SPARK-14357) Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job failure

Jason Moore created SPARK-14357: --- Summary: Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job failure Key: SPARK-14357 URL: https://issues.apache.org/jira/browse/SPARK-14357

[jira] [Created] (SPARK-8892) Column.cast(LongType) does not work for large values

Jason Moore created SPARK-8892: -- Summary: Column.cast(LongType) does not work for large values Key: SPARK-8892 URL: https://issues.apache.org/jira/browse/SPARK-8892 Project: Spark Issue Type: