[jira] [Updated] (SPARK-45094) isEmpty on union of RDDs sharing the same trait crash when the first RDD is empty

2023-09-06 Thread Jean-Francis Roy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Francis Roy updated SPARK-45094: - Environment: Tested on Spark 3.2.1 and Spark 3.4.0, using Scala 2.12.17 and OpenJDK

[jira] [Created] (SPARK-45094) isEmpty on union of RDDs sharing the same trait crash when the first RDD is empty

2023-09-06 Thread Jean-Francis Roy (Jira)
Jean-Francis Roy created SPARK-45094: Summary: isEmpty on union of RDDs sharing the same trait crash when the first RDD is empty Key: SPARK-45094 URL: https://issues.apache.org/jira/browse/SPARK-45094

[jira] [Comment Edited] (SPARK-34441) from_json documentation is wrong about malformed JSONs output

2021-02-16 Thread Jean-Francis Roy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285618#comment-17285618 ] Jean-Francis Roy edited comment on SPARK-34441 at 2/17/21, 3:17 AM:

[jira] [Commented] (SPARK-34441) from_json documentation is wrong about malformed JSONs output

2021-02-16 Thread Jean-Francis Roy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285618#comment-17285618 ] Jean-Francis Roy commented on SPARK-34441: -- [~hyukjin.kwon] of course, here is an example :  

[jira] [Commented] (SPARK-34441) from_json documentation is wrong about malformed JSONs output

2021-02-15 Thread Jean-Francis Roy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284955#comment-17284955 ] Jean-Francis Roy commented on SPARK-34441: -- It even seems we cannot reproduce the previous

[jira] [Commented] (SPARK-25243) Use FailureSafeParser in from_json

2021-02-15 Thread Jean-Francis Roy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284954#comment-17284954 ] Jean-Francis Roy commented on SPARK-25243: -- ``` from_json() doesn't support the DROPMALFORMED

[jira] [Comment Edited] (SPARK-25243) Use FailureSafeParser in from_json

2021-02-15 Thread Jean-Francis Roy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284954#comment-17284954 ] Jean-Francis Roy edited comment on SPARK-25243 at 2/15/21, 9:25 PM:

[jira] [Comment Edited] (SPARK-25243) Use FailureSafeParser in from_json

2021-02-15 Thread Jean-Francis Roy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284954#comment-17284954 ] Jean-Francis Roy edited comment on SPARK-25243 at 2/15/21, 9:25 PM:

[jira] [Created] (SPARK-34441) from_json documentation is wrong about malformed JSONs output

2021-02-15 Thread Jean-Francis Roy (Jira)
Jean-Francis Roy created SPARK-34441: Summary: from_json documentation is wrong about malformed JSONs output Key: SPARK-34441 URL: https://issues.apache.org/jira/browse/SPARK-34441 Project: Spark

[jira] [Commented] (SPARK-25243) Use FailureSafeParser in from_json

2021-02-15 Thread Jean-Francis Roy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284951#comment-17284951 ] Jean-Francis Roy commented on SPARK-25243: -- The documentation still states that `from_json`

[jira] [Resolved] (SPARK-24018) Spark-without-hadoop package fails to create or read parquet files with snappy compression

2018-12-10 Thread Jean-Francis Roy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Francis Roy resolved SPARK-24018. -- Resolution: Fixed Fix Version/s: 2.3.2 I confirm the fix that appeared in

[jira] [Commented] (SPARK-24018) Spark-without-hadoop package fails to create or read parquet files with snappy compression

2018-07-09 Thread Jean-Francis Roy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16537815#comment-16537815 ] Jean-Francis Roy commented on SPARK-24018: -- Oh, indeed you are right! I was mistaken when I

[jira] [Commented] (SPARK-24018) Spark-without-hadoop package fails to create or read parquet files with snappy compression

2018-07-07 Thread Jean-Francis Roy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535854#comment-16535854 ] Jean-Francis Roy commented on SPARK-24018: -- I don't think this is only related to the Spark

[jira] [Updated] (SPARK-24018) Spark-without-hadoop package fails to create or read parquet files with snappy compression

2018-04-18 Thread Jean-Francis Roy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Francis Roy updated SPARK-24018: - Description: On a brand-new installation of Spark 2.3.0 with a user-provided

[jira] [Created] (SPARK-24018) Spark-without-hadoop package fails to create or read parquet files with snappy compression

2018-04-18 Thread Jean-Francis Roy (JIRA)
Jean-Francis Roy created SPARK-24018: Summary: Spark-without-hadoop package fails to create or read parquet files with snappy compression Key: SPARK-24018 URL: