[jira] [Updated] (SPARK-28103) Cannot infer filters from union table with empty local relation table properly

2019-06-18 Thread William Wong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Wong updated SPARK-28103: - Description: Basically, the constraints of a union table could be turned empty if any subtable

[jira] [Resolved] (SPARK-27890) Improve SQL parser error message when missing backquotes for identifiers with hyphens

2019-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27890. - Resolution: Fixed Fix Version/s: 3.0.0 > Improve SQL parser error message when missing

[jira] [Assigned] (SPARK-27890) Improve SQL parser error message when missing backquotes for identifiers with hyphens

2019-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-27890: --- Assignee: Yesheng Ma > Improve SQL parser error message when missing backquotes for identifiers

[jira] [Updated] (SPARK-28103) Cannot infer filters from union table with empty local relation table properly

2019-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28103: Target Version/s: 3.0.0 > Cannot infer filters from union table with empty local relation table properly

[jira] [Resolved] (SPARK-28096) Lazy val performance pitfall in Spark SQL LogicalPlans

2019-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28096. - Resolution: Fixed Assignee: Yesheng Ma Fix Version/s: 3.0.0 > Lazy val performance

[jira] [Updated] (SPARK-28103) Cannot infer filters from union table with empty local relation table properly

2019-06-18 Thread William Wong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Wong updated SPARK-28103: - Description: Basically, the constraints of a union table could be turned empty if any subtable

[jira] [Created] (SPARK-28103) Cannot infer filters from union table with empty local relation table properly

2019-06-18 Thread William Wong (JIRA)
William Wong created SPARK-28103: Summary: Cannot infer filters from union table with empty local relation table properly Key: SPARK-28103 URL: https://issues.apache.org/jira/browse/SPARK-28103

[jira] [Resolved] (SPARK-27105) Prevent exponential complexity in ORC `createFilter`

2019-06-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27105. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24068

[jira] [Assigned] (SPARK-27105) Prevent exponential complexity in ORC `createFilter`

2019-06-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27105: --- Assignee: Ivan Vergiliev > Prevent exponential complexity in ORC `createFilter` >

[jira] [Assigned] (SPARK-28102) Add configuration for selecting LZ4 implementation (safe, unsafe, JNI)

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28102: Assignee: Josh Rosen (was: Apache Spark) > Add configuration for selecting LZ4

[jira] [Assigned] (SPARK-28102) Add configuration for selecting LZ4 implementation (safe, unsafe, JNI)

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28102: Assignee: Apache Spark (was: Josh Rosen) > Add configuration for selecting LZ4

[jira] [Created] (SPARK-28102) Add configuration for selecting LZ4 implementation (safe, unsafe, JNI)

2019-06-18 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-28102: -- Summary: Add configuration for selecting LZ4 implementation (safe, unsafe, JNI) Key: SPARK-28102 URL: https://issues.apache.org/jira/browse/SPARK-28102 Project: Spark

[jira] [Assigned] (SPARK-28075) String Functions: Enhance TRIM function

2019-06-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28075: --- Assignee: Yuming Wang > String Functions: Enhance TRIM function >

[jira] [Resolved] (SPARK-28075) String Functions: Enhance TRIM function

2019-06-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28075. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24891

[jira] [Resolved] (SPARK-27716) Complete the transactions support for part of jdbc datasource operations.

2019-06-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27716. --- Resolution: Won't Fix > Complete the transactions support for part of jdbc datasource operations. >

[jira] [Updated] (SPARK-28085) Spark Scala API documentation URLs not working properly in Chrome

2019-06-18 Thread Andrew Leverentz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Leverentz updated SPARK-28085: - Description: In Chrome version 75, URLs in the Scala API documentation are not working

[jira] [Resolved] (SPARK-28081) word2vec 'large' count value too low for very large corpora

2019-06-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28081. --- Resolution: Fixed Fix Version/s: 2.4.4 2.3.4 3.0.0

[jira] [Resolved] (SPARK-27823) Add an abstraction layer for accelerator resource handling to avoid manipulating raw confs

2019-06-18 Thread Xingbo Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-27823. -- Resolution: Fixed > Add an abstraction layer for accelerator resource handling to avoid >

[jira] [Updated] (SPARK-28101) Fix Flaky Test: `InputStreamsSuite.Modified files are correctly detected` in JDK9+

2019-06-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28101: -- Summary: Fix Flaky Test: `InputStreamsSuite.Modified files are correctly detected` in JDK9+

[jira] [Assigned] (SPARK-28101) Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected` in JDK9+

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28101: Assignee: (was: Apache Spark) > Fix Flaky Test: `InputStreamsSuit.Modified files are

[jira] [Assigned] (SPARK-28101) Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected` in JDK9+

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28101: Assignee: Apache Spark > Fix Flaky Test: `InputStreamsSuit.Modified files are correctly

[jira] [Commented] (SPARK-27815) do not leak SaveMode to file source v2

2019-06-18 Thread Tony Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867136#comment-16867136 ] Tony Zhang commented on SPARK-27815: [~cloud_fan] Hi Wenchen, do you think it is viable solution

[jira] [Updated] (SPARK-28101) Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected` in JDK9+

2019-06-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28101: -- Description: !error.png|height=250,width=250! {code} $ build/sbt "streaming/testOnly

[jira] [Updated] (SPARK-28101) Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected` in JDK9+

2019-06-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28101: -- Description: !error.png|width=100%! {code} $ build/sbt "streaming/testOnly

[jira] [Updated] (SPARK-28101) Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected` in JDK9+

2019-06-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28101: -- Attachment: error.png > Fix Flaky Test: `InputStreamsSuit.Modified files are correctly

[jira] [Updated] (SPARK-28101) Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected` in JDK9+

2019-06-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28101: -- Description: !error.png! {code} $ build/sbt "streaming/testOnly *.InputStreamsSuite"

[jira] [Updated] (SPARK-28101) Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected` in JDK9+

2019-06-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28101: -- Summary: Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected` in JDK9+

[jira] [Updated] (SPARK-28101) Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected` in JDK9+

2019-06-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28101: -- Attachment: (was: Screen Shot 2019-06-18 at 4.41.11 PM.png) > Fix Flaky Test:

[jira] [Created] (SPARK-28101) Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected`

2019-06-18 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28101: - Summary: Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected` Key: SPARK-28101 URL: https://issues.apache.org/jira/browse/SPARK-28101 Project:

[jira] [Updated] (SPARK-28101) Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected` in JDK9+

2019-06-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28101: -- Attachment: Screen Shot 2019-06-18 at 4.41.11 PM.png > Fix Flaky Test:

[jira] [Resolved] (SPARK-28039) Add float4.sql

2019-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28039. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Add float4.sql >

[jira] [Assigned] (SPARK-28088) String Functions: Enhance LPAD/RPAD function

2019-06-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28088: - Assignee: Yuming Wang > String Functions: Enhance LPAD/RPAD function >

[jira] [Resolved] (SPARK-28088) String Functions: Enhance LPAD/RPAD function

2019-06-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28088. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24899

[jira] [Updated] (SPARK-24936) Better error message when trying a shuffle fetch over 2 GB

2019-06-18 Thread Eric Maynard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Maynard updated SPARK-24936: - Description: *strong text*After SPARK-24297, spark will try to fetch shuffle blocks to disk if

[jira] [Comment Edited] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2019-06-18 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866973#comment-16866973 ] M. Le Bihan edited comment on SPARK-18105 at 6/18/19 8:45 PM: -- My trick

[jira] [Updated] (SPARK-24936) Better error message when trying a shuffle fetch over 2 GB

2019-06-18 Thread Eric Maynard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Maynard updated SPARK-24936: - Description: After SPARK-24297, spark will try to fetch shuffle blocks to disk if their over

[jira] [Created] (SPARK-28100) Unable to override JDBC types for ByteType when providing a custom JdbcDialect for Postgres

2019-06-18 Thread Seth Fitzsimmons (JIRA)
Seth Fitzsimmons created SPARK-28100: Summary: Unable to override JDBC types for ByteType when providing a custom JdbcDialect for Postgres Key: SPARK-28100 URL:

[jira] [Created] (SPARK-28099) Assertion when querying unpartitioned Hive table with partition-like naming

2019-06-18 Thread Douglas Drinka (JIRA)
Douglas Drinka created SPARK-28099: -- Summary: Assertion when querying unpartitioned Hive table with partition-like naming Key: SPARK-28099 URL: https://issues.apache.org/jira/browse/SPARK-28099

[jira] [Updated] (SPARK-28096) Lazy val performance pitfall in Spark SQL LogicalPlans

2019-06-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28096: -- Issue Type: Improvement (was: Bug) > Lazy val performance pitfall in Spark SQL LogicalPlans

[jira] [Created] (SPARK-28098) Native ORC reader doesn't support subdirectories with Hive tables

2019-06-18 Thread Douglas Drinka (JIRA)
Douglas Drinka created SPARK-28098: -- Summary: Native ORC reader doesn't support subdirectories with Hive tables Key: SPARK-28098 URL: https://issues.apache.org/jira/browse/SPARK-28098 Project: Spark

[jira] [Assigned] (SPARK-28097) Map ByteType to SMALLINT when using JDBC with PostgreSQL

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28097: Assignee: Apache Spark > Map ByteType to SMALLINT when using JDBC with PostgreSQL >

[jira] [Assigned] (SPARK-28097) Map ByteType to SMALLINT when using JDBC with PostgreSQL

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28097: Assignee: (was: Apache Spark) > Map ByteType to SMALLINT when using JDBC with

[jira] [Commented] (SPARK-28097) Map ByteType to SMALLINT when using JDBC with PostgreSQL

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867004#comment-16867004 ] Apache Spark commented on SPARK-28097: -- User 'mojodna' has created a pull request for this issue:

[jira] [Created] (SPARK-28097) Map ByteType to SMALLINT when using JDBC with PostgreSQL

2019-06-18 Thread Seth Fitzsimmons (JIRA)
Seth Fitzsimmons created SPARK-28097: Summary: Map ByteType to SMALLINT when using JDBC with PostgreSQL Key: SPARK-28097 URL: https://issues.apache.org/jira/browse/SPARK-28097 Project: Spark

[jira] [Commented] (SPARK-28096) Lazy val performance pitfall in Spark SQL LogicalPlans

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866995#comment-16866995 ] Apache Spark commented on SPARK-28096: -- User 'yeshengm' has created a pull request for this issue:

[jira] [Assigned] (SPARK-28096) Lazy val performance pitfall in Spark SQL LogicalPlans

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28096: Assignee: (was: Apache Spark) > Lazy val performance pitfall in Spark SQL

[jira] [Assigned] (SPARK-28096) Lazy val performance pitfall in Spark SQL LogicalPlans

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28096: Assignee: Apache Spark > Lazy val performance pitfall in Spark SQL LogicalPlans >

[jira] [Updated] (SPARK-28096) Lazy val performance pitfall in Spark SQL LogicalPlans

2019-06-18 Thread Yesheng Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesheng Ma updated SPARK-28096: --- Summary: Lazy val performance pitfall in Spark SQL LogicalPlans (was: Performance pitfall in Spark

[jira] [Created] (SPARK-28096) Performance pitfall in Spark SQL LogicalPlans

2019-06-18 Thread Yesheng Ma (JIRA)
Yesheng Ma created SPARK-28096: -- Summary: Performance pitfall in Spark SQL LogicalPlans Key: SPARK-28096 URL: https://issues.apache.org/jira/browse/SPARK-28096 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-28095) Pyspark with kubernetes doesn't parse arguments with spaces as expected.

2019-06-18 Thread Emma Dickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emma Dickson updated SPARK-28095: - Description: When passing in arguments to a bash script that sets up spark submit using a

[jira] [Resolved] (SPARK-27783) Add customizable hint error handler

2019-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27783. - Resolution: Fixed Assignee: Maryann Xue Fix Version/s: 3.0.0 > Add customizable hint

[jira] [Updated] (SPARK-28095) Pyspark with kubernetes doesn't parse arguments with spaces as expected.

2019-06-18 Thread Emma Dickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emma Dickson updated SPARK-28095: - Description: When passing in arguments to a bash script that sets up spark submit using a

[jira] [Updated] (SPARK-28095) Pyspark with kubernetes doesn't parse arguments with spaces as expected.

2019-06-18 Thread Emma Dickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emma Dickson updated SPARK-28095: - Description: When passing in arguments to a bash script that sets up spark submit using a

[jira] [Updated] (SPARK-28095) Pyspark with kubernetes doesn't parse arguments with spaces as expected.

2019-06-18 Thread Emma Dickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emma Dickson updated SPARK-28095: - Summary: Pyspark with kubernetes doesn't parse arguments with spaces as expected. (was:

[jira] [Created] (SPARK-28095) Pyspark on kubernetes doesn't parse arguments with spaces as expected.

2019-06-18 Thread Emma Dickson (JIRA)
Emma Dickson created SPARK-28095: Summary: Pyspark on kubernetes doesn't parse arguments with spaces as expected. Key: SPARK-28095 URL: https://issues.apache.org/jira/browse/SPARK-28095 Project:

[jira] [Comment Edited] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2019-06-18 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866973#comment-16866973 ] M. Le Bihan edited comment on SPARK-18105 at 6/18/19 7:10 PM: -- My trick

[jira] [Commented] (SPARK-28092) Spark cannot load files with COLON(:) char if not specified full path

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866978#comment-16866978 ] Steve Loughran commented on SPARK-28092: BTW, code snippets say ("s3://bucket/prefix/*",; I

[jira] [Commented] (SPARK-28092) Spark cannot load files with COLON(:) char if not specified full path

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866977#comment-16866977 ] Steve Loughran commented on SPARK-28092: You're going to have to see if you can replicate this

[jira] [Comment Edited] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2019-06-18 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866973#comment-16866973 ] M. Le Bihan edited comment on SPARK-18105 at 6/18/19 7:06 PM: -- My trick

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2019-06-18 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866973#comment-16866973 ] M. Le Bihan commented on SPARK-18105: - My trick eventually didn't succeed. And I fall back into the

[jira] [Assigned] (SPARK-28084) LOAD DATA command resolving the partition column name considering case senstive manner

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28084: Assignee: (was: Apache Spark) > LOAD DATA command resolving the partition column

[jira] [Assigned] (SPARK-28084) LOAD DATA command resolving the partition column name considering case senstive manner

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28084: Assignee: Apache Spark > LOAD DATA command resolving the partition column name

[jira] [Comment Edited] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2019-06-18 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861803#comment-16861803 ] M. Le Bihan edited comment on SPARK-18105 at 6/18/19 4:37 PM: -- It _seems_

[jira] [Commented] (SPARK-28079) CSV fails to detect corrupt record unless "columnNameOfCorruptRecord" is manually added to the schema

2019-06-18 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866777#comment-16866777 ] Liang-Chi Hsieh commented on SPARK-28079: - Isn't it the expected behavior as documented in

[jira] [Created] (SPARK-28094) Multiple left joins or aggregations in one query produce incorrect results

2019-06-18 Thread Joe Ammann (JIRA)
Joe Ammann created SPARK-28094: -- Summary: Multiple left joins or aggregations in one query produce incorrect results Key: SPARK-28094 URL: https://issues.apache.org/jira/browse/SPARK-28094 Project:

[jira] [Updated] (SPARK-28093) Built-in function trim/ltrim/rtrim has bug when using trimStr

2019-06-18 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28093: Affects Version/s: (was: 2.4.3) 2.3.3 > Built-in function

[jira] [Updated] (SPARK-28093) Built-in function trim/ltrim/rtrim has bug when using trimStr

2019-06-18 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28093: Affects Version/s: (was: 3.0.0) 2.4.3 > Built-in function

[jira] [Assigned] (SPARK-28093) Built-in function trim/ltrim/rtrim has bug when using trimStr

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28093: Assignee: Apache Spark > Built-in function trim/ltrim/rtrim has bug when using trimStr >

[jira] [Assigned] (SPARK-28093) Built-in function trim/ltrim/rtrim has bug when using trimStr

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28093: Assignee: (was: Apache Spark) > Built-in function trim/ltrim/rtrim has bug when

[jira] [Created] (SPARK-28093) Built-in function trim/ltrim/rtrim has bug when using trimStr

2019-06-18 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28093: --- Summary: Built-in function trim/ltrim/rtrim has bug when using trimStr Key: SPARK-28093 URL: https://issues.apache.org/jira/browse/SPARK-28093 Project: Spark

[jira] [Commented] (SPARK-28077) ANSI SQL: OVERLAY function(T312)

2019-06-18 Thread jiaan.geng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866351#comment-16866351 ] jiaan.geng commented on SPARK-28077: I'm working on. > ANSI SQL: OVERLAY function(T312) >

[jira] [Commented] (SPARK-28073) ANSI SQL: Character literals

2019-06-18 Thread jiaan.geng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866344#comment-16866344 ] jiaan.geng commented on SPARK-28073: I'm working on. > ANSI SQL: Character literals >

[jira] [Updated] (SPARK-28077) ANSI SQL: OVERLAY function(T312)

2019-06-18 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28077: Summary: ANSI SQL: OVERLAY function(T312) (was: String Functions: Add support OVERLAY) > ANSI

[jira] [Comment Edited] (SPARK-28091) Extend Spark metrics system with executor plugin metrics

2019-06-18 Thread Luca Canali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866336#comment-16866336 ] Luca Canali edited comment on SPARK-28091 at 6/18/19 8:07 AM: -- [~irashid]

[jira] [Commented] (SPARK-28091) Extend Spark metrics system with executor plugin metrics

2019-06-18 Thread Luca Canali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866336#comment-16866336 ] Luca Canali commented on SPARK-28091: - @irashid given your work on SPARK-24918 you may be interested

[jira] [Created] (SPARK-28092) Spark cannot load files with COLON(:) char if not specified full path

2019-06-18 Thread Ladislav Jech (JIRA)
Ladislav Jech created SPARK-28092: - Summary: Spark cannot load files with COLON(:) char if not specified full path Key: SPARK-28092 URL: https://issues.apache.org/jira/browse/SPARK-28092 Project:

[jira] [Assigned] (SPARK-28091) Extend Spark metrics system with executor plugin metrics

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28091: Assignee: (was: Apache Spark) > Extend Spark metrics system with executor plugin

[jira] [Assigned] (SPARK-28091) Extend Spark metrics system with executor plugin metrics

2019-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28091: Assignee: Apache Spark > Extend Spark metrics system with executor plugin metrics >

[jira] [Comment Edited] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2019-06-18 Thread Piotr Chowaniec (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856558#comment-16856558 ] Piotr Chowaniec edited comment on SPARK-18105 at 6/18/19 7:21 AM: -- I

[jira] [Created] (SPARK-28091) Extend Spark metrics system with executor plugin metrics

2019-06-18 Thread Luca Canali (JIRA)
Luca Canali created SPARK-28091: --- Summary: Extend Spark metrics system with executor plugin metrics Key: SPARK-28091 URL: https://issues.apache.org/jira/browse/SPARK-28091 Project: Spark Issue

[jira] [Resolved] (SPARK-28072) Fix IncompatibleClassChangeError in `FromUnixTime` codegen on JDK9+

2019-06-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28072. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 3.0.0 This is

[jira] [Updated] (SPARK-28090) Spark hangs when an execution plan has many projections on nested structs

2019-06-18 Thread Ruslan Yushchenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Yushchenko updated SPARK-28090: -- Description: This was already posted (#28016), but the provided example didn't always

[jira] [Created] (SPARK-28090) Spark hangs when an execution plan has many projections on nested structs

2019-06-18 Thread Ruslan Yushchenko (JIRA)
Ruslan Yushchenko created SPARK-28090: - Summary: Spark hangs when an execution plan has many projections on nested structs Key: SPARK-28090 URL: https://issues.apache.org/jira/browse/SPARK-28090

[jira] [Updated] (SPARK-28088) String Functions: Enhance LPAD/RPAD function

2019-06-18 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28088: Description: Enhance LPAD/RPAD function to make {{pad}} parameter optional. > String Functions: