[jira] [Commented] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161723#comment-17161723 ] Apache Spark commented on SPARK-32377: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161724#comment-17161724 ] Apache Spark commented on SPARK-32377: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-32362) AdaptiveQueryExecSuite misses verifying AE results

2020-07-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32362: Assignee: Lantao Jin > AdaptiveQueryExecSuite misses verifying AE results >

[jira] [Resolved] (SPARK-32362) AdaptiveQueryExecSuite misses verifying AE results

2020-07-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32362. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32365. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32365: - Assignee: jiaan.geng > Fix java.lang.IndexOutOfBoundsException: No group -1 >

[jira] [Closed] (SPARK-32360) Add MaxMinBy to support eliminate sorts

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-32360. - > Add MaxMinBy to support eliminate sorts > --- > >

[jira] [Resolved] (SPARK-32360) Add MaxMinBy to support eliminate sorts

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32360. --- Resolution: Invalid Please see the PR discussion. Since the operation is order-sensitive,

[jira] [Updated] (SPARK-32361) Remove project if output is subset of child

2020-07-20 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-32361: Summary: Remove project if output is subset of child (was: Support collapse project with case

[jira] [Updated] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32377: -- Affects Version/s: 2.1.3 > CaseInsensitiveMap should be deterministic for addition >

[jira] [Updated] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32377: -- Affects Version/s: 2.2.3 > CaseInsensitiveMap should be deterministic for addition >

[jira] [Updated] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32377: -- Description: {code} import org.apache.spark.sql.catalyst.util.CaseInsensitiveMap var m =

[jira] [Updated] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32377: -- Affects Version/s: 2.3.4 > CaseInsensitiveMap should be deterministic for addition >

[jira] [Updated] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32377: -- Description: {code} import org.apache.spark.sql.catalyst.util.CaseInsensitiveMap var m =

[jira] [Resolved] (SPARK-32338) Add overload for slice that accepts Columns or Int

2020-07-20 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-32338. --- Fix Version/s: 3.1.0 Assignee: Nikolas Vanderhoof Resolution: Fixed Issue

[jira] [Commented] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161630#comment-17161630 ] Apache Spark commented on SPARK-32377: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32377: Assignee: Apache Spark > CaseInsensitiveMap should be deterministic for addition >

[jira] [Assigned] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32377: Assignee: (was: Apache Spark) > CaseInsensitiveMap should be deterministic for

[jira] [Created] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

2020-07-20 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-32377: - Summary: CaseInsensitiveMap should be deterministic for addition Key: SPARK-32377 URL: https://issues.apache.org/jira/browse/SPARK-32377 Project: Spark

[jira] [Assigned] (SPARK-30876) Optimizer cannot infer from inferred constraints with join

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30876: Assignee: (was: Apache Spark) > Optimizer cannot infer from inferred constraints

[jira] [Assigned] (SPARK-30876) Optimizer cannot infer from inferred constraints with join

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30876: Assignee: Apache Spark > Optimizer cannot infer from inferred constraints with join >

[jira] [Commented] (SPARK-30876) Optimizer cannot infer from inferred constraints with join

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161616#comment-17161616 ] Apache Spark commented on SPARK-30876: -- User 'navinvishy' has created a pull request for this

[jira] [Updated] (SPARK-32364) `path` argument of DataFrame.load/save should override the existing options

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32364: -- Description: Although we introduced CaseInsensitiveMap and CaseInsensitiveStringMap(in

[jira] [Created] (SPARK-32376) Make unionByName null-filling behavior work with struct columns

2020-07-20 Thread Mukul Murthy (Jira)
Mukul Murthy created SPARK-32376: Summary: Make unionByName null-filling behavior work with struct columns Key: SPARK-32376 URL: https://issues.apache.org/jira/browse/SPARK-32376 Project: Spark

[jira] [Resolved] (SPARK-32368) Options in PartitioningAwareFileIndex should respect case insensitivity

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32368. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-32368) Options in PartitioningAwareFileIndex should respect case insensitivity

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32368: - Assignee: Hyukjin Kwon > Options in PartitioningAwareFileIndex should respect case

[jira] [Updated] (SPARK-32367) Fix typo of parameter in KubernetesTestComponents

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32367: -- Affects Version/s: 2.4.6 > Fix typo of parameter in KubernetesTestComponents >

[jira] [Updated] (SPARK-32367) Fix typo of parameter in KubernetesTestComponents

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32367: -- Summary: Fix typo of parameter in KubernetesTestComponents (was: Correct the spelling of

[jira] [Updated] (SPARK-32367) Fix typo of parameter in KubernetesTestComponents

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32367: -- Issue Type: Bug (was: Improvement) > Fix typo of parameter in KubernetesTestComponents >

[jira] [Assigned] (SPARK-32367) Correct the spelling of parameter in KubernetesTestComponents

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32367: - Assignee: merrily01 > Correct the spelling of parameter in KubernetesTestComponents >

[jira] [Resolved] (SPARK-32367) Correct the spelling of parameter in KubernetesTestComponents

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32367. --- Fix Version/s: 2.4.7 3.0.1 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-32357) Investigate test result reporter integration

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32357: Assignee: (was: Apache Spark) > Investigate test result reporter integration >

[jira] [Assigned] (SPARK-32357) Investigate test result reporter integration

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32357: Assignee: Apache Spark > Investigate test result reporter integration >

[jira] [Commented] (SPARK-32357) Investigate test result reporter integration

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161505#comment-17161505 ] Apache Spark commented on SPARK-32357: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32375) Implement TableCatalog for JDBC

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32375: Assignee: (was: Apache Spark) > Implement TableCatalog for JDBC >

[jira] [Commented] (SPARK-32375) Implement TableCatalog for JDBC

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161500#comment-17161500 ] Apache Spark commented on SPARK-32375: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32375) Implement TableCatalog for JDBC

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32375: Assignee: Apache Spark > Implement TableCatalog for JDBC >

[jira] [Created] (SPARK-32375) Implement TableCatalog for JDBC

2020-07-20 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32375: -- Summary: Implement TableCatalog for JDBC Key: SPARK-32375 URL: https://issues.apache.org/jira/browse/SPARK-32375 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-32374) Disallow setting properties when creating temporary views

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161478#comment-17161478 ] Apache Spark commented on SPARK-32374: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32374) Disallow setting properties when creating temporary views

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32374: Assignee: Apache Spark > Disallow setting properties when creating temporary views >

[jira] [Assigned] (SPARK-32374) Disallow setting properties when creating temporary views

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32374: Assignee: (was: Apache Spark) > Disallow setting properties when creating temporary

[jira] [Commented] (SPARK-32374) Disallow setting properties when creating temporary views

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161479#comment-17161479 ] Apache Spark commented on SPARK-32374: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32374) Disallow setting properties when creating temporary views

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32374: Assignee: Apache Spark > Disallow setting properties when creating temporary views >

[jira] [Created] (SPARK-32374) Disallow setting properties when creating temporary views

2020-07-20 Thread Terry Kim (Jira)
Terry Kim created SPARK-32374: - Summary: Disallow setting properties when creating temporary views Key: SPARK-32374 URL: https://issues.apache.org/jira/browse/SPARK-32374 Project: Spark Issue

[jira] [Created] (SPARK-32373) Spark Standalone - RetryingBlockFetcher tries to get block from worker even 10mins after it was de-registered from spark cluster

2020-07-20 Thread t oo (Jira)
t oo created SPARK-32373: Summary: Spark Standalone - RetryingBlockFetcher tries to get block from worker even 10mins after it was de-registered from spark cluster Key: SPARK-32373 URL:

[jira] [Commented] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161334#comment-17161334 ] Apache Spark commented on SPARK-32372: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32372: Assignee: (was: Apache Spark) > "Resolved attribute(s) XXX missing" after dudup

[jira] [Assigned] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32372: Assignee: Apache Spark > "Resolved attribute(s) XXX missing" after dudup conflict

[jira] [Commented] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161333#comment-17161333 ] Apache Spark commented on SPARK-32372: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Created] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-20 Thread wuyi (Jira)
wuyi created SPARK-32372: Summary: "Resolved attribute(s) XXX missing" after dudup conflict references Key: SPARK-32372 URL: https://issues.apache.org/jira/browse/SPARK-32372 Project: Spark Issue

[jira] [Assigned] (SPARK-32330) Preserve shuffled hash join build side partitioning

2020-07-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32330: --- Assignee: Cheng Su > Preserve shuffled hash join build side partitioning >

[jira] [Resolved] (SPARK-32330) Preserve shuffled hash join build side partitioning

2020-07-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32330. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29130

[jira] [Resolved] (SPARK-31869) BroadcastHashJoinExe's outputPartitioning can utilize the build side

2020-07-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31869. - Fix Version/s: 3.1.0 Assignee: Terry Kim Resolution: Fixed >

[jira] [Resolved] (SPARK-32302) Partially push down disjunctive predicates through Join/Partitions

2020-07-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32302. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29101

[jira] [Resolved] (SPARK-32324) Fix error messages during using PIVOT and lateral view

2020-07-20 Thread philipse (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] philipse resolved SPARK-32324. -- Resolution: Not A Problem > Fix error messages during using PIVOT and lateral view >

[jira] [Created] (SPARK-32371) Autodetect persistently failing executor pods and fail the application logging the cause.

2020-07-20 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-32371: --- Summary: Autodetect persistently failing executor pods and fail the application logging the cause. Key: SPARK-32371 URL: https://issues.apache.org/jira/browse/SPARK-32371

[jira] [Updated] (SPARK-32370) pyspark foreach/foreachPartition send http request failed

2020-07-20 Thread Tao Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Liu updated SPARK-32370: Environment: spark 3.0 python3.7 macos 10.15 > pyspark foreach/foreachPartition send http request

[jira] [Created] (SPARK-32370) pyspark foreach/foreachPartition send http request failed

2020-07-20 Thread Tao Liu (Jira)
Tao Liu created SPARK-32370: --- Summary: pyspark foreach/foreachPartition send http request failed Key: SPARK-32370 URL: https://issues.apache.org/jira/browse/SPARK-32370 Project: Spark Issue Type:

[jira] [Created] (SPARK-32369) pyspark foreach/foreachPartition send http request failed

2020-07-20 Thread Tao Liu (Jira)
Tao Liu created SPARK-32369: --- Summary: pyspark foreach/foreachPartition send http request failed Key: SPARK-32369 URL: https://issues.apache.org/jira/browse/SPARK-32369 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-32366) Fix doc link of datetime pattern in 3.0 migration guide

2020-07-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32366. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-32368) Options in PartitioningAwareFileIndex should respect case insensitivity

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32368: Assignee: Apache Spark > Options in PartitioningAwareFileIndex should respect case

[jira] [Assigned] (SPARK-32368) Options in PartitioningAwareFileIndex should respect case insensitivity

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32368: Assignee: (was: Apache Spark) > Options in PartitioningAwareFileIndex should respect

[jira] [Commented] (SPARK-32368) Options in PartitioningAwareFileIndex should respect case insensitivity

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161173#comment-17161173 ] Apache Spark commented on SPARK-32368: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-32368) Options in PartitioningAwareFileIndex should respect case insensitivity

2020-07-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32368: Summary: Options in PartitioningAwareFileIndex should respect case insensitivity Key: SPARK-32368 URL: https://issues.apache.org/jira/browse/SPARK-32368 Project:

[jira] [Commented] (SPARK-32240) UDF parse_url with a URL that contains pipe(|) will give incorrect result

2020-07-20 Thread Stanislav (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1716#comment-1716 ] Stanislav commented on SPARK-32240: --- I think the problem is that pipe is not a valid URL symbol.

[jira] [Commented] (SPARK-32367) Correct the spelling of parameter in KubernetesTestComponents

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161057#comment-17161057 ] Apache Spark commented on SPARK-32367: -- User 'merrily01' has created a pull request for this issue:

[jira] [Commented] (SPARK-32367) Correct the spelling of parameter in KubernetesTestComponents

2020-07-20 Thread merrily01 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161056#comment-17161056 ] merrily01 commented on SPARK-32367: --- [https://github.com/apache/spark/pull/29164/files] > Correct the

[jira] [Commented] (SPARK-32367) Correct the spelling of parameter in KubernetesTestComponents

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161059#comment-17161059 ] Apache Spark commented on SPARK-32367: -- User 'merrily01' has created a pull request for this issue:

[jira] [Resolved] (SPARK-32358) temp view not working after upgrading from 2.3.3 to 2.4.5

2020-07-20 Thread philipse (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] philipse resolved SPARK-32358. -- Resolution: Won't Fix > temp view not working after upgrading from 2.3.3 to 2.4.5 >

[jira] [Resolved] (SPARK-32358) temp view not working after upgrading from 2.3.3 to 2.4.5

2020-07-20 Thread philipse (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] philipse resolved SPARK-32358. -- Resolution: Fixed > temp view not working after upgrading from 2.3.3 to 2.4.5 >

[jira] [Reopened] (SPARK-32358) temp view not working after upgrading from 2.3.3 to 2.4.5

2020-07-20 Thread philipse (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] philipse reopened SPARK-32358: -- > temp view not working after upgrading from 2.3.3 to 2.4.5 >

[jira] [Assigned] (SPARK-32367) Correct the spelling of parameter in KubernetesTestComponents

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32367: Assignee: Apache Spark > Correct the spelling of parameter in KubernetesTestComponents >

[jira] [Assigned] (SPARK-32367) Correct the spelling of parameter in KubernetesTestComponents

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32367: Assignee: (was: Apache Spark) > Correct the spelling of parameter in

[jira] [Reopened] (SPARK-32367) Correct the spelling of parameter in KubernetesTestComponents

2020-07-20 Thread merrily01 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] merrily01 reopened SPARK-32367: --- > Correct the spelling of parameter in KubernetesTestComponents >

[jira] [Commented] (SPARK-32367) Correct the spelling of parameter in KubernetesTestComponents

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161038#comment-17161038 ] Apache Spark commented on SPARK-32367: -- User 'merrily01' has created a pull request for this issue:

[jira] [Commented] (SPARK-32367) Correct the spelling of parameter in KubernetesTestComponents

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161037#comment-17161037 ] Apache Spark commented on SPARK-32367: -- User 'merrily01' has created a pull request for this issue:

[jira] [Resolved] (SPARK-32367) Correct the spelling of parameter in KubernetesTestComponents

2020-07-20 Thread merrily01 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] merrily01 resolved SPARK-32367. --- Resolution: Works for Me > Correct the spelling of parameter in KubernetesTestComponents >

[jira] [Created] (SPARK-32367) Correct the spelling of parameter in KubernetesTestComponents

2020-07-20 Thread merrily01 (Jira)
merrily01 created SPARK-32367: - Summary: Correct the spelling of parameter in KubernetesTestComponents Key: SPARK-32367 URL: https://issues.apache.org/jira/browse/SPARK-32367 Project: Spark

[jira] [Commented] (SPARK-32366) Fix doc link of datetime pattern in 3.0 migration guide

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161029#comment-17161029 ] Apache Spark commented on SPARK-32366: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-32366) Fix doc link of datetime pattern in 3.0 migration guide

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32366: Assignee: Apache Spark (was: Gengliang Wang) > Fix doc link of datetime pattern in 3.0

[jira] [Assigned] (SPARK-32366) Fix doc link of datetime pattern in 3.0 migration guide

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32366: Assignee: Gengliang Wang (was: Apache Spark) > Fix doc link of datetime pattern in 3.0

[jira] [Commented] (SPARK-32366) Fix doc link of datetime pattern in 3.0 migration guide

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161028#comment-17161028 ] Apache Spark commented on SPARK-32366: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-32366) Fix doc link of datetime pattern in 3.0 migration guide

2020-07-20 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-32366: -- Summary: Fix doc link of datetime pattern in 3.0 migration guide Key: SPARK-32366 URL: https://issues.apache.org/jira/browse/SPARK-32366 Project: Spark

[jira] [Updated] (SPARK-32364) `path` argument of DataFrame.load/save should override the existing options

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32364: -- Description: Although we introduced CaseInsensitiveMap and CaseInsensitiveStringMap(in

[jira] [Updated] (SPARK-32364) `path` argument of DataFrame.load/save should override the existing options

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32364: -- Description: {code} spark.read .option("paTh", "1") .option("PATH", "2")

[jira] [Updated] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32344: -- Fix Version/s: 2.4.7 > Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct

[jira] [Assigned] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32365: Assignee: (was: Apache Spark) > Fix java.lang.IndexOutOfBoundsException: No group -1

[jira] [Commented] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160942#comment-17160942 ] Apache Spark commented on SPARK-32365: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32365: Assignee: Apache Spark > Fix java.lang.IndexOutOfBoundsException: No group -1 >

[jira] [Updated] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32365: --- Description: The current implement of regexp_extract will throws a unprocessed exception show

[jira] [Updated] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32365: --- Description: The current implement of regexp_extract will throws a unprocessed exception show

[jira] [Created] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-20 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-32365: -- Summary: Fix java.lang.IndexOutOfBoundsException: No group -1 Key: SPARK-32365 URL: https://issues.apache.org/jira/browse/SPARK-32365 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32344: -- Affects Version/s: 2.2.3 > Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct

[jira] [Updated] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32344: -- Affects Version/s: 2.3.4 > Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct

[jira] [Updated] (SPARK-32364) `path` argument of DataFrame.load/save should override the existing options

2020-07-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32364: -- Description: {code} spark.read .option("paTh", "1") .option("PATH", "2")

[jira] [Assigned] (SPARK-32364) `path` argument of DataFrame.load/save should override the existing options

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32364: Assignee: Apache Spark > `path` argument of DataFrame.load/save should override the

[jira] [Commented] (SPARK-32364) `path` argument of DataFrame.load/save should override the existing options

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160924#comment-17160924 ] Apache Spark commented on SPARK-32364: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-32364) `path` argument of DataFrame.load/save should override the existing options

2020-07-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32364: Assignee: (was: Apache Spark) > `path` argument of DataFrame.load/save should