[jira] [Updated] (SPARK-34607) NewInstance.resolved should not throw malformed class name error

2021-03-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34607: -- Fix Version/s: 3.0.3 > NewInstance.resolved should not throw malformed class name error >

[jira] [Updated] (SPARK-34607) NewInstance.resolved should not throw malformed class name error

2021-03-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34607: -- Fix Version/s: 3.1.2 > NewInstance.resolved should not throw malformed class name error >

[jira] [Commented] (SPARK-34683) Update the documents to explain the usage of LIST FILE and LIST JAR in case they take multiple file names

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298586#comment-17298586 ] Apache Spark commented on SPARK-34683: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-34683) Update the documents to explain the usage of LIST FILE and LIST JAR in case they take multiple file names

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298585#comment-17298585 ] Apache Spark commented on SPARK-34683: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34683) Update the documents to explain the usage of LIST FILE and LIST JAR in case they take multiple file names

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34683: Assignee: Kousuke Saruta (was: Apache Spark) > Update the documents to explain the

[jira] [Assigned] (SPARK-34683) Update the documents to explain the usage of LIST FILE and LIST JAR in case they take multiple file names

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34683: Assignee: Apache Spark (was: Kousuke Saruta) > Update the documents to explain the

[jira] [Commented] (SPARK-34683) Update the documents to explain the usage of LIST FILE and LIST JAR in case they take multiple file names

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298581#comment-17298581 ] Apache Spark commented on SPARK-34683: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-34683) Update the documents to explain the usage of LIST FILE and LIST JAR in case they take multiple file names

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298582#comment-17298582 ] Apache Spark commented on SPARK-34683: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-34684) Hadoop config could not be successfully serilized from driver pods to executor pods

2021-03-09 Thread Yue Peng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Peng updated SPARK-34684: - Affects Version/s: 3.0.2 > Hadoop config could not be successfully serilized from driver pods to >

[jira] [Created] (SPARK-34684) Hadoop config could not be successfully serilized from driver pods to executor pods

2021-03-09 Thread Yue Peng (Jira)
Yue Peng created SPARK-34684: Summary: Hadoop config could not be successfully serilized from driver pods to executor pods Key: SPARK-34684 URL: https://issues.apache.org/jira/browse/SPARK-34684 Project:

[jira] [Created] (SPARK-34683) Update the documents to explain the usage of LIST FILE and LIST JAR in case they take multiple file names

2021-03-09 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34683: -- Summary: Update the documents to explain the usage of LIST FILE and LIST JAR in case they take multiple file names Key: SPARK-34683 URL:

[jira] [Resolved] (SPARK-34681) Full outer shuffled hash join when building left side produces wrong result

2021-03-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34681. --- Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-34681) Full outer shuffled hash join when building left side produces wrong result

2021-03-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34681: - Assignee: Cheng Su > Full outer shuffled hash join when building left side produces

[jira] [Updated] (SPARK-34681) Full outer shuffled hash join when building left side produces wrong result

2021-03-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34681: -- Affects Version/s: 3.1.0 > Full outer shuffled hash join when building left side produces

[jira] [Updated] (SPARK-34681) Full outer shuffled hash join when building left side produces wrong result

2021-03-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34681: -- Labels: correctness (was: ) > Full outer shuffled hash join when building left side produces

[jira] [Updated] (SPARK-34682) Regression in "operating on canonicalized plan" check in CustomShuffleReaderExec

2021-03-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34682: -- Parent: SPARK-33828 Issue Type: Sub-task (was: Bug) > Regression in "operating on

[jira] [Reopened] (SPARK-34648) Reading Parquet Files in Spark Extremely Slow for Large Number of Files?

2021-03-09 Thread Pankaj Bhootra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pankaj Bhootra reopened SPARK-34648: Reopening this as there is no response on the email channel. Please help with clarification.

[jira] [Commented] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

2021-03-09 Thread Shubham Chaurasia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298524#comment-17298524 ] Shubham Chaurasia commented on SPARK-34675: --- Thanks [~dongjoon] [~maxgekk] Experiments with

[jira] [Commented] (SPARK-34641) ARM CI failed due to download hive-exec failed

2021-03-09 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298483#comment-17298483 ] Yikun Jiang commented on SPARK-34641: - FYI, the lastest build of spark-master-test-maven-arm is

[jira] [Commented] (SPARK-34682) Regression in "operating on canonicalized plan" check in CustomShuffleReaderExec

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298476#comment-17298476 ] Apache Spark commented on SPARK-34682: -- User 'andygrove' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34682) Regression in "operating on canonicalized plan" check in CustomShuffleReaderExec

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34682: Assignee: Apache Spark > Regression in "operating on canonicalized plan" check in >

[jira] [Assigned] (SPARK-34682) Regression in "operating on canonicalized plan" check in CustomShuffleReaderExec

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34682: Assignee: (was: Apache Spark) > Regression in "operating on canonicalized plan"

[jira] [Commented] (SPARK-34682) Regression in "operating on canonicalized plan" check in CustomShuffleReaderExec

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298477#comment-17298477 ] Apache Spark commented on SPARK-34682: -- User 'andygrove' has created a pull request for this issue:

[jira] [Created] (SPARK-34682) Regression in "operating on canonicalized plan" check in CustomShuffleReaderExec

2021-03-09 Thread Andy Grove (Jira)
Andy Grove created SPARK-34682: -- Summary: Regression in "operating on canonicalized plan" check in CustomShuffleReaderExec Key: SPARK-34682 URL: https://issues.apache.org/jira/browse/SPARK-34682

[jira] [Assigned] (SPARK-34681) Full outer shuffled hash join when building left side produces wrong result

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34681: Assignee: (was: Apache Spark) > Full outer shuffled hash join when building left

[jira] [Assigned] (SPARK-34681) Full outer shuffled hash join when building left side produces wrong result

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34681: Assignee: Apache Spark > Full outer shuffled hash join when building left side produces

[jira] [Commented] (SPARK-34681) Full outer shuffled hash join when building left side produces wrong result

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298446#comment-17298446 ] Apache Spark commented on SPARK-34681: -- User 'c21' has created a pull request for this issue:

[jira] [Commented] (SPARK-34681) Full outer shuffled hash join when building left side produces wrong result

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298445#comment-17298445 ] Apache Spark commented on SPARK-34681: -- User 'c21' has created a pull request for this issue:

[jira] [Commented] (SPARK-32399) Support full outer join in shuffled hash join

2021-03-09 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298443#comment-17298443 ] Cheng Su commented on SPARK-32399: -- Hi [~feellifexp] - thank you for reporting this. Yes this is a bug.

[jira] [Created] (SPARK-34681) Full outer shuffled hash join when building left side produces wrong result

2021-03-09 Thread Cheng Su (Jira)
Cheng Su created SPARK-34681: Summary: Full outer shuffled hash join when building left side produces wrong result Key: SPARK-34681 URL: https://issues.apache.org/jira/browse/SPARK-34681 Project: Spark

[jira] [Commented] (SPARK-32399) Support full outer join in shuffled hash join

2021-03-09 Thread Wensheng Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298414#comment-17298414 ] Wensheng Wang commented on SPARK-32399: --- [~chengsu] [~cloud_fan]  It seems there is a potential

[jira] [Updated] (SPARK-32399) Support full outer join in shuffled hash join

2021-03-09 Thread Wensheng Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wensheng Wang updated SPARK-32399: -- Attachment: Screen Shot 2021-03-09 at 3.06.30 PM.png > Support full outer join in shuffled

[jira] [Assigned] (SPARK-34678) Add table function registry

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34678: Assignee: Apache Spark > Add table function registry > --- > >

[jira] [Commented] (SPARK-34678) Add table function registry

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298352#comment-17298352 ] Apache Spark commented on SPARK-34678: -- User 'allisonwang-db' has created a pull request for this

[jira] [Assigned] (SPARK-34678) Add table function registry

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34678: Assignee: (was: Apache Spark) > Add table function registry >

[jira] [Assigned] (SPARK-34509) Make dynamic allocation upscaling more progressive on K8S

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34509: Assignee: Apache Spark > Make dynamic allocation upscaling more progressive on K8S >

[jira] [Assigned] (SPARK-34509) Make dynamic allocation upscaling more progressive on K8S

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34509: Assignee: (was: Apache Spark) > Make dynamic allocation upscaling more progressive

[jira] [Commented] (SPARK-34509) Make dynamic allocation upscaling more progressive on K8S

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298339#comment-17298339 ] Apache Spark commented on SPARK-34509: -- User 'attilapiros' has created a pull request for this

[jira] [Updated] (SPARK-34680) Spark hangs when out of diskspace

2021-03-09 Thread Laurens (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurens updated SPARK-34680: Description: Parsing a workflow using Koalas, I noticed a stage is hanging for 8 hours already. I

[jira] [Created] (SPARK-34680) Spark hangs when out of diskspace

2021-03-09 Thread Laurens (Jira)
Laurens created SPARK-34680: --- Summary: Spark hangs when out of diskspace Key: SPARK-34680 URL: https://issues.apache.org/jira/browse/SPARK-34680 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-34679) inferTimestamp option is missing from the list of options in DataFrameReader.json.

2021-03-09 Thread Prashanth Babu (Jira)
Prashanth Babu created SPARK-34679: -- Summary: inferTimestamp option is missing from the list of options in DataFrameReader.json. Key: SPARK-34679 URL: https://issues.apache.org/jira/browse/SPARK-34679

[jira] [Commented] (SPARK-34677) Support add and subtract of ANSI SQL intervals

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298266#comment-17298266 ] Apache Spark commented on SPARK-34677: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34677) Support add and subtract of ANSI SQL intervals

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34677: Assignee: Apache Spark > Support add and subtract of ANSI SQL intervals >

[jira] [Assigned] (SPARK-34677) Support add and subtract of ANSI SQL intervals

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34677: Assignee: (was: Apache Spark) > Support add and subtract of ANSI SQL intervals >

[jira] [Commented] (SPARK-34677) Support add and subtract of ANSI SQL intervals

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298265#comment-17298265 ] Apache Spark commented on SPARK-34677: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-34678) Add table function registry

2021-03-09 Thread Allison Wang (Jira)
Allison Wang created SPARK-34678: Summary: Add table function registry Key: SPARK-34678 URL: https://issues.apache.org/jira/browse/SPARK-34678 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-34677) Support add and subtract of ANSI SQL intervals

2021-03-09 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34677: -- Summary: Support add and subtract of ANSI SQL intervals Key: SPARK-34677 URL: https://issues.apache.org/jira/browse/SPARK-34677 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

2021-03-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298233#comment-17298233 ] Maxim Gekk commented on SPARK-34675: > Set session timezone to America/Los_Angeles > scala>

[jira] [Updated] (SPARK-34092) support filtering by task status in REST API call for a specific stage

2021-03-09 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-34092: --- Description: When we want to get a specific stage's detail info with task information, it will return all

[jira] [Assigned] (SPARK-34609) unify resolveExpressionBottomUp and resolveExpressionTopDown

2021-03-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34609: - Assignee: Wenchen Fan (was: Apache Spark) > unify resolveExpressionBottomUp and

[jira] [Resolved] (SPARK-34676) TableCapabilityCheckSuite should not inherit all tests from AnalysisSuite

2021-03-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34676. --- Fix Version/s: 3.0.3 3.1.2 3.2.0 Resolution:

[jira] [Commented] (SPARK-34676) TableCapabilityCheckSuite should not inherit all tests from AnalysisSuite

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298194#comment-17298194 ] Apache Spark commented on SPARK-34676: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34676) TableCapabilityCheckSuite should not inherit all tests from AnalysisSuite

2021-03-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34676: - Assignee: Wenchen Fan > TableCapabilityCheckSuite should not inherit all tests from

[jira] [Commented] (SPARK-34676) TableCapabilityCheckSuite should not inherit all tests from AnalysisSuite

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298193#comment-17298193 ] Apache Spark commented on SPARK-34676: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34676) TableCapabilityCheckSuite should not inherit all tests from AnalysisSuite

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34676: Assignee: Apache Spark > TableCapabilityCheckSuite should not inherit all tests from

[jira] [Assigned] (SPARK-34676) TableCapabilityCheckSuite should not inherit all tests from AnalysisSuite

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34676: Assignee: (was: Apache Spark) > TableCapabilityCheckSuite should not inherit all

[jira] [Created] (SPARK-34676) TableCapabilityCheckSuite should not inherit all tests from AnalysisSuite

2021-03-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-34676: - Summary: TableCapabilityCheckSuite should not inherit all tests from AnalysisSuite Key: SPARK-34676 URL: https://issues.apache.org/jira/browse/SPARK-34676 Project:

[jira] [Commented] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

2021-03-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298177#comment-17298177 ] Dongjoon Hyun commented on SPARK-34675: --- cc [~maxgekk] > TimeZone inconsistencies when JVM and

[jira] [Updated] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

2021-03-09 Thread Shubham Chaurasia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shubham Chaurasia updated SPARK-34675: -- Description: Inserted following data with UTC as both JVM and session timezone.

[jira] [Created] (SPARK-34675) TimeZone inconsistencies when JVM and session timezones are different

2021-03-09 Thread Shubham Chaurasia (Jira)
Shubham Chaurasia created SPARK-34675: - Summary: TimeZone inconsistencies when JVM and session timezones are different Key: SPARK-34675 URL: https://issues.apache.org/jira/browse/SPARK-34675

[jira] [Created] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-03-09 Thread Sergey (Jira)
Sergey created SPARK-34674: -- Summary: Spark app on k8s doesn't terminate without call to sparkContext.stop() method Key: SPARK-34674 URL: https://issues.apache.org/jira/browse/SPARK-34674 Project: Spark

[jira] [Updated] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-03-09 Thread Sergey (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey updated SPARK-34674: --- Description: Hello! I have run into a problem that if I don't call the method sparkContext.stop()

[jira] [Resolved] (SPARK-34672) Fix docker file for creating release

2021-03-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34672. -- Fix Version/s: 2.4.8 Resolution: Fixed Issue resolved by pull request 31787

[jira] [Assigned] (SPARK-34672) Fix docker file for creating release

2021-03-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34672: Assignee: L. C. Hsieh > Fix docker file for creating release >

[jira] [Resolved] (SPARK-34603) Support ADD ARCHIVE and LIST ARCHIVES command

2021-03-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34603. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31721

[jira] [Updated] (SPARK-34545) PySpark Python UDF return inconsistent results when applying 2 UDFs with different return type to 2 columns together

2021-03-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34545: - Fix Version/s: 3.0.3 > PySpark Python UDF return inconsistent results when applying 2 UDFs with

[jira] [Resolved] (SPARK-34649) org.apache.spark.sql.DataFrameNaFunctions.replace() fails for column name having a dot

2021-03-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34649. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31769

[jira] [Assigned] (SPARK-34649) org.apache.spark.sql.DataFrameNaFunctions.replace() fails for column name having a dot

2021-03-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34649: --- Assignee: Amandeep Sharma > org.apache.spark.sql.DataFrameNaFunctions.replace() fails for

[jira] [Resolved] (SPARK-34620) Code-gen broadcast nested loop join (inner/cross)

2021-03-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34620. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31736

[jira] [Assigned] (SPARK-34620) Code-gen broadcast nested loop join (inner/cross)

2021-03-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34620: --- Assignee: Cheng Su > Code-gen broadcast nested loop join (inner/cross) >

[jira] [Commented] (SPARK-34544) pyspark toPandas() should return pd.DataFrame

2021-03-09 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298016#comment-17298016 ] Rafal Wojdyla commented on SPARK-34544: --- [~zero323] yea, I see, in nature that suggestion is

[jira] [Commented] (SPARK-30655) Update WebUI Bootstrap to 4.4.1

2021-03-09 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298005#comment-17298005 ] Peter Toth commented on SPARK-30655: [~d.clarke], it looks like you already fixed this in 

[jira] [Created] (SPARK-34673) Select queries fail with Error: java.lang.IllegalArgumentException: Error: name expected at the position 10 of 'decimal(2,-2)' but '-' is found. (state=,code=0)

2021-03-09 Thread Chetan Bhat (Jira)
Chetan Bhat created SPARK-34673: --- Summary: Select queries fail with Error: java.lang.IllegalArgumentException: Error: name expected at the position 10 of 'decimal(2,-2)' but '-' is found. (state=,code=0) Key: SPARK-34673

[jira] [Commented] (SPARK-34672) Fix docker file for creating release

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297956#comment-17297956 ] Apache Spark commented on SPARK-34672: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34672) Fix docker file for creating release

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34672: Assignee: Apache Spark > Fix docker file for creating release >

[jira] [Commented] (SPARK-34672) Fix docker file for creating release

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297954#comment-17297954 ] Apache Spark commented on SPARK-34672: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34672) Fix docker file for creating release

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34672: Assignee: (was: Apache Spark) > Fix docker file for creating release >

[jira] [Created] (SPARK-34672) Fix docker file for creating release

2021-03-09 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-34672: --- Summary: Fix docker file for creating release Key: SPARK-34672 URL: https://issues.apache.org/jira/browse/SPARK-34672 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-34656) Add JobId to Stage page in web UI

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34656: Assignee: (was: Apache Spark) > Add JobId to Stage page in web UI >

[jira] [Commented] (SPARK-34656) Add JobId to Stage page in web UI

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297932#comment-17297932 ] Apache Spark commented on SPARK-34656: -- User 'gabrielenizzoli' has created a pull request for this

[jira] [Assigned] (SPARK-34656) Add JobId to Stage page in web UI

2021-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34656: Assignee: Apache Spark > Add JobId to Stage page in web UI >