[jira] [Commented] (SPARK-32253) Make readability better in the test result logs

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164148#comment-17164148 ] Apache Spark commented on SPARK-32253: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-32253) Make readability better in the test result logs

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164150#comment-17164150 ] Apache Spark commented on SPARK-32253: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-32408) Enable crossPaths back to prevent side effects

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164135#comment-17164135 ] Apache Spark commented on SPARK-32408: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32408) Enable crossPaths back to prevent side effects

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164134#comment-17164134 ] Apache Spark commented on SPARK-32408: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-32308) Move by-name resolution logic of unionByName from API code to analysis phase

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32308. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29107

[jira] [Updated] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32372: Fix Version/s: 2.4.7 > "Resolved attribute(s) XXX missing" after dudup conflict references >

[jira] [Updated] (SPARK-32280) AnalysisException thrown when query contains several JOINs

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32280: Fix Version/s: 2.4.7 > AnalysisException thrown when query contains several JOINs >

[jira] [Updated] (SPARK-32408) Enable crossPaths back to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Description: After SPARK-32245, crossPaths was disabled in SBT build to run the Junit tests

[jira] [Updated] (SPARK-32408) Enable crossPaths back to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Description: After SPARK-32245, crossPaths was disabled in SBT build to run the Junit tests

[jira] [Updated] (SPARK-32408) Enable crossPaths back to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Summary: Enable crossPaths back to prevent side effects (was: Disable crossPaths only in

[jira] [Created] (SPARK-32422) Don't skip pandas UDF tests in IntegratedUDFTestUtils

2020-07-23 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32422: Summary: Don't skip pandas UDF tests in IntegratedUDFTestUtils Key: SPARK-32422 URL: https://issues.apache.org/jira/browse/SPARK-32422 Project: Spark Issue

[jira] [Assigned] (SPARK-32422) Don't skip pandas UDF tests in IntegratedUDFTestUtils

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32422: Assignee: (was: Apache Spark) > Don't skip pandas UDF tests in

[jira] [Assigned] (SPARK-32422) Don't skip pandas UDF tests in IntegratedUDFTestUtils

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32422: Assignee: Apache Spark > Don't skip pandas UDF tests in IntegratedUDFTestUtils >

[jira] [Commented] (SPARK-32422) Don't skip pandas UDF tests in IntegratedUDFTestUtils

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164125#comment-17164125 ] Apache Spark commented on SPARK-32422: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-32237) Cannot resolve column when put hint in the views of common table expression

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32237. - Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-32237) Cannot resolve column when put hint in the views of common table expression

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32237: --- Assignee: Lantao Jin > Cannot resolve column when put hint in the views of common table

[jira] [Assigned] (SPARK-32420) Add handling for unique key in non-codegen hash join

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32420: Assignee: (was: Apache Spark) > Add handling for unique key in non-codegen hash join

[jira] [Assigned] (SPARK-32420) Add handling for unique key in non-codegen hash join

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32420: Assignee: Apache Spark > Add handling for unique key in non-codegen hash join >

[jira] [Commented] (SPARK-32420) Add handling for unique key in non-codegen hash join

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164113#comment-17164113 ] Apache Spark commented on SPARK-32420: -- User 'c21' has created a pull request for this issue:

[jira] [Created] (SPARK-32421) Add code-gen for shuffled hash join

2020-07-23 Thread Cheng Su (Jira)
Cheng Su created SPARK-32421: Summary: Add code-gen for shuffled hash join Key: SPARK-32421 URL: https://issues.apache.org/jira/browse/SPARK-32421 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32421) Add code-gen for shuffled hash join

2020-07-23 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164108#comment-17164108 ] Cheng Su commented on SPARK-32421: -- Will raise a PR in a couple of days. > Add code-gen for shuffled

[jira] [Created] (SPARK-32420) Add handling for unique key in non-codegen hash join

2020-07-23 Thread Cheng Su (Jira)
Cheng Su created SPARK-32420: Summary: Add handling for unique key in non-codegen hash join Key: SPARK-32420 URL: https://issues.apache.org/jira/browse/SPARK-32420 Project: Spark Issue Type:

[jira] [Updated] (SPARK-31547) Upgrade Genjavadoc to 0.16

2020-07-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31547: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Improvement) > Upgrade Genjavadoc to

[jira] [Commented] (SPARK-32363) Flaky pip installation test in Jenkins

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164102#comment-17164102 ] Apache Spark commented on SPARK-32363: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32264) More resources in Github Actions

2020-07-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164097#comment-17164097 ] Dongjoon Hyun commented on SPARK-32264: --- Thank you, [~holden] and [~hyukjin.kwon]. > More

[jira] [Commented] (SPARK-31525) Inconsistent result of df.head(1) and df.head()

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164086#comment-17164086 ] Apache Spark commented on SPARK-31525: -- User 'tianshizz' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31525) Inconsistent result of df.head(1) and df.head()

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31525: Assignee: (was: Apache Spark) > Inconsistent result of df.head(1) and df.head() >

[jira] [Commented] (SPARK-31525) Inconsistent result of df.head(1) and df.head()

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164084#comment-17164084 ] Apache Spark commented on SPARK-31525: -- User 'tianshizz' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31525) Inconsistent result of df.head(1) and df.head()

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31525: Assignee: Apache Spark > Inconsistent result of df.head(1) and df.head() >

[jira] [Commented] (SPARK-14820) Reduce shuffle data by pushing filter toward storage

2020-07-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164074#comment-17164074 ] Yuming Wang commented on SPARK-14820: - It seems the issue fixed by SPARK-31705. > Reduce shuffle

[jira] [Commented] (SPARK-32264) More resources in Github Actions

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164070#comment-17164070 ] Hyukjin Kwon commented on SPARK-32264: -- Thank you [~holden]! > More resources in Github Actions >

[jira] [Assigned] (SPARK-32419) Leverage Conda environment at pip packaging test in GitHub Actions

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32419: Assignee: Apache Spark > Leverage Conda environment at pip packaging test in GitHub

[jira] [Assigned] (SPARK-32419) Leverage Conda environment at pip packaging test in GitHub Actions

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32419: Assignee: (was: Apache Spark) > Leverage Conda environment at pip packaging test in

[jira] [Commented] (SPARK-32419) Leverage Conda environment at pip packaging test in GitHub Actions

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164067#comment-17164067 ] Apache Spark commented on SPARK-32419: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32264) More resources in Github Actions

2020-07-23 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164066#comment-17164066 ] Holden Karau commented on SPARK-32264: -- It's being routed inside of GitHub as of my last contact

[jira] [Updated] (SPARK-32419) Leverage Conda environment at pip packaging test in GitHub Actions

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32419: - Description: If you take a close look for GitHub Actions log: {code:java} Installing dist into

[jira] [Created] (SPARK-32419) Leverage Conda environment at pip packaging test in GitHub Actions

2020-07-23 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32419: Summary: Leverage Conda environment at pip packaging test in GitHub Actions Key: SPARK-32419 URL: https://issues.apache.org/jira/browse/SPARK-32419 Project: Spark

[jira] [Commented] (SPARK-32264) More resources in Github Actions

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164062#comment-17164062 ] Hyukjin Kwon commented on SPARK-32264: -- I'll assign this to [~holden] for now .. since she's being

[jira] [Assigned] (SPARK-32264) More resources in Github Actions

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32264: Assignee: Holden Karau > More resources in Github Actions >

[jira] [Resolved] (SPARK-32415) Enable JSON tests for the allowNonNumericNumbers option

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32415. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29207

[jira] [Assigned] (SPARK-32415) Enable JSON tests for the allowNonNumericNumbers option

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32415: Assignee: Maxim Gekk > Enable JSON tests for the allowNonNumericNumbers option >

[jira] [Resolved] (SPARK-32398) Upgrade to scalatest 3.2.0 for Scala 2.13.3 compatibility

2020-07-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32398. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29196

[jira] [Updated] (SPARK-32364) Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-07-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32364: -- Fix Version/s: 2.4.7 > Use CaseInsensitiveMap for DataFrameReader/Writer options >

[jira] [Created] (SPARK-32418) Flaky test: org.apache.spark.DistributedSuite.caching in memory, serialized, replicated (encryption = off)

2020-07-23 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-32418: Summary: Flaky test: org.apache.spark.DistributedSuite.caching in memory, serialized, replicated (encryption = off) Key: SPARK-32418 URL:

[jira] [Commented] (SPARK-31693) Investigate AmpLab Jenkins server network issue

2020-07-23 Thread Wing Yew Poon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163987#comment-17163987 ] Wing Yew Poon commented on SPARK-31693: --- I'm seeing a problem with the .m2 cache on

[jira] [Commented] (SPARK-31197) Exit the executor once all tasks & migrations are finished

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163983#comment-17163983 ] Apache Spark commented on SPARK-31197: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31197) Exit the executor once all tasks & migrations are finished

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163981#comment-17163981 ] Apache Spark commented on SPARK-31197: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-32054) Flaky test: org.apache.spark.sql.connector.FileDataSourceV2FallBackSuite.Fallback Parquet V2 to V1

2020-07-23 Thread Wing Yew Poon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163976#comment-17163976 ] Wing Yew Poon commented on SPARK-32054: ---

[jira] [Created] (SPARK-32417) Flaky test: BlockManagerDecommissionIntegrationSuite.verify that an already running task which is going to cache data succeeds on a decommissioned executor

2020-07-23 Thread Gabor Somogyi (Jira)
Gabor Somogyi created SPARK-32417: - Summary: Flaky test: BlockManagerDecommissionIntegrationSuite.verify that an already running task which is going to cache data succeeds on a decommissioned executor Key: SPARK-32417

[jira] [Created] (SPARK-32416) Flaky test: SparkContextSuite.Cancelling stages/jobs with custom reasons

2020-07-23 Thread Gabor Somogyi (Jira)
Gabor Somogyi created SPARK-32416: - Summary: Flaky test: SparkContextSuite.Cancelling stages/jobs with custom reasons Key: SPARK-32416 URL: https://issues.apache.org/jira/browse/SPARK-32416 Project:

[jira] [Commented] (SPARK-24497) ANSI SQL: Recursive query

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163864#comment-17163864 ] Apache Spark commented on SPARK-24497: -- User 'peter-toth' has created a pull request for this

[jira] [Commented] (SPARK-32364) Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163857#comment-17163857 ] Apache Spark commented on SPARK-32364: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-17053) Spark ignores hive.exec.drop.ignorenonexistent=true option

2020-07-23 Thread Jeffrey E Rodriguez (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163821#comment-17163821 ] Jeffrey E Rodriguez commented on SPARK-17053: -- [~rxin] as  esoteric as

[jira] [Resolved] (SPARK-31418) Blacklisting feature aborts Spark job without retrying for max num retries in case of Dynamic allocation

2020-07-23 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-31418. --- Fix Version/s: 3.1.0 Assignee: Venkata krishnan Sowrirajan Resolution: Fixed

[jira] [Closed] (SPARK-32413) Guidance for my project

2020-07-23 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler closed SPARK-32413. > Guidance for my project > > > Key: SPARK-32413 >

[jira] [Resolved] (SPARK-32413) Guidance for my project

2020-07-23 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-32413. -- Resolution: Not A Problem Hi [~stoksoz] , this type of discussion is more appropriate for the

[jira] [Commented] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163781#comment-17163781 ] Apache Spark commented on SPARK-32372: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-32280) AnalysisException thrown when query contains several JOINs

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163780#comment-17163780 ] Apache Spark commented on SPARK-32280: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-32411) GPU Cluster Fail

2020-07-23 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163742#comment-17163742 ] L. C. Hsieh commented on SPARK-32411: - I think it is because the configs.

[jira] [Resolved] (SPARK-32411) GPU Cluster Fail

2020-07-23 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-32411. - Resolution: Not A Problem > GPU Cluster Fail > > > Key:

[jira] [Assigned] (SPARK-32415) Enable JSON tests for the allowNonNumericNumbers option

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32415: Assignee: Apache Spark > Enable JSON tests for the allowNonNumericNumbers option >

[jira] [Assigned] (SPARK-32415) Enable JSON tests for the allowNonNumericNumbers option

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32415: Assignee: (was: Apache Spark) > Enable JSON tests for the allowNonNumericNumbers

[jira] [Commented] (SPARK-32415) Enable JSON tests for the allowNonNumericNumbers option

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163720#comment-17163720 ] Apache Spark commented on SPARK-32415: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-32415) Enable JSON tests for the allowNonNumericNumbers option

2020-07-23 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32415: --- Summary: Enable JSON tests for the allowNonNumericNumbers option (was: Enable JSON tests from the

[jira] [Created] (SPARK-32415) Enable JSON tests from the allowNonNumericNumbers option

2020-07-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32415: -- Summary: Enable JSON tests from the allowNonNumericNumbers option Key: SPARK-32415 URL: https://issues.apache.org/jira/browse/SPARK-32415 Project: Spark Issue

[jira] [Updated] (SPARK-32414) pyspark crashes in cluster mode with kafka structured streaming

2020-07-23 Thread cyrille cazenave (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cyrille cazenave updated SPARK-32414: - Attachment: spark.py > pyspark crashes in cluster mode with kafka structured streaming

[jira] [Updated] (SPARK-32414) pyspark crashes in cluster mode with kafka structured streaming

2020-07-23 Thread cyrille cazenave (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cyrille cazenave updated SPARK-32414: - Description: Hello, {{I have been trying to run a pyspark script on Spark on

[jira] [Updated] (SPARK-32414) pyspark crashes in cluster mode with kafka structured streaming

2020-07-23 Thread cyrille cazenave (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cyrille cazenave updated SPARK-32414: - Attachment: fulllogs.txt > pyspark crashes in cluster mode with kafka structured

[jira] [Updated] (SPARK-32414) pyspark crashes in cluster mode with kafka structured streaming

2020-07-23 Thread cyrille cazenave (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cyrille cazenave updated SPARK-32414: - Description: Hello, {{I have been trying to run a pyspark script on Spark on

[jira] [Commented] (SPARK-30648) Support filters pushdown in JSON datasource

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163690#comment-17163690 ] Apache Spark commented on SPARK-30648: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-32414) pyspark crashes in cluster mode with kafka structured streaming

2020-07-23 Thread cyrille cazenave (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cyrille cazenave updated SPARK-32414: - Description: Hello, {{I have been trying to run a pyspark script on Spark on

[jira] [Created] (SPARK-32414) pyspark crashes in cluster mode with kafka structured streaming

2020-07-23 Thread cyrille cazenave (Jira)
cyrille cazenave created SPARK-32414: Summary: pyspark crashes in cluster mode with kafka structured streaming Key: SPARK-32414 URL: https://issues.apache.org/jira/browse/SPARK-32414 Project:

[jira] [Resolved] (SPARK-32386) Fix temp view leaking in Structured Streaming tests

2020-07-23 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li resolved SPARK-32386. - Resolution: Won't Fix In various suites, we need this temp view for checking results, e.g 

[jira] [Resolved] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32372. - Fix Version/s: 3.1.0 3.0.1 Assignee: wuyi Resolution: Fixed

[jira] [Assigned] (SPARK-32374) Disallow setting properties when creating temporary views

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32374: --- Assignee: Terry Kim (was: Apache Spark) > Disallow setting properties when creating

[jira] [Updated] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32372: Priority: Major (was: Critical) > "Resolved attribute(s) XXX missing" after dudup conflict

[jira] [Updated] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32372: Priority: Critical (was: Blocker) > "Resolved attribute(s) XXX missing" after dudup conflict

[jira] [Resolved] (SPARK-32374) Disallow setting properties when creating temporary views

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32374. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29167

[jira] [Assigned] (SPARK-32280) AnalysisException thrown when query contains several JOINs

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32280: --- Assignee: wuyi > AnalysisException thrown when query contains several JOINs >

[jira] [Resolved] (SPARK-32280) AnalysisException thrown when query contains several JOINs

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32280. - Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163595#comment-17163595 ] Apache Spark commented on SPARK-32408: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32408: Assignee: (was: Apache Spark) > Disable crossPaths only in GitHub Actions to prevent

[jira] [Assigned] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32408: Assignee: Apache Spark > Disable crossPaths only in GitHub Actions to prevent side

[jira] [Commented] (SPARK-32334) Investigate commonizing Columnar and Row data transformations

2020-07-23 Thread Robert Joseph Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163576#comment-17163576 ] Robert Joseph Evans commented on SPARK-32334: - Row to columnar and columnar to row is mostly

[jira] [Updated] (SPARK-32364) Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-07-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32364: -- Reporter: Girish A Pandit (was: Dongjoon Hyun) > Use CaseInsensitiveMap for

[jira] [Assigned] (SPARK-32412) Unify error handling for spark thrift server operations

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32412: Assignee: Apache Spark > Unify error handling for spark thrift server operations >

[jira] [Assigned] (SPARK-32412) Unify error handling for spark thrift server operations

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32412: Assignee: (was: Apache Spark) > Unify error handling for spark thrift server

[jira] [Commented] (SPARK-32412) Unify error handling for spark thrift server operations

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163539#comment-17163539 ] Apache Spark commented on SPARK-32412: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Created] (SPARK-32413) Guidance for my project

2020-07-23 Thread Suat Toksoz (Jira)
Suat Toksoz created SPARK-32413: --- Summary: Guidance for my project Key: SPARK-32413 URL: https://issues.apache.org/jira/browse/SPARK-32413 Project: Spark Issue Type: Brainstorming

[jira] [Created] (SPARK-32412) Unify error handling for spark thrift server operations

2020-07-23 Thread Kent Yao (Jira)
Kent Yao created SPARK-32412: Summary: Unify error handling for spark thrift server operations Key: SPARK-32412 URL: https://issues.apache.org/jira/browse/SPARK-32412 Project: Spark Issue Type:

[jira] [Created] (SPARK-32411) GPU Cluster Fail

2020-07-23 Thread Vinh Tran (Jira)
Vinh Tran created SPARK-32411: - Summary: GPU Cluster Fail Key: SPARK-32411 URL: https://issues.apache.org/jira/browse/SPARK-32411 Project: Spark Issue Type: Bug Components: PySpark,

[jira] [Updated] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Parent: SPARK-32244 Issue Type: Sub-task (was: Improvement) > Disable crossPaths only

[jira] [Updated] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Description: After SPARK-32245, crossPaths was disabled in SBT build to run the Junit tests

[jira] [Updated] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Issue Type: Test (was: Improvement) > Disable crossPaths only in GitHub Actions to prevent

[jira] [Updated] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Issue Type: Improvement (was: Test) > Disable crossPaths only in GitHub Actions to prevent

[jira] [Updated] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Description: After SPARK-32245, crossPaths was disabled in SBT build to run the Junit tests

[jira] [Updated] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Description: After SPARK-32245, crossPaths was disabled in SBT build to run the Junit tests

[jira] [Updated] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Summary: Disable crossPaths only in GitHub Actions to prevent side effects (was: Reflect the

[jira] [Resolved] (SPARK-32389) Add all hive.execution suites in the parallel test group

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32389. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28977

[jira] [Assigned] (SPARK-32389) Add all hive.execution suites in the parallel test group

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32389: Assignee: Yuanjian Li > Add all hive.execution suites in the parallel test group >

  1   2   >