[jira] [Commented] (SPARK-32003) Shuffle files for lost executor are not unregistered if fetch failure occurs after executor is lost

[ https://issues.apache.org/jira/browse/SPARK-32003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162479#comment-17162479 ] Apache Spark commented on SPARK-32003: -- User 'wypoon' has created a pull request for this issue:

[jira] [Commented] (SPARK-32351) Partially pushed partition filters are not explained

[ https://issues.apache.org/jira/browse/SPARK-32351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162477#comment-17162477 ] pavithra ramachandran commented on SPARK-32351: --- i would like to check this > Partially

[jira] [Updated] (SPARK-32059) Nested Schema Pruning not Working in Window Functions

[ https://issues.apache.org/jira/browse/SPARK-32059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32059: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Nested Schema Pruning not

[jira] [Resolved] (SPARK-32350) Add batch write support on LevelDB to improve performance of HybridStore

[ https://issues.apache.org/jira/browse/SPARK-32350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-32350. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29149

[jira] [Assigned] (SPARK-32350) Add batch write support on LevelDB to improve performance of HybridStore

[ https://issues.apache.org/jira/browse/SPARK-32350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-32350: Assignee: Baohe Zhang > Add batch write support on LevelDB to improve performance of

[jira] [Updated] (SPARK-32330) Preserve shuffled hash join build side partitioning

[ https://issues.apache.org/jira/browse/SPARK-32330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32330: Priority: Major (was: Trivial) > Preserve shuffled hash join build side partitioning >

[jira] [Commented] (SPARK-23844) Socket Stream recovering from checkpoint will throw exception

[ https://issues.apache.org/jira/browse/SPARK-23844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162438#comment-17162438 ] pengzhiwei commented on SPARK-23844: Thanks [~jerryshao2015],I have meet the same issue with you. >

[jira] [Assigned] (SPARK-32383) Preserve hash join (BHJ and SHJ) stream side ordering

[ https://issues.apache.org/jira/browse/SPARK-32383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32383: Assignee: (was: Apache Spark) > Preserve hash join (BHJ and SHJ) stream side

[jira] [Commented] (SPARK-32383) Preserve hash join (BHJ and SHJ) stream side ordering

[ https://issues.apache.org/jira/browse/SPARK-32383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162413#comment-17162413 ] Apache Spark commented on SPARK-32383: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32383) Preserve hash join (BHJ and SHJ) stream side ordering

[ https://issues.apache.org/jira/browse/SPARK-32383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32383: Assignee: Apache Spark > Preserve hash join (BHJ and SHJ) stream side ordering >

[jira] [Created] (SPARK-32383) Preserve hash join (BHJ and SHJ) stream side ordering

Cheng Su created SPARK-32383: Summary: Preserve hash join (BHJ and SHJ) stream side ordering Key: SPARK-32383 URL: https://issues.apache.org/jira/browse/SPARK-32383 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-32286) Coalesce bucketed tables for shuffled hash join if applicable

[ https://issues.apache.org/jira/browse/SPARK-32286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32286. -- Fix Version/s: 3.1.0 Assignee: Cheng Su Resolution: Fixed Resolved by 

[jira] [Resolved] (SPARK-24266) Spark client terminates while driver is still running

[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-24266. -- Fix Version/s: 3.1.0 Target Version/s: 3.1.0 (was: 2.4.7, 3.1.0) Resolution:

[jira] [Updated] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

[ https://issues.apache.org/jira/browse/SPARK-32377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32377: -- Reporter: Girish A Pandit (was: Dongjoon Hyun) > CaseInsensitiveMap should be deterministic

[jira] [Assigned] (SPARK-17333) Make pyspark interface friendly with mypy static analysis

[ https://issues.apache.org/jira/browse/SPARK-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17333: Assignee: Apache Spark > Make pyspark interface friendly with mypy static analysis >

[jira] [Assigned] (SPARK-17333) Make pyspark interface friendly with mypy static analysis

[ https://issues.apache.org/jira/browse/SPARK-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17333: Assignee: (was: Apache Spark) > Make pyspark interface friendly with mypy static

[jira] [Commented] (SPARK-17333) Make pyspark interface friendly with mypy static analysis

[ https://issues.apache.org/jira/browse/SPARK-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162339#comment-17162339 ] Apache Spark commented on SPARK-17333: -- User 'Fokko' has created a pull request for this issue:

[jira] [Created] (SPARK-32382) Override table renaming in JDBC dialects

Maxim Gekk created SPARK-32382: -- Summary: Override table renaming in JDBC dialects Key: SPARK-32382 URL: https://issues.apache.org/jira/browse/SPARK-32382 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-32381) Expose the ability for users to use parallel file & avoid location information discovery in RDDs

Holden Karau created SPARK-32381: Summary: Expose the ability for users to use parallel file & avoid location information discovery in RDDs Key: SPARK-32381 URL: https://issues.apache.org/jira/browse/SPARK-32381

[jira] [Assigned] (SPARK-32381) Expose the ability for users to use parallel file & avoid location information discovery in RDDs

[ https://issues.apache.org/jira/browse/SPARK-32381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32381: Assignee: (was: Apache Spark) > Expose the ability for users to use parallel file &

[jira] [Assigned] (SPARK-32381) Expose the ability for users to use parallel file & avoid location information discovery in RDDs

[ https://issues.apache.org/jira/browse/SPARK-32381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32381: Assignee: Apache Spark > Expose the ability for users to use parallel file & avoid

[jira] [Commented] (SPARK-32381) Expose the ability for users to use parallel file & avoid location information discovery in RDDs

[ https://issues.apache.org/jira/browse/SPARK-32381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162314#comment-17162314 ] Apache Spark commented on SPARK-32381: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162313#comment-17162313 ] Holden Karau commented on SPARK-26345: -- We don't assign issues normally until after the merge.

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162311#comment-17162311 ] Felix Kizhakkel Jose commented on SPARK-26345: -- [~sha...@uber.com] I don't have permission

[jira] [Commented] (SPARK-32348) Get tests working for Scala 2.13 build

[ https://issues.apache.org/jira/browse/SPARK-32348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162280#comment-17162280 ] Sean R. Owen commented on SPARK-32348: -- I've found a few more easy test fixes, but also discovered

[jira] [Commented] (SPARK-32334) Investigate commonizing Columnar and Row data transformations

[ https://issues.apache.org/jira/browse/SPARK-32334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162147#comment-17162147 ] Robert Joseph Evans commented on SPARK-32334: - I think I can get the conversation started

[jira] [Updated] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

[ https://issues.apache.org/jira/browse/SPARK-32377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32377: -- Fix Version/s: 2.4.7 > CaseInsensitiveMap should be deterministic for addition >

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162063#comment-17162063 ] Xinli Shang commented on SPARK-26345: - [~yumwang][~FelixKJose], you can assign this JIra to me. When

[jira] [Commented] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162059#comment-17162059 ] Apache Spark commented on SPARK-32380: -- User 'DeyinZhong' has created a pull request for this

[jira] [Assigned] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32380: Assignee: Apache Spark > sparksql cannot access hive table while data in hbase >

[jira] [Assigned] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32380: Assignee: (was: Apache Spark) > sparksql cannot access hive table while data in

[jira] [Commented] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162058#comment-17162058 ] Apache Spark commented on SPARK-32380: -- User 'DeyinZhong' has created a pull request for this

[jira] [Assigned] (SPARK-32363) Flaky pip installation test in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-32363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32363: Assignee: Hyukjin Kwon > Flaky pip installation test in Jenkins >

[jira] [Resolved] (SPARK-32363) Flaky pip installation test in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-32363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32363. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29117

[jira] [Updated] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deyzhong updated SPARK-32380: - Description: * step1: create hbase table {code:java} hbase(main):001:0>create 'hbase_test1', 'cf1'

[jira] [Commented] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161959#comment-17161959 ] deyzhong commented on SPARK-32380: -- I have solved this bug by modified TableReader.scala. The solution

[jira] [Updated] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deyzhong updated SPARK-32380: - Description: * step1: create hbase table {code:java} hbase(main):001:0>create 'hbase_test1', 'cf1'

[jira] [Updated] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deyzhong updated SPARK-32380: - Description: * step1: create hbase table {code:java} create 'hbase_test2', 'cf1'{code} * create hive

[jira] [Updated] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deyzhong updated SPARK-32380: - Description: * step1: create hbase table * {code:java} create 'hbase_test2', 'cf1' {code} * create

[jira] [Updated] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deyzhong updated SPARK-32380: - Description: * step1: create hbase table * {code:java} create 'hbase_test2', 'cf1' {code} * create

[jira] [Updated] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deyzhong updated SPARK-32380: - Summary: sparksql cannot access hive table while data in hbase (was: sparksql cannot access hive table

[jira] [Updated] (SPARK-32380) sparksql cannot access hive table while data on hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deyzhong updated SPARK-32380: - Summary: sparksql cannot access hive table while data on hbase (was: sparksql cannot access hbase

[jira] [Updated] (SPARK-32380) sparksql cannot access hbase external table in hive

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deyzhong updated SPARK-32380: - Description: * step1: create hbase table * {code:java} create 'hbase_test2', 'cf1' {code} * create

[jira] [Updated] (SPARK-32380) sparksql cannot access hbase external table in hive

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deyzhong updated SPARK-32380: - Description: * step1: create hbase table * {code:java} create 'hbase_test2', 'cf1' {code} * create

[jira] [Commented] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161952#comment-17161952 ] Krish commented on SPARK-32317: --- Yes I do agree with your second point, if we map required schema and the

[jira] [Created] (SPARK-32380) sparksql cannot access hbase external table in hive

deyzhong created SPARK-32380: Summary: sparksql cannot access hbase external table in hive Key: SPARK-32380 URL: https://issues.apache.org/jira/browse/SPARK-32380 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-32379) docker based spark release script should use correct CRAN repo.

[ https://issues.apache.org/jira/browse/SPARK-32379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32379: Assignee: Prashant Sharma > docker based spark release script should use correct CRAN

[jira] [Resolved] (SPARK-32379) docker based spark release script should use correct CRAN repo.

[ https://issues.apache.org/jira/browse/SPARK-32379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32379. -- Fix Version/s: 2.4.7 Resolution: Fixed Issue resolved by pull request 29177

[jira] [Commented] (SPARK-32379) docker based spark release script should use correct CRAN repo.

[ https://issues.apache.org/jira/browse/SPARK-32379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161848#comment-17161848 ] Apache Spark commented on SPARK-32379: -- User 'ScrapCodes' has created a pull request for this

[jira] [Commented] (SPARK-32379) docker based spark release script should use correct CRAN repo.

[ https://issues.apache.org/jira/browse/SPARK-32379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161846#comment-17161846 ] Apache Spark commented on SPARK-32379: -- User 'ScrapCodes' has created a pull request for this

[jira] [Assigned] (SPARK-32379) docker based spark release script should use correct CRAN repo.

[ https://issues.apache.org/jira/browse/SPARK-32379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32379: Assignee: Apache Spark > docker based spark release script should use correct CRAN repo.

[jira] [Assigned] (SPARK-32379) docker based spark release script should use correct CRAN repo.

[ https://issues.apache.org/jira/browse/SPARK-32379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32379: Assignee: (was: Apache Spark) > docker based spark release script should use correct

[jira] [Created] (SPARK-32379) docker based spark release script should use correct CRAN repo.

Prashant Sharma created SPARK-32379: --- Summary: docker based spark release script should use correct CRAN repo. Key: SPARK-32379 URL: https://issues.apache.org/jira/browse/SPARK-32379 Project: Spark

[jira] [Commented] (SPARK-32378) Permission problem happens while prepareLocalResources

[ https://issues.apache.org/jira/browse/SPARK-32378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161764#comment-17161764 ] Apache Spark commented on SPARK-32378: -- User 'sekingme' has created a pull request for this issue:

[jira] [Commented] (SPARK-32378) Permission problem happens while prepareLocalResources

[ https://issues.apache.org/jira/browse/SPARK-32378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161763#comment-17161763 ] Apache Spark commented on SPARK-32378: -- User 'sekingme' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32378) Permission problem happens while prepareLocalResources

[ https://issues.apache.org/jira/browse/SPARK-32378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32378: Assignee: (was: Apache Spark) > Permission problem happens while

[jira] [Assigned] (SPARK-32378) Permission problem happens while prepareLocalResources

[ https://issues.apache.org/jira/browse/SPARK-32378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32378: Assignee: Apache Spark > Permission problem happens while prepareLocalResources >

[jira] [Created] (SPARK-32378) Permission problem happens while prepareLocalResources

jiangshequan created SPARK-32378: Summary: Permission problem happens while prepareLocalResources Key: SPARK-32378 URL: https://issues.apache.org/jira/browse/SPARK-32378 Project: Spark Issue

[jira] [Commented] (SPARK-32352) Partially push down support data filter if it mixed in partition filters

[ https://issues.apache.org/jira/browse/SPARK-32352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161760#comment-17161760 ] angerszhu commented on SPARK-32352: --- Looking into this > Partially push down support data filter if

[jira] [Resolved] (SPARK-32377) CaseInsensitiveMap should be deterministic for addition

[ https://issues.apache.org/jira/browse/SPARK-32377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32377. --- Fix Version/s: 3.1.0 3.0.1 Assignee: Dongjoon Hyun