[jira] [Updated] (SPARK-36447) Avoid inlining non-deterministic With-CTEs

2021-08-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36447: --- Priority: Blocker (was: Major) > Avoid inlining non-deterministic With-CTEs > -

[jira] [Updated] (SPARK-36447) Avoid inlining non-deterministic With-CTEs

2021-08-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36447: --- Affects Version/s: 3.2.0 > Avoid inlining non-deterministic With-CTEs >

[jira] [Updated] (SPARK-35959) Add a new Maven profile "no-shaded-client" for older Hadoop 3.x versions

2021-08-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35959: --- Priority: Blocker (was: Major) > Add a new Maven profile "no-shaded-client" for older Hadoo

[jira] [Comment Edited] (SPARK-33807) Data Source V2: Remove read specific distributions

2021-08-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396432#comment-17396432 ] Gengliang Wang edited comment on SPARK-33807 at 8/10/21, 8:05 AM:

[jira] [Comment Edited] (SPARK-36463) Prohibit update mode in native support of session window

2021-08-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396434#comment-17396434 ] Gengliang Wang edited comment on SPARK-36463 at 8/10/21, 8:05 AM:

[jira] [Comment Edited] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2021-08-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396420#comment-17396420 ] Gengliang Wang edited comment on SPARK-34827 at 8/10/21, 8:06 AM:

[jira] [Updated] (SPARK-36466) Table in unloaded catalog referenced by view should load correctly

2021-08-10 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Pan updated SPARK-36466: -- Affects Version/s: (was: 3.1.2) > Table in unloaded catalog referenced by view should load correct

[jira] [Comment Edited] (SPARK-26208) Empty dataframe does not roundtrip for csv with header

2021-08-10 Thread Ranga Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396076#comment-17396076 ] Ranga Reddy edited comment on SPARK-26208 at 8/10/21, 9:03 AM: ---

[jira] [Assigned] (SPARK-36466) Table in unloaded catalog referenced by view should load correctly

2021-08-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36466: --- Assignee: Cheng Pan > Table in unloaded catalog referenced by view should load correctly >

[jira] [Resolved] (SPARK-36466) Table in unloaded catalog referenced by view should load correctly

2021-08-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36466. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33692 [https://gith

[jira] [Assigned] (SPARK-36431) Support comparison of ANSI intervals with different fields

2021-08-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36431: Assignee: angerszhu > Support comparison of ANSI intervals with different fields > --

[jira] [Resolved] (SPARK-36431) Support comparison of ANSI intervals with different fields

2021-08-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36431. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33661 [https://github.com

[jira] [Updated] (SPARK-36086) The case of the delta table is inconsistent with parquet

2021-08-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-36086: Fix Version/s: 3.0.4 3.1.3 > The case of the delta table is inconsistent with p

[jira] [Created] (SPARK-36467) Creating Hive managed table from spark to Hive, results in the table being in the external directory

2021-08-10 Thread Abdullah Galal (Jira)
Abdullah Galal created SPARK-36467: -- Summary: Creating Hive managed table from spark to Hive, results in the table being in the external directory Key: SPARK-36467 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Updated] (SPARK-33307) Refact GROUPING ANALYTICS

2021-08-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-33307: --- Affects Version/s: 3.2.0 > Refact GROUPING ANALYTICS > - > >

[jira] [Created] (SPARK-36468) Update docs about ANSI interval literals

2021-08-10 Thread Max Gekk (Jira)
Max Gekk created SPARK-36468: Summary: Update docs about ANSI interval literals Key: SPARK-36468 URL: https://issues.apache.org/jira/browse/SPARK-36468 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-33307) Refactor GROUPING ANALYTICS

2021-08-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-33307: --- Summary: Refactor GROUPING ANALYTICS (was: Refact GROUPING ANALYTICS) > Refactor GROUPING A

[jira] [Assigned] (SPARK-36468) Update docs about ANSI interval literals

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36468: Assignee: Apache Spark (was: Max Gekk) > Update docs about ANSI interval literals >

[jira] [Assigned] (SPARK-36468) Update docs about ANSI interval literals

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36468: Assignee: Max Gekk (was: Apache Spark) > Update docs about ANSI interval literals >

[jira] [Commented] (SPARK-36468) Update docs about ANSI interval literals

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396754#comment-17396754 ] Apache Spark commented on SPARK-36468: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-29497) Cannot assign instance of java.lang.invoke.SerializedLambda to field

2021-08-10 Thread Victor Chan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396760#comment-17396760 ] Victor Chan commented on SPARK-29497: - I've also been able to reproduce this on Spar

[jira] [Updated] (SPARK-36464) Fix Underlying Size Variable Initialization in ChunkedByteBufferOutputStream for Writing Over 2GB Data

2021-08-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36464: -- Affects Version/s: 3.3.0 2.0.2 2.1.3

[jira] [Resolved] (SPARK-36464) Fix Underlying Size Variable Initialization in ChunkedByteBufferOutputStream for Writing Over 2GB Data

2021-08-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36464. --- Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution: Fix

[jira] [Assigned] (SPARK-36464) Fix Underlying Size Variable Initialization in ChunkedByteBufferOutputStream for Writing Over 2GB Data

2021-08-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36464: - Assignee: Kazuyuki Tanimura > Fix Underlying Size Variable Initialization in ChunkedByt

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2021-08-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396823#comment-17396823 ] Dongjoon Hyun commented on SPARK-18105: --- Ya, this is a nice simplification really.

[jira] [Updated] (SPARK-36395) Implement Index.map

2021-08-10 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36395: - Parent: (was: SPARK-36394) Issue Type: Umbrella (was: Sub-task) > Implement Index.m

[jira] [Updated] (SPARK-36395) Implement map for indexes

2021-08-10 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36395: - Summary: Implement map for indexes (was: Implement Index.map) > Implement map for indexes > ---

[jira] [Created] (SPARK-36470) Implement CategoricalIndex.map

2021-08-10 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-36470: Summary: Implement CategoricalIndex.map Key: SPARK-36470 URL: https://issues.apache.org/jira/browse/SPARK-36470 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36469) Implement Index.map

2021-08-10 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-36469: Summary: Implement Index.map Key: SPARK-36469 URL: https://issues.apache.org/jira/browse/SPARK-36469 Project: Spark Issue Type: Sub-task Components

[jira] [Created] (SPARK-36471) Implement DatetimeIndex.map

2021-08-10 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-36471: Summary: Implement DatetimeIndex.map Key: SPARK-36471 URL: https://issues.apache.org/jira/browse/SPARK-36471 Project: Spark Issue Type: Sub-task Co

[jira] [Commented] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2021-08-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396834#comment-17396834 ] Dongjoon Hyun commented on SPARK-34827: --- AFAIK, this is not resolved yet. SPARK-34

[jira] [Commented] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2021-08-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396835#comment-17396835 ] Dongjoon Hyun commented on SPARK-34827: --- Also, cc [~Mridul] and [~tgraves] and [~v

[jira] [Created] (SPARK-36472) Improve SQL syntax for MERGE

2021-08-10 Thread Denis Krivenko (Jira)
Denis Krivenko created SPARK-36472: -- Summary: Improve SQL syntax for MERGE Key: SPARK-36472 URL: https://issues.apache.org/jira/browse/SPARK-36472 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-36469) Implement Index.map

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36469: Assignee: Apache Spark > Implement Index.map > --- > > Ke

[jira] [Commented] (SPARK-36469) Implement Index.map

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396839#comment-17396839 ] Apache Spark commented on SPARK-36469: -- User 'xinrong-databricks' has created a pul

[jira] [Assigned] (SPARK-36469) Implement Index.map

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36469: Assignee: Apache Spark > Implement Index.map > --- > > Ke

[jira] [Assigned] (SPARK-36469) Implement Index.map

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36469: Assignee: (was: Apache Spark) > Implement Index.map > --- > >

[jira] [Assigned] (SPARK-34861) Support nested column in Spark vectorized readers

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34861: Assignee: (was: Apache Spark) > Support nested column in Spark vectorized readers > -

[jira] [Commented] (SPARK-34861) Support nested column in Spark vectorized readers

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396913#comment-17396913 ] Apache Spark commented on SPARK-34861: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-34861) Support nested column in Spark vectorized readers

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34861: Assignee: Apache Spark > Support nested column in Spark vectorized readers >

[jira] [Issue Comment Deleted] (SPARK-34861) Support nested column in Spark vectorized readers

2021-08-10 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-34861: - Comment: was deleted (was: Synced with [~chengsu] offline and I will take over this JIRA.) > Support ne

[jira] [Assigned] (SPARK-34863) Support nested column in Spark Parquet vectorized readers

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34863: Assignee: Apache Spark > Support nested column in Spark Parquet vectorized readers >

[jira] [Commented] (SPARK-34863) Support nested column in Spark Parquet vectorized readers

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396931#comment-17396931 ] Apache Spark commented on SPARK-34863: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-34863) Support nested column in Spark Parquet vectorized readers

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34863: Assignee: (was: Apache Spark) > Support nested column in Spark Parquet vectorized rea

[jira] [Assigned] (SPARK-34863) Support nested column in Spark Parquet vectorized readers

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34863: Assignee: Apache Spark > Support nested column in Spark Parquet vectorized readers >

[jira] [Updated] (SPARK-32210) Failed to serialize large MapStatuses

2021-08-10 Thread Kazuyuki Tanimura (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuyuki Tanimura updated SPARK-32210: -- Affects Version/s: 3.3.0 2.4.8 3.0.3 > F

[jira] [Assigned] (SPARK-36463) Prohibit update mode in native support of session window

2021-08-10 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-36463: Assignee: Jungtaek Lim > Prohibit update mode in native support of session window > -

[jira] [Resolved] (SPARK-36463) Prohibit update mode in native support of session window

2021-08-10 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-36463. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33689 [https://gi

[jira] [Created] (SPARK-36473) Add non-unified memory metrics

2021-08-10 Thread angerszhu (Jira)
angerszhu created SPARK-36473: - Summary: Add non-unified memory metrics Key: SPARK-36473 URL: https://issues.apache.org/jira/browse/SPARK-36473 Project: Spark Issue Type: Improvement Co

[jira] [Assigned] (SPARK-36437) Enable binary operations with list-like Python objects

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36437: Assignee: (was: Apache Spark) > Enable binary operations with list-like Python object

[jira] [Commented] (SPARK-36437) Enable binary operations with list-like Python objects

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397012#comment-17397012 ] Apache Spark commented on SPARK-36437: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-36437) Enable binary operations with list-like Python objects

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36437: Assignee: Apache Spark > Enable binary operations with list-like Python objects > ---

[jira] [Commented] (SPARK-36464) Fix Underlying Size Variable Initialization in ChunkedByteBufferOutputStream for Writing Over 2GB Data

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397013#comment-17397013 ] Apache Spark commented on SPARK-36464: -- User 'dongjoon-hyun' has created a pull req

[jira] [Resolved] (SPARK-36052) Introduce pending pod limit for Spark on K8s

2021-08-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36052. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33492 [https://

[jira] [Commented] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2021-08-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397022#comment-17397022 ] Gengliang Wang commented on SPARK-34827: +1, Thank you [~dongjoon] > Support fe

[jira] [Resolved] (SPARK-36445) ANSI type coercion rule for date time operations

2021-08-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36445. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33666 [https:

[jira] [Assigned] (SPARK-32986) Add bucket scan info in explain output of FileSourceScanExec

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32986: Assignee: Apache Spark > Add bucket scan info in explain output of FileSourceScanExec > -

[jira] [Assigned] (SPARK-32986) Add bucket scan info in explain output of FileSourceScanExec

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32986: Assignee: (was: Apache Spark) > Add bucket scan info in explain output of FileSourceS

[jira] [Commented] (SPARK-32986) Add bucket scan info in explain output of FileSourceScanExec

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397042#comment-17397042 ] Apache Spark commented on SPARK-32986: -- User 'c21' has created a pull request for t

[jira] [Commented] (SPARK-36473) Add non-unified memory metrics

2021-08-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397056#comment-17397056 ] Hyukjin Kwon commented on SPARK-36473: -- [~angerszhuuu] can you fill the JIRA descri

[jira] [Updated] (SPARK-36467) Creating Hive managed table from spark to Hive, results in the table being in the external directory

2021-08-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36467: - Priority: Major (was: Blocker) > Creating Hive managed table from spark to Hive, results in the

[jira] [Updated] (SPARK-36467) Creating Hive managed table from spark to Hive, results in the table being in the external directory

2021-08-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36467: - Flags: (was: Important) > Creating Hive managed table from spark to Hive, results in the table

[jira] [Commented] (SPARK-36467) Creating Hive managed table from spark to Hive, results in the table being in the external directory

2021-08-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397057#comment-17397057 ] Hyukjin Kwon commented on SPARK-36467: -- [~galal97], Spark 2.4.x is EOL, and it won'

[jira] [Resolved] (SPARK-36459) Date Value '0001-01-01' changes to '0001-12-30' when inserted into a parquet hive table

2021-08-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36459. -- Resolution: Incomplete > Date Value '0001-01-01' changes to '0001-12-30' when inserted into a

[jira] [Created] (SPARK-36474) Mention pandas API on Spark in Spark overview pages

2021-08-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-36474: Summary: Mention pandas API on Spark in Spark overview pages Key: SPARK-36474 URL: https://issues.apache.org/jira/browse/SPARK-36474 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-36474) Mention pandas API on Spark in Spark overview pages

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36474: Assignee: Apache Spark > Mention pandas API on Spark in Spark overview pages > --

[jira] [Assigned] (SPARK-36474) Mention pandas API on Spark in Spark overview pages

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36474: Assignee: (was: Apache Spark) > Mention pandas API on Spark in Spark overview pages >

[jira] [Commented] (SPARK-36474) Mention pandas API on Spark in Spark overview pages

2021-08-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397082#comment-17397082 ] Apache Spark commented on SPARK-36474: -- User 'HyukjinKwon' has created a pull reque

[jira] [Resolved] (SPARK-36456) Clean up the depredation usage of o.a.c.io.IOUtils.closeQuietly

2021-08-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36456. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33682 [https://

[jira] [Assigned] (SPARK-36456) Clean up the depredation usage of o.a.c.io.IOUtils.closeQuietly

2021-08-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36456: - Assignee: Yang Jie > Clean up the depredation usage of o.a.c.io.IOUtils.closeQuietly >

[jira] [Commented] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2021-08-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397100#comment-17397100 ] Wenchen Fan commented on SPARK-34827: - Marking as a known issue LGTM. This is not a