[
https://issues.apache.org/jira/browse/SPARK-32696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-32696.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29539
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-32696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-32696:
---
Assignee: Kent Yao
> Get columns operation should handle interval column properly
> ---
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185649#comment-17185649
]
L. C. Hsieh commented on SPARK-19256:
-
> Hive on Tez: support zero and multiple file
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185648#comment-17185648
]
L. C. Hsieh commented on SPARK-19256:
-
> Do not allow for writing Hive non-ORC/Parqu
[
https://issues.apache.org/jira/browse/SPARK-19335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185643#comment-17185643
]
S commented on SPARK-19335:
---
Efficient UPSERT using Spark DataFrame - is it available now? If
[
https://issues.apache.org/jira/browse/SPARK-32705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-32705.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29547
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-32705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-32705:
---
Assignee: Leanken.Lin
> EmptyHashedRelation$; no valid constructor
> --
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Su updated SPARK-19256:
-
Affects Version/s: 2.2.0
2.3.0
2.4.0
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Su updated SPARK-19256:
-
Summary: Hive bucketing write support (was: Hive bucketing support)
> Hive bucketing write support
> --
Cheng Su created SPARK-32712:
Summary: Support writing Hive non-ORC/Parquet bucketed table
Key: SPARK-32712
URL: https://issues.apache.org/jira/browse/SPARK-32712
Project: Spark
Issue Type: Sub-
Cheng Su created SPARK-32711:
Summary: Write Hive ORC/Parquet bucketed table with hive
murmur3hash (for Hive 3)
Key: SPARK-32711
URL: https://issues.apache.org/jira/browse/SPARK-32711
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32693:
Assignee: (was: Apache Spark)
> Compare two dataframes with same schema except nullab
[
https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185621#comment-17185621
]
Apache Spark commented on SPARK-32693:
--
User 'viirya' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32693:
Assignee: Apache Spark
> Compare two dataframes with same schema except nullable property
Cheng Su created SPARK-32710:
Summary: Add Hive Murmur3Hash expression
Key: SPARK-32710
URL: https://issues.apache.org/jira/browse/SPARK-32710
Project: Spark
Issue Type: Sub-task
Compon
Cheng Su created SPARK-32709:
Summary: Write Hive ORC/Parquet bucketed table with hivehash (for
Hive 1,2)
Key: SPARK-32709
URL: https://issues.apache.org/jira/browse/SPARK-32709
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185617#comment-17185617
]
Cheng Su commented on SPARK-19256:
--
Hi all, after discussion with [~cloud_fan], we deci
[
https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh updated SPARK-32693:
Affects Version/s: 3.1.0
> Compare two dataframes with same schema except nullable property
>
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Su updated SPARK-19256:
-
Description:
Update (2020 by Cheng Su):
We use this JIRA to track progress for Hive bucketing write sup
[
https://issues.apache.org/jira/browse/SPARK-32190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151885#comment-17151885
]
Hyukjin Kwon edited comment on SPARK-32190 at 8/27/20, 3:56 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-32707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32707:
Assignee: (was: Apache Spark)
> Support File Based spark.authenticate secret in Mesos
[
https://issues.apache.org/jira/browse/SPARK-32707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32707:
Assignee: Apache Spark
> Support File Based spark.authenticate secret in Mesos Backend
>
[
https://issues.apache.org/jira/browse/SPARK-32707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185542#comment-17185542
]
Apache Spark commented on SPARK-32707:
--
User 'farhan5900' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-32706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185530#comment-17185530
]
Yuming Wang commented on SPARK-32706:
-
Yes, but not much, valid and invalid data are
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185523#comment-17185523
]
Mingjia Liu edited comment on SPARK-32708 at 8/27/20, 12:14 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185523#comment-17185523
]
Mingjia Liu edited comment on SPARK-32708 at 8/27/20, 12:11 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185523#comment-17185523
]
Mingjia Liu edited comment on SPARK-32708 at 8/27/20, 12:11 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185523#comment-17185523
]
Mingjia Liu edited comment on SPARK-32708 at 8/27/20, 12:10 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185526#comment-17185526
]
Mingjia Liu edited comment on SPARK-32708 at 8/27/20, 12:10 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingjia Liu updated SPARK-32708:
Comment: was deleted
(was: I can't repro the issue at Spark 3.0
*Fix:* 2.4 needs to partially fo
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185526#comment-17185526
]
Mingjia Liu commented on SPARK-32708:
-
I can't repro the issue at Spark 3.0
Fix:
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185523#comment-17185523
]
Mingjia Liu edited comment on SPARK-32708 at 8/27/20, 12:06 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185524#comment-17185524
]
Mingjia Liu commented on SPARK-32708:
-
This bug is brought to the surface by [link
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185523#comment-17185523
]
Mingjia Liu commented on SPARK-32708:
-
This difference happened at ReuseExchange rul
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185523#comment-17185523
]
Mingjia Liu edited comment on SPARK-32708 at 8/27/20, 12:01 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingjia Liu updated SPARK-32708:
Description:
Repro query:
{code:java}
spark.conf.set("spark.sql.exchange.reuse","true")
spark.read
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingjia Liu updated SPARK-32708:
Description:
Repro query:
{code:java}
spark.conf.set("spark.sql.exchange.reuse","true")
spark.read
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingjia Liu updated SPARK-32708:
Description:
Repro query:
{code:java}
spark.conf.set("spark.sql.exchange.reuse","true")
spark.read
[
https://issues.apache.org/jira/browse/SPARK-32708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingjia Liu updated SPARK-32708:
Summary: Query optimization fails to reuse exchange with DataSourceV2
(was: Query optimization fa
Mingjia Liu created SPARK-32708:
---
Summary: Query optimization fail to reuse exchange with
DataSourceV2
Key: SPARK-32708
URL: https://issues.apache.org/jira/browse/SPARK-32708
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-32092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185518#comment-17185518
]
Apache Spark commented on SPARK-32092:
--
User 'Louiszr' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-32092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185517#comment-17185517
]
Apache Spark commented on SPARK-32092:
--
User 'Louiszr' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-32643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Holden Karau resolved SPARK-32643.
--
Fix Version/s: 3.1.0
Resolution: Fixed
> [Cleanup] Consolidate state kept in ExecutorDe
[
https://issues.apache.org/jira/browse/SPARK-32643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Holden Karau reassigned SPARK-32643:
Assignee: Devesh Agrawal
> [Cleanup] Consolidate state kept in ExecutorDecommissionInfo w
[
https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185494#comment-17185494
]
Xiao Li commented on SPARK-27733:
-
BTW, is Hive community will to introduce the version
[
https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185493#comment-17185493
]
Xiao Li commented on SPARK-27733:
-
Let us wait for one more month. If no one is complain
[
https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185477#comment-17185477
]
Dongjoon Hyun commented on SPARK-27733:
---
[~csun]. There was a community discussion
[
https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185429#comment-17185429
]
Apache Spark commented on SPARK-32481:
--
User 'Udbhav30' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185430#comment-17185430
]
Apache Spark commented on SPARK-32481:
--
User 'Udbhav30' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32481:
--
Fix Version/s: (was: 3.1.0)
> Support truncate table to move the data to trash
> -
[
https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185419#comment-17185419
]
Dongjoon Hyun commented on SPARK-32481:
---
Apache Spark 3.1 will support Hadoop 2.7
[
https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32481:
Assignee: (was: Apache Spark)
> Support truncate table to move the data to trash
> --
[
https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32481:
Assignee: Apache Spark
> Support truncate table to move the data to trash
> -
[
https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reopened SPARK-32481:
---
Assignee: (was: Udbhav Agrawal)
This is reverted due to the compilation error with Had
[
https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185293#comment-17185293
]
Chao Sun commented on SPARK-27733:
--
bq. Apache Spark 3.0 will ship both Hive 1.2.1 buil
[
https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-32412:
-
Fix Version/s: (was: 3.1.0)
> Unify error handling for spark thrift server operations
>
[
https://issues.apache.org/jira/browse/SPARK-32511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-32511:
-
Fix Version/s: (was: 3.1.0)
> Add dropFields method to Column class
> --
[
https://issues.apache.org/jira/browse/SPARK-32701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-32701:
-
Issue Type: Improvement (was: Bug)
Priority: Minor (was: Major)
> mapreduce.fileoutputco
[
https://issues.apache.org/jira/browse/SPARK-32706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185247#comment-17185247
]
Sean R. Owen commented on SPARK-32706:
--
Do we care much about this path - is it com
[
https://issues.apache.org/jira/browse/SPARK-32706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-32706:
-
Priority: Minor (was: Major)
> Poor performance when casting invalid decimal string to decimal
Farhan Khan created SPARK-32707:
---
Summary: Support File Based spark.authenticate secret in Mesos
Backend
Key: SPARK-32707
URL: https://issues.apache.org/jira/browse/SPARK-32707
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185220#comment-17185220
]
Apache Spark commented on SPARK-32481:
--
User 'Udbhav30' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185218#comment-17185218
]
Apache Spark commented on SPARK-32481:
--
User 'Udbhav30' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-31831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185211#comment-17185211
]
Apache Spark commented on SPARK-31831:
--
User 'alismess-db' has created a pull reque
Yuming Wang created SPARK-32706:
---
Summary: Poor performance when casting invalid decimal string to
decimal type
Key: SPARK-32706
URL: https://issues.apache.org/jira/browse/SPARK-32706
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32183:
Assignee: Apache Spark
> User Guide - PySpark Usage Guide for Pandas with Apache Arrow
>
[
https://issues.apache.org/jira/browse/SPARK-32183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32183:
Assignee: (was: Apache Spark)
> User Guide - PySpark Usage Guide for Pandas with Apac
[
https://issues.apache.org/jira/browse/SPARK-32183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185076#comment-17185076
]
Apache Spark commented on SPARK-32183:
--
User 'HyukjinKwon' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-32705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185000#comment-17185000
]
Apache Spark commented on SPARK-32705:
--
User 'leanken' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-32705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32705:
Assignee: Apache Spark
> EmptyHashedRelation$; no valid constructor
> ---
[
https://issues.apache.org/jira/browse/SPARK-32705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32705:
Assignee: (was: Apache Spark)
> EmptyHashedRelation$; no valid constructor
>
Leanken.Lin created SPARK-32705:
---
Summary: EmptyHashedRelation$; no valid constructor
Key: SPARK-32705
URL: https://issues.apache.org/jira/browse/SPARK-32705
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-32361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17184977#comment-17184977
]
L. C. Hsieh commented on SPARK-32361:
-
Isn't it already in physical plan phase? Remo
73 matches
Mail list logo
