[
https://issues.apache.org/jira/browse/SPARK-34353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-34353.
--
Fix Version/s: 3.2.0
Assignee: zhengruifeng
Resolution: Fixed
[
https://issues.apache.org/jira/browse/SPARK-34479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34479:
Assignee: (was: Apache Spark)
> Add zstandard codec to
[
https://issues.apache.org/jira/browse/SPARK-34479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34479:
Assignee: Apache Spark
> Add zstandard codec to spark.sql.avro.compression.codec
>
[
https://issues.apache.org/jira/browse/SPARK-34479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292047#comment-17292047
]
Apache Spark commented on SPARK-34479:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292045#comment-17292045
]
Apache Spark commented on SPARK-34543:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292041#comment-17292041
]
Yuming Wang edited comment on SPARK-34542 at 2/27/21, 7:14 AM:
---
Benchmark
[
https://issues.apache.org/jira/browse/SPARK-34542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292041#comment-17292041
]
Yuming Wang commented on SPARK-34542:
-
{code:scala}
/*
* Licensed to the Apache Software Foundation
ed, for example
> {code:sql}
> spark-sql> create database test2 location 'datalake';
> 21/02/26 21:52:57 WARN ObjectStore: Failed to get database test2, returning
> NoSuchObjectException
> Time taken: 0.052 seconds
> spark-sql> desc database test;
> Database Name test
> Co
t gets fully qualified, for example
> {code:sql}
> spark-sql> create database test2 location 'datalake';
> 21/02/26 21:52:57 WARN ObjectStore: Failed to get database test2, returning
> NoSuchObjectException
> Time taken: 0.052 seconds
> spark-sql> desc database test;
> D
untime, the app can work with it, and
> if we create a database, it gets fully qualified, for example
> {code:sql}
> spark-sql> create database test2 location 'datalake';
> 21/02/26 21:52:57 WARN ObjectStore: Failed to get database test2, returning
> NoSuchObjectException
>
[
https://issues.apache.org/jira/browse/SPARK-34557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292032#comment-17292032
]
Apache Spark commented on SPARK-34557:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-34557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34557:
Assignee: Apache Spark
> Exclude Avro's transitive zstd-jni dependency
>
[
https://issues.apache.org/jira/browse/SPARK-34557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34557:
Assignee: (was: Apache Spark)
> Exclude Avro's transitive zstd-jni dependency
>
[
https://issues.apache.org/jira/browse/SPARK-34557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292031#comment-17292031
]
Apache Spark commented on SPARK-34557:
--
User 'dongjoon-hyun' has created a pull request for this
ing
NoSuchObjectException
Time taken: 0.052 seconds
spark-sql> desc database test;
Database Name test
Comment
Location
file:/Users/kentyao/Downloads/spark/spark-3.2.0-SNAPSHOT-bin-20210226/datalake/test.db
Owner kentyao
Time taken: 0.023 seconds, Fetched 4 row(s)
{code}
Another thing is that t
Dongjoon Hyun created SPARK-34557:
-
Summary: Exclude Avro's transitive zstd-jni dependency
Key: SPARK-34557
URL: https://issues.apache.org/jira/browse/SPARK-34557
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-33172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-33172.
--
Resolution: Incomplete
The PR looks inactive, so I'll close this.
> Spark SQL
[
https://issues.apache.org/jira/browse/SPARK-34556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291998#comment-17291998
]
Apache Spark commented on SPARK-34556:
--
User 'zsxwing' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34556:
Assignee: (was: Apache Spark)
> Checking duplicate static partition columns doesn't
[
https://issues.apache.org/jira/browse/SPARK-34556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291996#comment-17291996
]
Apache Spark commented on SPARK-34556:
--
User 'zsxwing' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34556:
Assignee: Apache Spark
> Checking duplicate static partition columns doesn't respect
Shixiong Zhu created SPARK-34556:
Summary: Checking duplicate static partition columns doesn't
respect case sensitive conf
Key: SPARK-34556
URL: https://issues.apache.org/jira/browse/SPARK-34556
[
https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291982#comment-17291982
]
Dongjoon Hyun commented on SPARK-34507:
---
Well, I meant your complete Spark application projects by
[
https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291954#comment-17291954
]
Baohe Zhang commented on SPARK-34545:
-
A simpler code to reproduce the error:
{code:python}
>>> from
[
https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291928#comment-17291928
]
Apache Spark commented on SPARK-34555:
--
User 'karenfeng' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291927#comment-17291927
]
Apache Spark commented on SPARK-34555:
--
User 'karenfeng' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34555:
Assignee: (was: Apache Spark)
> Resolve metadata output from DataFrame
>
[
https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34555:
Assignee: Apache Spark
> Resolve metadata output from DataFrame
>
[
https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karen Feng updated SPARK-34555:
---
Summary: Resolve metadata output from DataFrame (was: Resolve metadata
output)
> Resolve metadata
[
https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291906#comment-17291906
]
Karen Feng commented on SPARK-34555:
I'm working on this.
> Resolve metadata output
>
[
https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karen Feng updated SPARK-34555:
---
Description: Today, we can't resolve a metadata column from a Spark
dataframe from Scala with
[
https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-34543:
--
Fix Version/s: (was: 3.0.3)
> Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION
Karen Feng created SPARK-34555:
--
Summary: Resolve metadata output
Key: SPARK-34555
URL: https://issues.apache.org/jira/browse/SPARK-34555
Project: Spark
Issue Type: Bug
Components:
[
https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291896#comment-17291896
]
Baohe Zhang commented on SPARK-34545:
-
This is a correctness bug, so I would like to raise the
[
https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34545:
Priority: Blocker (was: Critical)
> PySpark Python UDF return inconsistent results when applying
[
https://issues.apache.org/jira/browse/SPARK-32703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-32703:
-
Description: Currently in {{SpecificParquetRecordReaderBase}} we use
deprecated APIs in a few places
[
https://issues.apache.org/jira/browse/SPARK-32703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-32703:
-
Summary: Replace deprecated API calls from SpecificParquetRecordReaderBase
(was: Enable dictionary
[
https://issues.apache.org/jira/browse/SPARK-32703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291880#comment-17291880
]
Apache Spark commented on SPARK-32703:
--
User 'sunchao' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291876#comment-17291876
]
Apache Spark commented on SPARK-34527:
--
User 'karenfeng' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34527:
Assignee: (was: Apache Spark)
> De-duplicated common columns cannot be resolved from
[
https://issues.apache.org/jira/browse/SPARK-34527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291875#comment-17291875
]
Apache Spark commented on SPARK-34527:
--
User 'karenfeng' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34527:
Assignee: Apache Spark
> De-duplicated common columns cannot be resolved from
[
https://issues.apache.org/jira/browse/SPARK-34392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-34392.
--
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31624
[
https://issues.apache.org/jira/browse/SPARK-34392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-34392:
Assignee: karl wang
> Invalid ID for offset-based ZoneId since Spark 3.0
>
[
https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291757#comment-17291757
]
Yakov Kerzhner commented on SPARK-34448:
The faster convergence when using standardization that
[
https://issues.apache.org/jira/browse/SPARK-29329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291477#comment-17291477
]
Yikun Jiang edited comment on SPARK-29329 at 2/26/21, 2:21 PM:
---
Thanks for
[
https://issues.apache.org/jira/browse/SPARK-33971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-33971.
--
Fix Version/s: 3.2.0
Assignee: Tanel Kiis
Resolution: Fixed
Resolved
[
https://issues.apache.org/jira/browse/SPARK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-34554:
Assignee: Maxim Gekk
> Implement the copy() method in ColumnarMap
>
[
https://issues.apache.org/jira/browse/SPARK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-34554.
--
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31663
[
https://issues.apache.org/jira/browse/SPARK-34549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-34549.
--
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31658
[
https://issues.apache.org/jira/browse/SPARK-34550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-34550.
--
Fix Version/s: 3.1.2
Resolution: Fixed
Issue resolved by pull request 31659
[
https://issues.apache.org/jira/browse/SPARK-34550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-34550:
Assignee: ulysses you
> Skip InSet null value during push filter to Hive metastore
>
[
https://issues.apache.org/jira/browse/SPARK-34533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-34533:
---
Assignee: Cheng Su
> Eliminate LEFT ANTI join to empty relation in AQE
>
[
https://issues.apache.org/jira/browse/SPARK-34533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-34533.
-
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31641
[
https://issues.apache.org/jira/browse/SPARK-34524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-34524.
-
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31637
[
https://issues.apache.org/jira/browse/SPARK-34524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-34524:
---
Assignee: Wenchen Fan
> simplify v2 partition commands resolution
>
[
https://issues.apache.org/jira/browse/SPARK-34551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-34551:
Assignee: Hyukjin Kwon
> generate-contributors.py, releaseutils.py and
[
https://issues.apache.org/jira/browse/SPARK-34553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-34553.
--
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31662
[
https://issues.apache.org/jira/browse/SPARK-34551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-34551.
--
Fix Version/s: 3.1.2
Resolution: Fixed
Issue resolved by pull request 31660
[
https://issues.apache.org/jira/browse/SPARK-34541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291567#comment-17291567
]
Apache Spark commented on SPARK-34541:
--
User 'yikf' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291565#comment-17291565
]
Apache Spark commented on SPARK-34541:
--
User 'yikf' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291562#comment-17291562
]
zhengruifeng commented on SPARK-34448:
--
I am not sure to: 1, center the vector in existing impl (I
[
https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291559#comment-17291559
]
zhengruifeng commented on SPARK-34448:
--
1, I just make a simple
[
https://issues.apache.org/jira/browse/SPARK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291534#comment-17291534
]
Apache Spark commented on SPARK-34554:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34554:
Assignee: (was: Apache Spark)
> Implement the copy() method in ColumnarMap
>
[
https://issues.apache.org/jira/browse/SPARK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34554:
Assignee: Apache Spark
> Implement the copy() method in ColumnarMap
>
[
https://issues.apache.org/jira/browse/SPARK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291533#comment-17291533
]
Apache Spark commented on SPARK-34554:
--
User 'MaxGekk' has created a pull request for this issue:
Maxim Gekk created SPARK-34554:
--
Summary: Implement the copy() method in ColumnarMap
Key: SPARK-34554
URL: https://issues.apache.org/jira/browse/SPARK-34554
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-34405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-34405:
-
Fix Version/s: (was: 3.1.2)
3.1.1
> The getMetricsSnapshot method of the
[
https://issues.apache.org/jira/browse/SPARK-34553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34553:
Assignee: (was: Apache Spark)
> Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in
[
https://issues.apache.org/jira/browse/SPARK-34553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34553:
Assignee: Apache Spark
> Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in
[
https://issues.apache.org/jira/browse/SPARK-34553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34553:
Assignee: Apache Spark
> Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in
[
https://issues.apache.org/jira/browse/SPARK-34553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291507#comment-17291507
]
Apache Spark commented on SPARK-34553:
--
User 'HyukjinKwon' has created a pull request for this
Hyukjin Kwon created SPARK-34553:
Summary: Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in
translate-contributors
Key: SPARK-34553
URL: https://issues.apache.org/jira/browse/SPARK-34553
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34552:
Assignee: (was: Apache Spark)
> ExternalCatalog listPartitions and
[
https://issues.apache.org/jira/browse/SPARK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34552:
Assignee: Apache Spark
> ExternalCatalog listPartitions and listPartitionsByFilter calls
[
https://issues.apache.org/jira/browse/SPARK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291501#comment-17291501
]
Apache Spark commented on SPARK-34552:
--
User 'yeshengm' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291500#comment-17291500
]
Apache Spark commented on SPARK-34552:
--
User 'yeshengm' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34551:
Assignee: (was: Apache Spark)
> generate-contributors.py, releaseutils.py and
[
https://issues.apache.org/jira/browse/SPARK-34551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291498#comment-17291498
]
Apache Spark commented on SPARK-34551:
--
User 'HyukjinKwon' has created a pull request for this
Yesheng Ma created SPARK-34552:
--
Summary: ExternalCatalog listPartitions and listPartitionsByFilter
calls should also restore metadata
Key: SPARK-34552
URL: https://issues.apache.org/jira/browse/SPARK-34552
[
https://issues.apache.org/jira/browse/SPARK-34551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34551:
Assignee: Apache Spark
> generate-contributors.py, releaseutils.py and
Hyukjin Kwon created SPARK-34551:
Summary: generate-contributors.py, releaseutils.py and
translate-contributors.py are broken
Key: SPARK-34551
URL: https://issues.apache.org/jira/browse/SPARK-34551
[
https://issues.apache.org/jira/browse/SPARK-29329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291477#comment-17291477
]
Yikun Jiang commented on SPARK-29329:
-
Thanks for [~hyukjin.kwon] bring me in here from [1]. I wrote
84 matches
Mail list logo