[jira] [Resolved] (SPARK-34353) CollectLimitExec avoid shuffle if input rdd has single partition

2021-02-26 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34353. -- Fix Version/s: 3.2.0 Assignee: zhengruifeng Resolution: Fixed

[jira] [Assigned] (SPARK-34479) Add zstandard codec to spark.sql.avro.compression.codec

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34479: Assignee: (was: Apache Spark) > Add zstandard codec to

[jira] [Assigned] (SPARK-34479) Add zstandard codec to spark.sql.avro.compression.codec

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34479: Assignee: Apache Spark > Add zstandard codec to spark.sql.avro.compression.codec >

[jira] [Commented] (SPARK-34479) Add zstandard codec to spark.sql.avro.compression.codec

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292047#comment-17292047 ] Apache Spark commented on SPARK-34479: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292045#comment-17292045 ] Apache Spark commented on SPARK-34543: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-34542) Upgrade Parquet to 1.12.0

2021-02-26 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292041#comment-17292041 ] Yuming Wang edited comment on SPARK-34542 at 2/27/21, 7:14 AM: --- Benchmark

[jira] [Commented] (SPARK-34542) Upgrade Parquet to 1.12.0

2021-02-26 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292041#comment-17292041 ] Yuming Wang commented on SPARK-34542: - {code:scala} /* * Licensed to the Apache Software Foundation

[jira] [Assigned] (SPARK-34558) warehouse path should be resolved ahead of populating and use

2021-02-26 Thread Apache Spark (Jira)
ed, for example > {code:sql} > spark-sql> create database test2 location 'datalake'; > 21/02/26 21:52:57 WARN ObjectStore: Failed to get database test2, returning > NoSuchObjectException > Time taken: 0.052 seconds > spark-sql> desc database test; > Database Name test > Co

[jira] [Assigned] (SPARK-34558) warehouse path should be resolved ahead of populating and use

2021-02-26 Thread Apache Spark (Jira)
t gets fully qualified, for example > {code:sql} > spark-sql> create database test2 location 'datalake'; > 21/02/26 21:52:57 WARN ObjectStore: Failed to get database test2, returning > NoSuchObjectException > Time taken: 0.052 seconds > spark-sql> desc database test; > D

[jira] [Commented] (SPARK-34558) warehouse path should be resolved ahead of populating and use

2021-02-26 Thread Apache Spark (Jira)
untime, the app can work with it, and > if we create a database, it gets fully qualified, for example > {code:sql} > spark-sql> create database test2 location 'datalake'; > 21/02/26 21:52:57 WARN ObjectStore: Failed to get database test2, returning > NoSuchObjectException >

[jira] [Commented] (SPARK-34557) Exclude Avro's transitive zstd-jni dependency

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292032#comment-17292032 ] Apache Spark commented on SPARK-34557: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-34557) Exclude Avro's transitive zstd-jni dependency

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34557: Assignee: Apache Spark > Exclude Avro's transitive zstd-jni dependency >

[jira] [Assigned] (SPARK-34557) Exclude Avro's transitive zstd-jni dependency

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34557: Assignee: (was: Apache Spark) > Exclude Avro's transitive zstd-jni dependency >

[jira] [Commented] (SPARK-34557) Exclude Avro's transitive zstd-jni dependency

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292031#comment-17292031 ] Apache Spark commented on SPARK-34557: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-34558) warehouse path should be resolved ahead of populating and use

2021-02-26 Thread Kent Yao (Jira)
ing NoSuchObjectException Time taken: 0.052 seconds spark-sql> desc database test; Database Name test Comment Location file:/Users/kentyao/Downloads/spark/spark-3.2.0-SNAPSHOT-bin-20210226/datalake/test.db Owner kentyao Time taken: 0.023 seconds, Fetched 4 row(s) {code} Another thing is that t

[jira] [Created] (SPARK-34557) Exclude Avro's transitive zstd-jni dependency

2021-02-26 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-34557: - Summary: Exclude Avro's transitive zstd-jni dependency Key: SPARK-34557 URL: https://issues.apache.org/jira/browse/SPARK-34557 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-33172) Spark SQL CodeGenerator does not check for UserDefined type

2021-02-26 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33172. -- Resolution: Incomplete The PR looks inactive, so I'll close this. > Spark SQL

[jira] [Commented] (SPARK-34556) Checking duplicate static partition columns doesn't respect case sensitive conf

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291998#comment-17291998 ] Apache Spark commented on SPARK-34556: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34556) Checking duplicate static partition columns doesn't respect case sensitive conf

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34556: Assignee: (was: Apache Spark) > Checking duplicate static partition columns doesn't

[jira] [Commented] (SPARK-34556) Checking duplicate static partition columns doesn't respect case sensitive conf

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291996#comment-17291996 ] Apache Spark commented on SPARK-34556: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34556) Checking duplicate static partition columns doesn't respect case sensitive conf

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34556: Assignee: Apache Spark > Checking duplicate static partition columns doesn't respect

[jira] [Created] (SPARK-34556) Checking duplicate static partition columns doesn't respect case sensitive conf

2021-02-26 Thread Shixiong Zhu (Jira)
Shixiong Zhu created SPARK-34556: Summary: Checking duplicate static partition columns doesn't respect case sensitive conf Key: SPARK-34556 URL: https://issues.apache.org/jira/browse/SPARK-34556

[jira] [Commented] (SPARK-34507) Spark artefacts built against Scala 2.13 incorrectly depend on Scala 2.12

2021-02-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291982#comment-17291982 ] Dongjoon Hyun commented on SPARK-34507: --- Well, I meant your complete Spark application projects by

[jira] [Commented] (SPARK-34545) PySpark Python UDF return inconsistent results when applying 2 UDFs with different return type to 2 columns together

2021-02-26 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291954#comment-17291954 ] Baohe Zhang commented on SPARK-34545: - A simpler code to reproduce the error: {code:python} >>> from

[jira] [Commented] (SPARK-34555) Resolve metadata output from DataFrame

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291928#comment-17291928 ] Apache Spark commented on SPARK-34555: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Commented] (SPARK-34555) Resolve metadata output from DataFrame

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291927#comment-17291927 ] Apache Spark commented on SPARK-34555: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34555) Resolve metadata output from DataFrame

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34555: Assignee: (was: Apache Spark) > Resolve metadata output from DataFrame >

[jira] [Assigned] (SPARK-34555) Resolve metadata output from DataFrame

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34555: Assignee: Apache Spark > Resolve metadata output from DataFrame >

[jira] [Updated] (SPARK-34555) Resolve metadata output from DataFrame

2021-02-26 Thread Karen Feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Feng updated SPARK-34555: --- Summary: Resolve metadata output from DataFrame (was: Resolve metadata output) > Resolve metadata

[jira] [Commented] (SPARK-34555) Resolve metadata output

2021-02-26 Thread Karen Feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291906#comment-17291906 ] Karen Feng commented on SPARK-34555: I'm working on this. > Resolve metadata output >

[jira] [Updated] (SPARK-34555) Resolve metadata output

2021-02-26 Thread Karen Feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Feng updated SPARK-34555: --- Description: Today, we can't resolve a metadata column from a Spark dataframe from Scala with

[jira] [Updated] (SPARK-34543) Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

2021-02-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34543: -- Fix Version/s: (was: 3.0.3) > Respect case sensitivity in V1 ALTER TABLE .. SET LOCATION

[jira] [Created] (SPARK-34555) Resolve metadata output

2021-02-26 Thread Karen Feng (Jira)
Karen Feng created SPARK-34555: -- Summary: Resolve metadata output Key: SPARK-34555 URL: https://issues.apache.org/jira/browse/SPARK-34555 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-34545) PySpark Python UDF return inconsistent results when applying 2 UDFs with different return type to 2 columns together

2021-02-26 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291896#comment-17291896 ] Baohe Zhang commented on SPARK-34545: - This is a correctness bug, so I would like to raise the

[jira] [Updated] (SPARK-34545) PySpark Python UDF return inconsistent results when applying 2 UDFs with different return type to 2 columns together

2021-02-26 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baohe Zhang updated SPARK-34545: Priority: Blocker (was: Critical) > PySpark Python UDF return inconsistent results when applying

[jira] [Updated] (SPARK-32703) Replace deprecated API calls from SpecificParquetRecordReaderBase

2021-02-26 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-32703: - Description: Currently in {{SpecificParquetRecordReaderBase}} we use deprecated APIs in a few places

[jira] [Updated] (SPARK-32703) Replace deprecated API calls from SpecificParquetRecordReaderBase

2021-02-26 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-32703: - Summary: Replace deprecated API calls from SpecificParquetRecordReaderBase (was: Enable dictionary

[jira] [Commented] (SPARK-32703) Enable dictionary filtering for Parquet vectorized reader

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291880#comment-17291880 ] Apache Spark commented on SPARK-32703: -- User 'sunchao' has created a pull request for this issue:

[jira] [Commented] (SPARK-34527) De-duplicated common columns cannot be resolved from USING/NATURAL JOIN

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291876#comment-17291876 ] Apache Spark commented on SPARK-34527: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34527) De-duplicated common columns cannot be resolved from USING/NATURAL JOIN

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34527: Assignee: (was: Apache Spark) > De-duplicated common columns cannot be resolved from

[jira] [Commented] (SPARK-34527) De-duplicated common columns cannot be resolved from USING/NATURAL JOIN

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291875#comment-17291875 ] Apache Spark commented on SPARK-34527: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34527) De-duplicated common columns cannot be resolved from USING/NATURAL JOIN

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34527: Assignee: Apache Spark > De-duplicated common columns cannot be resolved from

[jira] [Resolved] (SPARK-34392) Invalid ID for offset-based ZoneId since Spark 3.0

2021-02-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34392. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31624

[jira] [Assigned] (SPARK-34392) Invalid ID for offset-based ZoneId since Spark 3.0

2021-02-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34392: Assignee: karl wang > Invalid ID for offset-based ZoneId since Spark 3.0 >

[jira] [Commented] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-26 Thread Yakov Kerzhner (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291757#comment-17291757 ] Yakov Kerzhner commented on SPARK-34448: The faster convergence when using standardization that

[jira] [Comment Edited] (SPARK-29329) maven incremental builds not working

2021-02-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291477#comment-17291477 ] Yikun Jiang edited comment on SPARK-29329 at 2/26/21, 2:21 PM: --- Thanks for

[jira] [Resolved] (SPARK-33971) Eliminate distinct from more aggregates

2021-02-26 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33971. -- Fix Version/s: 3.2.0 Assignee: Tanel Kiis Resolution: Fixed Resolved

[jira] [Assigned] (SPARK-34554) Implement the copy() method in ColumnarMap

2021-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34554: Assignee: Maxim Gekk > Implement the copy() method in ColumnarMap >

[jira] [Resolved] (SPARK-34554) Implement the copy() method in ColumnarMap

2021-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34554. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31663

[jira] [Resolved] (SPARK-34549) Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844

2021-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34549. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31658

[jira] [Resolved] (SPARK-34550) Skip InSet null value during push filter to Hive metastore

2021-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34550. -- Fix Version/s: 3.1.2 Resolution: Fixed Issue resolved by pull request 31659

[jira] [Assigned] (SPARK-34550) Skip InSet null value during push filter to Hive metastore

2021-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34550: Assignee: ulysses you > Skip InSet null value during push filter to Hive metastore >

[jira] [Assigned] (SPARK-34533) Eliminate LEFT ANTI join to empty relation in AQE

2021-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34533: --- Assignee: Cheng Su > Eliminate LEFT ANTI join to empty relation in AQE >

[jira] [Resolved] (SPARK-34533) Eliminate LEFT ANTI join to empty relation in AQE

2021-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34533. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31641

[jira] [Resolved] (SPARK-34524) simplify v2 partition commands resolution

2021-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34524. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31637

[jira] [Assigned] (SPARK-34524) simplify v2 partition commands resolution

2021-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34524: --- Assignee: Wenchen Fan > simplify v2 partition commands resolution >

[jira] [Assigned] (SPARK-34551) generate-contributors.py, releaseutils.py and translate-contributors.py are broken

2021-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34551: Assignee: Hyukjin Kwon > generate-contributors.py, releaseutils.py and

[jira] [Resolved] (SPARK-34553) Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in translate-contributors

2021-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34553. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31662

[jira] [Resolved] (SPARK-34551) generate-contributors.py, releaseutils.py and translate-contributors.py are broken

2021-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34551. -- Fix Version/s: 3.1.2 Resolution: Fixed Issue resolved by pull request 31660

[jira] [Commented] (SPARK-34541) Fixed an issue where data could not be cleaned up when unregisterShuffle

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291567#comment-17291567 ] Apache Spark commented on SPARK-34541: -- User 'yikf' has created a pull request for this issue:

[jira] [Commented] (SPARK-34541) Fixed an issue where data could not be cleaned up when unregisterShuffle

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291565#comment-17291565 ] Apache Spark commented on SPARK-34541: -- User 'yikf' has created a pull request for this issue:

[jira] [Commented] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-26 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291562#comment-17291562 ] zhengruifeng commented on SPARK-34448: -- I am not sure to: 1, center the vector in existing impl (I

[jira] [Commented] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-26 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291559#comment-17291559 ] zhengruifeng commented on SPARK-34448: -- 1, I just make a simple

[jira] [Commented] (SPARK-34554) Implement the copy() method in ColumnarMap

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291534#comment-17291534 ] Apache Spark commented on SPARK-34554: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34554) Implement the copy() method in ColumnarMap

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34554: Assignee: (was: Apache Spark) > Implement the copy() method in ColumnarMap >

[jira] [Assigned] (SPARK-34554) Implement the copy() method in ColumnarMap

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34554: Assignee: Apache Spark > Implement the copy() method in ColumnarMap >

[jira] [Commented] (SPARK-34554) Implement the copy() method in ColumnarMap

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291533#comment-17291533 ] Apache Spark commented on SPARK-34554: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-34554) Implement the copy() method in ColumnarMap

2021-02-26 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34554: -- Summary: Implement the copy() method in ColumnarMap Key: SPARK-34554 URL: https://issues.apache.org/jira/browse/SPARK-34554 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34405) The getMetricsSnapshot method of the PrometheusServlet class has a wrong value

2021-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34405: - Fix Version/s: (was: 3.1.2) 3.1.1 > The getMetricsSnapshot method of the

[jira] [Assigned] (SPARK-34553) Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in translate-contributors

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34553: Assignee: (was: Apache Spark) > Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in

[jira] [Assigned] (SPARK-34553) Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in translate-contributors

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34553: Assignee: Apache Spark > Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in

[jira] [Assigned] (SPARK-34553) Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in translate-contributors

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34553: Assignee: Apache Spark > Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in

[jira] [Commented] (SPARK-34553) Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in translate-contributors

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291507#comment-17291507 ] Apache Spark commented on SPARK-34553: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-34553) Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in translate-contributors

2021-02-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-34553: Summary: Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in translate-contributors Key: SPARK-34553 URL: https://issues.apache.org/jira/browse/SPARK-34553 Project: Spark

[jira] [Assigned] (SPARK-34552) ExternalCatalog listPartitions and listPartitionsByFilter calls should also restore metadata

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34552: Assignee: (was: Apache Spark) > ExternalCatalog listPartitions and

[jira] [Assigned] (SPARK-34552) ExternalCatalog listPartitions and listPartitionsByFilter calls should also restore metadata

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34552: Assignee: Apache Spark > ExternalCatalog listPartitions and listPartitionsByFilter calls

[jira] [Commented] (SPARK-34552) ExternalCatalog listPartitions and listPartitionsByFilter calls should also restore metadata

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291501#comment-17291501 ] Apache Spark commented on SPARK-34552: -- User 'yeshengm' has created a pull request for this issue:

[jira] [Commented] (SPARK-34552) ExternalCatalog listPartitions and listPartitionsByFilter calls should also restore metadata

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291500#comment-17291500 ] Apache Spark commented on SPARK-34552: -- User 'yeshengm' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34551) generate-contributors.py, releaseutils.py and translate-contributors.py are broken

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34551: Assignee: (was: Apache Spark) > generate-contributors.py, releaseutils.py and

[jira] [Commented] (SPARK-34551) generate-contributors.py, releaseutils.py and translate-contributors.py are broken

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291498#comment-17291498 ] Apache Spark commented on SPARK-34551: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-34552) ExternalCatalog listPartitions and listPartitionsByFilter calls should also restore metadata

2021-02-26 Thread Yesheng Ma (Jira)
Yesheng Ma created SPARK-34552: -- Summary: ExternalCatalog listPartitions and listPartitionsByFilter calls should also restore metadata Key: SPARK-34552 URL: https://issues.apache.org/jira/browse/SPARK-34552

[jira] [Assigned] (SPARK-34551) generate-contributors.py, releaseutils.py and translate-contributors.py are broken

2021-02-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34551: Assignee: Apache Spark > generate-contributors.py, releaseutils.py and

[jira] [Created] (SPARK-34551) generate-contributors.py, releaseutils.py and translate-contributors.py are broken

2021-02-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-34551: Summary: generate-contributors.py, releaseutils.py and translate-contributors.py are broken Key: SPARK-34551 URL: https://issues.apache.org/jira/browse/SPARK-34551

[jira] [Commented] (SPARK-29329) maven incremental builds not working

2021-02-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291477#comment-17291477 ] Yikun Jiang commented on SPARK-29329: - Thanks for [~hyukjin.kwon] bring me in here from [1]. I wrote