[jira] [Commented] (SPARK-33874) Spark may report PodRunning if there is a sidecar that has not exited

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259225#comment-17259225 ] Apache Spark commented on SPARK-33874: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33874) Spark may report PodRunning if there is a sidecar that has not exited

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259228#comment-17259228 ] Apache Spark commented on SPARK-33874: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33934) Support user-defined script command wrapper for more use case

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259214#comment-17259214 ] Apache Spark commented on SPARK-33934: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-33934) Support user-defined script command wrapper for more use case

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259215#comment-17259215 ] Apache Spark commented on SPARK-33934: -- User 'AngersZh' has created a pull request for this

[jira] [Updated] (SPARK-33844) InsertIntoDir failed since query column name contains ',' cause column type and column names size not equal

2021-01-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33844: Fix Version/s: 3.1.1 3.0.2 > InsertIntoDir failed since query column name

[jira] [Updated] (SPARK-34017) Pass json column information via pruneColumns()

2021-01-05 Thread Ted Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-34017: --- Description: Currently PushDownUtils#pruneColumns only passes root fields to

[jira] [Created] (SPARK-34017) Pass json column information via pruneColumns()

2021-01-05 Thread Ted Yu (Jira)
Ted Yu created SPARK-34017: -- Summary: Pass json column information via pruneColumns() Key: SPARK-34017 URL: https://issues.apache.org/jira/browse/SPARK-34017 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-33935) Fix CBOs cost function

2021-01-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33935: -- Affects Version/s: 3.1.0 2.4.7 3.0.1 > Fix CBOs

[jira] [Created] (SPARK-34016) SparkR not on CRAN (again)

2021-01-05 Thread Paul Johnson (Jira)
Paul Johnson created SPARK-34016: Summary: SparkR not on CRAN (again) Key: SPARK-34016 URL: https://issues.apache.org/jira/browse/SPARK-34016 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-34015) SparkR partition timing summary reports input time correctly

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259103#comment-17259103 ] Apache Spark commented on SPARK-34015: -- User 'WamBamBoozle' has created a pull request for this

[jira] [Commented] (SPARK-34015) SparkR partition timing summary reports input time correctly

2021-01-05 Thread Tom Howland (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259098#comment-17259098 ] Tom Howland commented on SPARK-34015: - Please review https://github.com/apache/spark/pull/31021 >

[jira] [Issue Comment Deleted] (SPARK-34015) SparkR partition timing summary reports input time correctly

2021-01-05 Thread Tom Howland (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Howland updated SPARK-34015: Comment: was deleted (was: Please review https://github.com/apache/spark/pull/31021) > SparkR

[jira] [Commented] (SPARK-34015) SparkR partition timing summary reports input time correctly

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259097#comment-17259097 ] Apache Spark commented on SPARK-34015: -- User 'WamBamBoozle' has created a pull request for this

[jira] [Assigned] (SPARK-34015) SparkR partition timing summary reports input time correctly

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34015: Assignee: Apache Spark > SparkR partition timing summary reports input time correctly >

[jira] [Assigned] (SPARK-34015) SparkR partition timing summary reports input time correctly

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34015: Assignee: (was: Apache Spark) > SparkR partition timing summary reports input time

[jira] [Resolved] (SPARK-33833) Allow Spark Structured Streaming report Kafka Lag through Burrow

2021-01-05 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-33833. - Resolution: Duplicate > Allow Spark Structured Streaming report Kafka Lag through Burrow >

[jira] [Commented] (SPARK-33833) Allow Spark Structured Streaming report Kafka Lag through Burrow

2021-01-05 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259094#comment-17259094 ] L. C. Hsieh commented on SPARK-33833: - I will close for now as duplicated. > Allow Spark Structured

[jira] [Created] (SPARK-34015) SparkR partition timing summary reports input time correctly

2021-01-05 Thread Tom Howland (Jira)
Tom Howland created SPARK-34015: --- Summary: SparkR partition timing summary reports input time correctly Key: SPARK-34015 URL: https://issues.apache.org/jira/browse/SPARK-34015 Project: Spark

[jira] [Assigned] (SPARK-34014) Ignore Distinct if it is the right child of a left semi or anti join

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34014: Assignee: Apache Spark > Ignore Distinct if it is the right child of a left semi or anti

[jira] [Assigned] (SPARK-34014) Ignore Distinct if it is the right child of a left semi or anti join

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34014: Assignee: (was: Apache Spark) > Ignore Distinct if it is the right child of a left

[jira] [Commented] (SPARK-34014) Ignore Distinct if it is the right child of a left semi or anti join

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259080#comment-17259080 ] Apache Spark commented on SPARK-34014: -- User 'tanelk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33950) ALTER TABLE .. DROP PARTITION doesn't refresh cache

2021-01-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259071#comment-17259071 ] Dongjoon Hyun commented on SPARK-33950: --- Thanks for recreating. > ALTER TABLE .. DROP PARTITION

[jira] [Comment Edited] (SPARK-33894) Word2VecSuite failed for Scala 2.13

2021-01-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259060#comment-17259060 ] Dongjoon Hyun edited comment on SPARK-33894 at 1/5/21, 5:09 PM:

[jira] [Commented] (SPARK-33894) Word2VecSuite failed for Scala 2.13

2021-01-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259060#comment-17259060 ] Dongjoon Hyun commented on SPARK-33894: --- [~hyukjin.kwon]. Before creating a new RC tag, this

[jira] [Created] (SPARK-34014) Ignore Distinct if it is the right child of a left semi or anti join

2021-01-05 Thread Tanel Kiis (Jira)
Tanel Kiis created SPARK-34014: -- Summary: Ignore Distinct if it is the right child of a left semi or anti join Key: SPARK-34014 URL: https://issues.apache.org/jira/browse/SPARK-34014 Project: Spark

[jira] [Assigned] (SPARK-33542) Group exception messages in catalyst/catalog

2021-01-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33542: --- Assignee: jiaan.geng > Group exception messages in catalyst/catalog >

[jira] [Resolved] (SPARK-33542) Group exception messages in catalyst/catalog

2021-01-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33542. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30870

[jira] [Commented] (SPARK-33948) ExpressionEncoderSuite failed in spark-branch-3.1-test-maven-hadoop-*-jdk-*-scala-2.13

2021-01-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258955#comment-17258955 ] Yang Jie commented on SPARK-33948: -- 21/01/05 22:07:03.867 ScalaTest-main-running-ExpressionEncoderSuite

[jira] [Commented] (SPARK-33948) ExpressionEncoderSuite failed in spark-branch-3.1-test-maven-hadoop-*-jdk-*-scala-2.13

2021-01-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258954#comment-17258954 ] Yang Jie commented on SPARK-33948: -- {code:java} /* 001 */ public java.lang.Object generate(Object[]

[jira] [Updated] (SPARK-33948) ExpressionEncoderSuite failed in spark-branch-3.1-test-maven-hadoop-*-jdk-*-scala-2.13

2021-01-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33948: - Summary: ExpressionEncoderSuite failed in spark-branch-3.1-test-maven-hadoop-*-jdk-*-scala-2.13 (was:

[jira] [Updated] (SPARK-33948) ExpressionEncoderSuite failed in spark-branch-3.1-test-maven-hadoop-*-jdk-*-scala-2.13

2021-01-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33948: - Description:

[jira] [Comment Edited] (SPARK-33948) branch-3.1 jenkins test failed in Scala 2.13

2021-01-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258945#comment-17258945 ] Yang Jie edited comment on SPARK-33948 at 1/5/21, 2:18 PM: --- [~cloud_fan] 

[jira] [Commented] (SPARK-33948) branch-3.1 jenkins test failed in Scala 2.13

2021-01-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258945#comment-17258945 ] Yang Jie commented on SPARK-33948: -- [~cloud_fan] ExpressionEncoderSuite  test both CODEGEN_ONLY and 

[jira] [Resolved] (SPARK-33949) Make approx_count_distinct result consistent whether Optimize rule exists or not

2021-01-05 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you resolved SPARK-33949. - Resolution: Won't Fix > Make approx_count_distinct result consistent whether Optimize rule

[jira] [Commented] (SPARK-34013) Data in redis was obtained using mapPartitions Sparkstreaming, which was not as expected

2021-01-05 Thread xiyang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258909#comment-17258909 ] xiyang commented on SPARK-34013: *I perform hmget "game_tag_union" "14899" "14450" "13249"

[jira] [Assigned] (SPARK-34009) Activate profile 'aarch64' based on OS

2021-01-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34009: Assignee: huangtianhua > Activate profile 'aarch64' based on OS >

[jira] [Resolved] (SPARK-34009) Activate profile 'aarch64' based on OS

2021-01-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34009. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31036

[jira] [Updated] (SPARK-34013) Data in redis was obtained using mapPartitions Sparkstreaming, which was not as expected

2021-01-05 Thread xiyang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiyang updated SPARK-34013: --- Description:   {code:java} rdd.mapPartitions(par => { val jedis: Jedis = AdJedisPoolUtils.getJedis

[jira] [Created] (SPARK-34013) Data in redis was obtained using mapPartitions Sparkstreaming, which was not as expected

2021-01-05 Thread xiyang (Jira)
xiyang created SPARK-34013: -- Summary: Data in redis was obtained using mapPartitions Sparkstreaming, which was not as expected Key: SPARK-34013 URL: https://issues.apache.org/jira/browse/SPARK-34013

[jira] [Assigned] (SPARK-34012) Keep behavior consistent when conf `spark.sql.legacy.parser.havingWithoutGroupByAsWhere` is true with migration guide

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34012: Assignee: Apache Spark > Keep behavior consistent when conf >

[jira] [Assigned] (SPARK-34012) Keep behavior consistent when conf `spark.sql.legacy.parser.havingWithoutGroupByAsWhere` is true with migration guide

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34012: Assignee: (was: Apache Spark) > Keep behavior consistent when conf >

[jira] [Commented] (SPARK-34012) Keep behavior consistent when conf `spark.sql.legacy.parser.havingWithoutGroupByAsWhere` is true with migration guide

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258864#comment-17258864 ] Apache Spark commented on SPARK-34012: -- User 'AngersZh' has created a pull request for this

[jira] [Created] (SPARK-34012) Keep behavior consistent when conf `spark.sql.legacy.parser.havingWithoutGroupByAsWhere` is true with migration guide

2021-01-05 Thread angerszhu (Jira)
angerszhu created SPARK-34012: - Summary: Keep behavior consistent when conf `spark.sql.legacy.parser.havingWithoutGroupByAsWhere` is true with migration guide Key: SPARK-34012 URL:

[jira] [Commented] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258844#comment-17258844 ] Apache Spark commented on SPARK-34011: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34011: Assignee: Maxim Gekk (was: Apache Spark) > ALTER TABLE .. RENAME TO PARTITION doesn't

[jira] [Assigned] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34011: Assignee: Apache Spark (was: Maxim Gekk) > ALTER TABLE .. RENAME TO PARTITION doesn't

[jira] [Commented] (SPARK-33935) Fix CBOs cost function

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258840#comment-17258840 ] Apache Spark commented on SPARK-33935: -- User 'tanelk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33935) Fix CBOs cost function

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258828#comment-17258828 ] Apache Spark commented on SPARK-33935: -- User 'tanelk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34010) Use python3 instead of python in SQL documentation build

2021-01-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34010: Assignee: Hyukjin Kwon > Use python3 instead of python in SQL documentation build >

[jira] [Resolved] (SPARK-34010) Use python3 instead of python in SQL documentation build

2021-01-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34010. -- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-34010) Use python3 instead of python in SQL documentation build

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34010: Assignee: (was: Apache Spark) > Use python3 instead of python in SQL documentation

[jira] [Assigned] (SPARK-34010) Use python3 instead of python in SQL documentation build

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34010: Assignee: Apache Spark > Use python3 instead of python in SQL documentation build >

[jira] [Commented] (SPARK-34010) Use python3 instead of python in SQL documentation build

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258821#comment-17258821 ] Apache Spark commented on SPARK-34010: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Issue Comment Deleted] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34011: --- Comment: was deleted (was: I am working on the issue.) > ALTER TABLE .. RENAME TO PARTITION

[jira] [Created] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34011: -- Summary: ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache Key: SPARK-34011 URL: https://issues.apache.org/jira/browse/SPARK-34011 Project: Spark Issue

[jira] [Commented] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258818#comment-17258818 ] Maxim Gekk commented on SPARK-34011: I am working on the issue. > ALTER TABLE .. RENAME TO

[jira] [Updated] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34011: --- Description: Here is the example to reproduce the issue: {code:sql} spark-sql> CREATE TABLE tbl1

[jira] [Created] (SPARK-34010) Use python3 instead of python in SQL documentation build

2021-01-05 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-34010: Summary: Use python3 instead of python in SQL documentation build Key: SPARK-34010 URL: https://issues.apache.org/jira/browse/SPARK-34010 Project: Spark

[jira] [Commented] (SPARK-34010) Use python3 instead of python in SQL documentation build

2021-01-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258816#comment-17258816 ] Hyukjin Kwon commented on SPARK-34010: -- This blocks release because the release container does not

[jira] [Updated] (SPARK-34010) Use python3 instead of python in SQL documentation build

2021-01-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34010: - Issue Type: Bug (was: Improvement) > Use python3 instead of python in SQL documentation build

[jira] [Resolved] (SPARK-33999) Make sbt unidoc success with JDK11

2021-01-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33999. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31023

[jira] [Updated] (SPARK-33999) Make sbt unidoc success with JDK11

2021-01-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33999: - Parent: (was: SPARK-24417) Issue Type: Bug (was: Sub-task) > Make sbt unidoc

[jira] [Commented] (SPARK-33100) Support parse the sql statements with c-style comments

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258792#comment-17258792 ] Apache Spark commented on SPARK-33100: -- User 'turboFei' has created a pull request for this issue:

[jira] [Commented] (SPARK-33100) Support parse the sql statements with c-style comments

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258791#comment-17258791 ] Apache Spark commented on SPARK-33100: -- User 'turboFei' has created a pull request for this issue:

[jira] [Commented] (SPARK-25708) HAVING without GROUP BY means global aggregate

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258787#comment-17258787 ] Apache Spark commented on SPARK-25708: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-25708) HAVING without GROUP BY means global aggregate

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258788#comment-17258788 ] Apache Spark commented on SPARK-25708: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-33844) InsertIntoDir failed since query column name contains ',' cause column type and column names size not equal

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258770#comment-17258770 ] Apache Spark commented on SPARK-33844: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-33844) InsertIntoDir failed since query column name contains ',' cause column type and column names size not equal

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258769#comment-17258769 ] Apache Spark commented on SPARK-33844: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-33844) InsertIntoDir failed since query column name contains ',' cause column type and column names size not equal

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258768#comment-17258768 ] Apache Spark commented on SPARK-33844: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-34009) Activate profile 'aarch64' based on OS

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258766#comment-17258766 ] Apache Spark commented on SPARK-34009: -- User 'huangtianhua' has created a pull request for this

[jira] [Assigned] (SPARK-34009) Activate profile 'aarch64' based on OS

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34009: Assignee: (was: Apache Spark) > Activate profile 'aarch64' based on OS >

[jira] [Assigned] (SPARK-34009) Activate profile 'aarch64' based on OS

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34009: Assignee: Apache Spark > Activate profile 'aarch64' based on OS >

[jira] [Commented] (SPARK-34009) Activate profile 'aarch64' based on OS

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258765#comment-17258765 ] Apache Spark commented on SPARK-34009: -- User 'huangtianhua' has created a pull request for this

[jira] [Commented] (SPARK-31952) The metric of MemoryBytesSpill is incorrect when doing Aggregate

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258761#comment-17258761 ] Apache Spark commented on SPARK-31952: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-31952) The metric of MemoryBytesSpill is incorrect when doing Aggregate

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258759#comment-17258759 ] Apache Spark commented on SPARK-31952: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33989) Strip auto-generated cast when using Cast.sql

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33989: Assignee: (was: Apache Spark) > Strip auto-generated cast when using Cast.sql >

[jira] [Assigned] (SPARK-33989) Strip auto-generated cast when using Cast.sql

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33989: Assignee: Apache Spark > Strip auto-generated cast when using Cast.sql >

[jira] [Commented] (SPARK-33989) Strip auto-generated cast when using Cast.sql

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258758#comment-17258758 ] Apache Spark commented on SPARK-33989: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-33100) Support parse the sql statements with c-style comments

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258754#comment-17258754 ] Apache Spark commented on SPARK-33100: -- User 'turboFei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34007) Downgrade scala-maven-plugin to 4.3.0

2021-01-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34007: Assignee: Hyukjin Kwon > Downgrade scala-maven-plugin to 4.3.0 >

[jira] [Created] (SPARK-34009) Activate profile 'aarch64' based on OS

2021-01-05 Thread huangtianhua (Jira)
huangtianhua created SPARK-34009: Summary: Activate profile 'aarch64' based on OS Key: SPARK-34009 URL: https://issues.apache.org/jira/browse/SPARK-34009 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-34007) Downgrade scala-maven-plugin to 4.3.0

2021-01-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34007. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 31031

[jira] [Assigned] (SPARK-34008) Upgrade derby to 10.14.2.0

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34008: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade derby to 10.14.2.0 >

[jira] [Assigned] (SPARK-34008) Upgrade derby to 10.14.2.0

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34008: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade derby to 10.14.2.0 >

[jira] [Commented] (SPARK-34008) Upgrade derby to 10.14.2.0

2021-01-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258742#comment-17258742 ] Apache Spark commented on SPARK-34008: -- User 'sarutak' has created a pull request for this issue:

[jira] [Created] (SPARK-34008) Upgrade derby to 10.14.2.0

2021-01-05 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34008: -- Summary: Upgrade derby to 10.14.2.0 Key: SPARK-34008 URL: https://issues.apache.org/jira/browse/SPARK-34008 Project: Spark Issue Type: Improvement

<    1   2