[jira] [Assigned] (SPARK-34171) Add SHOW COLUMNS as table valued function

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34171: Assignee: (was: Apache Spark) > Add SHOW COLUMNS as table valued function >

[jira] [Commented] (SPARK-34171) Add SHOW COLUMNS as table valued function

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280407#comment-17280407 ] Apache Spark commented on SPARK-34171: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34171) Add SHOW COLUMNS as table valued function

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34171: Assignee: Apache Spark > Add SHOW COLUMNS as table valued function >

[jira] [Resolved] (SPARK-34390) Enable Zstandard buffer pool by default

2021-02-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34390. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31502

[jira] [Assigned] (SPARK-34390) Enable Zstandard buffer pool by default

2021-02-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34390: - Assignee: Dongjoon Hyun > Enable Zstandard buffer pool by default >

[jira] [Assigned] (SPARK-34174) Add SHOW PArTITIONS as table valued function

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34174: Assignee: (was: Apache Spark) > Add SHOW PArTITIONS as table valued function >

[jira] [Commented] (SPARK-34174) Add SHOW PArTITIONS as table valued function

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280402#comment-17280402 ] Apache Spark commented on SPARK-34174: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34174) Add SHOW PArTITIONS as table valued function

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34174: Assignee: Apache Spark > Add SHOW PArTITIONS as table valued function >

[jira] [Updated] (SPARK-33979) Filter predicate reorder

2021-02-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33979: Description: Reorder filter predicate to improve query performance: {noformat} others < In < Like

[jira] [Updated] (SPARK-33979) Filter predicate reorder

2021-02-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33979: Description: Reorder filter predicate to improve query performance: {noformat} others < In < Like

[jira] [Commented] (SPARK-34172) Add SHOW DATABASES as table valued function

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280394#comment-17280394 ] Apache Spark commented on SPARK-34172: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34172) Add SHOW DATABASES as table valued function

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34172: Assignee: Apache Spark > Add SHOW DATABASES as table valued function >

[jira] [Assigned] (SPARK-34172) Add SHOW DATABASES as table valued function

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34172: Assignee: (was: Apache Spark) > Add SHOW DATABASES as table valued function >

[jira] [Commented] (SPARK-34172) Add SHOW DATABASES as table valued function

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280393#comment-17280393 ] Apache Spark commented on SPARK-34172: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-34344) Have functionality to trace back Spark SQL queries from the application ID that got submitted on YARN

2021-02-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280383#comment-17280383 ] Hyukjin Kwon commented on SPARK-34344: -- [~arpan3189] can you update the JIRA description to

[jira] [Comment Edited] (SPARK-34349) No python3 in docker images

2021-02-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280382#comment-17280382 ] Hyukjin Kwon edited comment on SPARK-34349 at 2/7/21, 5:44 AM: --- I think

[jira] [Commented] (SPARK-34349) No python3 in docker images

2021-02-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280382#comment-17280382 ] Hyukjin Kwon commented on SPARK-34349: -- I think it's fined in the upstream. It would be great if

[jira] [Commented] (SPARK-34358) Add API for all built-in expresssion functions

2021-02-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280380#comment-17280380 ] Hyukjin Kwon commented on SPARK-34358: -- Please link stackoverflow questions or mailing list to

[jira] [Resolved] (SPARK-34362) scala.MatchError: 2.3 (of class java.lang.String) for Hive on Google Dataproc 1.4

2021-02-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34362. -- Resolution: Won't Fix It is not supported in Apache Spark, and new features would not be

[jira] [Commented] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

2021-02-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280378#comment-17280378 ] Hyukjin Kwon commented on SPARK-34389: -- Does that happen specifically in Kubernates only? It would

[jira] [Updated] (SPARK-34342) Format DateLiteral and TimestampLiteral toString

2021-02-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34342: -- Summary: Format DateLiteral and TimestampLiteral toString (was: Format Literal toString) >

[jira] [Assigned] (SPARK-34342) Format Literal toString

2021-02-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34342: - Assignee: Yuming Wang > Format Literal toString > --- > >

[jira] [Resolved] (SPARK-34342) Format Literal toString

2021-02-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34342. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31455

[jira] [Issue Comment Deleted] (SPARK-34391) Upgrade commons-io to 2.8.0

2021-02-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34391: -- Comment: was deleted (was: User 'dongjoon-hyun' has created a pull request for this issue:

[jira] [Commented] (SPARK-34391) Upgrade commons-io to 2.8.0

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280363#comment-17280363 ] Apache Spark commented on SPARK-34391: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-34391) Upgrade commons-io to 2.8.0

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280362#comment-17280362 ] Apache Spark commented on SPARK-34391: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-34391) Upgrade commons-io to 2.8.0

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34391: Assignee: (was: Apache Spark) > Upgrade commons-io to 2.8.0 >

[jira] [Assigned] (SPARK-34391) Upgrade commons-io to 2.8.0

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34391: Assignee: Apache Spark > Upgrade commons-io to 2.8.0 > --- > >

[jira] [Created] (SPARK-34391) Upgrade commons-io to 2.8.0

2021-02-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-34391: - Summary: Upgrade commons-io to 2.8.0 Key: SPARK-34391 URL: https://issues.apache.org/jira/browse/SPARK-34391 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-34390) Enable Zstandard buffer pool by default

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34390: Assignee: Apache Spark > Enable Zstandard buffer pool by default >

[jira] [Assigned] (SPARK-34390) Enable Zstandard buffer pool by default

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34390: Assignee: (was: Apache Spark) > Enable Zstandard buffer pool by default >

[jira] [Commented] (SPARK-34390) Enable Zstandard buffer pool by default

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280357#comment-17280357 ] Apache Spark commented on SPARK-34390: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-34390) Enable Zstandard buffer pool by default

2021-02-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-34390: - Summary: Enable Zstandard buffer pool by default Key: SPARK-34390 URL: https://issues.apache.org/jira/browse/SPARK-34390 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33501) Encoding is not working if multiLine option is true.

2021-02-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280351#comment-17280351 ] Hyukjin Kwon commented on SPARK-33501: -- It is fixed Spark 3.0+. > Encoding is not working if

[jira] [Resolved] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

2021-02-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34370. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31501

[jira] [Assigned] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

2021-02-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34370: - Assignee: Attila Zsolt Piros > Supporting Avro schema evolution for partitioned Hive

[jira] [Created] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

2021-02-06 Thread Ranju (Jira)
Ranju created SPARK-34389: - Summary: Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation Key: SPARK-34389 URL:

[jira] [Resolved] (SPARK-34385) Unwrap SparkUpgradeException in v2 Parquet datasource

2021-02-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34385. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31497

[jira] [Assigned] (SPARK-34385) Unwrap SparkUpgradeException in v2 Parquet datasource

2021-02-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34385: - Assignee: Maxim Gekk > Unwrap SparkUpgradeException in v2 Parquet datasource >

[jira] [Resolved] (SPARK-34387) Add ZStandardBenchmark

2021-02-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34387. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31498

[jira] [Assigned] (SPARK-34387) Add ZStandardBenchmark

2021-02-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34387: - Assignee: Dongjoon Hyun > Add ZStandardBenchmark > -- > >

[jira] [Assigned] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34370: Assignee: Apache Spark > Supporting Avro schema evolution for partitioned Hive tables

[jira] [Assigned] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34370: Assignee: (was: Apache Spark) > Supporting Avro schema evolution for partitioned

[jira] [Assigned] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34370: Assignee: Apache Spark > Supporting Avro schema evolution for partitioned Hive tables

[jira] [Updated] (SPARK-34356) OVR transform fix potential column conflict

2021-02-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34356: - Priority: Minor (was: Major) > OVR transform fix potential column conflict >

[jira] [Commented] (SPARK-34370) Supporting Avro schema evolution for partitioned Hive tables using "avro.schema.url"

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280328#comment-17280328 ] Apache Spark commented on SPARK-34370: -- User 'attilapiros' has created a pull request for this

[jira] [Resolved] (SPARK-34356) OVR transform fix potential column conflict

2021-02-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34356. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31472

[jira] [Commented] (SPARK-34388) Propogate the registered UDF names to ScalaUDAF and ScalaAggregator

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280314#comment-17280314 ] Apache Spark commented on SPARK-34388: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34388) Propogate the registered UDF names to ScalaUDAF and ScalaAggregator

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34388: Assignee: Apache Spark > Propogate the registered UDF names to ScalaUDAF and

[jira] [Assigned] (SPARK-34388) Propogate the registered UDF names to ScalaUDAF and ScalaAggregator

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34388: Assignee: (was: Apache Spark) > Propogate the registered UDF names to ScalaUDAF and

[jira] [Commented] (SPARK-34388) Propogate the registered UDF names to ScalaUDAF and ScalaAggregator

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280313#comment-17280313 ] Apache Spark commented on SPARK-34388: -- User 'imback82' has created a pull request for this issue:

[jira] [Created] (SPARK-34388) Propogate the registered UDF names to ScalaUDAF and ScalaAggregator

2021-02-06 Thread Terry Kim (Jira)
Terry Kim created SPARK-34388: - Summary: Propogate the registered UDF names to ScalaUDAF and ScalaAggregator Key: SPARK-34388 URL: https://issues.apache.org/jira/browse/SPARK-34388 Project: Spark

[jira] [Commented] (SPARK-31891) `ALTER TABLE multipartIdentifier RECOVER PARTITIONS` should drop partition if partition specific location is not exist any more

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280283#comment-17280283 ] Apache Spark commented on SPARK-31891: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-34386) "Proleptic" date off by 10 days when returned by .collectAsList

2021-02-06 Thread Marek Byszewski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Byszewski resolved SPARK-34386. - Resolution: Not A Problem > "Proleptic" date off by 10 days when returned by

[jira] [Commented] (SPARK-34386) "Proleptic" date off by 10 days when returned by .collectAsList

2021-02-06 Thread Marek Byszewski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280274#comment-17280274 ] Marek Byszewski commented on SPARK-34386: - Thank you Maxim. I read the article, however, I

[jira] [Commented] (SPARK-34386) "Proleptic" date off by 10 days when returned by .collectAsList

2021-02-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280269#comment-17280269 ] Maxim Gekk commented on SPARK-34386: [~bysza] You can find more details in the blog post: 

[jira] [Commented] (SPARK-34386) "Proleptic" date off by 10 days when returned by .collectAsList

2021-02-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280268#comment-17280268 ] Maxim Gekk commented on SPARK-34386: [~bysza] Thanks for the ping. This is expected behavior,

[jira] [Resolved] (SPARK-34141) ExtractGenerator analyzer should handle lazy projectlists

2021-02-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34141. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31213

[jira] [Assigned] (SPARK-34141) ExtractGenerator analyzer should handle lazy projectlists

2021-02-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34141: Assignee: Tanel Kiis > ExtractGenerator analyzer should handle lazy projectlists >

[jira] [Assigned] (SPARK-34291) LSH hashDistance optimization

2021-02-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34291: Assignee: zhengruifeng > LSH hashDistance optimization > - >

[jira] [Resolved] (SPARK-34291) LSH hashDistance optimization

2021-02-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34291. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31394

[jira] [Commented] (SPARK-34387) Add ZStandardBenchmark

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280258#comment-17280258 ] Apache Spark commented on SPARK-34387: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-34387) Add ZStandardBenchmark

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34387: Assignee: Apache Spark > Add ZStandardBenchmark > -- > >

[jira] [Assigned] (SPARK-34387) Add ZStandardBenchmark

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34387: Assignee: (was: Apache Spark) > Add ZStandardBenchmark > -- > >

[jira] [Created] (SPARK-34387) Add ZStandardBenchmark

2021-02-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-34387: - Summary: Add ZStandardBenchmark Key: SPARK-34387 URL: https://issues.apache.org/jira/browse/SPARK-34387 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-34386) "Proleptic" date off by 10 days when returned by .collectAsList

2021-02-06 Thread Marek Byszewski (Jira)
Marek Byszewski created SPARK-34386: --- Summary: "Proleptic" date off by 10 days when returned by .collectAsList Key: SPARK-34386 URL: https://issues.apache.org/jira/browse/SPARK-34386 Project: Spark

[jira] [Commented] (SPARK-34137) The tree string does not contain statistics for nested scalar sub queries

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280220#comment-17280220 ] Apache Spark commented on SPARK-34137: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34137) The tree string does not contain statistics for nested scalar sub queries

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34137: Assignee: Apache Spark > The tree string does not contain statistics for nested scalar

[jira] [Assigned] (SPARK-34137) The tree string does not contain statistics for nested scalar sub queries

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34137: Assignee: (was: Apache Spark) > The tree string does not contain statistics for

[jira] [Commented] (SPARK-34385) Unwrap SparkUpgradeException in v2 Parquet datasource

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280190#comment-17280190 ] Apache Spark commented on SPARK-34385: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34385) Unwrap SparkUpgradeException in v2 Parquet datasource

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34385: Assignee: Apache Spark > Unwrap SparkUpgradeException in v2 Parquet datasource >

[jira] [Commented] (SPARK-34385) Unwrap SparkUpgradeException in v2 Parquet datasource

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280188#comment-17280188 ] Apache Spark commented on SPARK-34385: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34385) Unwrap SparkUpgradeException in v2 Parquet datasource

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34385: Assignee: (was: Apache Spark) > Unwrap SparkUpgradeException in v2 Parquet

[jira] [Updated] (SPARK-34385) Unwrap SparkUpgradeException in v2 Parquet datasource

2021-02-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34385: --- Summary: Unwrap SparkUpgradeException in v2 Parquet datasource (was: Unwrap SparkUpgradeException

[jira] [Created] (SPARK-34385) Unwrap SparkUpgradeException in v1 Parquet datasource

2021-02-06 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34385: -- Summary: Unwrap SparkUpgradeException in v1 Parquet datasource Key: SPARK-34385 URL: https://issues.apache.org/jira/browse/SPARK-34385 Project: Spark Issue

[jira] [Resolved] (SPARK-33207) Reduce the number of tasks launched after bucket pruning

2021-02-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-33207. - Resolution: Fixed Thank you [~chengsu]. > Reduce the number of tasks launched after bucket

[jira] [Updated] (SPARK-33207) Reduce the number of tasks launched after bucket pruning

2021-02-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33207: Fix Version/s: 3.2.0 > Reduce the number of tasks launched after bucket pruning >

[jira] [Assigned] (SPARK-34384) API cleanup for ResourceProfile

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34384: Assignee: (was: Apache Spark) > API cleanup for ResourceProfile >

[jira] [Assigned] (SPARK-34384) API cleanup for ResourceProfile

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34384: Assignee: Apache Spark > API cleanup for ResourceProfile >

[jira] [Commented] (SPARK-34384) API cleanup for ResourceProfile

2021-02-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280128#comment-17280128 ] Apache Spark commented on SPARK-34384: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Created] (SPARK-34384) API cleanup for ResourceProfile

2021-02-06 Thread wuyi (Jira)
wuyi created SPARK-34384: Summary: API cleanup for ResourceProfile Key: SPARK-34384 URL: https://issues.apache.org/jira/browse/SPARK-34384 Project: Spark Issue Type: Improvement