[jira] [Updated] (SPARK-33418) TaskSchedulerImpl: Check pending tasks in advance when resource offers

2020-11-10 Thread dingbei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dingbei updated SPARK-33418: Description: It begins with the needs to  start a lot of spark streaming receivers .  *The launch time

[jira] [Updated] (SPARK-33418) TaskSchedulerImpl: Check pending tasks in advance when resource offers

2020-11-10 Thread dingbei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dingbei updated SPARK-33418: Description: It begins with the needs to  start a lot of spark streaming receivers .  *The launch time

[jira] [Updated] (SPARK-33418) TaskSchedulerImpl: Check pending tasks in advance when resource offers

2020-11-10 Thread dingbei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dingbei updated SPARK-33418: Description: It begins with the needs to  start a lot of spark streaming receivers .  *The launch time

[jira] [Updated] (SPARK-33418) TaskSchedulerImpl: Check pending tasks in advance when resource offers

2020-11-10 Thread dingbei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dingbei updated SPARK-33418: Description: It begins with the needs to  start a lot of spark streaming receivers .  *The launch time

[jira] [Updated] (SPARK-33418) TaskSchedulerImpl: Check pending tasks in advance when resource offers

2020-11-10 Thread dingbei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dingbei updated SPARK-33418: Description: It begins with the needs to  start a lot of spark streaming receivers .  The launch time

[jira] [Updated] (SPARK-33418) TaskSchedulerImpl: Check pending tasks in advance when resource offers

2020-11-10 Thread dingbei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dingbei updated SPARK-33418: Description: It begins with the needs to  start a lot of spark streaming receivers .  The launch time

[jira] [Created] (SPARK-33418) TaskSchedulerImpl: Check pending tasks in advance when resource offers

2020-11-10 Thread dingbei (Jira)
dingbei created SPARK-33418: --- Summary: TaskSchedulerImpl: Check pending tasks in advance when resource offers Key: SPARK-33418 URL: https://issues.apache.org/jira/browse/SPARK-33418 Project: Spark

[jira] [Resolved] (SPARK-33417) Correct the behaviour of query filters in TPCDSQueryBenchmark

2020-11-10 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33417. -- Fix Version/s: 3.1.0 3.0.2 2.4.8

[jira] [Resolved] (SPARK-33414) Migrate SHOW CREATE TABLE to new resolution framework

2020-11-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33414. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30321

[jira] [Assigned] (SPARK-33414) Migrate SHOW CREATE TABLE to new resolution framework

2020-11-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33414: --- Assignee: Terry Kim > Migrate SHOW CREATE TABLE to new resolution framework >

[jira] [Assigned] (SPARK-33382) Unify v1 and v2 SHOW TABLES tests

2020-11-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33382: --- Assignee: Maxim Gekk > Unify v1 and v2 SHOW TABLES tests >

[jira] [Resolved] (SPARK-33382) Unify v1 and v2 SHOW TABLES tests

2020-11-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33382. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30287

[jira] [Commented] (SPARK-26825) Spark Structure Streaming job failing when submitted in cluster mode

2020-11-10 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229719#comment-17229719 ] Vinod KC commented on SPARK-26825: -- As a workaround, we can set a {{checkpointLocation to stream.}}  

[jira] [Assigned] (SPARK-33417) Correct the behaviour of query filters in TPCDSQueryBenchmark

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33417: Assignee: (was: Apache Spark) > Correct the behaviour of query filters in

[jira] [Assigned] (SPARK-33417) Correct the behaviour of query filters in TPCDSQueryBenchmark

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33417: Assignee: Apache Spark > Correct the behaviour of query filters in TPCDSQueryBenchmark

[jira] [Commented] (SPARK-33417) Correct the behaviour of query filters in TPCDSQueryBenchmark

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229685#comment-17229685 ] Apache Spark commented on SPARK-33417: -- User 'maropu' has created a pull request for this issue:

[jira] [Updated] (SPARK-33417) Correct the behaviour of query filters in TPCDSQueryBenchmark

2020-11-10 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33417: - Description: This PR intends to fix the behaviour of query filters in

[jira] [Created] (SPARK-33417) Correct the behaviour of query filters in TPCDSQueryBenchmark

2020-11-10 Thread Takeshi Yamamuro (Jira)
Takeshi Yamamuro created SPARK-33417: Summary: Correct the behaviour of query filters in TPCDSQueryBenchmark Key: SPARK-33417 URL: https://issues.apache.org/jira/browse/SPARK-33417 Project:

[jira] [Resolved] (SPARK-33410) Resolve SQL query reference a column by an alias

2020-11-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-33410. - Resolution: Won't Fix This is not a SQL standard. > Resolve SQL query reference a column by an

[jira] [Assigned] (SPARK-33390) Make Literal support char array

2020-11-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33390: Assignee: ulysses you > Make Literal support char array >

[jira] [Resolved] (SPARK-33390) Make Literal support char array

2020-11-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33390. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30295

[jira] [Resolved] (SPARK-33404) "date_trunc" expression returns incorrect results

2020-11-10 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33404. -- Fix Version/s: 3.1.0 Assignee: Utkarsh Agarwal Resolution: Fixed

[jira] [Updated] (SPARK-33404) "date_trunc" expression returns incorrect results

2020-11-10 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33404: - Affects Version/s: 3.1.0 > "date_trunc" expression returns incorrect results >

[jira] [Resolved] (SPARK-33337) Support subexpression elimination in branches of conditional expressions

2020-11-10 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-7. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30245

[jira] [Commented] (SPARK-33415) Column.__repr__ shouldn't encode JVM response

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229567#comment-17229567 ] Apache Spark commented on SPARK-33415: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33415) Column.__repr__ shouldn't encode JVM response

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33415: Assignee: (was: Apache Spark) > Column.__repr__ shouldn't encode JVM response >

[jira] [Assigned] (SPARK-33415) Column.__repr__ shouldn't encode JVM response

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33415: Assignee: Apache Spark > Column.__repr__ shouldn't encode JVM response >

[jira] [Commented] (SPARK-33415) Column.__repr__ shouldn't encode JVM response

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229566#comment-17229566 ] Apache Spark commented on SPARK-33415: -- User 'zero323' has created a pull request for this issue:

[jira] [Created] (SPARK-33415) Column.__repr__ shouldn't encode JVM response

2020-11-10 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33415: -- Summary: Column.__repr__ shouldn't encode JVM response Key: SPARK-33415 URL: https://issues.apache.org/jira/browse/SPARK-33415 Project: Spark

[jira] [Updated] (SPARK-33413) SparkUI / Executor Page doesn't work where under external reverse proxy

2020-11-10 Thread Pierre Leresteux (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pierre Leresteux updated SPARK-33413: - Description: When using SparkUI under an external reverse proxy (NGinx, Træfik, ... ),

[jira] [Assigned] (SPARK-33414) Migrate SHOW CREATE TABLE to new resolution framework

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33414: Assignee: Apache Spark > Migrate SHOW CREATE TABLE to new resolution framework >

[jira] [Assigned] (SPARK-33414) Migrate SHOW CREATE TABLE to new resolution framework

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33414: Assignee: (was: Apache Spark) > Migrate SHOW CREATE TABLE to new resolution

[jira] [Commented] (SPARK-33414) Migrate SHOW CREATE TABLE to new resolution framework

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229479#comment-17229479 ] Apache Spark commented on SPARK-33414: -- User 'imback82' has created a pull request for this issue:

[jira] [Created] (SPARK-33414) Migrate SHOW CREATE TABLE to new resolution framework

2020-11-10 Thread Terry Kim (Jira)
Terry Kim created SPARK-33414: - Summary: Migrate SHOW CREATE TABLE to new resolution framework Key: SPARK-33414 URL: https://issues.apache.org/jira/browse/SPARK-33414 Project: Spark Issue Type:

[jira] [Created] (SPARK-33413) SparkUI / Executor Page doesn't work were under external reverse proxy

2020-11-10 Thread Pierre Leresteux (Jira)
Pierre Leresteux created SPARK-33413: Summary: SparkUI / Executor Page doesn't work were under external reverse proxy Key: SPARK-33413 URL: https://issues.apache.org/jira/browse/SPARK-33413

[jira] [Updated] (SPARK-33413) SparkUI / Executor Page doesn't work where under external reverse proxy

2020-11-10 Thread Pierre Leresteux (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pierre Leresteux updated SPARK-33413: - Summary: SparkUI / Executor Page doesn't work where under external reverse proxy (was:

[jira] [Updated] (SPARK-33413) SparkUI / Executor Page doesn't work were under external reverse proxy

2020-11-10 Thread Pierre Leresteux (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pierre Leresteux updated SPARK-33413: - Description: When using SparkUI under an externel reverse proxy (NGinx, Træfik, ... ),

[jira] [Updated] (SPARK-33413) SparkUI / Executor Page doesn't work were under external reverse proxy

2020-11-10 Thread Pierre Leresteux (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pierre Leresteux updated SPARK-33413: - Description: When using SparkUI under an externel reverse proxy (NGinx, Træfik, ... ),

[jira] [Updated] (SPARK-33412) OverwriteByExpression should resolve its delete condition based on the table relation not the input query

2020-11-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33412: Summary: OverwriteByExpression should resolve its delete condition based on the table relation

[jira] [Closed] (SPARK-33374) [CORE] Remove unnecessary python path from spark home

2020-11-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-33374. - > [CORE] Remove unnecessary python path from spark home >

[jira] [Resolved] (SPARK-33374) [CORE] Remove unnecessary python path from spark home

2020-11-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33374. --- Resolution: Invalid > [CORE] Remove unnecessary python path from spark home >

[jira] [Commented] (SPARK-33402) SparkHadoopWriter to pass job UUID down in spark.sql.sources.writeJobUUID

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229344#comment-17229344 ] Apache Spark commented on SPARK-33402: -- User 'steveloughran' has created a pull request for this

[jira] [Commented] (SPARK-33402) SparkHadoopWriter to pass job UUID down in spark.sql.sources.writeJobUUID

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229343#comment-17229343 ] Apache Spark commented on SPARK-33402: -- User 'steveloughran' has created a pull request for this

[jira] [Assigned] (SPARK-33402) SparkHadoopWriter to pass job UUID down in spark.sql.sources.writeJobUUID

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33402: Assignee: Apache Spark > SparkHadoopWriter to pass job UUID down in

[jira] [Assigned] (SPARK-33402) SparkHadoopWriter to pass job UUID down in spark.sql.sources.writeJobUUID

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33402: Assignee: (was: Apache Spark) > SparkHadoopWriter to pass job UUID down in

[jira] [Assigned] (SPARK-33254) Migration to NumPy documentation style in Core (pyspark.*, pyspark.resource.*, etc.)

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33254: Assignee: (was: Apache Spark) > Migration to NumPy documentation style in Core

[jira] [Assigned] (SPARK-33254) Migration to NumPy documentation style in Core (pyspark.*, pyspark.resource.*, etc.)

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33254: Assignee: Apache Spark > Migration to NumPy documentation style in Core (pyspark.*, >

[jira] [Commented] (SPARK-33254) Migration to NumPy documentation style in Core (pyspark.*, pyspark.resource.*, etc.)

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229342#comment-17229342 ] Apache Spark commented on SPARK-33254: -- User 'zero323' has created a pull request for this issue:

[jira] [Commented] (SPARK-33401) Vector type column is not possible to create using spark SQL

2020-11-10 Thread Pavlo Borshchenko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229328#comment-17229328 ] Pavlo Borshchenko commented on SPARK-33401: --- [~maropu] it is a bug from the point of view of

[jira] [Updated] (SPARK-33404) "date_trunc" expression returns incorrect results

2020-11-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-33404: - Fix Version/s: (was: 3.1.0) > "date_trunc" expression returns incorrect results >

[jira] [Resolved] (SPARK-33376) Remove the option of "sharesHadoopClasses" in Hive IsolatedClientLoader

2020-11-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33376. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30284

[jira] [Assigned] (SPARK-33302) Failed to push down filters through Expand

2020-11-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33302: --- Assignee: angerszhu > Failed to push down filters through Expand >

[jira] [Resolved] (SPARK-33302) Failed to push down filters through Expand

2020-11-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33302. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30278

[jira] [Assigned] (SPARK-33305) DSv2: DROP TABLE command should also invalidate cache

2020-11-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33305: --- Assignee: Chao Sun > DSv2: DROP TABLE command should also invalidate cache >

[jira] [Resolved] (SPARK-33305) DSv2: DROP TABLE command should also invalidate cache

2020-11-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33305. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30211

[jira] [Commented] (SPARK-33412) update OverwriteByExpression.deleteExpr after resolving v2 write commands

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229192#comment-17229192 ] Apache Spark commented on SPARK-33412: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33412) update OverwriteByExpression.deleteExpr after resolving v2 write commands

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33412: Assignee: Wenchen Fan (was: Apache Spark) > update OverwriteByExpression.deleteExpr

[jira] [Commented] (SPARK-33412) update OverwriteByExpression.deleteExpr after resolving v2 write commands

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229185#comment-17229185 ] Apache Spark commented on SPARK-33412: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33412) update OverwriteByExpression.deleteExpr after resolving v2 write commands

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33412: Assignee: Apache Spark (was: Wenchen Fan) > update OverwriteByExpression.deleteExpr

[jira] [Created] (SPARK-33412) update OverwriteByExpression.deleteExpr after resolving v2 write commands

2020-11-10 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-33412: --- Summary: update OverwriteByExpression.deleteExpr after resolving v2 write commands Key: SPARK-33412 URL: https://issues.apache.org/jira/browse/SPARK-33412 Project:

[jira] [Updated] (SPARK-33372) Fix InSet bucket pruning

2020-11-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33372: Fix Version/s: 2.4.8 > Fix InSet bucket pruning > > >

[jira] [Assigned] (SPARK-33409) Spark job can not be killed in BoradcastNestedLoopJoin

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33409: Assignee: (was: Apache Spark) > Spark job can not be killed in

[jira] [Commented] (SPARK-33409) Spark job can not be killed in BoradcastNestedLoopJoin

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229168#comment-17229168 ] Apache Spark commented on SPARK-33409: -- User 'constzhou' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33409) Spark job can not be killed in BoradcastNestedLoopJoin

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33409: Assignee: Apache Spark > Spark job can not be killed in BoradcastNestedLoopJoin >

[jira] [Created] (SPARK-33411) Cardinality estimation of union, range and sort logical operators

2020-11-10 Thread Ayushi Agarwal (Jira)
Ayushi Agarwal created SPARK-33411: -- Summary: Cardinality estimation of union, range and sort logical operators Key: SPARK-33411 URL: https://issues.apache.org/jira/browse/SPARK-33411 Project: Spark

[jira] [Updated] (SPARK-33330) Catalyst StringType converter unable to convert enum type

2020-11-10 Thread Miguel Duarte (Jira)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miguel Duarte updated SPARK-0: -- Description: Given that: # JavaTypeInference maps [Enums to

[jira] [Commented] (SPARK-33330) Catalyst StringType converter unable to convert enum type

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229148#comment-17229148 ] Apache Spark commented on SPARK-0: -- User 'malduarte' has created a pull request for this issue:

[jira] [Commented] (SPARK-33330) Catalyst StringType converter unable to convert enum type

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229145#comment-17229145 ] Apache Spark commented on SPARK-0: -- User 'malduarte' has created a pull request for this issue:

[jira] [Commented] (SPARK-33388) Merge In and InSet predicate

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229146#comment-17229146 ] Apache Spark commented on SPARK-33388: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-33388) Merge In and InSet predicate

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33388: Assignee: Apache Spark > Merge In and InSet predicate > > >

[jira] [Assigned] (SPARK-33388) Merge In and InSet predicate

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33388: Assignee: (was: Apache Spark) > Merge In and InSet predicate >

[jira] [Commented] (SPARK-33388) Merge In and InSet predicate

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229144#comment-17229144 ] Apache Spark commented on SPARK-33388: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-33410) Resolve SQL query reference a column by an alias

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229127#comment-17229127 ] Apache Spark commented on SPARK-33410: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-33410) Resolve SQL query reference a column by an alias

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229123#comment-17229123 ] Apache Spark commented on SPARK-33410: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33410) Resolve SQL query reference a column by an alias

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33410: Assignee: Apache Spark > Resolve SQL query reference a column by an alias >

[jira] [Assigned] (SPARK-33410) Resolve SQL query reference a column by an alias

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33410: Assignee: (was: Apache Spark) > Resolve SQL query reference a column by an alias >

[jira] [Updated] (SPARK-33410) Resolve SQL query reference a column by an alias

2020-11-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33410: Description: This pr add support resolve SQL query reference a column by an alias, for example:

[jira] [Assigned] (SPARK-33339) Pyspark application will hang due to non Exception

2020-11-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-9: Assignee: lrz > Pyspark application will hang due to non Exception >

[jira] [Resolved] (SPARK-33339) Pyspark application will hang due to non Exception

2020-11-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-9. -- Fix Version/s: 3.1.0 3.0.2 Resolution: Fixed Fixed in

[jira] [Created] (SPARK-33410) Resolve SQL query reference a column by an alias

2020-11-10 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33410: --- Summary: Resolve SQL query reference a column by an alias Key: SPARK-33410 URL: https://issues.apache.org/jira/browse/SPARK-33410 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33251) Migration to NumPy documentation style in ML (pyspark.ml.*)

2020-11-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229116#comment-17229116 ] Apache Spark commented on SPARK-33251: -- User 'zero323' has created a pull request for this issue: