[jira] [Assigned] (SPARK-37307) Don't obtain JDBC connection for empty partition

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37307: Assignee: (was: Apache Spark) > Don't obtain JDBC connection for empty partition >

[jira] [Assigned] (SPARK-37307) Don't obtain JDBC connection for empty partition

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37307: Assignee: Apache Spark > Don't obtain JDBC connection for empty partition >

[jira] [Commented] (SPARK-37307) Don't obtain JDBC connection for empty partition

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443027#comment-17443027 ] Apache Spark commented on SPARK-37307: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic

2021-11-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443026#comment-17443026 ] Hyukjin Kwon commented on SPARK-37308: -- Thanks for cc'ing me [~dongjoon]! > Flaky Test:

[jira] [Updated] (SPARK-37288) Backport update pyspark.since annotation to 3.1 and 3.2

2021-11-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37288: - Description: Annotation for {{pyspark.since}} has been changed in SPARK-36906, from

[jira] [Updated] (SPARK-37288) Backport update pyspark.since annotation to 3.1 and 3.2

2021-11-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37288: - Issue Type: Bug (was: Improvement) > Backport update pyspark.since annotation to 3.1 and 3.2 >

[jira] [Resolved] (SPARK-37312) Add `.java-version` to `.gitignore` and `.rat-excludes`

2021-11-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37312. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved in

[jira] [Commented] (SPARK-37314) Upgrade kubernetes-client to 5.10.1

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443021#comment-17443021 ] Apache Spark commented on SPARK-37314: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37314) Upgrade kubernetes-client to 5.10.1

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37314: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade kubernetes-client to 5.10.1 >

[jira] [Assigned] (SPARK-37314) Upgrade kubernetes-client to 5.10.1

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37314: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade kubernetes-client to 5.10.1 >

[jira] [Assigned] (SPARK-37314) Upgrade kubernetes-client to 5.10.1

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37314: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade kubernetes-client to 5.10.1 >

[jira] [Updated] (SPARK-37314) Upgrade kubernetes-client to 5.10.1

2021-11-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37314: --- Description: kubernetes-client 5.10.0 and 5.10.1 were released, which include some bug

[jira] [Updated] (SPARK-37314) Upgrade kubernetes-client to 5.10.1

2021-11-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37314: --- Description: kubernetes-client 5.10.0 and 5.10.1 were relased, which include some bug

[jira] [Updated] (SPARK-37314) Upgrade kubernetes-client to 5.10.1

2021-11-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37314: --- Description: A few days ago, kubernetes-client 5.10.0 and 5.10.1 are relased, which include

[jira] [Created] (SPARK-37314) Upgrade kubernetes-client to 5.10.1

2021-11-12 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-37314: -- Summary: Upgrade kubernetes-client to 5.10.1 Key: SPARK-37314 URL: https://issues.apache.org/jira/browse/SPARK-37314 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-37270) Incorect result of filter using isNull condition

2021-11-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443018#comment-17443018 ] Yuming Wang commented on SPARK-37270: - Thank you [~bersprockets] I will fix it soon. > Incorect

[jira] [Created] (SPARK-37313) Child stage using merged output or not should be based on the availability of merged output from parent stage

2021-11-12 Thread Minchu Yang (Jira)
Minchu Yang created SPARK-37313: --- Summary: Child stage using merged output or not should be based on the availability of merged output from parent stage Key: SPARK-37313 URL:

[jira] [Assigned] (SPARK-37300) TaskSchedulerImpl should ignore task finished event if its task was already finished state

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37300: Assignee: Apache Spark > TaskSchedulerImpl should ignore task finished event if its task

[jira] [Commented] (SPARK-37300) TaskSchedulerImpl should ignore task finished event if its task was already finished state

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443010#comment-17443010 ] Apache Spark commented on SPARK-37300: -- User 'sleep1661' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37300) TaskSchedulerImpl should ignore task finished event if its task was already finished state

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37300: Assignee: (was: Apache Spark) > TaskSchedulerImpl should ignore task finished event

[jira] [Assigned] (SPARK-37312) Add `.java-version` to `.gitignore` and `.rat-excludes`

2021-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37312: - Assignee: Dongjoon Hyun > Add `.java-version` to `.gitignore` and `.rat-excludes` >

[jira] [Updated] (SPARK-37312) Add `.java-version` to `.gitignore` and `.rat-excludes`

2021-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37312: -- Parent: SPARK-33772 Issue Type: Sub-task (was: Test) > Add `.java-version` to

[jira] [Commented] (SPARK-37312) Add `.java-version` to `.gitignore` and `.rat-excludes`

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443003#comment-17443003 ] Apache Spark commented on SPARK-37312: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37312) Add `.java-version` to `.gitignore` and `.rat-excludes`

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37312: Assignee: (was: Apache Spark) > Add `.java-version` to `.gitignore` and

[jira] [Commented] (SPARK-37312) Add `.java-version` to `.gitignore` and `.rat-excludes`

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443004#comment-17443004 ] Apache Spark commented on SPARK-37312: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37312) Add `.java-version` to `.gitignore` and `.rat-excludes`

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37312: Assignee: Apache Spark > Add `.java-version` to `.gitignore` and `.rat-excludes` >

[jira] [Created] (SPARK-37312) Add `.java-version` to `.gitignore` and `.rat-excludes`

2021-11-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37312: - Summary: Add `.java-version` to `.gitignore` and `.rat-excludes` Key: SPARK-37312 URL: https://issues.apache.org/jira/browse/SPARK-37312 Project: Spark

[jira] [Commented] (SPARK-37282) Add ExtendedLevelDBTest and disable LevelDB tests on Apple Silicon

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443000#comment-17443000 ] Apache Spark commented on SPARK-37282: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-37282) Add ExtendedLevelDBTest and disable LevelDB tests on Apple Silicon

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442999#comment-17442999 ] Apache Spark commented on SPARK-37282: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Resolved] (SPARK-37298) Use unique exprId in RewriteAsOfJoin

2021-11-12 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-37298. --- Fix Version/s: 3.3.0 Assignee: Allison Wang Resolution: Fixed Issue

[jira] [Commented] (SPARK-37273) Hidden File Metadata Support for Spark SQL

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442945#comment-17442945 ] Apache Spark commented on SPARK-37273: -- User 'Yaohua628' has created a pull request for this issue:

[jira] [Commented] (SPARK-34332) Unify v1 and v2 ALTER TABLE .. SET LOCATION tests

2021-11-12 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442935#comment-17442935 ] Terry Kim commented on SPARK-34332: --- [~maxgekk] I will work on this. > Unify v1 and v2 ALTER TABLE ..

[jira] [Commented] (SPARK-37310) Migrate ALTER NAMESPACE ... SET PROPERTIES to use v2 command by default

2021-11-12 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442925#comment-17442925 ] Terry Kim commented on SPARK-37310: --- working on this. > Migrate ALTER NAMESPACE ... SET PROPERTIES to

[jira] [Commented] (SPARK-37311) Migrate ALTER NAMESPACE ... SET LOCATION to use v2 command by default

2021-11-12 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442926#comment-17442926 ] Terry Kim commented on SPARK-37311: --- working on this. > Migrate ALTER NAMESPACE ... SET LOCATION to

[jira] [Created] (SPARK-37311) Migrate ALTER NAMESPACE ... SET LOCATION to use v2 command by default

2021-11-12 Thread Terry Kim (Jira)
Terry Kim created SPARK-37311: - Summary: Migrate ALTER NAMESPACE ... SET LOCATION to use v2 command by default Key: SPARK-37311 URL: https://issues.apache.org/jira/browse/SPARK-37311 Project: Spark

[jira] [Created] (SPARK-37310) Migrate ALTER NAMESPACE ... SET PROPERTIES to use v2 command by default

2021-11-12 Thread Terry Kim (Jira)
Terry Kim created SPARK-37310: - Summary: Migrate ALTER NAMESPACE ... SET PROPERTIES to use v2 command by default Key: SPARK-37310 URL: https://issues.apache.org/jira/browse/SPARK-37310 Project: Spark

[jira] [Commented] (SPARK-25642) Add new Metrics in External Shuffle Service to help determine Network performance and Connection Handling capabilities of the Shuffle Service

2021-11-12 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442924#comment-17442924 ] Yongjun Zhang commented on SPARK-25642: --- Hi [~pgandhi] , thanks for your work here. I thought

[jira] [Created] (SPARK-37309) Add available_now to PySpark trigger function

2021-11-12 Thread Lennox Stevenson (Jira)
Lennox Stevenson created SPARK-37309: Summary: Add available_now to PySpark trigger function Key: SPARK-37309 URL: https://issues.apache.org/jira/browse/SPARK-37309 Project: Spark Issue

[jira] [Resolved] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh

2021-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37302. --- Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed Issue resolved by

[jira] [Commented] (SPARK-37139) Inline type hints for python/pyspark/taskcontext.py and python/pyspark/version.py

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442905#comment-17442905 ] Apache Spark commented on SPARK-37139: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-37139) Inline type hints for python/pyspark/taskcontext.py and python/pyspark/version.py

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442904#comment-17442904 ] Apache Spark commented on SPARK-37139: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic

2021-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442901#comment-17442901 ] Dongjoon Hyun commented on SPARK-37308: --- This is a long standing issue I've observed before. cc

[jira] [Updated] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic

2021-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37308: -- Description: - https://github.com/apache/spark/runs/4188475706 -

[jira] [Updated] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic

2021-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37308: -- Description: - https://github.com/apache/spark/runs/4188475706 -

[jira] [Updated] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic

2021-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37308: -- Description: [https://github.com/apache/spark/runs/4188475706]   !Screen Shot 2021-11-12 at

[jira] [Updated] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic

2021-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37308: -- Attachment: Screen Shot 2021-11-12 at 10.34.32 AM.png > Flaky Test: DDLParserSuite.create

[jira] [Created] (SPARK-37308) Flaky Test: DDLParserSuite.create view -- basic

2021-11-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37308: - Summary: Flaky Test: DDLParserSuite.create view -- basic Key: SPARK-37308 URL: https://issues.apache.org/jira/browse/SPARK-37308 Project: Spark Issue

[jira] [Commented] (SPARK-37270) Incorect result of filter using isNull condition

2021-11-12 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442848#comment-17442848 ] Bruce Robbins commented on SPARK-37270: --- [~yumwang] Seems related to SPARK-33848. > Incorect

[jira] [Commented] (SPARK-35557) Adapt uses of JDK 17 Internal APIs

2021-11-12 Thread Olivier Peyrusse (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442843#comment-17442843 ] Olivier Peyrusse commented on SPARK-35557: -- Interesting that a {{--add-open}} would work in

[jira] [Updated] (SPARK-37266) View text can only be SELECT queries

2021-11-12 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37266: --- Summary: View text can only be SELECT queries (was: Optimize the analysis for view text of

[jira] [Commented] (SPARK-37292) Removes outer join if it only has DISTINCT on streamed side with alias

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442820#comment-17442820 ] Apache Spark commented on SPARK-37292: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-37202) Temp view didn't collect temp function that registered with catalog API

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442799#comment-17442799 ] Apache Spark commented on SPARK-37202: -- User 'linhongliu-db' has created a pull request for this

[jira] [Created] (SPARK-37307) Don't obtain JDBC connection for empty partition

2021-11-12 Thread Sean R. Owen (Jira)
Sean R. Owen created SPARK-37307: Summary: Don't obtain JDBC connection for empty partition Key: SPARK-37307 URL: https://issues.apache.org/jira/browse/SPARK-37307 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-37202) Temp view didn't collect temp function that registered with catalog API

2021-11-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37202. - Fix Version/s: 3.2.1 3.3.0 Assignee: Linhong Liu Resolution:

[jira] [Commented] (SPARK-37202) Temp view didn't collect temp function that registered with catalog API

2021-11-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442770#comment-17442770 ] Wenchen Fan commented on SPARK-37202: - resolved by https://github.com/apache/spark/pull/34546 >

[jira] [Resolved] (SPARK-37304) Check replacing columns with ANSI intervals

2021-11-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-37304. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34571

[jira] [Updated] (SPARK-37306) Unify v1 and v2 ALTER TABLE .. REPLACE COLUMNS tests

2021-11-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37306: - Description: Extract ALTER TABLE .. REPLACE COLUMNS tests to the common place to run them for V1 and v2

[jira] [Assigned] (SPARK-37306) Unify v1 and v2 ALTER TABLE .. REPLACE COLUMNS tests

2021-11-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-37306: Assignee: (was: Max Gekk) > Unify v1 and v2 ALTER TABLE .. REPLACE COLUMNS tests >

[jira] [Created] (SPARK-37306) Unify v1 and v2 ALTER TABLE .. REPLACE COLUMNS tests

2021-11-12 Thread Max Gekk (Jira)
Max Gekk created SPARK-37306: Summary: Unify v1 and v2 ALTER TABLE .. REPLACE COLUMNS tests Key: SPARK-37306 URL: https://issues.apache.org/jira/browse/SPARK-37306 Project: Spark Issue Type:

[jira] [Created] (SPARK-37305) Spark Dynamic Resource Allocation in Standalone Mode

2021-11-12 Thread Fernando (Jira)
Fernando created SPARK-37305: - Summary: Spark Dynamic Resource Allocation in Standalone Mode Key: SPARK-37305 URL: https://issues.apache.org/jira/browse/SPARK-37305 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37304) Check replacing columns with ANSI intervals

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442690#comment-17442690 ] Apache Spark commented on SPARK-37304: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-37304) Check replacing columns with ANSI intervals

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442689#comment-17442689 ] Apache Spark commented on SPARK-37304: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37304) Check replacing columns with ANSI intervals

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37304: Assignee: Max Gekk (was: Apache Spark) > Check replacing columns with ANSI intervals >

[jira] [Assigned] (SPARK-37304) Check replacing columns with ANSI intervals

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37304: Assignee: Apache Spark (was: Max Gekk) > Check replacing columns with ANSI intervals >

[jira] [Assigned] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37302: Assignee: Apache Spark (was: Kousuke Saruta) > Explicitly download the dependencies of

[jira] [Commented] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442686#comment-17442686 ] Apache Spark commented on SPARK-37302: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37302: Assignee: Kousuke Saruta (was: Apache Spark) > Explicitly download the dependencies of

[jira] [Updated] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh

2021-11-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37302: --- Description: dev/run-tests.py fails if Scala 2.13 is used and guava or jetty-io is not in

[jira] [Updated] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh

2021-11-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37302: --- Description: dev/run-tests.py fails if Scala 2.13 is used and guava or jetty-io is not in

[jira] [Created] (SPARK-37304) Check replacing columns with ANSI intervals

2021-11-12 Thread Max Gekk (Jira)
Max Gekk created SPARK-37304: Summary: Check replacing columns with ANSI intervals Key: SPARK-37304 URL: https://issues.apache.org/jira/browse/SPARK-37304 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-37303) ALTER TABLE .. REPLACE COLUMNS works incorrectly for v2 tables in tests

2021-11-12 Thread Max Gekk (Jira)
Max Gekk created SPARK-37303: Summary: ALTER TABLE .. REPLACE COLUMNS works incorrectly for v2 tables in tests Key: SPARK-37303 URL: https://issues.apache.org/jira/browse/SPARK-37303 Project: Spark

[jira] [Updated] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh

2021-11-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37302: --- Description: dev/run-tests.py fails if Scala 2.13 is used and guava or jetty-io is not in

[jira] [Updated] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh

2021-11-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37302: --- Description: dev/run-tests.py fails if Scala 2.13 is used and guava or jetty-io is not in

[jira] [Created] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh

2021-11-12 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-37302: -- Summary: Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh Key: SPARK-37302 URL: https://issues.apache.org/jira/browse/SPARK-37302

[jira] [Resolved] (SPARK-37294) Check inserting of ANSI intervals into a table partitioned by the interval columns

2021-11-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-37294. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34561

[jira] [Commented] (SPARK-37295) illegal reflective access operation has occurred; Please consider reporting this to the maintainers

2021-11-12 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442611#comment-17442611 ] Yang Jie commented on SPARK-37295: -- This is only a warning message for Java 11. You can try the master

[jira] [Assigned] (SPARK-37301) ConcurrentModificationException caused by CollectionAccumulator serialization in the heartbeat thread

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37301: Assignee: Apache Spark > ConcurrentModificationException caused by CollectionAccumulator

[jira] [Commented] (SPARK-37301) ConcurrentModificationException caused by CollectionAccumulator serialization in the heartbeat thread

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442609#comment-17442609 ] Apache Spark commented on SPARK-37301: -- User 'mcdull-zhang' has created a pull request for this

[jira] [Assigned] (SPARK-37301) ConcurrentModificationException caused by CollectionAccumulator serialization in the heartbeat thread

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37301: Assignee: (was: Apache Spark) > ConcurrentModificationException caused by

[jira] [Assigned] (SPARK-37287) Pull out dynamic partition and bucket sort from FileFormatWriter

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37287: Assignee: (was: Apache Spark) > Pull out dynamic partition and bucket sort from

[jira] [Commented] (SPARK-37287) Pull out dynamic partition and bucket sort from FileFormatWriter

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442603#comment-17442603 ] Apache Spark commented on SPARK-37287: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-37287) Pull out dynamic partition and bucket sort from FileFormatWriter

2021-11-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37287: Assignee: Apache Spark > Pull out dynamic partition and bucket sort from

[jira] [Updated] (SPARK-37301) ConcurrentModificationException caused by CollectionAccumulator serialization in the heartbeat thread

2021-11-12 Thread mcdull_zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mcdull_zhang updated SPARK-37301: - Description: In our production environment, you can use the following code to reproduce the

[jira] [Updated] (SPARK-37301) ConcurrentModificationException caused by CollectionAccumulator serialization in the heartbeat thread

2021-11-12 Thread mcdull_zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mcdull_zhang updated SPARK-37301: - Description: In our production environment, you can use the following code to reproduce the

[jira] [Created] (SPARK-37301) ConcurrentModificationException caused by CollectionAccumulator serialization in the heartbeat thread

2021-11-12 Thread mcdull_zhang (Jira)
mcdull_zhang created SPARK-37301: Summary: ConcurrentModificationException caused by CollectionAccumulator serialization in the heartbeat thread Key: SPARK-37301 URL: