[jira] [Assigned] (SPARK-45287) Add Java 21 benchmark result

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45287: - Assignee: Dongjoon Hyun > Add Java 21 benchmark result >

[jira] [Resolved] (SPARK-45287) Add Java 21 benchmark result

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45287. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43065

[jira] [Resolved] (SPARK-44119) Drop K8s v1.25 and lower version support

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44119. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43069

[jira] [Assigned] (SPARK-44119) Drop K8s v1.25 and lower version support

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44119: - Assignee: Dongjoon Hyun > Drop K8s v1.25 and lower version support >

[jira] [Assigned] (SPARK-44118) Support K8s scheduling gates

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44118: - Assignee: (was: Dongjoon Hyun) > Support K8s scheduling gates >

[jira] [Assigned] (SPARK-44118) Support K8s scheduling gates

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44118: - Assignee: Dongjoon Hyun > Support K8s scheduling gates >

[jira] [Updated] (SPARK-44119) Drop K8s v1.25 and lower version support

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44119: -- Description: *1. Default K8s Version in Public Cloud environments* The default K8s versions

[jira] [Resolved] (SPARK-45288) Remove outdated benchmark result files `jdk1[17]*results.txt`

2023-09-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45288. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43066

[jira] [Assigned] (SPARK-45288) Remove outdated benchmark result files `jdk1[17]*results.txt`

2023-09-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45288: Assignee: Dongjoon Hyun > Remove outdated benchmark result files `jdk1[17]*results.txt` >

[jira] [Updated] (SPARK-44119) Drop K8s v1.25 and lower version support

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44119: --- Labels: pull-request-available (was: ) > Drop K8s v1.25 and lower version support >

[jira] [Resolved] (SPARK-45274) Implementation of a new DAG drawing approach to avoid fork

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45274. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43053

[jira] [Assigned] (SPARK-45274) Implementation of a new DAG drawing approach to avoid fork

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45274: - Assignee: Kent Yao > Implementation of a new DAG drawing approach to avoid fork >

[jira] [Updated] (SPARK-44550) Wrong semantics for null IN (empty list)

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44550: --- Labels: pull-request-available (was: ) > Wrong semantics for null IN (empty list) >

[jira] [Updated] (SPARK-42669) Short circuit local relation rpcs

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42669: --- Labels: pull-request-available (was: ) > Short circuit local relation rpcs >

[jira] [Updated] (SPARK-42830) Link skipped stages on Spark UI

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42830: --- Labels: pull-request-available (was: ) > Link skipped stages on Spark UI >

[jira] [Updated] (SPARK-42890) Add Identifier to the InMemoryTableScan node on the SQL page

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42890: --- Labels: pull-request-available (was: ) > Add Identifier to the InMemoryTableScan node on

[jira] [Updated] (SPARK-45057) Deadlock caused by rdd replication level of 2

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45057: --- Labels: pull-request-available (was: ) > Deadlock caused by rdd replication level of 2 >

[jira] [Assigned] (SPARK-45285) Remove deprecated `Runtime.getRuntime.exec(String)` API usage

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45285: - Assignee: Dongjoon Hyun > Remove deprecated `Runtime.getRuntime.exec(String)` API

[jira] [Resolved] (SPARK-45285) Remove deprecated `Runtime.getRuntime.exec(String)` API usage

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45285. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43062

[jira] [Assigned] (SPARK-45284) Update SparkR minimum SystemRequirements to Java 17

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45284: - Assignee: Dongjoon Hyun > Update SparkR minimum SystemRequirements to Java 17 >

[jira] [Resolved] (SPARK-45284) Update SparkR minimum SystemRequirements to Java 17

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45284. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43060

[jira] [Updated] (SPARK-45265) Support Hive 4.0 metastore

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45265: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Support Hive 4.0 metastore >

[jira] [Updated] (SPARK-45288) Remove outdated benchmark result files `jdk1[17]*results.txt`

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45288: --- Labels: pull-request-available (was: ) > Remove outdated benchmark result files

[jira] [Created] (SPARK-45288) Remove outdated benchmark result files `jdk1[17]*results.txt`

2023-09-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45288: - Summary: Remove outdated benchmark result files `jdk1[17]*results.txt` Key: SPARK-45288 URL: https://issues.apache.org/jira/browse/SPARK-45288 Project: Spark

[jira] [Updated] (SPARK-45287) Add Java 21 benchmark result

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45287: --- Labels: pull-request-available (was: ) > Add Java 21 benchmark result >

[jira] [Created] (SPARK-45287) Add Java 21 benchmark result

2023-09-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45287: - Summary: Add Java 21 benchmark result Key: SPARK-45287 URL: https://issues.apache.org/jira/browse/SPARK-45287 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45265) Support Hive 4.0 metastore

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45265: --- Labels: pull-request-available (was: ) > Support Hive 4.0 metastore >

[jira] [Updated] (SPARK-43288) DataSourceV2: CREATE TABLE LIKE

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43288: --- Labels: pull-request-available (was: ) > DataSourceV2: CREATE TABLE LIKE >

[jira] [Updated] (SPARK-39822) Provides a good error during create Index with different dtype elements

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-39822: --- Labels: pull-request-available (was: ) > Provides a good error during create Index with

[jira] [Updated] (SPARK-45286) Add back Matomo analytics to release docs

2023-09-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45286: - Target Version/s: 3.4.2, 4.0.0, 3.5.1 (was: 4.0.0) > Add back Matomo analytics to release docs

[jira] [Updated] (SPARK-45286) Add back Matomo analytics to release docs

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45286: --- Labels: pull-request-available (was: ) > Add back Matomo analytics to release docs >

[jira] [Commented] (SPARK-45273) Http header Attack【HttpSecurityFilter】

2023-09-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768144#comment-17768144 ] Sean R. Owen commented on SPARK-45273: -- Yep we typically evaluate security reports on

[jira] [Commented] (SPARK-45273) Http header Attack【HttpSecurityFilter】

2023-09-22 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-45273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768140#comment-17768140 ] Bjørn Jørgensen commented on SPARK-45273: - Hi, [~chenyu-opensource] can you take this on mail to

[jira] [Created] (SPARK-45286) Add back Matomo analytics to release docs

2023-09-22 Thread Sean R. Owen (Jira)
Sean R. Owen created SPARK-45286: Summary: Add back Matomo analytics to release docs Key: SPARK-45286 URL: https://issues.apache.org/jira/browse/SPARK-45286 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-45282) Join loses records for cached datasets

2023-09-22 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768123#comment-17768123 ] koert kuipers edited comment on SPARK-45282 at 9/22/23 7:04 PM: after

[jira] [Updated] (SPARK-45282) Join loses records for cached datasets

2023-09-22 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] koert kuipers updated SPARK-45282: -- Description: we observed this issue on spark 3.4.1 but it is also present on 3.5.0. it is

[jira] [Updated] (SPARK-45285) Remove deprecated `Runtime.getRuntime.exec(String)` API usage

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45285: --- Labels: pull-request-available (was: ) > Remove deprecated

[jira] [Created] (SPARK-45285) Remove deprecated `Runtime.getRuntime.exec(String)` API usage

2023-09-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45285: - Summary: Remove deprecated `Runtime.getRuntime.exec(String)` API usage Key: SPARK-45285 URL: https://issues.apache.org/jira/browse/SPARK-45285 Project: Spark

[jira] [Updated] (SPARK-45282) Join loses records for cached datasets

2023-09-22 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] koert kuipers updated SPARK-45282: -- Description: we observed this issue on spark 3.4.1 but it is also present on 3.5.0. it is

[jira] [Commented] (SPARK-45282) Join loses records for cached datasets

2023-09-22 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768123#comment-17768123 ] koert kuipers commented on SPARK-45282: --- after reverting SPARK-41048 the issue went away. so i

[jira] [Updated] (SPARK-42768) Enable cached plan apply AQE by default

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42768: --- Labels: pull-request-available (was: ) > Enable cached plan apply AQE by default >

[jira] [Updated] (SPARK-45284) Update SparkR minimum SystemRequirements to Java 17

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45284: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Update SparkR minimum

[jira] [Updated] (SPARK-45284) Update SparkR minimum SystemRequirements to Java 17

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45284: --- Labels: pull-request-available (was: ) > Update SparkR minimum SystemRequirements to Java

[jira] [Updated] (SPARK-45077) Upgrade dagre-d3.js from 0.4.3 to 0.6.4

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45077: --- Labels: pull-request-available (was: ) > Upgrade dagre-d3.js from 0.4.3 to 0.6.4 >

[jira] [Created] (SPARK-45284) Update SparkR minimum +SystemRequirements to Java 17

2023-09-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45284: - Summary: Update SparkR minimum +SystemRequirements to Java 17 Key: SPARK-45284 URL: https://issues.apache.org/jira/browse/SPARK-45284 Project: Spark Issue

[jira] [Updated] (SPARK-45284) Update SparkR minimum SystemRequirements to Java 17

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45284: -- Summary: Update SparkR minimum SystemRequirements to Java 17 (was: Update SparkR minimum

[jira] [Updated] (SPARK-45282) Join loses records for cached datasets

2023-09-22 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] koert kuipers updated SPARK-45282: -- Description: we observed this issue on spark 3.4.1 but it is also present on 3.5.0. it is

[jira] [Updated] (SPARK-45282) Join loses records for cached datasets

2023-09-22 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] koert kuipers updated SPARK-45282: -- Description: we observed this issue on spark 3.4.1 but it is also present on 3.5.0. it is

[jira] [Created] (SPARK-45283) Make StatusTrackerSuite less fragile

2023-09-22 Thread Bo Xiong (Jira)
Bo Xiong created SPARK-45283: Summary: Make StatusTrackerSuite less fragile Key: SPARK-45283 URL: https://issues.apache.org/jira/browse/SPARK-45283 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-45282) Join loses records for cached datasets

2023-09-22 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] koert kuipers updated SPARK-45282: -- Description: we observed this issue on spark 3.4.1 but it is also present on 3.5.0. it is

[jira] [Created] (SPARK-45282) Join loses records for cached datasets

2023-09-22 Thread koert kuipers (Jira)
koert kuipers created SPARK-45282: - Summary: Join loses records for cached datasets Key: SPARK-45282 URL: https://issues.apache.org/jira/browse/SPARK-45282 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-45281) Update BenchmarkBase to use Java 17 as the base version

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45281. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43059

[jira] [Assigned] (SPARK-45281) Update BenchmarkBase to use Java 17 as the base version

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45281: - Assignee: Dongjoon Hyun > Update BenchmarkBase to use Java 17 as the base version >

[jira] [Assigned] (SPARK-45277) Install Java 17 for Windows SparkR test

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45277: - Assignee: Yang Jie > Install Java 17 for Windows SparkR test >

[jira] [Resolved] (SPARK-45277) Install Java 17 for Windows SparkR test

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45277. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43056

[jira] [Updated] (SPARK-45281) Update BenchmarkBase to use Java 17 as the base version

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45281: --- Labels: pull-request-available (was: ) > Update BenchmarkBase to use Java 17 as the base

[jira] [Created] (SPARK-45281) Update BenchmarkBase to use Java 17 as the base version

2023-09-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45281: - Summary: Update BenchmarkBase to use Java 17 as the base version Key: SPARK-45281 URL: https://issues.apache.org/jira/browse/SPARK-45281 Project: Spark

[jira] [Resolved] (SPARK-45256) Arrow DurationWriter fails when vector is at capacity

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45256. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43035

[jira] [Assigned] (SPARK-45256) Arrow DurationWriter fails when vector is at capacity

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45256: - Assignee: Sander Goos > Arrow DurationWriter fails when vector is at capacity >

[jira] [Assigned] (SPARK-45280) Change Maven daily test use Java 17 for testing.

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45280: - Assignee: Yang Jie > Change Maven daily test use Java 17 for testing. >

[jira] [Resolved] (SPARK-45280) Change Maven daily test use Java 17 for testing.

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45280. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43057

[jira] [Updated] (SPARK-36321) Do not fail application in kubernetes if name is too long

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-36321: --- Labels: pull-request-available (was: ) > Do not fail application in kubernetes if name is

[jira] [Comment Edited] (SPARK-45255) Spark connect client failing with java.lang.NoClassDefFoundError

2023-09-22 Thread Faiz Halde (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768040#comment-17768040 ] Faiz Halde edited comment on SPARK-45255 at 9/22/23 2:31 PM: - to get past

[jira] [Comment Edited] (SPARK-45255) Spark connect client failing with java.lang.NoClassDefFoundError

2023-09-22 Thread Faiz Halde (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768040#comment-17768040 ] Faiz Halde edited comment on SPARK-45255 at 9/22/23 2:31 PM: - to get past

[jira] [Commented] (SPARK-45255) Spark connect client failing with java.lang.NoClassDefFoundError

2023-09-22 Thread Faiz Halde (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768040#comment-17768040 ] Faiz Halde commented on SPARK-45255: to get pas the error

[jira] [Commented] (SPARK-45255) Spark connect client failing with java.lang.NoClassDefFoundError

2023-09-22 Thread Faiz Halde (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768037#comment-17768037 ] Faiz Halde commented on SPARK-45255: For now, I unblocked myself by manually building spark connect

[jira] [Comment Edited] (SPARK-45255) Spark connect client failing with java.lang.NoClassDefFoundError

2023-09-22 Thread Faiz Halde (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768037#comment-17768037 ] Faiz Halde edited comment on SPARK-45255 at 9/22/23 2:29 PM: - For now, I

[jira] [Updated] (SPARK-45280) Change Maven daily test use Java 17 for testing.

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45280: --- Labels: pull-request-available (was: ) > Change Maven daily test use Java 17 for testing.

[jira] [Created] (SPARK-45280) Change Maven daily test use Java 17 for testing.

2023-09-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-45280: Summary: Change Maven daily test use Java 17 for testing. Key: SPARK-45280 URL: https://issues.apache.org/jira/browse/SPARK-45280 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-45255) Spark connect client failing with java.lang.NoClassDefFoundError

2023-09-22 Thread Aleksandr Aleksandrov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768005#comment-17768005 ] Aleksandr Aleksandrov commented on SPARK-45255: --- I have the same issue. But adding guava

[jira] [Updated] (SPARK-45277) Install Java 17 for Windows SparkR test

2023-09-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45277: - Summary: Install Java 17 for Windows SparkR test (was: Install a Java 17 for windows SparkR test) >

[jira] [Updated] (SPARK-45277) Install Java 17 for Windows SparkR test

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45277: --- Labels: pull-request-available (was: ) > Install Java 17 for Windows SparkR test >

[jira] [Assigned] (SPARK-45247) Upgrade Pandas to 2.1.1

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45247: - Assignee: Haejoon Lee > Upgrade Pandas to 2.1.1 > --- > >

[jira] [Resolved] (SPARK-45247) Upgrade Pandas to 2.1.1

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45247. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43025

[jira] [Assigned] (SPARK-44112) Drop Java 8 and 11 support

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44112: - Assignee: Yang Jie > Drop Java 8 and 11 support > -- > >

[jira] [Resolved] (SPARK-44112) Drop Java 8 and 11 support

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44112. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43005

[jira] [Resolved] (SPARK-43655) Enable NamespaceParityTests.test_get_index_map

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43655. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43052

[jira] [Assigned] (SPARK-43655) Enable NamespaceParityTests.test_get_index_map

2023-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43655: - Assignee: Haejoon Lee > Enable NamespaceParityTests.test_get_index_map >

[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable

2023-09-22 Thread Hendra Saputra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Fix Version/s: (was: 4.0.0) (was: 3.5.1) > Make Yarn executor's

[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable

2023-09-22 Thread Hendra Saputra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Fix Version/s: 4.0.0 3.5.1 (was:

[jira] [Updated] (SPARK-45279) Attach plan_id for all logical plan

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45279: --- Labels: pull-request-available (was: ) > Attach plan_id for all logical plan >

[jira] [Commented] (SPARK-45278) Make Yarn executor's bindAddress configurable

2023-09-22 Thread Hendra Saputra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767932#comment-17767932 ] Hendra Saputra commented on SPARK-45278: PR is up for review

[jira] [Created] (SPARK-45279) Attach plan_id for all logical plan

2023-09-22 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-45279: - Summary: Attach plan_id for all logical plan Key: SPARK-45279 URL: https://issues.apache.org/jira/browse/SPARK-45279 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable

2023-09-22 Thread Hendra Saputra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Description: An improvement has been made in SPARK-24203 that executor's bind address is

[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable

2023-09-22 Thread Hendra Saputra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Description: An improvement has been made in SPARK-24203 that executor's bind address is

[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable

2023-09-22 Thread Hendra Saputra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Description: An improvement has been made in SPARK-24203 that executor's bind address is

[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable

2023-09-22 Thread Hendra Saputra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Affects Version/s: 4.0.0 3.5.1 (was:

[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable

2023-09-22 Thread Hendra Saputra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Description: Previous improvement is made that now Executor bind address is configurable in 

[jira] [Created] (SPARK-45278) Make Yarn executor's bindAddress configurable

2023-09-22 Thread Hendra Saputra (Jira)
Hendra Saputra created SPARK-45278: -- Summary: Make Yarn executor's bindAddress configurable Key: SPARK-45278 URL: https://issues.apache.org/jira/browse/SPARK-45278 Project: Spark Issue

[jira] [Assigned] (SPARK-44112) Drop Java 8 and 11 support

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-44112: -- Assignee: (was: Apache Spark) > Drop Java 8 and 11 support >

[jira] [Assigned] (SPARK-44112) Drop Java 8 and 11 support

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-44112: -- Assignee: Apache Spark > Drop Java 8 and 11 support > -- > >

[jira] [Assigned] (SPARK-44112) Drop Java 8 and 11 support

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-44112: -- Assignee: (was: Apache Spark) > Drop Java 8 and 11 support >

[jira] [Assigned] (SPARK-44112) Drop Java 8 and 11 support

2023-09-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-44112: -- Assignee: Apache Spark > Drop Java 8 and 11 support > -- > >

[jira] [Created] (SPARK-45277) Install a Java 17 for windows SparkR test

2023-09-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-45277: Summary: Install a Java 17 for windows SparkR test Key: SPARK-45277 URL: https://issues.apache.org/jira/browse/SPARK-45277 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-45276) Replace Java 8 and Java 11 installed in the Dockerfile with Java

2023-09-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-45276: Summary: Replace Java 8 and Java 11 installed in the Dockerfile with Java Key: SPARK-45276 URL: https://issues.apache.org/jira/browse/SPARK-45276 Project: Spark

[jira] [Commented] (SPARK-45175) download krb5.conf from remote storage in spark-submit on k8s

2023-09-22 Thread Qian Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767908#comment-17767908 ] Qian Sun commented on SPARK-45175: -- In multi-tenant scenarios, I find Apache Spark provide

[jira] [Resolved] (SPARK-45242) Use DataFrame ID to semantically validate CollectMetrics

2023-09-22 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-45242. -- Fix Version/s: 4.0.0 Resolution: Fixed https://github.com/apache/spark/pull/43010 > Use

[jira] [Updated] (SPARK-45275) replace function fails to handle null replace param

2023-09-22 Thread Diogo Marques (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Diogo Marques updated SPARK-45275: -- Attachment: replace_bug.png > replace function fails to handle null replace param >

[jira] [Updated] (SPARK-45275) replace function fails to handle null replace param

2023-09-22 Thread Diogo Marques (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Diogo Marques updated SPARK-45275: -- Description: [replace |https://spark.apache.org/docs/latest/api/sql/#replace]function fails

[jira] [Updated] (SPARK-45275) replace function fails to handle null replace param

2023-09-22 Thread Diogo Marques (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Diogo Marques updated SPARK-45275: -- Priority: Trivial (was: Major) > replace function fails to handle null replace param >

  1   2   >