[jira] [Updated] (SPARK-38700) Use error classes in the execution errors of save mode

2022-06-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38700: - Fix Version/s: 3.3.1 > Use error classes in the execution errors of save mode >

[jira] [Commented] (SPARK-39457) Support pure IPV6 environment without IPV4

2022-06-13 Thread Ruslan Dautkhanov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553901#comment-17553901 ] Ruslan Dautkhanov commented on SPARK-39457: --- Is there a dependency on Hadoop to support IPv6

[jira] [Resolved] (SPARK-39454) failed to convert LogicalPlan to SparkPlan when subquery exists after "IN" predicate

2022-06-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39454. -- Resolution: Duplicate > failed to convert LogicalPlan to SparkPlan when subquery exists after

[jira] [Resolved] (SPARK-39462) Contains function to check if a string is contained

2022-06-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39462. -- Resolution: Duplicate > Contains function to check if a string is contained >

[jira] [Updated] (SPARK-39462) Contains function to check if a string is contained

2022-06-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39462: - Summary: Contains function to check if a string is contained (was: [Support]add contains

[jira] [Assigned] (SPARK-39339) Support TimestampNTZ in JDBC data source

2022-06-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39339: -- Assignee: Ivan Sadikov > Support TimestampNTZ in JDBC data source >

[jira] [Resolved] (SPARK-39339) Support TimestampNTZ in JDBC data source

2022-06-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39339. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36726

[jira] [Commented] (SPARK-39463) Use UUID for test database location in JavaJdbcRDDSuite

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553885#comment-17553885 ] Apache Spark commented on SPARK-39463: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-39463) Use UUID for test database location in JavaJdbcRDDSuite

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553884#comment-17553884 ] Apache Spark commented on SPARK-39463: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39463) Use UUID for test database location in JavaJdbcRDDSuite

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39463: Assignee: Apache Spark > Use UUID for test database location in JavaJdbcRDDSuite >

[jira] [Assigned] (SPARK-39463) Use UUID for test database location in JavaJdbcRDDSuite

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39463: Assignee: (was: Apache Spark) > Use UUID for test database location in

[jira] [Created] (SPARK-39463) Use UUID for test database location in JavaJdbcRDDSuite

2022-06-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39463: - Summary: Use UUID for test database location in JavaJdbcRDDSuite Key: SPARK-39463 URL: https://issues.apache.org/jira/browse/SPARK-39463 Project: Spark

[jira] [Updated] (SPARK-39459) LocalSchedulerBackend doesn't support IPV6

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39459: -- Affects Version/s: 3.4.0 (was: 3.2.1) > LocalSchedulerBackend

[jira] [Updated] (SPARK-39457) Support pure IPV6 environment without IPV4

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39457: -- Labels: releasenotes (was: ) > Support pure IPV6 environment without IPV4 >

[jira] [Assigned] (SPARK-39459) LocalSchedulerBackend doesn't support IPV6

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39459: - Assignee: Dongjoon Hyun > LocalSchedulerBackend doesn't support IPV6 >

[jira] [Commented] (SPARK-39459) LocalSchedulerBackend doesn't support IPV6

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553880#comment-17553880 ] Apache Spark commented on SPARK-39459: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-39459) LocalSchedulerBackend doesn't support IPV6

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553879#comment-17553879 ] Apache Spark commented on SPARK-39459: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39459) LocalSchedulerBackend doesn't support IPV6

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39459: Assignee: (was: Apache Spark) > LocalSchedulerBackend doesn't support IPV6 >

[jira] [Assigned] (SPARK-39459) LocalSchedulerBackend doesn't support IPV6

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39459: Assignee: Apache Spark > LocalSchedulerBackend doesn't support IPV6 >

[jira] [Commented] (SPARK-39454) failed to convert LogicalPlan to SparkPlan when subquery exists after "IN" predicate

2022-06-13 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553874#comment-17553874 ] XiDuo You commented on SPARK-39454: --- [~allxu] this issue should be fixed by SPARK-37995 > failed to

[jira] [Comment Edited] (SPARK-24815) Structured Streaming should support dynamic allocation

2022-06-13 Thread Ramiz Mehran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553867#comment-17553867 ] Ramiz Mehran edited comment on SPARK-24815 at 6/14/22 3:05 AM: --- Guys, is

[jira] [Commented] (SPARK-24815) Structured Streaming should support dynamic allocation

2022-06-13 Thread Ramiz Mehran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553867#comment-17553867 ] Ramiz Mehran commented on SPARK-24815: -- Guys, is this thread still alive? I think SSS for

[jira] [Assigned] (SPARK-39461) Print `SPARK_LOCAL_(HOSTNAME|IP)` in `build/{mvn|sbt}`

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39461: - Assignee: Dongjoon Hyun > Print `SPARK_LOCAL_(HOSTNAME|IP)` in `build/{mvn|sbt}` >

[jira] [Resolved] (SPARK-39461) Print `SPARK_LOCAL_(HOSTNAME|IP)` in `build/{mvn|sbt}`

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39461. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36862

[jira] [Resolved] (SPARK-30835) Add support for YARN decommissioning & pre-emption

2022-06-13 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-30835. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-30835) Add support for YARN decommissioning & pre-emption

2022-06-13 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-30835: --- Assignee: Abhishek Dixit > Add support for YARN decommissioning &

[jira] [Created] (SPARK-39462) [Support]add contains function

2022-06-13 Thread melin (Jira)
melin created SPARK-39462: - Summary: [Support]add contains function Key: SPARK-39462 URL: https://issues.apache.org/jira/browse/SPARK-39462 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-39433) to_date function returns a null for the first week of the year

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39433. -- Resolution: Duplicate Oh, I think it's a subset of the linked issue

[jira] [Resolved] (SPARK-38812) when i clean data ,I hope one rdd spill two rdd according clean data rule

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38812. -- Resolution: Invalid > when i clean data ,I hope one rdd spill two rdd according clean data

[jira] [Resolved] (SPARK-38925) update guava to 30.1.1-jre

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38925. -- Fix Version/s: (was: 3.4.0) Resolution: Won't Fix > update guava to 30.1.1-jre >

[jira] [Resolved] (SPARK-38960) Spark should fail fast if initial memory too large(set by "spark.executor.extraJavaOptions") for executor to start

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38960. -- Fix Version/s: (was: 3.4.0) Resolution: Won't Fix > Spark should fail fast if

[jira] [Resolved] (SPARK-39005) Introduce 4 new functions to KVUtils

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39005. -- Resolution: Won't Fix > Introduce 4 new functions to KVUtils >

[jira] [Resolved] (SPARK-39020) [CVE-2020-9480] Transitive dependency "unused" from spark-sql_2.12 highlight as vulnerable in dependency tracker

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39020. -- Resolution: Not A Problem This isn't a real artifact and can be ignored. > [CVE-2020-9480]

[jira] [Updated] (SPARK-39066) Update to Maven 3.8.6 / fix problem with dev/test-dependencies.sh in 3.8.5

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39066: - Summary: Update to Maven 3.8.6 / fix problem with dev/test-dependencies.sh in 3.8.5 (was: Run

[jira] [Updated] (SPARK-39066) Update to Maven 3.8.6 / fix problem with dev/test-dependencies.sh in 3.8.5

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39066: - Issue Type: Improvement (was: Bug) > Update to Maven 3.8.6 / fix problem with

[jira] [Updated] (SPARK-39066) Update to Maven 3.8.6 / fix problem with dev/test-dependencies.sh in 3.8.5

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39066: - Priority: Minor (was: Major) > Update to Maven 3.8.6 / fix problem with

[jira] [Resolved] (SPARK-39441) Speed up DeduplicateRelations

2022-06-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39441. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36837

[jira] [Assigned] (SPARK-39441) Speed up DeduplicateRelations

2022-06-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39441: --- Assignee: Allison Wang > Speed up DeduplicateRelations > - > >

[jira] [Resolved] (SPARK-39460) Fix CoarseGrainedSchedulerBackendSuite to handle fast allocations

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39460. --- Fix Version/s: 3.4.0 Assignee: Dongjoon Hyun Resolution: Fixed This is

[jira] [Resolved] (SPARK-39151) Need Support for avro 1.11.0 in apache spark

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39151. -- Resolution: Duplicate Spark already uses 1.11.0 > Need Support for avro 1.11.0 in apache

[jira] [Commented] (SPARK-39146) The singleton Jackson ObjectMapper should be preferred

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553828#comment-17553828 ] Sean R. Owen commented on SPARK-39146: -- Sounds good, do you want to open a PR? > The singleton

[jira] [Updated] (SPARK-39151) Need Support for avro 1.11.0 in apache spark

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39151: - Issue Type: Improvement (was: Bug) Priority: Minor (was: Major) > Need Support for avro

[jira] [Commented] (SPARK-39269) spark3.2.0 commit tmp file is not found when rename

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553826#comment-17553826 ] Sean R. Owen commented on SPARK-39269: -- I think this just isn't actionable - not clear how it is

[jira] [Commented] (SPARK-39302) Spark SQL - wrong field selection in group by

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553825#comment-17553825 ] Sean R. Owen commented on SPARK-39302: -- I don't understand this - you didn't show a query with a

[jira] [Updated] (SPARK-39388) Reuse orcSchema when push down Orc predicates

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39388: - Summary: Reuse orcSchema when push down Orc predicates (was: Reuse orcScheam when push down

[jira] [Updated] (SPARK-39433) to_date function returns a null for the first week of the year

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39433: - Priority: Minor (was: Major) Not sure; "w" is not supported, it seems:

[jira] [Commented] (SPARK-39436) graph.connectedComponents(maxIterations) get ArrayIndexOutOfBoundsException: -1

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553823#comment-17553823 ] Sean R. Owen commented on SPARK-39436: -- This is not actionable. There is no detail on the error or

[jira] [Resolved] (SPARK-39435) graph.connectedComponents(maxIterations) get ArrayIndexOutOfBoundsException: -1

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39435. -- Resolution: Duplicate > graph.connectedComponents(maxIterations) get

[jira] [Updated] (SPARK-37865) Spark should not dedup the groupingExpressions when the first child of Union has duplicate columns

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37865: - Fix Version/s: (was: 3.1.3) (was: 3.0.4) (was:

[jira] [Updated] (SPARK-37865) Spark should not dedup the groupingExpressions when the first child of Union has duplicate columns

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37865: - Fix Version/s: 3.1.3 3.0.4 3.3.0 3.2.2

[jira] [Resolved] (SPARK-39345) Replace `filter` negation condition with `filterNot`

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39345. -- Resolution: Won't Fix > Replace `filter` negation condition with `filterNot` >

[jira] [Resolved] (SPARK-39289) Replace map.getOrElse(false/true) with exists/forall

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39289. -- Resolution: Won't Fix > Replace map.getOrElse(false/true) with exists/forall >

[jira] [Assigned] (SPARK-39461) Print `SPARK_LOCAL_(HOSTNAME|IP)` in `build/{mvn|sbt}`

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39461: Assignee: (was: Apache Spark) > Print `SPARK_LOCAL_(HOSTNAME|IP)` in

[jira] [Resolved] (SPARK-38422) Encryption algorithms should be used with secure mode and padding scheme

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38422. -- Resolution: Not A Problem > Encryption algorithms should be used with secure mode and padding

[jira] [Resolved] (SPARK-38801) ISO-8859-1 encoding doesn't work for text format

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38801. -- Resolution: Won't Fix > ISO-8859-1 encoding doesn't work for text format >

[jira] [Commented] (SPARK-39461) Print `SPARK_LOCAL_(HOSTNAME|IP)` in `build/{mvn|sbt}`

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553821#comment-17553821 ] Apache Spark commented on SPARK-39461: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39461) Print `SPARK_LOCAL_(HOSTNAME|IP)` in `build/{mvn|sbt}`

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39461: Assignee: Apache Spark > Print `SPARK_LOCAL_(HOSTNAME|IP)` in `build/{mvn|sbt}` >

[jira] [Resolved] (SPARK-38858) PythonException - socke.timeout: timed out - socket.py line 707

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38858. -- Resolution: Not A Problem > PythonException - socke.timeout: timed out - socket.py line 707 >

[jira] [Resolved] (SPARK-38884) java.util.NoSuchElementException: key not found: numPartitions

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38884. -- Resolution: Won't Fix > java.util.NoSuchElementException: key not found: numPartitions >

[jira] [Resolved] (SPARK-38265) Update comments of ExecutorAllocationClient

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38265. -- Resolution: Won't Fix > Update comments of ExecutorAllocationClient >

[jira] [Resolved] (SPARK-38919) Filter stale event log before parse logs

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38919. -- Resolution: Invalid > Filter stale event log before parse logs >

[jira] [Resolved] (SPARK-38539) Add document for ToNumber for DecimalFormat's compatibility

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38539. -- Resolution: Not A Problem > Add document for ToNumber for DecimalFormat's compatibility >

[jira] [Updated] (SPARK-38539) Add document for ToNumber for DecimalFormat's compatibility

2022-06-13 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-38539: - Priority: Trivial (was: Major) > Add document for ToNumber for DecimalFormat's compatibility >

[jira] [Created] (SPARK-39461) Print `SPARK_LOCAL_(HOSTNAME|IP)` in `build/{mvn|sbt}`

2022-06-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39461: - Summary: Print `SPARK_LOCAL_(HOSTNAME|IP)` in `build/{mvn|sbt}` Key: SPARK-39461 URL: https://issues.apache.org/jira/browse/SPARK-39461 Project: Spark

[jira] [Commented] (SPARK-39460) Fix CoarseGrainedSchedulerBackendSuite to handle fast allocations

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553817#comment-17553817 ] Apache Spark commented on SPARK-39460: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39460) Fix CoarseGrainedSchedulerBackendSuite to handle fast allocations

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39460: Assignee: (was: Apache Spark) > Fix CoarseGrainedSchedulerBackendSuite to handle

[jira] [Assigned] (SPARK-39460) Fix CoarseGrainedSchedulerBackendSuite to handle fast allocations

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39460: Assignee: Apache Spark > Fix CoarseGrainedSchedulerBackendSuite to handle fast

[jira] [Commented] (SPARK-38796) Implement the to_number and try_to_number SQL functions according to a new specification

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553816#comment-17553816 ] Apache Spark commented on SPARK-38796: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Commented] (SPARK-39460) Fix CoarseGrainedSchedulerBackendSuite to handle fast allocations

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553815#comment-17553815 ] Apache Spark commented on SPARK-39460: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-39460) Fix CoarseGrainedSchedulerBackendSuite to handle fast allocations

2022-06-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39460: - Summary: Fix CoarseGrainedSchedulerBackendSuite to handle fast allocations Key: SPARK-39460 URL: https://issues.apache.org/jira/browse/SPARK-39460 Project: Spark

[jira] [Updated] (SPARK-39442) Update PlanStabilitySuite comment with SPARK_ANSI_SQL_MODE

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39442: -- Fix Version/s: 3.3.1 (was: 3.3.0) > Update PlanStabilitySuite comment

[jira] [Updated] (SPARK-39458) Fix UISuite for IPv6

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39458: -- Fix Version/s: 3.3.1 (was: 3.3.0) > Fix UISuite for IPv6 >

[jira] [Assigned] (SPARK-39458) Fix UISuite for IPv6

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39458: - Assignee: Dongjoon Hyun > Fix UISuite for IPv6 > > >

[jira] [Resolved] (SPARK-39458) Fix UISuite for IPv6

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39458. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36858

[jira] [Assigned] (SPARK-39439) Suppress error log for in-progress event log not found

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39439: - Assignee: Cheng Pan > Suppress error log for in-progress event log not found >

[jira] [Resolved] (SPARK-39439) Suppress error log for in-progress event log not found

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39439. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36832

[jira] [Commented] (SPARK-39458) Fix UISuite for IPv6

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553754#comment-17553754 ] Apache Spark commented on SPARK-39458: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39458) Fix UISuite for IPv6

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39458: Assignee: (was: Apache Spark) > Fix UISuite for IPv6 > > >

[jira] [Assigned] (SPARK-39458) Fix UISuite for IPv6

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39458: Assignee: Apache Spark > Fix UISuite for IPv6 > > >

[jira] [Commented] (SPARK-39458) Fix UISuite for IPv6

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553753#comment-17553753 ] Apache Spark commented on SPARK-39458: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-39458) Fix UISuite for IPv6

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39458: -- Parent: SPARK-39457 Issue Type: Sub-task (was: Bug) > Fix UISuite for IPv6 >

[jira] [Updated] (SPARK-39457) Support pure IPV6 environment without IPV4

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39457: -- Affects Version/s: 3.4.0 (was: 3.2.1) > Support pure IPV6

[jira] [Updated] (SPARK-39458) Fix UISuite for IPv6

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39458: -- Affects Version/s: 3.2.1 3.1.2 3.3.0 > Fix

[jira] [Created] (SPARK-39459) LocalSchedulerBackend doesn't support IPV6

2022-06-13 Thread DB Tsai (Jira)
DB Tsai created SPARK-39459: --- Summary: LocalSchedulerBackend doesn't support IPV6 Key: SPARK-39459 URL: https://issues.apache.org/jira/browse/SPARK-39459 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-39458) Fix UISuite for IPv6

2022-06-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39458: - Summary: Fix UISuite for IPv6 Key: SPARK-39458 URL: https://issues.apache.org/jira/browse/SPARK-39458 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-39457) Support pure IPV6 environment without IPV4

2022-06-13 Thread DB Tsai (Jira)
DB Tsai created SPARK-39457: --- Summary: Support pure IPV6 environment without IPV4 Key: SPARK-39457 URL: https://issues.apache.org/jira/browse/SPARK-39457 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-39434) Provide runtime error query context when array index is out of bound

2022-06-13 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-39434: -- Fix Version/s: 3.4.0 > Provide runtime error query context when array index is out of bound >

[jira] [Commented] (SPARK-29250) Upgrade to Hadoop 3.3.1

2022-06-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553744#comment-17553744 ] Steve Loughran commented on SPARK-29250: use whatever version the spark release was built with

[jira] [Updated] (SPARK-39437) normalize plan id separately in PlanStabilitySuite

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39437: -- Fix Version/s: 3.3.0 (was: 3.4.0) > normalize plan id separately in

[jira] [Updated] (SPARK-39437) normalize plan id separately in PlanStabilitySuite

2022-06-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39437: -- Fix Version/s: 3.4.0 3.3.1 (was: 3.3.0) > normalize

[jira] [Updated] (SPARK-39456) Fix broken function links in the auto-generated pandas API support list documentation.

2022-06-13 Thread Hyunwoo Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyunwoo Park updated SPARK-39456: - Summary: Fix broken function links in the auto-generated pandas API support list documentation.

[jira] [Updated] (SPARK-39456) Fix broken function links in the auto-generated pandas API support list documetation.

2022-06-13 Thread Hyunwoo Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyunwoo Park updated SPARK-39456: - Summary: Fix broken function links in the auto-generated pandas API support list documetation.

[jira] [Commented] (SPARK-39456) Fix broken function links in the auto-generated documetation on pandas API support list.

2022-06-13 Thread Hyunwoo Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553638#comment-17553638 ] Hyunwoo Park commented on SPARK-39456: -- Related:

[jira] [Created] (SPARK-39456) Fix broken function links in the auto-generated documetation on pandas API support list.

2022-06-13 Thread Hyunwoo Park (Jira)
Hyunwoo Park created SPARK-39456: Summary: Fix broken function links in the auto-generated documetation on pandas API support list. Key: SPARK-39456 URL: https://issues.apache.org/jira/browse/SPARK-39456

[jira] [Assigned] (SPARK-39455) Improve expression non-codegen code path performance by cache data type matching

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39455: Assignee: (was: Apache Spark) > Improve expression non-codegen code path performance

[jira] [Assigned] (SPARK-39455) Improve expression non-codegen code path performance by cache data type matching

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39455: Assignee: Apache Spark > Improve expression non-codegen code path performance by cache

[jira] [Commented] (SPARK-39455) Improve expression non-codegen code path performance by cache data type matching

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553556#comment-17553556 ] Apache Spark commented on SPARK-39455: -- User 'ulysses-you' has created a pull request for this

[jira] [Created] (SPARK-39455) Improve expression non-codegen code path performance by cache data type matching

2022-06-13 Thread XiDuo You (Jira)
XiDuo You created SPARK-39455: - Summary: Improve expression non-codegen code path performance by cache data type matching Key: SPARK-39455 URL: https://issues.apache.org/jira/browse/SPARK-39455 Project:

[jira] [Commented] (SPARK-39432) element_at(*, 0) does not return INVALID_ARRAY_INDEX_IN_ELEMENT_AT

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553537#comment-17553537 ] Apache Spark commented on SPARK-39432: -- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-39432) element_at(*, 0) does not return INVALID_ARRAY_INDEX_IN_ELEMENT_AT

2022-06-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553534#comment-17553534 ] Apache Spark commented on SPARK-39432: -- User 'panbingkun' has created a pull request for this

  1   2   >