[jira] [Created] (SPARK-39502) Downgrade scala-maven-plugin to 4.6.1

2022-06-16 Thread Yang Jie (Jira)
Yang Jie created SPARK-39502: Summary: Downgrade scala-maven-plugin to 4.6.1 Key: SPARK-39502 URL: https://issues.apache.org/jira/browse/SPARK-39502 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-39501) Use java.net.preferIPv6Addresses=true in tests

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39501: Assignee: (was: Apache Spark) > Use java.net.preferIPv6Addresses=true in tests >

[jira] [Assigned] (SPARK-39501) Use java.net.preferIPv6Addresses=true in tests

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39501: Assignee: Apache Spark > Use java.net.preferIPv6Addresses=true in tests >

[jira] [Commented] (SPARK-39501) Use java.net.preferIPv6Addresses=true in tests

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555384#comment-17555384 ] Apache Spark commented on SPARK-39501: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-39501) Use java.net.preferIPv6Addresses=true in tests

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555385#comment-17555385 ] Apache Spark commented on SPARK-39501: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-39501) Use java.net.preferIPv6Addresses=true in tests

2022-06-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39501: - Summary: Use java.net.preferIPv6Addresses=true in tests Key: SPARK-39501 URL: https://issues.apache.org/jira/browse/SPARK-39501 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-39500) Ivy doesn't work correctly on IPv6-only environment

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39500. --- Resolution: Incomplete > Ivy doesn't work correctly on IPv6-only environment >

[jira] [Created] (SPARK-39500) Ivy doesn't work correctly on IPv6-only environment

2022-06-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39500: - Summary: Ivy doesn't work correctly on IPv6-only environment Key: SPARK-39500 URL: https://issues.apache.org/jira/browse/SPARK-39500 Project: Spark Issue

[jira] [Resolved] (SPARK-39499) Substring function support pattern expression

2022-06-16 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin resolved SPARK-39499. --- Resolution: Duplicate > Substring function support pattern expression >

[jira] [Created] (SPARK-39499) Substring function support pattern expression

2022-06-16 Thread melin (Jira)
melin created SPARK-39499: - Summary: Substring function support pattern expression Key: SPARK-39499 URL: https://issues.apache.org/jira/browse/SPARK-39499 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-39498) Support function: percentile_approx、percentile_count、percentile_disc

2022-06-16 Thread melin (Jira)
melin created SPARK-39498: - Summary: Support function: percentile_approx、percentile_count、percentile_disc Key: SPARK-39498 URL: https://issues.apache.org/jira/browse/SPARK-39498 Project: Spark

[jira] [Resolved] (SPARK-39495) Support SPARK_TEST_HIVE_CLIENT_VERSIONS for HiveClientVersions

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39495. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36894

[jira] [Assigned] (SPARK-39495) Support SPARK_TEST_HIVE_CLIENT_VERSIONS for HiveClientVersions

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39495: - Assignee: Dongjoon Hyun > Support SPARK_TEST_HIVE_CLIENT_VERSIONS for

[jira] [Commented] (SPARK-38688) Use error classes in the compilation errors of deserializer

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555339#comment-17555339 ] Apache Spark commented on SPARK-38688: -- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-38688) Use error classes in the compilation errors of deserializer

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555338#comment-17555338 ] Apache Spark commented on SPARK-38688: -- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-39497) Improve the analysis exception of missing map key column

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555335#comment-17555335 ] Apache Spark commented on SPARK-39497: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-39497) Improve the analysis exception of missing map key column

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39497: Assignee: Apache Spark (was: Gengliang Wang) > Improve the analysis exception of

[jira] [Commented] (SPARK-39497) Improve the analysis exception of missing map key column

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555334#comment-17555334 ] Apache Spark commented on SPARK-39497: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-39497) Improve the analysis exception of missing map key column

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39497: Assignee: Gengliang Wang (was: Apache Spark) > Improve the analysis exception of

[jira] [Created] (SPARK-39497) Improve the analysis exception of missing map key column

2022-06-16 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39497: -- Summary: Improve the analysis exception of missing map key column Key: SPARK-39497 URL: https://issues.apache.org/jira/browse/SPARK-39497 Project: Spark

[jira] [Updated] (SPARK-39493) Update ORC to 1.7.5

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39493: -- Fix Version/s: 3.4.0 > Update ORC to 1.7.5 > --- > > Key:

[jira] [Assigned] (SPARK-39456) Fix broken function links in the auto-generated pandas API support list documentation.

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39456: Assignee: (was: Apache Spark) > Fix broken function links in the auto-generated

[jira] [Assigned] (SPARK-39456) Fix broken function links in the auto-generated pandas API support list documentation.

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39456: Assignee: Apache Spark > Fix broken function links in the auto-generated pandas API

[jira] [Commented] (SPARK-39456) Fix broken function links in the auto-generated pandas API support list documentation.

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555326#comment-17555326 ] Apache Spark commented on SPARK-39456: -- User 'beobest2' has created a pull request for this issue:

[jira] [Created] (SPARK-39496) Inline eval path cannot handle null structs

2022-06-16 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-39496: - Summary: Inline eval path cannot handle null structs Key: SPARK-39496 URL: https://issues.apache.org/jira/browse/SPARK-39496 Project: Spark Issue Type:

[jira] [Updated] (SPARK-39493) Update ORC to 1.7.5

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39493: -- Affects Version/s: 3.3.0 > Update ORC to 1.7.5 > --- > > Key:

[jira] [Updated] (SPARK-39493) Update ORC to 1.7.5

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39493: -- Fix Version/s: 3.3.1 (was: 3.3.0) > Update ORC to 1.7.5 >

[jira] [Assigned] (SPARK-39493) Update ORC to 1.7.5

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39493: - Assignee: William Hyun > Update ORC to 1.7.5 > --- > >

[jira] [Resolved] (SPARK-39493) Update ORC to 1.7.5

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39493. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36892

[jira] [Commented] (SPARK-39495) Support SPARK_TEST_HIVE_CLIENT_VERSIONS for HiveClientVersions

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555314#comment-17555314 ] Apache Spark commented on SPARK-39495: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39495) Support SPARK_TEST_HIVE_CLIENT_VERSIONS for HiveClientVersions

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39495: Assignee: (was: Apache Spark) > Support SPARK_TEST_HIVE_CLIENT_VERSIONS for

[jira] [Assigned] (SPARK-39495) Support SPARK_TEST_HIVE_CLIENT_VERSIONS for HiveClientVersions

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39495: Assignee: Apache Spark > Support SPARK_TEST_HIVE_CLIENT_VERSIONS for HiveClientVersions

[jira] [Commented] (SPARK-39495) Support SPARK_TEST_HIVE_CLIENT_VERSIONS for HiveClientVersions

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555313#comment-17555313 ] Apache Spark commented on SPARK-39495: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-39495) Support SPARK_TEST_HIVE_CLIENT_VERSIONS for HiveClientVersions

2022-06-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39495: - Summary: Support SPARK_TEST_HIVE_CLIENT_VERSIONS for HiveClientVersions Key: SPARK-39495 URL: https://issues.apache.org/jira/browse/SPARK-39495 Project: Spark

[jira] [Assigned] (SPARK-39494) Support `createDataFrame` from a list of scalars

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39494: Assignee: Apache Spark > Support `createDataFrame` from a list of scalars >

[jira] [Assigned] (SPARK-39494) Support `createDataFrame` from a list of scalars

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39494: Assignee: (was: Apache Spark) > Support `createDataFrame` from a list of scalars >

[jira] [Commented] (SPARK-39494) Support `createDataFrame` from a list of scalars

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555311#comment-17555311 ] Apache Spark commented on SPARK-39494: -- User 'xinrong-databricks' has created a pull request for

[jira] [Commented] (SPARK-39494) Support `createDataFrame` from a list of scalars

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555312#comment-17555312 ] Apache Spark commented on SPARK-39494: -- User 'xinrong-databricks' has created a pull request for

[jira] [Created] (SPARK-39494) Support `createDataFrame` from a list of scalars

2022-06-16 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-39494: Summary: Support `createDataFrame` from a list of scalars Key: SPARK-39494 URL: https://issues.apache.org/jira/browse/SPARK-39494 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39493) Update ORC to 1.7.5

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555296#comment-17555296 ] Apache Spark commented on SPARK-39493: -- User 'williamhyun' has created a pull request for this

[jira] [Commented] (SPARK-39493) Update ORC to 1.7.5

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555294#comment-17555294 ] Apache Spark commented on SPARK-39493: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-39493) Update ORC to 1.7.5

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39493: Assignee: Apache Spark > Update ORC to 1.7.5 > --- > >

[jira] [Assigned] (SPARK-39493) Update ORC to 1.7.5

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39493: Assignee: (was: Apache Spark) > Update ORC to 1.7.5 > --- > >

[jira] [Created] (SPARK-39493) Update ORC to 1.7.5

2022-06-16 Thread William Hyun (Jira)
William Hyun created SPARK-39493: Summary: Update ORC to 1.7.5 Key: SPARK-39493 URL: https://issues.apache.org/jira/browse/SPARK-39493 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-35782) leveldbjni doesn't work in Apple Silicon on macOS

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555255#comment-17555255 ] Dongjoon Hyun commented on SPARK-35782: --- We provide RocksDB alternative for this issue. >

[jira] [Resolved] (SPARK-35781) Support Spark on Apple Silicon on macOS natively on Java 17

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35781. --- Fix Version/s: 3.3.0 Resolution: Fixed > Support Spark on Apple Silicon on macOS

[jira] [Updated] (SPARK-36731) BrotliCodec doesn't support Apple Silicon on MacOS

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36731: -- Parent: (was: SPARK-35781) Issue Type: Bug (was: Sub-task) > BrotliCodec doesn't

[jira] [Updated] (SPARK-38888) Add `RocksDBProvider` similar to `LevelDBProvider`

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-3: -- Parent: (was: SPARK-35781) Issue Type: Improvement (was: Sub-task) > Add

[jira] [Updated] (SPARK-35782) leveldbjni doesn't work in Apple Silicon on macOS

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35782: -- Parent: (was: SPARK-35781) Issue Type: Bug (was: Sub-task) > leveldbjni doesn't

[jira] [Assigned] (SPARK-39492) Rework MISSING_COLUMN error class

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39492: Assignee: Apache Spark > Rework MISSING_COLUMN error class >

[jira] [Assigned] (SPARK-39492) Rework MISSING_COLUMN error class

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39492: Assignee: (was: Apache Spark) > Rework MISSING_COLUMN error class >

[jira] [Commented] (SPARK-39492) Rework MISSING_COLUMN error class

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555250#comment-17555250 ] Apache Spark commented on SPARK-39492: -- User 'srielau' has created a pull request for this issue:

[jira] [Commented] (SPARK-39492) Rework MISSING_COLUMN error class

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555249#comment-17555249 ] Apache Spark commented on SPARK-39492: -- User 'srielau' has created a pull request for this issue:

[jira] [Commented] (SPARK-39491) Hadoop 2.7 build fails due to org.apache.hadoop.yarn.api.records.NodeState.DECOMMISSIONING

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555217#comment-17555217 ] Apache Spark commented on SPARK-39491: -- User 'abhishekd0907' has created a pull request for this

[jira] [Assigned] (SPARK-39491) Hadoop 2.7 build fails due to org.apache.hadoop.yarn.api.records.NodeState.DECOMMISSIONING

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39491: Assignee: (was: Apache Spark) > Hadoop 2.7 build fails due to >

[jira] [Assigned] (SPARK-39491) Hadoop 2.7 build fails due to org.apache.hadoop.yarn.api.records.NodeState.DECOMMISSIONING

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39491: Assignee: Apache Spark > Hadoop 2.7 build fails due to >

[jira] [Commented] (SPARK-39491) Hadoop 2.7 build fails due to org.apache.hadoop.yarn.api.records.NodeState.DECOMMISSIONING

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555216#comment-17555216 ] Apache Spark commented on SPARK-39491: -- User 'abhishekd0907' has created a pull request for this

[jira] [Commented] (SPARK-30835) Add support for YARN decommissioning & pre-emption

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555215#comment-17555215 ] Apache Spark commented on SPARK-30835: -- User 'abhishekd0907' has created a pull request for this

[jira] [Created] (SPARK-39492) Rework MISSING_COLUMN error class

2022-06-16 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-39492: Summary: Rework MISSING_COLUMN error class Key: SPARK-39492 URL: https://issues.apache.org/jira/browse/SPARK-39492 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-39491) Hadoop 2.7 build fails due to org.apache.hadoop.yarn.api.records.NodeState.DECOMMISSIONING

2022-06-16 Thread Thomas Graves (Jira)
Thomas Graves created SPARK-39491: - Summary: Hadoop 2.7 build fails due to org.apache.hadoop.yarn.api.records.NodeState.DECOMMISSIONING Key: SPARK-39491 URL: https://issues.apache.org/jira/browse/SPARK-39491

[jira] [Assigned] (SPARK-37961) override maxRows/maxRowsPerPartition for some logical operators

2022-06-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37961: --- Assignee: zhengruifeng > override maxRows/maxRowsPerPartition for some logical operators >

[jira] [Resolved] (SPARK-37961) override maxRows/maxRowsPerPartition for some logical operators

2022-06-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37961. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35250

[jira] [Updated] (SPARK-38614) After Spark update, df.show() shows incorrect F.percent_rank results

2022-06-16 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZygD updated SPARK-38614: - Description: Expected result is obtained using Spark 3.1.2, but not 3.2.0, 3.2.1 or 3.3.0. *Minimal

[jira] [Commented] (SPARK-38614) After Spark update, df.show() shows incorrect F.percent_rank results

2022-06-16 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555124#comment-17555124 ] ZygD commented on SPARK-38614: -- Just checked with the new 3.3.0 release. The error still persists. > After

[jira] [Updated] (SPARK-38614) After Spark update, df.show() shows incorrect F.percent_rank results

2022-06-16 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZygD updated SPARK-38614: - Affects Version/s: 3.3.0 > After Spark update, df.show() shows incorrect F.percent_rank results >

[jira] [Updated] (SPARK-39107) Silent change in regexp_replace's handling of empty strings

2022-06-16 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39107: - Fix Version/s: 3.1.4 (was: 3.1.3) > Silent change in regexp_replace's

[jira] [Commented] (SPARK-39107) Silent change in regexp_replace's handling of empty strings

2022-06-16 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555120#comment-17555120 ] Sean R. Owen commented on SPARK-39107: -- I agree, oops. I'll fix it.

[jira] [Commented] (SPARK-39107) Silent change in regexp_replace's handling of empty strings

2022-06-16 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555111#comment-17555111 ] Thomas Graves commented on SPARK-39107: --- [~srowen]   I think this actually went into 3.1.4,  not

[jira] [Commented] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

2022-06-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555107#comment-17555107 ] Apache Spark commented on SPARK-21195: -- User 'robert3005' has created a pull request for this

[jira] [Assigned] (SPARK-39446) Add relevance score for nDCG evaluation in MLLIB

2022-06-16 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39446: Assignee: Ryosuke Horiuchi > Add relevance score for nDCG evaluation in MLLIB >

[jira] [Resolved] (SPARK-39446) Add relevance score for nDCG evaluation in MLLIB

2022-06-16 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39446. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36843

[jira] [Updated] (SPARK-39446) Add relevance score for nDCG evaluation in MLLIB

2022-06-16 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39446: - Priority: Minor (was: Major) > Add relevance score for nDCG evaluation in MLLIB >

[jira] [Resolved] (SPARK-39470) Support cast of ANSI intervals to decimals

2022-06-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39470. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36857

[jira] [Updated] (SPARK-39446) Add relevance score for nDCG evaluation in MLLIB

2022-06-16 Thread Ryosuke Horiuchi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryosuke Horiuchi updated SPARK-39446: - Description: The current implementation of ndcgAt function treats relevance score as

[jira] [Resolved] (SPARK-39490) Support `ipFamilyPolicy` and `ipFamilies` in Driver Service

2022-06-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39490. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36887

[jira] [Resolved] (SPARK-39488) Simplify the error handling of TempResolvedColumn

2022-06-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39488. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36809

[jira] [Assigned] (SPARK-39488) Simplify the error handling of TempResolvedColumn

2022-06-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39488: --- Assignee: Wenchen Fan > Simplify the error handling of TempResolvedColumn >