[jira] [Created] (SPARK-41462) Date and timestamp type can up cast to TimestampNTZ

2022-12-08 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41462: -- Summary: Date and timestamp type can up cast to TimestampNTZ Key: SPARK-41462 URL: https://issues.apache.org/jira/browse/SPARK-41462 Project: Spark

[jira] [Commented] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645141#comment-17645141 ] Apache Spark commented on SPARK-41008: -- User 'ahmed-mahran' has created a pull request for this

[jira] [Commented] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645140#comment-17645140 ] Apache Spark commented on SPARK-41008: -- User 'ahmed-mahran' has created a pull request for this

[jira] [Commented] (SPARK-41369) Refactor connect directory structure

2022-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645137#comment-17645137 ] Hyukjin Kwon commented on SPARK-41369: -- Followup

[jira] [Updated] (SPARK-41461) protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14

2022-12-08 Thread Haonan Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haonan Jiang updated SPARK-41461: - Description: Compile Spark Core module on CentOS release 6.3, the default glibc version is

[jira] [Comment Edited] (SPARK-41125) Simple call to createDataFrame fails with PicklingError but only on python3.11

2022-12-08 Thread Jamie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645126#comment-17645126 ] Jamie edited comment on SPARK-41125 at 12/9/22 7:22 AM: [~dongjoon] thank you

[jira] [Commented] (SPARK-41125) Simple call to createDataFrame fails with PicklingError but only on python3.11

2022-12-08 Thread Jamie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645126#comment-17645126 ] Jamie commented on SPARK-41125: --- [~dongjoon] thank you very much. I shall re-test when the next version is

[jira] [Commented] (SPARK-41461) protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14

2022-12-08 Thread Haonan Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645124#comment-17645124 ] Haonan Jiang commented on SPARK-41461: -- I'm working on this jira. > protoc-3.21.9-linux-x86_64.exe

[jira] [Updated] (SPARK-41461) protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14

2022-12-08 Thread Haonan Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haonan Jiang updated SPARK-41461: - Description: Compile Spark Core module on CentOS release 6.3, the default glibc version is

[jira] [Created] (SPARK-41461) protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14

2022-12-08 Thread Haonan Jiang (Jira)
Haonan Jiang created SPARK-41461: Summary: protoc-3.21.9-linux-x86_64.exe requires GLIBC_2.14 Key: SPARK-41461 URL: https://issues.apache.org/jira/browse/SPARK-41461 Project: Spark Issue

[jira] [Assigned] (SPARK-41460) Introduce IsolatedThreadSafeRpcEndpoint to extend IsolatedRpcEndpoint

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41460: Assignee: (was: Apache Spark) > Introduce IsolatedThreadSafeRpcEndpoint to extend

[jira] [Commented] (SPARK-41460) Introduce IsolatedThreadSafeRpcEndpoint to extend IsolatedRpcEndpoint

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645121#comment-17645121 ] Apache Spark commented on SPARK-41460: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41460) Introduce IsolatedThreadSafeRpcEndpoint to extend IsolatedRpcEndpoint

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41460: Assignee: Apache Spark > Introduce IsolatedThreadSafeRpcEndpoint to extend

[jira] [Commented] (SPARK-41329) Solve circular import between Column and _typing/functions

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645118#comment-17645118 ] Apache Spark commented on SPARK-41329: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41329) Solve circular import between Column and _typing/functions

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41329: Assignee: (was: Apache Spark) > Solve circular import between Column and

[jira] [Assigned] (SPARK-41329) Solve circular import between Column and _typing/functions

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41329: Assignee: Apache Spark > Solve circular import between Column and _typing/functions >

[jira] [Commented] (SPARK-41329) Solve circular import between Column and _typing/functions

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645117#comment-17645117 ] Apache Spark commented on SPARK-41329: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41459) Spark Thrift Server operation log output is empty

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645115#comment-17645115 ] Apache Spark commented on SPARK-41459: -- User 'idealspark' has created a pull request for this

[jira] [Assigned] (SPARK-41459) Spark Thrift Server operation log output is empty

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41459: Assignee: (was: Apache Spark) > Spark Thrift Server operation log output is empty >

[jira] [Assigned] (SPARK-41459) Spark Thrift Server operation log output is empty

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41459: Assignee: Apache Spark > Spark Thrift Server operation log output is empty >

[jira] [Commented] (SPARK-41459) Spark Thrift Server operation log output is empty

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645116#comment-17645116 ] Apache Spark commented on SPARK-41459: -- User 'idealspark' has created a pull request for this

[jira] [Commented] (SPARK-41459) Spark Thrift Server operation log output is empty

2022-12-08 Thread Yun Tian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645114#comment-17645114 ] Yun Tian commented on SPARK-41459: -- pull request https://github.com/apache/spark/pull/38993/ > Spark

[jira] [Commented] (SPARK-41459) Spark Thrift Server operation log output is empty

2022-12-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645111#comment-17645111 ] Yuming Wang commented on SPARK-41459: - cc [~LuciferYang] > Spark Thrift Server operation log output

[jira] [Created] (SPARK-41460) Introduce IsolatedThreadSafeRpcEndpoint to extend IsolatedRpcEndpoint

2022-12-08 Thread wuyi (Jira)
wuyi created SPARK-41460: Summary: Introduce IsolatedThreadSafeRpcEndpoint to extend IsolatedRpcEndpoint Key: SPARK-41460 URL: https://issues.apache.org/jira/browse/SPARK-41460 Project: Spark

[jira] [Commented] (SPARK-41457) Refactor pandas, pyarrow and grpc check in tests

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645106#comment-17645106 ] Apache Spark commented on SPARK-41457: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41457) Refactor pandas, pyarrow and grpc check in tests

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645105#comment-17645105 ] Apache Spark commented on SPARK-41457: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41457) Refactor pandas, pyarrow and grpc check in tests

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41457: Assignee: Apache Spark > Refactor pandas, pyarrow and grpc check in tests >

[jira] [Assigned] (SPARK-41457) Refactor pandas, pyarrow and grpc check in tests

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41457: Assignee: (was: Apache Spark) > Refactor pandas, pyarrow and grpc check in tests >

[jira] [Created] (SPARK-41459) Spark Thrift Server operation log output is empty

2022-12-08 Thread Yun Tian (Jira)
Yun Tian created SPARK-41459: Summary: Spark Thrift Server operation log output is empty Key: SPARK-41459 URL: https://issues.apache.org/jira/browse/SPARK-41459 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645085#comment-17645085 ] Apache Spark commented on SPARK-41458: -- User 'pan3793' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41458: Assignee: (was: Apache Spark) > Correctly transform the SPI services for Yarn

[jira] [Assigned] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41458: Assignee: Apache Spark > Correctly transform the SPI services for Yarn Shuffle Service >

[jira] [Commented] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645084#comment-17645084 ] Apache Spark commented on SPARK-41458: -- User 'pan3793' has created a pull request for this issue:

[jira] [Created] (SPARK-41458) Correctly transform the SPI services for Yarn Shuffle Service

2022-12-08 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-41458: - Summary: Correctly transform the SPI services for Yarn Shuffle Service Key: SPARK-41458 URL: https://issues.apache.org/jira/browse/SPARK-41458 Project: Spark

[jira] [Created] (SPARK-41457) Refactor pandas, pyarrow and grpc check in tests

2022-12-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-41457: Summary: Refactor pandas, pyarrow and grpc check in tests Key: SPARK-41457 URL: https://issues.apache.org/jira/browse/SPARK-41457 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41456) Improve the performance of try_cast

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41456: Assignee: Gengliang Wang (was: Apache Spark) > Improve the performance of try_cast >

[jira] [Commented] (SPARK-41456) Improve the performance of try_cast

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645080#comment-17645080 ] Apache Spark commented on SPARK-41456: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-41456) Improve the performance of try_cast

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41456: Assignee: Apache Spark (was: Gengliang Wang) > Improve the performance of try_cast >

[jira] [Updated] (SPARK-41456) Improve the performance of try_cast

2022-12-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41456: --- Description: For try_cast and the legacy cast (cast with ANSI SQL mode off), there are

[jira] [Created] (SPARK-41456) Improve the performance of try_cast

2022-12-08 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41456: -- Summary: Improve the performance of try_cast Key: SPARK-41456 URL: https://issues.apache.org/jira/browse/SPARK-41456 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41440) Implement DataFrame.randomSplit

2022-12-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645066#comment-17645066 ] jiaan.geng commented on SPARK-41440: I'm working on. > Implement DataFrame.randomSplit >

[jira] [Updated] (SPARK-41402) Override nodeName of StringDecode

2022-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41402: - Component/s: SQL (was: PySpark) > Override nodeName of StringDecode >

[jira] [Commented] (SPARK-41450) PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler"

2022-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645044#comment-17645044 ] Hyukjin Kwon commented on SPARK-41450: -- [~LuciferYang]  have you ever seen this before? > PySpark

[jira] [Commented] (SPARK-41125) Simple call to createDataFrame fails with PicklingError but only on python3.11

2022-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645040#comment-17645040 ] Dongjoon Hyun commented on SPARK-41125: --- Hi, [~jamet]. I believe this issue is resolved in the

[jira] [Resolved] (SPARK-41454) Support Python 3.11

2022-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41454. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38987

[jira] [Assigned] (SPARK-41454) Support Python 3.11

2022-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41454: - Assignee: Dongjoon Hyun > Support Python 3.11 > --- > >

[jira] [Assigned] (SPARK-41452) to_char throws NullPointerException when format is null

2022-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41452: - Assignee: Bruce Robbins > to_char throws NullPointerException when format is null >

[jira] [Resolved] (SPARK-41452) to_char throws NullPointerException when format is null

2022-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41452. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38986

[jira] [Updated] (SPARK-41455) Resolve dtypes inconsistencies of date/timestamp functions

2022-12-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41455: - Description: When implementing date/timestamp functions, we notice inconsistent dtypes with

[jira] [Updated] (SPARK-41455) Resolve dtypes inconsistencies of date/timestamp functions

2022-12-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41455: - Description: When implementing date/timestamp functions, we notice inconsistent dtypes with

[jira] [Updated] (SPARK-41455) Resolve dtypes inconsistencies of date/timestamp functions

2022-12-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41455: - Description: When implementing date/timestamp functions, we notice inconsistent dtypes with

[jira] [Created] (SPARK-41455) Resolve dtypes inconsistencies of date/timestamp functions

2022-12-08 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-41455: Summary: Resolve dtypes inconsistencies of date/timestamp functions Key: SPARK-41455 URL: https://issues.apache.org/jira/browse/SPARK-41455 Project: Spark

[jira] [Commented] (SPARK-41454) Support Python 3.11

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645022#comment-17645022 ] Apache Spark commented on SPARK-41454: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-41454) Support Python 3.11

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41454: Assignee: Apache Spark > Support Python 3.11 > --- > >

[jira] [Assigned] (SPARK-41454) Support Python 3.11

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41454: Assignee: (was: Apache Spark) > Support Python 3.11 > --- > >

[jira] [Created] (SPARK-41454) Support Python 3.11

2022-12-08 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-41454: - Summary: Support Python 3.11 Key: SPARK-41454 URL: https://issues.apache.org/jira/browse/SPARK-41454 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-41453) Implement DataFrame.subtract

2022-12-08 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-41453: -- Summary: Implement DataFrame.subtract Key: SPARK-41453 URL: https://issues.apache.org/jira/browse/SPARK-41453 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41452) to_char throws NullPointerException when format is null

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41452: Assignee: Apache Spark > to_char throws NullPointerException when format is null >

[jira] [Assigned] (SPARK-41452) to_char throws NullPointerException when format is null

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41452: Assignee: (was: Apache Spark) > to_char throws NullPointerException when format is

[jira] [Commented] (SPARK-41452) to_char throws NullPointerException when format is null

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644995#comment-17644995 ] Apache Spark commented on SPARK-41452: -- User 'bersprockets' has created a pull request for this

[jira] [Updated] (SPARK-41452) to_char throws NullPointerException when format is null

2022-12-08 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41452: -- Description: Example: {noformat} spark-sql> select to_char(454, null); [INTERNAL_ERROR] The

[jira] [Created] (SPARK-41452) to_char throws NullPointerException when format is null

2022-12-08 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-41452: - Summary: to_char throws NullPointerException when format is null Key: SPARK-41452 URL: https://issues.apache.org/jira/browse/SPARK-41452 Project: Spark

[jira] [Assigned] (SPARK-41451) Avoid using empty abbrevMarker in StringUtils.abbreviate

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41451: Assignee: Apache Spark > Avoid using empty abbrevMarker in StringUtils.abbreviate >

[jira] [Commented] (SPARK-41451) Avoid using empty abbrevMarker in StringUtils.abbreviate

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644888#comment-17644888 ] Apache Spark commented on SPARK-41451: -- User 'pan3793' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41451) Avoid using empty abbrevMarker in StringUtils.abbreviate

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41451: Assignee: (was: Apache Spark) > Avoid using empty abbrevMarker in

[jira] [Created] (SPARK-41451) Avoid using empty abbrevMarker in StringUtils.abbreviate

2022-12-08 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-41451: - Summary: Avoid using empty abbrevMarker in StringUtils.abbreviate Key: SPARK-41451 URL: https://issues.apache.org/jira/browse/SPARK-41451 Project: Spark Issue

[jira] [Assigned] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-12-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41008: Assignee: Ahmed Mahran > Isotonic regression result differs from sklearn implementation

[jira] [Resolved] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-12-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41008. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38966

[jira] [Resolved] (SPARK-41408) Upgrade scala-maven-plugin to 4.8.0

2022-12-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41408. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38936

[jira] [Assigned] (SPARK-41408) Upgrade scala-maven-plugin to 4.8.0

2022-12-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-41408: Assignee: Yang Jie > Upgrade scala-maven-plugin to 4.8.0 >

[jira] [Updated] (SPARK-41450) PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler"

2022-12-08 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-41450: --- Description: Reproducing steps: first, clone spark master code, then # Build pyspark package by:

[jira] [Created] (SPARK-41450) PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler"

2022-12-08 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-41450: -- Summary: PySpark built from master code raise error "java.lang.ClassNotFoundException: org.eclipse.jetty.server.Handler" Key: SPARK-41450 URL:

[jira] [Commented] (SPARK-41349) Implement `DataFrame.hint`

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644805#comment-17644805 ] Apache Spark commented on SPARK-41349: -- User 'dengziming' has created a pull request for this

[jira] [Assigned] (SPARK-41349) Implement `DataFrame.hint`

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41349: Assignee: Deng Ziming (was: Apache Spark) > Implement `DataFrame.hint` >

[jira] [Commented] (SPARK-41349) Implement `DataFrame.hint`

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644803#comment-17644803 ] Apache Spark commented on SPARK-41349: -- User 'dengziming' has created a pull request for this

[jira] [Assigned] (SPARK-41349) Implement `DataFrame.hint`

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41349: Assignee: Apache Spark (was: Deng Ziming) > Implement `DataFrame.hint` >

[jira] [Commented] (SPARK-36833) Can't use SSL with spark on kubernetes on service level

2022-12-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-36833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644792#comment-17644792 ] Gellért commented on SPARK-36833: - You could use on your sparkconf .setAppName("name") > Can't use SSL

[jira] [Resolved] (SPARK-41435) Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null

2022-12-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41435. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38960

[jira] [Assigned] (SPARK-41435) Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null

2022-12-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41435: Assignee: Yang Jie > Make `curdate()` throw `WRONG_NUM_ARGS ` instead of

[jira] [Updated] (SPARK-41449) Stage level scheduling, allow to change number of executors

2022-12-08 Thread Shay Elbaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shay Elbaz updated SPARK-41449: --- Description: Since the total/max number of executor is constant throughout the application - in

[jira] [Updated] (SPARK-41449) Stage level scheduling, allow to change number of executors

2022-12-08 Thread Shay Elbaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shay Elbaz updated SPARK-41449: --- Description: Since the total/max number of executor is constant throughout the application - in

[jira] [Created] (SPARK-41449) Stage level scheduling, allow to change number of executors

2022-12-08 Thread Shay Elbaz (Jira)
Shay Elbaz created SPARK-41449: -- Summary: Stage level scheduling, allow to change number of executors Key: SPARK-41449 URL: https://issues.apache.org/jira/browse/SPARK-41449 Project: Spark

[jira] [Assigned] (SPARK-41447) clean up expired event log files that don't exist in listing db

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41447: Assignee: (was: Apache Spark) > clean up expired event log files that don't exist in

[jira] [Assigned] (SPARK-41447) clean up expired event log files that don't exist in listing db

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41447: Assignee: Apache Spark > clean up expired event log files that don't exist in listing db

[jira] [Commented] (SPARK-41447) clean up expired event log files that don't exist in listing db

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644759#comment-17644759 ] Apache Spark commented on SPARK-41447: -- User 'shuyouZZ' has created a pull request for this issue:

[jira] [Commented] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644750#comment-17644750 ] Apache Spark commented on SPARK-41376: -- User 'pan3793' has created a pull request for this issue:

[jira] [Commented] (SPARK-41376) Executor netty direct memory check should respect spark.shuffle.io.preferDirectBufs

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644749#comment-17644749 ] Apache Spark commented on SPARK-41376: -- User 'pan3793' has created a pull request for this issue:

[jira] [Updated] (SPARK-41447) clean up expired event log files that don't exist in listing db

2022-12-08 Thread shuyouZZ (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuyouZZ updated SPARK-41447: - Description: When restarting the history server, the previous logic is to execute {{checkForLogs}}

[jira] [Commented] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644724#comment-17644724 ] Apache Spark commented on SPARK-41448: -- User 'boneanxs' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41448: Assignee: Apache Spark > Make consistent MR job IDs in FileBatchWriter and

[jira] [Assigned] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter

2022-12-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41448: Assignee: (was: Apache Spark) > Make consistent MR job IDs in FileBatchWriter and

[jira] [Updated] (SPARK-41448) Make consistent MR job IDs in FileBatchWriter and FileFormatWriter

2022-12-08 Thread Hui An (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui An updated SPARK-41448: --- Summary: Make consistent MR job IDs in FileBatchWriter and FileFormatWriter (was: Make consistent MR job

[jira] [Created] (SPARK-41448) Make consistent MR job IDs in DSV2 and FileFormatWriter

2022-12-08 Thread Hui An (Jira)
Hui An created SPARK-41448: -- Summary: Make consistent MR job IDs in DSV2 and FileFormatWriter Key: SPARK-41448 URL: https://issues.apache.org/jira/browse/SPARK-41448 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-41447) clean up expired event log files that don't exist in listing db

2022-12-08 Thread shuyouZZ (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuyouZZ updated SPARK-41447: - Description: When restarting the history server, the previous logic is to execute {{checkForLogs}}

[jira] [Updated] (SPARK-41439) Implement `DataFrame.melt` and `DataFrame.unpivot`

2022-12-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-41439: --- Summary: Implement `DataFrame.melt` and `DataFrame.unpivot` (was: Implement `DataFrame.melt`) >

[jira] [Assigned] (SPARK-41436) Implement `collection` functions: A~C

2022-12-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41436: - Assignee: Ruifeng Zheng > Implement `collection` functions: A~C >

[jira] [Resolved] (SPARK-41436) Implement `collection` functions: A~C

2022-12-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41436. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38961

[jira] [Resolved] (SPARK-41412) Implement `Cast`

2022-12-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41412. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38970

[jira] [Created] (SPARK-41447) clean up expired event log files that don't exist in listing db

2022-12-08 Thread shuyouZZ (Jira)
shuyouZZ created SPARK-41447: Summary: clean up expired event log files that don't exist in listing db Key: SPARK-41447 URL: https://issues.apache.org/jira/browse/SPARK-41447 Project: Spark

[jira] [Resolved] (SPARK-41445) Implement DataFrameReader.parquet

2022-12-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41445. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38977

  1   2   >