[jira] [Commented] (SPARK-33357) Support SparkLauncher in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-33357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239550#comment-17239550 ] Apache Spark commented on SPARK-33357: -- User 'hddong' has created a pull request for this issue:

[jira] [Commented] (SPARK-33357) Support SparkLauncher in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-33357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239549#comment-17239549 ] Apache Spark commented on SPARK-33357: -- User 'hddong' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33357) Support SparkLauncher in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-33357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33357: Assignee: (was: Apache Spark) > Support SparkLauncher in Kubernetes >

[jira] [Assigned] (SPARK-33357) Support SparkLauncher in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-33357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33357: Assignee: Apache Spark > Support SparkLauncher in Kubernetes >

[jira] [Comment Edited] (SPARK-32691) Update commons-crypto to v1.1.0

[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239536#comment-17239536 ] RuiChen edited comment on SPARK-32691 at 11/27/20, 7:18 AM: [~huangtianhua] 

[jira] [Commented] (SPARK-32691) Update commons-crypto to v1.1.0

[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239536#comment-17239536 ] RuiChen commented on SPARK-32691: - [~huangtianhua] looks Spark ARM CI passed in these days,  > Update

[jira] [Resolved] (SPARK-33575) Fix incorrect exception message for ANALYZE COLUMN

[ https://issues.apache.org/jira/browse/SPARK-33575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33575. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30519

[jira] [Assigned] (SPARK-33575) Fix incorrect exception message for ANALYZE COLUMN

[ https://issues.apache.org/jira/browse/SPARK-33575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33575: --- Assignee: Terry Kim > Fix incorrect exception message for ANALYZE COLUMN >

[jira] [Resolved] (SPARK-33566) Incorrectly Parsing CSV file

[ https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33566. -- Fix Version/s: 3.1.0 Resolution: Fixed Fixed in

[jira] [Created] (SPARK-33576) PythonException: An exception was thrown from a UDF: 'OSError: Invalid IPC message: negative bodyLength'.

Darshat created SPARK-33576: --- Summary: PythonException: An exception was thrown from a UDF: 'OSError: Invalid IPC message: negative bodyLength'. Key: SPARK-33576 URL: https://issues.apache.org/jira/browse/SPARK-33576

[jira] [Updated] (SPARK-33570) Set the proper version of gssapi plugin automatically for MariaDBKrbIntegrationsuite

[ https://issues.apache.org/jira/browse/SPARK-33570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33570: --- Description: For MariaDBKrbIntegrationSuite, the version of mariadb-plugin-gssapi-server is

[jira] [Commented] (SPARK-33560) Add "unused import" check to Maven compilation process

[ https://issues.apache.org/jira/browse/SPARK-33560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239495#comment-17239495 ] Hyukjin Kwon commented on SPARK-33560: -- Seems like Scalac now has its built-in silencer support.

[jira] [Assigned] (SPARK-33575) Fix incorrect exception message for ANALYZE COLUMN

[ https://issues.apache.org/jira/browse/SPARK-33575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33575: Assignee: Apache Spark > Fix incorrect exception message for ANALYZE COLUMN >

[jira] [Assigned] (SPARK-33575) Fix incorrect exception message for ANALYZE COLUMN

[ https://issues.apache.org/jira/browse/SPARK-33575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33575: Assignee: (was: Apache Spark) > Fix incorrect exception message for ANALYZE COLUMN >

[jira] [Commented] (SPARK-33575) Fix incorrect exception message for ANALYZE COLUMN

[ https://issues.apache.org/jira/browse/SPARK-33575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239478#comment-17239478 ] Apache Spark commented on SPARK-33575: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33563) Expose inverse hyperbolic trig functions in PySpark and SparkR

[ https://issues.apache.org/jira/browse/SPARK-33563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33563: Assignee: Maciej Szymkiewicz > Expose inverse hyperbolic trig functions in PySpark and

[jira] [Resolved] (SPARK-33563) Expose inverse hyperbolic trig functions in PySpark and SparkR

[ https://issues.apache.org/jira/browse/SPARK-33563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33563. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30501

[jira] [Created] (SPARK-33575) Fix incorrect exception message for ANALYZE COLUMN

Terry Kim created SPARK-33575: - Summary: Fix incorrect exception message for ANALYZE COLUMN Key: SPARK-33575 URL: https://issues.apache.org/jira/browse/SPARK-33575 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33517) Incorrect menu item display and link in PySpark Usage Guide for Pandas with Apache Arrow

[ https://issues.apache.org/jira/browse/SPARK-33517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liucht-inspur updated SPARK-33517: -- Description: Error setting menu item and link, change "Apache Arrow in Spark" to "Apache

[jira] [Updated] (SPARK-33517) Incorrect menu item display and link in PySpark Usage Guide for Pandas with Apache Arrow

[ https://issues.apache.org/jira/browse/SPARK-33517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liucht-inspur updated SPARK-33517: -- Attachment: image-2020-11-27-09-43-58-141.png > Incorrect menu item display and link in

[jira] [Commented] (SPARK-33489) Support null for conversion from and to Arrow type

[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239461#comment-17239461 ] Yuya Kanai commented on SPARK-33489: [~bryanc] Yes I'll try working on it.  Thank you for

[jira] [Commented] (SPARK-16854) mapWithState Support for Python

[ https://issues.apache.org/jira/browse/SPARK-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239407#comment-17239407 ] Haim Bendanan commented on SPARK-16854: --- +1 > mapWithState Support for Python >

[jira] [Resolved] (SPARK-33568) install coverage for pypy3

[ https://issues.apache.org/jira/browse/SPARK-33568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-33568. - Resolution: Fixed > install coverage for pypy3 > -- > >

[jira] [Assigned] (SPARK-33568) install coverage for pypy3

[ https://issues.apache.org/jira/browse/SPARK-33568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp reassigned SPARK-33568: --- Assignee: Shane Knapp > install coverage for pypy3 > -- > >

[jira] [Commented] (SPARK-33568) install coverage for pypy3

[ https://issues.apache.org/jira/browse/SPARK-33568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239399#comment-17239399 ] Shane Knapp commented on SPARK-33568: - this is now installed on the ubuntu 16 workers > install

[jira] [Created] (SPARK-33574) Improve locality for push-based shuffle especially for join like operations

Min Shen created SPARK-33574: Summary: Improve locality for push-based shuffle especially for join like operations Key: SPARK-33574 URL: https://issues.apache.org/jira/browse/SPARK-33574 Project: Spark

[jira] [Created] (SPARK-33573) Server and client side metrics related to push-based shuffle

Min Shen created SPARK-33573: Summary: Server and client side metrics related to push-based shuffle Key: SPARK-33573 URL: https://issues.apache.org/jira/browse/SPARK-33573 Project: Spark Issue

[jira] [Updated] (SPARK-33235) Push-based Shuffle Improvement Tasks

[ https://issues.apache.org/jira/browse/SPARK-33235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Min Shen updated SPARK-33235: - Description: This is the parent jira for follow-up improvement tasks for supporting Push-based shuffle.

[jira] [Updated] (SPARK-33235) Push-based Shuffle Improvement Tasks

[ https://issues.apache.org/jira/browse/SPARK-33235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Min Shen updated SPARK-33235: - Summary: Push-based Shuffle Improvement Tasks (was: Push-based Shuffle Phase 2 Tasks) > Push-based

[jira] [Assigned] (SPARK-33566) Incorrectly Parsing CSV file

[ https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33566: Assignee: Apache Spark > Incorrectly Parsing CSV file > > >

[jira] [Commented] (SPARK-33566) Incorrectly Parsing CSV file

[ https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239304#comment-17239304 ] Apache Spark commented on SPARK-33566: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-33566) Incorrectly Parsing CSV file

[ https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239303#comment-17239303 ] Apache Spark commented on SPARK-33566: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-33566) Incorrectly Parsing CSV file

[ https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33566: Assignee: (was: Apache Spark) > Incorrectly Parsing CSV file >

[jira] [Comment Edited] (SPARK-33566) Incorrectly Parsing CSV file

[ https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239256#comment-17239256 ] Yang Jie edited comment on SPARK-33566 at 11/26/20, 1:12 PM: - I think the

[jira] [Commented] (SPARK-33566) Incorrectly Parsing CSV file

[ https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239256#comment-17239256 ] Yang Jie commented on SPARK-33566: -- I think the reason for the bad case is Spark use

[jira] [Updated] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Roberto de Oliveira Castro updated SPARK-33564: - Description: Following the

[jira] [Commented] (SPARK-33498) Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

[ https://issues.apache.org/jira/browse/SPARK-33498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239233#comment-17239233 ] Apache Spark commented on SPARK-33498: -- User 'waitinfuture' has created a pull request for this

[jira] [Created] (SPARK-33572) Datetime building should fail if the year, month, ..., second combination is invalid

zhoukeyong created SPARK-33572: -- Summary: Datetime building should fail if the year, month, ..., second combination is invalid Key: SPARK-33572 URL: https://issues.apache.org/jira/browse/SPARK-33572

[jira] [Commented] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239204#comment-17239204 ] Simon commented on SPARK-33571: --- Below the output of the date testscript with the noise removed Writing

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239204#comment-17239204 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:16 AM: --- Below the output

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:11 AM: --- Below the output

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:11 AM: --- Below the output

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:07 AM: --- Below the output

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:06 AM: --- Below the output

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:06 AM: --- Below the output

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:05 AM: --- Below the output

[jira] [Commented] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239193#comment-17239193 ] Simon commented on SPARK-33571: --- Below the output of the timestamp test script with the noise removed

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:03 AM: --- Below the output

[jira] [Created] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

Simon created SPARK-33571: - Summary: Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly Key: SPARK-33571 URL: https://issues.apache.org/jira/browse/SPARK-33571

[jira] [Updated] (SPARK-33570) Set the proper version of gssapi plugin automatically for MariaDBKrbIntegrationsuite

[ https://issues.apache.org/jira/browse/SPARK-33570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33570: --- Description: For MariaDBKrbIntegrationSuite, the version of mariadb-plugin-gssapi-server is

[jira] [Assigned] (SPARK-33570) Set the proper version of gssapi plugin automatically for MariaDBKrbIntegrationsuite

[ https://issues.apache.org/jira/browse/SPARK-33570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33570: Assignee: Apache Spark (was: Kousuke Saruta) > Set the proper version of gssapi plugin

[jira] [Assigned] (SPARK-33570) Set the proper version of gssapi plugin automatically for MariaDBKrbIntegrationsuite

[ https://issues.apache.org/jira/browse/SPARK-33570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33570: Assignee: Kousuke Saruta (was: Apache Spark) > Set the proper version of gssapi plugin

[jira] [Commented] (SPARK-33570) Set the proper version of gssapi plugin automatically for MariaDBKrbIntegrationsuite

[ https://issues.apache.org/jira/browse/SPARK-33570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239145#comment-17239145 ] Apache Spark commented on SPARK-33570: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-33570) Set the proper version of gssapi plugin automatically for MariaDBKrbIntegrationsuite

[ https://issues.apache.org/jira/browse/SPARK-33570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33570: --- Description: For MariaDBKrbIntegrationSuite, the version of mariadb-plugin-gssapi-server is

[jira] [Created] (SPARK-33570) Set the proper version of gssapi plugin automatically for MariaDBKrbIntegrationsuite

Kousuke Saruta created SPARK-33570: -- Summary: Set the proper version of gssapi plugin automatically for MariaDBKrbIntegrationsuite Key: SPARK-33570 URL: https://issues.apache.org/jira/browse/SPARK-33570

[jira] [Assigned] (SPARK-33569) Remove getting partitions by only ident

[ https://issues.apache.org/jira/browse/SPARK-33569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33569: Assignee: (was: Apache Spark) > Remove getting partitions by only ident >

[jira] [Assigned] (SPARK-33569) Remove getting partitions by only ident

[ https://issues.apache.org/jira/browse/SPARK-33569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33569: Assignee: Apache Spark > Remove getting partitions by only ident >

[jira] [Commented] (SPARK-33569) Remove getting partitions by only ident

[ https://issues.apache.org/jira/browse/SPARK-33569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239128#comment-17239128 ] Apache Spark commented on SPARK-33569: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-33569) Remove getting partitions by only ident

Maxim Gekk created SPARK-33569: -- Summary: Remove getting partitions by only ident Key: SPARK-33569 URL: https://issues.apache.org/jira/browse/SPARK-33569 Project: Spark Issue Type: Sub-task