[jira] [Commented] (SPARK-27389) pyspark test failures w/ "UnknownTimeZoneError: 'US/Pacific-New'"

[ https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811461#comment-16811461 ] Felix Cheung commented on SPARK-27389: -- maybe a new JDK changes TimeZone? > pyspark test failures

[jira] [Commented] (SPARK-27389) pyspark test failures w/ "UnknownTimeZoneError: 'US/Pacific-New'"

[ https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811355#comment-16811355 ] Bryan Cutler commented on SPARK-27389: -- >From the stacktrace, it looks like it's getting this from

[jira] [Assigned] (SPARK-27391) deadlock in ContinuousExecution unit tests

[ https://issues.apache.org/jira/browse/SPARK-27391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-27391: - Assignee: Jose Torres > deadlock in ContinuousExecution unit tests >

[jira] [Resolved] (SPARK-27391) deadlock in ContinuousExecution unit tests

[ https://issues.apache.org/jira/browse/SPARK-27391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Torres resolved SPARK-27391. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24301

[jira] [Commented] (SPARK-16548) java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data

[ https://issues.apache.org/jira/browse/SPARK-16548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811206#comment-16811206 ] Bijith Kumar commented on SPARK-16548: -- [~cloud_fan] I am getting the same Exception in Spark

[jira] [Commented] (SPARK-27396) SPIP: Public APIs for extended Columnar Processing Support

[ https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811183#comment-16811183 ] Robert Joseph Evans commented on SPARK-27396: - I have kept this at a high level just

[jira] [Created] (SPARK-27396) SPIP: Public APIs for extended Columnar Processing Support

Robert Joseph Evans created SPARK-27396: --- Summary: SPIP: Public APIs for extended Columnar Processing Support Key: SPARK-27396 URL: https://issues.apache.org/jira/browse/SPARK-27396 Project:

[jira] [Resolved] (SPARK-26936) On yarn-client mode, insert overwrite local directory can not create temporary path in local staging directory

[ https://issues.apache.org/jira/browse/SPARK-26936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26936. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23841

[jira] [Assigned] (SPARK-26936) On yarn-client mode, insert overwrite local directory can not create temporary path in local staging directory

[ https://issues.apache.org/jira/browse/SPARK-26936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26936: - Assignee: jiaan.geng > On yarn-client mode, insert overwrite local directory can not create >

[jira] [Resolved] (SPARK-27390) Fix package name mismatch

[ https://issues.apache.org/jira/browse/SPARK-27390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27390. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 3.0.0

[jira] [Resolved] (SPARK-27192) spark.task.cpus should be less or equal than spark.task.cpus when use static executor allocation

[ https://issues.apache.org/jira/browse/SPARK-27192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27192. --- Resolution: Fixed Issue resolved by pull request 24261 [https://github.com/apache/spark/pull/24261]

[jira] [Commented] (SPARK-25994) SPIP: Property Graphs, Cypher Queries, and Algorithms

[ https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811163#comment-16811163 ] Saikat Kanjilal commented on SPARK-25994: - [~mju] I added some initial comments, will review PR

[jira] [Resolved] (SPARK-27358) Update jquery to 1.12.x to pick up security fixes

[ https://issues.apache.org/jira/browse/SPARK-27358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27358. --- Resolution: Fixed Fix Version/s: 2.3.4 2.4.2 3.0.0

[jira] [Commented] (SPARK-20787) PySpark can't handle datetimes before 1900

[ https://issues.apache.org/jira/browse/SPARK-20787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811044#comment-16811044 ] Ruben Berenguel commented on SPARK-20787: - Hi [~AdiC], indeed, I have not added additional work.

[jira] [Resolved] (SPARK-27393) Show ReusedSubquery in the plan when the subquery is reused

[ https://issues.apache.org/jira/browse/SPARK-27393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27393. - Resolution: Fixed Fix Version/s: 3.0.0 > Show ReusedSubquery in the plan when the subquery is

[jira] [Commented] (SPARK-27176) Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

[ https://issues.apache.org/jira/browse/SPARK-27176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810652#comment-16810652 ] Yuming Wang commented on SPARK-27176: - For Hive 2.3.4, we also need {{hive-llap-common}} and

[jira] [Updated] (SPARK-27388) expression encoder for avro like objects

[ https://issues.apache.org/jira/browse/SPARK-27388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Taoufik DACHRAOUI updated SPARK-27388: -- Description: Add an expression encoder for objects defined by properties (ie. I call

[jira] [Commented] (SPARK-27289) spark-submit explicit configuration does not take effect but Spark UI shows it's effective

[ https://issues.apache.org/jira/browse/SPARK-27289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810627#comment-16810627 ] Udbhav Agrawal commented on SPARK-27289: [~KaiXu] for me it is coming correct and could not

[jira] [Resolved] (SPARK-24545) Function hour not working as expected for hour 2 in PySpark

[ https://issues.apache.org/jira/browse/SPARK-24545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Blanco resolved SPARK-24545. - Resolution: Fixed Field date was in String format so the change happened because it converted