[jira] [Created] (SPARK-36722) Problems with update function in koalas - pyspark pandas.

2021-09-11 Thread Jira
Bjørn Jørgensen created SPARK-36722: --- Summary: Problems with update function in koalas - pyspark pandas. Key: SPARK-36722 URL: https://issues.apache.org/jira/browse/SPARK-36722 Project: Spark

[jira] [Created] (SPARK-36723) day-time interval types should respect daylight saving time correctly

2021-09-11 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36723: -- Summary: day-time interval types should respect daylight saving time correctly Key: SPARK-36723 URL: https://issues.apache.org/jira/browse/SPARK-36723 Project: Sp

[jira] [Updated] (SPARK-36723) day-time interval types should respect daylight saving time correctly

2021-09-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36723: --- Description: In the current master, day-time interval types handle 24 hours as 1 day regard

[jira] [Updated] (SPARK-36723) day-time interval types should respect daylight saving time correctly

2021-09-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36723: --- Description: In the current master, day-time interval types handle 24 hours as 1 day regard

[jira] [Created] (SPARK-36724) Support timestamp_ntz as a type of time column for SessionWindow

2021-09-11 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36724: -- Summary: Support timestamp_ntz as a type of time column for SessionWindow Key: SPARK-36724 URL: https://issues.apache.org/jira/browse/SPARK-36724 Project: Spark

[jira] [Commented] (SPARK-36724) Support timestamp_ntz as a type of time column for SessionWindow

2021-09-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413554#comment-17413554 ] Apache Spark commented on SPARK-36724: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-36724) Support timestamp_ntz as a type of time column for SessionWindow

2021-09-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36724: Assignee: Apache Spark (was: Kousuke Saruta) > Support timestamp_ntz as a type of time c

[jira] [Assigned] (SPARK-36724) Support timestamp_ntz as a type of time column for SessionWindow

2021-09-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36724: Assignee: Kousuke Saruta (was: Apache Spark) > Support timestamp_ntz as a type of time c

[jira] [Commented] (SPARK-36724) Support timestamp_ntz as a type of time column for SessionWindow

2021-09-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413555#comment-17413555 ] Apache Spark commented on SPARK-36724: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-36556) Add DSV2 filters

2021-09-11 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36556: --- Assignee: Huaxin Gao > Add DSV2 filters > > > Key: SPARK-3

[jira] [Resolved] (SPARK-36556) Add DSV2 filters

2021-09-11 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36556. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33803 [https://gith

[jira] [Resolved] (SPARK-36704) InaccessibleObjectException in Java 9+ on startup

2021-09-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36704. -- Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution: Fixed

[jira] [Created] (SPARK-36725) Ensure HiveThriftServer2Suites to stop Thrift JDBC server on exit

2021-09-11 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36725: -- Summary: Ensure HiveThriftServer2Suites to stop Thrift JDBC server on exit Key: SPARK-36725 URL: https://issues.apache.org/jira/browse/SPARK-36725 Project: Spark

[jira] [Assigned] (SPARK-36725) Ensure HiveThriftServer2Suites to stop Thrift JDBC server on exit

2021-09-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36725: Assignee: Kousuke Saruta (was: Apache Spark) > Ensure HiveThriftServer2Suites to stop Th

[jira] [Assigned] (SPARK-36725) Ensure HiveThriftServer2Suites to stop Thrift JDBC server on exit

2021-09-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36725: Assignee: Apache Spark (was: Kousuke Saruta) > Ensure HiveThriftServer2Suites to stop Th

[jira] [Commented] (SPARK-36725) Ensure HiveThriftServer2Suites to stop Thrift JDBC server on exit

2021-09-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413597#comment-17413597 ] Apache Spark commented on SPARK-36725: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-28620) Double type returned for float type in Beeline/JDBC

2021-09-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413602#comment-17413602 ] Kousuke Saruta commented on SPARK-28620: [~yumwang] The reason is ColumnValue.fl

[jira] [Updated] (SPARK-36685) Fix wrong assert messages

2021-09-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36685: -- Summary: Fix wrong assert messages (was: Fix wrong assert statement) > Fix wrong assert messa

[jira] [Resolved] (SPARK-36685) Fix wrong assert messages

2021-09-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36685. --- Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution: Fix

[jira] [Resolved] (SPARK-36725) Ensure HiveThriftServer2Suites to stop Thrift JDBC server on exit

2021-09-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36725. --- Fix Version/s: 3.2.0 Resolution: Fixed This is resolved via https://github.com/apache

[jira] [Assigned] (SPARK-36685) Fix wrong assert messages

2021-09-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36685: - Assignee: dgd_contributor > Fix wrong assert messages > - > >

[jira] [Resolved] (SPARK-35822) Spark UI-Executor tab is empty in IE11

2021-09-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35822. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33937 [https://

[jira] [Assigned] (SPARK-36719) Supporting Netty Logging at the network layer

2021-09-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36719: - Assignee: Attila Zsolt Piros > Supporting Netty Logging at the network layer >

[jira] [Resolved] (SPARK-36719) Supporting Netty Logging at the network layer

2021-09-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36719. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33962 [https://

[jira] [Assigned] (SPARK-35822) Spark UI-Executor tab is empty in IE11

2021-09-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35822: - Assignee: dgd_contributor > Spark UI-Executor tab is empty in IE11 > --

[jira] [Commented] (SPARK-36722) Problems with update function in koalas - pyspark pandas.

2021-09-11 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413632#comment-17413632 ] dgd_contributor commented on SPARK-36722: - I will make a PR to fix this one soon

[jira] [Commented] (SPARK-24943) Convert a SQL Struct to StructType

2021-09-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413633#comment-17413633 ] Hyukjin Kwon commented on SPARK-24943: -- {{uniontype, char, and varchar}} these are

[jira] [Commented] (SPARK-32285) Add PySpark support for nested timestamps with arrow

2021-09-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413634#comment-17413634 ] Hyukjin Kwon commented on SPARK-32285: -- Please go ahead. > Add PySpark support for

[jira] [Updated] (SPARK-36722) Problems with update function in koalas - pyspark pandas.

2021-09-11 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dgd_contributor updated SPARK-36722: Affects Version/s: 3.2.0 > Problems with update function in koalas - pyspark pandas. > ---

[jira] [Commented] (SPARK-36722) Problems with update function in koalas - pyspark pandas.

2021-09-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413636#comment-17413636 ] Apache Spark commented on SPARK-36722: -- User 'dgd-contributor' has created a pull r

[jira] [Assigned] (SPARK-36722) Problems with update function in koalas - pyspark pandas.

2021-09-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36722: Assignee: Apache Spark > Problems with update function in koalas - pyspark pandas. >

[jira] [Assigned] (SPARK-36722) Problems with update function in koalas - pyspark pandas.

2021-09-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36722: Assignee: (was: Apache Spark) > Problems with update function in koalas - pyspark pan

[jira] [Commented] (SPARK-36722) Problems with update function in koalas - pyspark pandas.

2021-09-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413637#comment-17413637 ] Apache Spark commented on SPARK-36722: -- User 'dgd-contributor' has created a pull r

[jira] [Commented] (SPARK-36720) On overwrite mode, setting option truncate as true doesn't truncate the table

2021-09-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413639#comment-17413639 ] Hyukjin Kwon commented on SPARK-36720: -- The error is from: {quote} com.sap.db.jdbc

[jira] [Updated] (SPARK-36714) bugs in MIniLSH

2021-09-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36714: - Fix Version/s: (was: 2.1.1) > bugs in MIniLSH > --- > > Key: SPA

[jira] [Updated] (SPARK-36714) bugs in MIniLSH

2021-09-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36714: - Target Version/s: (was: 3.1.2) > bugs in MIniLSH > --- > > Key: SP

[jira] [Commented] (SPARK-36714) bugs in MIniLSH

2021-09-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413640#comment-17413640 ] Hyukjin Kwon commented on SPARK-36714: -- Apache Spark 2.x is EOL. Mind double chekin

[jira] [Resolved] (SPARK-36461) Enable ObjectHashAggregate for more Aggregate functions

2021-09-11 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36461. - Resolution: Won't Fix > Enable ObjectHashAggregate for more Aggregate functions > --