[jira] [Updated] (SPARK-36081) The implementation of cast doesn't comply with its specification

2021-07-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36081: --- Description: sql-migration-guide.md mentions about the behavior of cast like as follows

[jira] [Updated] (SPARK-36081) The implementation of cast doesn't comply with its specification

2021-07-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36081: --- Component/s: (was: Spark Core) > The implementation of cast doesn't comply with

[jira] [Created] (SPARK-36081) The implementation of cast doesn't comply with its specification

2021-07-10 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36081: -- Summary: The implementation of cast doesn't comply with its specification Key: SPARK-36081 URL: https://issues.apache.org/jira/browse/SPARK-36081 Project: Spark

[jira] [Updated] (SPARK-36068) No tests in hadoop-cloud run unless hadoop-3.2 profile is activated explicitly

2021-07-09 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36068: --- Summary: No tests in hadoop-cloud run unless hadoop-3.2 profile is activated explicitly

[jira] [Updated] (SPARK-36068) No tests in hadoop-cloud run unless hadoop-3.2 profile is not activated explicitly

2021-07-09 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36068: --- Description: No tests in hadoop-cloud are compiled and run unless hadoop-3.2 profile

[jira] [Created] (SPARK-36068) No tests in hadoop-cloud run unless hadoop-3.2 profile is not activated explicitly

2021-07-09 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36068: -- Summary: No tests in hadoop-cloud run unless hadoop-3.2 profile is not activated explicitly Key: SPARK-36068 URL: https://issues.apache.org/jira/browse/SPARK-36068

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Description: YarnClusterSuite will fails due to NoClassDefFoundError unless hadoop-3.2

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Summary: YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Summary: YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Description: YarnClusterSuite will fails due to ClassNotFoundException unless hadoop-3.2

[jira] [Created] (SPARK-36067) YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is enabled explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36067: -- Summary: YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is enabled explicitly Key: SPARK-36067 URL: https://issues.apache.org/jira/browse

[jira] [Resolved] (SPARK-36019) Cannot run leveldb related UTs on Mac OS of M1 architecture

2021-07-06 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36019. Resolution: Duplicate > Cannot run leveldb related UTs on Mac OS of M1 architect

[jira] [Commented] (SPARK-36022) Respect interval fields in extract

2021-07-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375219#comment-17375219 ] Kousuke Saruta commented on SPARK-36022: I'll check this. > Respect interval fields in extr

[jira] [Commented] (SPARK-36019) Cannot run leveldb related UTs on Mac OS of M1 architecture

2021-07-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375212#comment-17375212 ] Kousuke Saruta commented on SPARK-36019: Seems a duplicate of SPARK-35782 ? > Cannot

[jira] [Resolved] (SPARK-36010) Upgrade sbt-antlr4 from 0.8.2 to 0.8.3

2021-07-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36010. Fix Version/s: 3.3.0 Assignee: Hyukjin Kwon Resolution: Fixed Issue

[jira] [Updated] (SPARK-36013) Upgrade Dropwizard Metrics to 4.2.2

2021-07-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36013: --- Description: Dropwizard 4.2.1 fixes a bug related to JMXReporter but 4.2.1 also contains

[jira] [Updated] (SPARK-36013) Upgrade Dropwizard Metrics to 4.2.2

2021-07-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36013: --- Description: Dropwizard 4.2.1 fixes a bug related to JMXReporter but 4.2.1 also contains

[jira] [Updated] (SPARK-36013) Upgrade Dropwizard Metrics to 4.2.2

2021-07-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36013: --- Description: Dropwizard 4.2.1 fixes a bug related to JMXReporter but 4.2.1 also contains

[jira] [Updated] (SPARK-36013) Upgrade Dropwizard Metrics to 4.2.2

2021-07-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36013: --- Description: Dropwizard 4.2.1 fixes a bug related to JMXReporter but 4.2.1 also contains

[jira] [Created] (SPARK-36013) Upgrade Dropwizard Metrics to 4.2.2

2021-07-04 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36013: -- Summary: Upgrade Dropwizard Metrics to 4.2.2 Key: SPARK-36013 URL: https://issues.apache.org/jira/browse/SPARK-36013 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-35999) Make from_csv/to_csv to handle day-time intervals properly

2021-07-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35999: -- Summary: Make from_csv/to_csv to handle day-time intervals properly Key: SPARK-35999 URL: https://issues.apache.org/jira/browse/SPARK-35999 Project: Spark

[jira] [Created] (SPARK-35998) Make from_csv/to_csv to handle year-month intervals properly

2021-07-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35998: -- Summary: Make from_csv/to_csv to handle year-month intervals properly Key: SPARK-35998 URL: https://issues.apache.org/jira/browse/SPARK-35998 Project: Spark

[jira] [Created] (SPARK-35990) Remove avro-sbt plugin dependency

2021-07-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35990: -- Summary: Remove avro-sbt plugin dependency Key: SPARK-35990 URL: https://issues.apache.org/jira/browse/SPARK-35990 Project: Spark Issue Type

[jira] [Updated] (SPARK-35983) Allow from_json/to_json for map types where value types are day-time intervals

2021-07-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35983: --- Description: In the current master, from_json and to_json are doesn't support map types

[jira] [Updated] (SPARK-35982) Allow from_json/to_json for map types where value types are year-month intervals

2021-07-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35982: --- Description: In the current master, from_json and to_json are doesn't support map types

[jira] [Updated] (SPARK-35982) Allow from_json/to_json for map types where value types are year-month intervals

2021-07-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35982: --- Summary: Allow from_json/to_json for map types where value types are year-month intervals

[jira] [Updated] (SPARK-35983) Allow from_json/to_json for map types where value types are day-time intervals

2021-07-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35983: --- Summary: Allow from_json/to_json for map types where value types are day-time intervals

[jira] [Created] (SPARK-35983) Allow day-time intervals as map value types

2021-07-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35983: -- Summary: Allow day-time intervals as map value types Key: SPARK-35983 URL: https://issues.apache.org/jira/browse/SPARK-35983 Project: Spark Issue Type

[jira] [Updated] (SPARK-35982) Allow year-month intervals as map value types

2021-07-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35982: --- Summary: Allow year-month intervals as map value types (was: Allow year-month intervals

[jira] [Updated] (SPARK-35982) Allow year-month intervals as map value types

2021-07-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35982: --- Description: In the current master, an exception is thrown if we specify year-month

[jira] [Created] (SPARK-35982) Allow year-month intervals as map key types

2021-07-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35982: -- Summary: Allow year-month intervals as map key types Key: SPARK-35982 URL: https://issues.apache.org/jira/browse/SPARK-35982 Project: Spark Issue Type

[jira] [Created] (SPARK-35930) Upgrade kinesis-client to 1.14.4

2021-06-29 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35930: -- Summary: Upgrade kinesis-client to 1.14.4 Key: SPARK-35930 URL: https://issues.apache.org/jira/browse/SPARK-35930 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-35921) ${spark.yarn.isHadoopProvided} in config.properties is not edited if build with SBT

2021-06-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35921: --- Summary: ${spark.yarn.isHadoopProvided} in config.properties is not edited if build

[jira] [Created] (SPARK-35921) The value of spark.yarn.isHadoopProvided property in config.properties is not edited if build with SBT

2021-06-28 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35921: -- Summary: The value of spark.yarn.isHadoopProvided property in config.properties is not edited if build with SBT Key: SPARK-35921 URL: https://issues.apache.org/jira/browse

[jira] [Commented] (SPARK-35802) Error loading the stages/stage/ page in spark UI

2021-06-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370590#comment-17370590 ] Kousuke Saruta commented on SPARK-35802: Hadoop version is 2.9.0 on my environment. I ran

[jira] [Commented] (SPARK-35802) Error loading the stages/stage/ page in spark UI

2021-06-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370448#comment-17370448 ] Kousuke Saruta commented on SPARK-35802: [~Heltman]According to the URL, I guess you run your

[jira] [Reopened] (SPARK-35802) Error loading the stages/stage/ page in spark UI

2021-06-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reopened SPARK-35802: > Error loading the stages/stage/ page in spark

[jira] [Resolved] (SPARK-35870) Upgrade Jetty to 9.4.42

2021-06-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35870. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved inhttps://github.com/apache

[jira] [Resolved] (SPARK-35802) Error loading the stages/stage/ page in spark UI

2021-06-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35802. Resolution: Not A Problem > Error loading the stages/stage/ page in spark

[jira] [Created] (SPARK-35870) Upgrade Jetty to 9.4.42

2021-06-24 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35870: -- Summary: Upgrade Jetty to 9.4.42 Key: SPARK-35870 URL: https://issues.apache.org/jira/browse/SPARK-35870 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-35870) Upgrade Jetty to 9.4.42

2021-06-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35870: --- Component/s: (was: Spark Core) Build > Upgrade Jetty to 9.4

[jira] [Commented] (SPARK-35821) Spark 3.1.1 Internet Explorer 11 compatibility issues

2021-06-19 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366101#comment-17366101 ] Kousuke Saruta commented on SPARK-35821: [~tsudukim] I remember you have hit this issue a few

[jira] [Commented] (SPARK-35802) Error loading the stages/stage/ page in spark UI

2021-06-19 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366098#comment-17366098 ] Kousuke Saruta commented on SPARK-35802: [~Heltman] /taskTable should take query strings. Also

[jira] [Updated] (SPARK-35827) Show proper error message when update column types to year-month/day-time interval

2021-06-19 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35827: --- Summary: Show proper error message when update column types to year-month/day-time interval

[jira] [Created] (SPARK-35827) Show proper erro message when update column types to year-month/day-time interval

2021-06-19 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35827: -- Summary: Show proper erro message when update column types to year-month/day-time interval Key: SPARK-35827 URL: https://issues.apache.org/jira/browse/SPARK-35827

[jira] [Commented] (SPARK-35815) Allow delayThreshold for watermark to be represented as ANSI day-time/year-month interval literals

2021-06-18 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365547#comment-17365547 ] Kousuke Saruta commented on SPARK-35815: Waiting for SPARK-35749 and SPARK-35773 are merged

[jira] [Created] (SPARK-35815) Allow delayThreshold for watermark to be represented as ANSI day-time/year-month interval literals

2021-06-18 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35815: -- Summary: Allow delayThreshold for watermark to be represented as ANSI day-time/year-month interval literals Key: SPARK-35815 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Updated] (SPARK-35749) Parse unit list interval literals as year-month/day-time interval types

2021-06-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35749: --- Description: Currently, unit list interval literals like `interval '1' year '2' months

[jira] [Updated] (SPARK-35749) Parse unit list interval literals as year-month/day-time interval types

2021-06-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35749: --- Summary: Parse unit list interval literals as year-month/day-time interval types

[jira] [Updated] (SPARK-35749) Parse multiple unit fields interval literals as year-month/day-time interval types

2021-06-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35749: --- Description: Currently, single unit field interval literals like `interval '1' year '2

[jira] [Updated] (SPARK-35749) Parse multiple unit fields interval literals as year-month/day-time interval types

2021-06-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35749: --- Summary: Parse multiple unit fields interval literals as year-month/day-time interval types

[jira] [Commented] (SPARK-35774) Parse any year-month interval types in SQL

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364063#comment-17364063 ] Kousuke Saruta commented on SPARK-35774: [~maxgekk]Thank you for letting me know. Actually, I'm

[jira] [Comment Edited] (SPARK-35774) Parse any year-month interval types in SQL

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364063#comment-17364063 ] Kousuke Saruta edited comment on SPARK-35774 at 6/16/21, 5:13 AM

[jira] [Resolved] (SPARK-35691) addFile/addJar/addDirectory should put CanonicalFile

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35691. Fix Version/s: 3.2.0 Assignee: Kevin Su Resolution: Fixed Issue resolved

[jira] [Updated] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35758: --- Component/s: (was: Spark Core) docs > Update the document ab

[jira] [Updated] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35758: --- Affects Version/s: 3.2.0 > Update the document about building Spark with Hadoop for Had

[jira] [Updated] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35758: --- Summary: Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

[jira] [Updated] (SPARK-35749) Parse multiple unit fields interval literals as day-time interval types

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35749: --- Summary: Parse multiple unit fields interval literals as day-time interval types

[jira] [Commented] (SPARK-35758) Spark Core doesn't build when selecting -Dhadoop.version=2.x from Spark 3.1.1

2021-06-14 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363307#comment-17363307 ] Kousuke Saruta commented on SPARK-35758: [~ferranjr] Could you build with -Phadoop-2.7 ? I can

[jira] [Created] (SPARK-35749) Parse single unit field interval literals as day-time interval types

2021-06-13 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35749: -- Summary: Parse single unit field interval literals as day-time interval types Key: SPARK-35749 URL: https://issues.apache.org/jira/browse/SPARK-35749 Project

[jira] [Created] (SPARK-35748) Fix StreamingJoinHelper to be able to handle day-time interval

2021-06-13 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35748: -- Summary: Fix StreamingJoinHelper to be able to handle day-time interval Key: SPARK-35748 URL: https://issues.apache.org/jira/browse/SPARK-35748 Project: Spark

[jira] [Resolved] (SPARK-35746) Task id in the Stage page timeline is incorrect

2021-06-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35746. Target Version/s: 3.0.3, 3.2.0, 3.1.3 Assignee: shahid Resolution

[jira] [Commented] (SPARK-35740) ChromeUIHistoryServerSuite and ChromeUISeleniumSuite failed on Mac 10.15

2021-06-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362243#comment-17362243 ] Kousuke Saruta commented on SPARK-35740: [~abhinavofficial] Could you try with the following

[jira] [Resolved] (SPARK-35741) Variance of 1 record gives NULL in Spark 3.x and NaN in Spark 2.x

2021-06-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35741. Resolution: Not A Problem > Variance of 1 record gives NULL in Spark 3.x and NaN in Sp

[jira] [Commented] (SPARK-35741) Variance of 1 record gives NULL in Spark 3.x and NaN in Spark 2.x

2021-06-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362236#comment-17362236 ] Kousuke Saruta commented on SPARK-35741: [~AbdealiJK] The behavior was changed in Spark 3.1. You

[jira] [Commented] (SPARK-35637) 2 active tasks shown in Spark UI but executor core is 1 and task cpu is 1

2021-06-07 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359041#comment-17359041 ] Kousuke Saruta commented on SPARK-35637: Hmm, the cause seems task-result-getter thread runs

[jira] [Commented] (SPARK-35632) SELECT rand(cast(3 / 7 AS int)) value gives different resultset in Spark 3.1 as compared to Spark 2.4.5

2021-06-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17358020#comment-17358020 ] Kousuke Saruta commented on SPARK-35632: Hi [~chetdb], this is caused by the change of SPARK

[jira] [Updated] (SPARK-35656) Upgrade SBT to 1.5.3

2021-06-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35656: --- Description: Recently, SBT 1.5.3 was released and includes a bug fix for Scala 2.13.16

[jira] [Created] (SPARK-35656) Upgrade SBT to 1.5.3

2021-06-05 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35656: -- Summary: Upgrade SBT to 1.5.3 Key: SPARK-35656 URL: https://issues.apache.org/jira/browse/SPARK-35656 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-35655) Upgrade HtmlUnit and its related artifacts to 2.50.

2021-06-05 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35655: -- Summary: Upgrade HtmlUnit and its related artifacts to 2.50. Key: SPARK-35655 URL: https://issues.apache.org/jira/browse/SPARK-35655 Project: Spark

[jira] [Commented] (SPARK-35649) Failed to read data from Db2 on the column of DECFLOAT data type

2021-06-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357124#comment-17357124 ] Kousuke Saruta commented on SPARK-35649: Hi [~sunguor], Spark enforces the maximum precision

[jira] [Commented] (SPARK-35602) Job crashes with java.io.UTFDataFormatException: encoded string too long

2021-06-03 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17356614#comment-17356614 ] Kousuke Saruta commented on SPARK-35602: [~dej...@gmail.com] Thank you for reporting. I

[jira] [Resolved] (SPARK-35609) Add style rules to prohibit to use a Guava's API which is incompatible with newer versions

2021-06-03 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35609. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved in https://github.com/apache

[jira] [Commented] (SPARK-35602) Job crashes with java.io.UTFDataFormatException: encoded string too long

2021-06-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17356088#comment-17356088 ] Kousuke Saruta commented on SPARK-35602: Hi [~dej...@gmail.com] , could you provide reproducible

[jira] [Updated] (SPARK-35609) Add style rules to prohibit to use a Guava's API which is incompatible with newer versions

2021-06-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35609: --- Description: SPARK-30272 replaced Objects.toStringHelper which is an APIs Guava 14 provides

[jira] [Created] (SPARK-35609) Add style rules to prohibit to use a Guava's API which is incompatible with newer versions

2021-06-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35609: -- Summary: Add style rules to prohibit to use a Guava's API which is incompatible with newer versions Key: SPARK-35609 URL: https://issues.apache.org/jira/browse/SPARK-35609

[jira] [Assigned] (SPARK-35516) Storage UI tab Storage Level tool tip correction

2021-06-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned SPARK-35516: -- Assignee: Lidiya Nixon > Storage UI tab Storage Level tool tip correct

[jira] [Resolved] (SPARK-35516) Storage UI tab Storage Level tool tip correction

2021-06-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35516. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved in https://github.com/apache

[jira] [Updated] (SPARK-35586) Set a default value for spark.kubernetes.test.sparkTgz in pom.xml for Kubernetes integration tests

2021-05-31 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35586: --- Description: In kubernetes/integration-tests/pom.xml, there is no default value

[jira] [Created] (SPARK-35586) Set a default value for spark.kubernetes.test.sparkTgz in pom.xml for Kubernetes integration tests

2021-05-31 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35586: -- Summary: Set a default value for spark.kubernetes.test.sparkTgz in pom.xml for Kubernetes integration tests Key: SPARK-35586 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Created] (SPARK-35577) Allow to log container output for docker integration tests

2021-05-31 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35577: -- Summary: Allow to log container output for docker integration tests Key: SPARK-35577 URL: https://issues.apache.org/jira/browse/SPARK-35577 Project: Spark

[jira] [Created] (SPARK-35530) Fix rounding error in DifferentiableLossAggregatorSuite with Java 11

2021-05-26 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35530: -- Summary: Fix rounding error in DifferentiableLossAggregatorSuite with Java 11 Key: SPARK-35530 URL: https://issues.apache.org/jira/browse/SPARK-35530 Project

[jira] [Created] (SPARK-35527) Fix HiveExternalCatalogVersionsSuite to pass with Java 11

2021-05-25 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35527: -- Summary: Fix HiveExternalCatalogVersionsSuite to pass with Java 11 Key: SPARK-35527 URL: https://issues.apache.org/jira/browse/SPARK-35527 Project: Spark

[jira] [Created] (SPARK-35501) Add a feature for removing pulled container image for docker integration tests

2021-05-24 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35501: -- Summary: Add a feature for removing pulled container image for docker integration tests Key: SPARK-35501 URL: https://issues.apache.org/jira/browse/SPARK-35501

[jira] [Resolved] (SPARK-35488) Upgrade ASM to 7.3.1

2021-05-22 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35488. Fix Version/s: 3.20 Assignee: Vinod KC Resolution: Fixed Resolved

[jira] [Commented] (SPARK-35483) Add a new GA test job for the docker integration tests

2021-05-22 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349614#comment-17349614 ] Kousuke Saruta commented on SPARK-35483: I'll open a PR now if you don't mind. > Add a

[jira] [Commented] (SPARK-35483) Add a new GA test job for the integration tests

2021-05-21 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349592#comment-17349592 ] Kousuke Saruta commented on SPARK-35483: Actually, I've been working on this issue for docker

[jira] [Created] (SPARK-35487) Upgrade dropwizard metrics to 4.2.0

2021-05-21 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35487: -- Summary: Upgrade dropwizard metrics to 4.2.0 Key: SPARK-35487 URL: https://issues.apache.org/jira/browse/SPARK-35487 Project: Spark Issue Type

[jira] [Resolved] (SPARK-35418) Add sentences function to functions.{scala,py}

2021-05-19 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35418. Fix Version/s: 3.2.0 Resolution: Fixed Resolved in https://github.com/apache/spark

[jira] [Updated] (SPARK-35434) Upgrade scalatestplus artifacts to 3.2.9.0

2021-05-18 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35434: --- Summary: Upgrade scalatestplus artifacts to 3.2.9.0 (was: Upgrade scalatestplus artifacts

[jira] [Created] (SPARK-35434) Upgrade scalatestplus artifacts 3.2.9.0

2021-05-18 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35434: -- Summary: Upgrade scalatestplus artifacts 3.2.9.0 Key: SPARK-35434 URL: https://issues.apache.org/jira/browse/SPARK-35434 Project: Spark Issue Type

[jira] [Updated] (SPARK-35420) Replace the usage of toStringHelper with ToStringBuilder

2021-05-18 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35420: --- Fix Version/s: 3.2.0 > Replace the usage of toStringHelper with ToStringBuil

[jira] [Resolved] (SPARK-35425) Add note about Jinja2 as a required dependency for document build.

2021-05-18 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35425. Target Version/s: 3.20 Resolution: Fixed This issue was resolved in https

[jira] [Resolved] (SPARK-35420) Replace the usage of toStringHelper with ToStringBuilder

2021-05-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35420. Resolution: Fixed This issue was resolved in https://github.com/apache/spark/pull/32567

[jira] [Created] (SPARK-35425) Add note about Jinja2 as a required dependency for document build.

2021-05-17 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35425: -- Summary: Add note about Jinja2 as a required dependency for document build. Key: SPARK-35425 URL: https://issues.apache.org/jira/browse/SPARK-35425 Project

[jira] [Created] (SPARK-35421) Remove redundant ProjectExec from streaming queries with V2Relation

2021-05-17 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35421: -- Summary: Remove redundant ProjectExec from streaming queries with V2Relation Key: SPARK-35421 URL: https://issues.apache.org/jira/browse/SPARK-35421 Project

[jira] [Created] (SPARK-35420) Replace the usage of toStringHelper with ToStringBuilder

2021-05-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35420: -- Summary: Replace the usage of toStringHelper with ToStringBuilder Key: SPARK-35420 URL: https://issues.apache.org/jira/browse/SPARK-35420 Project: Spark

[jira] [Created] (SPARK-35418) Add sentences function to functions.scala

2021-05-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35418: -- Summary: Add sentences function to functions.scala Key: SPARK-35418 URL: https://issues.apache.org/jira/browse/SPARK-35418 Project: Spark Issue Type

[jira] [Updated] (SPARK-35418) Add sentences function to functions.{scala,py}

2021-05-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35418: --- Summary: Add sentences function to functions.{scala,py} (was: Add sentences function

[jira] [Updated] (SPARK-35377) Add JS linter to GA

2021-05-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35377: --- Issue Type: Improvement (was: Bug) > Add JS linter to

<    1   2   3   4   5   6   7   8   9   10   >