[jira] [Resolved] (SPARK-36400) Redact sensitive information in Spark Thrift Server UI

2021-08-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36400. Fix Version/s: 3.1.3 3.2.0 Assignee: Kousuke Saruta

[jira] [Created] (SPARK-36512) Fix UISeleniumSuite in sql/hive-thriftserver

2021-08-14 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36512: -- Summary: Fix UISeleniumSuite in sql/hive-thriftserver Key: SPARK-36512 URL: https://issues.apache.org/jira/browse/SPARK-36512 Project: Spark Issue Type:

[jira] [Created] (SPARK-36507) Remove/Replace missing links to AMP Camp materials from index.md

2021-08-12 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36507: -- Summary: Remove/Replace missing links to AMP Camp materials from index.md Key: SPARK-36507 URL: https://issues.apache.org/jira/browse/SPARK-36507 Project: Spark

[jira] [Created] (SPARK-36491) Make from_json/to_json to handle timestamp_ntz type properly

2021-08-12 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36491: -- Summary: Make from_json/to_json to handle timestamp_ntz type properly Key: SPARK-36491 URL: https://issues.apache.org/jira/browse/SPARK-36491 Project: Spark

[jira] [Updated] (SPARK-36490) Make from_csv/to_csv to handle timestamp_ntz type properly

2021-08-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36490: --- Summary: Make from_csv/to_csv to handle timestamp_ntz type properly (was: Make

[jira] [Created] (SPARK-36490) Make from_csv/to_csv to handle timestamp w/o timezone properly

2021-08-12 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36490: -- Summary: Make from_csv/to_csv to handle timestamp w/o timezone properly Key: SPARK-36490 URL: https://issues.apache.org/jira/browse/SPARK-36490 Project: Spark

[jira] [Created] (SPARK-36441) Downloading lintr dependencies fail on GA

2021-08-05 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36441: -- Summary: Downloading lintr dependencies fail on GA Key: SPARK-36441 URL: https://issues.apache.org/jira/browse/SPARK-36441 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36426) Pin pyzmq to 2.22.0

2021-08-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36426. Resolution: Invalid I re-triggered the failed GA job and it finally succeeded so I'll

[jira] [Updated] (SPARK-36426) Pin pyzmq to 2.22.0

2021-08-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36426: --- Description: GA is failing and the root cause seems the latest release of pyzmq, which is

[jira] [Updated] (SPARK-36426) Pin pyzmq to 2.22.0

2021-08-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36426: --- Description: GA is failing and the root cause seems the latest release of pyzmq, which is

[jira] [Updated] (SPARK-36426) Pin pyzmq to 2.22.0

2021-08-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36426: --- Description: GA is failing and the root cause seems the latest release of pyzmq.

[jira] [Updated] (SPARK-36426) Pin pyzmq to 2.22.0

2021-08-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36426: --- Affects Version/s: 3.2.0 > Pin pyzmq to 2.22.0 > --- > >

[jira] [Created] (SPARK-36426) Pin pyzmq to 2.22.0

2021-08-05 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36426: -- Summary: Pin pyzmq to 2.22.0 Key: SPARK-36426 URL: https://issues.apache.org/jira/browse/SPARK-36426 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-35870) Upgrade Jetty to 9.4.42

2021-08-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393277#comment-17393277 ] Kousuke Saruta commented on SPARK-35870: Hi [~this]. v2.4.8 is the last release of brnch-2.4

[jira] [Updated] (SPARK-36408) Upgrade json4s to 4.0.3

2021-08-03 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36408: --- Issue Type: Improvement (was: Bug) > Upgrade json4s to 4.0.3 > --- > >

[jira] [Created] (SPARK-36408) Upgrade json4s to 4.0.3

2021-08-03 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36408: -- Summary: Upgrade json4s to 4.0.3 Key: SPARK-36408 URL: https://issues.apache.org/jira/browse/SPARK-36408 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-36382) Remove noisy footer from the summary table for metrics

2021-08-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36382: --- Summary: Remove noisy footer from the summary table for metrics (was: Remove unnecesssary

[jira] [Created] (SPARK-36382) Remove unnecesssary footer from the summary table for metrics

2021-08-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36382: -- Summary: Remove unnecesssary footer from the summary table for metrics Key: SPARK-36382 URL: https://issues.apache.org/jira/browse/SPARK-36382 Project: Spark

[jira] [Created] (SPARK-36371) Support raw string literal

2021-07-31 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36371: -- Summary: Support raw string literal Key: SPARK-36371 URL: https://issues.apache.org/jira/browse/SPARK-36371 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-36318) Update docs about mapping of ANSI interval types to Java/Scala/SQL types

2021-07-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36318. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved in

[jira] [Created] (SPARK-36323) Support ANSI interval literals for TimeWindow

2021-07-27 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36323: -- Summary: Support ANSI interval literals for TimeWindow Key: SPARK-36323 URL: https://issues.apache.org/jira/browse/SPARK-36323 Project: Spark Issue

[jira] [Updated] (SPARK-34619) Update the Spark SQL guide about day-time and year-month interval types

2021-07-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34619: --- Affects Version/s: 3.2.0 > Update the Spark SQL guide about day-time and year-month

[jira] [Updated] (SPARK-34619) Update the Spark SQL guide about day-time and year-month interval types

2021-07-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34619: --- Affects Version/s: (was: 3.3.0) > Update the Spark SQL guide about day-time and

[jira] [Updated] (SPARK-34619) Update the Spark SQL guide about day-time and year-month interval types

2021-07-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34619: --- Affects Version/s: (was: 3.2.0) 3.3.0 > Update the Spark SQL

[jira] [Resolved] (SPARK-34619) Update the Spark SQL guide about day-time and year-month interval types

2021-07-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-34619. Fix Version/s: 3.2.0 Assignee: Max Gekk Resolution: Fixed Issue resolved

[jira] [Created] (SPARK-36256) Upgrade lz4-java to 1.8.0

2021-07-22 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36256: -- Summary: Upgrade lz4-java to 1.8.0 Key: SPARK-36256 URL: https://issues.apache.org/jira/browse/SPARK-36256 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36244) Upgrade zstd-jni to 1.5.0-3 to avoid a bug about buffer size calculation

2021-07-21 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36244: -- Summary: Upgrade zstd-jni to 1.5.0-3 to avoid a bug about buffer size calculation Key: SPARK-36244 URL: https://issues.apache.org/jira/browse/SPARK-36244

[jira] [Commented] (SPARK-35815) Allow delayThreshold for watermark to be represented as ANSI day-time/year-month interval literals

2021-07-19 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383781#comment-17383781 ] Kousuke Saruta commented on SPARK-35815: I don't think so, and I'll work on this soon. > Allow

[jira] [Updated] (SPARK-36208) SparkScriptTransformation should support ANSI interval types

2021-07-19 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36208: --- Summary: SparkScriptTransformation should support ANSI interval types (was:

[jira] [Updated] (SPARK-36208) SparkScriptTransformation

2021-07-19 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36208: --- Parent: SPARK-27790 Issue Type: Sub-task (was: Bug) > SparkScriptTransformation >

[jira] [Created] (SPARK-36208) SparkScriptTransformation

2021-07-19 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36208: -- Summary: SparkScriptTransformation Key: SPARK-36208 URL: https://issues.apache.org/jira/browse/SPARK-36208 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-36171) Upgrade GenJavadoc to 0.18

2021-07-15 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36171: -- Summary: Upgrade GenJavadoc to 0.18 Key: SPARK-36171 URL: https://issues.apache.org/jira/browse/SPARK-36171 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36170) Change quoted interval literal (interval constructor) to be converted to ANSI interval types

2021-07-15 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36170: -- Summary: Change quoted interval literal (interval constructor) to be converted to ANSI interval types Key: SPARK-36170 URL: https://issues.apache.org/jira/browse/SPARK-36170

[jira] [Created] (SPARK-36129) Upgrade commons-compress to 1.21 to deal with CVEs

2021-07-13 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36129: -- Summary: Upgrade commons-compress to 1.21 to deal with CVEs Key: SPARK-36129 URL: https://issues.apache.org/jira/browse/SPARK-36129 Project: Spark Issue

[jira] [Updated] (SPARK-36110) Upgrade SBT to 1.5.5

2021-07-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36110: --- Description: SBT 1.5.5 was released, which includes 16 imrovements/bug fixes.

[jira] [Updated] (SPARK-36110) Upgrade SBT to 1.5.5

2021-07-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36110: --- Issue Type: Improvement (was: Bug) > Upgrade SBT to 1.5.5 > > >

[jira] [Created] (SPARK-36110) Upgrade SBT to 1.5.5

2021-07-12 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36110: -- Summary: Upgrade SBT to 1.5.5 Key: SPARK-36110 URL: https://issues.apache.org/jira/browse/SPARK-36110 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-36081) Update the document about the behavior change of trimming characters for cast

2021-07-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36081: --- Description: sql-migration-guide.md mentions about the behavior of cast like as follows.

[jira] [Updated] (SPARK-36081) Update the document about the behavior change of trimming characters for cast

2021-07-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36081: --- Summary: Update the document about the behavior change of trimming characters for cast

[jira] [Updated] (SPARK-36081) The implementation of cast doesn't comply with its specification

2021-07-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36081: --- Description: sql-migration-guide.md mentions about the behavior of cast like as follows.

[jira] [Updated] (SPARK-36081) The implementation of cast doesn't comply with its specification

2021-07-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36081: --- Description: sql-migration-guide.md mentions about the behavior of cast like as follows.

[jira] [Updated] (SPARK-36081) The implementation of cast doesn't comply with its specification

2021-07-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36081: --- Component/s: (was: Spark Core) > The implementation of cast doesn't comply with its

[jira] [Created] (SPARK-36081) The implementation of cast doesn't comply with its specification

2021-07-10 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36081: -- Summary: The implementation of cast doesn't comply with its specification Key: SPARK-36081 URL: https://issues.apache.org/jira/browse/SPARK-36081 Project: Spark

[jira] [Updated] (SPARK-36068) No tests in hadoop-cloud run unless hadoop-3.2 profile is activated explicitly

2021-07-09 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36068: --- Summary: No tests in hadoop-cloud run unless hadoop-3.2 profile is activated explicitly

[jira] [Updated] (SPARK-36068) No tests in hadoop-cloud run unless hadoop-3.2 profile is not activated explicitly

2021-07-09 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36068: --- Description: No tests in hadoop-cloud are compiled and run unless hadoop-3.2 profile is

[jira] [Created] (SPARK-36068) No tests in hadoop-cloud run unless hadoop-3.2 profile is not activated explicitly

2021-07-09 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36068: -- Summary: No tests in hadoop-cloud run unless hadoop-3.2 profile is not activated explicitly Key: SPARK-36068 URL: https://issues.apache.org/jira/browse/SPARK-36068

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Description: YarnClusterSuite will fails due to NoClassDefFoundError unless hadoop-3.2

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Summary: YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Summary: YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Description: YarnClusterSuite will fails due to ClassNotFoundException unless hadoop-3.2

[jira] [Created] (SPARK-36067) YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is enabled explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36067: -- Summary: YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is enabled explicitly Key: SPARK-36067 URL:

[jira] [Resolved] (SPARK-36019) Cannot run leveldb related UTs on Mac OS of M1 architecture

2021-07-06 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36019. Resolution: Duplicate > Cannot run leveldb related UTs on Mac OS of M1 architecture >

[jira] [Commented] (SPARK-36022) Respect interval fields in extract

2021-07-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375219#comment-17375219 ] Kousuke Saruta commented on SPARK-36022: I'll check this. > Respect interval fields in extract

[jira] [Commented] (SPARK-36019) Cannot run leveldb related UTs on Mac OS of M1 architecture

2021-07-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375212#comment-17375212 ] Kousuke Saruta commented on SPARK-36019: Seems a duplicate of SPARK-35782 ? > Cannot run

[jira] [Resolved] (SPARK-36010) Upgrade sbt-antlr4 from 0.8.2 to 0.8.3

2021-07-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36010. Fix Version/s: 3.3.0 Assignee: Hyukjin Kwon Resolution: Fixed Issue

[jira] [Updated] (SPARK-36013) Upgrade Dropwizard Metrics to 4.2.2

2021-07-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36013: --- Description: Dropwizard 4.2.1 fixes a bug related to JMXReporter but 4.2.1 also contains a

[jira] [Updated] (SPARK-36013) Upgrade Dropwizard Metrics to 4.2.2

2021-07-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36013: --- Description: Dropwizard 4.2.1 fixes a bug related to JMXReporter but 4.2.1 also contains a

[jira] [Updated] (SPARK-36013) Upgrade Dropwizard Metrics to 4.2.2

2021-07-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36013: --- Description: Dropwizard 4.2.1 fixes a bug related to JMXReporter but 4.2.1 also contains a

[jira] [Updated] (SPARK-36013) Upgrade Dropwizard Metrics to 4.2.2

2021-07-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36013: --- Description: Dropwizard 4.2.1 fixes a bug related to JMXReporter but 4.2.1 also contains a

[jira] [Created] (SPARK-36013) Upgrade Dropwizard Metrics to 4.2.2

2021-07-04 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36013: -- Summary: Upgrade Dropwizard Metrics to 4.2.2 Key: SPARK-36013 URL: https://issues.apache.org/jira/browse/SPARK-36013 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-35999) Make from_csv/to_csv to handle day-time intervals properly

2021-07-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35999: -- Summary: Make from_csv/to_csv to handle day-time intervals properly Key: SPARK-35999 URL: https://issues.apache.org/jira/browse/SPARK-35999 Project: Spark

[jira] [Created] (SPARK-35998) Make from_csv/to_csv to handle year-month intervals properly

2021-07-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35998: -- Summary: Make from_csv/to_csv to handle year-month intervals properly Key: SPARK-35998 URL: https://issues.apache.org/jira/browse/SPARK-35998 Project: Spark

[jira] [Created] (SPARK-35990) Remove avro-sbt plugin dependency

2021-07-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35990: -- Summary: Remove avro-sbt plugin dependency Key: SPARK-35990 URL: https://issues.apache.org/jira/browse/SPARK-35990 Project: Spark Issue Type:

[jira] [Updated] (SPARK-35983) Allow from_json/to_json for map types where value types are day-time intervals

2021-07-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35983: --- Description: In the current master, from_json and to_json are doesn't support map types

[jira] [Updated] (SPARK-35982) Allow from_json/to_json for map types where value types are year-month intervals

2021-07-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35982: --- Description: In the current master, from_json and to_json are doesn't support map types

[jira] [Updated] (SPARK-35982) Allow from_json/to_json for map types where value types are year-month intervals

2021-07-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35982: --- Summary: Allow from_json/to_json for map types where value types are year-month intervals

[jira] [Updated] (SPARK-35983) Allow from_json/to_json for map types where value types are day-time intervals

2021-07-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35983: --- Summary: Allow from_json/to_json for map types where value types are day-time intervals

[jira] [Created] (SPARK-35983) Allow day-time intervals as map value types

2021-07-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35983: -- Summary: Allow day-time intervals as map value types Key: SPARK-35983 URL: https://issues.apache.org/jira/browse/SPARK-35983 Project: Spark Issue Type:

[jira] [Updated] (SPARK-35982) Allow year-month intervals as map value types

2021-07-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35982: --- Summary: Allow year-month intervals as map value types (was: Allow year-month intervals as

[jira] [Updated] (SPARK-35982) Allow year-month intervals as map value types

2021-07-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35982: --- Description: In the current master, an exception is thrown if we specify year-month

[jira] [Created] (SPARK-35982) Allow year-month intervals as map key types

2021-07-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35982: -- Summary: Allow year-month intervals as map key types Key: SPARK-35982 URL: https://issues.apache.org/jira/browse/SPARK-35982 Project: Spark Issue Type:

[jira] [Created] (SPARK-35930) Upgrade kinesis-client to 1.14.4

2021-06-29 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35930: -- Summary: Upgrade kinesis-client to 1.14.4 Key: SPARK-35930 URL: https://issues.apache.org/jira/browse/SPARK-35930 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-35921) ${spark.yarn.isHadoopProvided} in config.properties is not edited if build with SBT

2021-06-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35921: --- Summary: ${spark.yarn.isHadoopProvided} in config.properties is not edited if build with

[jira] [Created] (SPARK-35921) The value of spark.yarn.isHadoopProvided property in config.properties is not edited if build with SBT

2021-06-28 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35921: -- Summary: The value of spark.yarn.isHadoopProvided property in config.properties is not edited if build with SBT Key: SPARK-35921 URL:

[jira] [Commented] (SPARK-35802) Error loading the stages/stage/ page in spark UI

2021-06-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370590#comment-17370590 ] Kousuke Saruta commented on SPARK-35802: Hadoop version is 2.9.0 on my environment. I ran an

[jira] [Commented] (SPARK-35802) Error loading the stages/stage/ page in spark UI

2021-06-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370448#comment-17370448 ] Kousuke Saruta commented on SPARK-35802: [~Heltman]According to the URL, I guess you run your

[jira] [Reopened] (SPARK-35802) Error loading the stages/stage/ page in spark UI

2021-06-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reopened SPARK-35802: > Error loading the stages/stage/ page in spark UI >

[jira] [Resolved] (SPARK-35870) Upgrade Jetty to 9.4.42

2021-06-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35870. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved

[jira] [Resolved] (SPARK-35802) Error loading the stages/stage/ page in spark UI

2021-06-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35802. Resolution: Not A Problem > Error loading the stages/stage/ page in spark UI >

[jira] [Created] (SPARK-35870) Upgrade Jetty to 9.4.42

2021-06-24 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35870: -- Summary: Upgrade Jetty to 9.4.42 Key: SPARK-35870 URL: https://issues.apache.org/jira/browse/SPARK-35870 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-35870) Upgrade Jetty to 9.4.42

2021-06-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35870: --- Component/s: (was: Spark Core) Build > Upgrade Jetty to 9.4.42 >

[jira] [Commented] (SPARK-35821) Spark 3.1.1 Internet Explorer 11 compatibility issues

2021-06-19 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366101#comment-17366101 ] Kousuke Saruta commented on SPARK-35821: [~tsudukim] I remember you have hit this issue a few

[jira] [Commented] (SPARK-35802) Error loading the stages/stage/ page in spark UI

2021-06-19 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366098#comment-17366098 ] Kousuke Saruta commented on SPARK-35802: [~Heltman] /taskTable should take query strings. Also,

[jira] [Updated] (SPARK-35827) Show proper error message when update column types to year-month/day-time interval

2021-06-19 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35827: --- Summary: Show proper error message when update column types to year-month/day-time interval

[jira] [Created] (SPARK-35827) Show proper erro message when update column types to year-month/day-time interval

2021-06-19 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35827: -- Summary: Show proper erro message when update column types to year-month/day-time interval Key: SPARK-35827 URL: https://issues.apache.org/jira/browse/SPARK-35827

[jira] [Commented] (SPARK-35815) Allow delayThreshold for watermark to be represented as ANSI day-time/year-month interval literals

2021-06-18 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365547#comment-17365547 ] Kousuke Saruta commented on SPARK-35815: Waiting for SPARK-35749 and SPARK-35773 are merged. >

[jira] [Created] (SPARK-35815) Allow delayThreshold for watermark to be represented as ANSI day-time/year-month interval literals

2021-06-18 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35815: -- Summary: Allow delayThreshold for watermark to be represented as ANSI day-time/year-month interval literals Key: SPARK-35815 URL:

[jira] [Updated] (SPARK-35749) Parse unit list interval literals as year-month/day-time interval types

2021-06-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35749: --- Description: Currently, unit list interval literals like `interval '1' year '2' months` or

[jira] [Updated] (SPARK-35749) Parse unit list interval literals as year-month/day-time interval types

2021-06-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35749: --- Summary: Parse unit list interval literals as year-month/day-time interval types (was:

[jira] [Updated] (SPARK-35749) Parse multiple unit fields interval literals as year-month/day-time interval types

2021-06-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35749: --- Description: Currently, single unit field interval literals like `interval '1' year '2'

[jira] [Updated] (SPARK-35749) Parse multiple unit fields interval literals as year-month/day-time interval types

2021-06-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35749: --- Summary: Parse multiple unit fields interval literals as year-month/day-time interval types

[jira] [Commented] (SPARK-35774) Parse any year-month interval types in SQL

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364063#comment-17364063 ] Kousuke Saruta commented on SPARK-35774: [~maxgekk]Thank you for letting me know. Actually, I'm

[jira] [Comment Edited] (SPARK-35774) Parse any year-month interval types in SQL

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364063#comment-17364063 ] Kousuke Saruta edited comment on SPARK-35774 at 6/16/21, 5:13 AM: --

[jira] [Resolved] (SPARK-35691) addFile/addJar/addDirectory should put CanonicalFile

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35691. Fix Version/s: 3.2.0 Assignee: Kevin Su Resolution: Fixed Issue resolved

[jira] [Updated] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35758: --- Component/s: (was: Spark Core) docs > Update the document about

[jira] [Updated] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35758: --- Affects Version/s: 3.2.0 > Update the document about building Spark with Hadoop for Hadoop

[jira] [Updated] (SPARK-35758) Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35758: --- Summary: Update the document about building Spark with Hadoop for Hadoop 2.x and 3.x (was:

[jira] [Updated] (SPARK-35749) Parse multiple unit fields interval literals as day-time interval types

2021-06-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35749: --- Summary: Parse multiple unit fields interval literals as day-time interval types (was:

[jira] [Commented] (SPARK-35758) Spark Core doesn't build when selecting -Dhadoop.version=2.x from Spark 3.1.1

2021-06-14 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363307#comment-17363307 ] Kousuke Saruta commented on SPARK-35758: [~ferranjr] Could you build with -Phadoop-2.7 ? I can

[jira] [Created] (SPARK-35749) Parse single unit field interval literals as day-time interval types

2021-06-13 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35749: -- Summary: Parse single unit field interval literals as day-time interval types Key: SPARK-35749 URL: https://issues.apache.org/jira/browse/SPARK-35749 Project:

<    1   2   3   4   5   6   7   8   9   10   >