[jira] [Created] (SPARK-34763) col(), $"" and df("name") should handle quoted column name properly.

2021-03-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34763: -- Summary: col(), $"" and df("name") should handle quoted column name properly. Key: SPARK-34763 URL: https://issues.apache.org/jira/browse/SPARK-34763 Project:

[jira] [Created] (SPARK-34747) Add virtual operators to the built-in function document.

2021-03-15 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34747: -- Summary: Add virtual operators to the built-in function document. Key: SPARK-34747 URL: https://issues.apache.org/jira/browse/SPARK-34747 Project: Spark

[jira] [Updated] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string concatenation operator).

2021-03-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34697: --- Summary: Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string concatenation

[jira] [Updated] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string cocatenation operator).

2021-03-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34697: --- Description: SHOW FUNCTIONS command doesn't show the || operator and DESCRIBE FUNCTION ||

[jira] [Updated] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string cocatenation operator).

2021-03-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34697: --- Summary: Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string cocatenation

[jira] [Created] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTION explain about || (string cocatenation operator).

2021-03-10 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34697: -- Summary: Allow DESCRIBE FUNCTION and SHOW FUNCTION explain about || (string cocatenation operator). Key: SPARK-34697 URL: https://issues.apache.org/jira/browse/SPARK-34697

[jira] [Created] (SPARK-34683) Update the documents to explain the usage of LIST FILE and LIST JAR in case they take multiple file names

2021-03-09 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34683: -- Summary: Update the documents to explain the usage of LIST FILE and LIST JAR in case they take multiple file names Key: SPARK-34683 URL:

[jira] [Updated] (SPARK-34636) sql method in UnresolvedAttribute, AttributeReference and Alias don't quote qualified names properly.

2021-03-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34636: --- Description: UnresolvedReference, AttributeReference and Alias which take qualifier don't

[jira] [Updated] (SPARK-34636) sql method in UnresolvedAttribute, AttributeReference and Alias don't quote qualified names properly.

2021-03-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34636: --- Description: UnresolvedReference, AttributeReference and Alias which take qualifier don't

[jira] [Updated] (SPARK-34636) sql method in UnresolvedAttribute, AttributeReference and Alias don't quote qualified names properly.

2021-03-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34636: --- Description: UnresolvedReference, AttributeReference and Alias which take qualifier don't

[jira] [Created] (SPARK-34636) sql method in UnresolvedAttribute, AttributeReference and Alias don't quote qualified names properly.

2021-03-04 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34636: -- Summary: sql method in UnresolvedAttribute, AttributeReference and Alias don't quote qualified names properly. Key: SPARK-34636 URL:

[jira] [Commented] (SPARK-34626) UnresolvedAttribute.sql may return an incorrect sql

2021-03-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295782#comment-17295782 ] Kousuke Saruta commented on SPARK-34626: I've found some similar issues and trying to fix them

[jira] [Updated] (SPARK-34603) Support ADD ARCHIVE and LIST ARCHIVES command

2021-03-03 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34603: --- Summary: Support ADD ARCHIVE and LIST ARCHIVES command (was: Support ADD ARCHIVE and LIST

[jira] [Created] (SPARK-34603) Support ADD ARCHIVE and LIST ARCHIVE command

2021-03-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34603: -- Summary: Support ADD ARCHIVE and LIST ARCHIVE command Key: SPARK-34603 URL: https://issues.apache.org/jira/browse/SPARK-34603 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34603) Support ADD ARCHIVE and LIST ARCHIVE command

2021-03-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34603: --- Description: SPARK-33530 added addArchive and listArchives to SparkContext but it's not

[jira] [Updated] (SPARK-34590) Allow JDWP debug for tests

2021-03-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34590: --- Description: In the current master, if we want to debug using JDWP for tests, we need to

[jira] [Updated] (SPARK-34590) Allow JDWP debug for tests

2021-03-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34590: --- Summary: Allow JDWP debug for tests (was: Allow JDWP debug for tests with sbt) > Allow

[jira] [Created] (SPARK-34590) Allow JDWP debug for tests with sbt

2021-03-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34590: -- Summary: Allow JDWP debug for tests with sbt Key: SPARK-34590 URL: https://issues.apache.org/jira/browse/SPARK-34590 Project: Spark Issue Type:

[jira] [Created] (SPARK-34574) Jekyll fails to generate Scala API docs for Scala 2.13

2021-02-28 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34574: -- Summary: Jekyll fails to generate Scala API docs for Scala 2.13 Key: SPARK-34574 URL: https://issues.apache.org/jira/browse/SPARK-34574 Project: Spark

[jira] [Updated] (SPARK-34484) Introduce a new syntax to represent map types with the Catalyst DSL

2021-02-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34484: --- Summary: Introduce a new syntax to represent map types with the Catalyst DSL (was:

[jira] [Created] (SPARK-34500) Replace symbol literals with $"" in examples and documents

2021-02-22 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34500: -- Summary: Replace symbol literals with $"" in examples and documents Key: SPARK-34500 URL: https://issues.apache.org/jira/browse/SPARK-34500 Project: Spark

[jira] [Updated] (SPARK-34484) Introduce a new syntax to represent attributes with the Catalyst DSL

2021-02-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34484: --- Summary: Introduce a new syntax to represent attributes with the Catalyst DSL (was:

[jira] [Created] (SPARK-34484) Introduce a new syntax attr() to represent attributes with Catalyst DSL

2021-02-20 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34484: -- Summary: Introduce a new syntax attr() to represent attributes with Catalyst DSL Key: SPARK-34484 URL: https://issues.apache.org/jira/browse/SPARK-34484 Project:

[jira] [Updated] (SPARK-34484) Introduce a new syntax to represent attributes with Catalyst DSL

2021-02-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34484: --- Summary: Introduce a new syntax to represent attributes with Catalyst DSL (was: Introduce

[jira] [Resolved] (SPARK-34379) Map JDBC RowID to StringType rather than LongType

2021-02-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-34379. Fix Version/s: 3.2.0 Resolution: Fixed This issue is resolved by

[jira] [Created] (SPARK-34449) Upgrade Jetty to fix CVE-2020-27218

2021-02-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34449: -- Summary: Upgrade Jetty to fix CVE-2020-27218 Key: SPARK-34449 URL: https://issues.apache.org/jira/browse/SPARK-34449 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-34333) Fix PostgresDialect to handle money types properly

2021-02-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-34333. Fix Version/s: 3.2.0 Resolution: Fixed This issue is resolved by

[jira] [Updated] (SPARK-34443) Replace symbol literals with Symbol constructor invocations to comply with Scala 2.13

2021-02-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34443: --- Summary: Replace symbol literals with Symbol constructor invocations to comply with Scala

[jira] [Created] (SPARK-34443) Replace symbol literals with Symbol constructor invocations

2021-02-15 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34443: -- Summary: Replace symbol literals with Symbol constructor invocations Key: SPARK-34443 URL: https://issues.apache.org/jira/browse/SPARK-34443 Project: Spark

[jira] [Updated] (SPARK-34379) Map JDBC RowID to StringType rather than LongType

2021-02-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34379: --- Description: In the current implementation, JDBC RowID type is mapped to LongType except

[jira] [Created] (SPARK-34379) Map JDBC RowID to StringType rather than LongType

2021-02-05 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34379: -- Summary: Map JDBC RowID to StringType rather than LongType Key: SPARK-34379 URL: https://issues.apache.org/jira/browse/SPARK-34379 Project: Spark Issue

[jira] [Updated] (SPARK-34379) Map JDBC RowID to StringType rather than LongType

2021-02-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34379: --- Issue Type: Bug (was: Improvement) > Map JDBC RowID to StringType rather than LongType >

[jira] [Created] (SPARK-34350) replace withTimeZone defined in OracleIntegrationSuite with DateTimeTestUtils.withDefaultTimeZone

2021-02-03 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34350: -- Summary: replace withTimeZone defined in OracleIntegrationSuite with DateTimeTestUtils.withDefaultTimeZone Key: SPARK-34350 URL:

[jira] [Updated] (SPARK-34343) Add missing test for some non-array types in PostgreSQL

2021-02-03 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34343: --- Issue Type: Improvement (was: Bug) > Add missing test for some non-array types in

[jira] [Created] (SPARK-34343) Add missing test for some non-array types in PostgreSQL

2021-02-03 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34343: -- Summary: Add missing test for some non-array types in PostgreSQL Key: SPARK-34343 URL: https://issues.apache.org/jira/browse/SPARK-34343 Project: Spark

[jira] [Created] (SPARK-34333) Fix PostgresDialect to handle money types properly

2021-02-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34333: -- Summary: Fix PostgresDialect to handle money types properly Key: SPARK-34333 URL: https://issues.apache.org/jira/browse/SPARK-34333 Project: Spark Issue

[jira] [Resolved] (SPARK-34263) Simplify the code for treating unicode/octal/escaped characters in string literals

2021-02-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-34263. Resolution: Fixed > Simplify the code for treating unicode/octal/escaped characters in

[jira] [Commented] (SPARK-34263) Simplify the code for treating unicode/octal/escaped characters in string literals

2021-02-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277233#comment-17277233 ] Kousuke Saruta commented on SPARK-34263: This issue is resolved by

[jira] [Updated] (SPARK-34263) Simplify the code for treating unicode/octal/escaped characters in string literals

2021-02-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34263: --- Fix Version/s: 3.2.0 > Simplify the code for treating unicode/octal/escaped characters in

[jira] [Created] (SPARK-34318) Dataset.colRegex should work with column names and qualifiers which contain newlines

2021-02-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34318: -- Summary: Dataset.colRegex should work with column names and qualifiers which contain newlines Key: SPARK-34318 URL: https://issues.apache.org/jira/browse/SPARK-34318

[jira] [Updated] (SPARK-34311) PostgresDialect can't treat arrays of some types

2021-02-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34311: --- Description: PostgresDialect implements the logic to treat array of some types but it's not

[jira] [Updated] (SPARK-34311) PostgresDialect can't treat arrays of some types

2021-02-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34311: --- Summary: PostgresDialect can't treat arrays of some types (was: PostgresDialect can't

[jira] [Created] (SPARK-34311) PostgresDialect can't treat array of some types

2021-02-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34311: -- Summary: PostgresDialect can't treat array of some types Key: SPARK-34311 URL: https://issues.apache.org/jira/browse/SPARK-34311 Project: Spark Issue

[jira] [Updated] (SPARK-34308) Escape meta-characters in printSchema

2021-01-31 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34308: --- Description: Similar to SPARK-33690, the output layout of printSchema can break if column

[jira] [Created] (SPARK-34308) Escape meta-characters in printSchema

2021-01-31 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34308: -- Summary: Escape meta-characters in printSchema Key: SPARK-34308 URL: https://issues.apache.org/jira/browse/SPARK-34308 Project: Spark Issue Type:

[jira] [Created] (SPARK-34263) Simplify the code for treating unicode/octal/escaped characters in string literals

2021-01-27 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34263: -- Summary: Simplify the code for treating unicode/octal/escaped characters in string literals Key: SPARK-34263 URL: https://issues.apache.org/jira/browse/SPARK-34263

[jira] [Updated] (SPARK-34201) Fix the test code build error for docker-integration-tests in branch-3.0

2021-01-23 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34201: --- Component/s: (was: Build) > Fix the test code build error for docker-integration-tests

[jira] [Updated] (SPARK-34201) Fix the test code build error for docker-integration-tests in branch-3.0

2021-01-22 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34201: --- Summary: Fix the test code build error for docker-integration-tests in branch-3.0 (was:

[jira] [Created] (SPARK-34201) Fix the test code build error for docker-integration-tests

2021-01-22 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34201: -- Summary: Fix the test code build error for docker-integration-tests Key: SPARK-34201 URL: https://issues.apache.org/jira/browse/SPARK-34201 Project: Spark

[jira] [Commented] (SPARK-33813) JDBC datasource fails when reading spatial datatypes with the MS SQL driver

2021-01-21 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269271#comment-17269271 ] Kousuke Saruta commented on SPARK-33813: [~cloud_fan] O.K, I'll try it. > JDBC datasource fails

[jira] [Created] (SPARK-34186) Fix DockerJDBCIntegrationSuites to reflect the change of SPARK-33888

2021-01-20 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34186: -- Summary: Fix DockerJDBCIntegrationSuites to reflect the change of SPARK-33888 Key: SPARK-34186 URL: https://issues.apache.org/jira/browse/SPARK-34186 Project:

[jira] [Updated] (SPARK-34180) Fix the regression brought by SPARK-33888 for PostgresDialect

2021-01-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Summary: Fix the regression brought by SPARK-33888 for PostgresDialect (was: Fix the

[jira] [Updated] (SPARK-34180) Fix the regression brought by SPARK-33888

2021-01-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Description: A regression brought by SPARK-33888 affects PostgresDialect causing

[jira] [Updated] (SPARK-34180) Fix the regression brought by SPARK-33888

2021-01-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Description: SPARK-33888 PR has the two serious problems. 1. A regression which affects

[jira] [Updated] (SPARK-34180) Fix the regression brought by SPARK-33888

2021-01-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Summary: Fix the regression brought by SPARK-33888 (was: Fix the regression brought by

[jira] [Updated] (SPARK-34180) Fix the regression brought by SPARK-33888 for PostgresDialect

2021-01-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Summary: Fix the regression brought by SPARK-33888 for PostgresDialect (was: Fix the

[jira] [Updated] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-33888

2021-01-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Description: PostgresDIalect#getCatalystType throws Exception for array types. It's a

[jira] [Updated] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-33888

2021-01-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Description: PostgresDIalect#getCatalystType throws Exception for ArrayTypes. It's a

[jira] [Updated] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-33888

2021-01-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Summary: Fix the regression for PostgresDialect brought by SPARK-33888 (was: Fix the

[jira] [Created] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-

2021-01-20 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34180: -- Summary: Fix the regression for PostgresDialect brought by SPARK- Key: SPARK-34180 URL: https://issues.apache.org/jira/browse/SPARK-34180 Project: Spark

[jira] [Updated] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-

2021-01-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Issue Type: Bug (was: Improvement) > Fix the regression for PostgresDialect brought by

[jira] [Updated] (SPARK-34101) Make spark-sql CLI configurable for the behavior of printing header by SET command

2021-01-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34101: --- Description: Like Hive CLI, spark-sql CLI accepts hive.cli.print.header property and we can

[jira] [Updated] (SPARK-34101) Make spark-sql CLI configurable for the behavior of printing header by SET command

2021-01-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34101: --- Description: Like Hive CLI, spark-sql CLI accept hive.cli.print.header property and we can

[jira] [Created] (SPARK-34101) Make spark-sql CLI configurable for the behavior of printing header by SET command

2021-01-13 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34101: -- Summary: Make spark-sql CLI configurable for the behavior of printing header by SET command Key: SPARK-34101 URL: https://issues.apache.org/jira/browse/SPARK-34101

[jira] [Updated] (SPARK-34094) Extends StringTranslate to support unicode characters whose code point >= U+10000

2021-01-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34094: --- Description: Currently, StringTranslate works with only unicode characters whose code point

[jira] [Updated] (SPARK-34094) Extends StringTranslate to support unicode characters whose code point >= U+10000

2021-01-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34094: --- Summary: Extends StringTranslate to support unicode characters whose code point >= U+1

[jira] [Created] (SPARK-34094) Extends StringTranslate to support unicode characters whose code point >= 0x10000

2021-01-12 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34094: -- Summary: Extends StringTranslate to support unicode characters whose code point >= 0x1 Key: SPARK-34094 URL: https://issues.apache.org/jira/browse/SPARK-34094

[jira] [Updated] (SPARK-34051) Support 32-bit unicode escape in string literals

2021-01-12 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34051: --- Priority: Minor (was: Major) > Support 32-bit unicode escape in string literals >

[jira] [Created] (SPARK-34051) Support 32-bit unicode escape in string literals

2021-01-08 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34051: -- Summary: Support 32-bit unicode escape in string literals Key: SPARK-34051 URL: https://issues.apache.org/jira/browse/SPARK-34051 Project: Spark Issue

[jira] [Created] (SPARK-34008) Upgrade derby to 10.14.2.0

2021-01-05 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34008: -- Summary: Upgrade derby to 10.14.2.0 Key: SPARK-34008 URL: https://issues.apache.org/jira/browse/SPARK-34008 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-34005) Update peak memory metrics for each Executor on task end.

2021-01-04 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34005: -- Summary: Update peak memory metrics for each Executor on task end. Key: SPARK-34005 URL: https://issues.apache.org/jira/browse/SPARK-34005 Project: Spark

[jira] [Updated] (SPARK-34005) Update peak memory metrics for each Executor on task end.

2021-01-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34005: --- Issue Type: Improvement (was: Bug) > Update peak memory metrics for each Executor on task

[jira] [Created] (SPARK-33999) Make sbt unidoc success with JDK11

2021-01-04 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33999: -- Summary: Make sbt unidoc success with JDK11 Key: SPARK-33999 URL: https://issues.apache.org/jira/browse/SPARK-33999 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-33900) Show shuffle read size / records correctly when only remotebytesread is available

2020-12-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33900: --- Fix Version/s: 3.2.0 3.1.0 3.0.2 > Show shuffle read

[jira] [Resolved] (SPARK-33900) Show shuffle read size / records correctly when only remotebytesread is available

2020-12-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-33900. Resolution: Fixed > Show shuffle read size / records correctly when only remotebytesread

[jira] [Assigned] (SPARK-33900) Show shuffle read size / records correctly when only remotebytesread is available

2020-12-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned SPARK-33900: -- Assignee: dzcxzl > Show shuffle read size / records correctly when only

[jira] [Updated] (SPARK-33853) EXPLAIN CODEGEN and BenchmarkQueryTest don't show subquery code

2020-12-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33853: --- Summary: EXPLAIN CODEGEN and BenchmarkQueryTest don't show subquery code (was:

[jira] [Updated] (SPARK-33853) [SPARK-33853][SQL] EXPLAIN CODEGEN doesn't show subquery code

2020-12-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33853: --- Description: {{EXPLAIN CODEGEN}} and {{BenchmarkQueryTest}} don't show the corresponding

[jira] [Updated] (SPARK-33853) [SPARK-33853][SQL] EXPLAIN CODEGEN doesn't show subquery code

2020-12-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33853: --- Summary: [SPARK-33853][SQL] EXPLAIN CODEGEN doesn't show subquery code (was: EXPLAIN

[jira] [Created] (SPARK-33853) EXPLAIN CODEGEN doesn't show subquery code

2020-12-19 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33853: -- Summary: EXPLAIN CODEGEN doesn't show subquery code Key: SPARK-33853 URL: https://issues.apache.org/jira/browse/SPARK-33853 Project: Spark Issue Type:

[jira] [Created] (SPARK-33850) EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled

2020-12-19 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33850: -- Summary: EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled Key: SPARK-33850 URL: https://issues.apache.org/jira/browse/SPARK-33850

[jira] [Resolved] (SPARK-26341) Expose executor memory metrics at the stage level, in the Stages tab

2020-12-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-26341. Fix Version/s: 3.2.0 3.1.0 Assignee: angerszhu

[jira] [Updated] (SPARK-33757) Fix the R dependencies build error on GitHub Actions and AppVeyor

2020-12-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33757: --- Description: R dependencies build error happens now. The reason seems that usethis package

[jira] [Updated] (SPARK-33757) Fix the R dependencies build error on GitHub Actions and AppVeyor

2020-12-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33757: --- Summary: Fix the R dependencies build error on GitHub Actions and AppVeyor (was: Fix the R

[jira] [Created] (SPARK-33757) Fix the R dependencies build error on GitHub Actions

2020-12-11 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33757: -- Summary: Fix the R dependencies build error on GitHub Actions Key: SPARK-33757 URL: https://issues.apache.org/jira/browse/SPARK-33757 Project: Spark

[jira] [Created] (SPARK-33754) Update kubernetes/integration-tests/README.md to follow the default Hadoop profile updated

2020-12-11 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33754: -- Summary: Update kubernetes/integration-tests/README.md to follow the default Hadoop profile updated Key: SPARK-33754 URL: https://issues.apache.org/jira/browse/SPARK-33754

[jira] [Updated] (SPARK-33732) Kubernetes integration tests doesn't work with Minikube 1.9+

2020-12-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33732: --- Fix Version/s: 2.4.8 > Kubernetes integration tests doesn't work with Minikube 1.9+ >

[jira] [Created] (SPARK-33732) Kubernetes integration tests doesn't work with Minikube 1.9+

2020-12-09 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33732: -- Summary: Kubernetes integration tests doesn't work with Minikube 1.9+ Key: SPARK-33732 URL: https://issues.apache.org/jira/browse/SPARK-33732 Project: Spark

[jira] [Created] (SPARK-33698) Fix the compilation error of OracleIntegrationSuite for Scala 2.13

2020-12-07 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33698: -- Summary: Fix the compilation error of OracleIntegrationSuite for Scala 2.13 Key: SPARK-33698 URL: https://issues.apache.org/jira/browse/SPARK-33698 Project:

[jira] [Created] (SPARK-33684) Upgrade httpclient from 4.5.6 to 4.5.13

2020-12-06 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33684: -- Summary: Upgrade httpclient from 4.5.6 to 4.5.13 Key: SPARK-33684 URL: https://issues.apache.org/jira/browse/SPARK-33684 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33683) Remove -Djava.version=11 from Scala 2.13 build in GitHub Actions

2020-12-06 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33683: --- Issue Type: Bug (was: Improvement) > Remove -Djava.version=11 from Scala 2.13 build in

[jira] [Created] (SPARK-33683) Remove -Djava.version=11 from Scala 2.13 build in GitHub Actions

2020-12-06 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33683: -- Summary: Remove -Djava.version=11 from Scala 2.13 build in GitHub Actions Key: SPARK-33683 URL: https://issues.apache.org/jira/browse/SPARK-33683 Project: Spark

[jira] [Created] (SPARK-33656) Add option to keep container after tests finish for DockerJDBCIntegrationSuites for debug

2020-12-03 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33656: -- Summary: Add option to keep container after tests finish for DockerJDBCIntegrationSuites for debug Key: SPARK-33656 URL: https://issues.apache.org/jira/browse/SPARK-33656

[jira] [Created] (SPARK-33640) Extend connection timeout to DB server for DB2IntegrationSuite and its variants

2020-12-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33640: -- Summary: Extend connection timeout to DB server for DB2IntegrationSuite and its variants Key: SPARK-33640 URL: https://issues.apache.org/jira/browse/SPARK-33640

[jira] [Updated] (SPARK-33607) Input Rate timeline/histogram aren't rendered if built with Scala 2.13

2020-11-30 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33607: --- Summary: Input Rate timeline/histogram aren't rendered if built with Scala 2.13 (was:

[jira] [Created] (SPARK-33607) Input Rate isn't rendered if built with Scala 2.13

2020-11-30 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33607: -- Summary: Input Rate isn't rendered if built with Scala 2.13 Key: SPARK-33607 URL: https://issues.apache.org/jira/browse/SPARK-33607 Project: Spark Issue

[jira] [Resolved] (SPARK-33579) Executors blank page behind proxy

2020-11-30 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-33579. Fix Version/s: 3.1.0 3.0.2 Assignee: Pascal GILLET

[jira] [Updated] (SPARK-33579) Executors blank page behind proxy

2020-11-30 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33579: --- Priority: Major (was: Minor) > Executors blank page behind proxy >

[jira] [Commented] (SPARK-33570) Set the proper version of gssapi plugin automatically for MariaDBKrbIntegrationSuite

2020-11-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239994#comment-17239994 ] Kousuke Saruta commented on SPARK-33570: Issue resolved by pull request 30515

[jira] [Resolved] (SPARK-33570) Set the proper version of gssapi plugin automatically for MariaDBKrbIntegrationSuite

2020-11-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-33570. Fix Version/s: 3.1.0 Resolution: Fixed > Set the proper version of gssapi plugin

<    1   2   3   4   5   6   7   8   9   10   >