[jira] [Created] (SPARK-35377) Add JS linter to GA

2021-05-11 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35377: -- Summary: Add JS linter to GA Key: SPARK-35377 URL: https://issues.apache.org/jira/browse/SPARK-35377 Project: Spark Issue Type: Bug Components

[jira] [Updated] (SPARK-35375) Use Jinja2 < 3.0.0 for Python linter dependency in GA

2021-05-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35375: --- Summary: Use Jinja2 < 3.0.0 for Python linter dependency in GA (was: Use Jinja2 <

[jira] [Updated] (SPARK-35375) Use Jinja2 < 3.0.0 for linter dependency in GA

2021-05-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35375: --- Description: >From a few hours ago, Python linter fails in GA. The latest Jinja 3.0.0 se

[jira] [Updated] (SPARK-35375) Use Jinja2 < 3.0.0 for linter dependency in GA

2021-05-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35375: --- Description: >From a few hours ago, Python linter fails in GA. The latest Jinja 3.0.0 se

[jira] [Created] (SPARK-35375) Use Jinja2 < 3.0.0 for linter dependency in GA

2021-05-11 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35375: -- Summary: Use Jinja2 < 3.0.0 for linter dependency in GA Key: SPARK-35375 URL: https://issues.apache.org/jira/browse/SPARK-35375 Project: Spark Is

[jira] [Resolved] (SPARK-35372) JDK 11 compilation failure due to StackOverflowError

2021-05-11 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35372. Fix Version/s: 3.2.0 Assignee: Hyukjin Kwon Resolution: Fixed This issue

[jira] [Created] (SPARK-35374) Add string-to-number conversion support to JacksonParser

2021-05-11 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35374: -- Summary: Add string-to-number conversion support to JacksonParser Key: SPARK-35374 URL: https://issues.apache.org/jira/browse/SPARK-35374 Project: Spark

[jira] [Resolved] (SPARK-35175) Add linter for JavaScript source files

2021-05-07 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35175. Fix Version/s: 3.2.0 Resolution: Fixed This issue was resolved in https

[jira] [Created] (SPARK-35326) Upgrade Jersey to 2.34

2021-05-06 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35326: -- Summary: Upgrade Jersey to 2.34 Key: SPARK-35326 URL: https://issues.apache.org/jira/browse/SPARK-35326 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-35268) Upgrade GenJavadoc to 0.17

2021-04-29 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35268: --- Description: GenJavadoc 0.17 was released and it seems to include a fix for an issue which

[jira] [Created] (SPARK-35268) Upgrade GenJavadoc to 0.17

2021-04-29 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35268: -- Summary: Upgrade GenJavadoc to 0.17 Key: SPARK-35268 URL: https://issues.apache.org/jira/browse/SPARK-35268 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-35105) Support multiple paths for ADD FILE/JAR/ARCHIVE commands

2021-04-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35105. Fix Version/s: 3.2.0 Resolution: Fixed This issue was resolved in https

[jira] [Resolved] (SPARK-35226) JDBC datasources should accept refreshKrb5Config parameter

2021-04-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35226. Fix Version/s: 3.2.0 3.1.2 Resolution: Fixed This issue

[jira] [Commented] (SPARK-35229) Spark Job web page is extremely slow while there are more than 1500 events in timeline

2021-04-28 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334511#comment-17334511 ] Kousuke Saruta commented on SPARK-35229: [~tiehexue]Thanks for the report. I'll try to mitigate

[jira] [Created] (SPARK-35247) Add `mask` built-in function as a data masking function

2021-04-27 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35247: -- Summary: Add `mask` built-in function as a data masking function Key: SPARK-35247 URL: https://issues.apache.org/jira/browse/SPARK-35247 Project: Spark

[jira] [Updated] (SPARK-35247) Add `mask` built-in function as a data masking function

2021-04-27 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35247: --- Issue Type: New Feature (was: Bug) > Add `mask` built-in function as a data mask

[jira] [Updated] (SPARK-35236) Support archive files as resources for CREATE FUNCTION USING syntax

2021-04-26 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35236: --- Description: CREATE FUNCTION USING syntax doesn't support archives as resources. The reason

[jira] [Created] (SPARK-35236) Support archive files as resources for CREATE FUNCTION USING syntax

2021-04-26 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35236: -- Summary: Support archive files as resources for CREATE FUNCTION USING syntax Key: SPARK-35236 URL: https://issues.apache.org/jira/browse/SPARK-35236 Project

[jira] [Updated] (SPARK-35236) Support archive files as resources for CREATE FUNCTION USING syntax

2021-04-26 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35236: --- Issue Type: Improvement (was: Bug) > Support archive files as resources for CRE

[jira] [Updated] (SPARK-35226) JDBC datasources should accept refreshKrb5Config parameter

2021-04-25 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35226: --- Summary: JDBC datasources should accept refreshKrb5Config parameter (was: JDBCOptions

[jira] [Updated] (SPARK-35226) JDBC datasources should accept refreshKrb5Config parameter

2021-04-25 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35226: --- Description: In the current master, JDBC datasources can't accept refreshKrb5Config which

[jira] [Updated] (SPARK-35226) JDBCOption should accept refreshKrb5Config parameter

2021-04-25 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35226: --- Description: In the current master, JDBCOptions can't accept refreshKrb5Config which

[jira] [Updated] (SPARK-35226) JDBCOptions should accept refreshKrb5Config parameter

2021-04-25 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35226: --- Summary: JDBCOptions should accept refreshKrb5Config parameter (was: JDBCOption should

[jira] [Created] (SPARK-35226) JDBCOption should accept refreshKrb5Config parameter

2021-04-25 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35226: -- Summary: JDBCOption should accept refreshKrb5Config parameter Key: SPARK-35226 URL: https://issues.apache.org/jira/browse/SPARK-35226 Project: Spark

[jira] [Resolved] (SPARK-35087) Some columns in table ` Aggregated Metrics by Executor` of stage-detail page shows incorrectly.

2021-04-25 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35087. Resolution: Fixed This issue was resolved in https://github.com/apache/spark/pull/32190

[jira] [Assigned] (SPARK-35087) Some columns in table ` Aggregated Metrics by Executor` of stage-detail page shows incorrectly.

2021-04-25 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned SPARK-35087: -- Assignee: akiyamaneko > Some columns in table ` Aggregated Metrics by Execu

[jira] [Updated] (SPARK-35087) Some columns in table ` Aggregated Metrics by Executor` of stage-detail page shows incorrectly.

2021-04-25 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35087: --- Fix Version/s: 3.2.0 3.1.2 > Some columns in table ` Aggregated Metr

[jira] [Updated] (SPARK-35210) Upgrade Jetty to 9.4.40 to fix ERR_CONNECTION_RESET issue

2021-04-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35210: --- Fix Version/s: 3.1.2 3.0.3 > Upgrade Jetty to 9.4.40 to

[jira] [Resolved] (SPARK-35210) Upgrade Jetty to 9.4.40 to fix ERR_CONNECTION_RESET issue

2021-04-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35210. Fix Version/s: 3.2.0 Resolution: Fixed This issue is resolved in https

[jira] [Updated] (SPARK-35210) Upgrade Jetty to 9.4.40 to fix ERR_CONNECTION_RESET issue

2021-04-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35210: --- Component/s: (was: Spark Core) Build > Upgrade Jetty to 9.4.40 to

[jira] [Created] (SPARK-35210) Upgrade Jetty to 9.4.40 to fix ERR_CONNECTION_RESET issue

2021-04-24 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35210: -- Summary: Upgrade Jetty to 9.4.40 to fix ERR_CONNECTION_RESET issue Key: SPARK-35210 URL: https://issues.apache.org/jira/browse/SPARK-35210 Project: Spark

[jira] [Resolved] (SPARK-35127) When we switch between different stage-detail pages, the entry item in the newly-opened page may be blank.

2021-04-22 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35127. Fix Version/s: 3.2.0 3.1.2 3.0.3 Assignee

[jira] [Created] (SPARK-35180) Allow to build SparkR with SBT

2021-04-21 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35180: -- Summary: Allow to build SparkR with SBT Key: SPARK-35180 URL: https://issues.apache.org/jira/browse/SPARK-35180 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-35175) Add linter for JavaScript source files

2021-04-21 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35175: --- Summary: Add linter for JavaScript source files (was: Add linter for JavaScript sources

[jira] [Created] (SPARK-35175) Add linter for JavaScript sources

2021-04-21 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35175: -- Summary: Add linter for JavaScript sources Key: SPARK-35175 URL: https://issues.apache.org/jira/browse/SPARK-35175 Project: Spark Issue Type

[jira] [Resolved] (SPARK-35117) UI progress bar no longer highlights in progress tasks

2021-04-19 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35117. Fix Version/s: 3.2.0 3.1.2 Assignee: Adam Binford

[jira] [Resolved] (SPARK-35092) the auto-generated rdd's name in the storage tab should be truncated if it is too long.

2021-04-18 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35092. Fix Version/s: 3.2.0 Assignee: akiyamaneko (was: Apache Spark) Resolution

[jira] [Updated] (SPARK-35092) the auto-generated rdd's name in the storage tab should be truncated if it is too long.

2021-04-18 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35092: --- Affects Version/s: 3.1.1 > the auto-generated rdd's name in the storage tab sho

[jira] [Created] (SPARK-35105) Support multiple paths for ADD FILE/JAR/ARCHIVE commands

2021-04-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35105: -- Summary: Support multiple paths for ADD FILE/JAR/ARCHIVE commands Key: SPARK-35105 URL: https://issues.apache.org/jira/browse/SPARK-35105 Project: Spark

[jira] [Updated] (SPARK-35104) Fix ugly indentation of multiple JSON records in a single split file generated by JacksonGenerator when pretty option is true

2021-04-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35104: --- Description: When writing multiple JSON records into a single split file with pretty option

[jira] [Created] (SPARK-35104) Fix ugly indentation of multiple JSON records in a single split file generated by JacksonGenerator when pretty option is true

2021-04-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35104: -- Summary: Fix ugly indentation of multiple JSON records in a single split file generated by JacksonGenerator when pretty option is true Key: SPARK-35104 URL: https

[jira] [Resolved] (SPARK-34977) LIST FILES/JARS/ARCHIVES cannot handle multiple arguments properly when at least one path is quoted.

2021-04-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-34977. Fix Version/s: 3.2.0 Resolution: Fixed This issue is resolved in https

[jira] [Commented] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320196#comment-17320196 ] Kousuke Saruta commented on SPARK-34993: The reason {code:java} "\\asd", "

[jira] [Updated] (SPARK-35047) Allow Json datasources to write non-ascii characters as codepoints

2021-04-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35047: --- Summary: Allow Json datasources to write non-ascii characters as codepoints (was: Allow

[jira] [Created] (SPARK-35047) Allow Json datasources to write non-ascii characters as code points

2021-04-13 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-35047: -- Summary: Allow Json datasources to write non-ascii characters as code points Key: SPARK-35047 URL: https://issues.apache.org/jira/browse/SPARK-35047 Project

[jira] [Comment Edited] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319958#comment-17319958 ] Kousuke Saruta edited comment on SPARK-34993 at 4/13/21, 7:14 AM: -- Hi

[jira] [Comment Edited] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319958#comment-17319958 ] Kousuke Saruta edited comment on SPARK-34993 at 4/13/21, 7:01 AM: -- Hi

[jira] [Commented] (SPARK-34993) from_json() acts differently on created and literal strings with backslashes

2021-04-13 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319958#comment-17319958 ] Kousuke Saruta commented on SPARK-34993: Hi [~laurikoobas]. I think all of the results

[jira] [Updated] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34988: --- Description: CVE-2021-28165 affects the version of Jetty that Spark uses and it seems

[jira] [Created] (SPARK-34988) Upgrade Jetty for CVE-2021-28165

2021-04-08 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34988: -- Summary: Upgrade Jetty for CVE-2021-28165 Key: SPARK-34988 URL: https://issues.apache.org/jira/browse/SPARK-34988 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-34977) LIST FILES/JARS/ARCHIVES cannot handle multiple arguments properly when at least one path is quoted.

2021-04-07 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34977: --- Description: `LIST FILES/JARS/ARCHIVES path1 path2 ...` cannot list all paths if at least

[jira] [Created] (SPARK-34977) LIST FILES/JARS/ARCHIVES cannot handle multiple arguments properly when at least one path is quoted.

2021-04-06 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34977: -- Summary: LIST FILES/JARS/ARCHIVES cannot handle multiple arguments properly when at least one path is quoted. Key: SPARK-34977 URL: https://issues.apache.org/jira/browse

[jira] [Created] (SPARK-34955) ADD JAR command cannot add jar files which contains whitespaces in the path

2021-04-05 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34955: -- Summary: ADD JAR command cannot add jar files which contains whitespaces in the path Key: SPARK-34955 URL: https://issues.apache.org/jira/browse/SPARK-34955

[jira] [Created] (SPARK-34933) Remove the description that || and && can be used as logical operators from the document.

2021-04-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34933: -- Summary: Remove the description that || and && can be used as logical operators from the document. Key: SPARK-34933 URL: https://issues.apache.org/jira/browse/SPA

[jira] [Updated] (SPARK-34872) quoteIfNeeded should quote a name which contains non-word characters

2021-03-25 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34872: --- Description: quoteIfNeeded quotes a name only when it contains . (dots) or ` (backticks

[jira] [Created] (SPARK-34872) quoteIfNeeded should quote a name which contains non-word characters

2021-03-25 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34872: -- Summary: quoteIfNeeded should quote a name which contains non-word characters Key: SPARK-34872 URL: https://issues.apache.org/jira/browse/SPARK-34872 Project

[jira] [Resolved] (SPARK-34225) Jars or file paths which contain spaces are generating FileNotFoundException exception

2021-03-21 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-34225. Fix Version/s: 3.1.2 3.2.0 Assignee: Kousuke Saruta

[jira] [Updated] (SPARK-34773) change-scala-version.sh fails to modify pom.xml if it changes the version from 2.13 to 2.12

2021-03-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34773: --- Summary: change-scala-version.sh fails to modify pom.xml if it changes the version from

[jira] [Created] (SPARK-34773) change-scala-version fails to modify pom.xml if it changes the version from 2.13 to 2.12

2021-03-17 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34773: -- Summary: change-scala-version fails to modify pom.xml if it changes the version from 2.13 to 2.12 Key: SPARK-34773 URL: https://issues.apache.org/jira/browse/SPARK-34773

[jira] [Updated] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly.

2021-03-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34763: --- Summary: col(), $"" and df("name") should handle quoted column names

[jira] [Created] (SPARK-34763) col(), $"" and df("name") should handle quoted column name properly.

2021-03-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34763: -- Summary: col(), $"" and df("name") should handle quoted column name properly. Key: SPARK-34763 URL: https://issues.apache.org/jira/browse/SPARK-34763

[jira] [Created] (SPARK-34747) Add virtual operators to the built-in function document.

2021-03-15 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34747: -- Summary: Add virtual operators to the built-in function document. Key: SPARK-34747 URL: https://issues.apache.org/jira/browse/SPARK-34747 Project: Spark

[jira] [Updated] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string concatenation operator).

2021-03-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34697: --- Summary: Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string concatenation

[jira] [Updated] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string cocatenation operator).

2021-03-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34697: --- Description: SHOW FUNCTIONS command doesn't show the || operator and DESCRIBE FUNCTION

[jira] [Updated] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string cocatenation operator).

2021-03-10 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34697: --- Summary: Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about || (string cocatenation

[jira] [Created] (SPARK-34697) Allow DESCRIBE FUNCTION and SHOW FUNCTION explain about || (string cocatenation operator).

2021-03-10 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34697: -- Summary: Allow DESCRIBE FUNCTION and SHOW FUNCTION explain about || (string cocatenation operator). Key: SPARK-34697 URL: https://issues.apache.org/jira/browse/SPARK-34697

[jira] [Created] (SPARK-34683) Update the documents to explain the usage of LIST FILE and LIST JAR in case they take multiple file names

2021-03-09 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34683: -- Summary: Update the documents to explain the usage of LIST FILE and LIST JAR in case they take multiple file names Key: SPARK-34683 URL: https://issues.apache.org/jira/browse

[jira] [Updated] (SPARK-34636) sql method in UnresolvedAttribute, AttributeReference and Alias don't quote qualified names properly.

2021-03-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34636: --- Description: UnresolvedReference, AttributeReference and Alias which take qualifier don't

[jira] [Updated] (SPARK-34636) sql method in UnresolvedAttribute, AttributeReference and Alias don't quote qualified names properly.

2021-03-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34636: --- Description: UnresolvedReference, AttributeReference and Alias which take qualifier don't

[jira] [Updated] (SPARK-34636) sql method in UnresolvedAttribute, AttributeReference and Alias don't quote qualified names properly.

2021-03-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34636: --- Description: UnresolvedReference, AttributeReference and Alias which take qualifier don't

[jira] [Created] (SPARK-34636) sql method in UnresolvedAttribute, AttributeReference and Alias don't quote qualified names properly.

2021-03-04 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34636: -- Summary: sql method in UnresolvedAttribute, AttributeReference and Alias don't quote qualified names properly. Key: SPARK-34636 URL: https://issues.apache.org/jira/browse

[jira] [Commented] (SPARK-34626) UnresolvedAttribute.sql may return an incorrect sql

2021-03-04 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295782#comment-17295782 ] Kousuke Saruta commented on SPARK-34626: I've found some similar issues and trying to fix them

[jira] [Updated] (SPARK-34603) Support ADD ARCHIVE and LIST ARCHIVES command

2021-03-03 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34603: --- Summary: Support ADD ARCHIVE and LIST ARCHIVES command (was: Support ADD ARCHIVE and LIST

[jira] [Created] (SPARK-34603) Support ADD ARCHIVE and LIST ARCHIVE command

2021-03-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34603: -- Summary: Support ADD ARCHIVE and LIST ARCHIVE command Key: SPARK-34603 URL: https://issues.apache.org/jira/browse/SPARK-34603 Project: Spark Issue Type

[jira] [Updated] (SPARK-34603) Support ADD ARCHIVE and LIST ARCHIVE command

2021-03-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34603: --- Description: SPARK-33530 added addArchive and listArchives to SparkContext but it's

[jira] [Updated] (SPARK-34590) Allow JDWP debug for tests

2021-03-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34590: --- Description: In the current master, if we want to debug using JDWP for tests, we need

[jira] [Updated] (SPARK-34590) Allow JDWP debug for tests

2021-03-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34590: --- Summary: Allow JDWP debug for tests (was: Allow JDWP debug for tests with sbt) > Al

[jira] [Created] (SPARK-34590) Allow JDWP debug for tests with sbt

2021-03-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34590: -- Summary: Allow JDWP debug for tests with sbt Key: SPARK-34590 URL: https://issues.apache.org/jira/browse/SPARK-34590 Project: Spark Issue Type

[jira] [Created] (SPARK-34574) Jekyll fails to generate Scala API docs for Scala 2.13

2021-02-28 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34574: -- Summary: Jekyll fails to generate Scala API docs for Scala 2.13 Key: SPARK-34574 URL: https://issues.apache.org/jira/browse/SPARK-34574 Project: Spark

[jira] [Updated] (SPARK-34484) Introduce a new syntax to represent map types with the Catalyst DSL

2021-02-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34484: --- Summary: Introduce a new syntax to represent map types with the Catalyst DSL

[jira] [Created] (SPARK-34500) Replace symbol literals with $"" in examples and documents

2021-02-22 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34500: -- Summary: Replace symbol literals with $"" in examples and documents Key: SPARK-34500 URL: https://issues.apache.org/jira/browse/SPARK-34500 Proj

[jira] [Updated] (SPARK-34484) Introduce a new syntax to represent attributes with the Catalyst DSL

2021-02-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34484: --- Summary: Introduce a new syntax to represent attributes with the Catalyst DSL

[jira] [Created] (SPARK-34484) Introduce a new syntax attr() to represent attributes with Catalyst DSL

2021-02-20 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34484: -- Summary: Introduce a new syntax attr() to represent attributes with Catalyst DSL Key: SPARK-34484 URL: https://issues.apache.org/jira/browse/SPARK-34484 Project

[jira] [Updated] (SPARK-34484) Introduce a new syntax to represent attributes with Catalyst DSL

2021-02-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34484: --- Summary: Introduce a new syntax to represent attributes with Catalyst DSL (was: Introduce

[jira] [Resolved] (SPARK-34379) Map JDBC RowID to StringType rather than LongType

2021-02-20 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-34379. Fix Version/s: 3.2.0 Resolution: Fixed This issue is resolved by https

[jira] [Created] (SPARK-34449) Upgrade Jetty to fix CVE-2020-27218

2021-02-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34449: -- Summary: Upgrade Jetty to fix CVE-2020-27218 Key: SPARK-34449 URL: https://issues.apache.org/jira/browse/SPARK-34449 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-34333) Fix PostgresDialect to handle money types properly

2021-02-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-34333. Fix Version/s: 3.2.0 Resolution: Fixed This issue is resolved by https

[jira] [Updated] (SPARK-34443) Replace symbol literals with Symbol constructor invocations to comply with Scala 2.13

2021-02-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34443: --- Summary: Replace symbol literals with Symbol constructor invocations to comply with Scala

[jira] [Created] (SPARK-34443) Replace symbol literals with Symbol constructor invocations

2021-02-15 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34443: -- Summary: Replace symbol literals with Symbol constructor invocations Key: SPARK-34443 URL: https://issues.apache.org/jira/browse/SPARK-34443 Project: Spark

[jira] [Updated] (SPARK-34379) Map JDBC RowID to StringType rather than LongType

2021-02-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34379: --- Description: In the current implementation, JDBC RowID type is mapped to LongType except

[jira] [Created] (SPARK-34379) Map JDBC RowID to StringType rather than LongType

2021-02-05 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34379: -- Summary: Map JDBC RowID to StringType rather than LongType Key: SPARK-34379 URL: https://issues.apache.org/jira/browse/SPARK-34379 Project: Spark Issue

[jira] [Updated] (SPARK-34379) Map JDBC RowID to StringType rather than LongType

2021-02-05 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34379: --- Issue Type: Bug (was: Improvement) > Map JDBC RowID to StringType rather than LongT

[jira] [Created] (SPARK-34350) replace withTimeZone defined in OracleIntegrationSuite with DateTimeTestUtils.withDefaultTimeZone

2021-02-03 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34350: -- Summary: replace withTimeZone defined in OracleIntegrationSuite with DateTimeTestUtils.withDefaultTimeZone Key: SPARK-34350 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Updated] (SPARK-34343) Add missing test for some non-array types in PostgreSQL

2021-02-03 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34343: --- Issue Type: Improvement (was: Bug) > Add missing test for some non-array ty

[jira] [Created] (SPARK-34343) Add missing test for some non-array types in PostgreSQL

2021-02-03 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34343: -- Summary: Add missing test for some non-array types in PostgreSQL Key: SPARK-34343 URL: https://issues.apache.org/jira/browse/SPARK-34343 Project: Spark

[jira] [Created] (SPARK-34333) Fix PostgresDialect to handle money types properly

2021-02-02 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34333: -- Summary: Fix PostgresDialect to handle money types properly Key: SPARK-34333 URL: https://issues.apache.org/jira/browse/SPARK-34333 Project: Spark Issue

[jira] [Resolved] (SPARK-34263) Simplify the code for treating unicode/octal/escaped characters in string literals

2021-02-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-34263. Resolution: Fixed > Simplify the code for treating unicode/octal/escaped charact

[jira] [Commented] (SPARK-34263) Simplify the code for treating unicode/octal/escaped characters in string literals

2021-02-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277233#comment-17277233 ] Kousuke Saruta commented on SPARK-34263: This issue is resolved by https://github.com/apache

[jira] [Updated] (SPARK-34263) Simplify the code for treating unicode/octal/escaped characters in string literals

2021-02-02 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34263: --- Fix Version/s: 3.2.0 > Simplify the code for treating unicode/octal/escaped charact

[jira] [Created] (SPARK-34318) Dataset.colRegex should work with column names and qualifiers which contain newlines

2021-02-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34318: -- Summary: Dataset.colRegex should work with column names and qualifiers which contain newlines Key: SPARK-34318 URL: https://issues.apache.org/jira/browse/SPARK-34318

<    1   2   3   4   5   6   7   8   9   10   >