[jira] [Created] (SPARK-37112) Fix MiMa failure with Scala 2.13

Kousuke Saruta created SPARK-37112: -- Summary: Fix MiMa failure with Scala 2.13 Key: SPARK-37112 URL: https://issues.apache.org/jira/browse/SPARK-37112 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-37103) Switch from Maven to SBT to build Spark on AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-37103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37103: --- Description: Recently, building Spark on AppVeyor almost always fails due to

[jira] [Created] (SPARK-37103) Switch from Maven to SBT to build Spark on AppVeyor

Kousuke Saruta created SPARK-37103: -- Summary: Switch from Maven to SBT to build Spark on AppVeyor Key: SPARK-37103 URL: https://issues.apache.org/jira/browse/SPARK-37103 Project: Spark

[jira] [Updated] (SPARK-37086) Fix the R test of FPGrowthModel for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-37086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37086: --- Description: Similar to the issue filed in SPARK-37059, the R test of FPGrowthModel assumes

[jira] [Created] (SPARK-37086) Fix the R test of FPGrowthModel for Scala 2.13

Kousuke Saruta created SPARK-37086: -- Summary: Fix the R test of FPGrowthModel for Scala 2.13 Key: SPARK-37086 URL: https://issues.apache.org/jira/browse/SPARK-37086 Project: Spark Issue

[jira] [Created] (SPARK-37081) Upgrade the version of RDBMS and corresponding JDBC drivers used by docker-integration-tests

Kousuke Saruta created SPARK-37081: -- Summary: Upgrade the version of RDBMS and corresponding JDBC drivers used by docker-integration-tests Key: SPARK-37081 URL: https://issues.apache.org/jira/browse/SPARK-37081

[jira] [Updated] (SPARK-37076) Implement StructType.toString explicitly for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-37076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37076: --- Summary: Implement StructType.toString explicitly for Scala 2.13 (was: Implements

[jira] [Created] (SPARK-37076) Implements StructType.toString explicitly for Scala 2.13

Kousuke Saruta created SPARK-37076: -- Summary: Implements StructType.toString explicitly for Scala 2.13 Key: SPARK-37076 URL: https://issues.apache.org/jira/browse/SPARK-37076 Project: Spark

[jira] [Resolved] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37059. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved in

[jira] [Updated] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37059: --- Description: The collect_set builtin function doesn't ensure the sort order of its result

[jira] [Updated] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37059: --- Description: The collect_set builtin function doesn't ensure the sort order of its result

[jira] [Updated] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37059: --- Description: The collect_set builtin function doesn't ensure the sort order of its result

[jira] [Updated] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37059: --- Description: The collect_set builtin function doesn't ensure the sort order of its result

[jira] [Updated] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37059: --- Component/s: Tests > Ensure the sort order of the output in the PySpark doctests >

[jira] [Updated] (SPARK-37059) Ensure the sort order of the output in the PySpark doctests

[ https://issues.apache.org/jira/browse/SPARK-37059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37059: --- Summary: Ensure the sort order of the output in the PySpark doctests (was: Ensure the sort

[jira] [Created] (SPARK-37059) Ensure the sort order of the output in the PySpark examples

Kousuke Saruta created SPARK-37059: -- Summary: Ensure the sort order of the output in the PySpark examples Key: SPARK-37059 URL: https://issues.apache.org/jira/browse/SPARK-37059 Project: Spark

[jira] [Updated] (SPARK-37026) Ensure the element type of ResolvedRFormula.terms is scala.Seq for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-37026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37026: --- Component/s: Build > Ensure the element type of ResolvedRFormula.terms is scala.Seq for

[jira] [Updated] (SPARK-37026) Ensure the element type of ResolvedRFormula.terms is scala.Seq for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-37026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37026: --- Summary: Ensure the element type of ResolvedRFormula.terms is scala.Seq for Scala 2.13

[jira] [Updated] (SPARK-37026) Ensure the element type of RFormula.terms is scala.Seq for Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-37026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37026: --- Summary: Ensure the element type of RFormula.terms is scala.Seq for Scala 2.13 (was:

[jira] [Updated] (SPARK-37026) ResolvedRFormula.toString throws ClassCastException with Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-37026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37026: --- Description: ResolvedRFormula.toString throws ClassCastException with Scala 2.13 because

[jira] [Created] (SPARK-37026) ResolvedRFormula.toString throws ClassCastException with Scala 2.13

Kousuke Saruta created SPARK-37026: -- Summary: ResolvedRFormula.toString throws ClassCastException with Scala 2.13 Key: SPARK-37026 URL: https://issues.apache.org/jira/browse/SPARK-37026 Project:

[jira] [Updated] (SPARK-37026) ResolvedRFormula.toString throws ClassCastException with Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-37026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-37026: --- Issue Type: Bug (was: Improvement) > ResolvedRFormula.toString throws ClassCastException

[jira] [Resolved] (SPARK-36922) The SIGN/SIGNUM functions should support ANSI intervals

[ https://issues.apache.org/jira/browse/SPARK-36922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36922. Fix Version/s: 3.3.0 Assignee: PengLei Resolution: Fixed Issue resolved

[jira] [Updated] (SPARK-36993) Fix json_tuple throw NPE if fields exist no foldable null value

[ https://issues.apache.org/jira/browse/SPARK-36993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36993: --- Summary: Fix json_tuple throw NPE if fields exist no foldable null value (was: Fix

[jira] [Resolved] (SPARK-36981) Upgrade joda-time to 2.10.12

[ https://issues.apache.org/jira/browse/SPARK-36981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36981. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved in

[jira] [Resolved] (SPARK-36972) Add max_by/min_by API to PySpark

[ https://issues.apache.org/jira/browse/SPARK-36972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36972. Fix Version/s: 3.3.0 Assignee: Leona Yoda Resolution: Fixed Issue

[jira] [Updated] (SPARK-36981) Upgrade joda-time to 2.10.12

[ https://issues.apache.org/jira/browse/SPARK-36981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36981: --- Description: joda-time 2.10.12 seems to support an updated TZDB.

[jira] [Created] (SPARK-36981) Upgrade joda-time to 2.10.12

Kousuke Saruta created SPARK-36981: -- Summary: Upgrade joda-time to 2.10.12 Key: SPARK-36981 URL: https://issues.apache.org/jira/browse/SPARK-36981 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-36960) Pushdown filters with ANSI interval values to ORC

Kousuke Saruta created SPARK-36960: -- Summary: Pushdown filters with ANSI interval values to ORC Key: SPARK-36960 URL: https://issues.apache.org/jira/browse/SPARK-36960 Project: Spark Issue

[jira] [Updated] (SPARK-36937) Change OrcSourceSuite to test both V1 and V2 sources.

[ https://issues.apache.org/jira/browse/SPARK-36937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36937: --- Summary: Change OrcSourceSuite to test both V1 and V2 sources. (was: Re-structure

[jira] [Created] (SPARK-36937) Re-structure OrcSourceSuite to test both V1 and V2 sources.

Kousuke Saruta created SPARK-36937: -- Summary: Re-structure OrcSourceSuite to test both V1 and V2 sources. Key: SPARK-36937 URL: https://issues.apache.org/jira/browse/SPARK-36937 Project: Spark

[jira] [Updated] (SPARK-36937) Re-structure OrcSourceSuite to test both V1 and V2 sources.

[ https://issues.apache.org/jira/browse/SPARK-36937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36937: --- Issue Type: Improvement (was: Bug) > Re-structure OrcSourceSuite to test both V1 and V2

[jira] [Updated] (SPARK-36931) Read/write dataframes with ANSI intervals from/to ORC files

[ https://issues.apache.org/jira/browse/SPARK-36931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36931: --- Summary: Read/write dataframes with ANSI intervals from/to ORC files (was: Read/write

[jira] [Created] (SPARK-36931) Read/write dataframes with ANSI intervals from/to parquet files

Kousuke Saruta created SPARK-36931: -- Summary: Read/write dataframes with ANSI intervals from/to parquet files Key: SPARK-36931 URL: https://issues.apache.org/jira/browse/SPARK-36931 Project: Spark

[jira] [Resolved] (SPARK-36038) Basic speculation metrics at stage level

[ https://issues.apache.org/jira/browse/SPARK-36038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36038. Fix Version/s: 3.3.0 Assignee: Venkata krishnan Sowrirajan Resolution:

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422557#comment-17422557 ] Kousuke Saruta commented on SPARK-36861: Hmm, if a "T" follows the date part but it's not a

[jira] [Resolved] (SPARK-36899) Support ILIKE API on R

[ https://issues.apache.org/jira/browse/SPARK-36899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36899. Fix Version/s: 3.3.0 Assignee: Leona Yoda Resolution: Fixed Issue

[jira] [Updated] (SPARK-36830) Read/write dataframes with ANSI intervals from/to JSON files

[ https://issues.apache.org/jira/browse/SPARK-36830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36830: --- Description: Implement writing and reading ANSI intervals (year-month and day-time

[jira] [Commented] (SPARK-36830) Read/write dataframes with ANSI intervals from/to JSON files

[ https://issues.apache.org/jira/browse/SPARK-36830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422483#comment-17422483 ] Kousuke Saruta commented on SPARK-36830: Thank you, will do. > Read/write dataframes with ANSI

[jira] [Commented] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422108#comment-17422108 ] Kousuke Saruta commented on SPARK-36831: Thank you. I'll open a PR. > Read/write dataframes

[jira] [Updated] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36831: --- Description: Implement writing and reading ANSI intervals (year-month and day-time

[jira] [Commented] (SPARK-36831) Read/write dataframes with ANSI intervals from/to CSV files

[ https://issues.apache.org/jira/browse/SPARK-36831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422007#comment-17422007 ] Kousuke Saruta commented on SPARK-36831: [~maxgekk] Are you already working on this? >

[jira] [Resolved] (SPARK-36882) Support ILIKE API on Python

[ https://issues.apache.org/jira/browse/SPARK-36882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36882. Fix Version/s: 3.3.0 Assignee: Leona Yoda Resolution: Fixed Issue

[jira] [Updated] (SPARK-36865) Add PySpark API document of session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36865: --- Summary: Add PySpark API document of session_window (was: Add PySpark API document for

[jira] [Updated] (SPARK-36865) Add PySpark API document of session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36865: --- Description: There is no PySpark API document of session_window. The docstring of the

[jira] [Updated] (SPARK-36865) Add PySpark API document for session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36865: --- Description: There is no PySpark API document for session_window. The docstring of the

[jira] [Updated] (SPARK-36865) Add PySpark API document for session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36865: --- Summary: Add PySpark API document for session_window (was: The layout of PySpark API

[jira] [Created] (SPARK-36865) The layout of PySpark API document for session_window is broken

Kousuke Saruta created SPARK-36865: -- Summary: The layout of PySpark API document for session_window is broken Key: SPARK-36865 URL: https://issues.apache.org/jira/browse/SPARK-36865 Project: Spark

[jira] [Commented] (SPARK-36860) Create the external hive table for HBase failed

[ https://issues.apache.org/jira/browse/SPARK-36860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420483#comment-17420483 ] Kousuke Saruta commented on SPARK-36860: [~yimo_yym] Spark doesn't support creating Hive table

[jira] [Updated] (SPARK-36808) Upgrade Kafka to 2.8.1

[ https://issues.apache.org/jira/browse/SPARK-36808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36808: --- Issue Type: Improvement (was: Bug) > Upgrade Kafka to 2.8.1 > -- > >

[jira] [Resolved] (SPARK-36683) Support secant and cosecant

[ https://issues.apache.org/jira/browse/SPARK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36683. Fix Version/s: 3.3.0 Assignee: Yuto Akutsu Resolution: Fixed Issue

[jira] [Created] (SPARK-36808) Upgrade Kafka to 2.8.1

Kousuke Saruta created SPARK-36808: -- Summary: Upgrade Kafka to 2.8.1 Key: SPARK-36808 URL: https://issues.apache.org/jira/browse/SPARK-36808 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-36777) Move Java 17 on GitHub Actions from EA to LTS release

[ https://issues.apache.org/jira/browse/SPARK-36777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36777: --- Issue Type: Improvement (was: Bug) > Move Java 17 on GitHub Actions from EA to LTS release

[jira] [Created] (SPARK-36777) Move Java 17 on GitHub Actions from EA to LTS release

Kousuke Saruta created SPARK-36777: -- Summary: Move Java 17 on GitHub Actions from EA to LTS release Key: SPARK-36777 URL: https://issues.apache.org/jira/browse/SPARK-36777 Project: Spark

[jira] [Resolved] (SPARK-36751) octet_length/bit_length API is not implemented on Scala/Python/R

[ https://issues.apache.org/jira/browse/SPARK-36751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36751. Fix Version/s: 3.3.0 Assignee: Leona Yoda Resolution: Fixed Issue

[jira] [Updated] (SPARK-35930) Upgrade kinesis-client to 1.14.4

[ https://issues.apache.org/jira/browse/SPARK-35930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35930: --- Priority: Major (was: Minor) > Upgrade kinesis-client to 1.14.4 >

[jira] [Commented] (SPARK-35930) Upgrade kinesis-client to 1.14.4

[ https://issues.apache.org/jira/browse/SPARK-35930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414656#comment-17414656 ] Kousuke Saruta commented on SPARK-35930: [~holden] Yes, I didn't think it's a common case so I

[jira] [Updated] (SPARK-36729) Upgrade Netty from 4.1.63 to 4.1.68

[ https://issues.apache.org/jira/browse/SPARK-36729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36729: --- Priority: Minor (was: Major) > Upgrade Netty from 4.1.63 to 4.1.68 >

[jira] [Created] (SPARK-36729) Upgrade Netty from 4.1.63 to 4.1.68

Kousuke Saruta created SPARK-36729: -- Summary: Upgrade Netty from 4.1.63 to 4.1.68 Key: SPARK-36729 URL: https://issues.apache.org/jira/browse/SPARK-36729 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-28620) Double type returned for float type in Beeline/JDBC

[ https://issues.apache.org/jira/browse/SPARK-28620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17413602#comment-17413602 ] Kousuke Saruta commented on SPARK-28620: [~yumwang] The reason is ColumnValue.floatValue treats

[jira] [Created] (SPARK-36725) Ensure HiveThriftServer2Suites to stop Thrift JDBC server on exit

Kousuke Saruta created SPARK-36725: -- Summary: Ensure HiveThriftServer2Suites to stop Thrift JDBC server on exit Key: SPARK-36725 URL: https://issues.apache.org/jira/browse/SPARK-36725 Project: Spark

[jira] [Created] (SPARK-36724) Support timestamp_ntz as a type of time column for SessionWindow

Kousuke Saruta created SPARK-36724: -- Summary: Support timestamp_ntz as a type of time column for SessionWindow Key: SPARK-36724 URL: https://issues.apache.org/jira/browse/SPARK-36724 Project: Spark

[jira] [Updated] (SPARK-36723) day-time interval types should respect daylight saving time correctly

[ https://issues.apache.org/jira/browse/SPARK-36723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36723: --- Description: In the current master, day-time interval types handle 24 hours as 1 day

[jira] [Updated] (SPARK-36723) day-time interval types should respect daylight saving time correctly

[ https://issues.apache.org/jira/browse/SPARK-36723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36723: --- Description: In the current master, day-time interval types handle 24 hours as 1 day

[jira] [Created] (SPARK-36723) day-time interval types should respect daylight saving time correctly

Kousuke Saruta created SPARK-36723: -- Summary: day-time interval types should respect daylight saving time correctly Key: SPARK-36723 URL: https://issues.apache.org/jira/browse/SPARK-36723 Project:

[jira] [Commented] (SPARK-36694) Unable to build Spark on Azure DevOps with ubuntu-latest

[ https://issues.apache.org/jira/browse/SPARK-36694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412272#comment-17412272 ] Kousuke Saruta commented on SPARK-36694: [~LvffY] Could you make sure that Java8 is used to

[jira] [Commented] (SPARK-36683) Support secent and cosecent

[ https://issues.apache.org/jira/browse/SPARK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411808#comment-17411808 ] Kousuke Saruta commented on SPARK-36683: [~YActs] This issue is still open so let's not set Fix

[jira] [Updated] (SPARK-36683) Support secent and cosecent

[ https://issues.apache.org/jira/browse/SPARK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36683: --- Fix Version/s: (was: 3.3.0) > Support secent and cosecent > ---

[jira] [Created] (SPARK-36675) Support ScriptTransformation for timestamp_ntz

Kousuke Saruta created SPARK-36675: -- Summary: Support ScriptTransformation for timestamp_ntz Key: SPARK-36675 URL: https://issues.apache.org/jira/browse/SPARK-36675 Project: Spark Issue

[jira] [Commented] (SPARK-36672) Using value from map in grouping sets result org.apache.spark.sql.AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-36672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410441#comment-17410441 ] Kousuke Saruta commented on SPARK-36672: [~jhu] After SPARK-33308 was resolved, this issue seems

[jira] [Resolved] (SPARK-36603) Use WeakReference over SoftReference in LevelDB to avoid retaining iterator refs

[ https://issues.apache.org/jira/browse/SPARK-36603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36603. Fix Version/s: 3.1.3 3.2.0 Resolution: Fixed Issue resolved in

[jira] [Resolved] (SPARK-36635) spark-sql do NOT support that select name expression as string type now

[ https://issues.apache.org/jira/browse/SPARK-36635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36635. Resolution: Not A Problem [~weixiuli] I'll close this. If you can justify that it should

[jira] [Updated] (SPARK-36660) Cotangent is not supported by Dataframe

[ https://issues.apache.org/jira/browse/SPARK-36660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36660: --- Issue Type: Improvement (was: Bug) > Cotangent is not supported by Dataframe >

[jira] [Updated] (SPARK-36664) Log time spent waiting for cluster resources

[ https://issues.apache.org/jira/browse/SPARK-36664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36664: --- Issue Type: Improvement (was: Bug) > Log time spent waiting for cluster resources >

[jira] [Commented] (SPARK-36668) py4j.protocol.Py4JJavaError: java.util.NoSuchElementException: None.get

[ https://issues.apache.org/jira/browse/SPARK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410126#comment-17410126 ] Kousuke Saruta commented on SPARK-36668: [~ruzi]I meant that 2.4.8 is the last release of 2.4.x

[jira] [Commented] (SPARK-36668) py4j.protocol.Py4JJavaError: java.util.NoSuchElementException: None.get

[ https://issues.apache.org/jira/browse/SPARK-36668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410112#comment-17410112 ] Kousuke Saruta commented on SPARK-36668: [~ruzi] No more 2.4.x will be released. Does this issue

[jira] [Commented] (SPARK-36639) SQL sequence function with interval returns unexpected error in latest versions

[ https://issues.apache.org/jira/browse/SPARK-36639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17409539#comment-17409539 ] Kousuke Saruta commented on SPARK-36639: Issue resolved in

[jira] [Resolved] (SPARK-36639) SQL sequence function with interval returns unexpected error in latest versions

[ https://issues.apache.org/jira/browse/SPARK-36639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36639. Assignee: Kousuke Saruta Resolution: Fixed > SQL sequence function with interval

[jira] [Updated] (SPARK-36639) SQL sequence function with interval returns unexpected error in latest versions

[ https://issues.apache.org/jira/browse/SPARK-36639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36639: --- Fix Version/s: 3.1.3 3.2.0 > SQL sequence function with interval returns

[jira] [Commented] (SPARK-36639) SQL sequence function with interval returns unexpected error in latest versions

[ https://issues.apache.org/jira/browse/SPARK-36639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17408267#comment-17408267 ] Kousuke Saruta commented on SPARK-36639: [~amstel8] Thank you for reporting. SPARK-31980 seems

[jira] [Updated] (SPARK-36605) Upgrade Jackson to 2.12.5

[ https://issues.apache.org/jira/browse/SPARK-36605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36605: --- Description: Recently, Jackson 2.12.5 was released and it seems to be expected as the last

[jira] [Updated] (SPARK-36605) Upgrade Jackson to 2.12.5

[ https://issues.apache.org/jira/browse/SPARK-36605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36605: --- Description: Recently, Jackson 2.12.5 was released and it seems to be expected as the last

[jira] [Resolved] (SPARK-36509) Executors don't get rescheduled in standalone mode when worker dies

[ https://issues.apache.org/jira/browse/SPARK-36509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36509. Target Version/s: 3.2.0, 3.1.3, 3.0.4 Assignee: Kousuke Saruta

[jira] [Updated] (SPARK-36605) Upgrade Jackson to 2.12.5

[ https://issues.apache.org/jira/browse/SPARK-36605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36605: --- Description: Recently, Jackson 2.12.5 was released and it seems to be expected as the last

[jira] [Created] (SPARK-36605) Upgrade Jackson to 2.12.5

Kousuke Saruta created SPARK-36605: -- Summary: Upgrade Jackson to 2.12.5 Key: SPARK-36605 URL: https://issues.apache.org/jira/browse/SPARK-36605 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-36601) Reading a valid JSON file causes a NPE

[ https://issues.apache.org/jira/browse/SPARK-36601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405993#comment-17405993 ] Kousuke Saruta commented on SPARK-36601: [~lyytinen] This issue seems resolved in SPARK-36379.

[jira] [Updated] (SPARK-36398) Redact sensitive information in Spark Thrift Server log

[ https://issues.apache.org/jira/browse/SPARK-36398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36398: --- Fix Version/s: 3.1.3 3.2.0 > Redact sensitive information in Spark

[jira] [Resolved] (SPARK-36398) Redact sensitive information in Spark Thrift Server log

[ https://issues.apache.org/jira/browse/SPARK-36398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36398. Target Version/s: 3.2.0, 3.1.3 Resolution: Fixed Issue resolved in

[jira] [Updated] (SPARK-36398) Redact sensitive information in Spark Thrift Server log

[ https://issues.apache.org/jira/browse/SPARK-36398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36398: --- Target Version/s: (was: 3.2.0, 3.1.3) > Redact sensitive information in Spark Thrift

[jira] [Reopened] (SPARK-36398) Redact sensitive information in Spark Thrift Server log

[ https://issues.apache.org/jira/browse/SPARK-36398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reopened SPARK-36398: > Redact sensitive information in Spark Thrift Server log >

[jira] [Commented] (SPARK-36400) Redact sensitive information in Spark Thrift Server UI

[ https://issues.apache.org/jira/browse/SPARK-36400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17404322#comment-17404322 ] Kousuke Saruta commented on SPARK-36400: Issue resolved in

[jira] [Updated] (SPARK-36400) Redact sensitive information in Spark Thrift Server UI

[ https://issues.apache.org/jira/browse/SPARK-36400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36400: --- Fix Version/s: (was: 3.1.2) 3.1.3 > Redact sensitive information in

[jira] [Updated] (SPARK-36400) Redact sensitive information in Spark Thrift Server UI

[ https://issues.apache.org/jira/browse/SPARK-36400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36400: --- Fix Version/s: (was: 3.3.0) 3.1.2 > Redact sensitive information in

[jira] [Updated] (SPARK-36400) Redact sensitive information in Spark Thrift Server UI

[ https://issues.apache.org/jira/browse/SPARK-36400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36400: --- Fix Version/s: (was: 3.1.3) 3.3.0 > Redact sensitive information in

[jira] [Updated] (SPARK-36398) Redact sensitive information in Spark Thrift Server log

[ https://issues.apache.org/jira/browse/SPARK-36398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36398: --- Fix Version/s: (was: 3.1.3) (was: 3.2.0) > Redact sensitive

[jira] [Commented] (SPARK-36572) Removal of netty-3.9.9.Final.jar dependent code and use only netty-all-4.1.47.Final.jar in Spark 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-36572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403798#comment-17403798 ] Kousuke Saruta commented on SPARK-36572: [~sshukla05] Sorry, 2.4.8 is the last release of 2.4.x.

[jira] [Commented] (SPARK-36429) JacksonParser should throw exception when data type unsupported.

[ https://issues.apache.org/jira/browse/SPARK-36429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402951#comment-17402951 ] Kousuke Saruta commented on SPARK-36429: Issue resolved in

[jira] [Commented] (SPARK-36544) Special strings for dates are no longer automatically converted without the "date" keyword

[ https://issues.apache.org/jira/browse/SPARK-36544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402366#comment-17402366 ] Kousuke Saruta commented on SPARK-36544: [~laurikoobas] The behavior was changed. See

[jira] [Commented] (SPARK-36548) Throwing NoClassDefFoundError for Logging$class

[ https://issues.apache.org/jira/browse/SPARK-36548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402364#comment-17402364 ] Kousuke Saruta commented on SPARK-36548: [~sadagopan] It was wrongly exposed before. Logging is

[jira] [Resolved] (SPARK-36398) Redact sensitive information in Spark Thrift Server log

[ https://issues.apache.org/jira/browse/SPARK-36398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36398. Fix Version/s: 3.1.3 3.2.0 Assignee: Kousuke Saruta

<    1   2   3   4   5   6   7   8   9   10   >