[jira] [Resolved] (SPARK-29986) Introduce java like string trim to UTF8String

[ https://issues.apache.org/jira/browse/SPARK-29986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29986. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26626

[jira] [Assigned] (SPARK-29986) Introduce java like string trim to UTF8String

[ https://issues.apache.org/jira/browse/SPARK-29986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29986: --- Assignee: Kent Yao > Introduce java like string trim to UTF8String >

[jira] [Created] (SPARK-30015) Move hive-storage-api dependency from `hive-2.3` to `sql/core`

Dongjoon Hyun created SPARK-30015: - Summary: Move hive-storage-api dependency from `hive-2.3` to `sql/core` Key: SPARK-30015 URL: https://issues.apache.org/jira/browse/SPARK-30015 Project: Spark

[jira] [Commented] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility)

[ https://issues.apache.org/jira/browse/SPARK-25923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16981310#comment-16981310 ] L. C. Hsieh commented on SPARK-25923: - Sent an email to CRAN for help. > SparkR UT Failure

[jira] [Reopened] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility)

[ https://issues.apache.org/jira/browse/SPARK-25923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-25923: --- This seems to happen again. - PR: https://github.com/apache/spark/pull/26611 - Jenkins:

[jira] [Resolved] (SPARK-30000) Trim the string when cast string type to decimals

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-3. - Resolution: Fixed Issue resolved by pull request 26640

[jira] [Updated] (SPARK-29939) Add spark.shuffle.mapStatus.compression.codec conf

[ https://issues.apache.org/jira/browse/SPARK-29939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29939: -- Summary: Add spark.shuffle.mapStatus.compression.codec conf (was: Add a conf for

[jira] [Resolved] (SPARK-29939) Add a conf for CompressionCodec for Ser/Deser of MapOutputStatus

[ https://issues.apache.org/jira/browse/SPARK-29939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29939. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26611

[jira] [Created] (SPARK-30014) for non-default catalog, namespace name is always needed in a query?

xufei created SPARK-30014: - Summary: for non-default catalog, namespace name is always needed in a query? Key: SPARK-30014 URL: https://issues.apache.org/jira/browse/SPARK-30014 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-29707) Make PartitionFilters and PushedFilters abbreviate configurable in metadata

[ https://issues.apache.org/jira/browse/SPARK-29707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hu Fuwang updated SPARK-29707: -- Comment: was deleted (was: I am working on this.) > Make PartitionFilters and PushedFilters

[jira] [Assigned] (SPARK-30013) No parens for calls to BigDecimal.longValue() etc.

[ https://issues.apache.org/jira/browse/SPARK-30013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30013: - Assignee: Sean R. Owen > No parens for calls to BigDecimal.longValue() etc. >

[jira] [Resolved] (SPARK-30013) No parens for calls to BigDecimal.longValue() etc.

[ https://issues.apache.org/jira/browse/SPARK-30013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30013. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26653

[jira] [Resolved] (SPARK-29937) Make FileSourceScanExec class fields lazy

[ https://issues.apache.org/jira/browse/SPARK-29937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29937. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26565

[jira] [Assigned] (SPARK-29937) Make FileSourceScanExec class fields lazy

[ https://issues.apache.org/jira/browse/SPARK-29937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29937: - Assignee: ulysses you > Make FileSourceScanExec class fields lazy >

[jira] [Resolved] (SPARK-29999) Writing empty partition via DSv2 implementation of FileStreamSink throws FileNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-2. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26639

[jira] [Assigned] (SPARK-29999) Writing empty partition via DSv2 implementation of FileStreamSink throws FileNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-2: - Assignee: Jungtaek Lim > Writing empty partition via DSv2 implementation of

[jira] [Created] (SPARK-30013) No parens for calls to BigDecimal.longValue() etc.

Sean R. Owen created SPARK-30013: Summary: No parens for calls to BigDecimal.longValue() etc. Key: SPARK-30013 URL: https://issues.apache.org/jira/browse/SPARK-30013 Project: Spark Issue

[jira] [Created] (SPARK-30012) Change classes extending scala collection classes to work with 2.13

Sean R. Owen created SPARK-30012: Summary: Change classes extending scala collection classes to work with 2.13 Key: SPARK-30012 URL: https://issues.apache.org/jira/browse/SPARK-30012 Project: Spark

[jira] [Resolved] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-27681. -- Resolution: Duplicate > Use scala.collection.Seq explicitly instead of scala.Seq alias >

[jira] [Updated] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-27681: - Parent: (was: SPARK-25075) Issue Type: Task (was: Sub-task) > Use

[jira] [Updated] (SPARK-30010) Remove deprecated SparkConf.setAll(Traversable)

[ https://issues.apache.org/jira/browse/SPARK-30010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-30010: - Target Version/s: 3.1.0 > Remove deprecated SparkConf.setAll(Traversable) >

[jira] [Created] (SPARK-30011) Use DoubleAsIfIntegral / FloatAsIfIntegral workalike in 2.13

Sean R. Owen created SPARK-30011: Summary: Use DoubleAsIfIntegral / FloatAsIfIntegral workalike in 2.13 Key: SPARK-30011 URL: https://issues.apache.org/jira/browse/SPARK-30011 Project: Spark

[jira] [Created] (SPARK-30010) Remove deprecated SparkConf.setAll(Traversable)

Sean R. Owen created SPARK-30010: Summary: Remove deprecated SparkConf.setAll(Traversable) Key: SPARK-30010 URL: https://issues.apache.org/jira/browse/SPARK-30010 Project: Spark Issue Type:

[jira] [Created] (SPARK-30009) Replace Ordering.Double with Ordering.Double.TotalOrdering

Sean R. Owen created SPARK-30009: Summary: Replace Ordering.Double with Ordering.Double.TotalOrdering Key: SPARK-30009 URL: https://issues.apache.org/jira/browse/SPARK-30009 Project: Spark

[jira] [Updated] (SPARK-25075) Build and test Spark against Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-25075: - Component/s: SQL Spark Core MLlib

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16981173#comment-16981173 ] Sean R. Owen commented on SPARK-25075: -- Yeah this change will be tricky but not terrible. One

[jira] [Commented] (SPARK-29226) Upgrade jackson-databind to 2.9.10 and fix vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-29226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16981159#comment-16981159 ] Dongjoon Hyun commented on SPARK-29226: --- `3.0.0-preview` has `2.10.0`. :) > Upgrade

[jira] [Updated] (SPARK-29970) open/close state is not preserved for Timelineview

[ https://issues.apache.org/jira/browse/SPARK-29970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29970: -- Affects Version/s: 2.0.2 > open/close state is not preserved for Timelineview >

[jira] [Updated] (SPARK-29970) open/close state is not preserved for Timelineview

[ https://issues.apache.org/jira/browse/SPARK-29970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29970: -- Affects Version/s: 2.1.3 > open/close state is not preserved for Timelineview >

[jira] [Updated] (SPARK-29970) open/close state is not preserved for Timelineview

[ https://issues.apache.org/jira/browse/SPARK-29970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29970: -- Affects Version/s: 2.2.3 > open/close state is not preserved for Timelineview >

[jira] [Updated] (SPARK-29970) open/close state is not preserved for Timelineview

[ https://issues.apache.org/jira/browse/SPARK-29970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29970: -- Affects Version/s: (was: 3.0.0) > open/close state is not preserved for Timelineview >

[jira] [Updated] (SPARK-29970) open/close state is not preserved for Timelineview

[ https://issues.apache.org/jira/browse/SPARK-29970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29970: -- Affects Version/s: 2.3.4 > open/close state is not preserved for Timelineview >

[jira] [Updated] (SPARK-29970) open/close state is not preserved for Timelineview

[ https://issues.apache.org/jira/browse/SPARK-29970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29970: -- Fix Version/s: 2.4.5 > open/close state is not preserved for Timelineview >

[jira] [Updated] (SPARK-29970) open/close state is not preserved for Timelineview

[ https://issues.apache.org/jira/browse/SPARK-29970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29970: -- Affects Version/s: 2.4.4 > open/close state is not preserved for Timelineview >

[jira] [Assigned] (SPARK-30005) Update `test-dependencies.sh` to check `hive-1.2/2.3` profile

[ https://issues.apache.org/jira/browse/SPARK-30005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30005: - Assignee: Dongjoon Hyun > Update `test-dependencies.sh` to check `hive-1.2/2.3`

[jira] [Resolved] (SPARK-30005) Update `test-dependencies.sh` to check `hive-1.2/2.3` profile

[ https://issues.apache.org/jira/browse/SPARK-30005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30005. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26646

[jira] [Resolved] (SPARK-24690) Add a new config to control plan stats computation in LogicalRelation

[ https://issues.apache.org/jira/browse/SPARK-24690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-24690. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 21668

[jira] [Assigned] (SPARK-24690) Add a new config to control plan stats computation in LogicalRelation

[ https://issues.apache.org/jira/browse/SPARK-24690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-24690: - Assignee: Takeshi Yamamuro > Add a new config to control plan stats computation in

[jira] [Created] (SPARK-30008) the dataType of collect_list and collect_set aggregate functions should be ArrayType(_, false)

Kent Yao created SPARK-30008: Summary: the dataType of collect_list and collect_set aggregate functions should be ArrayType(_, false) Key: SPARK-30008 URL: https://issues.apache.org/jira/browse/SPARK-30008

[jira] [Updated] (SPARK-30008) the dataType of collect_list and collect_set aggregate functions should be ArrayType(_, false)

[ https://issues.apache.org/jira/browse/SPARK-30008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-30008: - Issue Type: Bug (was: Improvement) > the dataType of collect_list and collect_set aggregate functions

[jira] [Resolved] (SPARK-29973) Use nano time to calculate 'processedRowsPerSecond' to avoid 'NaN'/'Infinity'

[ https://issues.apache.org/jira/browse/SPARK-29973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29973. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26610

[jira] [Assigned] (SPARK-29973) Use nano time to calculate 'processedRowsPerSecond' to avoid 'NaN'/'Infinity'

[ https://issues.apache.org/jira/browse/SPARK-29973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29973: Assignee: Genmao Yu > Use nano time to calculate 'processedRowsPerSecond' to avoid

[jira] [Commented] (SPARK-28437) Different format when casting interval type to string type

[ https://issues.apache.org/jira/browse/SPARK-28437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16981050#comment-16981050 ] Kent Yao commented on SPARK-28437: -- We're able to use `spark.sql.intervalOutputStyle` to change this