[jira] [Assigned] (SPARK-31119) Add interval value support for extract expression as source

[ https://issues.apache.org/jira/browse/SPARK-31119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31119: --- Assignee: Kent Yao > Add interval value support for extract expression as source >

[jira] [Resolved] (SPARK-31119) Add interval value support for extract expression as source

[ https://issues.apache.org/jira/browse/SPARK-31119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31119. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27876

[jira] [Commented] (SPARK-22299) Use OFFSET and LIMIT for JDBC DataFrameReader striping

[ https://issues.apache.org/jira/browse/SPARK-22299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061359#comment-17061359 ] Pushpinder Heer commented on SPARK-22299: - This shows resolved, but no version indicated.  Is

[jira] [Updated] (SPARK-28593) Rename ShuffleClient to BlockStoreClient which more close to its usage

[ https://issues.apache.org/jira/browse/SPARK-28593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28593: -- Affects Version/s: (was: 2.4.0) 3.0.0 > Rename ShuffleClient to

[jira] [Updated] (SPARK-31179) Fast fail the connection while last shuffle connection failed in the last retry IO wait

[ https://issues.apache.org/jira/browse/SPARK-31179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-31179: Description: When reading shuffle data, maybe several fetch request sent to a same shuffle server. There

[jira] [Commented] (SPARK-27665) Split fetch shuffle blocks protocol from OpenBlocks

[ https://issues.apache.org/jira/browse/SPARK-27665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061337#comment-17061337 ] Dongjoon Hyun commented on SPARK-27665: --- Thank you for confirmation! > Split fetch shuffle blocks

[jira] [Commented] (SPARK-29278) Data Source V2: Support SHOW CURRENT CATALOG

[ https://issues.apache.org/jira/browse/SPARK-29278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061332#comment-17061332 ] Dongjoon Hyun commented on SPARK-29278: --- Thanks! > Data Source V2: Support SHOW CURRENT CATALOG >

[jira] [Created] (SPARK-31179) Fast fail the connection while last shuffle connection failed in the last retry IO wait

feiwang created SPARK-31179: --- Summary: Fast fail the connection while last shuffle connection failed in the last retry IO wait Key: SPARK-31179 URL: https://issues.apache.org/jira/browse/SPARK-31179

[jira] [Commented] (SPARK-31178) sql("INSERT INTO v2DataSource ...").collect() double inserts

[ https://issues.apache.org/jira/browse/SPARK-31178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061292#comment-17061292 ] Burak Yavuz commented on SPARK-31178: - cc [~wenchen] [~rdblue] > sql("INSERT INTO v2DataSource

[jira] [Created] (SPARK-31178) sql("INSERT INTO v2DataSource ...").collect() double inserts

Burak Yavuz created SPARK-31178: --- Summary: sql("INSERT INTO v2DataSource ...").collect() double inserts Key: SPARK-31178 URL: https://issues.apache.org/jira/browse/SPARK-31178 Project: Spark

[jira] [Assigned] (SPARK-30954) TreeModelWrappers class name do not correspond to file name

[ https://issues.apache.org/jira/browse/SPARK-30954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30954: - Assignee: kevin yu > TreeModelWrappers class name do not correspond to file name >

[jira] [Resolved] (SPARK-30954) TreeModelWrappers class name do not correspond to file name

[ https://issues.apache.org/jira/browse/SPARK-30954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30954. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27940

[jira] [Created] (SPARK-31177) DataFrameReader.csv incorrectly reads gzip encoded CSV from S3 when it has non-".gz" extension

Mark Waddle created SPARK-31177: --- Summary: DataFrameReader.csv incorrectly reads gzip encoded CSV from S3 when it has non-".gz" extension Key: SPARK-31177 URL: https://issues.apache.org/jira/browse/SPARK-31177

[jira] [Assigned] (SPARK-31047) Improve file listing for ViewFileSystem

[ https://issues.apache.org/jira/browse/SPARK-31047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31047: - Assignee: Manu Zhang > Improve file listing for ViewFileSystem >

[jira] [Resolved] (SPARK-31047) Improve file listing for ViewFileSystem

[ https://issues.apache.org/jira/browse/SPARK-31047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31047. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27801

[jira] [Resolved] (SPARK-31123) Drop does not work after join with aliases

[ https://issues.apache.org/jira/browse/SPARK-31123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikel San Vicente resolved SPARK-31123. --- Fix Version/s: 3.0.0 Resolution: Fixed > Drop does not work after join with

[jira] [Resolved] (SPARK-31125) When processing new K8s state snapshots Spark treats Terminating nodes as terminated.

[ https://issues.apache.org/jira/browse/SPARK-31125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31125. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27905

[jira] [Assigned] (SPARK-31171) size(null) should return null under ansi mode

[ https://issues.apache.org/jira/browse/SPARK-31171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31171: - Assignee: Wenchen Fan > size(null) should return null under ansi mode >

[jira] [Resolved] (SPARK-31171) size(null) should return null under ansi mode

[ https://issues.apache.org/jira/browse/SPARK-31171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31171. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27936

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061101#comment-17061101 ] Dongjoon Hyun commented on SPARK-28594: --- `releasenotes` is added for 3.0.0 release. > Allow event

[jira] [Updated] (SPARK-28594) Allow event logs for running streaming apps to be rolled over

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28594: -- Labels: releasenotes (was: ) > Allow event logs for running streaming apps to be rolled over

[jira] [Resolved] (SPARK-30860) Different behavior between rolling and non-rolling event log

[ https://issues.apache.org/jira/browse/SPARK-30860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30860. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27764

[jira] [Assigned] (SPARK-30860) Different behavior between rolling and non-rolling event log

[ https://issues.apache.org/jira/browse/SPARK-30860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30860: - Assignee: Adam Binford > Different behavior between rolling and non-rolling event log

[jira] [Updated] (SPARK-31176) Remove support for 'e'/'c' as datetime pattern charactar

[ https://issues.apache.org/jira/browse/SPARK-31176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-31176: - Summary: Remove support for 'e'/'c' as datetime pattern charactar (was: Romove support for 'e'/'c' as

[jira] [Created] (SPARK-31176) Romove support for 'e'/'c' as datetime pattern charactar

Kent Yao created SPARK-31176: Summary: Romove support for 'e'/'c' as datetime pattern charactar Key: SPARK-31176 URL: https://issues.apache.org/jira/browse/SPARK-31176 Project: Spark Issue

[jira] [Updated] (SPARK-31175) Avoid creating reverse comparator for each compare in InterpretedOrdering

[ https://issues.apache.org/jira/browse/SPARK-31175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31175: - Summary: Avoid creating reverse comparator for each compare in InterpretedOrdering (was: Avoid creating new

[jira] [Created] (SPARK-31175) Avoid creating new reverse comparator per compare in InterpretedOrdering

wuyi created SPARK-31175: Summary: Avoid creating new reverse comparator per compare in InterpretedOrdering Key: SPARK-31175 URL: https://issues.apache.org/jira/browse/SPARK-31175 Project: Spark

[jira] [Created] (SPARK-31174) unix_timestamp() function returning NULL values for corner cases (daylight saving)

Piotr Skąpski created SPARK-31174: - Summary: unix_timestamp() function returning NULL values for corner cases (daylight saving) Key: SPARK-31174 URL: https://issues.apache.org/jira/browse/SPARK-31174

[jira] [Resolved] (SPARK-29278) Data Source V2: Support SHOW CURRENT CATALOG

[ https://issues.apache.org/jira/browse/SPARK-29278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim resolved SPARK-29278. --- Resolution: Duplicate > Data Source V2: Support SHOW CURRENT CATALOG >

[jira] [Commented] (SPARK-29278) Data Source V2: Support SHOW CURRENT CATALOG

[ https://issues.apache.org/jira/browse/SPARK-29278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061005#comment-17061005 ] Terry Kim commented on SPARK-29278: --- Thanks [~dongjoon]. I am resolving this since SHOW CURRENT

[jira] [Updated] (SPARK-29278) Data Source V2: Support SHOW CURRENT CATALOG

[ https://issues.apache.org/jira/browse/SPARK-29278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-29278: -- Summary: Data Source V2: Support SHOW CURRENT CATALOG (was: Implement CATALOG/NAMESPACE related SQL

[jira] [Resolved] (SPARK-31170) Spark Cli does not respect hive-site.xml and spark.sql.warehouse.dir

[ https://issues.apache.org/jira/browse/SPARK-31170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31170. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27933

[jira] [Assigned] (SPARK-31170) Spark Cli does not respect hive-site.xml and spark.sql.warehouse.dir

[ https://issues.apache.org/jira/browse/SPARK-31170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31170: --- Assignee: Kent Yao > Spark Cli does not respect hive-site.xml and spark.sql.warehouse.dir

[jira] [Updated] (SPARK-25561) HiveClient.getPartitionsByFilter throws an exception if Hive retries directSql

[ https://issues.apache.org/jira/browse/SPARK-25561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-25561: - Description: In HiveShim.scala, the current

[jira] [Updated] (SPARK-25561) HiveClient.getPartitionsByFilter throws an exception if Hive retries directSql

[ https://issues.apache.org/jira/browse/SPARK-25561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-25561: - Description: In HiveShim.scala, the current behavior is that if hive.metastore.try.direct.sql

[jira] [Created] (SPARK-31173) Spark Kubernetes add tolerations and nodeName support

zhongwei liu created SPARK-31173: Summary: Spark Kubernetes add tolerations and nodeName support Key: SPARK-31173 URL: https://issues.apache.org/jira/browse/SPARK-31173 Project: Spark Issue

[jira] [Created] (SPARK-31172) RecordBinaryComparator Tests failing on Big Endian Platform (s390x)

Jinesh Patel created SPARK-31172: Summary: RecordBinaryComparator Tests failing on Big Endian Platform (s390x) Key: SPARK-31172 URL: https://issues.apache.org/jira/browse/SPARK-31172 Project: Spark

[jira] [Assigned] (SPARK-31150) Parsing seconds fraction with variable length for timestamp

[ https://issues.apache.org/jira/browse/SPARK-31150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31150: --- Assignee: Kent Yao > Parsing seconds fraction with variable length for timestamp >

[jira] [Resolved] (SPARK-31150) Parsing seconds fraction with variable length for timestamp

[ https://issues.apache.org/jira/browse/SPARK-31150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31150. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27906

[jira] [Created] (SPARK-31171) size(null) should return null under ansi mode

Wenchen Fan created SPARK-31171: --- Summary: size(null) should return null under ansi mode Key: SPARK-31171 URL: https://issues.apache.org/jira/browse/SPARK-31171 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-31164) Inconsistent rdd and output partitioning for bucket table when output doesn't contain all bucket columns

[ https://issues.apache.org/jira/browse/SPARK-31164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31164: --- Assignee: Zhenhua Wang > Inconsistent rdd and output partitioning for bucket table when

[jira] [Resolved] (SPARK-31164) Inconsistent rdd and output partitioning for bucket table when output doesn't contain all bucket columns

[ https://issues.apache.org/jira/browse/SPARK-31164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31164. - Fix Version/s: 2.4.6 3.0.0 Resolution: Fixed > Inconsistent rdd and

[jira] [Resolved] (SPARK-28934) Add `spark.sql.compatiblity.mode`

[ https://issues.apache.org/jira/browse/SPARK-28934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28934. - Resolution: Won't Fix > Add `spark.sql.compatiblity.mode` > - >

[jira] [Commented] (SPARK-27665) Split fetch shuffle blocks protocol from OpenBlocks

[ https://issues.apache.org/jira/browse/SPARK-27665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060870#comment-17060870 ] Wenchen Fan commented on SPARK-27665: - I believe it's fixed by SPARK-29435 > Split fetch shuffle

[jira] [Updated] (SPARK-25383) Image data source supports sample pushdown

[ https://issues.apache.org/jira/browse/SPARK-25383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25383: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Image data source supports

[jira] [Updated] (SPARK-25349) Support sample pushdown in Data Source V2

[ https://issues.apache.org/jira/browse/SPARK-25349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25349: -- Issue Type: New Feature (was: Story) > Support sample pushdown in Data Source V2 >

[jira] [Updated] (SPARK-25349) Support sample pushdown in Data Source V2

[ https://issues.apache.org/jira/browse/SPARK-25349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25349: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support sample pushdown in

[jira] [Commented] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060780#comment-17060780 ] Dongjoon Hyun commented on SPARK-25728: --- Hi, [~kiszk]. is there any update on this issue? > SPIP:

[jira] [Updated] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25728: -- Affects Version/s: (was: 3.0.0) 3.1.0 > SPIP: Structured

[jira] [Updated] (SPARK-25802) Use JDBC Oracle Binds from Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-25802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25802: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Use JDBC Oracle Binds from

[jira] [Resolved] (SPARK-26028) Design sketch for SPIP: Property Graphs, Cypher Queries, and Algorithms

[ https://issues.apache.org/jira/browse/SPARK-26028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26028. --- Assignee: (was: Martin Junghanns) Resolution: Won't Do Unfortunately, the

[jira] [Updated] (SPARK-26301) Consider switching from putting secret in environment variable directly to using secret reference

[ https://issues.apache.org/jira/browse/SPARK-26301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26301: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Consider switching from

[jira] [Updated] (SPARK-26354) Ability to return schema prefix before dataframe column names

[ https://issues.apache.org/jira/browse/SPARK-26354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26354: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Ability to return schema

[jira] [Updated] (SPARK-31165) Multiple wrong references in Dockerfile for k8s

[ https://issues.apache.org/jira/browse/SPARK-31165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikolay Dimolarov updated SPARK-31165: -- Description: I am currently trying to follow the k8s instructions for Spark: 

[jira] [Updated] (SPARK-26373) Spark UI 'environment' tab - column to indicate default vs overridden values

[ https://issues.apache.org/jira/browse/SPARK-26373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26373: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Spark UI 'environment' tab

[jira] [Updated] (SPARK-26498) Integrate barrier execution with MMLSpark's LightGBM

[ https://issues.apache.org/jira/browse/SPARK-26498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26498: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Integrate barrier

[jira] [Updated] (SPARK-26410) Support per Pandas UDF configuration

[ https://issues.apache.org/jira/browse/SPARK-26410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26410: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support per Pandas UDF

[jira] [Updated] (SPARK-26589) proper `median` method for spark dataframe

[ https://issues.apache.org/jira/browse/SPARK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26589: -- Affects Version/s: (was: 3.0.0) 3.1.0 > proper `median` method for

[jira] [Updated] (SPARK-26764) [SPIP] Spark Relational Cache

[ https://issues.apache.org/jira/browse/SPARK-26764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26764: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [SPIP] Spark Relational

[jira] [Updated] (SPARK-27014) Support removal of jars and Spark binaries from Mesos driver and executor sandboxes

[ https://issues.apache.org/jira/browse/SPARK-27014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27014: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support removal of jars

[jira] [Updated] (SPARK-26867) Spark Support of YARN Placement Constraint

[ https://issues.apache.org/jira/browse/SPARK-26867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26867: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Spark Support of YARN

[jira] [Updated] (SPARK-27143) Provide REST API for JDBC/ODBC level information

[ https://issues.apache.org/jira/browse/SPARK-27143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27143: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Provide REST API for

[jira] [Updated] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27249: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Developers API for

[jira] [Updated] (SPARK-27447) Add collaborate filtering Explain API in SPARKML

[ https://issues.apache.org/jira/browse/SPARK-27447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27447: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add collaborate filtering

[jira] [Updated] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses

[ https://issues.apache.org/jira/browse/SPARK-27561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27561: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support "lateral column

[jira] [Updated] (SPARK-27616) Standalone cluster management user resource allocation

[ https://issues.apache.org/jira/browse/SPARK-27616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27616: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Standalone cluster

[jira] [Updated] (SPARK-27753) Support SQL expressions for interval parameter in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-27753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27753: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support SQL expressions

[jira] [Commented] (SPARK-27780) Shuffle server & client should be versioned to enable smoother upgrade

[ https://issues.apache.org/jira/browse/SPARK-27780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060768#comment-17060768 ] Dongjoon Hyun commented on SPARK-27780: --- Hi, [~irashid]. Is there any update? > Shuffle server &

[jira] [Commented] (SPARK-27665) Split fetch shuffle blocks protocol from OpenBlocks

[ https://issues.apache.org/jira/browse/SPARK-27665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060767#comment-17060767 ] Dongjoon Hyun commented on SPARK-27665: --- [~koert]. Do you still hit the same issue at

[jira] [Updated] (SPARK-27785) Introduce .joinWith() overloads for typed inner joins of 3 or more tables

[ https://issues.apache.org/jira/browse/SPARK-27785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27785: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Introduce .joinWith()

[jira] [Updated] (SPARK-27790) Support SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27790: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support SQL INTERVAL types

[jira] [Updated] (SPARK-27780) Shuffle server & client should be versioned to enable smoother upgrade

[ https://issues.apache.org/jira/browse/SPARK-27780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27780: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Shuffle server & client

[jira] [Updated] (SPARK-27799) Allow SerializerManager.canUseKryo whitelist to be extended via a configuration

[ https://issues.apache.org/jira/browse/SPARK-27799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27799: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Allow

[jira] [Updated] (SPARK-27808) Ability to ignore existing files for structured streaming

[ https://issues.apache.org/jira/browse/SPARK-27808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27808: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Ability to ignore existing

[jira] [Updated] (SPARK-27911) PySpark Packages should automatically choose correct scala version

[ https://issues.apache.org/jira/browse/SPARK-27911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27911: -- Affects Version/s: (was: 3.0.0) 3.1.0 > PySpark Packages should

[jira] [Updated] (SPARK-27935) Introduce leftOuterJoinWith and fullOuterJoinWith

[ https://issues.apache.org/jira/browse/SPARK-27935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27935: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Introduce

[jira] [Updated] (SPARK-19700) Design an API for pluggable scheduler implementations

[ https://issues.apache.org/jira/browse/SPARK-19700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-19700: -- Affects Version/s: (was: 2.1.0) 3.1.0 > Design an API for

[jira] [Updated] (SPARK-27941) Serverless Spark in the Cloud

[ https://issues.apache.org/jira/browse/SPARK-27941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27941: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Serverless Spark in the

[jira] [Resolved] (SPARK-28022) k8s pod affinity to achieve cloud native friendly autoscaling

[ https://issues.apache.org/jira/browse/SPARK-28022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28022. --- Resolution: Invalid >From Spark side, the suggested idea looks invalid to me. You may

[jira] [Updated] (SPARK-31165) Multiple wrong references in Dockerfile for k8s

[ https://issues.apache.org/jira/browse/SPARK-31165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikolay Dimolarov updated SPARK-31165: -- Affects Version/s: 2.4.5 > Multiple wrong references in Dockerfile for k8s >

[jira] [Updated] (SPARK-28022) k8s pod affinity to achieve cloud native friendly autoscaling

[ https://issues.apache.org/jira/browse/SPARK-28022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28022: -- Shepherd: (was: Dongjoon Hyun) > k8s pod affinity to achieve cloud native friendly

[jira] [Updated] (SPARK-28050) DataFrameWriter support insertInto a specific table partition

[ https://issues.apache.org/jira/browse/SPARK-28050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28050: -- Affects Version/s: (was: 3.0.0) 3.1.0 > DataFrameWriter support

[jira] [Commented] (SPARK-29262) DataFrameWriter insertIntoPartition function

[ https://issues.apache.org/jira/browse/SPARK-29262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060747#comment-17060747 ] Dongjoon Hyun commented on SPARK-29262: --- I close this issue as a `Duplicate` of SPARK-28050.

[jira] [Closed] (SPARK-29262) DataFrameWriter insertIntoPartition function

[ https://issues.apache.org/jira/browse/SPARK-29262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-29262. - > DataFrameWriter insertIntoPartition function > > >

[jira] [Resolved] (SPARK-29262) DataFrameWriter insertIntoPartition function

[ https://issues.apache.org/jira/browse/SPARK-29262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29262. --- Resolution: Duplicate > DataFrameWriter insertIntoPartition function >

[jira] [Updated] (SPARK-28254) Use More Generic Netty Interfaces to Support Fabric Network in Spark

[ https://issues.apache.org/jira/browse/SPARK-28254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28254: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Use More Generic Netty

[jira] [Resolved] (SPARK-28415) Add messageHandler to Kafka 10 direct stream API

[ https://issues.apache.org/jira/browse/SPARK-28415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28415. --- Resolution: Invalid According to the decision on

[jira] [Resolved] (SPARK-28727) Request for partial least square (PLS) regression model

[ https://issues.apache.org/jira/browse/SPARK-28727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28727. --- Resolution: Won't Do According to the current status and the above advice, I close this

[jira] [Updated] (SPARK-28727) Request for partial least square (PLS) regression model

[ https://issues.apache.org/jira/browse/SPARK-28727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28727: -- Environment: (was: I am using Windows 10, Spark v2.3.2) > Request for partial least

[jira] [Updated] (SPARK-28727) Request for partial least square (PLS) regression model

[ https://issues.apache.org/jira/browse/SPARK-28727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28727: -- Labels: (was: PLS least partial regression square) > Request for partial least square (PLS)

[jira] [Updated] (SPARK-28870) Snapshot event log files to support incremental reading

[ https://issues.apache.org/jira/browse/SPARK-28870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28870: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Snapshot event log files

[jira] [Commented] (SPARK-28934) Add `spark.sql.compatiblity.mode`

[ https://issues.apache.org/jira/browse/SPARK-28934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060739#comment-17060739 ] Dongjoon Hyun commented on SPARK-28934: --- Shall we close this JIRA since this is superseded by

[jira] [Updated] (SPARK-28948) Support passing all Table metadata in TableProvider

[ https://issues.apache.org/jira/browse/SPARK-28948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28948: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support passing all Table

[jira] [Resolved] (SPARK-28986) from_json cannot handle data with the same name but different case in the json string.

[ https://issues.apache.org/jira/browse/SPARK-28986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28986. --- Resolution: Invalid Hi, [~iduanyingjie]. JSON key name should be case sensitive. {code}

[jira] [Updated] (SPARK-29031) Materialized column to accelerate queries

[ https://issues.apache.org/jira/browse/SPARK-29031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29031: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Materialized column to

[jira] [Updated] (SPARK-29038) SPIP: Support Spark Materialized View

[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29038: -- Affects Version/s: (was: 3.0.0) 3.1.0 > SPIP: Support Spark

[jira] [Updated] (SPARK-29059) [SPIP] Support for Hive Materialized Views in Spark SQL.

[ https://issues.apache.org/jira/browse/SPARK-29059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29059: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [SPIP] Support for Hive

[jira] [Resolved] (SPARK-29059) [SPIP] Support for Hive Materialized Views in Spark SQL.

[ https://issues.apache.org/jira/browse/SPARK-29059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29059. --- Resolution: Later This is closed due to inactivity. Please feel free to reopen this after

[jira] [Comment Edited] (SPARK-29278) Implement CATALOG/NAMESPACE related SQL commands for Data Source V2

[ https://issues.apache.org/jira/browse/SPARK-29278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060722#comment-17060722 ] Dongjoon Hyun edited comment on SPARK-29278 at 3/17/20, 8:46 AM: - Hi,

[jira] [Updated] (SPARK-29185) Add new SaveMode types for Spark SQL jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-29185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29185: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add new SaveMode types for

  1   2   >