[jira] [Updated] (SPARK-31188) Spark shell version miss match

[ https://issues.apache.org/jira/browse/SPARK-31188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timmanna Channal updated SPARK-31188: - Description: Hi Team, I downloaded the spark3.x latest tar ball from the spark website.

[jira] [Updated] (SPARK-31188) Spark shell version miss match

[ https://issues.apache.org/jira/browse/SPARK-31188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timmanna Channal updated SPARK-31188: - Description: Hi Team, I downloaded the spark3.x latest tar ball from the spark website.

[jira] [Created] (SPARK-31188) Spark shell version miss match

Timmanna Channal created SPARK-31188: Summary: Spark shell version miss match Key: SPARK-31188 URL: https://issues.apache.org/jira/browse/SPARK-31188 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-31188) Spark shell version miss match

[ https://issues.apache.org/jira/browse/SPARK-31188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timmanna Channal updated SPARK-31188: - Attachment: screenshot-1.png > Spark shell version miss match >

[jira] [Resolved] (SPARK-31159) Incompatible Parquet dates/timestamps with Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-31159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31159. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27915 [https://gith

[jira] [Assigned] (SPARK-31159) Incompatible Parquet dates/timestamps with Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-31159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31159: --- Assignee: Maxim Gekk > Incompatible Parquet dates/timestamps with Spark 2.4 > -

[jira] [Created] (SPARK-31187) Sort the whole-stage codegen debug output by codegenStageId

Kris Mok created SPARK-31187: Summary: Sort the whole-stage codegen debug output by codegenStageId Key: SPARK-31187 URL: https://issues.apache.org/jira/browse/SPARK-31187 Project: Spark Issue Ty

[jira] [Created] (SPARK-31186) toPandas fails on simple query (collect() works)

Michael Chirico created SPARK-31186: --- Summary: toPandas fails on simple query (collect() works) Key: SPARK-31186 URL: https://issues.apache.org/jira/browse/SPARK-31186 Project: Spark Issue

[jira] [Updated] (SPARK-31159) Incompatible Parquet dates/timestamps with Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-31159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31159: Parent: SPARK-30951 Issue Type: Sub-task (was: Bug) > Incompatible Parquet dates/timestam

[jira] [Updated] (SPARK-31183) Incompatible Avro dates/timestamps with Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-31183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31183: Parent: SPARK-30951 Issue Type: Sub-task (was: Bug) > Incompatible Avro dates/timestamps

[jira] [Updated] (SPARK-31076) Convert Catalyst's DATE/TIMESTAMP to Java Date/Timestamp via local date-time

[ https://issues.apache.org/jira/browse/SPARK-31076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31076: Parent: SPARK-30951 Issue Type: Sub-task (was: Improvement) > Convert Catalyst's DATE/TIM

[jira] [Commented] (SPARK-28626) Spark leaves unencrypted data on local disk, even with encryption turned on (CVE-2019-10099)

[ https://issues.apache.org/jira/browse/SPARK-28626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17062230#comment-17062230 ] Wing Yew Poon commented on SPARK-28626: --- For the record, to assist folks who need

[jira] [Commented] (SPARK-27941) Serverless Spark in the Cloud

[ https://issues.apache.org/jira/browse/SPARK-27941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17062198#comment-17062198 ] Dongjoon Hyun commented on SPARK-27941: --- Hi, [~mu5358271]. Is there any update on

[jira] [Resolved] (SPARK-31178) sql("INSERT INTO v2DataSource ...").collect() double inserts

[ https://issues.apache.org/jira/browse/SPARK-31178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-31178. - Fix Version/s: 3.0.0 Assignee: Burak Yavuz Resolution: Fixed Resolved by [https:

[jira] [Created] (SPARK-31185) implement VarianceThresholdSelector

Huaxin Gao created SPARK-31185: -- Summary: implement VarianceThresholdSelector Key: SPARK-31185 URL: https://issues.apache.org/jira/browse/SPARK-31185 Project: Spark Issue Type: Bug Com

[jira] [Resolved] (SPARK-30933) ML, GraphX 3.0 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-30933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30933. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27880 [https://gi

[jira] [Assigned] (SPARK-30933) ML, GraphX 3.0 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-30933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-30933: Assignee: Huaxin Gao (was: zhengruifeng) > ML, GraphX 3.0 QA: Update user guide for new

[jira] [Assigned] (SPARK-30933) ML, GraphX 3.0 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-30933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-30933: Assignee: zhengruifeng > ML, GraphX 3.0 QA: Update user guide for new features & APIs > -

[jira] [Created] (SPARK-31184) Support getTablesByType API of Hive Client

Xin Wu created SPARK-31184: -- Summary: Support getTablesByType API of Hive Client Key: SPARK-31184 URL: https://issues.apache.org/jira/browse/SPARK-31184 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061916#comment-17061916 ] Reynold Xin commented on SPARK-25728: - It's too big of a change and realistically sp

[jira] [Resolved] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-25728. - Resolution: Won't Fix > SPIP: Structured Intermediate Representation (Tungsten IR) for generatin

[jira] [Commented] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061914#comment-17061914 ] Kazuaki Ishizaki commented on SPARK-25728: -- For now, no update on my side. I a

[jira] [Commented] (SPARK-31183) Incompatible Avro dates/timestamps with Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-31183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061902#comment-17061902 ] Maxim Gekk commented on SPARK-31183: I am working on the issue. > Incompatible Avro

[jira] [Commented] (SPARK-31183) Incompatible Avro dates/timestamps with Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-31183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061903#comment-17061903 ] Maxim Gekk commented on SPARK-31183: [~cloud_fan] FYI > Incompatible Avro dates/tim

[jira] [Created] (SPARK-31183) Incompatible Avro dates/timestamps with Spark 2.4

Maxim Gekk created SPARK-31183: -- Summary: Incompatible Avro dates/timestamps with Spark 2.4 Key: SPARK-31183 URL: https://issues.apache.org/jira/browse/SPARK-31183 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-31175) Avoid creating reverse comparator for each compare in InterpretedOrdering

[ https://issues.apache.org/jira/browse/SPARK-31175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31175: --- Assignee: wuyi > Avoid creating reverse comparator for each compare in InterpretedOrdering

[jira] [Resolved] (SPARK-31175) Avoid creating reverse comparator for each compare in InterpretedOrdering

[ https://issues.apache.org/jira/browse/SPARK-31175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31175. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27938 [https://gith

[jira] [Resolved] (SPARK-30295) Remove Hive dependencies from SparkSQLCLI

[ https://issues.apache.org/jira/browse/SPARK-30295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30295. -- Resolution: Won't Fix > Remove Hive dependencies from SparkSQLCLI > --

[jira] [Updated] (SPARK-31165) Multiple wrong references in Dockerfile for k8s

[ https://issues.apache.org/jira/browse/SPARK-31165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikolay Dimolarov updated SPARK-31165: -- Description: I am currently trying to follow the k8s instructions for Spark:  [https:/

[jira] [Assigned] (SPARK-31176) Remove support for 'e'/'c' as datetime pattern charactar

[ https://issues.apache.org/jira/browse/SPARK-31176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31176: --- Assignee: Kent Yao > Remove support for 'e'/'c' as datetime pattern charactar > --

[jira] [Resolved] (SPARK-31176) Remove support for 'e'/'c' as datetime pattern charactar

[ https://issues.apache.org/jira/browse/SPARK-31176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31176. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27939 [https://gith

[jira] [Created] (SPARK-31182) PairRDD support aggregateByKeyWithinPartitions

zhengruifeng created SPARK-31182: Summary: PairRDD support aggregateByKeyWithinPartitions Key: SPARK-31182 URL: https://issues.apache.org/jira/browse/SPARK-31182 Project: Spark Issue Type: Im

[jira] [Created] (SPARK-31181) Remove the default value assumption on CREATE TABLE test cases

Dongjoon Hyun created SPARK-31181: - Summary: Remove the default value assumption on CREATE TABLE test cases Key: SPARK-31181 URL: https://issues.apache.org/jira/browse/SPARK-31181 Project: Spark

[jira] [Updated] (SPARK-31181) Remove the default value assumption on CREATE TABLE test cases

[ https://issues.apache.org/jira/browse/SPARK-31181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31181: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Remove the default value as

[jira] [Comment Edited] (SPARK-31136) Revert SPARK-30098 Use default datasource as provider for CREATE TABLE syntax

[ https://issues.apache.org/jira/browse/SPARK-31136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058333#comment-17058333 ] Jungtaek Lim edited comment on SPARK-31136 at 3/18/20, 8:14 AM: --

[jira] [Created] (SPARK-31180) Implement PowerTransform

zhengruifeng created SPARK-31180: Summary: Implement PowerTransform Key: SPARK-31180 URL: https://issues.apache.org/jira/browse/SPARK-31180 Project: Spark Issue Type: Improvement Co