[jira] [Created] (SPARK-40723) Add .asf.yaml to apache/spark-docker

2022-10-10 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40723: --- Summary: Add .asf.yaml to apache/spark-docker Key: SPARK-40723 URL: https://issues.apache.org/jira/browse/SPARK-40723 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40724) Simplify `corr` with method `inline`

2022-10-10 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40724: - Summary: Simplify `corr` with method `inline` Key: SPARK-40724 URL: https://issues.apache.org/jira/browse/SPARK-40724 Project: Spark Issue Type: Improvemen

[jira] [Assigned] (SPARK-40515) Add apache/spark-docker repo

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40515: --- Assignee: Matei Alexandru Zaharia > Add apache/spark-docker repo >

[jira] [Resolved] (SPARK-40515) Add apache/spark-docker repo

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40515. - Fix Version/s: 3.4.0 Resolution: Fixed Repo created: https://github.com/apache/spark-dock

[jira] [Assigned] (SPARK-40724) Simplify `corr` with method `inline`

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40724: Assignee: Apache Spark > Simplify `corr` with method `inline` > -

[jira] [Assigned] (SPARK-40724) Simplify `corr` with method `inline`

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40724: Assignee: (was: Apache Spark) > Simplify `corr` with method `inline` > --

[jira] [Commented] (SPARK-40724) Simplify `corr` with method `inline`

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614923#comment-17614923 ] Apache Spark commented on SPARK-40724: -- User 'zhengruifeng' has created a pull requ

[jira] [Updated] (SPARK-40723) Add .asf.yaml to apache/spark-docker

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-40723: Description: We will initial the repo with .asf.yaml as first commit {code:yaml} # Licensed to t

[jira] [Commented] (SPARK-40724) Simplify `corr` with method `inline`

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614922#comment-17614922 ] Apache Spark commented on SPARK-40724: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-40723) Add .asf.yaml to apache/spark-docker

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614924#comment-17614924 ] Yikun Jiang commented on SPARK-40723: - I will push the first commit with .asf.yaml t

[jira] [Comment Edited] (SPARK-40723) Add .asf.yaml to apache/spark-docker

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614924#comment-17614924 ] Yikun Jiang edited comment on SPARK-40723 at 10/10/22 7:07 AM: ---

[jira] [Comment Edited] (SPARK-40723) Add .asf.yaml to apache/spark-docker

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614924#comment-17614924 ] Yikun Jiang edited comment on SPARK-40723 at 10/10/22 7:08 AM: ---

[jira] [Comment Edited] (SPARK-40723) Add .asf.yaml to apache/spark-docker

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614924#comment-17614924 ] Yikun Jiang edited comment on SPARK-40723 at 10/10/22 7:10 AM: ---

[jira] [Commented] (SPARK-40723) Add .asf.yaml to apache/spark-docker

2022-10-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614931#comment-17614931 ] Hyukjin Kwon commented on SPARK-40723: -- Sure, please go ahead. > Add .asf.yaml to

[jira] [Commented] (SPARK-40718) Replace shaded netty with grpc netty to avoid double shaded dependency.

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614937#comment-17614937 ] Apache Spark commented on SPARK-40718: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-40718) Replace shaded netty with grpc netty to avoid double shaded dependency.

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614939#comment-17614939 ] Apache Spark commented on SPARK-40718: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40725: - Summary: Add mypy-protobuf to requirements Key: SPARK-40725 URL: https://issues.apache.org/jira/browse/SPARK-40725 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-40725: -- Component/s: Project Infra (was: Build) > Add mypy-protobuf to requiremen

[jira] [Commented] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614948#comment-17614948 ] Apache Spark commented on SPARK-40725: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40725: Assignee: (was: Apache Spark) > Add mypy-protobuf to requirements > -

[jira] [Assigned] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40725: Assignee: Apache Spark > Add mypy-protobuf to requirements >

[jira] [Commented] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614949#comment-17614949 ] Apache Spark commented on SPARK-40725: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-40665) Avoid embedding Spark Connect in the Apache Spark binary release

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614953#comment-17614953 ] Apache Spark commented on SPARK-40665: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-40723) Add .asf.yaml to apache/spark-docker

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614972#comment-17614972 ] Yikun Jiang commented on SPARK-40723: - https://github.com/apache/spark-docker/commit

[jira] [Resolved] (SPARK-40723) Add .asf.yaml to apache/spark-docker

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40723. - Resolution: Fixed > Add .asf.yaml to apache/spark-docker >

[jira] [Created] (SPARK-40726) Supplement undocumented orc configurations in documentation

2022-10-10 Thread Qian Sun (Jira)
Qian Sun created SPARK-40726: Summary: Supplement undocumented orc configurations in documentation Key: SPARK-40726 URL: https://issues.apache.org/jira/browse/SPARK-40726 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-40724) Simplify `corr` with method `inline`

2022-10-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40724. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38184 [https://

[jira] [Assigned] (SPARK-40724) Simplify `corr` with method `inline`

2022-10-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40724: - Assignee: Ruifeng Zheng > Simplify `corr` with method `inline` > --

[jira] [Resolved] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40725. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38186 [https://gith

[jira] [Assigned] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40725: --- Assignee: Ruifeng Zheng > Add mypy-protobuf to requirements > -

[jira] [Commented] (SPARK-40726) Supplement undocumented orc configurations in documentation

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615003#comment-17615003 ] Apache Spark commented on SPARK-40726: -- User 'dcoliversun' has created a pull reque

[jira] [Assigned] (SPARK-40726) Supplement undocumented orc configurations in documentation

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40726: Assignee: Apache Spark > Supplement undocumented orc configurations in documentation > --

[jira] [Assigned] (SPARK-40726) Supplement undocumented orc configurations in documentation

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40726: Assignee: (was: Apache Spark) > Supplement undocumented orc configurations in documen

[jira] [Created] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40727: --- Summary: Add merge_spark_docker_pr.py to help merge commit Key: SPARK-40727 URL: https://issues.apache.org/jira/browse/SPARK-40727 Project: Spark Issue Type: S

[jira] [Created] (SPARK-40728) Upgrade ASM to 9.4

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40728: Summary: Upgrade ASM to 9.4 Key: SPARK-40728 URL: https://issues.apache.org/jira/browse/SPARK-40728 Project: Spark Issue Type: Improvement Components: Buil

[jira] [Commented] (SPARK-40728) Upgrade ASM to 9.4

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615076#comment-17615076 ] Apache Spark commented on SPARK-40728: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-40728) Upgrade ASM to 9.4

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40728: Assignee: (was: Apache Spark) > Upgrade ASM to 9.4 > -- > >

[jira] [Assigned] (SPARK-40728) Upgrade ASM to 9.4

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40728: Assignee: Apache Spark > Upgrade ASM to 9.4 > -- > > Key:

[jira] [Created] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40729: Summary: Spark-shell run failed with Java 19 Key: SPARK-40729 URL: https://issues.apache.org/jira/browse/SPARK-40729 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40727. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 1 [https://github.c

[jira] [Updated] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-40727: Fix Version/s: (was: 3.4.0) > Add merge_spark_docker_pr.py to help merge commit >

[jira] [Reopened] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reopened SPARK-40727: - > Add merge_spark_docker_pr.py to help merge commit > --

[jira] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727 ] Yikun Jiang deleted comment on SPARK-40727: - was (Author: yikunkero): Issue resolved by pull request 1 [https://github.com/apache/spark-docker/pull/1] > Add merge_spark_docker_pr.py to help

[jira] [Resolved] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40727. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 1 [https://github.c

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

2022-10-10 Thread icyjhl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615087#comment-17615087 ] icyjhl commented on SPARK-36681: Hi [~viirya], So this is only fixed in 3.3.0 and after?

[jira] [Assigned] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40729: Assignee: (was: Apache Spark) > Spark-shell run failed with Java 19 > ---

[jira] [Assigned] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40729: Assignee: Apache Spark > Spark-shell run failed with Java 19 > --

[jira] [Commented] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615093#comment-17615093 ] Apache Spark commented on SPARK-40729: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-40730) Java 19 related issues

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40730: Summary: Java 19 related issues Key: SPARK-40730 URL: https://issues.apache.org/jira/browse/SPARK-40730 Project: Spark Issue Type: Umbrella Components: Spa

[jira] [Updated] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40729: - Parent: SPARK-40730 Issue Type: Sub-task (was: Improvement) > Spark-shell run failed with Java

[jira] [Updated] (SPARK-40730) Java 19 related issues

2022-10-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40730: - Description: I run maven test with Java 19, there are some test failed,  whether it can be solved or no

[jira] [Created] (SPARK-40731) Sealed class cannot be mock by mockito

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40731: Summary: Sealed class cannot be mock by mockito Key: SPARK-40731 URL: https://issues.apache.org/jira/browse/SPARK-40731 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40732) Floating point precision changes

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40732: Summary: Floating point precision changes Key: SPARK-40732 URL: https://issues.apache.org/jira/browse/SPARK-40732 Project: Spark Issue Type: Sub-task Compo

[jira] [Created] (SPARK-40733) ShowCreateTableSuite test failed

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40733: Summary: ShowCreateTableSuite test failed Key: SPARK-40733 URL: https://issues.apache.org/jira/browse/SPARK-40733 Project: Spark Issue Type: Sub-task Compo

[jira] [Created] (SPARK-40734) KafkaMicroBatchSourceSuite failed

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40734: Summary: KafkaMicroBatchSourceSuite failed Key: SPARK-40734 URL: https://issues.apache.org/jira/browse/SPARK-40734 Project: Spark Issue Type: Sub-task Comp

[jira] [Assigned] (SPARK-40726) Supplement undocumented orc configurations in documentation

2022-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40726: Assignee: Qian Sun > Supplement undocumented orc configurations in documentation > --

[jira] [Resolved] (SPARK-40726) Supplement undocumented orc configurations in documentation

2022-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40726. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38188 [https://gi

[jira] [Assigned] (SPARK-40705) Issue with spark converting Row to Json using Scala 2.13

2022-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40705: Assignee: Amrane Ait Zeouay > Issue with spark converting Row to Json using Scala 2.13 >

[jira] [Resolved] (SPARK-40705) Issue with spark converting Row to Json using Scala 2.13

2022-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40705. -- Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread xiaoping.huang (Jira)
xiaoping.huang created SPARK-40735: -- Summary: Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable Key: SPARK-40735 URL: https://issues.apache.org/jira/browse/SPARK-40735

[jira] [Commented] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615190#comment-17615190 ] Apache Spark commented on SPARK-40735: -- User 'huangxiaopingRD' has created a pull r

[jira] [Assigned] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40735: Assignee: (was: Apache Spark) > Consistently invoke bash with /usr/bin/env bash in sc

[jira] [Assigned] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40735: Assignee: Apache Spark > Consistently invoke bash with /usr/bin/env bash in scripts to ma

[jira] [Updated] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread xiaoping.huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaoping.huang updated SPARK-40735: --- Component/s: Connect Kubernetes R Spark Co

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

2022-10-10 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615201#comment-17615201 ] L. C. Hsieh commented on SPARK-36681: - This is fixed in 3.3.0 and later, yes, by upg

[jira] [Resolved] (SPARK-40714) Remove PartitionAlreadyExistsException

2022-10-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40714. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38161 [https://github.com

[jira] [Comment Edited] (SPARK-40706) IllegalStateException when querying array values inside a nested struct

2022-10-10 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614550#comment-17614550 ] Bruce Robbins edited comment on SPARK-40706 at 10/10/22 5:01 PM: -

[jira] [Created] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-10 Thread Pratik Malani (Jira)
Pratik Malani created SPARK-40736: - Summary: Spark 3.3.0 doesn't works with Hive 3.1.2 Key: SPARK-40736 URL: https://issues.apache.org/jira/browse/SPARK-40736 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-10 Thread Pratik Malani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratik Malani updated SPARK-40736: -- Description: Hive 2.3.9 is impacted with CVE-2021-34538, so trying to use the Hive 3.1.2. Usi

[jira] [Updated] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-10 Thread Pratik Malani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratik Malani updated SPARK-40736: -- Labels: Hive spark spark3.0 (was: ) > Spark 3.3.0 doesn't works with Hive 3.1.2 > ---

[jira] [Updated] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-10 Thread Pratik Malani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratik Malani updated SPARK-40736: -- Fix Version/s: 3.3.1 > Spark 3.3.0 doesn't works with Hive 3.1.2 > ---

[jira] [Created] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Martin Grund (Jira)
Martin Grund created SPARK-40737: Summary: Add basic support for DataFrameWriter Key: SPARK-40737 URL: https://issues.apache.org/jira/browse/SPARK-40737 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40737: Assignee: (was: Apache Spark) > Add basic support for DataFrameWriter > -

[jira] [Assigned] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40737: Assignee: Apache Spark > Add basic support for DataFrameWriter >

[jira] [Commented] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615251#comment-17615251 ] Apache Spark commented on SPARK-40737: -- User 'grundprinzip' has created a pull requ

[jira] [Assigned] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40737: Assignee: Apache Spark > Add basic support for DataFrameWriter >

[jira] [Commented] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615255#comment-17615255 ] Chao Sun commented on SPARK-40703: -- Thanks [~bryanck] . Now I see where the issue is.

[jira] [Commented] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Bryan Keller (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615264#comment-17615264 ] Bryan Keller commented on SPARK-40703: -- Sounds good, thanks. > Performance regress

[jira] [Created] (SPARK-40738) spark-shell fails with "bad array subscript" in cygwin or msys bash session

2022-10-10 Thread Phil Walker (Jira)
Phil Walker created SPARK-40738: --- Summary: spark-shell fails with "bad array subscript" in cygwin or msys bash session Key: SPARK-40738 URL: https://issues.apache.org/jira/browse/SPARK-40738 Project: Sp

[jira] [Created] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-10 Thread Phil Walker (Jira)
Phil Walker created SPARK-40739: --- Summary: "sbt packageBin" fails in cygwin or other windows bash session Key: SPARK-40739 URL: https://issues.apache.org/jira/browse/SPARK-40739 Project: Spark

[jira] [Resolved] (SPARK-39199) Implement pandas API missing parameters

2022-10-10 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-39199. -- Resolution: Resolved > Implement pandas API missing parameters > -

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615357#comment-17615357 ] Apache Spark commented on SPARK-39375: -- User 'amaliujia' has created a pull request

[jira] [Assigned] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39375: Assignee: (was: Apache Spark) > SPIP: Spark Connect - A client and server interface f

[jira] [Assigned] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39375: Assignee: Apache Spark > SPIP: Spark Connect - A client and server interface for Apache S

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615358#comment-17615358 ] Apache Spark commented on SPARK-39375: -- User 'amaliujia' has created a pull request

[jira] [Commented] (SPARK-37945) Use error classes in the execution errors of arithmetic ops

2022-10-10 Thread Khalid Mammadov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615361#comment-17615361 ] Khalid Mammadov commented on SPARK-37945: - [~maxgekk] I see you have already fix

[jira] [Created] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Allison Wang (Jira)
Allison Wang created SPARK-40740: Summary: Improve listFunctions in SessionCatalog Key: SPARK-40740 URL: https://issues.apache.org/jira/browse/SPARK-40740 Project: Spark Issue Type: Improveme

[jira] [Assigned] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40740: Assignee: Apache Spark > Improve listFunctions in SessionCatalog > --

[jira] [Assigned] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40740: Assignee: (was: Apache Spark) > Improve listFunctions in SessionCatalog > ---

[jira] [Commented] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615369#comment-17615369 ] Apache Spark commented on SPARK-40740: -- User 'allisonwang-db' has created a pull re

[jira] [Commented] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615370#comment-17615370 ] Apache Spark commented on SPARK-40740: -- User 'allisonwang-db' has created a pull re

[jira] [Commented] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615372#comment-17615372 ] Apache Spark commented on SPARK-40725: -- User 'amaliujia' has created a pull request

[jira] [Commented] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615373#comment-17615373 ] Apache Spark commented on SPARK-40725: -- User 'amaliujia' has created a pull request

[jira] [Commented] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615379#comment-17615379 ] Apache Spark commented on SPARK-40703: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40703: Assignee: Apache Spark > Performance regression for joins in Spark 3.3 vs Spark 3.2 > ---

[jira] [Assigned] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40703: Assignee: (was: Apache Spark) > Performance regression for joins in Spark 3.3 vs Spar

[jira] [Resolved] (SPARK-40534) Extend support for Join Relation

2022-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40534. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38157 [https://gith

[jira] [Assigned] (SPARK-40534) Extend support for Join Relation

2022-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40534: --- Assignee: Rui Wang > Extend support for Join Relation > >

[jira] [Resolved] (SPARK-40596) Populate ExecutorDecommission with more informative messages

2022-10-10 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-40596. -- Assignee: Bo Zhang Resolution: Fixed Issue resolved by https://github.com/apache/spark/pull/38030 > Pop

[jira] [Assigned] (SPARK-40358) Migrate collection type check failures onto error classes

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40358: Assignee: Apache Spark > Migrate collection type check failures onto error classes >

  1   2   >