[jira] [Assigned] (SPARK-40667) Refactor File Data Source Options

2022-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40667: --- Assignee: Xiaonan Yang > Refactor File Data Source Options > --

[jira] [Resolved] (SPARK-40667) Refactor File Data Source Options

2022-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40667. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38113 [https://gith

[jira] [Resolved] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40740. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38194 [https://gi

[jira] [Assigned] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40740: Assignee: Allison Wang > Improve listFunctions in SessionCatalog > --

[jira] [Assigned] (SPARK-40744) Make `_reduce_for_stat_function` in `groupby` accept `min_count`

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40744: Assignee: (was: Apache Spark) > Make `_reduce_for_stat_function` in `groupby` accept

[jira] [Commented] (SPARK-40744) Make `_reduce_for_stat_function` in `groupby` accept `min_count`

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615495#comment-17615495 ] Apache Spark commented on SPARK-40744: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-40744) Make `_reduce_for_stat_function` in `groupby` accept `min_count`

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615492#comment-17615492 ] Apache Spark commented on SPARK-40744: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-40744) Make `_reduce_for_stat_function` in `groupby` accept `min_count`

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40744: Assignee: Apache Spark > Make `_reduce_for_stat_function` in `groupby` accept `min_count`

[jira] [Commented] (SPARK-40743) StructType should contain a list of StructField and each field should have a name

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615490#comment-17615490 ] Apache Spark commented on SPARK-40743: -- User 'amaliujia' has created a pull request

[jira] [Assigned] (SPARK-40743) StructType should contain a list of StructField and each field should have a name

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40743: Assignee: (was: Apache Spark) > StructType should contain a list of StructField and e

[jira] [Assigned] (SPARK-40743) StructType should contain a list of StructField and each field should have a name

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40743: Assignee: Apache Spark > StructType should contain a list of StructField and each field s

[jira] [Created] (SPARK-40744) Make `_reduce_for_stat_function` in `groupby` accept `min_count`

2022-10-10 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40744: - Summary: Make `_reduce_for_stat_function` in `groupby` accept `min_count` Key: SPARK-40744 URL: https://issues.apache.org/jira/browse/SPARK-40744 Project: Spark

[jira] [Created] (SPARK-40743) StructType should contain a list of StructField and each field should have a name

2022-10-10 Thread Rui Wang (Jira)
Rui Wang created SPARK-40743: Summary: StructType should contain a list of StructField and each field should have a name Key: SPARK-40743 URL: https://issues.apache.org/jira/browse/SPARK-40743 Project: Sp

[jira] [Assigned] (SPARK-40358) Migrate collection type check failures onto error classes

2022-10-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40358: Assignee: Shaokang Lv > Migrate collection type check failures onto error classes > -

[jira] [Resolved] (SPARK-40358) Migrate collection type check failures onto error classes

2022-10-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40358. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38197 [https://github.com

[jira] [Commented] (SPARK-37945) Use error classes in the execution errors of arithmetic ops

2022-10-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615459#comment-17615459 ] Max Gekk commented on SPARK-37945: -- [~khalidmammad...@gmail.com] Sure, go ahead. > Use

[jira] [Assigned] (SPARK-40707) Add groupby to connect DSL and test more than one grouping expressions

2022-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40707: --- Assignee: Rui Wang > Add groupby to connect DSL and test more than one grouping expressions

[jira] [Resolved] (SPARK-40707) Add groupby to connect DSL and test more than one grouping expressions

2022-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40707. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38155 [https://gith

[jira] [Commented] (SPARK-40722) How to set BlockManager info of hostname as ipaddress

2022-10-10 Thread Chen Xia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615450#comment-17615450 ] Chen Xia commented on SPARK-40722: -- I know it can be used spark.driver.host  to set thi

[jira] [Commented] (SPARK-40658) Protobuf v2 & v3 support

2022-10-10 Thread Mohan Parthasarathy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615440#comment-17615440 ] Mohan Parthasarathy commented on SPARK-40658: - [~sanysand...@gmail.com]  #

[jira] [Commented] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615437#comment-17615437 ] Apache Spark commented on SPARK-40739: -- User 'philwalk' has created a pull request

[jira] [Assigned] (SPARK-40738) spark-shell fails with "bad array subscript" in cygwin or msys bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40738: Assignee: (was: Apache Spark) > spark-shell fails with "bad array subscript" in cygwi

[jira] [Assigned] (SPARK-40738) spark-shell fails with "bad array subscript" in cygwin or msys bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40738: Assignee: Apache Spark > spark-shell fails with "bad array subscript" in cygwin or msys b

[jira] [Commented] (SPARK-40738) spark-shell fails with "bad array subscript" in cygwin or msys bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615439#comment-17615439 ] Apache Spark commented on SPARK-40738: -- User 'philwalk' has created a pull request

[jira] [Commented] (SPARK-40738) spark-shell fails with "bad array subscript" in cygwin or msys bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615438#comment-17615438 ] Apache Spark commented on SPARK-40738: -- User 'philwalk' has created a pull request

[jira] [Assigned] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40739: Assignee: (was: Apache Spark) > "sbt packageBin" fails in cygwin or other windows bas

[jira] [Assigned] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40739: Assignee: Apache Spark > "sbt packageBin" fails in cygwin or other windows bash session >

[jira] [Commented] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615436#comment-17615436 ] Apache Spark commented on SPARK-40739: -- User 'philwalk' has created a pull request

[jira] [Commented] (SPARK-40742) Java compilation warnings related to generic type

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615430#comment-17615430 ] Apache Spark commented on SPARK-40742: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-40742) Java compilation warnings related to generic type

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40742: Assignee: (was: Apache Spark) > Java compilation warnings related to generic type > -

[jira] [Commented] (SPARK-40742) Java compilation warnings related to generic type

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615428#comment-17615428 ] Apache Spark commented on SPARK-40742: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-40742) Java compilation warnings related to generic type

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40742: Assignee: Apache Spark > Java compilation warnings related to generic type >

[jira] [Created] (SPARK-40742) Java compilation warnings related to generic type

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40742: Summary: Java compilation warnings related to generic type Key: SPARK-40742 URL: https://issues.apache.org/jira/browse/SPARK-40742 Project: Spark Issue Type: Improve

[jira] [Resolved] (SPARK-40516) Add official image dockerfile for Spark v3.3.0

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40516. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 2 [https://github.c

[jira] [Assigned] (SPARK-40516) Add official image dockerfile for Spark v3.3.0

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40516: --- Assignee: Yikun Jiang > Add official image dockerfile for Spark v3.3.0 > --

[jira] [Resolved] (SPARK-40698) Improve the precision of `product` for intergral inputs

2022-10-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40698. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38148 [https://gi

[jira] [Assigned] (SPARK-40698) Improve the precision of `product` for intergral inputs

2022-10-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40698: Assignee: Ruifeng Zheng > Improve the precision of `product` for intergral inputs > -

[jira] [Created] (SPARK-40741) spark项目bin/beeline对于distribute by sort by语句支持不好,输出结果错误

2022-10-10 Thread kaiqingli (Jira)
kaiqingli created SPARK-40741: - Summary: spark项目bin/beeline对于distribute by sort by语句支持不好,输出结果错误 Key: SPARK-40741 URL: https://issues.apache.org/jira/browse/SPARK-40741 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40358) Migrate collection type check failures onto error classes

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40358: Assignee: (was: Apache Spark) > Migrate collection type check failures onto error cla

[jira] [Commented] (SPARK-40358) Migrate collection type check failures onto error classes

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615412#comment-17615412 ] Apache Spark commented on SPARK-40358: -- User 'lvshaokang' has created a pull reques

[jira] [Assigned] (SPARK-40358) Migrate collection type check failures onto error classes

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40358: Assignee: Apache Spark > Migrate collection type check failures onto error classes >

[jira] [Resolved] (SPARK-40596) Populate ExecutorDecommission with more informative messages

2022-10-10 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-40596. -- Assignee: Bo Zhang Resolution: Fixed Issue resolved by https://github.com/apache/spark/pull/38030 > Pop

[jira] [Assigned] (SPARK-40534) Extend support for Join Relation

2022-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40534: --- Assignee: Rui Wang > Extend support for Join Relation > >

[jira] [Resolved] (SPARK-40534) Extend support for Join Relation

2022-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40534. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38157 [https://gith

[jira] [Assigned] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40703: Assignee: (was: Apache Spark) > Performance regression for joins in Spark 3.3 vs Spar

[jira] [Assigned] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40703: Assignee: Apache Spark > Performance regression for joins in Spark 3.3 vs Spark 3.2 > ---

[jira] [Commented] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615379#comment-17615379 ] Apache Spark commented on SPARK-40703: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615373#comment-17615373 ] Apache Spark commented on SPARK-40725: -- User 'amaliujia' has created a pull request

[jira] [Commented] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615372#comment-17615372 ] Apache Spark commented on SPARK-40725: -- User 'amaliujia' has created a pull request

[jira] [Commented] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615370#comment-17615370 ] Apache Spark commented on SPARK-40740: -- User 'allisonwang-db' has created a pull re

[jira] [Commented] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615369#comment-17615369 ] Apache Spark commented on SPARK-40740: -- User 'allisonwang-db' has created a pull re

[jira] [Assigned] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40740: Assignee: (was: Apache Spark) > Improve listFunctions in SessionCatalog > ---

[jira] [Assigned] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40740: Assignee: Apache Spark > Improve listFunctions in SessionCatalog > --

[jira] [Created] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Allison Wang (Jira)
Allison Wang created SPARK-40740: Summary: Improve listFunctions in SessionCatalog Key: SPARK-40740 URL: https://issues.apache.org/jira/browse/SPARK-40740 Project: Spark Issue Type: Improveme

[jira] [Commented] (SPARK-37945) Use error classes in the execution errors of arithmetic ops

2022-10-10 Thread Khalid Mammadov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615361#comment-17615361 ] Khalid Mammadov commented on SPARK-37945: - [~maxgekk] I see you have already fix

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615358#comment-17615358 ] Apache Spark commented on SPARK-39375: -- User 'amaliujia' has created a pull request

[jira] [Assigned] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39375: Assignee: Apache Spark > SPIP: Spark Connect - A client and server interface for Apache S

[jira] [Assigned] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39375: Assignee: (was: Apache Spark) > SPIP: Spark Connect - A client and server interface f

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615357#comment-17615357 ] Apache Spark commented on SPARK-39375: -- User 'amaliujia' has created a pull request

[jira] [Resolved] (SPARK-39199) Implement pandas API missing parameters

2022-10-10 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-39199. -- Resolution: Resolved > Implement pandas API missing parameters > -

[jira] [Created] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-10 Thread Phil Walker (Jira)
Phil Walker created SPARK-40739: --- Summary: "sbt packageBin" fails in cygwin or other windows bash session Key: SPARK-40739 URL: https://issues.apache.org/jira/browse/SPARK-40739 Project: Spark

[jira] [Created] (SPARK-40738) spark-shell fails with "bad array subscript" in cygwin or msys bash session

2022-10-10 Thread Phil Walker (Jira)
Phil Walker created SPARK-40738: --- Summary: spark-shell fails with "bad array subscript" in cygwin or msys bash session Key: SPARK-40738 URL: https://issues.apache.org/jira/browse/SPARK-40738 Project: Sp

[jira] [Commented] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Bryan Keller (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615264#comment-17615264 ] Bryan Keller commented on SPARK-40703: -- Sounds good, thanks. > Performance regress

[jira] [Commented] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615255#comment-17615255 ] Chao Sun commented on SPARK-40703: -- Thanks [~bryanck] . Now I see where the issue is.

[jira] [Assigned] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40737: Assignee: Apache Spark > Add basic support for DataFrameWriter >

[jira] [Commented] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615251#comment-17615251 ] Apache Spark commented on SPARK-40737: -- User 'grundprinzip' has created a pull requ

[jira] [Assigned] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40737: Assignee: Apache Spark > Add basic support for DataFrameWriter >

[jira] [Assigned] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40737: Assignee: (was: Apache Spark) > Add basic support for DataFrameWriter > -

[jira] [Created] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Martin Grund (Jira)
Martin Grund created SPARK-40737: Summary: Add basic support for DataFrameWriter Key: SPARK-40737 URL: https://issues.apache.org/jira/browse/SPARK-40737 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-10 Thread Pratik Malani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratik Malani updated SPARK-40736: -- Fix Version/s: 3.3.1 > Spark 3.3.0 doesn't works with Hive 3.1.2 > ---

[jira] [Updated] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-10 Thread Pratik Malani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratik Malani updated SPARK-40736: -- Labels: Hive spark spark3.0 (was: ) > Spark 3.3.0 doesn't works with Hive 3.1.2 > ---

[jira] [Updated] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-10 Thread Pratik Malani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratik Malani updated SPARK-40736: -- Description: Hive 2.3.9 is impacted with CVE-2021-34538, so trying to use the Hive 3.1.2. Usi

[jira] [Created] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-10 Thread Pratik Malani (Jira)
Pratik Malani created SPARK-40736: - Summary: Spark 3.3.0 doesn't works with Hive 3.1.2 Key: SPARK-40736 URL: https://issues.apache.org/jira/browse/SPARK-40736 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-40706) IllegalStateException when querying array values inside a nested struct

2022-10-10 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17614550#comment-17614550 ] Bruce Robbins edited comment on SPARK-40706 at 10/10/22 5:01 PM: -

[jira] [Resolved] (SPARK-40714) Remove PartitionAlreadyExistsException

2022-10-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40714. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38161 [https://github.com

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

2022-10-10 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615201#comment-17615201 ] L. C. Hsieh commented on SPARK-36681: - This is fixed in 3.3.0 and later, yes, by upg

[jira] [Updated] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread xiaoping.huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaoping.huang updated SPARK-40735: --- Component/s: Connect Kubernetes R Spark Co

[jira] [Assigned] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40735: Assignee: Apache Spark > Consistently invoke bash with /usr/bin/env bash in scripts to ma

[jira] [Assigned] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40735: Assignee: (was: Apache Spark) > Consistently invoke bash with /usr/bin/env bash in sc

[jira] [Commented] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615190#comment-17615190 ] Apache Spark commented on SPARK-40735: -- User 'huangxiaopingRD' has created a pull r

[jira] [Created] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread xiaoping.huang (Jira)
xiaoping.huang created SPARK-40735: -- Summary: Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable Key: SPARK-40735 URL: https://issues.apache.org/jira/browse/SPARK-40735

[jira] [Resolved] (SPARK-40705) Issue with spark converting Row to Json using Scala 2.13

2022-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40705. -- Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-40705) Issue with spark converting Row to Json using Scala 2.13

2022-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40705: Assignee: Amrane Ait Zeouay > Issue with spark converting Row to Json using Scala 2.13 >

[jira] [Resolved] (SPARK-40726) Supplement undocumented orc configurations in documentation

2022-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40726. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38188 [https://gi

[jira] [Assigned] (SPARK-40726) Supplement undocumented orc configurations in documentation

2022-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40726: Assignee: Qian Sun > Supplement undocumented orc configurations in documentation > --

[jira] [Created] (SPARK-40734) KafkaMicroBatchSourceSuite failed

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40734: Summary: KafkaMicroBatchSourceSuite failed Key: SPARK-40734 URL: https://issues.apache.org/jira/browse/SPARK-40734 Project: Spark Issue Type: Sub-task Comp

[jira] [Created] (SPARK-40733) ShowCreateTableSuite test failed

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40733: Summary: ShowCreateTableSuite test failed Key: SPARK-40733 URL: https://issues.apache.org/jira/browse/SPARK-40733 Project: Spark Issue Type: Sub-task Compo

[jira] [Created] (SPARK-40732) Floating point precision changes

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40732: Summary: Floating point precision changes Key: SPARK-40732 URL: https://issues.apache.org/jira/browse/SPARK-40732 Project: Spark Issue Type: Sub-task Compo

[jira] [Created] (SPARK-40731) Sealed class cannot be mock by mockito

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40731: Summary: Sealed class cannot be mock by mockito Key: SPARK-40731 URL: https://issues.apache.org/jira/browse/SPARK-40731 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40730) Java 19 related issues

2022-10-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40730: - Description: I run maven test with Java 19, there are some test failed,  whether it can be solved or no

[jira] [Updated] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40729: - Parent: SPARK-40730 Issue Type: Sub-task (was: Improvement) > Spark-shell run failed with Java

[jira] [Created] (SPARK-40730) Java 19 related issues

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40730: Summary: Java 19 related issues Key: SPARK-40730 URL: https://issues.apache.org/jira/browse/SPARK-40730 Project: Spark Issue Type: Umbrella Components: Spa

[jira] [Commented] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615093#comment-17615093 ] Apache Spark commented on SPARK-40729: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40729: Assignee: Apache Spark > Spark-shell run failed with Java 19 > --

[jira] [Assigned] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40729: Assignee: (was: Apache Spark) > Spark-shell run failed with Java 19 > ---

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

2022-10-10 Thread icyjhl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17615087#comment-17615087 ] icyjhl commented on SPARK-36681: Hi [~viirya], So this is only fixed in 3.3.0 and after?

[jira] [Resolved] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40727. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 1 [https://github.c

[jira] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727 ] Yikun Jiang deleted comment on SPARK-40727: - was (Author: yikunkero): Issue resolved by pull request 1 [https://github.com/apache/spark-docker/pull/1] > Add merge_spark_docker_pr.py to help

[jira] [Updated] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-40727: Fix Version/s: (was: 3.4.0) > Add merge_spark_docker_pr.py to help merge commit >

[jira] [Reopened] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reopened SPARK-40727: - > Add merge_spark_docker_pr.py to help merge commit > --

  1   2   >