Ruifeng Zheng created SPARK-40631:
-
Summary: Implement `min_count` in `GroupBy.first`
Key: SPARK-40631
URL: https://issues.apache.org/jira/browse/SPARK-40631
Project: Spark
Issue Type: Sub-ta
[
https://issues.apache.org/jira/browse/SPARK-40631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612040#comment-17612040
]
Apache Spark commented on SPARK-40631:
--
User 'zhengruifeng' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-40631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40631:
Assignee: (was: Apache Spark)
> Implement `min_count` in `GroupBy.first`
> --
[
https://issues.apache.org/jira/browse/SPARK-40631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40631:
Assignee: Apache Spark
> Implement `min_count` in `GroupBy.first`
> -
Yuming Wang created SPARK-40632:
---
Summary: Do not inject runtime filter if join condition reference
non simple expression
Key: SPARK-40632
URL: https://issues.apache.org/jira/browse/SPARK-40632
Project:
[
https://issues.apache.org/jira/browse/SPARK-40632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40632:
Assignee: Apache Spark
> Do not inject runtime filter if join condition reference non sim
[
https://issues.apache.org/jira/browse/SPARK-40632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612048#comment-17612048
]
Apache Spark commented on SPARK-40632:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-40632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40632:
Assignee: (was: Apache Spark)
> Do not inject runtime filter if join condition refere
[
https://issues.apache.org/jira/browse/SPARK-40632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612049#comment-17612049
]
Apache Spark commented on SPARK-40632:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-38496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612066#comment-17612066
]
Apache Spark commented on SPARK-38496:
--
User 'khalidmammadov' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-38496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38496:
Assignee: Apache Spark
> Improve the test coverage for pyspark/sql module
> -
[
https://issues.apache.org/jira/browse/SPARK-38496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38496:
Assignee: (was: Apache Spark)
> Improve the test coverage for pyspark/sql module
> --
Yang Jie created SPARK-40633:
Summary: Upgrade janino to 3.1.8
Key: SPARK-40633
URL: https://issues.apache.org/jira/browse/SPARK-40633
Project: Spark
Issue Type: Improvement
Components:
[
https://issues.apache.org/jira/browse/SPARK-40633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-40633:
-
Description: https://github.com/janino-compiler/janino/releases/tag/v3.1.8
> Upgrade janino to 3.1.8
> -
[
https://issues.apache.org/jira/browse/SPARK-40633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612093#comment-17612093
]
Apache Spark commented on SPARK-40633:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40633:
Assignee: Apache Spark
> Upgrade janino to 3.1.8
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-40633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40633:
Assignee: (was: Apache Spark)
> Upgrade janino to 3.1.8
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-40633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612094#comment-17612094
]
Apache Spark commented on SPARK-40633:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-40634:
-
Description: https://www.joda.org/joda-time/changes-report.html#a2.11.2
> Upgrade jodatime to 2.11.2
> -
Yang Jie created SPARK-40634:
Summary: Upgrade jodatime to 2.11.2
Key: SPARK-40634
URL: https://issues.apache.org/jira/browse/SPARK-40634
Project: Spark
Issue Type: Improvement
Componen
[
https://issues.apache.org/jira/browse/SPARK-40634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40634:
Assignee: (was: Apache Spark)
> Upgrade jodatime to 2.11.2
>
[
https://issues.apache.org/jira/browse/SPARK-40634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40634:
Assignee: Apache Spark
> Upgrade jodatime to 2.11.2
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-40634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612096#comment-17612096
]
Apache Spark commented on SPARK-40634:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612097#comment-17612097
]
Apache Spark commented on SPARK-40634:
--
User 'LuciferYang' has created a pull reque
Yang Jie created SPARK-40635:
Summary: Scala 2.12 + Hadoop 2 + JDK 8 Daily Test failed
Key: SPARK-40635
URL: https://issues.apache.org/jira/browse/SPARK-40635
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-40636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhongwei Zhu updated SPARK-40636:
-
Description:
```
4 of 24 local shuffles are added. In total, 24 shuffles are remained.
20
Zhongwei Zhu created SPARK-40636:
Summary: Fix wrong remained shuffles log in
BlockManagerDecommissioner
Key: SPARK-40636
URL: https://issues.apache.org/jira/browse/SPARK-40636
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhongwei Zhu updated SPARK-40636:
-
Description:
BlockManagerDecommissioner should log correct remained shuffles
```
4 of 24 l
[
https://issues.apache.org/jira/browse/SPARK-40636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhongwei Zhu updated SPARK-40636:
-
Description:
BlockManagerDecommissioner should log correct remained shuffles
{code:java}
4 o
[
https://issues.apache.org/jira/browse/SPARK-40636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhongwei Zhu updated SPARK-40636:
-
Description:
BlockManagerDecommissioner should log correct remained shuffles.
{code:java}
4 of
[
https://issues.apache.org/jira/browse/SPARK-40636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612126#comment-17612126
]
Apache Spark commented on SPARK-40636:
--
User 'warrenzhu25' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40636:
Assignee: (was: Apache Spark)
> Fix wrong remained shuffles log in BlockManagerDecomm
[
https://issues.apache.org/jira/browse/SPARK-40636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40636:
Assignee: Apache Spark
> Fix wrong remained shuffles log in BlockManagerDecommissioner
>
[
https://issues.apache.org/jira/browse/SPARK-40635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612128#comment-17612128
]
Yang Jie commented on SPARK-40635:
--
{code:java}
Exception message: Cannot run program "
[
https://issues.apache.org/jira/browse/SPARK-40635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-40635:
-
Attachment: build-failed
> Scala 2.12 + Hadoop 2 + JDK 8 Daily Test failed
> --
[
https://issues.apache.org/jira/browse/SPARK-40635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612131#comment-17612131
]
Yang Jie commented on SPARK-40635:
--
Manual test ： build/sbt "yarn/test" -Phadoop-2 -Pya
[
https://issues.apache.org/jira/browse/SPARK-40635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612131#comment-17612131
]
Yang Jie edited comment on SPARK-40635 at 10/2/22 3:43 PM:
---
Ma
[
https://issues.apache.org/jira/browse/SPARK-40635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612131#comment-17612131
]
Yang Jie edited comment on SPARK-40635 at 10/2/22 3:44 PM:
---
Ma
[
https://issues.apache.org/jira/browse/SPARK-40635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612131#comment-17612131
]
Yang Jie edited comment on SPARK-40635 at 10/2/22 3:47 PM:
---
Ma
[
https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ming95 updated SPARK-40610:
---
Attachment: image-2022-10-03-00-21-24-506.png
> Spark fall back to use getPartitions instead of getP
[
https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612135#comment-17612135
]
ming95 commented on SPARK-40610:
Spark will perform partition pruning when execu
[
https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612135#comment-17612135
]
ming95 edited comment on SPARK-40610 at 10/2/22 4:26 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ming95 updated SPARK-40610:
---
Attachment: (was: image-2022-10-03-00-21-24-506.png)
> Spark fall back to use getPartitions inst
[
https://issues.apache.org/jira/browse/SPARK-40629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40629:
-
Description:
h3. Describe the bug
Storing a FLOAT/DOUBLE value with division by 0 (e.g. {{{}( 1.0/0
).floatVal
[
https://issues.apache.org/jira/browse/SPARK-40624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40624:
-
Description:
h3. Describe the bug
Storing an invalid value (e.g. {{{}BigDecimal("1.0/0"){}}}) via {{spark-shell
xsys created SPARK-40637:
Summary: DataFrame can correctly encode BINARY type but SparkSQL
cannot
Key: SPARK-40637
URL: https://issues.apache.org/jira/browse/SPARK-40637
Project: Spark
Issue Type: B
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xsys updated SPARK-40637:
-
Description:
h3. Describe the bug
Storing a BINARY value (e.g. {{BigInt("1").toByteArray)}} / {{{}X'01'{}}}) vi
[
https://issues.apache.org/jira/browse/SPARK-40635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612162#comment-17612162
]
Apache Spark commented on SPARK-40635:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40635:
Assignee: Apache Spark
> Scala 2.12 + Hadoop 2 + JDK 8 Daily Test failed
> -
[
https://issues.apache.org/jira/browse/SPARK-40635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40635:
Assignee: (was: Apache Spark)
> Scala 2.12 + Hadoop 2 + JDK 8 Daily Test failed
> --
test2022123 created SPARK-40638:
---
Summary: RpcOutboxMessage: Ask terminated before connecting
successfully
Key: SPARK-40638
URL: https://issues.apache.org/jira/browse/SPARK-40638
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
test2022123 updated SPARK-40638:
Description:
{color:#ff}*Pyspark submit job stuck and infinitely retry.*{color}
*pyspark job
[
https://issues.apache.org/jira/browse/SPARK-40638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
test2022123 updated SPARK-40638:
Environment:
mac 12.6
Python 3.8.13
spark-3.3.0-bin-hadoop3
was:
mac 12.6
Python 3.8.13
spa
[
https://issues.apache.org/jira/browse/SPARK-40638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
test2022123 updated SPARK-40638:
Description:
{color:#ff}*Pyspark submit job stuck and infinitely retry.*{color}
*pyspark job
[
https://issues.apache.org/jira/browse/SPARK-40602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612166#comment-17612166
]
ming95 commented on SPARK-40602:
It seems to be a problem with the hive metastor
[
https://issues.apache.org/jira/browse/SPARK-40602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612166#comment-17612166
]
ming95 edited comment on SPARK-40602 at 10/3/22 4:11 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-40634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-40634.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38076
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-40634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-40634:
Assignee: Yang Jie
> Upgrade jodatime to 2.11.2
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-40631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-40631:
Assignee: Ruifeng Zheng
> Implement `min_count` in `GroupBy.first`
>
[
https://issues.apache.org/jira/browse/SPARK-40631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-40631.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38072
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-40630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612177#comment-17612177
]
Hyukjin Kwon commented on SPARK-40630:
--
Can you turn {{spark.sql.ansi.enabled}} on?
[
https://issues.apache.org/jira/browse/SPARK-40602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-40602:
-
Priority: Major (was: Blocker)
> RunTimeException for ETL job
>
>
[
https://issues.apache.org/jira/browse/SPARK-40602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612178#comment-17612178
]
Hyukjin Kwon commented on SPARK-40602:
--
{quote}
You can set the Spark configuration
[
https://issues.apache.org/jira/browse/SPARK-40614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612179#comment-17612179
]
Hyukjin Kwon commented on SPARK-40614:
--
[~Mar_zieh] Mind posting the reproducer ple
[
https://issues.apache.org/jira/browse/SPARK-40624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612183#comment-17612183
]
Hyukjin Kwon commented on SPARK-40624:
--
Does it work if you set {{spark.sql.ansi.en
[
https://issues.apache.org/jira/browse/SPARK-40629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612184#comment-17612184
]
Hyukjin Kwon commented on SPARK-40629:
--
Can you set {{spark.sql.ansi.enabled}} on a
66 matches
Mail list logo
