[jira] [Created] (SPARK-40385) Classes with companion object constructor fails interpreted path

2022-09-07 Thread Emil Ejbyfeldt (Jira)
Emil Ejbyfeldt created SPARK-40385: -- Summary: Classes with companion object constructor fails interpreted path Key: SPARK-40385 URL: https://issues.apache.org/jira/browse/SPARK-40385 Project: Spark

[jira] [Assigned] (SPARK-40384) Do base image real in time build only when infra dockerfile is changed

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40384: Assignee: (was: Apache Spark) > Do base image real in time build only when infra

[jira] [Commented] (SPARK-40384) Do base image real in time build only when infra dockerfile is changed

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601633#comment-17601633 ] Apache Spark commented on SPARK-40384: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-40384) Do base image real in time build only when infra dockerfile is changed

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601632#comment-17601632 ] Apache Spark commented on SPARK-40384: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40384) Do base image real in time build only when infra dockerfile is changed

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40384: Assignee: Apache Spark > Do base image real in time build only when infra dockerfile is

[jira] [Created] (SPARK-40384) Do base image real in time build only when infra dockerfile is changed

2022-09-07 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40384: --- Summary: Do base image real in time build only when infra dockerfile is changed Key: SPARK-40384 URL: https://issues.apache.org/jira/browse/SPARK-40384 Project: Spark

[jira] [Commented] (SPARK-40364) Unify `initDB` method in `DBProvider`

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601622#comment-17601622 ] Apache Spark commented on SPARK-40364: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-40364) Unify `initDB` method in `DBProvider`

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601620#comment-17601620 ] Apache Spark commented on SPARK-40364: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40383) Pin mypy ==0.920 in dev/requirements.txt

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40383: Assignee: (was: Apache Spark) > Pin mypy ==0.920 in dev/requirements.txt >

[jira] [Assigned] (SPARK-40383) Pin mypy ==0.920 in dev/requirements.txt

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40383: Assignee: Apache Spark > Pin mypy ==0.920 in dev/requirements.txt >

[jira] [Assigned] (SPARK-40364) Unify `initDB` method in `DBProvider`

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40364: Assignee: Apache Spark > Unify `initDB` method in `DBProvider` >

[jira] [Commented] (SPARK-40383) Pin mypy ==0.920 in dev/requirements.txt

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601621#comment-17601621 ] Apache Spark commented on SPARK-40383: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40364) Unify `initDB` method in `DBProvider`

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40364: Assignee: (was: Apache Spark) > Unify `initDB` method in `DBProvider` >

[jira] [Created] (SPARK-40383) Pin mypy ==0.920 in dev/requirements.txt

2022-09-07 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40383: - Summary: Pin mypy ==0.920 in dev/requirements.txt Key: SPARK-40383 URL: https://issues.apache.org/jira/browse/SPARK-40383 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40186) mergedShuffleCleaner should have been shutdown before db closed

2022-09-07 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40186. - Target Version/s: 3.4.0 Assignee: Yang Jie Resolution:

[jira] [Updated] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

2022-09-07 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-40362: - Description: In the canonicalization code which is now in two stages, canonicalization involving Commutative

[jira] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

2022-09-07 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40362 ] Asif deleted comment on SPARK-40362: -- was (Author: ashahid7): I have added locally test for  &&, ||, &, | and *  and they all fail for the same reason.. in process of adding tests for xor,

[jira] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

2022-09-07 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40362 ] Asif deleted comment on SPARK-40362: -- was (Author: ashahid7): will be generating a PR tomorrow.. > Bug in Canonicalization of expressions like Add & Multiply i.e Commutative > Operators >

[jira] [Resolved] (SPARK-40365) Bump ANTLR runtime version from 4.8 to 4.9.3

2022-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40365. -- Resolution: Fixed Issue resolved by pull request 37814

[jira] [Assigned] (SPARK-40365) Bump ANTLR runtime version from 4.8 to 4.9.3

2022-09-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40365: Assignee: BingKun Pan > Bump ANTLR runtime version from 4.8 to 4.9.3 >

[jira] [Resolved] (SPARK-40378) What is React Native.

2022-09-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40378. - Resolution: Invalid > What is React Native. > - > > Key:

[jira] [Updated] (SPARK-40378) What is React Native.

2022-09-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40378: Target Version/s: (was: 3.1.2) > What is React Native. > - > >

[jira] [Updated] (SPARK-40378) What is React Native.

2022-09-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40378: Fix Version/s: (was: 3.1.3) > What is React Native. > - > >

[jira] [Commented] (SPARK-40382) Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601554#comment-17601554 ] Apache Spark commented on SPARK-40382: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-40382) Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40382: Assignee: (was: Apache Spark) > Reduce projections in Expand when multiple distinct

[jira] [Assigned] (SPARK-40382) Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40382: Assignee: Apache Spark > Reduce projections in Expand when multiple distinct

[jira] [Created] (SPARK-40382) Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children

2022-09-07 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-40382: - Summary: Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children Key: SPARK-40382 URL:

[jira] [Comment Edited] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-07 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601543#comment-17601543 ] Mars edited comment on SPARK-40320 at 9/7/22 10:50 PM: --- [~Ngone51]  Shouldn't it

[jira] [Updated] (SPARK-40311) Introduce withColumnsRenamed

2022-09-07 Thread Santosh Pingale (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santosh Pingale updated SPARK-40311: Docs Text: Add withColumnsRenamed to scala and pyspark API > Introduce withColumnsRenamed

[jira] [Updated] (SPARK-40087) Support multiple Column drop in R

2022-09-07 Thread Santosh Pingale (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santosh Pingale updated SPARK-40087: Docs Text: Support for SparkR to drop multiple "Column" > Support multiple Column drop in

[jira] [Updated] (SPARK-39895) pyspark drop doesn't accept *cols

2022-09-07 Thread Santosh Pingale (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santosh Pingale updated SPARK-39895: Docs Text: Support for PySpark to drop multiple "Column" > pyspark drop doesn't accept

[jira] [Commented] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-07 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601543#comment-17601543 ] Mars commented on SPARK-40320: -- [~Ngone51]  Shouldn't it bring up a new `receiveLoop()` to serve RPC

[jira] [Updated] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

2022-09-07 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-40362: - Description: In the canonicalization code which is now in two stages, canonicalization involving Commutative

[jira] [Updated] (SPARK-40362) Bug in Canonicalization of expressions like Add & Multiply i.e Commutative Operators

2022-09-07 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-40362: - Shepherd: Wenchen Fan (was: Tanel Kiis) > Bug in Canonicalization of expressions like Add & Multiply i.e

[jira] [Resolved] (SPARK-40291) Improve the message for column not in group by clause error

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40291. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37742

[jira] [Assigned] (SPARK-40291) Improve the message for column not in group by clause error

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40291: Assignee: Linhong Liu > Improve the message for column not in group by clause error >

[jira] [Resolved] (SPARK-40293) Make the V2 table error message more meaningful

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40293. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37746

[jira] [Assigned] (SPARK-40293) Make the V2 table error message more meaningful

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40293: Assignee: Huaxin Gao > Make the V2 table error message more meaningful >

[jira] [Assigned] (SPARK-40380) Constant-folding of InvokeLike should not result in non-serializable result

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40380: Assignee: (was: Apache Spark) > Constant-folding of InvokeLike should not result in

[jira] [Assigned] (SPARK-40380) Constant-folding of InvokeLike should not result in non-serializable result

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40380: Assignee: Apache Spark > Constant-folding of InvokeLike should not result in

[jira] [Commented] (SPARK-40380) Constant-folding of InvokeLike should not result in non-serializable result

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601472#comment-17601472 ] Apache Spark commented on SPARK-40380: -- User 'rednaxelafx' has created a pull request for this

[jira] [Assigned] (SPARK-40381) Support standalone worker recommission

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40381: Assignee: (was: Apache Spark) > Support standalone worker recommission >

[jira] [Commented] (SPARK-40381) Support standalone worker recommission

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601468#comment-17601468 ] Apache Spark commented on SPARK-40381: -- User 'warrenzhu25' has created a pull request for this

[jira] [Commented] (SPARK-40381) Support standalone worker recommission

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601469#comment-17601469 ] Apache Spark commented on SPARK-40381: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-40381) Support standalone worker recommission

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40381: Assignee: Apache Spark > Support standalone worker recommission >

[jira] [Created] (SPARK-40381) Support standalone worker recommission

2022-09-07 Thread Zhongwei Zhu (Jira)
Zhongwei Zhu created SPARK-40381: Summary: Support standalone worker recommission Key: SPARK-40381 URL: https://issues.apache.org/jira/browse/SPARK-40381 Project: Spark Issue Type:

[jira] [Created] (SPARK-40380) Constant-folding of InvokeLike should not result in non-serializable result

2022-09-07 Thread Kris Mok (Jira)
Kris Mok created SPARK-40380: Summary: Constant-folding of InvokeLike should not result in non-serializable result Key: SPARK-40380 URL: https://issues.apache.org/jira/browse/SPARK-40380 Project: Spark

[jira] [Assigned] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40379: Assignee: Apache Spark (was: Holden Karau) > Propagate decommission executor loss

[jira] [Commented] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601386#comment-17601386 ] Apache Spark commented on SPARK-40379: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40379: Assignee: Holden Karau (was: Apache Spark) > Propagate decommission executor loss

[jira] [Commented] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601385#comment-17601385 ] Apache Spark commented on SPARK-40379: -- User 'holdenk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-40295) Allow v2 functions with literal args in write distribution and ordering

2022-09-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-40295. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37749

[jira] [Assigned] (SPARK-40295) Allow v2 functions with literal args in write distribution and ordering

2022-09-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-40295: Assignee: Anton Okolnychyi > Allow v2 functions with literal args in write distribution and

[jira] [Updated] (SPARK-40378) What is React Native.

2022-09-07 Thread Nikhil Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Sharma updated SPARK-40378: -- Summary: What is React Native. (was: React Native is an open source framework for building

[jira] [Created] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s

2022-09-07 Thread Holden Karau (Jira)
Holden Karau created SPARK-40379: Summary: Propagate decommission executor loss reason during onDisconnect in K8s Key: SPARK-40379 URL: https://issues.apache.org/jira/browse/SPARK-40379 Project:

[jira] [Created] (SPARK-40378) React Native is an open source framework for building mobile apps. It was created by Facebook and is designed for cross-platform capability.

2022-09-07 Thread Nikhil Sharma (Jira)
Nikhil Sharma created SPARK-40378: - Summary: React Native is an open source framework for building mobile apps. It was created by Facebook and is designed for cross-platform capability. Key: SPARK-40378 URL:

[jira] [Updated] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-09-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-40149: Fix Version/s: 3.2.3 > Star expansion after outer join asymmetrically includes joining key >

[jira] [Commented] (SPARK-38961) Enhance to automatically generate the pandas API support list

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601358#comment-17601358 ] Apache Spark commented on SPARK-38961: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-38961) Enhance to automatically generate the pandas API support list

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601359#comment-17601359 ] Apache Spark commented on SPARK-38961: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Elhoussine Talab (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601311#comment-17601311 ] Elhoussine Talab commented on SPARK-40376: -- Thanks [~srowen]  > `np.bool` will be deprecated >

[jira] [Updated] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40376: - Issue Type: Improvement (was: Bug) Priority: Trivial (was: Major) This is not a bug >

[jira] [Assigned] (SPARK-40377) Allow customize maxBroadcastTableBytes and maxBroadcastRows

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40377: Assignee: (was: Apache Spark) > Allow customize maxBroadcastTableBytes and

[jira] [Assigned] (SPARK-40377) Allow customize maxBroadcastTableBytes and maxBroadcastRows

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40377: Assignee: Apache Spark > Allow customize maxBroadcastTableBytes and maxBroadcastRows >

[jira] [Commented] (SPARK-40377) Allow customize maxBroadcastTableBytes and maxBroadcastRows

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601297#comment-17601297 ] Apache Spark commented on SPARK-40377: -- User 'LLiu' has created a pull request for this issue:

[jira] [Commented] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

2022-09-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601293#comment-17601293 ] Karl Håkan Nordgren commented on SPARK-38218: - [~hyukjin.kwon] : Could I ask for an update?

[jira] [Updated] (SPARK-40377) Allow customize maxBroadcastTableBytes and maxBroadcastRows

2022-09-07 Thread LeeeeLiu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LLiu updated SPARK-40377: - Attachment: 截屏2022-09-07 20.40.06.png 截屏2022-09-07 20.40.16.png > Allow customize

[jira] [Created] (SPARK-40377) Allow customize maxBroadcastTableBytes and maxBroadcastRows

2022-09-07 Thread LeeeeLiu (Jira)
LLiu created SPARK-40377: Summary: Allow customize maxBroadcastTableBytes and maxBroadcastRows Key: SPARK-40377 URL: https://issues.apache.org/jira/browse/SPARK-40377 Project: Spark Issue

[jira] [Assigned] (SPARK-40185) Remove column suggestion when the candidate list is empty for unresolved column/attribute/map key

2022-09-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40185: --- Assignee: Vitalii Li > Remove column suggestion when the candidate list is empty for

[jira] [Resolved] (SPARK-40185) Remove column suggestion when the candidate list is empty for unresolved column/attribute/map key

2022-09-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40185. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37621

[jira] [Commented] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601258#comment-17601258 ] Apache Spark commented on SPARK-40149: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601257#comment-17601257 ] Apache Spark commented on SPARK-40149: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40376: Assignee: Apache Spark > `np.bool` will be deprecated > > >

[jira] [Updated] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Elhoussine Talab (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elhoussine Talab updated SPARK-40376: - Description: Using `np.bool` generates this warning:  {quote} UserWarning: toPandas

[jira] [Commented] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601256#comment-17601256 ] Apache Spark commented on SPARK-40376: -- User 'ELHoussineT' has created a pull request for this

[jira] [Assigned] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40376: Assignee: (was: Apache Spark) > `np.bool` will be deprecated >

[jira] [Commented] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601255#comment-17601255 ] Apache Spark commented on SPARK-40376: -- User 'ELHoussineT' has created a pull request for this

[jira] [Created] (SPARK-40376) `np.bool` will be deprecated

2022-09-07 Thread Elhoussine Talab (Jira)
Elhoussine Talab created SPARK-40376: Summary: `np.bool` will be deprecated Key: SPARK-40376 URL: https://issues.apache.org/jira/browse/SPARK-40376 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-09-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40149. - Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-40332) Implement `GroupBy.quantile`.

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601228#comment-17601228 ] Apache Spark commented on SPARK-40332: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40332) Implement `GroupBy.quantile`.

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40332: Assignee: Apache Spark > Implement `GroupBy.quantile`. > - >

[jira] [Commented] (SPARK-40332) Implement `GroupBy.quantile`.

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601226#comment-17601226 ] Apache Spark commented on SPARK-40332: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40332) Implement `GroupBy.quantile`.

2022-09-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40332: Assignee: (was: Apache Spark) > Implement `GroupBy.quantile`. >

[jira] [Commented] (SPARK-40298) shuffle data recovery on the reused PVCs no effect

2022-09-07 Thread todd (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601225#comment-17601225 ] todd commented on SPARK-40298: -- [~dongjoon]  I use aws spot cluster to terminate the instance where the

[jira] [Created] (SPARK-40373) Implement `ps.show_versions`

2022-09-07 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40373: --- Summary: Implement `ps.show_versions` Key: SPARK-40373 URL: https://issues.apache.org/jira/browse/SPARK-40373 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40374) Migrate type check failures of type creators onto error classes

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40374: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the complex type creator

[jira] [Created] (SPARK-40375) Implement `spark.show_versions`

2022-09-07 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40375: --- Summary: Implement `spark.show_versions` Key: SPARK-40375 URL: https://issues.apache.org/jira/browse/SPARK-40375 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-40374) Migrate type check failures of type creators onto error classes

2022-09-07 Thread Max Gekk (Jira)
Max Gekk created SPARK-40374: Summary: Migrate type check failures of type creators onto error classes Key: SPARK-40374 URL: https://issues.apache.org/jira/browse/SPARK-40374 Project: Spark

[jira] [Updated] (SPARK-40372) Migrate failures of array type checks onto error classes

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40372: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in collection expressions: 1.

[jira] [Updated] (SPARK-40358) Migrate collection type check failures onto error classes

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40358: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in collection expressions: 1.

[jira] [Created] (SPARK-40372) Migrate failures of array type checks onto error classes

2022-09-07 Thread Max Gekk (Jira)
Max Gekk created SPARK-40372: Summary: Migrate failures of array type checks onto error classes Key: SPARK-40372 URL: https://issues.apache.org/jira/browse/SPARK-40372 Project: Spark Issue Type:

[jira] [Updated] (SPARK-40358) Migrate collection type check failures onto error classes

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40358: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in collection expressions: 1.

[jira] [Updated] (SPARK-40357) Migrate window type check failures onto error classes

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40357: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in window expressions: 1.

[jira] [Created] (SPARK-40371) Migrate type check failures of NthValue and NTile onto error classes

2022-09-07 Thread Max Gekk (Jira)
Max Gekk created SPARK-40371: Summary: Migrate type check failures of NthValue and NTile onto error classes Key: SPARK-40371 URL: https://issues.apache.org/jira/browse/SPARK-40371 Project: Spark

[jira] [Updated] (SPARK-40371) Migrate type check failures of NthValue and NTile onto error classes

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40371: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in window expressions: 1.

[jira] [Commented] (SPARK-40273) Fix the documents "Contributing and Maintaining Type Hints".

2022-09-07 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601213#comment-17601213 ] Maciej Szymkiewicz commented on SPARK-40273: Issue resolved by pull request 37724

[jira] [Resolved] (SPARK-40273) Fix the documents "Contributing and Maintaining Type Hints".

2022-09-07 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-40273. Fix Version/s: 3.4.0 Assignee: Haejoon Lee Resolution: Fixed >

[jira] [Updated] (SPARK-40370) Migrate cast type check failures onto error classes

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40370: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the CAST expression:

[jira] [Created] (SPARK-40370) Migrate cast type check failures onto error classes

2022-09-07 Thread Max Gekk (Jira)
Max Gekk created SPARK-40370: Summary: Migrate cast type check failures onto error classes Key: SPARK-40370 URL: https://issues.apache.org/jira/browse/SPARK-40370 Project: Spark Issue Type:

[jira] [Updated] (SPARK-40369) Migrate the type check failures of calls via reflection onto error classes

2022-09-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40369: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the expressions of invokes

[jira] [Created] (SPARK-40369) Migrate the type check failures of calls via reflection onto error classes

2022-09-07 Thread Max Gekk (Jira)
Max Gekk created SPARK-40369: Summary: Migrate the type check failures of calls via reflection onto error classes Key: SPARK-40369 URL: https://issues.apache.org/jira/browse/SPARK-40369 Project: Spark

  1   2   >