[jira] [Commented] (SPARK-36423) Randomize blocks within a push request before pushing to improve block merge ratio

[ https://issues.apache.org/jira/browse/SPARK-36423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393647#comment-17393647 ] Apache Spark commented on SPARK-36423: -- User 'Victsm' has created a pull request fo

[jira] [Commented] (SPARK-36423) Randomize blocks within a push request before pushing to improve block merge ratio

[ https://issues.apache.org/jira/browse/SPARK-36423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393646#comment-17393646 ] Apache Spark commented on SPARK-36423: -- User 'Victsm' has created a pull request fo

[jira] [Assigned] (SPARK-36423) Randomize blocks within a push request before pushing to improve block merge ratio

[ https://issues.apache.org/jira/browse/SPARK-36423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36423: Assignee: (was: Apache Spark) > Randomize blocks within a push request before pushing

[jira] [Assigned] (SPARK-36423) Randomize blocks within a push request before pushing to improve block merge ratio

[ https://issues.apache.org/jira/browse/SPARK-36423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36423: Assignee: Apache Spark > Randomize blocks within a push request before pushing to improve

[jira] [Created] (SPARK-36423) Randomize blocks within a push request before pushing to improve block merge ratio

Min Shen created SPARK-36423: Summary: Randomize blocks within a push request before pushing to improve block merge ratio Key: SPARK-36423 URL: https://issues.apache.org/jira/browse/SPARK-36423 Project: S

[jira] [Commented] (SPARK-36420) Use `isEmpty` to improve performance in Pregel's superstep

[ https://issues.apache.org/jira/browse/SPARK-36420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393628#comment-17393628 ] Apache Spark commented on SPARK-36420: -- User 'StefanXiepj' has created a pull reque

[jira] [Assigned] (SPARK-36420) Use `isEmpty` to improve performance in Pregel's superstep

[ https://issues.apache.org/jira/browse/SPARK-36420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36420: Assignee: Apache Spark > Use `isEmpty` to improve performance in Pregel's superstep > ---

[jira] [Assigned] (SPARK-36420) Use `isEmpty` to improve performance in Pregel's superstep

[ https://issues.apache.org/jira/browse/SPARK-36420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36420: Assignee: (was: Apache Spark) > Use `isEmpty` to improve performance in Pregel's supe

[jira] [Commented] (SPARK-36420) Use `isEmpty` to improve performance in Pregel's superstep

[ https://issues.apache.org/jira/browse/SPARK-36420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393627#comment-17393627 ] Apache Spark commented on SPARK-36420: -- User 'StefanXiepj' has created a pull reque

[jira] [Created] (SPARK-36422) Examples can't run in IDE directly

Yang Jie created SPARK-36422: Summary: Examples can't run in IDE directly Key: SPARK-36422 URL: https://issues.apache.org/jira/browse/SPARK-36422 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-36422) Examples can't run in IDE directly

[ https://issues.apache.org/jira/browse/SPARK-36422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-36422: - Issue Type: Bug (was: Improvement) > Examples can't run in IDE directly > -

[jira] [Commented] (SPARK-36421) Validate all SQL configs to prevent from wrong use for ConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-36421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393610#comment-17393610 ] Apache Spark commented on SPARK-36421: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-36421) Validate all SQL configs to prevent from wrong use for ConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-36421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36421: Assignee: Apache Spark > Validate all SQL configs to prevent from wrong use for ConfigEnt

[jira] [Commented] (SPARK-36421) Validate all SQL configs to prevent from wrong use for ConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-36421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393609#comment-17393609 ] Apache Spark commented on SPARK-36421: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-36421) Validate all SQL configs to prevent from wrong use for ConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-36421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36421: Assignee: (was: Apache Spark) > Validate all SQL configs to prevent from wrong use fo

[jira] [Commented] (SPARK-36388) Fix DataFrame groupby-rolling to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393608#comment-17393608 ] Apache Spark commented on SPARK-36388: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-36386) Fix DataFrame groupby-expanding to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393605#comment-17393605 ] Haejoon Lee commented on SPARK-36386: - I'm working on it > Fix DataFrame groupby-ex

[jira] [Commented] (SPARK-36388) Fix DataFrame groupby-rolling to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393606#comment-17393606 ] Apache Spark commented on SPARK-36388: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-36388) Fix DataFrame groupby-rolling to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36388: Assignee: Apache Spark > Fix DataFrame groupby-rolling to follow pandas 1.3 > ---

[jira] [Assigned] (SPARK-36388) Fix DataFrame groupby-rolling to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36388: Assignee: (was: Apache Spark) > Fix DataFrame groupby-rolling to follow pandas 1.3 >

[jira] [Created] (SPARK-36421) Validate all SQL configs to prevent from wrong use for ConfigEntry

Kent Yao created SPARK-36421: Summary: Validate all SQL configs to prevent from wrong use for ConfigEntry Key: SPARK-36421 URL: https://issues.apache.org/jira/browse/SPARK-36421 Project: Spark I

[jira] [Updated] (SPARK-36421) Validate all SQL configs to prevent from wrong use for ConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-36421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36421: - Issue Type: Bug (was: Improvement) > Validate all SQL configs to prevent from wrong use for ConfigEntry

[jira] [Updated] (SPARK-36421) Validate all SQL configs to prevent from wrong use for ConfigEntry

[ https://issues.apache.org/jira/browse/SPARK-36421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36421: - Priority: Minor (was: Major) > Validate all SQL configs to prevent from wrong use for ConfigEntry > ---

[jira] [Commented] (SPARK-36173) [CORE] Support getting CPU number in TaskContext

[ https://issues.apache.org/jira/browse/SPARK-36173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393578#comment-17393578 ] Apache Spark commented on SPARK-36173: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-36173) [CORE] Support getting CPU number in TaskContext

[ https://issues.apache.org/jira/browse/SPARK-36173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393577#comment-17393577 ] Apache Spark commented on SPARK-36173: -- User 'sarutak' has created a pull request f

[jira] [Created] (SPARK-36420) Use `isEmpty` to improve performance in Pregel's superstep

xiepengjie created SPARK-36420: -- Summary: Use `isEmpty` to improve performance in Pregel's superstep Key: SPARK-36420 URL: https://issues.apache.org/jira/browse/SPARK-36420 Project: Spark Issue

[jira] [Assigned] (SPARK-36173) [CORE] Support getting CPU number in TaskContext

[ https://issues.apache.org/jira/browse/SPARK-36173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-36173: --- Assignee: Xiaochang Wu > [CORE] Support getting CPU number in TaskContext >

[jira] [Resolved] (SPARK-36173) [CORE] Support getting CPU number in TaskContext

[ https://issues.apache.org/jira/browse/SPARK-36173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-36173. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 333

[jira] [Assigned] (SPARK-36384) Add documentation for shuffle checksum

[ https://issues.apache.org/jira/browse/SPARK-36384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36384: Assignee: wuyi > Add documentation for shuffle checksum > ---

[jira] [Resolved] (SPARK-36384) Add documentation for shuffle checksum

[ https://issues.apache.org/jira/browse/SPARK-36384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36384. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33637 [https://gi

[jira] [Assigned] (SPARK-36068) No tests in hadoop-cloud run unless hadoop-3.2 profile is activated explicitly

[ https://issues.apache.org/jira/browse/SPARK-36068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36068: Assignee: Kousuke Saruta > No tests in hadoop-cloud run unless hadoop-3.2 profile is acti

[jira] [Resolved] (SPARK-36068) No tests in hadoop-cloud run unless hadoop-3.2 profile is activated explicitly

[ https://issues.apache.org/jira/browse/SPARK-36068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36068. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33277 [https://gi

[jira] [Updated] (SPARK-36416) Add SQL metrics to AdaptiveSparkPlanExec for BHJs and Skew joins

[ https://issues.apache.org/jira/browse/SPARK-36416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated SPARK-36416: --- Description: Add {{"num broadcast joins conversions"}} and {{"num skew join conversions"}}

[jira] [Commented] (SPARK-36419) Move final aggregation in RDD.treeAggregate to executor

[ https://issues.apache.org/jira/browse/SPARK-36419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393435#comment-17393435 ] Apache Spark commented on SPARK-36419: -- User 'akpatnam25' has created a pull reques

[jira] [Commented] (SPARK-36419) Move final aggregation in RDD.treeAggregate to executor

[ https://issues.apache.org/jira/browse/SPARK-36419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393434#comment-17393434 ] Apache Spark commented on SPARK-36419: -- User 'akpatnam25' has created a pull reques

[jira] [Assigned] (SPARK-36419) Move final aggregation in RDD.treeAggregate to executor

[ https://issues.apache.org/jira/browse/SPARK-36419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36419: Assignee: (was: Apache Spark) > Move final aggregation in RDD.treeAggregate to execut

[jira] [Commented] (SPARK-36419) Move final aggregation in RDD.treeAggregate to executor

[ https://issues.apache.org/jira/browse/SPARK-36419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393429#comment-17393429 ] Apache Spark commented on SPARK-36419: -- User 'akpatnam25' has created a pull reques

[jira] [Assigned] (SPARK-36419) Move final aggregation in RDD.treeAggregate to executor

[ https://issues.apache.org/jira/browse/SPARK-36419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36419: Assignee: Apache Spark > Move final aggregation in RDD.treeAggregate to executor > --

[jira] [Commented] (SPARK-36419) Move final aggregation in RDD.treeAggregate to executor

[ https://issues.apache.org/jira/browse/SPARK-36419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393428#comment-17393428 ] Apache Spark commented on SPARK-36419: -- User 'akpatnam25' has created a pull reques

[jira] [Resolved] (SPARK-34309) Use Caffeine instead of Guava Cache

[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-34309. -- Fix Version/s: 3.3.0 Assignee: Yang Jie Resolution: Fixed > Use Caffeine inste

[jira] [Commented] (SPARK-36416) Add SQL metrics to AdaptiveSparkPlanExec for BHJs and Skew joins

[ https://issues.apache.org/jira/browse/SPARK-36416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393396#comment-17393396 ] Apache Spark commented on SPARK-36416: -- User 'ekoifman' has created a pull request

[jira] [Commented] (SPARK-36416) Add SQL metrics to AdaptiveSparkPlanExec for BHJs and Skew joins

[ https://issues.apache.org/jira/browse/SPARK-36416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393394#comment-17393394 ] Apache Spark commented on SPARK-36416: -- User 'ekoifman' has created a pull request

[jira] [Assigned] (SPARK-36416) Add SQL metrics to AdaptiveSparkPlanExec for BHJs and Skew joins

[ https://issues.apache.org/jira/browse/SPARK-36416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36416: Assignee: (was: Apache Spark) > Add SQL metrics to AdaptiveSparkPlanExec for BHJs and

[jira] [Assigned] (SPARK-36416) Add SQL metrics to AdaptiveSparkPlanExec for BHJs and Skew joins

[ https://issues.apache.org/jira/browse/SPARK-36416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36416: Assignee: Apache Spark > Add SQL metrics to AdaptiveSparkPlanExec for BHJs and Skew joins

[jira] [Created] (SPARK-36419) Move final aggregation in RDD.treeAggregate to executor

Aravind Patnam created SPARK-36419: -- Summary: Move final aggregation in RDD.treeAggregate to executor Key: SPARK-36419 URL: https://issues.apache.org/jira/browse/SPARK-36419 Project: Spark I

[jira] [Created] (SPARK-36418) Use CAST in parsing of dates/timestamps with default pattern

Max Gekk created SPARK-36418: Summary: Use CAST in parsing of dates/timestamps with default pattern Key: SPARK-36418 URL: https://issues.apache.org/jira/browse/SPARK-36418 Project: Spark Issue T

[jira] [Resolved] (SPARK-36417) Add resource profile to Spark pods labels

[ https://issues.apache.org/jira/browse/SPARK-36417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-36417. -- Resolution: Duplicate > Add resource profile to Spark pods labels > --

[jira] [Created] (SPARK-36417) Add resource profile to Spark pods labels

Holden Karau created SPARK-36417: Summary: Add resource profile to Spark pods labels Key: SPARK-36417 URL: https://issues.apache.org/jira/browse/SPARK-36417 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-36416) Add SQL metrics to AdaptiveSparkPlanExec for BHJs and Skew joins

[ https://issues.apache.org/jira/browse/SPARK-36416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393360#comment-17393360 ] Erik Krogen commented on SPARK-36416: - +1 this would be very helpful! > Add SQL met

[jira] [Created] (SPARK-36416) Add SQL metrics to AdaptiveSparkPlanExec for BHJs and Skew joins

Eugene Koifman created SPARK-36416: -- Summary: Add SQL metrics to AdaptiveSparkPlanExec for BHJs and Skew joins Key: SPARK-36416 URL: https://issues.apache.org/jira/browse/SPARK-36416 Project: Spark

[jira] [Commented] (SPARK-36409) Splitting test cases from datetime.sql

[ https://issues.apache.org/jira/browse/SPARK-36409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393347#comment-17393347 ] Apache Spark commented on SPARK-36409: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-36409) Splitting test cases from datetime.sql

[ https://issues.apache.org/jira/browse/SPARK-36409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393346#comment-17393346 ] Apache Spark commented on SPARK-36409: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-34952) DS V2 Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-34952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393317#comment-17393317 ] Apache Spark commented on SPARK-34952: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-34952) DS V2 Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-34952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393318#comment-17393318 ] Apache Spark commented on SPARK-34952: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-35870) Upgrade Jetty to 9.4.42

[ https://issues.apache.org/jira/browse/SPARK-35870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393277#comment-17393277 ] Kousuke Saruta commented on SPARK-35870: Hi [~this]. v2.4.8 is the last release

[jira] [Assigned] (SPARK-36415) Add docs for try_cast/try_add/try_divide

[ https://issues.apache.org/jira/browse/SPARK-36415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36415: Assignee: Apache Spark (was: Gengliang Wang) > Add docs for try_cast/try_add/try_divide

[jira] [Assigned] (SPARK-36415) Add docs for try_cast/try_add/try_divide

[ https://issues.apache.org/jira/browse/SPARK-36415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36415: Assignee: Gengliang Wang (was: Apache Spark) > Add docs for try_cast/try_add/try_divide

[jira] [Commented] (SPARK-36415) Add docs for try_cast/try_add/try_divide

[ https://issues.apache.org/jira/browse/SPARK-36415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393272#comment-17393272 ] Apache Spark commented on SPARK-36415: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-36415) Add docs for try_cast/try_add/try_divide

Gengliang Wang created SPARK-36415: -- Summary: Add docs for try_cast/try_add/try_divide Key: SPARK-36415 URL: https://issues.apache.org/jira/browse/SPARK-36415 Project: Spark Issue Type: Sub-

[jira] [Commented] (SPARK-35870) Upgrade Jetty to 9.4.42

[ https://issues.apache.org/jira/browse/SPARK-35870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393258#comment-17393258 ] Sajith A commented on SPARK-35870: -- CVE-2021-28169 is also present in Spark v2.4.8 (See

[jira] [Assigned] (SPARK-36384) Add documentation for shuffle checksum

[ https://issues.apache.org/jira/browse/SPARK-36384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36384: Assignee: (was: Apache Spark) > Add documentation for shuffle checksum >

[jira] [Assigned] (SPARK-36384) Add documentation for shuffle checksum

[ https://issues.apache.org/jira/browse/SPARK-36384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36384: Assignee: Apache Spark > Add documentation for shuffle checksum > ---

[jira] [Commented] (SPARK-36384) Add documentation for shuffle checksum

[ https://issues.apache.org/jira/browse/SPARK-36384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393147#comment-17393147 ] Apache Spark commented on SPARK-36384: -- User 'Ngone51' has created a pull request f

[jira] [Resolved] (SPARK-36354) EventLogFileReaders should not complain in case of no event log files

[ https://issues.apache.org/jira/browse/SPARK-36354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-36354. -- Fix Version/s: 3.1.3 3.2.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-36354) EventLogFileReaders should not complain in case of no event log files

[ https://issues.apache.org/jira/browse/SPARK-36354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-36354: Assignee: Dongjoon Hyun > EventLogFileReaders should not complain in case of no event log

[jira] [Commented] (SPARK-36414) Disable timeout for BroadcastQueryStageExec in AQE

[ https://issues.apache.org/jira/browse/SPARK-36414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393036#comment-17393036 ] Apache Spark commented on SPARK-36414: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-36414) Disable timeout for BroadcastQueryStageExec in AQE

[ https://issues.apache.org/jira/browse/SPARK-36414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393035#comment-17393035 ] Apache Spark commented on SPARK-36414: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-36414) Disable timeout for BroadcastQueryStageExec in AQE

[ https://issues.apache.org/jira/browse/SPARK-36414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36414: Assignee: Apache Spark > Disable timeout for BroadcastQueryStageExec in AQE > ---

[jira] [Assigned] (SPARK-36414) Disable timeout for BroadcastQueryStageExec in AQE

[ https://issues.apache.org/jira/browse/SPARK-36414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36414: Assignee: (was: Apache Spark) > Disable timeout for BroadcastQueryStageExec in AQE >

[jira] [Updated] (SPARK-36414) Disable timeout for BroadcastQueryStageExec in AQE

[ https://issues.apache.org/jira/browse/SPARK-36414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36414: - Description: This reverts SPARK-31475, as there are always more concurrent jobs running in AQE mode, es

[jira] [Commented] (SPARK-36413) Spark and Hive are inconsistent in inferring the expression type in the view, resulting in AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-36413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393026#comment-17393026 ] bingfeng.guo commented on SPARK-36413: -- This scenario is very common in my business

[jira] [Created] (SPARK-36414) Disable timeout for BroadcastQueryStageExec in AQE

Kent Yao created SPARK-36414: Summary: Disable timeout for BroadcastQueryStageExec in AQE Key: SPARK-36414 URL: https://issues.apache.org/jira/browse/SPARK-36414 Project: Spark Issue Type: Improv

[jira] [Updated] (SPARK-36414) Disable timeout for BroadcastQueryStageExec in AQE

[ https://issues.apache.org/jira/browse/SPARK-36414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36414: - Attachment: image-2021-08-04-18-53-44-879.png > Disable timeout for BroadcastQueryStageExec in AQE > ---

[jira] [Updated] (SPARK-36413) Spark and Hive are inconsistent in inferring the expression type in the view, resulting in AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-36413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bingfeng.guo updated SPARK-36413: - Description: The scene of the restoration is as follows:   Suppose I have a hive table： {quote

[jira] [Updated] (SPARK-36413) Spark and Hive are inconsistent in inferring the expression type in the view, resulting in AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-36413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bingfeng.guo updated SPARK-36413: - Description: The scene of the restoration is as follows:   Suppose I have a hive table： {quote

[jira] [Created] (SPARK-36413) Spark and Hive are inconsistent in inferring the expression type in the view, resulting in AnalysisException

bingfeng.guo created SPARK-36413: Summary: Spark and Hive are inconsistent in inferring the expression type in the view, resulting in AnalysisException Key: SPARK-36413 URL: https://issues.apache.org/jira/browse/S

[jira] [Updated] (SPARK-36412) Add Test Coverage to meet viewFs(Hadoop federation) scenario

[ https://issues.apache.org/jira/browse/SPARK-36412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Senthil Kumar updated SPARK-36412: -- Summary: Add Test Coverage to meet viewFs(Hadoop federation) scenario (was: Create coverage

[jira] [Commented] (SPARK-36412) Create coverage Test to meet viewFs(Hadoop federation) scenario

[ https://issues.apache.org/jira/browse/SPARK-36412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392976#comment-17392976 ] Senthil Kumar commented on SPARK-36412: --- I am working on this > Create coverage T

[jira] [Created] (SPARK-36412) Create coverage Test to meet viewFs(Hadoop federation) scenario

Senthil Kumar created SPARK-36412: - Summary: Create coverage Test to meet viewFs(Hadoop federation) scenario Key: SPARK-36412 URL: https://issues.apache.org/jira/browse/SPARK-36412 Project: Spark

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392971#comment-17392971 ] Cameron Todd commented on SPARK-18105: -- Let me know if that's enough info. From my

[jira] [Updated] (SPARK-36411) Unable to Write non-Delta Formats to Azure Data Lake Gen2 Due to Owner of the Parent Folder's Permissions

[ https://issues.apache.org/jira/browse/SPARK-36411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Osama Suleiman updated SPARK-36411: --- Description: When writing a Spark DataFrame to Azure Data Lake Gen2 storage using any format

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392968#comment-17392968 ] Cameron Todd commented on SPARK-18105: -- I'll attach a portion of the code that is n

[jira] [Created] (SPARK-36411) Unable to Write non-Delta Formats to Azure Data Lake Gen2 Due to Owner of the Parent Folder's Permissions

Osama Suleiman created SPARK-36411: -- Summary: Unable to Write non-Delta Formats to Azure Data Lake Gen2 Due to Owner of the Parent Folder's Permissions Key: SPARK-36411 URL: https://issues.apache.org/jira/browse/

[jira] [Updated] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cameron Todd updated SPARK-18105: - Attachment: TestWeightedGraph.java > LZ4 failed to decompress a stream of shuffled data > --

[jira] [Commented] (SPARK-36410) Replace anonymous classes with lambda expressions

[ https://issues.apache.org/jira/browse/SPARK-36410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392839#comment-17392839 ] Apache Spark commented on SPARK-36410: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-36410) Replace anonymous classes with lambda expressions

[ https://issues.apache.org/jira/browse/SPARK-36410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36410: Assignee: (was: Apache Spark) > Replace anonymous classes with lambda expressions > -

[jira] [Assigned] (SPARK-36410) Replace anonymous classes with lambda expressions

[ https://issues.apache.org/jira/browse/SPARK-36410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36410: Assignee: Apache Spark > Replace anonymous classes with lambda expressions >

[jira] [Created] (SPARK-36410) Replace anonymous classes with lambda expressions

Yang Jie created SPARK-36410: Summary: Replace anonymous classes with lambda expressions Key: SPARK-36410 URL: https://issues.apache.org/jira/browse/SPARK-36410 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-36388) Fix DataFrame groupby-rolling to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392827#comment-17392827 ] Haejoon Lee commented on SPARK-36388: - I'm working on it. > Fix DataFrame groupby-r

[jira] [Assigned] (SPARK-36369) Fix Index.union to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36369: Assignee: (was: Apache Spark) > Fix Index.union to follow pandas 1.3 > --

[jira] [Commented] (SPARK-36369) Fix Index.union to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392825#comment-17392825 ] Apache Spark commented on SPARK-36369: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-36369) Fix Index.union to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36369: Assignee: (was: Apache Spark) > Fix Index.union to follow pandas 1.3 > --

[jira] [Assigned] (SPARK-36369) Fix Index.union to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36369: Assignee: Apache Spark > Fix Index.union to follow pandas 1.3 > -

[jira] [Assigned] (SPARK-36409) Splitting test cases from datetime.sql

[ https://issues.apache.org/jira/browse/SPARK-36409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36409: Assignee: Apache Spark (was: Gengliang Wang) > Splitting test cases from datetime.sql >

[jira] [Assigned] (SPARK-36409) Splitting test cases from datetime.sql

[ https://issues.apache.org/jira/browse/SPARK-36409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36409: Assignee: Gengliang Wang (was: Apache Spark) > Splitting test cases from datetime.sql >

[jira] [Commented] (SPARK-36409) Splitting test cases from datetime.sql

[ https://issues.apache.org/jira/browse/SPARK-36409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392824#comment-17392824 ] Apache Spark commented on SPARK-36409: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-36409) Splitting test cases from datetime.sql

Gengliang Wang created SPARK-36409: -- Summary: Splitting test cases from datetime.sql Key: SPARK-36409 URL: https://issues.apache.org/jira/browse/SPARK-36409 Project: Spark Issue Type: Sub-ta

[jira] [Commented] (SPARK-36360) StreamingSource duplicates appName

[ https://issues.apache.org/jira/browse/SPARK-36360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392793#comment-17392793 ] Apache Spark commented on SPARK-36360: -- User 'mrclneumann' has created a pull reque