[jira] [Resolved] (SPARK-39958) Add warning log when unable to load custom metric object

[ https://issues.apache.org/jira/browse/SPARK-39958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-39958. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37386 [https://gith

[jira] [Assigned] (SPARK-39958) Add warning log when unable to load custom metric object

[ https://issues.apache.org/jira/browse/SPARK-39958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-39958: --- Assignee: L. C. Hsieh > Add warning log when unable to load custom metric object >

[jira] [Created] (SPARK-39967) Instead of using the scalar tasksSuccessful, use the successful array to calculate whether the task is completed

jingxiong zhong created SPARK-39967: --- Summary: Instead of using the scalar tasksSuccessful, use the successful array to calculate whether the task is completed Key: SPARK-39967 URL: https://issues.apache.org/jir

[jira] [Assigned] (SPARK-39962) Global aggregation against pandas aggregate UDF does not take the column order into account

[ https://issues.apache.org/jira/browse/SPARK-39962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39962: Assignee: Hyukjin Kwon > Global aggregation against pandas aggregate UDF does not take th

[jira] [Resolved] (SPARK-39962) Global aggregation against pandas aggregate UDF does not take the column order into account

[ https://issues.apache.org/jira/browse/SPARK-39962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39962. -- Fix Version/s: 3.3.1 3.1.4 3.2.3 3.4.0

[jira] [Commented] (SPARK-39867) Global limit should not inherit OrderPreservingUnaryNode

[ https://issues.apache.org/jira/browse/SPARK-39867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574556#comment-17574556 ] Apache Spark commented on SPARK-39867: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-39867) Global limit should not inherit OrderPreservingUnaryNode

[ https://issues.apache.org/jira/browse/SPARK-39867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574558#comment-17574558 ] Apache Spark commented on SPARK-39867: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-39967) Instead of using the scalar tasksSuccessful, use the successful array to calculate whether the task is completed

[ https://issues.apache.org/jira/browse/SPARK-39967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39967: Assignee: Apache Spark > Instead of using the scalar tasksSuccessful, use the successful

[jira] [Assigned] (SPARK-39967) Instead of using the scalar tasksSuccessful, use the successful array to calculate whether the task is completed

[ https://issues.apache.org/jira/browse/SPARK-39967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39967: Assignee: (was: Apache Spark) > Instead of using the scalar tasksSuccessful, use the

[jira] [Commented] (SPARK-39967) Instead of using the scalar tasksSuccessful, use the successful array to calculate whether the task is completed

[ https://issues.apache.org/jira/browse/SPARK-39967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574567#comment-17574567 ] Apache Spark commented on SPARK-39967: -- User 'smallzhongfeng' has created a pull re

[jira] [Updated] (SPARK-39967) Instead of using the scalar tasksSuccessful, use the successful array to calculate whether the task is completed

[ https://issues.apache.org/jira/browse/SPARK-39967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jingxiong zhong updated SPARK-39967: Attachment: spark1-1.png spark2.png spark3-1.png > Instead

[jira] [Updated] (SPARK-39967) Instead of using the scalar tasksSuccessful, use the successful array to calculate whether the task is completed

[ https://issues.apache.org/jira/browse/SPARK-39967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jingxiong zhong updated SPARK-39967: Description: When counting the number of successful tasks in the stage of spark, spark use

[jira] [Resolved] (SPARK-39949) Principals in KafkaTestUtils should use canonical host name

[ https://issues.apache.org/jira/browse/SPARK-39949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39949. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37377 [https://

[jira] [Assigned] (SPARK-39949) Principals in KafkaTestUtils should use canonical host name

[ https://issues.apache.org/jira/browse/SPARK-39949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39949: - Assignee: Jungtaek Lim > Principals in KafkaTestUtils should use canonical host name >

[jira] [Updated] (SPARK-39949) Principals in KafkaTestUtils should use canonical host name

[ https://issues.apache.org/jira/browse/SPARK-39949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39949: -- Parent: SPARK-39457 Issue Type: Sub-task (was: Bug) > Principals in KafkaTestUtils sh

[jira] [Created] (SPARK-39968) Update K8s doc to recommend K8s 1.22+

Dongjoon Hyun created SPARK-39968: - Summary: Update K8s doc to recommend K8s 1.22+ Key: SPARK-39968 URL: https://issues.apache.org/jira/browse/SPARK-39968 Project: Spark Issue Type: Documenta

[jira] [Commented] (SPARK-39968) Update K8s doc to recommend K8s 1.22+

[ https://issues.apache.org/jira/browse/SPARK-39968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574629#comment-17574629 ] Apache Spark commented on SPARK-39968: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-39968) Update K8s doc to recommend K8s 1.22+

[ https://issues.apache.org/jira/browse/SPARK-39968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39968: Assignee: Apache Spark > Update K8s doc to recommend K8s 1.22+ >

[jira] [Assigned] (SPARK-39968) Update K8s doc to recommend K8s 1.22+

[ https://issues.apache.org/jira/browse/SPARK-39968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39968: Assignee: (was: Apache Spark) > Update K8s doc to recommend K8s 1.22+ > -

[jira] [Commented] (SPARK-39968) Update K8s doc to recommend K8s 1.22+

[ https://issues.apache.org/jira/browse/SPARK-39968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574630#comment-17574630 ] Apache Spark commented on SPARK-39968: -- User 'dongjoon-hyun' has created a pull req

[jira] [Updated] (SPARK-35428) Spark history Server to S3 doesn't show incomplete applications

[ https://issues.apache.org/jira/browse/SPARK-35428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rostislav Nedelchev updated SPARK-35428: Attachment: image-2022-08-03-12-03-39-533.png > Spark history Server to S3 doesn't

[jira] [Commented] (SPARK-35428) Spark history Server to S3 doesn't show incomplete applications

[ https://issues.apache.org/jira/browse/SPARK-35428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574649#comment-17574649 ] Rostislav Nedelchev commented on SPARK-35428: - Hey [~kabhwan] , I am also e

[jira] [Assigned] (SPARK-39939) shift() func need support periods=0

[ https://issues.apache.org/jira/browse/SPARK-39939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-39939: - Assignee: bo zhao > shift() func need support periods=0 > -

[jira] [Resolved] (SPARK-39939) shift() func need support periods=0

[ https://issues.apache.org/jira/browse/SPARK-39939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-39939. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37366 [https://

[jira] [Resolved] (SPARK-39900) Issue with querying dataframe produced by 'binaryFile' format using 'not' operator

[ https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39900. -- Fix Version/s: 3.3.1 3.1.4 3.2.3 3.4.0

[jira] [Assigned] (SPARK-39900) Issue with querying dataframe produced by 'binaryFile' format using 'not' operator

[ https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39900: Assignee: zhiming she > Issue with querying dataframe produced by 'binaryFile' format usi

[jira] [Assigned] (SPARK-39968) Update K8s doc to recommend K8s 1.22+

[ https://issues.apache.org/jira/browse/SPARK-39968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39968: Assignee: Dongjoon Hyun > Update K8s doc to recommend K8s 1.22+ > ---

[jira] [Resolved] (SPARK-39968) Update K8s doc to recommend K8s 1.22+

[ https://issues.apache.org/jira/browse/SPARK-39968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39968. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37396 [https://gi

[jira] [Commented] (SPARK-39867) Global limit should not inherit OrderPreservingUnaryNode

[ https://issues.apache.org/jira/browse/SPARK-39867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574711#comment-17574711 ] Apache Spark commented on SPARK-39867: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-39867) Global limit should not inherit OrderPreservingUnaryNode

[ https://issues.apache.org/jira/browse/SPARK-39867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574712#comment-17574712 ] Apache Spark commented on SPARK-39867: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-39867) Global limit should not inherit OrderPreservingUnaryNode

[ https://issues.apache.org/jira/browse/SPARK-39867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574715#comment-17574715 ] Apache Spark commented on SPARK-39867: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-39867) Global limit should not inherit OrderPreservingUnaryNode

[ https://issues.apache.org/jira/browse/SPARK-39867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574714#comment-17574714 ] Apache Spark commented on SPARK-39867: -- User 'ulysses-you' has created a pull reque

[jira] [Updated] (SPARK-39969) Spark AWS SDK and kinesis dependencies lagging hadoop-aws and s3a

[ https://issues.apache.org/jira/browse/SPARK-39969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-39969: --- Priority: Minor (was: Major) > Spark AWS SDK and kinesis dependencies lagging hadoop-aws an

[jira] [Created] (SPARK-39969) Spark AWS SDK and kinesis dependencies lagging hadoop-aws and s3a

Steve Loughran created SPARK-39969: -- Summary: Spark AWS SDK and kinesis dependencies lagging hadoop-aws and s3a Key: SPARK-39969 URL: https://issues.apache.org/jira/browse/SPARK-39969 Project: Spark

[jira] [Commented] (SPARK-39969) Spark AWS SDK and kinesis dependencies lagging hadoop-aws and s3a

[ https://issues.apache.org/jira/browse/SPARK-39969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574720#comment-17574720 ] Steve Loughran commented on SPARK-39969: note: although the latest release fixes

[jira] [Commented] (SPARK-39863) Upgrade Hadoop to 3.3.4

[ https://issues.apache.org/jira/browse/SPARK-39863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574722#comment-17574722 ] Steve Loughran commented on SPARK-39863: probably should follow this with an upg

[jira] [Assigned] (SPARK-39947) Upgrade jersey to 2.36

[ https://issues.apache.org/jira/browse/SPARK-39947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39947: Assignee: Yang Jie > Upgrade jersey to 2.36 > -- > >

[jira] [Resolved] (SPARK-39947) Upgrade jersey to 2.36

[ https://issues.apache.org/jira/browse/SPARK-39947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39947. -- Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-39928) Optimize Utils.getIteratorSize for Scala 2.13 refer to IterableOnceOps.size

[ https://issues.apache.org/jira/browse/SPARK-39928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39928: Assignee: Yang Jie > Optimize Utils.getIteratorSize for Scala 2.13 refer to IterableOnceO

[jira] [Resolved] (SPARK-39928) Optimize Utils.getIteratorSize for Scala 2.13 refer to IterableOnceOps.size

[ https://issues.apache.org/jira/browse/SPARK-39928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39928. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37353 [https://gi

[jira] [Commented] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574766#comment-17574766 ] Yikun Jiang commented on SPARK-39959: - Looks like a little bit wired, we didn't upda

[jira] [Commented] (SPARK-39863) Upgrade Hadoop to 3.3.4

[ https://issues.apache.org/jira/browse/SPARK-39863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574770#comment-17574770 ] Chao Sun commented on SPARK-39863: -- Thanks [~ste...@apache.org], noted > Upgrade Hadoo

[jira] [Commented] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574864#comment-17574864 ] Yikun Jiang commented on SPARK-39959: - - Looks like docker cache not working (do ful

[jira] [Comment Edited] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574864#comment-17574864 ] Yikun Jiang edited comment on SPARK-39959 at 8/3/22 4:56 PM: -

[jira] [Comment Edited] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574864#comment-17574864 ] Yikun Jiang edited comment on SPARK-39959 at 8/3/22 4:59 PM: -

[jira] [Assigned] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39959: Assignee: (was: Apache Spark) > Recover SparkR CRAN check in GitHub Actions CI >

[jira] [Assigned] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39959: Assignee: Apache Spark > Recover SparkR CRAN check in GitHub Actions CI > ---

[jira] [Commented] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574866#comment-17574866 ] Apache Spark commented on SPARK-39959: -- User 'Yikun' has created a pull request for

[jira] [Resolved] (SPARK-39952) SaveIntoDataSourceCommand should recache result relation

[ https://issues.apache.org/jira/browse/SPARK-39952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39952. - Fix Version/s: 3.3.1 3.1.4 3.2.3 3.4.0

[jira] [Commented] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574868#comment-17574868 ] Apache Spark commented on SPARK-39959: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-39952) SaveIntoDataSourceCommand should recache result relation

[ https://issues.apache.org/jira/browse/SPARK-39952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39952: --- Assignee: XiDuo You > SaveIntoDataSourceCommand should recache result relation > --

[jira] [Resolved] (SPARK-39944) Upgrade dropwizard metrics to 4.2.10

[ https://issues.apache.org/jira/browse/SPARK-39944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39944. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37372 [https://

[jira] [Assigned] (SPARK-39944) Upgrade dropwizard metrics to 4.2.10

[ https://issues.apache.org/jira/browse/SPARK-39944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39944: - Assignee: Yang Jie > Upgrade dropwizard metrics to 4.2.10 > ---

[jira] [Resolved] (SPARK-39936) Spark View creation with hyphens in column-type names fails

[ https://issues.apache.org/jira/browse/SPARK-39936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39936. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37364 [https://gith

[jira] [Assigned] (SPARK-39936) Spark View creation with hyphens in column-type names fails

[ https://issues.apache.org/jira/browse/SPARK-39936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39936: --- Assignee: Jeffrey Chen > Spark View creation with hyphens in column-type names fails >

[jira] [Resolved] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39959. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37399 [https://

[jira] [Assigned] (SPARK-39959) Recover SparkR CRAN check in GitHub Actions CI

[ https://issues.apache.org/jira/browse/SPARK-39959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39959: - Assignee: Yikun Jiang > Recover SparkR CRAN check in GitHub Actions CI > --

[jira] [Commented] (SPARK-39957) Delay onDisconnected to enable Driver receives ExecutorExitCode

[ https://issues.apache.org/jira/browse/SPARK-39957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574947#comment-17574947 ] Apache Spark commented on SPARK-39957: -- User 'kevin85421' has created a pull reques

[jira] [Assigned] (SPARK-39957) Delay onDisconnected to enable Driver receives ExecutorExitCode

[ https://issues.apache.org/jira/browse/SPARK-39957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39957: Assignee: Apache Spark > Delay onDisconnected to enable Driver receives ExecutorExitCode

[jira] [Assigned] (SPARK-39957) Delay onDisconnected to enable Driver receives ExecutorExitCode

[ https://issues.apache.org/jira/browse/SPARK-39957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39957: Assignee: (was: Apache Spark) > Delay onDisconnected to enable Driver receives Execut

[jira] [Commented] (SPARK-39957) Delay onDisconnected to enable Driver receives ExecutorExitCode

[ https://issues.apache.org/jira/browse/SPARK-39957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574948#comment-17574948 ] Apache Spark commented on SPARK-39957: -- User 'kevin85421' has created a pull reques

[jira] [Created] (SPARK-39970) Introduce ThrottledLogger to prevent log message flooding caused by network issues

Kai-Hsun Chen created SPARK-39970: - Summary: Introduce ThrottledLogger to prevent log message flooding caused by network issues Key: SPARK-39970 URL: https://issues.apache.org/jira/browse/SPARK-39970

[jira] [Created] (SPARK-39971) ANALYZE TABLE makes some queries run forever

Felipe created SPARK-39971: -- Summary: ANALYZE TABLE makes some queries run forever Key: SPARK-39971 URL: https://issues.apache.org/jira/browse/SPARK-39971 Project: Spark Issue Type: Bug Co

[jira] [Updated] (SPARK-39972) Revert the test case of SPARK-39962 in branch-3.2 and branch-3.1

[ https://issues.apache.org/jira/browse/SPARK-39972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39972: - Description: See https://github.com/apache/spark/pull/37390#issuecomment-1204658808 > Revert th

[jira] [Created] (SPARK-39972) Revert the test case of SPARK-39962 in branch-3.2 and branch-3.1

Hyukjin Kwon created SPARK-39972: Summary: Revert the test case of SPARK-39962 in branch-3.2 and branch-3.1 Key: SPARK-39972 URL: https://issues.apache.org/jira/browse/SPARK-39972 Project: Spark

[jira] [Assigned] (SPARK-39972) Revert the test case of SPARK-39962 in branch-3.2 and branch-3.1

[ https://issues.apache.org/jira/browse/SPARK-39972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39972: Assignee: Hyukjin Kwon > Revert the test case of SPARK-39962 in branch-3.2 and branch-3.1

[jira] [Commented] (SPARK-39972) Revert the test case of SPARK-39962 in branch-3.2 and branch-3.1

[ https://issues.apache.org/jira/browse/SPARK-39972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574983#comment-17574983 ] Apache Spark commented on SPARK-39972: -- User 'HyukjinKwon' has created a pull reque

[jira] [Resolved] (SPARK-39972) Revert the test case of SPARK-39962 in branch-3.2 and branch-3.1

[ https://issues.apache.org/jira/browse/SPARK-39972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39972. -- Fix Version/s: 3.1.4 3.2.3 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-39962) Global aggregation against pandas aggregate UDF does not take the column order into account

[ https://issues.apache.org/jira/browse/SPARK-39962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574984#comment-17574984 ] Apache Spark commented on SPARK-39962: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-39962) Global aggregation against pandas aggregate UDF does not take the column order into account

[ https://issues.apache.org/jira/browse/SPARK-39962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574985#comment-17574985 ] Apache Spark commented on SPARK-39962: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-39962) Global aggregation against pandas aggregate UDF does not take the column order into account

[ https://issues.apache.org/jira/browse/SPARK-39962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574986#comment-17574986 ] Apache Spark commented on SPARK-39962: -- User 'HyukjinKwon' has created a pull reque

[jira] [Created] (SPARK-39973) Avoid noisy warnings logs when spark.scheduler.listenerbus.metrics.maxListenerClassesTimed = 0

Josh Rosen created SPARK-39973: -- Summary: Avoid noisy warnings logs when spark.scheduler.listenerbus.metrics.maxListenerClassesTimed = 0 Key: SPARK-39973 URL: https://issues.apache.org/jira/browse/SPARK-39973

[jira] [Updated] (SPARK-39973) Avoid noisy warnings logs when spark.scheduler.listenerbus.metrics.maxListenerClassesTimed = 0

[ https://issues.apache.org/jira/browse/SPARK-39973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-39973: --- Description: If {{spark.scheduler.listenerbus.metrics.maxListenerClassesTimed}} has been set to {{0

[jira] [Created] (SPARK-39974) Create separate static image tag for infra cache

Yikun Jiang created SPARK-39974: --- Summary: Create separate static image tag for infra cache Key: SPARK-39974 URL: https://issues.apache.org/jira/browse/SPARK-39974 Project: Spark Issue Type: Bu

[jira] [Assigned] (SPARK-39974) Create separate static image tag for infra cache

[ https://issues.apache.org/jira/browse/SPARK-39974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39974: Assignee: Apache Spark > Create separate static image tag for infra cache > -

[jira] [Assigned] (SPARK-39974) Create separate static image tag for infra cache

[ https://issues.apache.org/jira/browse/SPARK-39974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39974: Assignee: (was: Apache Spark) > Create separate static image tag for infra cache > --

[jira] [Commented] (SPARK-39974) Create separate static image tag for infra cache

[ https://issues.apache.org/jira/browse/SPARK-39974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575002#comment-17575002 ] Apache Spark commented on SPARK-39974: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-39974) Create separate static image tag for infra cache

[ https://issues.apache.org/jira/browse/SPARK-39974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575003#comment-17575003 ] Apache Spark commented on SPARK-39974: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-10970) Executors overload Hive metastore by making massive connections at execution time

[ https://issues.apache.org/jira/browse/SPARK-10970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575014#comment-17575014 ] Mitesh commented on SPARK-10970: [~cheolsoo] I'm seeing this on Spark 2.4, here is my ca

[jira] [Created] (SPARK-39975) Upgrade rocksdbjni to 7.4.5

Yang Jie created SPARK-39975: Summary: Upgrade rocksdbjni to 7.4.5 Key: SPARK-39975 URL: https://issues.apache.org/jira/browse/SPARK-39975 Project: Spark Issue Type: Improvement Compone

[jira] [Created] (SPARK-39976) NULL check in ArrayIntersect adds extraneous null from first param

Navin Kumar created SPARK-39976: --- Summary: NULL check in ArrayIntersect adds extraneous null from first param Key: SPARK-39976 URL: https://issues.apache.org/jira/browse/SPARK-39976 Project: Spark

[jira] [Comment Edited] (SPARK-39833) Filtered parquet data frame count() and show() produce inconsistent results when spark.sql.parquet.filterPushdown is true

[ https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575032#comment-17575032 ] Ivan Sadikov edited comment on SPARK-39833 at 8/4/22 5:47 AM:

[jira] [Commented] (SPARK-39833) Filtered parquet data frame count() and show() produce inconsistent results when spark.sql.parquet.filterPushdown is true

[ https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575032#comment-17575032 ] Ivan Sadikov commented on SPARK-39833: -- This is related to case insensitive analysi

[jira] [Comment Edited] (SPARK-39833) Filtered parquet data frame count() and show() produce inconsistent results when spark.sql.parquet.filterPushdown is true

[ https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575032#comment-17575032 ] Ivan Sadikov edited comment on SPARK-39833 at 8/4/22 5:51 AM:

[jira] [Resolved] (SPARK-39934) takeRDD in R is slow

[ https://issues.apache.org/jira/browse/SPARK-39934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39934. -- Resolution: Invalid takeRDD isn;t an API in SparkR > takeRDD in R is slow > -

[jira] [Assigned] (SPARK-39866) Memory leak when closing a session of Spark Thrift Server

[ https://issues.apache.org/jira/browse/SPARK-39866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39866: Assignee: (was: Apache Spark) > Memory leak when closing a session of Spark Thrift S

[jira] [Commented] (SPARK-39866) Memory leak when closing a session of Spark Thrift Server

[ https://issues.apache.org/jira/browse/SPARK-39866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575054#comment-17575054 ] Apache Spark commented on SPARK-39866: -- User 'Resol1992' has created a pull request

[jira] [Assigned] (SPARK-39866) Memory leak when closing a session of Spark Thrift Server

[ https://issues.apache.org/jira/browse/SPARK-39866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39866: Assignee: Apache Spark > Memory leak when closing a session of Spark Thrift Server > ---