[jira] [Comment Edited] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130164#comment-17130164 ] Brandon edited comment on SPARK-31911 at 6/10/20, 6:35 AM: --- So

[jira] [Comment Edited] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130164#comment-17130164 ] Brandon edited comment on SPARK-31911 at 6/10/20, 6:34 AM: --- So

[jira] [Commented] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130164#comment-17130164 ] Brandon commented on SPARK-31911: - Some more notes: My Spark app is configured with `s

[jira] [Commented] (SPARK-30062) bug with DB2Driver using mode("overwrite") option("truncate",True)

[ https://issues.apache.org/jira/browse/SPARK-30062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130128#comment-17130128 ] Jason Depp Dev commented on SPARK-30062: I've ran into the same issue under Scal

[jira] [Commented] (SPARK-31935) Hadoop file system config should be effective in data source options

[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130065#comment-17130065 ] Apache Spark commented on SPARK-31935: -- User 'gengliangwang' has created a pull req

[jira] [Comment Edited] (SPARK-31946) Failed to register SIGPWR handler on MacOS

[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130059#comment-17130059 ] Jungtaek Lim edited comment on SPARK-31946 at 6/10/20, 4:31 AM: --

[jira] [Commented] (SPARK-31946) Failed to register SIGPWR handler on MacOS

[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130059#comment-17130059 ] Jungtaek Lim commented on SPARK-31946: -- Oh I see what you meant. Thanks for making

[jira] [Commented] (SPARK-31486) spark.submit.waitForCompletion flag to control spark-submit exit in Standalone Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-31486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130034#comment-17130034 ] Apache Spark commented on SPARK-31486: -- User 'Ngone51' has created a pull request f

[jira] [Commented] (SPARK-19169) columns changed orc table encouter 'IndexOutOfBoundsException' when read the old schema files

[ https://issues.apache.org/jira/browse/SPARK-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130033#comment-17130033 ] angerszhu commented on SPARK-19169: --- [~hyukjin.kwon]   Today our user meet this erro

[jira] [Updated] (SPARK-31948) expose mapSideCombine in aggByKey/reduceByKey/foldByKey

[ https://issues.apache.org/jira/browse/SPARK-31948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-31948: - Description: {{1, aggregateByKey,}} {{reduceByKey}} and  {{foldByKey}} will always perform {{ma

[jira] [Updated] (SPARK-31948) expose mapSideCombine in aggByKey/reduceByKey/foldByKey

[ https://issues.apache.org/jira/browse/SPARK-31948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-31948: - Description: {{1, aggregateByKey,}} {{reduceByKey}} and  {{foldByKey}} will always perform {{ma

[jira] [Created] (SPARK-31948) expose mapSideCombine in aggByKey/reduceByKey/foldByKey

zhengruifeng created SPARK-31948: Summary: expose mapSideCombine in aggByKey/reduceByKey/foldByKey Key: SPARK-31948 URL: https://issues.apache.org/jira/browse/SPARK-31948 Project: Spark Issue

[jira] [Commented] (SPARK-31946) Failed to register SIGPWR handler on MacOS

[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130015#comment-17130015 ] wuyi commented on SPARK-31946: -- oh, I mean, for the **decommission** feature, we should reg

[jira] [Comment Edited] (SPARK-31946) Failed to register SIGPWR handler on MacOS

[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130015#comment-17130015 ] wuyi edited comment on SPARK-31946 at 6/10/20, 3:27 AM: oh, I me

[jira] [Commented] (SPARK-31925) Summary.totalIterations greater than maxIters

[ https://issues.apache.org/jira/browse/SPARK-31925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130004#comment-17130004 ] Sean R. Owen commented on SPARK-31925: -- Sounds like a small bug, unless one of the

[jira] [Commented] (SPARK-31925) Summary.totalIterations greater than maxIters

[ https://issues.apache.org/jira/browse/SPARK-31925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130002#comment-17130002 ] zhengruifeng commented on SPARK-31925: -- also ping [~srowen]  [~weichenxu123] > Sum

[jira] [Commented] (SPARK-31946) Failed to register SIGPWR handler on MacOS

[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130001#comment-17130001 ] Jungtaek Lim commented on SPARK-31946: -- It’s intended to take up non-posix complian

[jira] [Resolved] (SPARK-29897) Implicit cast to timestamp is failing

[ https://issues.apache.org/jira/browse/SPARK-29897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29897. - Resolution: Won't Do > Implicit cast to timestamp is failing >

[jira] [Commented] (SPARK-31946) Failed to register SIGPWR handler on MacOS

[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129982#comment-17129982 ] wuyi commented on SPARK-31946: -- The message is good. But the failure should not be expected

[jira] [Commented] (SPARK-31947) Solve string value error about Date/Timestamp in ScriptTransform

[ https://issues.apache.org/jira/browse/SPARK-31947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129973#comment-17129973 ] angerszhu commented on SPARK-31947: --- raise pr soon > Solve string value error about D

[jira] [Created] (SPARK-31947) Solve string value error about Date/Timestamp in ScriptTransform

angerszhu created SPARK-31947: - Summary: Solve string value error about Date/Timestamp in ScriptTransform Key: SPARK-31947 URL: https://issues.apache.org/jira/browse/SPARK-31947 Project: Spark I

[jira] [Comment Edited] (SPARK-31946) Failed to register SIGPWR handler on MacOS

[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129955#comment-17129955 ] Jungtaek Lim edited comment on SPARK-31946 at 6/10/20, 2:12 AM: --

[jira] [Commented] (SPARK-31946) Failed to register SIGPWR handler on MacOS

[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129955#comment-17129955 ] Jungtaek Lim commented on SPARK-31946: -- That message is intended. It wasn't showing

[jira] [Commented] (SPARK-31945) Make more cache enable for Python UDFs.

[ https://issues.apache.org/jira/browse/SPARK-31945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129951#comment-17129951 ] Apache Spark commented on SPARK-31945: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-31945) Make more cache enable for Python UDFs.

[ https://issues.apache.org/jira/browse/SPARK-31945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31945: Assignee: Apache Spark > Make more cache enable for Python UDFs. > --

[jira] [Updated] (SPARK-31946) Failed to register SIGPWR handler on MacOS

[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31946: - Description:   {code:java} 20/06/09 22:54:54 WARN SignalUtils: Failed to register SIGPWR handler - disabling de

[jira] [Commented] (SPARK-31945) Make more cache enable for Python UDFs.

[ https://issues.apache.org/jira/browse/SPARK-31945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129948#comment-17129948 ] Apache Spark commented on SPARK-31945: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-31945) Make more cache enable for Python UDFs.

[ https://issues.apache.org/jira/browse/SPARK-31945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31945: Assignee: (was: Apache Spark) > Make more cache enable for Python UDFs. > ---

[jira] [Commented] (SPARK-31946) Failed to register SIGPWR handler on MacOS

[ https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129947#comment-17129947 ] wuyi commented on SPARK-31946: -- cc [~holden] > Failed to register SIGPWR handler on MacOS

[jira] [Created] (SPARK-31946) Failed to register SIGPWR handler on MacOS

wuyi created SPARK-31946: Summary: Failed to register SIGPWR handler on MacOS Key: SPARK-31946 URL: https://issues.apache.org/jira/browse/SPARK-31946 Project: Spark Issue Type: Sub-task Com

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129944#comment-17129944 ] Wenchen Fan commented on SPARK-26905: - [~maropu] shall we also add the listed non-re

[jira] [Created] (SPARK-31945) Make more cache enable for Python UDFs.

Takuya Ueshin created SPARK-31945: - Summary: Make more cache enable for Python UDFs. Key: SPARK-31945 URL: https://issues.apache.org/jira/browse/SPARK-31945 Project: Spark Issue Type: Improve

[jira] [Comment Edited] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129904#comment-17129904 ] Takeshi Yamamuro edited comment on SPARK-26905 at 6/10/20, 1:20 AM: --

[jira] [Assigned] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26905: Assignee: (was: Apache Spark) > Revisit reserved/non-reserved keywords based on the A

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129906#comment-17129906 ] Apache Spark commented on SPARK-26905: -- User 'maropu' has created a pull request fo

[jira] [Assigned] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26905: Assignee: Apache Spark > Revisit reserved/non-reserved keywords based on the ANSI SQL sta

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129905#comment-17129905 ] Takeshi Yamamuro commented on SPARK-26905: -- I've opened a PR to add TYPE in the

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129904#comment-17129904 ] Takeshi Yamamuro commented on SPARK-26905: -- Thanks for checking them, Maxim! Ah

[jira] [Commented] (SPARK-31944) Add instance weight support in LinearRegressionSummary

[ https://issues.apache.org/jira/browse/SPARK-31944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129844#comment-17129844 ] Apache Spark commented on SPARK-31944: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-31944) Add instance weight support in LinearRegressionSummary

[ https://issues.apache.org/jira/browse/SPARK-31944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31944: Assignee: (was: Apache Spark) > Add instance weight support in LinearRegressionSummar

[jira] [Assigned] (SPARK-31944) Add instance weight support in LinearRegressionSummary

[ https://issues.apache.org/jira/browse/SPARK-31944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31944: Assignee: Apache Spark > Add instance weight support in LinearRegressionSummary > ---

[jira] [Created] (SPARK-31944) Add instance weight support in LinearRegressionSummary

Huaxin Gao created SPARK-31944: -- Summary: Add instance weight support in LinearRegressionSummary Key: SPARK-31944 URL: https://issues.apache.org/jira/browse/SPARK-31944 Project: Spark Issue Type

[jira] [Commented] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129814#comment-17129814 ] Everett Rush commented on SPARK-27249: -- [~nafshartous] Hi Nick, thanks for looping

[jira] [Commented] (SPARK-31935) Hadoop file system config should be effective in data source options

[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129747#comment-17129747 ] Apache Spark commented on SPARK-31935: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-31935) Hadoop file system config should be effective in data source options

[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129746#comment-17129746 ] Apache Spark commented on SPARK-31935: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129737#comment-17129737 ] Maxim Gekk commented on SPARK-26905: Spark's reserved keywords that are not reserved

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129732#comment-17129732 ] Xiao Li commented on SPARK-26905: - cc [~maropu] > Revisit reserved/non-reserved keyword

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129730#comment-17129730 ] Maxim Gekk commented on SPARK-26905: Spark's ANSI Non-Reserved keywords are actually

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129729#comment-17129729 ] Maxim Gekk commented on SPARK-26905: I downloaded SQL2016 reserved and non-reserved

[jira] [Updated] (SPARK-31935) Hadoop file system config should be effective in data source options

[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-31935: --- Affects Version/s: 2.4.7 3.0.1 > Hadoop file system config should be

[jira] [Updated] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-26905: --- Attachment: sql2016-02-nonreserved.txt sql2016-02-reserved.txt sql201

[jira] [Resolved] (SPARK-31830) Consistent error handling for datetime formatting functions

[ https://issues.apache.org/jira/browse/SPARK-31830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31830. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28650 [https://gith

[jira] [Resolved] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31926. - Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31926: --- Assignee: Kent Yao > Fix concurrency issue for ThriftCLIService to getPortNumber >

[jira] [Updated] (SPARK-31932) Add date/timestamp benchmarks for toHiveString

[ https://issues.apache.org/jira/browse/SPARK-31932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31932: -- Fix Version/s: (was: 3.0.0) 3.1.0 3.0.1 > Add date/t

[jira] [Updated] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31940: -- Fix Version/s: (was: 3.0.0) 3.1.0 3.0.1 > Document t

[jira] [Commented] (SPARK-31220) repartition obeys spark.sql.adaptive.coalescePartitions.initialPartitionNum when spark.sql.adaptive.enabled

[ https://issues.apache.org/jira/browse/SPARK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129529#comment-17129529 ] Dongjoon Hyun commented on SPARK-31220: --- Hi, [~cloud_fan]. I updated the fixed ver

[jira] [Updated] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

[ https://issues.apache.org/jira/browse/SPARK-31921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31921: -- Fix Version/s: 3.1.0 > Wrong warning of "WARN Master: App app-xxx requires more resource than

[jira] [Updated] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

[ https://issues.apache.org/jira/browse/SPARK-31921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31921: -- Fix Version/s: (was: 3.0.0) 3.0.1 > Wrong warning of "WARN Master: App

[jira] [Updated] (SPARK-31220) repartition obeys spark.sql.adaptive.coalescePartitions.initialPartitionNum when spark.sql.adaptive.enabled

[ https://issues.apache.org/jira/browse/SPARK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31220: -- Fix Version/s: (was: 3.0.0) 3.1.0 3.0.1 > repartitio

[jira] [Resolved] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

[ https://issues.apache.org/jira/browse/SPARK-31921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31921. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28742 [https://

[jira] [Assigned] (SPARK-31921) Wrong warning of "WARN Master: App app-xxx requires more resource than any of Workers could have."

[ https://issues.apache.org/jira/browse/SPARK-31921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31921: - Assignee: wuyi > Wrong warning of "WARN Master: App app-xxx requires more resource than

[jira] [Assigned] (SPARK-31220) repartition obeys spark.sql.adaptive.coalescePartitions.initialPartitionNum when spark.sql.adaptive.enabled

[ https://issues.apache.org/jira/browse/SPARK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31220: --- Assignee: Yuming Wang > repartition obeys spark.sql.adaptive.coalescePartitions.initialPart

[jira] [Resolved] (SPARK-31220) repartition obeys spark.sql.adaptive.coalescePartitions.initialPartitionNum when spark.sql.adaptive.enabled

[ https://issues.apache.org/jira/browse/SPARK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31220. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27986 [https://gith

[jira] [Updated] (SPARK-31943) SPARK-31500 introduces breaking changes in 2.4.6

[ https://issues.apache.org/jira/browse/SPARK-31943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jefferson V updated SPARK-31943: Labels: backward-incompatible (was: ) > SPARK-31500 introduces breaking changes in 2.4.6 > --

[jira] [Updated] (SPARK-31943) SPARK-31500 introduces breaking changes in 2.4.6

[ https://issues.apache.org/jira/browse/SPARK-31943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jefferson V updated SPARK-31943: Description: [31500|[https://github.com/apache/spark/pull/28351/files]] introduced unimplemented

[jira] [Created] (SPARK-31943) SPARK-31500 introduces breaking changes in 2.4.6

Jefferson V created SPARK-31943: --- Summary: SPARK-31500 introduces breaking changes in 2.4.6 Key: SPARK-31943 URL: https://issues.apache.org/jira/browse/SPARK-31943 Project: Spark Issue Type: Bu

[jira] [Resolved] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31940. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28767 [https://gith

[jira] [Assigned] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31940: --- Assignee: Maxim Gekk > Document the default JVM time zone in to/fromJavaDate and legacy dat

[jira] [Updated] (SPARK-31486) spark.submit.waitForCompletion flag to control spark-submit exit in Standalone Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-31486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31486: - Priority: Minor (was: Major) > spark.submit.waitForCompletion flag to control spark-submit exit

[jira] [Resolved] (SPARK-31486) spark.submit.waitForCompletion flag to control spark-submit exit in Standalone Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-31486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31486. -- Fix Version/s: 3.1.0 Assignee: Akshat Bordia Resolution: Fixed Resolved by htt

[jira] [Resolved] (SPARK-31906) Enhance comments in NamedExpression.qualifier

[ https://issues.apache.org/jira/browse/SPARK-31906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31906. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28726 [https://gith

[jira] [Assigned] (SPARK-31906) Enhance comments in NamedExpression.qualifier

[ https://issues.apache.org/jira/browse/SPARK-31906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31906: --- Assignee: Zhu, Lipeng > Enhance comments in NamedExpression.qualifier > ---

[jira] [Commented] (SPARK-28834) JDBC option "sessionInitStatement" does not executes sql statement when write data into database from dataframe

[ https://issues.apache.org/jira/browse/SPARK-28834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129209#comment-17129209 ] Thomas Uhren commented on SPARK-28834: -- Any chance to get this issue resolved? > J

[jira] [Commented] (SPARK-31864) Adjust AQE skew join trigger condition

[ https://issues.apache.org/jira/browse/SPARK-31864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129187#comment-17129187 ] Apache Spark commented on SPARK-31864: -- User 'manuzhang' has created a pull request

[jira] [Commented] (SPARK-31942) Revert SPARK-31864 Adjust AQE skew join trigger condition

[ https://issues.apache.org/jira/browse/SPARK-31942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129185#comment-17129185 ] Apache Spark commented on SPARK-31942: -- User 'manuzhang' has created a pull request

[jira] [Commented] (SPARK-31864) Adjust AQE skew join trigger condition

[ https://issues.apache.org/jira/browse/SPARK-31864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129186#comment-17129186 ] Apache Spark commented on SPARK-31864: -- User 'manuzhang' has created a pull request

[jira] [Commented] (SPARK-31942) Revert SPARK-31864 Adjust AQE skew join trigger condition

[ https://issues.apache.org/jira/browse/SPARK-31942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129184#comment-17129184 ] Apache Spark commented on SPARK-31942: -- User 'manuzhang' has created a pull request

[jira] [Assigned] (SPARK-31942) Revert SPARK-31864 Adjust AQE skew join trigger condition

[ https://issues.apache.org/jira/browse/SPARK-31942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31942: Assignee: Apache Spark > Revert SPARK-31864 Adjust AQE skew join trigger condition >

[jira] [Assigned] (SPARK-31942) Revert SPARK-31864 Adjust AQE skew join trigger condition

[ https://issues.apache.org/jira/browse/SPARK-31942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31942: Assignee: (was: Apache Spark) > Revert SPARK-31864 Adjust AQE skew join trigger condi

[jira] [Created] (SPARK-31942) Revert SPARK-31864 Adjust AQE skew join trigger condition

Manu Zhang created SPARK-31942: -- Summary: Revert SPARK-31864 Adjust AQE skew join trigger condition Key: SPARK-31942 URL: https://issues.apache.org/jira/browse/SPARK-31942 Project: Spark Issue T

[jira] [Commented] (SPARK-31927) Upgrade fabric8 to 4.10.2 to support Kubernetes 1.18

[ https://issues.apache.org/jira/browse/SPARK-31927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129153#comment-17129153 ] Jaakko Pallari commented on SPARK-31927: Actually, the fix for SPARK-31819 is su

[jira] [Assigned] (SPARK-31929) local cache size exceeding "spark.history.store.maxDiskUsage" triggered "java.io.IOException" in history server on Windows

[ https://issues.apache.org/jira/browse/SPARK-31929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31929: Assignee: (was: Apache Spark) > local cache size exceeding "spark.history.store.maxDi

[jira] [Assigned] (SPARK-31929) local cache size exceeding "spark.history.store.maxDiskUsage" triggered "java.io.IOException" in history server on Windows

[ https://issues.apache.org/jira/browse/SPARK-31929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31929: Assignee: Apache Spark > local cache size exceeding "spark.history.store.maxDiskUsage" tr

[jira] [Commented] (SPARK-31929) local cache size exceeding "spark.history.store.maxDiskUsage" triggered "java.io.IOException" in history server on Windows

[ https://issues.apache.org/jira/browse/SPARK-31929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129101#comment-17129101 ] Apache Spark commented on SPARK-31929: -- User 'zhli1142015' has created a pull reque

[jira] [Commented] (SPARK-31929) local cache size exceeding "spark.history.store.maxDiskUsage" triggered "java.io.IOException" in history server on Windows

[ https://issues.apache.org/jira/browse/SPARK-31929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129102#comment-17129102 ] Apache Spark commented on SPARK-31929: -- User 'zhli1142015' has created a pull reque

[jira] [Commented] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

[ https://issues.apache.org/jira/browse/SPARK-31941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129074#comment-17129074 ] Apache Spark commented on SPARK-31941: -- User 'SaurabhChawla100' has created a pull

[jira] [Assigned] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

[ https://issues.apache.org/jira/browse/SPARK-31941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31941: Assignee: (was: Apache Spark) > Handling the exception in SparkUI for getSparkUser me

[jira] [Commented] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

[ https://issues.apache.org/jira/browse/SPARK-31941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129073#comment-17129073 ] Apache Spark commented on SPARK-31941: -- User 'SaurabhChawla100' has created a pull

[jira] [Assigned] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

[ https://issues.apache.org/jira/browse/SPARK-31941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31941: Assignee: Apache Spark > Handling the exception in SparkUI for getSparkUser method >

[jira] [Created] (SPARK-31941) Handling the exception in SparkUI for getSparkUser method

Saurabh Chawla created SPARK-31941: -- Summary: Handling the exception in SparkUI for getSparkUser method Key: SPARK-31941 URL: https://issues.apache.org/jira/browse/SPARK-31941 Project: Spark

[jira] [Commented] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129055#comment-17129055 ] Apache Spark commented on SPARK-31940: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129054#comment-17129054 ] Apache Spark commented on SPARK-31940: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31940: Assignee: (was: Apache Spark) > Document the default JVM time zone in to/fromJavaDate

[jira] [Assigned] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

[ https://issues.apache.org/jira/browse/SPARK-31940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31940: Assignee: Apache Spark > Document the default JVM time zone in to/fromJavaDate and legacy

[jira] [Created] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

Maxim Gekk created SPARK-31940: -- Summary: Document the default JVM time zone in to/fromJavaDate and legacy date formatters Key: SPARK-31940 URL: https://issues.apache.org/jira/browse/SPARK-31940 Project:

[jira] [Assigned] (SPARK-31939) Fix Parsing day of year when year field pattern is missing

[ https://issues.apache.org/jira/browse/SPARK-31939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31939: Assignee: (was: Apache Spark) > Fix Parsing day of year when year field pattern is mi

[jira] [Commented] (SPARK-31939) Fix Parsing day of year when year field pattern is missing

[ https://issues.apache.org/jira/browse/SPARK-31939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129025#comment-17129025 ] Apache Spark commented on SPARK-31939: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-31939) Fix Parsing day of year when year field pattern is missing

[ https://issues.apache.org/jira/browse/SPARK-31939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129024#comment-17129024 ] Apache Spark commented on SPARK-31939: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-31939) Fix Parsing day of year when year field pattern is missing

[ https://issues.apache.org/jira/browse/SPARK-31939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31939: Assignee: Apache Spark > Fix Parsing day of year when year field pattern is missing > ---

  1   2   >