[jira] [Commented] (SPARK-27198) Heartbeat interval mismatch in driver and executor

[ https://issues.apache.org/jira/browse/SPARK-27198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806062#comment-16806062 ] Xiao Li commented on SPARK-27198: - [~srowen][~dbtsai] This requires a release note since

[jira] [Updated] (SPARK-27198) Heartbeat interval mismatch in driver and executor

[ https://issues.apache.org/jira/browse/SPARK-27198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27198: Fix Version/s: (was: 2.4.2) 2.4.1 > Heartbeat interval mismatch in driver and execu

[jira] [Updated] (SPARK-27198) Heartbeat interval mismatch in driver and executor

[ https://issues.apache.org/jira/browse/SPARK-27198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27198: Labels: release-notes (was: ) > Heartbeat interval mismatch in driver and executor >

[jira] [Updated] (SPARK-26601) Make broadcast-exchange thread pool keepalivetime and maxThreadNumber configurable

[ https://issues.apache.org/jira/browse/SPARK-26601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26601: -- Priority: Minor (was: Major) > Make broadcast-exchange thread pool keepalivetime and maxThrea

[jira] [Updated] (SPARK-27244) Redact Passwords While Using Option logConf=true

[ https://issues.apache.org/jira/browse/SPARK-27244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27244: -- Summary: Redact Passwords While Using Option logConf=true (was: Conf Log Displays Password In

[jira] [Created] (SPARK-27328) Create 'deprecate' property in ExpressionDescription for SQL functions documentation

Hyukjin Kwon created SPARK-27328: Summary: Create 'deprecate' property in ExpressionDescription for SQL functions documentation Key: SPARK-27328 URL: https://issues.apache.org/jira/browse/SPARK-27328

[jira] [Resolved] (SPARK-26918) All .md should have ASF license header

[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26918. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24243 [https://github.c

[jira] [Assigned] (SPARK-26918) All .md should have ASF license header

[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26918: - Assignee: Sean Owen > All .md should have ASF license header >

[jira] [Resolved] (SPARK-27153) add weightCol in python RegressionEvaluator

[ https://issues.apache.org/jira/browse/SPARK-27153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27153. --- Resolution: Duplicate > add weightCol in python RegressionEvaluator > --

[jira] [Reopened] (SPARK-27192) spark.task.cpus should be less or equal than spark.task.cpus when use static executor allocation

[ https://issues.apache.org/jira/browse/SPARK-27192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-27192: --- This is reverted due to UT failures. > spark.task.cpus should be less or equal than spark.task.

[jira] [Resolved] (SPARK-27326) Fall back all v2 file sources in `InsertIntoTable` to V1 FileFormat

[ https://issues.apache.org/jira/browse/SPARK-27326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27326. --- Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 3.0.0 This is reso

[jira] [Created] (SPARK-27327) New JSON benchmarks: functions, dataset parsing

Maxim Gekk created SPARK-27327: -- Summary: New JSON benchmarks: functions, dataset parsing Key: SPARK-27327 URL: https://issues.apache.org/jira/browse/SPARK-27327 Project: Spark Issue Type: Impro

[jira] [Updated] (SPARK-27192) spark.task.cpus should be less or equal than spark.task.cpus when use static executor allocation

[ https://issues.apache.org/jira/browse/SPARK-27192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27192: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > spark.task.cpus should be le

[jira] [Assigned] (SPARK-27192) spark.task.cpus should be less or equal than spark.task.cpus when use static executor allocation

[ https://issues.apache.org/jira/browse/SPARK-27192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27192: - Assignee: Lijia Liu > spark.task.cpus should be less or equal than spark.task.cpus when use sta

[jira] [Resolved] (SPARK-27192) spark.task.cpus should be less or equal than spark.task.cpus when use static executor allocation

[ https://issues.apache.org/jira/browse/SPARK-27192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27192. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24131 [https://github.c

[jira] [Created] (SPARK-27326) Fall back all v2 file sources in `InsertIntoTable` to V1 FileFormat

Gengliang Wang created SPARK-27326: -- Summary: Fall back all v2 file sources in `InsertIntoTable` to V1 FileFormat Key: SPARK-27326 URL: https://issues.apache.org/jira/browse/SPARK-27326 Project: Spar

[jira] [Commented] (SPARK-24540) Support for multiple delimiter in Spark CSV read

[ https://issues.apache.org/jira/browse/SPARK-24540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805829#comment-16805829 ] Sankara Subramanian commented on SPARK-24540: - [~hyukjin.kwon]  Any follow u

[jira] [Created] (SPARK-27325) Support implicit encoders for LocalDate and Instant

Maxim Gekk created SPARK-27325: -- Summary: Support implicit encoders for LocalDate and Instant Key: SPARK-27325 URL: https://issues.apache.org/jira/browse/SPARK-27325 Project: Spark Issue Type: N

[jira] [Updated] (SPARK-27267) Snappy 1.1.7.1 fails when decompressing empty serialized data

[ https://issues.apache.org/jira/browse/SPARK-27267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27267: -- Fix Version/s: 2.4.2 > Snappy 1.1.7.1 fails when decompressing empty serialized data > ---

[jira] [Resolved] (SPARK-27301) DStreamCheckpointData failed to clean up because it's fileSystem cached

[ https://issues.apache.org/jira/browse/SPARK-27301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27301. --- Resolution: Fixed Fix Version/s: 2.3.4 2.4.2 3.0.0 Issu

[jira] [Assigned] (SPARK-27301) DStreamCheckpointData failed to clean up because it's fileSystem cached

[ https://issues.apache.org/jira/browse/SPARK-27301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27301: - Assignee: Kent Yao > DStreamCheckpointData failed to clean up because it's fileSystem cached >

[jira] [Resolved] (SPARK-27121) Resolve Scala compiler failure for Java 9+ in REPL

[ https://issues.apache.org/jira/browse/SPARK-27121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27121. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24239 [https://github.c

[jira] [Assigned] (SPARK-27121) Resolve Scala compiler failure for Java 9+ in REPL

[ https://issues.apache.org/jira/browse/SPARK-27121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27121: - Assignee: Sean Owen > Resolve Scala compiler failure for Java 9+ in REPL >

[jira] [Assigned] (SPARK-27320) Converting seq to array in AggregationIterator to improve its access performance

[ https://issues.apache.org/jira/browse/SPARK-27320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27320: - Assignee: eaton > Converting seq to array in AggregationIterator to improve its access > perfo

[jira] [Resolved] (SPARK-27320) Converting seq to array in AggregationIterator to improve its access performance

[ https://issues.apache.org/jira/browse/SPARK-27320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27320. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24238 [https://github.c