[jira] [Resolved] (SPARK-26904) API Auditing

[ https://issues.apache.org/jira/browse/SPARK-26904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-26904. - Resolution: Done > API Auditing > > > Key: SPARK-26904 > UR

[jira] [Comment Edited] (SPARK-26043) Make SparkHadoopUtil private to Spark

[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128908#comment-17128908 ] Hyukjin Kwon edited comment on SPARK-26043 at 6/9/20, 6:37 AM: ---

[jira] [Commented] (SPARK-21117) Built-in SQL Function Support - WIDTH_BUCKET

[ https://issues.apache.org/jira/browse/SPARK-21117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128919#comment-17128919 ] Apache Spark commented on SPARK-21117: -- User 'maropu' has created a pull request fo

[jira] [Comment Edited] (SPARK-26043) Make SparkHadoopUtil private to Spark

[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128908#comment-17128908 ] Hyukjin Kwon edited comment on SPARK-26043 at 6/9/20, 6:29 AM: ---

[jira] [Commented] (SPARK-26043) Make SparkHadoopUtil private to Spark

[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128908#comment-17128908 ] Hyukjin Kwon commented on SPARK-26043: -- Shall we discuss and conclude what to put i

[jira] [Commented] (SPARK-26043) Make SparkHadoopUtil private to Spark

[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128899#comment-17128899 ] Wenchen Fan commented on SPARK-26043: - it depends on the definition of migration gui

[jira] [Resolved] (SPARK-31932) Add date/timestamp benchmarks for toHiveString

[ https://issues.apache.org/jira/browse/SPARK-31932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31932. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28757 [https://gith

[jira] [Assigned] (SPARK-31932) Add date/timestamp benchmarks for toHiveString

[ https://issues.apache.org/jira/browse/SPARK-31932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31932: --- Assignee: Maxim Gekk > Add date/timestamp benchmarks for toHiveString > ---

[jira] [Commented] (SPARK-28199) Move Trigger implementations to Triggers.scala and avoid exposing these to the end users

[ https://issues.apache.org/jira/browse/SPARK-28199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128804#comment-17128804 ] Apache Spark commented on SPARK-28199: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-26043) Make SparkHadoopUtil private to Spark

[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128800#comment-17128800 ] Sean R. Owen commented on SPARK-26043: -- I think it's the other way around: some thi

[jira] [Commented] (SPARK-26026) Published Scaladoc jars missing from Maven Central

[ https://issues.apache.org/jira/browse/SPARK-26026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128799#comment-17128799 ] Sean R. Owen commented on SPARK-26026: -- I'm OK with that too, just going with a gen

[jira] [Commented] (SPARK-26026) Published Scaladoc jars missing from Maven Central

[ https://issues.apache.org/jira/browse/SPARK-26026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128790#comment-17128790 ] Wenchen Fan commented on SPARK-26026: - I think users will not use `InterfaceStabilit

[jira] [Commented] (SPARK-26043) Make SparkHadoopUtil private to Spark

[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128788#comment-17128788 ] Wenchen Fan commented on SPARK-26043: - I feel this is a tiny thing that we should pu

[jira] [Commented] (SPARK-26026) Published Scaladoc jars missing from Maven Central

[ https://issues.apache.org/jira/browse/SPARK-26026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128783#comment-17128783 ] Sean R. Owen commented on SPARK-26026: -- [~cloud_fan] The cause ended up being how s

[jira] [Commented] (SPARK-26026) Published Scaladoc jars missing from Maven Central

[ https://issues.apache.org/jira/browse/SPARK-26026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128781#comment-17128781 ] Wenchen Fan commented on SPARK-26026: - It's just about missing document jars, and we

[jira] [Created] (SPARK-31938) To perfect using constraints of script transform

angerszhu created SPARK-31938: - Summary: To perfect using constraints of script transform Key: SPARK-31938 URL: https://issues.apache.org/jira/browse/SPARK-31938 Project: Spark Issue Type: Sub-ta

[jira] [Assigned] (SPARK-31936) Implement ScriptTransform in sql/core

[ https://issues.apache.org/jira/browse/SPARK-31936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31936: Assignee: (was: Apache Spark) > Implement ScriptTransform in sql/core > -

[jira] [Assigned] (SPARK-31936) Implement ScriptTransform in sql/core

[ https://issues.apache.org/jira/browse/SPARK-31936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31936: Assignee: Apache Spark > Implement ScriptTransform in sql/core >

[jira] [Commented] (SPARK-31936) Implement ScriptTransform in sql/core

[ https://issues.apache.org/jira/browse/SPARK-31936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128769#comment-17128769 ] Apache Spark commented on SPARK-31936: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-31936) Implement ScriptTransform in sql/core

[ https://issues.apache.org/jira/browse/SPARK-31936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31936: Assignee: (was: Apache Spark) > Implement ScriptTransform in sql/core > -

[jira] [Created] (SPARK-31937) Support processing array and map type using script transform

angerszhu created SPARK-31937: - Summary: Support processing array and map type using script transform Key: SPARK-31937 URL: https://issues.apache.org/jira/browse/SPARK-31937 Project: Spark Issue

[jira] [Updated] (SPARK-28227) Spark can’t support TRANSFORM with aggregation

[ https://issues.apache.org/jira/browse/SPARK-28227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28227: -- Parent: SPARK-31936 Issue Type: Sub-task (was: Improvement) > Spark can’t support TRANSFORM

[jira] [Created] (SPARK-31936) Implement ScriptTransform in sql/core

angerszhu created SPARK-31936: - Summary: Implement ScriptTransform in sql/core Key: SPARK-31936 URL: https://issues.apache.org/jira/browse/SPARK-31936 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-31849) Improve Python exception messages to be more Pythonic

[ https://issues.apache.org/jira/browse/SPARK-31849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128746#comment-17128746 ] Apache Spark commented on SPARK-31849: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-25557) ORC predicate pushdown for nested fields

[ https://issues.apache.org/jira/browse/SPARK-25557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25557: Assignee: (was: Apache Spark) > ORC predicate pushdown for nested fields > --

[jira] [Assigned] (SPARK-25557) ORC predicate pushdown for nested fields

[ https://issues.apache.org/jira/browse/SPARK-25557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25557: Assignee: Apache Spark > ORC predicate pushdown for nested fields > -

[jira] [Commented] (SPARK-25557) ORC predicate pushdown for nested fields

[ https://issues.apache.org/jira/browse/SPARK-25557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128729#comment-17128729 ] Apache Spark commented on SPARK-25557: -- User 'viirya' has created a pull request fo

[jira] [Updated] (SPARK-31935) Hadoop file system config should be effective in data source options

[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-31935: --- Summary: Hadoop file system config should be effective in data source options (was: Data s

[jira] [Updated] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-31923: - Affects Version/s: 2.3.0 2.3.1 2.3.2

[jira] [Updated] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-31923: - Affects Version/s: 2.4.0 2.4.1 2.4.2

[jira] [Issue Comment Deleted] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-31923: - Comment: was deleted (was: User 'zsxwing' has created a pull request for this issue: https://git

[jira] [Assigned] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31923: Assignee: Apache Spark (was: Shixiong Zhu) > Event log cannot be generated when some int

[jira] [Resolved] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-31923. -- Assignee: Shixiong Zhu (was: Apache Spark) Resolution: Fixed > Event log cannot be gene

[jira] [Assigned] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-31923: Assignee: Shixiong Zhu > Event log cannot be generated when some internal accumulators us

[jira] [Updated] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-31923: - Fix Version/s: 2.4.7 > Event log cannot be generated when some internal accumulators use unexpec

[jira] [Assigned] (SPARK-31935) Data source options should be propagated in method `checkAndGlobPathIfNecessary`

[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31935: Assignee: (was: Apache Spark) > Data source options should be propagated in method >

[jira] [Commented] (SPARK-31935) Data source options should be propagated in method `checkAndGlobPathIfNecessary`

[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128711#comment-17128711 ] Apache Spark commented on SPARK-31935: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-31935) Data source options should be propagated in method `checkAndGlobPathIfNecessary`

[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31935: Assignee: Apache Spark > Data source options should be propagated in method > `checkAndG

[jira] [Created] (SPARK-31935) Data source options should be propagated in method `checkAndGlobPathIfNecessary`

Gengliang Wang created SPARK-31935: -- Summary: Data source options should be propagated in method `checkAndGlobPathIfNecessary` Key: SPARK-31935 URL: https://issues.apache.org/jira/browse/SPARK-31935

[jira] [Comment Edited] (SPARK-31931) When using GCS as checkpoint location for Structured Streaming aggregation pipeline, the Spark writing job is aborted

[ https://issues.apache.org/jira/browse/SPARK-31931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128707#comment-17128707 ] Jungtaek Lim edited comment on SPARK-31931 at 6/8/20, 11:12 PM: --

[jira] [Commented] (SPARK-31931) When using GCS as checkpoint location for Structured Streaming aggregation pipeline, the Spark writing job is aborted

[ https://issues.apache.org/jira/browse/SPARK-31931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128707#comment-17128707 ] Jungtaek Lim commented on SPARK-31931: -- Well, I looked into the attached file, and

[jira] [Commented] (SPARK-31931) When using GCS as checkpoint location for Structured Streaming aggregation pipeline, the Spark writing job is aborted

[ https://issues.apache.org/jira/browse/SPARK-31931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128705#comment-17128705 ] Jungtaek Lim commented on SPARK-31931: -- Critical+ is reserved for committers. Lower

[jira] [Resolved] (SPARK-31934) Don't print out extra info from the docker image tool if passed --help

[ https://issues.apache.org/jira/browse/SPARK-31934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31934. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed > Don't print out extra

[jira] [Updated] (SPARK-31931) When using GCS as checkpoint location for Structured Streaming aggregation pipeline, the Spark writing job is aborted

[ https://issues.apache.org/jira/browse/SPARK-31931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-31931: - Priority: Major (was: Blocker) > When using GCS as checkpoint location for Structured Streaming

[jira] [Assigned] (SPARK-31934) Don't print out extra info from the docker image tool if passed --help

[ https://issues.apache.org/jira/browse/SPARK-31934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31934: Assignee: Apache Spark (was: Holden Karau) > Don't print out extra info from the docker

[jira] [Assigned] (SPARK-31934) Don't print out extra info from the docker image tool if passed --help

[ https://issues.apache.org/jira/browse/SPARK-31934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31934: Assignee: Holden Karau (was: Apache Spark) > Don't print out extra info from the docker

[jira] [Commented] (SPARK-31934) Don't print out extra info from the docker image tool if passed --help

[ https://issues.apache.org/jira/browse/SPARK-31934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128700#comment-17128700 ] Apache Spark commented on SPARK-31934: -- User 'holdenk' has created a pull request f

[jira] [Created] (SPARK-31934) Don't print out extra info from the docker image tool if passed --help

Holden Karau created SPARK-31934: Summary: Don't print out extra info from the docker image tool if passed --help Key: SPARK-31934 URL: https://issues.apache.org/jira/browse/SPARK-31934 Project: Spark

[jira] [Commented] (SPARK-30274) Avoid BytesToBytesMap lookup hang forever when holding keys reaching max capacity

[ https://issues.apache.org/jira/browse/SPARK-30274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128649#comment-17128649 ] Dongjoon Hyun commented on SPARK-30274: --- I removed the label, `release-notes`, sin

[jira] [Updated] (SPARK-30274) Avoid BytesToBytesMap lookup hang forever when holding keys reaching max capacity

[ https://issues.apache.org/jira/browse/SPARK-30274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30274: -- Labels: (was: release-notes) > Avoid BytesToBytesMap lookup hang forever when holding keys r

[jira] [Resolved] (SPARK-30845) spark-submit pyspark app on yarn uploads local pyspark archives

[ https://issues.apache.org/jira/browse/SPARK-30845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-30845. --- Fix Version/s: 3.1.0 Assignee: shanyu zhao Resolution: Fixed > spark-submit

[jira] [Commented] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128639#comment-17128639 ] Apache Spark commented on SPARK-31923: -- User 'zsxwing' has created a pull request f

[jira] [Updated] (SPARK-31933) Found another deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-31933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenning Ding updated SPARK-31933: - Description: This is another Spark java-level deadlock we found: it looks similar to  https://is

[jira] [Commented] (SPARK-31683) Make Prometheus output consistent with DropWizard 4.1 result

[ https://issues.apache.org/jira/browse/SPARK-31683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128625#comment-17128625 ] Jorge Machado commented on SPARK-31683: --- It would be great if we could use the RPC

[jira] [Updated] (SPARK-31933) Found another deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-31933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenning Ding updated SPARK-31933: - Description: This is another Spark java-level deadlock we found: it looks similar to  https://is

[jira] [Updated] (SPARK-31933) Found another deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-31933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenning Ding updated SPARK-31933: - Description: This is another Spark java-level deadlock we found: it looks similar to  https://is

[jira] [Created] (SPARK-31933) Found another deadlock in Spark Driver

Wenning Ding created SPARK-31933: Summary: Found another deadlock in Spark Driver Key: SPARK-31933 URL: https://issues.apache.org/jira/browse/SPARK-31933 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-31683) Make Prometheus output consistent with DropWizard 4.1 result

[ https://issues.apache.org/jira/browse/SPARK-31683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128606#comment-17128606 ] Dongjoon Hyun commented on SPARK-31683: --- [~jomach]. No, SPARK-29032 exposed the pr

[jira] [Commented] (SPARK-30312) Preserve path permission when truncate table

[ https://issues.apache.org/jira/browse/SPARK-30312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128597#comment-17128597 ] Dongjoon Hyun commented on SPARK-30312: --- To be complete, we need to mention the fi

[jira] [Commented] (SPARK-30312) Preserve path permission when truncate table

[ https://issues.apache.org/jira/browse/SPARK-30312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128590#comment-17128590 ] Dongjoon Hyun commented on SPARK-30312: --- It's because this is a security fix. With

[jira] [Commented] (SPARK-30274) Avoid BytesToBytesMap lookup hang forever when holding keys reaching max capacity

[ https://issues.apache.org/jira/browse/SPARK-30274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128586#comment-17128586 ] Dongjoon Hyun commented on SPARK-30274: --- It was because we had a community report

[jira] [Assigned] (SPARK-31932) Add date/timestamp benchmarks for toHiveString

[ https://issues.apache.org/jira/browse/SPARK-31932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31932: Assignee: Apache Spark > Add date/timestamp benchmarks for toHiveString > ---

[jira] [Assigned] (SPARK-31932) Add date/timestamp benchmarks for toHiveString

[ https://issues.apache.org/jira/browse/SPARK-31932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31932: Assignee: (was: Apache Spark) > Add date/timestamp benchmarks for toHiveString >

[jira] [Commented] (SPARK-31932) Add date/timestamp benchmarks for toHiveString

[ https://issues.apache.org/jira/browse/SPARK-31932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128564#comment-17128564 ] Apache Spark commented on SPARK-31932: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-31932) Add date/timestamp benchmarks for toHiveString

Maxim Gekk created SPARK-31932: -- Summary: Add date/timestamp benchmarks for toHiveString Key: SPARK-31932 URL: https://issues.apache.org/jira/browse/SPARK-31932 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-31923: - Fix Version/s: 3.1.0 3.0.1 > Event log cannot be generated when some internal

[jira] [Commented] (SPARK-30274) Avoid BytesToBytesMap lookup hang forever when holding keys reaching max capacity

[ https://issues.apache.org/jira/browse/SPARK-30274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128487#comment-17128487 ] L. C. Hsieh commented on SPARK-30274: - I think this is internal bug fix and should n

[jira] [Commented] (SPARK-30312) Preserve path permission when truncate table

[ https://issues.apache.org/jira/browse/SPARK-30312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128486#comment-17128486 ] L. C. Hsieh commented on SPARK-30312: - I am not sure. [~dongjoon] Do you remember th

[jira] [Updated] (SPARK-11215) Add multiple columns support to StringIndexer

[ https://issues.apache.org/jira/browse/SPARK-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-11215: Labels: (was: release-notes) > Add multiple columns support to StringIndexer > -

[jira] [Updated] (SPARK-23469) HashingTF should use corrected MurmurHash3 implementation

[ https://issues.apache.org/jira/browse/SPARK-23469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-23469: Labels: (was: release-notes) > HashingTF should use corrected MurmurHash3 implementation > -

[jira] [Updated] (SPARK-21492) Memory leak in SortMergeJoin

[ https://issues.apache.org/jira/browse/SPARK-21492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-21492: Labels: (was: release-notes) > Memory leak in SortMergeJoin > > >

[jira] [Updated] (SPARK-23643) XORShiftRandom.hashSeed allocates unnecessary memory

[ https://issues.apache.org/jira/browse/SPARK-23643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-23643: Labels: (was: release-notes) > XORShiftRandom.hashSeed allocates unnecessary memory > --

[jira] [Commented] (SPARK-26043) Make SparkHadoopUtil private to Spark

[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128484#comment-17128484 ] Sean R. Owen commented on SPARK-26043: -- Also one that needs release notes [~cloud_f

[jira] [Commented] (SPARK-26026) Published Scaladoc jars missing from Maven Central

[ https://issues.apache.org/jira/browse/SPARK-26026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128483#comment-17128483 ] Sean R. Owen commented on SPARK-26026: -- [~cloud_fan] I think this needs release not

[jira] [Updated] (SPARK-25449) Don't send zero accumulators in heartbeats

[ https://issues.apache.org/jira/browse/SPARK-25449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-25449: Labels: (was: release-notes) > Don't send zero accumulators in heartbeats >

[jira] [Updated] (SPARK-25696) The storage memory displayed on spark Application UI is incorrect.

[ https://issues.apache.org/jira/browse/SPARK-25696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-25696: Labels: (was: release-notes) > The storage memory displayed on spark Application UI is incorrect

[jira] [Updated] (SPARK-25986) Banning throw new Errors

[ https://issues.apache.org/jira/browse/SPARK-25986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-25986: Labels: (was: release-notes) > Banning throw new Errors > > >

[jira] [Updated] (SPARK-26026) Published Scaladoc jars missing from Maven Central

[ https://issues.apache.org/jira/browse/SPARK-26026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-26026: Labels: (was: release-notes) > Published Scaladoc jars missing from Maven Central >

[jira] [Updated] (SPARK-26043) Make SparkHadoopUtil private to Spark

[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-26043: Labels: (was: release-notes) > Make SparkHadoopUtil private to Spark > -

[jira] [Updated] (SPARK-26060) Track SparkConf entries and make SET command reject such entries.

[ https://issues.apache.org/jira/browse/SPARK-26060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-26060: Labels: (was: release-notes) > Track SparkConf entries and make SET command reject such entries.

[jira] [Updated] (SPARK-26903) Remove the TimeZone cache

[ https://issues.apache.org/jira/browse/SPARK-26903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-26903: Labels: (was: release-notes) > Remove the TimeZone cache > - > >

[jira] [Updated] (SPARK-27035) Current time with microsecond resolution

[ https://issues.apache.org/jira/browse/SPARK-27035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-27035: Labels: (was: release-notes) > Current time with microsecond resolution > --

[jira] [Updated] (SPARK-27521) move data source v2 API to catalyst module

[ https://issues.apache.org/jira/browse/SPARK-27521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-27521: Labels: (was: release-notes) > move data source v2 API to catalyst module >

[jira] [Updated] (SPARK-27630) Stage retry causes totalRunningTasks calculation to be negative

[ https://issues.apache.org/jira/browse/SPARK-27630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-27630: Labels: (was: release-notes) > Stage retry causes totalRunningTasks calculation to be negative >

[jira] [Updated] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

[ https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-27812: Labels: (was: release-notes) > kubernetes client import non-daemon thread which block jvm exit.

[jira] [Updated] (SPARK-27868) Better document shuffle / RPC listen backlog

[ https://issues.apache.org/jira/browse/SPARK-27868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-27868: Labels: (was: release-notes) > Better document shuffle / RPC listen backlog > --

[jira] [Updated] (SPARK-28152) Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

[ https://issues.apache.org/jira/browse/SPARK-28152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-28152: Labels: (was: release-notes) > Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServe

[jira] [Updated] (SPARK-31931) When using GCS as checkpoint location for Structured Streaming aggregation pipeline, the Spark writing job is aborted

[ https://issues.apache.org/jira/browse/SPARK-31931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Jones updated SPARK-31931: - Description: Structured streaming checkpointing does not work with Google Cloud Storage when th

[jira] [Updated] (SPARK-31931) When using GCS as checkpoint location for Structured Streaming aggregation pipeline, the Spark writing job is aborted

[ https://issues.apache.org/jira/browse/SPARK-31931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Jones updated SPARK-31931: - Attachment: spark-structured-streaming-error > When using GCS as checkpoint location for Structu

[jira] [Created] (SPARK-31931) When using GCS as checkpoint location for Structured Streaming aggregation pipeline, the Spark writing job is aborted

Adrian Jones created SPARK-31931: Summary: When using GCS as checkpoint location for Structured Streaming aggregation pipeline, the Spark writing job is aborted Key: SPARK-31931 URL: https://issues.apache.org/jira

[jira] [Updated] (SPARK-28939) SQL configuration are not always propagated

[ https://issues.apache.org/jira/browse/SPARK-28939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-28939: Labels: (was: release-notes) > SQL configuration are not always propagated > ---

[jira] [Updated] (SPARK-29890) Unable to fill na with 0 with duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-29890: Labels: (was: release-notes) > Unable to fill na with 0 with duplicate columns > ---

[jira] [Updated] (SPARK-30098) Use default datasource as provider for CREATE TABLE syntax

[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-30098: Labels: (was: release-notes) > Use default datasource as provider for CREATE TABLE syntax >

[jira] [Reopened] (SPARK-30098) Use default datasource as provider for CREATE TABLE syntax

[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-30098: - > Use default datasource as provider for CREATE TABLE syntax > -

[jira] [Resolved] (SPARK-30098) Use default datasource as provider for CREATE TABLE syntax

[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30098. - Assignee: (was: wuyi) Resolution: Won't Do > Use default datasource as provider for CR

[jira] [Updated] (SPARK-30065) Unable to drop na with duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-30065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-30065: Labels: (was: release-notes) > Unable to drop na with duplicate columns > --

[jira] [Commented] (SPARK-30274) Avoid BytesToBytesMap lookup hang forever when holding keys reaching max capacity

[ https://issues.apache.org/jira/browse/SPARK-30274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128414#comment-17128414 ] Wenchen Fan commented on SPARK-30274: - what shall we write for the release notes? >

[jira] [Commented] (SPARK-30312) Preserve path permission when truncate table

[ https://issues.apache.org/jira/browse/SPARK-30312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128411#comment-17128411 ] Wenchen Fan commented on SPARK-30312: - why does this bug fix need release notes? Wha

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128381#comment-17128381 ] Apache Spark commented on SPARK-8981: - User 'Ngone51' has created a pull request for

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128382#comment-17128382 ] Apache Spark commented on SPARK-8981: - User 'Ngone51' has created a pull request for

  1   2   >