[jira] [Assigned] (SPARK-30345) Flaky test failure: ThriftServerWithSparkContextSuite.SPARK-29911: Uncache cached tables when session closed

[ https://issues.apache.org/jira/browse/SPARK-30345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30345: --- Assignee: Jungtaek Lim > Flaky test failure:

[jira] [Resolved] (SPARK-30345) Flaky test failure: ThriftServerWithSparkContextSuite.SPARK-29911: Uncache cached tables when session closed

[ https://issues.apache.org/jira/browse/SPARK-30345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30345. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27001

[jira] [Assigned] (SPARK-30355) Unify isExecutorActive between CoarseGrainedSchedulerBackend and DriverEndpoint

[ https://issues.apache.org/jira/browse/SPARK-30355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30355: --- Assignee: wuyi > Unify isExecutorActive between CoarseGrainedSchedulerBackend and >

[jira] [Commented] (SPARK-25030) SparkSubmit.doSubmit will not return result if the mainClass submitted creates a Timer()

[ https://issues.apache.org/jira/browse/SPARK-25030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003932#comment-17003932 ] Ajith S commented on SPARK-25030: - [~jiangxb1987] is there a reproduce case for this.? i just tried this

[jira] [Resolved] (SPARK-30355) Unify isExecutorActive between CoarseGrainedSchedulerBackend and DriverEndpoint

[ https://issues.apache.org/jira/browse/SPARK-30355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30355. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27012

[jira] [Resolved] (SPARK-30278) Update Spark SQL document menu for new changes

[ https://issues.apache.org/jira/browse/SPARK-30278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30278. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26917

[jira] [Assigned] (SPARK-30278) Update Spark SQL document menu for new changes

[ https://issues.apache.org/jira/browse/SPARK-30278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30278: --- Assignee: Yuanjian Li > Update Spark SQL document menu for new changes >

[jira] [Assigned] (SPARK-30102) GMM supports instance weighting

[ https://issues.apache.org/jira/browse/SPARK-30102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-30102: Assignee: zhengruifeng > GMM supports instance weighting >

[jira] [Resolved] (SPARK-30102) GMM supports instance weighting

[ https://issues.apache.org/jira/browse/SPARK-30102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-30102. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26735

[jira] [Commented] (SPARK-30363) Add Documentation for Refresh Resources

[ https://issues.apache.org/jira/browse/SPARK-30363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003887#comment-17003887 ] Rakesh Raushan commented on SPARK-30363: I am working on it.   > Add Documentation for Refresh

[jira] [Created] (SPARK-30363) Add Documentation for Refresh Resources

Rakesh Raushan created SPARK-30363: -- Summary: Add Documentation for Refresh Resources Key: SPARK-30363 URL: https://issues.apache.org/jira/browse/SPARK-30363 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30362) InputMetrics are not updated for DataSourceRDD V2

[ https://issues.apache.org/jira/browse/SPARK-30362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Katta updated SPARK-30362: -- Attachment: inputMetrics.png > InputMetrics are not updated for DataSourceRDD V2 >

[jira] [Resolved] (SPARK-30036) REPARTITION hint dose not work with order by

[ https://issues.apache.org/jira/browse/SPARK-30036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30036. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26946

[jira] [Assigned] (SPARK-30036) REPARTITION hint dose not work with order by

[ https://issues.apache.org/jira/browse/SPARK-30036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30036: --- Assignee: Jackey Lee > REPARTITION hint dose not work with order by >

[jira] [Created] (SPARK-30362) InputMetrics are not updated for DataSourceRDD V2

Sandeep Katta created SPARK-30362: - Summary: InputMetrics are not updated for DataSourceRDD V2 Key: SPARK-30362 URL: https://issues.apache.org/jira/browse/SPARK-30362 Project: Spark Issue

[jira] [Commented] (SPARK-27878) Support ARRAY(sub-SELECT) expressions

[ https://issues.apache.org/jira/browse/SPARK-27878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003836#comment-17003836 ] Hyukjin Kwon commented on SPARK-27878: -- Ah, [~maropu] sorry I missed your comment. Feel free to

[jira] [Commented] (SPARK-27764) Feature Parity between PostgreSQL and Spark

[ https://issues.apache.org/jira/browse/SPARK-27764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003835#comment-17003835 ] Hyukjin Kwon commented on SPARK-27764: -- I hope so if we are able to divide ... > Feature Parity

[jira] [Resolved] (SPARK-27878) Support ARRAY(sub-SELECT) expressions

[ https://issues.apache.org/jira/browse/SPARK-27878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27878. -- Resolution: Won't Fix > Support ARRAY(sub-SELECT) expressions >

[jira] [Commented] (SPARK-29059) [SPIP] Support for Hive Materialized Views in Spark SQL.

[ https://issues.apache.org/jira/browse/SPARK-29059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003832#comment-17003832 ] Takeshi Yamamuro commented on SPARK-29059: -- Still active? > [SPIP] Support for Hive

[jira] [Updated] (SPARK-30144) MLP param map missing

[ https://issues.apache.org/jira/browse/SPARK-30144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-30144: --- Docs Text: >From 3.0, MultilayerPerceptronClassificationModel extends >MultilayerPerceptronParams

[jira] [Updated] (SPARK-30144) MLP param map missing

[ https://issues.apache.org/jira/browse/SPARK-30144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-30144: --- Component/s: (was: MLlib) ML > MLP param map missing > - >

[jira] [Updated] (SPARK-30144) MLP param map missing

[ https://issues.apache.org/jira/browse/SPARK-30144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-30144: --- Labels: release_notes (was: ) > MLP param map missing > - > >

[jira] [Resolved] (SPARK-29853) lpad returning empty instead of NULL for empty pad value

[ https://issues.apache.org/jira/browse/SPARK-29853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Raj Boudh resolved SPARK-29853. - Fix Version/s: 3.0.0 Resolution: Duplicate > lpad returning empty instead of

[jira] [Updated] (SPARK-29776) rpad and lpad should return NULL when padstring parameter is empty

[ https://issues.apache.org/jira/browse/SPARK-29776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Raj Boudh updated SPARK-29776: Summary: rpad and lpad should return NULL when padstring parameter is empty (was: rpad

[jira] [Comment Edited] (SPARK-30319) Adds a stricter version of as[T]

[ https://issues.apache.org/jira/browse/SPARK-30319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003718#comment-17003718 ] Farooq Qaiser edited comment on SPARK-30319 at 12/26/19 6:13 PM: - I have

[jira] [Commented] (SPARK-30319) Adds a stricter version of as[T]

[ https://issues.apache.org/jira/browse/SPARK-30319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003718#comment-17003718 ] Farooq Qaiser commented on SPARK-30319: --- I have written similar variants of this feature (using

[jira] [Resolved] (SPARK-28849) Spark's UnsafeShuffleWriter may run into infinite loop in transferTo occasionally

[ https://issues.apache.org/jira/browse/SPARK-28849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28849. -- Resolution: Won't Fix > Spark's UnsafeShuffleWriter may run into infinite loop in transferTo

[jira] [Commented] (SPARK-27764) Feature Parity between PostgreSQL and Spark

[ https://issues.apache.org/jira/browse/SPARK-27764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003661#comment-17003661 ] Takeshi Yamamuro commented on SPARK-27764: -- btw, since this umbrella has many sub tasks, can we

[jira] [Commented] (SPARK-27878) Support ARRAY(sub-SELECT) expressions

[ https://issues.apache.org/jira/browse/SPARK-27878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003657#comment-17003657 ] Takeshi Yamamuro commented on SPARK-27878: -- It seems PgSql and BigQuery support this feature.

[jira] [Resolved] (SPARK-10892) Join with Data Frame returns wrong results

[ https://issues.apache.org/jira/browse/SPARK-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-10892. -- Fix Version/s: 3.0.0 Assignee: Wenchen Fan Resolution: Fixed Resolved

[jira] [Commented] (SPARK-10892) Join with Data Frame returns wrong results

[ https://issues.apache.org/jira/browse/SPARK-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003649#comment-17003649 ] Takeshi Yamamuro commented on SPARK-10892: -- Since I checked that the current master threw an

[jira] [Resolved] (SPARK-30350) Fix ScalaReflection to use an empty array for getting its class object

[ https://issues.apache.org/jira/browse/SPARK-30350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-30350. -- Fix Version/s: 3.0.0 Assignee: Kengo Seki Resolution: Fixed Resolved

[jira] [Created] (SPARK-30361) Monitoring URL do not redact information about environment

Ajith S created SPARK-30361: --- Summary: Monitoring URL do not redact information about environment Key: SPARK-30361 URL: https://issues.apache.org/jira/browse/SPARK-30361 Project: Spark Issue Type:

[jira] [Created] (SPARK-30360) Redact classpath entries in Spark UI

Ajith S created SPARK-30360: --- Summary: Redact classpath entries in Spark UI Key: SPARK-30360 URL: https://issues.apache.org/jira/browse/SPARK-30360 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-30359) Do not clear executorsPendingToRemove in CoarseGrainedSchedulerBackend.reset

wuyi created SPARK-30359: Summary: Do not clear executorsPendingToRemove in CoarseGrainedSchedulerBackend.reset Key: SPARK-30359 URL: https://issues.apache.org/jira/browse/SPARK-30359 Project: Spark

[jira] [Updated] (SPARK-30358) ML expose predictRaw and predictProbability

[ https://issues.apache.org/jira/browse/SPARK-30358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-30358: - Description: Support {{predictRaw}} and {{predictProbability}} on single instance. Currently

[jira] [Updated] (SPARK-30358) ML expose predictRaw and predictProbability

[ https://issues.apache.org/jira/browse/SPARK-30358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-30358: - Description: Support {{predictRaw}} and {{predictProbability}} on single instance. Currently

[jira] [Assigned] (SPARK-30358) ML expose predictRaw and predictProbability

[ https://issues.apache.org/jira/browse/SPARK-30358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-30358: Assignee: zhengruifeng > ML expose predictRaw and predictProbability >

[jira] [Created] (SPARK-30358) ML expose predictRaw and predictProbability

zhengruifeng created SPARK-30358: Summary: ML expose predictRaw and predictProbability Key: SPARK-30358 URL: https://issues.apache.org/jira/browse/SPARK-30358 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-27986) Support Aggregate Expressions with filter

[ https://issues.apache.org/jira/browse/SPARK-27986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27986: --- Assignee: jiaan.geng > Support Aggregate Expressions with filter >

[jira] [Resolved] (SPARK-27986) Support Aggregate Expressions with filter

[ https://issues.apache.org/jira/browse/SPARK-27986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27986. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26656

[jira] [Created] (SPARK-30357) SparkContext: Invoking stop() from shutdown hook

Veera created SPARK-30357: - Summary: SparkContext: Invoking stop() from shutdown hook Key: SPARK-30357 URL: https://issues.apache.org/jira/browse/SPARK-30357 Project: Spark Issue Type: Bug