[jira] [Updated] (SPARK-24701) SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different ports per app

[ https://issues.apache.org/jira/browse/SPARK-24701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-24701: - Labels: master security ui web web-ui (was: ) > SparkMaster WebUI allow all appids to be shown in detail on

[jira] [Created] (SPARK-24701) SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different ports per app

t oo created SPARK-24701: Summary: SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different ports per app Key: SPARK-24701 URL: https://issues.apache.org/jira/browse/SPARK-24701

[jira] [Commented] (SPARK-24689) java.io.NotSerializableException: org.apache.spark.mllib.clustering.DistributedLDAModel

[ https://issues.apache.org/jira/browse/SPARK-24689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528527#comment-16528527 ] Hyukjin Kwon commented on SPARK-24689: -- Yea please.. (releases are going on now fwiw) >

[jira] [Updated] (SPARK-24689) java.io.NotSerializableException: org.apache.spark.mllib.clustering.DistributedLDAModel

[ https://issues.apache.org/jira/browse/SPARK-24689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24689: - Priority: Major (was: Blocker) > java.io.NotSerializableException: >

[jira] [Commented] (SPARK-23461) vignettes should include model predictions for some ML models

[ https://issues.apache.org/jira/browse/SPARK-23461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528508#comment-16528508 ] Apache Spark commented on SPARK-23461: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23461) vignettes should include model predictions for some ML models

[ https://issues.apache.org/jira/browse/SPARK-23461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23461: Assignee: Apache Spark > vignettes should include model predictions for some ML models >

[jira] [Assigned] (SPARK-23461) vignettes should include model predictions for some ML models

[ https://issues.apache.org/jira/browse/SPARK-23461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23461: Assignee: (was: Apache Spark) > vignettes should include model predictions for some

[jira] [Commented] (SPARK-24689) java.io.NotSerializableException: org.apache.spark.mllib.clustering.DistributedLDAModel

[ https://issues.apache.org/jira/browse/SPARK-24689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528490#comment-16528490 ] Liang-Chi Hsieh commented on SPARK-24689: - I think we don't set priority as Blocker which is

[jira] [Issue Comment Deleted] (SPARK-24692) Improvement FilterPushdownBenchmark

[ https://issues.apache.org/jira/browse/SPARK-24692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24692: Comment: was deleted (was: I'm working on it.) > Improvement FilterPushdownBenchmark >

[jira] [Assigned] (SPARK-24692) Improvement FilterPushdownBenchmark

[ https://issues.apache.org/jira/browse/SPARK-24692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24692: Assignee: (was: Apache Spark) > Improvement FilterPushdownBenchmark >

[jira] [Commented] (SPARK-23534) Spark run on Hadoop 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-23534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528412#comment-16528412 ] t oo commented on SPARK-23534: -- Should this jira title be renamed to hadoop 3.1? as it looks like hadoop

[jira] [Assigned] (SPARK-24692) Improvement FilterPushdownBenchmark

[ https://issues.apache.org/jira/browse/SPARK-24692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24692: Assignee: Apache Spark > Improvement FilterPushdownBenchmark >

[jira] [Commented] (SPARK-24692) Improvement FilterPushdownBenchmark

[ https://issues.apache.org/jira/browse/SPARK-24692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528409#comment-16528409 ] Apache Spark commented on SPARK-24692: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528406#comment-16528406 ] t oo commented on SPARK-16859: -- still an issue in spark 2.3.1, storage tab on the SparkHistoryServer UI is

[jira] [Updated] (SPARK-24699) Watermark / Append mode should work with Trigger.Once

[ https://issues.apache.org/jira/browse/SPARK-24699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Horn updated SPARK-24699: --- Description: I have a use case where I would like to trigger a structured streaming job from an

[jira] [Commented] (SPARK-23309) Spark 2.3 cached query performance 20-30% worse then spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-23309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528379#comment-16528379 ] Dongjoon Hyun commented on SPARK-23309: --- Thank you for updating, [~tgraves]. > Spark 2.3 cached

[jira] [Updated] (SPARK-24700) AM shutdown terminates streaming application but marks it as successful

[ https://issues.apache.org/jira/browse/SPARK-24700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niranjani updated SPARK-24700: -- Description: While running Spark streaming applications on YARN in cluster mode,

[jira] [Created] (SPARK-24700) AM shutdown terminates streaming application but marks it as successful

Niranjani created SPARK-24700: - Summary: AM shutdown terminates streaming application but marks it as successful Key: SPARK-24700 URL: https://issues.apache.org/jira/browse/SPARK-24700 Project: Spark

[jira] [Commented] (SPARK-24699) Watermark / Append mode should work with Trigger.Once

[ https://issues.apache.org/jira/browse/SPARK-24699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528356#comment-16528356 ] Chris Horn commented on SPARK-24699: I have attached two scala repl scripts for reproducing this

[jira] [Commented] (SPARK-24699) Watermark / Append mode should work with Trigger.Once

[ https://issues.apache.org/jira/browse/SPARK-24699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528355#comment-16528355 ] Apache Spark commented on SPARK-24699: -- User 'c-horn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24699) Watermark / Append mode should work with Trigger.Once

[ https://issues.apache.org/jira/browse/SPARK-24699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24699: Assignee: (was: Apache Spark) > Watermark / Append mode should work with

[jira] [Assigned] (SPARK-24699) Watermark / Append mode should work with Trigger.Once

[ https://issues.apache.org/jira/browse/SPARK-24699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24699: Assignee: Apache Spark > Watermark / Append mode should work with Trigger.Once >

[jira] [Updated] (SPARK-24699) Watermark / Append mode should work with Trigger.Once

[ https://issues.apache.org/jira/browse/SPARK-24699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Horn updated SPARK-24699: --- Attachment: watermark-stream.scala watermark-once.scala > Watermark / Append mode

[jira] [Created] (SPARK-24699) Watermark / Append mode should work with Trigger.Once

Chris Horn created SPARK-24699: -- Summary: Watermark / Append mode should work with Trigger.Once Key: SPARK-24699 URL: https://issues.apache.org/jira/browse/SPARK-24699 Project: Spark Issue

[jira] [Assigned] (SPARK-24698) In Pyspark's ML, an Identifiable's UID has 20 random characters rather than the 12 mentioned in the documentation.

[ https://issues.apache.org/jira/browse/SPARK-24698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24698: Assignee: (was: Apache Spark) > In Pyspark's ML, an Identifiable's UID has 20 random

[jira] [Assigned] (SPARK-24698) In Pyspark's ML, an Identifiable's UID has 20 random characters rather than the 12 mentioned in the documentation.

[ https://issues.apache.org/jira/browse/SPARK-24698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24698: Assignee: Apache Spark > In Pyspark's ML, an Identifiable's UID has 20 random characters

[jira] [Commented] (SPARK-24698) In Pyspark's ML, an Identifiable's UID has 20 random characters rather than the 12 mentioned in the documentation.

[ https://issues.apache.org/jira/browse/SPARK-24698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528318#comment-16528318 ] Apache Spark commented on SPARK-24698: -- User 'mcteo' has created a pull request for this issue:

[jira] [Created] (SPARK-24698) In Pyspark's ML, an Identifiable's UID has 20 random characters rather than the 12 mentioned in the documentation.

Thomas Dunne created SPARK-24698: Summary: In Pyspark's ML, an Identifiable's UID has 20 random characters rather than the 12 mentioned in the documentation. Key: SPARK-24698 URL:

[jira] [Commented] (SPARK-24615) Accelerator aware task scheduling for Spark

[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528293#comment-16528293 ] Thomas Graves commented on SPARK-24615: --- maybe I"m missing it but how is this working with the

[jira] [Assigned] (SPARK-24696) ColumnPruning rule fails to remove extra Project

[ https://issues.apache.org/jira/browse/SPARK-24696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24696: Assignee: Maryann Xue (was: Apache Spark) > ColumnPruning rule fails to remove extra

[jira] [Commented] (SPARK-24696) ColumnPruning rule fails to remove extra Project

[ https://issues.apache.org/jira/browse/SPARK-24696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528281#comment-16528281 ] Apache Spark commented on SPARK-24696: -- User 'maryannxue' has created a pull request for this

[jira] [Assigned] (SPARK-24696) ColumnPruning rule fails to remove extra Project

[ https://issues.apache.org/jira/browse/SPARK-24696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24696: Assignee: Apache Spark (was: Maryann Xue) > ColumnPruning rule fails to remove extra

[jira] [Commented] (SPARK-24697) Fix the reported start offsets in streaming query progress

[ https://issues.apache.org/jira/browse/SPARK-24697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528276#comment-16528276 ] Apache Spark commented on SPARK-24697: -- User 'arunmahadevan' has created a pull request for this

[jira] [Assigned] (SPARK-24697) Fix the reported start offsets in streaming query progress

[ https://issues.apache.org/jira/browse/SPARK-24697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24697: Assignee: Apache Spark > Fix the reported start offsets in streaming query progress >

[jira] [Assigned] (SPARK-24697) Fix the reported start offsets in streaming query progress

[ https://issues.apache.org/jira/browse/SPARK-24697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24697: Assignee: (was: Apache Spark) > Fix the reported start offsets in streaming query

[jira] [Updated] (SPARK-24697) Fix the reported start offsets in streaming query progress

[ https://issues.apache.org/jira/browse/SPARK-24697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Mahadevan updated SPARK-24697: --- Summary: Fix the reported start offsets in streaming query progress (was: Fix the reported

[jira] [Updated] (SPARK-24697) Fix the reported start offsets in streaming query

[ https://issues.apache.org/jira/browse/SPARK-24697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Mahadevan updated SPARK-24697: --- Summary: Fix the reported start offsets in streaming query (was: Fix the reported start

[jira] [Created] (SPARK-24697) Fix the reported start and end offsets in streaming query

Arun Mahadevan created SPARK-24697: -- Summary: Fix the reported start and end offsets in streaming query Key: SPARK-24697 URL: https://issues.apache.org/jira/browse/SPARK-24697 Project: Spark

[jira] [Updated] (SPARK-24696) ColumnPruning rule fails to remove extra Project

[ https://issues.apache.org/jira/browse/SPARK-24696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maryann Xue updated SPARK-24696: Description: The following test case would cause a "max iterations reached" error, i.e., an

[jira] [Resolved] (SPARK-24643) from_json should accept an aggregate function as schema

[ https://issues.apache.org/jira/browse/SPARK-24643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-24643. Resolution: Won't Fix > from_json should accept an aggregate function as schema >

[jira] [Updated] (SPARK-23618) docker-image-tool.sh Fails While Building Image

[ https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-23618: --- Fix Version/s: 2.4.0 > docker-image-tool.sh Fails While Building Image >

[jira] [Resolved] (SPARK-24566) Fix spark.storage.blockManagerSlaveTimeoutMs default config

[ https://issues.apache.org/jira/browse/SPARK-24566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-24566. -- Resolution: Fixed Assignee: xueyu Fix Version/s: 2.4.0 > Fix

[jira] [Updated] (SPARK-24566) Fix spark.storage.blockManagerSlaveTimeoutMs default config

[ https://issues.apache.org/jira/browse/SPARK-24566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-24566: - Summary: Fix spark.storage.blockManagerSlaveTimeoutMs default config (was:

[jira] [Assigned] (SPARK-24696) ColumnPruning rule fails to remove extra Project

[ https://issues.apache.org/jira/browse/SPARK-24696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-24696: --- Assignee: Maryann Xue > ColumnPruning rule fails to remove extra Project >

[jira] [Created] (SPARK-24696) ColumnPruning rule fails to remove extra Project

Xiao Li created SPARK-24696: --- Summary: ColumnPruning rule fails to remove extra Project Key: SPARK-24696 URL: https://issues.apache.org/jira/browse/SPARK-24696 Project: Spark Issue Type:

[jira] [Updated] (SPARK-24695) Unable to return calendar interval from udf

[ https://issues.apache.org/jira/browse/SPARK-24695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Priyanka Garg updated SPARK-24695: -- Fix Version/s: (was: 2.3.2) (was: 2.3.1) > Unable to return

[jira] [Updated] (SPARK-24695) Unable to return calendar interval from udf

[ https://issues.apache.org/jira/browse/SPARK-24695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Priyanka Garg updated SPARK-24695: -- Target Version/s: (was: 2.3.1) > Unable to return calendar interval from udf >

[jira] [Updated] (SPARK-24695) Unable to return calendar interval from udf

[ https://issues.apache.org/jira/browse/SPARK-24695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Priyanka Garg updated SPARK-24695: -- Priority: Major (was: Critical) > Unable to return calendar interval from udf >

[jira] [Created] (SPARK-24695) Unable to return calendar interval from udf

Priyanka Garg created SPARK-24695: - Summary: Unable to return calendar interval from udf Key: SPARK-24695 URL: https://issues.apache.org/jira/browse/SPARK-24695 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-24694) Integration tests pass only one app argument

[ https://issues.apache.org/jira/browse/SPARK-24694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24694: Assignee: (was: Apache Spark) > Integration tests pass only one app argument >

[jira] [Commented] (SPARK-24694) Integration tests pass only one app argument

[ https://issues.apache.org/jira/browse/SPARK-24694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527921#comment-16527921 ] Apache Spark commented on SPARK-24694: -- User 'skonto' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24694) Integration tests pass only one app argument

[ https://issues.apache.org/jira/browse/SPARK-24694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24694: Assignee: Apache Spark > Integration tests pass only one app argument >

[jira] [Updated] (SPARK-24694) Integration tests pass only one app argument

[ https://issues.apache.org/jira/browse/SPARK-24694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-24694: Summary: Integration tests pass only one app argument (was: Integration tests

[jira] [Updated] (SPARK-23618) docker-image-tool.sh Fails While Building Image

[ https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-23618: --- Fix Version/s: 2.3.2 > docker-image-tool.sh Fails While Building Image >

[jira] [Commented] (SPARK-23309) Spark 2.3 cached query performance 20-30% worse then spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-23309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527865#comment-16527865 ] Thomas Graves commented on SPARK-23309: --- We tried this on a newest 2.3.1 and haven't been able to

[jira] [Resolved] (SPARK-23309) Spark 2.3 cached query performance 20-30% worse then spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-23309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-23309. --- Resolution: Works for Me > Spark 2.3 cached query performance 20-30% worse then spark 2.2 >

[jira] [Updated] (SPARK-24694) Integration tests pass only one argument

[ https://issues.apache.org/jira/browse/SPARK-24694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-24694: Description: I tried to add another test in the current suite which uses more

[jira] [Created] (SPARK-24694) Integration tests only pass one argument

Stavros Kontopoulos created SPARK-24694: --- Summary: Integration tests only pass one argument Key: SPARK-24694 URL: https://issues.apache.org/jira/browse/SPARK-24694 Project: Spark Issue

[jira] [Updated] (SPARK-24694) Integration tests pass only one argument

[ https://issues.apache.org/jira/browse/SPARK-24694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-24694: Summary: Integration tests pass only one argument (was: Integration tests only

[jira] [Commented] (SPARK-24682) from_json / to_json do not handle java.sql.Date inside Maps correctly

[ https://issues.apache.org/jira/browse/SPARK-24682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527767#comment-16527767 ] Apache Spark commented on SPARK-24682: -- User 'patrickmcgloin' has created a pull request for this

[jira] [Assigned] (SPARK-24682) from_json / to_json do not handle java.sql.Date inside Maps correctly

[ https://issues.apache.org/jira/browse/SPARK-24682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24682: Assignee: Apache Spark > from_json / to_json do not handle java.sql.Date inside Maps

[jira] [Assigned] (SPARK-24682) from_json / to_json do not handle java.sql.Date inside Maps correctly

[ https://issues.apache.org/jira/browse/SPARK-24682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24682: Assignee: (was: Apache Spark) > from_json / to_json do not handle java.sql.Date

[jira] [Commented] (SPARK-24682) from_json / to_json do not handle java.sql.Date inside Maps correctly

[ https://issues.apache.org/jira/browse/SPARK-24682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527764#comment-16527764 ] Apache Spark commented on SPARK-24682: -- User 'patrickmcgloin' has created a pull request for this

[jira] [Commented] (SPARK-24165) UDF within when().otherwise() raises NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-24165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527734#comment-16527734 ] Marek Novotny commented on SPARK-24165: --- [~jingxuan001] Please could you provide a short example

[jira] [Comment Edited] (SPARK-24165) UDF within when().otherwise() raises NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-24165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527556#comment-16527556 ] Marek Novotny edited comment on SPARK-24165 at 6/29/18 12:33 PM: - It

[jira] [Commented] (SPARK-24165) UDF within when().otherwise() raises NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-24165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527556#comment-16527556 ] Marek Novotny commented on SPARK-24165: --- It seems that Spark is not able resolve nullability for

[jira] [Created] (SPARK-24693) Row order preservation for operations on MLlib IndexedRowMatrix

Anuj Nagpall created SPARK-24693: Summary: Row order preservation for operations on MLlib IndexedRowMatrix Key: SPARK-24693 URL: https://issues.apache.org/jira/browse/SPARK-24693 Project: Spark

[jira] [Commented] (SPARK-19498) Discussion: Making MLlib APIs extensible for 3rd party libraries

[ https://issues.apache.org/jira/browse/SPARK-19498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527351#comment-16527351 ] Lucas Partridge commented on SPARK-19498: - Ok great. Here's me feedback after wrapping a large

[jira] [Comment Edited] (SPARK-19498) Discussion: Making MLlib APIs extensible for 3rd party libraries

[ https://issues.apache.org/jira/browse/SPARK-19498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527351#comment-16527351 ] Lucas Partridge edited comment on SPARK-19498 at 6/29/18 9:12 AM: -- Ok

[jira] [Commented] (SPARK-24667) If folders managed by DiskBlockManager are deleted manually, shell throws FileNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-24667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527347#comment-16527347 ] Liang-Chi Hsieh commented on SPARK-24667: - I think it is not a bug... > If folders managed by

[jira] [Assigned] (SPARK-23257) Implement Kerberos Support in Kubernetes resource manager

[ https://issues.apache.org/jira/browse/SPARK-23257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23257: Assignee: (was: Apache Spark) > Implement Kerberos Support in Kubernetes resource

[jira] [Commented] (SPARK-23257) Implement Kerberos Support in Kubernetes resource manager

[ https://issues.apache.org/jira/browse/SPARK-23257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527328#comment-16527328 ] Apache Spark commented on SPARK-23257: -- User 'ifilonenko' has created a pull request for this

[jira] [Assigned] (SPARK-23257) Implement Kerberos Support in Kubernetes resource manager

[ https://issues.apache.org/jira/browse/SPARK-23257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23257: Assignee: Apache Spark > Implement Kerberos Support in Kubernetes resource manager >

[jira] [Commented] (SPARK-24018) Spark-without-hadoop package fails to create or read parquet files with snappy compression

[ https://issues.apache.org/jira/browse/SPARK-24018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527327#comment-16527327 ] Jiri Humpolicek commented on SPARK-24018: - Hi, I have got exactly same problem with spark-2.3.1

[jira] [Commented] (SPARK-8659) Spark SQL Thrift Server does NOT honour hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAuthorizerFactory

[ https://issues.apache.org/jira/browse/SPARK-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527325#comment-16527325 ] t oo commented on SPARK-8659: - _"show_ current _roles" gives an error about sql catalyst parser_ > Spark SQL

[jira] [Commented] (SPARK-24692) Improvement FilterPushdownBenchmark

[ https://issues.apache.org/jira/browse/SPARK-24692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527324#comment-16527324 ] Yuming Wang commented on SPARK-24692: - I'm working on it. > Improvement FilterPushdownBenchmark >

[jira] [Created] (SPARK-24692) Improvement FilterPushdownBenchmark

Yuming Wang created SPARK-24692: --- Summary: Improvement FilterPushdownBenchmark Key: SPARK-24692 URL: https://issues.apache.org/jira/browse/SPARK-24692 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-24692) Improvement FilterPushdownBenchmark

[ https://issues.apache.org/jira/browse/SPARK-24692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24692: Priority: Major (was: Critical) > Improvement FilterPushdownBenchmark >

[jira] [Commented] (SPARK-24144) monotonically_increasing_id on streaming dataFrames

[ https://issues.apache.org/jira/browse/SPARK-24144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527306#comment-16527306 ] Richard Yu commented on SPARK-24144: Hi [~marmbrus] I'm interested in doing this JIRA, but I'm

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527291#comment-16527291 ] Hyukjin Kwon commented on SPARK-20202: -- Would you guys please give some thought on this when you

[jira] [Commented] (SPARK-24690) Add a new config to control plan stats computation in LogicalRelation

[ https://issues.apache.org/jira/browse/SPARK-24690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527263#comment-16527263 ] Apache Spark commented on SPARK-24690: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24690) Add a new config to control plan stats computation in LogicalRelation

[ https://issues.apache.org/jira/browse/SPARK-24690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24690: Assignee: (was: Apache Spark) > Add a new config to control plan stats computation

[jira] [Assigned] (SPARK-24690) Add a new config to control plan stats computation in LogicalRelation

[ https://issues.apache.org/jira/browse/SPARK-24690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24690: Assignee: Apache Spark > Add a new config to control plan stats computation in

[jira] [Assigned] (SPARK-24691) Add new API `supportDataType` in FileFormat

[ https://issues.apache.org/jira/browse/SPARK-24691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24691: Assignee: Apache Spark > Add new API `supportDataType` in FileFormat >

[jira] [Assigned] (SPARK-24691) Add new API `supportDataType` in FileFormat

[ https://issues.apache.org/jira/browse/SPARK-24691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24691: Assignee: (was: Apache Spark) > Add new API `supportDataType` in FileFormat >

[jira] [Commented] (SPARK-24691) Add new API `supportDataType` in FileFormat

[ https://issues.apache.org/jira/browse/SPARK-24691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527260#comment-16527260 ] Apache Spark commented on SPARK-24691: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-24691) Add new API `supportDataType` in FileFormat

Gengliang Wang created SPARK-24691: -- Summary: Add new API `supportDataType` in FileFormat Key: SPARK-24691 URL: https://issues.apache.org/jira/browse/SPARK-24691 Project: Spark Issue Type:

[jira] [Created] (SPARK-24690) Add a new config to control plan stats computation in LogicalRelation

Takeshi Yamamuro created SPARK-24690: Summary: Add a new config to control plan stats computation in LogicalRelation Key: SPARK-24690 URL: https://issues.apache.org/jira/browse/SPARK-24690

[jira] [Assigned] (SPARK-24535) Fix java version parsing in SparkR

[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24535: Assignee: Apache Spark (was: Felix Cheung) > Fix java version parsing in SparkR >

[jira] [Commented] (SPARK-24535) Fix java version parsing in SparkR

[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527234#comment-16527234 ] Apache Spark commented on SPARK-24535: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-24535) Fix java version parsing in SparkR

[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24535: Assignee: Felix Cheung (was: Apache Spark) > Fix java version parsing in SparkR >