[jira] [Commented] (SPARK-11125) Unreadable exception when running spark-sql without building with -Phive-thriftserver and SPARK_PREPEND_CLASSES is set

[ https://issues.apache.org/jira/browse/SPARK-11125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958441#comment-14958441 ] Apache Spark commented on SPARK-11125: -- User 'zjffdu' has created a pull request for

[jira] [Assigned] (SPARK-11125) Unreadable exception when running spark-sql without building with -Phive-thriftserver and SPARK_PREPEND_CLASSES is set

[ https://issues.apache.org/jira/browse/SPARK-11125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11125: Assignee: Apache Spark > Unreadable exception when running spark-sql without building with

[jira] [Assigned] (SPARK-11125) Unreadable exception when running spark-sql without building with -Phive-thriftserver and SPARK_PREPEND_CLASSES is set

[ https://issues.apache.org/jira/browse/SPARK-11125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11125: Assignee: (was: Apache Spark) > Unreadable exception when running spark-sql without bu

[jira] [Commented] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958447#comment-14958447 ] Reynold Xin commented on SPARK-11097: - Simplifies code and improves performance (no n

[jira] [Created] (SPARK-11128) strange NPE when writing in non-existing S3 bucket

mathieu despriee created SPARK-11128: Summary: strange NPE when writing in non-existing S3 bucket Key: SPARK-11128 URL: https://issues.apache.org/jira/browse/SPARK-11128 Project: Spark Is

[jira] [Commented] (SPARK-10893) Lag Analytic function broken

[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958520#comment-14958520 ] Herman van Hovell commented on SPARK-10893: --- A bug was found in the Window impl

[jira] [Commented] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958524#comment-14958524 ] Cheng Hao commented on SPARK-4226: -- [~nadenf] Actually I am working on it right now, and

[jira] [Commented] (SPARK-6065) Optimize word2vec.findSynonyms speed

[ https://issues.apache.org/jira/browse/SPARK-6065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958585#comment-14958585 ] Franck Zhang commented on SPARK-6065: -- When I used the same dataset (text8 - aroun

[jira] [Commented] (SPARK-11128) strange NPE when writing in non-existing S3 bucket

[ https://issues.apache.org/jira/browse/SPARK-11128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958756#comment-14958756 ] Sean Owen commented on SPARK-11128: --- Is this a Spark problem? sounds like an issue betw

[jira] [Commented] (SPARK-9241) Supporting multiple DISTINCT columns

[ https://issues.apache.org/jira/browse/SPARK-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958758#comment-14958758 ] Herman van Hovell commented on SPARK-9241: -- We could implement this using GROUPIN

[jira] [Resolved] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10528. --- Resolution: Not A Problem This looks like an environment problem. > spark-shell throws java.lang.Run

[jira] [Commented] (SPARK-11120) maxNumExecutorFailures defaults to 3 under dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958762#comment-14958762 ] Sean Owen commented on SPARK-11120: --- Is this specific to dynamic allocation though? you

[jira] [Commented] (SPARK-10935) Avito Context Ad Clicks

[ https://issues.apache.org/jira/browse/SPARK-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958823#comment-14958823 ] Kristina Plazonic commented on SPARK-10935: --- @Xusen, I'm almost done - should b

[jira] [Created] (SPARK-11129) Link Spark WebUI in Mesos WebUI

Philipp Hoffmann created SPARK-11129: Summary: Link Spark WebUI in Mesos WebUI Key: SPARK-11129 URL: https://issues.apache.org/jira/browse/SPARK-11129 Project: Spark Issue Type: New Featu

[jira] [Commented] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958841#comment-14958841 ] Dominic Ricard commented on SPARK-11103: Setting the property {{spark.sql.parquet

[jira] [Commented] (SPARK-11129) Link Spark WebUI in Mesos WebUI

[ https://issues.apache.org/jira/browse/SPARK-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958856#comment-14958856 ] Philipp Hoffmann commented on SPARK-11129: -- submitted a pull request > Link Spa

[jira] [Assigned] (SPARK-11129) Link Spark WebUI in Mesos WebUI

[ https://issues.apache.org/jira/browse/SPARK-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11129: Assignee: (was: Apache Spark) > Link Spark WebUI in Mesos WebUI >

[jira] [Commented] (SPARK-11129) Link Spark WebUI in Mesos WebUI

[ https://issues.apache.org/jira/browse/SPARK-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958858#comment-14958858 ] Apache Spark commented on SPARK-11129: -- User 'philipphoffmann' has created a pull re

[jira] [Assigned] (SPARK-11129) Link Spark WebUI in Mesos WebUI

[ https://issues.apache.org/jira/browse/SPARK-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11129: Assignee: Apache Spark > Link Spark WebUI in Mesos WebUI > ---

[jira] [Commented] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958879#comment-14958879 ] Hyukjin Kwon commented on SPARK-11103: -- For me, I think Spark should appropriately s

[jira] [Commented] (SPARK-10729) word2vec model save for python

[ https://issues.apache.org/jira/browse/SPARK-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959097#comment-14959097 ] Jian Feng Zhang commented on SPARK-10729: - I can take this if no objections. > w

[jira] [Commented] (SPARK-10935) Avito Context Ad Clicks

[ https://issues.apache.org/jira/browse/SPARK-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959140#comment-14959140 ] Xusen Yin commented on SPARK-10935: --- OK, ping me if you need help. > Avito Context Ad

[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959156#comment-14959156 ] Xusen Yin commented on SPARK-5874: -- How about adding a warm-start strategy in ML Estimato

[jira] [Commented] (SPARK-9941) Try ML pipeline API on Kaggle competitions

[ https://issues.apache.org/jira/browse/SPARK-9941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959174#comment-14959174 ] Xusen Yin commented on SPARK-9941: -- I'd love to try the cooking dataset: https://www.kagg

[jira] [Commented] (SPARK-10217) Spark SQL cannot handle ordering directive in ORDER BY clauses with expressions

[ https://issues.apache.org/jira/browse/SPARK-10217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959197#comment-14959197 ] Simeon Simeonov commented on SPARK-10217: - Well, that would suggest the issue is

[jira] [Resolved] (SPARK-11093) ChildFirstURLClassLoader#getResources should return all found resources, not just those in the child classloader

[ https://issues.apache.org/jira/browse/SPARK-11093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11093. Resolution: Fixed Assignee: Adam Lewandowski Fix Version/s: 1.6.0 > ChildFi

[jira] [Resolved] (SPARK-11099) Default conf property file is not loaded

[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11099. Resolution: Fixed Assignee: Jeff Zhang Fix Version/s: 1.6.0 > Default conf

[jira] [Created] (SPARK-11130) TestHive fails on machines with few cores

Marcelo Vanzin created SPARK-11130: -- Summary: TestHive fails on machines with few cores Key: SPARK-11130 URL: https://issues.apache.org/jira/browse/SPARK-11130 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11130) TestHive fails on machines with few cores

[ https://issues.apache.org/jira/browse/SPARK-11130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-11130: --- Description: Filing so it doesn't get lost (again). TestHive.scala has this code: {code}

[jira] [Resolved] (SPARK-10217) Spark SQL cannot handle ordering directive in ORDER BY clauses with expressions

[ https://issues.apache.org/jira/browse/SPARK-10217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10217. --- Resolution: Cannot Reproduce > Spark SQL cannot handle ordering directive in ORDER BY clauses with >

[jira] [Created] (SPARK-11131) Worker registration protocol is racy

Marcelo Vanzin created SPARK-11131: -- Summary: Worker registration protocol is racy Key: SPARK-11131 URL: https://issues.apache.org/jira/browse/SPARK-11131 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11066. --- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11066: -- Assignee: Dr Stephen A Hellberg > Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler >

[jira] [Created] (SPARK-11132) Mean Shift algorithm integration

Beck Gaël created SPARK-11132: - Summary: Mean Shift algorithm integration Key: SPARK-11132 URL: https://issues.apache.org/jira/browse/SPARK-11132 Project: Spark Issue Type: Brainstorming

[jira] [Commented] (SPARK-11132) Mean Shift algorithm integration

[ https://issues.apache.org/jira/browse/SPARK-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959245#comment-14959245 ] Sean Owen commented on SPARK-11132: --- [~Kybe] please have a look at https://cwiki.apach

[jira] [Resolved] (SPARK-11047) Internal accumulators miss the internal flag when replaying events in the history server

[ https://issues.apache.org/jira/browse/SPARK-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11047. - Resolution: Fixed Assignee: Carson Wang Fix Version/s: 1.6.0 1.

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959273#comment-14959273 ] Ragu Ramaswamy commented on SPARK-4105: --- I get this error consistently when using sp

[jira] [Assigned] (SPARK-10186) Add support for more postgres column types

[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10186: Assignee: Apache Spark > Add support for more postgres column types >

[jira] [Assigned] (SPARK-10186) Add support for more postgres column types

[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10186: Assignee: (was: Apache Spark) > Add support for more postgres column types > -

[jira] [Commented] (SPARK-10186) Add support for more postgres column types

[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959289#comment-14959289 ] Apache Spark commented on SPARK-10186: -- User 'mariusvniekerk' has created a pull req

[jira] [Commented] (SPARK-5739) Size exceeds Integer.MAX_VALUE in File Map

[ https://issues.apache.org/jira/browse/SPARK-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959298#comment-14959298 ] Karl D. Gierach commented on SPARK-5739: Is there anyway to increase this block li

[jira] [Updated] (SPARK-10943) NullType Column cannot be written to Parquet

[ https://issues.apache.org/jira/browse/SPARK-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10943: - Description: {code} var data02 = sqlContext.sql("select 1 as id, \"cat in the hat\" as te

[jira] [Commented] (SPARK-10943) NullType Column cannot be written to Parquet

[ https://issues.apache.org/jira/browse/SPARK-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959304#comment-14959304 ] Michael Armbrust commented on SPARK-10943: -- Yeah, parquet doesn't have a concept

[jira] [Commented] (SPARK-11058) failed spark job reports on YARN as successful

[ https://issues.apache.org/jira/browse/SPARK-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959320#comment-14959320 ] Lan Jiang commented on SPARK-11058: --- Sean, I recreated this problem after I triggered

[jira] [Commented] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959342#comment-14959342 ] Zhan Zhang commented on SPARK-11087: [~patcharee] I tried a simple case with partitio

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959347#comment-14959347 ] Michael Armbrust commented on SPARK-: - Yeah, that Scala code should work. Reg

[jira] [Resolved] (SPARK-10943) NullType Column cannot be written to Parquet

[ https://issues.apache.org/jira/browse/SPARK-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10943. -- Resolution: Won't Fix > NullType Column cannot be written to Parquet >

[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959357#comment-14959357 ] Joseph K. Bradley commented on SPARK-5874: -- That sounds useful, but we should add

[jira] [Updated] (SPARK-9919) Matrices should respect Java's equals and hashCode contract

[ https://issues.apache.org/jira/browse/SPARK-9919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9919: - Assignee: (was: Manoj Kumar) > Matrices should respect Java's equals and hashCode cont

[jira] [Commented] (SPARK-11131) Worker registration protocol is racy

[ https://issues.apache.org/jira/browse/SPARK-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959378#comment-14959378 ] Apache Spark commented on SPARK-11131: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-11131) Worker registration protocol is racy

[ https://issues.apache.org/jira/browse/SPARK-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11131: Assignee: Apache Spark > Worker registration protocol is racy > --

[jira] [Assigned] (SPARK-11131) Worker registration protocol is racy

[ https://issues.apache.org/jira/browse/SPARK-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11131: Assignee: (was: Apache Spark) > Worker registration protocol is racy > ---

[jira] [Comment Edited] (SPARK-5739) Size exceeds Integer.MAX_VALUE in File Map

[ https://issues.apache.org/jira/browse/SPARK-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959298#comment-14959298 ] Karl D. Gierach edited comment on SPARK-5739 at 10/15/15 7:06 PM: --

[jira] [Commented] (SPARK-9241) Supporting multiple DISTINCT columns

[ https://issues.apache.org/jira/browse/SPARK-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959440#comment-14959440 ] Reynold Xin commented on SPARK-9241: Do we have any idea on performance characteristic

[jira] [Commented] (SPARK-8658) AttributeReference equals method only compare name, exprId and dataType

[ https://issues.apache.org/jira/browse/SPARK-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959451#comment-14959451 ] Michael Armbrust commented on SPARK-8658: - There is no query that exposes the prob

[jira] [Resolved] (SPARK-11039) Document all UI "retained*" configurations

[ https://issues.apache.org/jira/browse/SPARK-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11039. Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull reque

[jira] [Updated] (SPARK-11039) Document all UI "retained*" configurations

[ https://issues.apache.org/jira/browse/SPARK-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11039: --- Assignee: Nick Pritchard > Document all UI "retained*" configurations > -

[jira] [Resolved] (SPARK-5657) Add PySpark Avro Output Format example

[ https://issues.apache.org/jira/browse/SPARK-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5657. --- Resolution: Won't Fix > Add PySpark Avro Output Format example > -

[jira] [Assigned] (SPARK-6488) Support addition/multiplication in PySpark's BlockMatrix

[ https://issues.apache.org/jira/browse/SPARK-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6488: --- Assignee: Apache Spark (was: Mike Dusenberry) > Support addition/multiplication in PySpark's

[jira] [Commented] (SPARK-6488) Support addition/multiplication in PySpark's BlockMatrix

[ https://issues.apache.org/jira/browse/SPARK-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959534#comment-14959534 ] Apache Spark commented on SPARK-6488: - User 'dusenberrymw' has created a pull request

[jira] [Assigned] (SPARK-6488) Support addition/multiplication in PySpark's BlockMatrix

[ https://issues.apache.org/jira/browse/SPARK-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6488: --- Assignee: Mike Dusenberry (was: Apache Spark) > Support addition/multiplication in PySpark's

[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959564#comment-14959564 ] Xusen Yin commented on SPARK-5874: -- I'd love to add supports to individual models first.

[jira] [Commented] (SPARK-2984) FileNotFoundException on _temporary directory

[ https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959571#comment-14959571 ] Pratik Khadloya commented on SPARK-2984: Am seeing the same issue on Spark 1.4.1.

[jira] [Comment Edited] (SPARK-2984) FileNotFoundException on _temporary directory

[ https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959571#comment-14959571 ] Pratik Khadloya edited comment on SPARK-2984 at 10/15/15 8:40 PM: --

[jira] [Comment Edited] (SPARK-2984) FileNotFoundException on _temporary directory

[ https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959571#comment-14959571 ] Pratik Khadloya edited comment on SPARK-2984 at 10/15/15 8:39 PM: --

[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959592#comment-14959592 ] Xusen Yin commented on SPARK-5874: -- Sure I'll do it. > How to improve the current ML pip

[jira] [Commented] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959599#comment-14959599 ] Zhan Zhang commented on SPARK-11087: [~patcharee] I try to duplicate your table as mu

[jira] [Comment Edited] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959599#comment-14959599 ] Zhan Zhang edited comment on SPARK-11087 at 10/15/15 8:58 PM: -

[jira] [Commented] (SPARK-9241) Supporting multiple DISTINCT columns

[ https://issues.apache.org/jira/browse/SPARK-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959604#comment-14959604 ] Herman van Hovell commented on SPARK-9241: -- It should grow linear (or am I missin

[jira] [Updated] (SPARK-11133) Flaky test: o.a.s.launcher.LauncherServerSuite

[ https://issues.apache.org/jira/browse/SPARK-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11133: -- Labels: flaky-test (was: ) > Flaky test: o.a.s.launcher.LauncherServerSuite >

[jira] [Created] (SPARK-11133) Flaky test: o.a.s.launcher.LauncherServerSuite

Andrew Or created SPARK-11133: - Summary: Flaky test: o.a.s.launcher.LauncherServerSuite Key: SPARK-11133 URL: https://issues.apache.org/jira/browse/SPARK-11133 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-11134) Flaky test: o.a.s.launcher.LauncherBackendSuite

Andrew Or created SPARK-11134: - Summary: Flaky test: o.a.s.launcher.LauncherBackendSuite Key: SPARK-11134 URL: https://issues.apache.org/jira/browse/SPARK-11134 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-11133) Flaky test: o.a.s.launcher.LauncherServerSuite

[ https://issues.apache.org/jira/browse/SPARK-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11133. Resolution: Duplicate > Flaky test: o.a.s.launcher.LauncherServerSuite > --

[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959589#comment-14959589 ] Joseph K. Bradley commented on SPARK-5874: -- Sure, that sounds good. Can you also

[jira] [Updated] (SPARK-11134) Flaky test: o.a.s.launcher.LauncherBackendSuite

[ https://issues.apache.org/jira/browse/SPARK-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11134: -- Labels: flaky-test (was: ) > Flaky test: o.a.s.launcher.LauncherBackendSuite > ---

[jira] [Updated] (SPARK-11071) Flaky test: o.a.s.launcher.LauncherServerSuite

[ https://issues.apache.org/jira/browse/SPARK-11071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11071: -- Component/s: (was: Spark Core) Tests > Flaky test: o.a.s.launcher.LauncherServerSu

[jira] [Updated] (SPARK-11071) Flaky test: o.a.s.launcher.LauncherServerSuite

[ https://issues.apache.org/jira/browse/SPARK-11071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11071: -- Labels: flaky-test (was: ) > Flaky test: o.a.s.launcher.LauncherServerSuite >

[jira] [Updated] (SPARK-11071) Flaky test: o.a.s.launcher.LauncherServerSuite

[ https://issues.apache.org/jira/browse/SPARK-11071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11071: -- Summary: Flaky test: o.a.s.launcher.LauncherServerSuite (was: LauncherServerSuite::testTimeout is flak

[jira] [Updated] (SPARK-11135) Exchange sort-planning logic may incorrect avoid sorts

[ https://issues.apache.org/jira/browse/SPARK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11135: --- Description: In Spark SQL, the Exchange planner tries to avoid unnecessary sorts in cases where the

[jira] [Created] (SPARK-11135) Exchange sort-planning logic may incorrect avoid sorts

Josh Rosen created SPARK-11135: -- Summary: Exchange sort-planning logic may incorrect avoid sorts Key: SPARK-11135 URL: https://issues.apache.org/jira/browse/SPARK-11135 Project: Spark Issue Type

[jira] [Updated] (SPARK-11135) Exchange sort-planning logic incorrectly avoid sorts when existing ordering is subset of required ordering

[ https://issues.apache.org/jira/browse/SPARK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11135: --- Summary: Exchange sort-planning logic incorrectly avoid sorts when existing ordering is subset of req

[jira] [Updated] (SPARK-11135) Exchange sort-planning logic incorrectly avoid sorts when existing ordering is non-empty subset of required ordering

[ https://issues.apache.org/jira/browse/SPARK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11135: --- Summary: Exchange sort-planning logic incorrectly avoid sorts when existing ordering is non-empty sub

[jira] [Resolved] (SPARK-11071) Flaky test: o.a.s.launcher.LauncherServerSuite

[ https://issues.apache.org/jira/browse/SPARK-11071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11071. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Flaky test: o.a.s.l

[jira] [Resolved] (SPARK-10515) When killing executor, the pending replacement executors will be lost

[ https://issues.apache.org/jira/browse/SPARK-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10515. --- Resolution: Fixed Assignee: KaiXinXIaoLei Fix Version/s: 1.6.0

[jira] [Resolved] (SPARK-10412) In SQL tab, show execution memory per physical operator

[ https://issues.apache.org/jira/browse/SPARK-10412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10412. --- Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.6.0 > In SQL tab, show execu

[jira] [Created] (SPARK-11136) Warm-start support for ML estimator

Xusen Yin created SPARK-11136: - Summary: Warm-start support for ML estimator Key: SPARK-11136 URL: https://issues.apache.org/jira/browse/SPARK-11136 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-11135) Exchange sort-planning logic incorrectly avoid sorts when existing ordering is non-empty subset of required ordering

[ https://issues.apache.org/jira/browse/SPARK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11135: Assignee: Apache Spark (was: Josh Rosen) > Exchange sort-planning logic incorrectly avoid

[jira] [Commented] (SPARK-11135) Exchange sort-planning logic incorrectly avoid sorts when existing ordering is non-empty subset of required ordering

[ https://issues.apache.org/jira/browse/SPARK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959735#comment-14959735 ] Apache Spark commented on SPARK-11135: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-11135) Exchange sort-planning logic incorrectly avoid sorts when existing ordering is non-empty subset of required ordering

[ https://issues.apache.org/jira/browse/SPARK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11135: Assignee: Josh Rosen (was: Apache Spark) > Exchange sort-planning logic incorrectly avoid

[jira] [Updated] (SPARK-10829) Scan DataSource with predicate expression combine partition key and attributes doesn't work

[ https://issues.apache.org/jira/browse/SPARK-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10829: -- Assignee: Cheng Hao > Scan DataSource with predicate expression combine partition key and > attributes

[jira] [Updated] (SPARK-5391) SparkSQL fails to create tables with custom JSON SerDe

[ https://issues.apache.org/jira/browse/SPARK-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5391: - Assignee: Davies Liu > SparkSQL fails to create tables with custom JSON SerDe > --

[jira] [Updated] (SPARK-11032) Failure to resolve having correctly

[ https://issues.apache.org/jira/browse/SPARK-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11032: -- Assignee: Wenchen Fan > Failure to resolve having correctly > --- > >

[jira] [Updated] (SPARK-11076) Decimal Support for Ceil/Floor

[ https://issues.apache.org/jira/browse/SPARK-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11076: -- Assignee: Cheng Hao > Decimal Support for Ceil/Floor > -- > >

[jira] [Updated] (SPARK-11068) Add callback to query execution

[ https://issues.apache.org/jira/browse/SPARK-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11068: -- Assignee: Wenchen Fan > Add callback to query execution > --- > >

[jira] [Resolved] (SPARK-11123) Inprove HistoryServer with multithread to relay logs

[ https://issues.apache.org/jira/browse/SPARK-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11123. --- Resolution: Duplicate [~xietingwen] please search JIRAs before opening a new one. > Inprove HistoryS

[jira] [Updated] (SPARK-11124) JsonParser/Generator should be closed for resource recycle

[ https://issues.apache.org/jira/browse/SPARK-11124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11124: -- Component/s: Spark Core > JsonParser/Generator should be closed for resource recycle >

[jira] [Updated] (SPARK-11128) strange NPE when writing in non-existing S3 bucket

[ https://issues.apache.org/jira/browse/SPARK-11128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11128: -- Component/s: Input/Output > strange NPE when writing in non-existing S3 bucket > --

[jira] [Updated] (SPARK-11102) Uninformative exception when specifing non-exist input for JSON data source

[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11102: --- Summary: Uninformative exception when specifing non-exist input for JSON data source (was: Unreadabl

[jira] [Created] (SPARK-11137) Make StreamingContext.stop() exception-safe

Felix Cheung created SPARK-11137: Summary: Make StreamingContext.stop() exception-safe Key: SPARK-11137 URL: https://issues.apache.org/jira/browse/SPARK-11137 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-11138) Flaky pyspark test: test_add_py_file

Marcelo Vanzin created SPARK-11138: -- Summary: Flaky pyspark test: test_add_py_file Key: SPARK-11138 URL: https://issues.apache.org/jira/browse/SPARK-11138 Project: Spark Issue Type: Bug

  1   2   >