[jira] [Updated] (SPARK-8402) DP means clustering

2015-09-02 Thread Meethu Mathew (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Meethu Mathew updated SPARK-8402: - Description: At present, all the clustering algorithms in MLlib require the number of clusters

[jira] [Resolved] (SPARK-8694) Defer executing drawTaskAssignmentTimeline until page loaded to avoid to freeze the page

2015-09-02 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-8694. --- Resolution: Won't Fix > Defer executing drawTaskAssignmentTimeline until page loaded to avoid

[jira] [Commented] (SPARK-8694) Defer executing drawTaskAssignmentTimeline until page loaded to avoid to freeze the page

2015-09-02 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726815#comment-14726815 ] Kousuke Saruta commented on SPARK-8694: --- Now this issue is addressed by the pagination. > Defer

[jira] [Updated] (SPARK-10288) Add a rest client for Spark on Yarn

2015-09-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-10288: Description: This is a proposal to add rest client for Spark on Yarn. Rest API offers a

[jira] [Commented] (SPARK-10400) Rename or deprecate SQL option "spark.sql.parquet.followParquetFormatSpec"

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726879#comment-14726879 ] Apache Spark commented on SPARK-10400: -- User 'liancheng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10400) Rename or deprecate SQL option "spark.sql.parquet.followParquetFormatSpec"

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10400: Assignee: Cheng Lian (was: Apache Spark) > Rename or deprecate SQL option

[jira] [Assigned] (SPARK-10400) Rename or deprecate SQL option "spark.sql.parquet.followParquetFormatSpec"

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10400: Assignee: Apache Spark (was: Cheng Lian) > Rename or deprecate SQL option

[jira] [Resolved] (SPARK-5719) allow daemons to bind to specified host

2015-09-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5719. -- Resolution: Won't Fix > allow daemons to bind to specified host >

[jira] [Resolved] (SPARK-3000) drop old blocks to disk in parallel when memory is not large enough for caching new blocks

2015-09-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3000. -- Resolution: Won't Fix Per PR discussion, the PR is stale and duplicates some other subsequent changes.

[jira] [Assigned] (SPARK-10411) In SQL tab move visualization above explain output

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10411: Assignee: Shixiong Zhu (was: Apache Spark) > In SQL tab move visualization above explain

[jira] [Assigned] (SPARK-10411) In SQL tab move visualization above explain output

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10411: Assignee: Apache Spark (was: Shixiong Zhu) > In SQL tab move visualization above explain

[jira] [Resolved] (SPARK-9514) Add EventHubsReceiver to support Spark Streaming using Azure EventHubs

2015-09-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9514. -- Resolution: Won't Fix > Add EventHubsReceiver to support Spark Streaming using Azure EventHubs >

[jira] [Commented] (SPARK-10411) In SQL tab move visualization above explain output

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726953#comment-14726953 ] Apache Spark commented on SPARK-10411: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Updated] (SPARK-10415) Enhance Navigation Sidebar in PySpark API

2015-09-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10415: -- Priority: Minor (was: Major) How do you implement this? this is auto-generated docs, not something

[jira] [Commented] (SPARK-9821) pyspark reduceByKey should allow a custom partitioner

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726903#comment-14726903 ] Apache Spark commented on SPARK-9821: - User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-9821) pyspark reduceByKey should allow a custom partitioner

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9821: --- Assignee: Apache Spark > pyspark reduceByKey should allow a custom partitioner >

[jira] [Created] (SPARK-10415) Enhance Navigation Sidebar in PySpark API

2015-09-02 Thread Noel Smith (JIRA)
Noel Smith created SPARK-10415: -- Summary: Enhance Navigation Sidebar in PySpark API Key: SPARK-10415 URL: https://issues.apache.org/jira/browse/SPARK-10415 Project: Spark Issue Type:

[jira] [Created] (SPARK-10416) Thrift Server cannot do isolation for different users

2015-09-02 Thread Tao Wang (JIRA)
Tao Wang created SPARK-10416: Summary: Thrift Server cannot do isolation for different users Key: SPARK-10416 URL: https://issues.apache.org/jira/browse/SPARK-10416 Project: Spark Issue Type:

[jira] [Commented] (SPARK-10416) Thrift Server cannot do isolation for different users

2015-09-02 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727036#comment-14727036 ] Tao Wang commented on SPARK-10416: -- BTW the build command is "mvn -Pbigtop-dist -Phive-thriftserver

[jira] [Commented] (SPARK-9605) SparkR installation error: Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.6.jar

2015-09-02 Thread Laurent Jolia-Ferrier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727046#comment-14727046 ] Laurent Jolia-Ferrier commented on SPARK-9605: -- @Shivaram: You need to install SparkR in R

[jira] [Commented] (SPARK-10413) Model should support prediction on single instance

2015-09-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726909#comment-14726909 ] Yanbo Liang commented on SPARK-10413: - I will try to work on it. > Model should support prediction

[jira] [Assigned] (SPARK-9821) pyspark reduceByKey should allow a custom partitioner

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9821: --- Assignee: (was: Apache Spark) > pyspark reduceByKey should allow a custom partitioner >

[jira] [Resolved] (SPARK-3871) compute-classpath.sh does not escape :

2015-09-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3871. -- Resolution: Not A Problem > compute-classpath.sh does not escape : >

[jira] [Updated] (SPARK-10411) In SQL tab move visualization above explain output

2015-09-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10411: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > In SQL tab move

[jira] [Updated] (SPARK-10405) Support takeOrdered and topK values per key

2015-09-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10405: -- Priority: Minor (was: Major) Oops, I mean aggregateByKey. Why use a custom implementation? You need

[jira] [Commented] (SPARK-10415) Enhance Navigation Sidebar in PySpark API

2015-09-02 Thread Noel Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727001#comment-14727001 ] Noel Smith commented on SPARK-10415: Simple CSS/JavaScript additions to the theme that transform the

[jira] [Assigned] (SPARK-10415) Enhance Navigation Sidebar in PySpark API

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10415: Assignee: Apache Spark > Enhance Navigation Sidebar in PySpark API >

[jira] [Assigned] (SPARK-10415) Enhance Navigation Sidebar in PySpark API

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10415: Assignee: (was: Apache Spark) > Enhance Navigation Sidebar in PySpark API >

[jira] [Commented] (SPARK-10415) Enhance Navigation Sidebar in PySpark API

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727007#comment-14727007 ] Apache Spark commented on SPARK-10415: -- User 'noel-smith' has created a pull request for this issue:

[jira] [Commented] (SPARK-8469) Application timeline view unreadable with many executors

2015-09-02 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726812#comment-14726812 ] Kousuke Saruta commented on SPARK-8469: --- Thanks for investigating the use case of the timeline view

[jira] [Assigned] (SPARK-9718) LinearRegressionTrainingSummary should hold all columns in transformed data

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9718: --- Assignee: Apache Spark > LinearRegressionTrainingSummary should hold all columns in

[jira] [Commented] (SPARK-9718) LinearRegressionTrainingSummary should hold all columns in transformed data

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726845#comment-14726845 ] Apache Spark commented on SPARK-9718: - User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-9718) LinearRegressionTrainingSummary should hold all columns in transformed data

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9718: --- Assignee: (was: Apache Spark) > LinearRegressionTrainingSummary should hold all columns

[jira] [Commented] (SPARK-9722) Pass random seed to spark.ml DecisionTree*

2015-09-02 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726844#comment-14726844 ] holdenk commented on SPARK-9722: I can do this if no one else is working on it :) > Pass random seed to

[jira] [Assigned] (SPARK-9723) Params.getOrDefault should throw more meaningful exception

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9723: --- Assignee: Apache Spark > Params.getOrDefault should throw more meaningful exception >

[jira] [Commented] (SPARK-9723) Params.getOrDefault should throw more meaningful exception

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726880#comment-14726880 ] Apache Spark commented on SPARK-9723: - User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-9723) Params.getOrDefault should throw more meaningful exception

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9723: --- Assignee: (was: Apache Spark) > Params.getOrDefault should throw more meaningful

[jira] [Commented] (SPARK-10400) Rename or deprecate SQL option "spark.sql.parquet.followParquetFormatSpec"

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726884#comment-14726884 ] Apache Spark commented on SPARK-10400: -- User 'liancheng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10414) DenseMatrix gives different hashcode even though equals returns true

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10414: Assignee: Apache Spark > DenseMatrix gives different hashcode even though equals returns

[jira] [Commented] (SPARK-10414) DenseMatrix gives different hashcode even though equals returns true

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726869#comment-14726869 ] Apache Spark commented on SPARK-10414: -- User 'vinodkc' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10414) DenseMatrix gives different hashcode even though equals returns true

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10414: Assignee: (was: Apache Spark) > DenseMatrix gives different hashcode even though

[jira] [Commented] (SPARK-9296) variance, var_pop, and var_samp aggregate functions

2015-09-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726888#comment-14726888 ] Yanbo Liang commented on SPARK-9296: [~yhuai] I will work on this issue. I have implemented single

[jira] [Commented] (SPARK-10288) Add a rest client for Spark on Yarn

2015-09-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726814#comment-14726814 ] Saisai Shao commented on SPARK-10288: - Hi [~vanzin], thanks a lot for your comments. Yes it doesn't

[jira] [Created] (SPARK-10414) DenseMatrix gives different hashcode even though equals returns true

2015-09-02 Thread Vinod KC (JIRA)
Vinod KC created SPARK-10414: Summary: DenseMatrix gives different hashcode even though equals returns true Key: SPARK-10414 URL: https://issues.apache.org/jira/browse/SPARK-10414 Project: Spark

[jira] [Commented] (SPARK-10399) Off Heap Memory Access for non-JVM libraries (C++)

2015-09-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726886#comment-14726886 ] Saisai Shao commented on SPARK-10399: - Hi [~paulweiss], a simple question about C++ library to access

[jira] [Commented] (SPARK-9834) Normal equation solver and summary statistics for ordinary least squares

2015-09-02 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727568#comment-14727568 ] Meihua Wu commented on SPARK-9834: -- I would like to work on this. > Normal equation solver and summary

[jira] [Updated] (SPARK-2666) Always try to cancel running tasks when a stage is marked as zombie

2015-09-02 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-2666: Description: There are some situations in which the scheduler can mark a task set as a "zombie"

[jira] [Commented] (SPARK-6880) Spark Shutdowns with NoSuchElementException when running parallel collect on cachedRDD

2015-09-02 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727617#comment-14727617 ] Imran Rashid commented on SPARK-6880: - Explanation of the remaining issue from [~markhamstra] on why

[jira] [Commented] (SPARK-9834) Normal equation solver and summary statistics for ordinary least squares

2015-09-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727636#comment-14727636 ] Xiangrui Meng commented on SPARK-9834: -- [~meihuawu] I assigned this JIRA to me because it blocks

[jira] [Updated] (SPARK-2666) Always try to cancel running tasks when a stage is marked as zombie

2015-09-02 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-2666: Summary: Always try to cancel running tasks when a stage is marked as zombie (was: when task is

[jira] [Commented] (SPARK-10094) Mark ML PySpark feature transformers as Experimental to match Scala

2015-09-02 Thread Noel Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727474#comment-14727474 ] Noel Smith commented on SPARK-10094: Is this still outstanding? If so I can take a look at it later

[jira] [Updated] (SPARK-2666) Always try to cancel running tasks when a stage is marked as zombie

2015-09-02 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-2666: Description: There are some situations in which the scheduler can mark a task set as a "zombie"

[jira] [Commented] (SPARK-10288) Add a rest client for Spark on Yarn

2015-09-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727697#comment-14727697 ] Marcelo Vanzin commented on SPARK-10288: So, the design document still spends more time talking

[jira] [Commented] (SPARK-2666) when task is FetchFailed cancel running tasks of failedStage

2015-09-02 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727544#comment-14727544 ] Imran Rashid commented on SPARK-2666: - Great, thanks Kay. I am going to change the title &

[jira] [Commented] (SPARK-10397) Make Python's SparkContext self-descriptive on "print sc"

2015-09-02 Thread Alexey Grishchenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727473#comment-14727473 ] Alexey Grishchenko commented on SPARK-10397: I think this might be useful. But if this

[jira] [Updated] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-09-02 Thread Kalle Jepsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kalle Jepsen updated SPARK-4105: Affects Version/s: 1.4.1 > FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with

[jira] [Updated] (SPARK-2666) Always try to cancel running tasks when a stage is marked as zombie

2015-09-02 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-2666: Component/s: Scheduler > Always try to cancel running tasks when a stage is marked as zombie >

[jira] [Updated] (SPARK-2666) Always try to cancel running tasks when a stage is marked as zombie

2015-09-02 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-2666: Description: There are some situations in which the scheduler can mark a task set as a "zombie"

[jira] [Updated] (SPARK-2666) Always try to cancel running tasks when a stage is marked as zombie

2015-09-02 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-2666: Description: There are some situations in which the scheduler can mark a task set as a "zombie"

[jira] [Created] (SPARK-10420) Implementing Reactive Streams based Spark Streaming Receiver

2015-09-02 Thread Nilanjan Raychaudhuri (JIRA)
Nilanjan Raychaudhuri created SPARK-10420: - Summary: Implementing Reactive Streams based Spark Streaming Receiver Key: SPARK-10420 URL: https://issues.apache.org/jira/browse/SPARK-10420

[jira] [Commented] (SPARK-2960) Spark executables fail to start via symlinks

2015-09-02 Thread Mike Ringenburg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727704#comment-14727704 ] Mike Ringenburg commented on SPARK-2960: Has there been any progress on this? It looks like there

[jira] [Created] (SPARK-10424) ShuffleHashOuterJoin should consider condition

2015-09-02 Thread Davies Liu (JIRA)
Davies Liu created SPARK-10424: -- Summary: ShuffleHashOuterJoin should consider condition Key: SPARK-10424 URL: https://issues.apache.org/jira/browse/SPARK-10424 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-10332) spark-submit to yarn doesn't fail if executors is 0

2015-09-02 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728292#comment-14728292 ] holdenk commented on SPARK-10332: - Looking at the code, it seems like the relevant logic is still there

[jira] [Assigned] (SPARK-10332) spark-submit to yarn doesn't fail if executors is 0

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10332: Assignee: Apache Spark > spark-submit to yarn doesn't fail if executors is 0 >

[jira] [Assigned] (SPARK-10332) spark-submit to yarn doesn't fail if executors is 0

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10332: Assignee: (was: Apache Spark) > spark-submit to yarn doesn't fail if executors is 0 >

[jira] [Created] (SPARK-10421) tachyon dependency can leak different curator artifact versions

2015-09-02 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-10421: -- Summary: tachyon dependency can leak different curator artifact versions Key: SPARK-10421 URL: https://issues.apache.org/jira/browse/SPARK-10421 Project: Spark

[jira] [Resolved] (SPARK-10004) Shuffle service should make sure applications are allowed to read shuffle data

2015-09-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10004. Resolution: Fixed Fix Version/s: 1.6.0 It might be worth it to consider this patch

[jira] [Updated] (SPARK-10353) MLlib BLAS gemm outputs wrong result when beta = 0.0 for transpose transpose matrix multiplication

2015-09-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10353: -- Fix Version/s: 1.5.0 1.4.2 > MLlib BLAS gemm outputs wrong result when beta

[jira] [Closed] (SPARK-10306) sbt hive/update issue

2015-09-02 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk closed SPARK-10306. --- Resolution: Not A Problem Guess it was a local problem. > sbt hive/update issue > - > >

[jira] [Created] (SPARK-10426) Cannot call methods on a stopped SparkContext

2015-09-02 Thread cen yuhai (JIRA)
cen yuhai created SPARK-10426: - Summary: Cannot call methods on a stopped SparkContext Key: SPARK-10426 URL: https://issues.apache.org/jira/browse/SPARK-10426 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-10427) Spark-sql -f or -e will output some

2015-09-02 Thread cen yuhai (JIRA)
cen yuhai created SPARK-10427: - Summary: Spark-sql -f or -e will output some Key: SPARK-10427 URL: https://issues.apache.org/jira/browse/SPARK-10427 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-10425) Add a regression test for SPARK-10379

2015-09-02 Thread Davies Liu (JIRA)
Davies Liu created SPARK-10425: -- Summary: Add a regression test for SPARK-10379 Key: SPARK-10425 URL: https://issues.apache.org/jira/browse/SPARK-10425 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-10424) ShuffleHashOuterJoin should consider condition

2015-09-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-10424: --- Priority: Blocker (was: Major) > ShuffleHashOuterJoin should consider condition >

[jira] [Commented] (SPARK-10332) spark-submit to yarn doesn't fail if executors is 0

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728328#comment-14728328 ] Apache Spark commented on SPARK-10332: -- User 'holdenk' has created a pull request for this issue:

[jira] [Created] (SPARK-10428) Struct fields read from parquet are mis-aligned

2015-09-02 Thread Yin Huai (JIRA)
Yin Huai created SPARK-10428: Summary: Struct fields read from parquet are mis-aligned Key: SPARK-10428 URL: https://issues.apache.org/jira/browse/SPARK-10428 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-9834) Normal equation solver for ordinary least squares

2015-09-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9834: - Summary: Normal equation solver for ordinary least squares (was: Normal equation solver and

[jira] [Updated] (SPARK-7539) Perf tests for Python MLlib

2015-09-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7539: - Target Version/s: 1.6.0 (was: 1.5.0) > Perf tests for Python MLlib > ---

[jira] [Updated] (SPARK-7609) Add standardized checks for (Model, Estimator) unit tests

2015-09-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7609: - Target Version/s: 1.6.0 (was: 1.5.0) > Add standardized checks for (Model, Estimator) unit tests

[jira] [Closed] (SPARK-10247) Cleanup DAGSchedulerSuite "ignore late map task completion"

2015-09-02 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-10247. - Resolution: Fixed Fix Version/s: 1.6.0 > Cleanup DAGSchedulerSuite "ignore late map task

[jira] [Updated] (SPARK-8707) RDD#toDebugString fails if any cached RDD has invalid partitions

2015-09-02 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8707: - Assignee: Navis > RDD#toDebugString fails if any cached RDD has invalid partitions >

[jira] [Closed] (SPARK-10411) In SQL tab move visualization above explain output

2015-09-02 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-10411. - Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > In SQL tab move visualization

[jira] [Created] (SPARK-10430) AccumulableInfo and RDDOperationScope violates hashCode + equals contract

2015-09-02 Thread Vinod KC (JIRA)
Vinod KC created SPARK-10430: Summary: AccumulableInfo and RDDOperationScope violates hashCode + equals contract Key: SPARK-10430 URL: https://issues.apache.org/jira/browse/SPARK-10430 Project: Spark

[jira] [Assigned] (SPARK-10430) AccumulableInfo and RDDOperationScope violates hashCode + equals contract

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10430: Assignee: Apache Spark > AccumulableInfo and RDDOperationScope violates hashCode + equals

[jira] [Assigned] (SPARK-10205) Specify schema during PowerIterationClustering.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10205: Assignee: (was: Apache Spark) > Specify schema during PowerIterationClustering.save

[jira] [Assigned] (SPARK-10204) Specify schema during NaiveBayes.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10204: Assignee: Apache Spark > Specify schema during NaiveBayes.save to avoid reflection >

[jira] [Commented] (SPARK-10205) Specify schema during PowerIterationClustering.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728437#comment-14728437 ] Apache Spark commented on SPARK-10205: -- User 'vinodkc' has created a pull request for this issue:

[jira] [Commented] (SPARK-10209) Specify schema during DistributedLDAModel.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728441#comment-14728441 ] Apache Spark commented on SPARK-10209: -- User 'vinodkc' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10205) Specify schema during PowerIterationClustering.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10205: Assignee: Apache Spark > Specify schema during PowerIterationClustering.save to avoid

[jira] [Commented] (SPARK-10206) Specify schema during IsotonicRegression.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728438#comment-14728438 ] Apache Spark commented on SPARK-10206: -- User 'vinodkc' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10206) Specify schema during IsotonicRegression.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10206: Assignee: (was: Apache Spark) > Specify schema during IsotonicRegression.save to

[jira] [Assigned] (SPARK-10204) Specify schema during NaiveBayes.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10204: Assignee: (was: Apache Spark) > Specify schema during NaiveBayes.save to avoid

[jira] [Assigned] (SPARK-10209) Specify schema during DistributedLDAModel.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10209: Assignee: (was: Apache Spark) > Specify schema during DistributedLDAModel.save to

[jira] [Assigned] (SPARK-10212) Specify schema during TreeEnsembleModel.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10212: Assignee: (was: Apache Spark) > Specify schema during TreeEnsembleModel.save to avoid

[jira] [Assigned] (SPARK-10206) Specify schema during IsotonicRegression.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10206: Assignee: Apache Spark > Specify schema during IsotonicRegression.save to avoid

[jira] [Commented] (SPARK-9296) variance, var_pop, and var_samp aggregate functions

2015-09-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728446#comment-14728446 ] Yin Huai commented on SPARK-9296: - [~yanboliang] We will remove the old aggregate function code path in

[jira] [Assigned] (SPARK-10213) Specify schema during DecisionTreeModel.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10213: Assignee: Apache Spark > Specify schema during DecisionTreeModel.save to avoid reflection

[jira] [Assigned] (SPARK-10213) Specify schema during DecisionTreeModel.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10213: Assignee: (was: Apache Spark) > Specify schema during DecisionTreeModel.save to avoid

[jira] [Assigned] (SPARK-10208) Specify schema during LocalLDAModel.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10208: Assignee: (was: Apache Spark) > Specify schema during LocalLDAModel.save to avoid

[jira] [Assigned] (SPARK-10202) Specify schema during KMeansModel.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10202: Assignee: (was: Apache Spark) > Specify schema during KMeansModel.save to avoid

[jira] [Commented] (SPARK-10204) Specify schema during NaiveBayes.save to avoid reflection

2015-09-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728436#comment-14728436 ] Apache Spark commented on SPARK-10204: -- User 'vinodkc' has created a pull request for this issue:

  1   2   3   >