[jira] [Resolved] (SPARK-1331) Graceful shutdown of Spark Streaming computation

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1331. Resolution: Fixed Fix Version/s: 1.0.0 > Graceful shutdown of Spark Streaming comput

[jira] [Commented] (SPARK-1441) compile Spark Core error with Hadoop 0.23.x

2014-04-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13962644#comment-13962644 ] Sean Owen commented on SPARK-1441: -- You're not enabling the yarn-alpha build profile here

[jira] [Commented] (SPARK-1438) Update RDD.sample() API to make seed parameter optional

2014-04-08 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13962653#comment-13962653 ] Sandeep Singh commented on SPARK-1438: -- You mean we should create a different method

[jira] [Updated] (SPARK-1441) Compile Spark Core error with Hadoop 0.23.x

2014-04-08 Thread witgo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] witgo updated SPARK-1441: - Summary: Compile Spark Core error with Hadoop 0.23.x (was: compile Spark Core error with Hadoop 0.23.x) > Compi

[jira] [Commented] (SPARK-1441) Compile Spark Core error with Hadoop 0.23.x

2014-04-08 Thread witgo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13962669#comment-13962669 ] witgo commented on SPARK-1441: -- If someone compile spark without yarn support,like this {cod

[jira] [Comment Edited] (SPARK-1413) Parquet messes up stdout and stdin when used in Spark REPL

2014-04-08 Thread witgo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13959784#comment-13959784 ] witgo edited comment on SPARK-1413 at 4/8/14 8:11 AM: -- You can try th

[jira] [Commented] (SPARK-1127) Add saveAsHBase to PairRDDFunctions

2014-04-08 Thread haosdent (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13962698#comment-13962698 ] haosdent commented on SPARK-1127: - [~pwendell] I have update the code in https://github.co

[jira] [Updated] (SPARK-1396) DAGScheduler has a memory leak for cancelled jobs

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1396: --- Fix Version/s: 1.0.0 > DAGScheduler has a memory leak for cancelled jobs > --

[jira] [Resolved] (SPARK-1396) DAGScheduler has a memory leak for cancelled jobs

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1396. Resolution: Fixed > DAGScheduler has a memory leak for cancelled jobs > ---

[jira] [Created] (SPARK-1442) Add Window function support

2014-04-08 Thread Chengxiang Li (JIRA)
Chengxiang Li created SPARK-1442: Summary: Add Window function support Key: SPARK-1442 URL: https://issues.apache.org/jira/browse/SPARK-1442 Project: Spark Issue Type: New Feature C

[jira] [Created] (SPARK-1443) Accessing Mongo GridFS data with Spark using mongo-hadoop API

2014-04-08 Thread Pavan Kumar Varma (JIRA)
Pavan Kumar Varma created SPARK-1443: Summary: Accessing Mongo GridFS data with Spark using mongo-hadoop API Key: SPARK-1443 URL: https://issues.apache.org/jira/browse/SPARK-1443 Project: Spark

[jira] [Updated] (SPARK-1443) Unable to Access MongoDB GridFS data with Spark using mongo-hadoop API

2014-04-08 Thread Pavan Kumar Varma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavan Kumar Varma updated SPARK-1443: - Summary: Unable to Access MongoDB GridFS data with Spark using mongo-hadoop API (was: Ac

[jira] [Updated] (SPARK-1443) Unable to Access MongoDB GridFS data with Spark using mongo-hadoop API

2014-04-08 Thread Pavan Kumar Varma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavan Kumar Varma updated SPARK-1443: - Description: I saved a 2GB pdf file into MongoDB using GridFS. now i want process those

[jira] [Commented] (SPARK-1443) Unable to Access MongoDB GridFS data with Spark using mongo-hadoop API

2014-04-08 Thread Pavan Kumar Varma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13962944#comment-13962944 ] Pavan Kumar Varma commented on SPARK-1443: -- working fine with spark when accessin

[jira] [Updated] (SPARK-1443) Unable to Access MongoDB GridFS data with Spark using mongo-hadoop API

2014-04-08 Thread Pavan Kumar Varma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavan Kumar Varma updated SPARK-1443: - Labels: GridFS MongoDB Spark hadoop2 java (was: ) > Unable to Access MongoDB GridFS data

[jira] [Commented] (SPARK-1441) Compile Spark Core error with Hadoop 0.23.x

2014-04-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963008#comment-13963008 ] Thomas Graves commented on SPARK-1441: -- It sounds like the avro changes we put into t

[jira] [Commented] (SPARK-1441) Compile Spark Core error with Hadoop 0.23.x

2014-04-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963016#comment-13963016 ] Sean Owen commented on SPARK-1441: -- I see, I had taken the "yarn-alpha" profile to be the

[jira] [Commented] (SPARK-1441) Compile Spark Core error with Hadoop 0.23.x

2014-04-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963021#comment-13963021 ] Thomas Graves commented on SPARK-1441: -- The yarn-alpha profile is tied to meaning inc

[jira] [Commented] (SPARK-1407) EventLogging to HDFS doesn't work properly on yarn

2014-04-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963025#comment-13963025 ] Thomas Graves commented on SPARK-1407: -- Note that the logging also doesn't work on se

[jira] [Commented] (SPARK-1441) Compile Spark Core error with Hadoop 0.23.x

2014-04-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963027#comment-13963027 ] Sean Owen commented on SPARK-1441: -- Got it. Maybe the profile can be switched around to a

[jira] [Commented] (SPARK-1441) Compile Spark Core error with Hadoop 0.23.x

2014-04-08 Thread witgo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963047#comment-13963047 ] witgo commented on SPARK-1441: -- How can use multiple property to activate profile? {code}

[jira] [Commented] (SPARK-1407) EventLogging to HDFS doesn't work properly on yarn

2014-04-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963052#comment-13963052 ] Thomas Graves commented on SPARK-1407: -- Ignore the last comment about secure hdfs. I

[jira] [Commented] (SPARK-1438) Update RDD.sample() API to make seed parameter optional

2014-04-08 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963173#comment-13963173 ] Aaron Davidson commented on SPARK-1438: --- PartitionwiseSampledRDD already has the see

[jira] [Commented] (SPARK-1407) EventLogging to HDFS doesn't work properly on yarn

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963231#comment-13963231 ] Patrick Wendell commented on SPARK-1407: [~tgraves] Did you test this with an appl

[jira] [Updated] (SPARK-1444) Update branch-0.9's SBT to 0.13.1 so that it works with Java 8

2014-04-08 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-1444: - Fix Version/s: 0.9.2 > Update branch-0.9's SBT to 0.13.1 so that it works with Java 8 > -

[jira] [Created] (SPARK-1444) Update branch-0.9's SBT to 0.13.1 so that it works with Java 8

2014-04-08 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-1444: Summary: Update branch-0.9's SBT to 0.13.1 so that it works with Java 8 Key: SPARK-1444 URL: https://issues.apache.org/jira/browse/SPARK-1444 Project: Spark

[jira] [Assigned] (SPARK-1428) MLlib should convert non-float64 NumPy arrays to float64 instead of complaining

2014-04-08 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia reassigned SPARK-1428: Assignee: Matei Zaharia > MLlib should convert non-float64 NumPy arrays to float64 instead

[jira] [Updated] (SPARK-1428) MLlib should convert non-float64 NumPy arrays to float64 instead of complaining

2014-04-08 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-1428: - Assignee: Sandeep Singh (was: Matei Zaharia) > MLlib should convert non-float64 NumPy arrays to

[jira] [Created] (SPARK-1445) compute-classpath.sh should not print error if lib_managed not found

2014-04-08 Thread Aaron Davidson (JIRA)
Aaron Davidson created SPARK-1445: - Summary: compute-classpath.sh should not print error if lib_managed not found Key: SPARK-1445 URL: https://issues.apache.org/jira/browse/SPARK-1445 Project: Spark

[jira] [Commented] (SPARK-1438) Update RDD.sample() API to make seed parameter optional

2014-04-08 Thread Kevin Tham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963291#comment-13963291 ] Kevin Tham commented on SPARK-1438: --- I can work on this (I'd like to try to submit my fi

[jira] [Commented] (SPARK-1407) EventLogging to HDFS doesn't work properly on yarn

2014-04-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963306#comment-13963306 ] Thomas Graves commented on SPARK-1407: -- I was just running SparkHdfsLR. I also tried

[jira] [Commented] (SPARK-1407) EventLogging to HDFS doesn't work properly on yarn

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963310#comment-13963310 ] Patrick Wendell commented on SPARK-1407: Unfortuantely I think SparkHDFSLR might j

[jira] [Commented] (SPARK-1049) spark on yarn - yarn-client mode doesn't always exit properly

2014-04-08 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963367#comment-13963367 ] Tathagata Das commented on SPARK-1049: -- [~tgraves] Wasnt this resolved, in master as

[jira] [Commented] (SPARK-1049) spark on yarn - yarn-client mode doesn't always exit properly

2014-04-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963409#comment-13963409 ] Thomas Graves commented on SPARK-1049: -- Yes it was, go ahead and resolve it. > spark

[jira] [Assigned] (SPARK-1049) spark on yarn - yarn-client mode doesn't always exit properly

2014-04-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-1049: Assignee: Thomas Graves > spark on yarn - yarn-client mode doesn't always exit properly > -

[jira] [Updated] (SPARK-1049) spark on yarn - yarn-client mode doesn't always exit properly

2014-04-08 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1049: - Fix Version/s: 0.9.1 1.0.0 > spark on yarn - yarn-client mode doesn't always e

[jira] [Resolved] (SPARK-1049) spark on yarn - yarn-client mode doesn't always exit properly

2014-04-08 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1049. -- Resolution: Fixed > spark on yarn - yarn-client mode doesn't always exit properly > ---

[jira] [Updated] (SPARK-1049) spark on yarn - yarn-client mode doesn't always exit properly

2014-04-08 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1049: - Affects Version/s: 0.9.0 > spark on yarn - yarn-client mode doesn't always exit properly > --

[jira] [Commented] (SPARK-1407) EventLogging to HDFS doesn't work properly on yarn

2014-04-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963456#comment-13963456 ] Thomas Graves commented on SPARK-1407: -- That was the problem. I modified SparkHdfsLR

[jira] [Closed] (SPARK-1407) EventLogging to HDFS doesn't work properly on yarn

2014-04-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves closed SPARK-1407. Resolution: Not a Problem Assignee: Thomas Graves > EventLogging to HDFS doesn't work properl

[jira] [Created] (SPARK-1446) Spark examples should not do a System.exit

2014-04-08 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-1446: Summary: Spark examples should not do a System.exit Key: SPARK-1446 URL: https://issues.apache.org/jira/browse/SPARK-1446 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-1402) 3 more compression algorithms for in-memory columnar storage

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1402. Resolution: Fixed > 3 more compression algorithms for in-memory columnar storage >

[jira] [Commented] (SPARK-1348) Spark UI's do not bind to localhost interface anymore

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963468#comment-13963468 ] Patrick Wendell commented on SPARK-1348: Okay we fixed this for 1.0. The decision

[jira] [Updated] (SPARK-1348) Spark UI's do not bind to localhost interface anymore

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1348: --- Assignee: Kan Zhang > Spark UI's do not bind to localhost interface anymore > ---

[jira] [Resolved] (SPARK-1348) Spark UI's do not bind to localhost interface anymore

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1348. Resolution: Fixed > Spark UI's do not bind to localhost interface anymore > ---

[jira] [Updated] (SPARK-1397) SparkListeners should be notified when stages are cancelled

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1397: --- Fix Version/s: 1.0.0 > SparkListeners should be notified when stages are cancelled >

[jira] [Created] (SPARK-1447) Update Java programming guide to explain Java 8 syntax

2014-04-08 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-1447: Summary: Update Java programming guide to explain Java 8 syntax Key: SPARK-1447 URL: https://issues.apache.org/jira/browse/SPARK-1447 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-1445) compute-classpath.sh should not print error if lib_managed not found

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1445. Resolution: Fixed > compute-classpath.sh should not print error if lib_managed not found >

[jira] [Updated] (SPARK-1397) SparkListeners should be notified when stages are cancelled

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1397: --- Priority: Critical (was: Major) > SparkListeners should be notified when stages are cancelle

[jira] [Resolved] (SPARK-1397) SparkListeners should be notified when stages are cancelled

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1397. Resolution: Fixed > SparkListeners should be notified when stages are cancelled > -

[jira] [Updated] (SPARK-1433) Upgrade Mesos dependency to 0.17.0

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1433: --- Assignee: Sandeep Singh > Upgrade Mesos dependency to 0.17.0 > --

[jira] [Resolved] (SPARK-1433) Upgrade Mesos dependency to 0.17.0

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1433. Resolution: Fixed Fix Version/s: 1.0.0 > Upgrade Mesos dependency to 0.17.0 > --

[jira] [Created] (SPARK-1448) KEYS file to be added to dist directory

2014-04-08 Thread Sebb (JIRA)
Sebb created SPARK-1448: --- Summary: KEYS file to be added to dist directory Key: SPARK-1448 URL: https://issues.apache.org/jira/browse/SPARK-1448 Project: Spark Issue Type: Task Reporter: Se

[jira] [Created] (SPARK-1449) Please delete old releases from mirroring system

2014-04-08 Thread Sebb (JIRA)
Sebb created SPARK-1449: --- Summary: Please delete old releases from mirroring system Key: SPARK-1449 URL: https://issues.apache.org/jira/browse/SPARK-1449 Project: Spark Issue Type: Task Affects Ver

[jira] [Created] (SPARK-1450) Specify the default zone in the EC2 script help

2014-04-08 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-1450: Summary: Specify the default zone in the EC2 script help Key: SPARK-1450 URL: https://issues.apache.org/jira/browse/SPARK-1450 Project: Spark Issue Type: Imp

[jira] [Assigned] (SPARK-1288) yarn stable finishApplicationMaster incomplete

2014-04-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-1288: Assignee: Thomas Graves > yarn stable finishApplicationMaster incomplete >

[jira] [Commented] (SPARK-1408) Modify Spark on Yarn to point to the history server when app finishes

2014-04-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963654#comment-13963654 ] Thomas Graves commented on SPARK-1408: -- https://github.com/apache/spark/pull/362 > M

[jira] [Commented] (SPARK-1288) yarn stable finishApplicationMaster incomplete

2014-04-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963655#comment-13963655 ] Thomas Graves commented on SPARK-1288: -- https://github.com/apache/spark/pull/362 > y

[jira] [Commented] (SPARK-1438) Update RDD.sample() API to make seed parameter optional

2014-04-08 Thread Kevin Tham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963670#comment-13963670 ] Kevin Tham commented on SPARK-1438: --- I see that org.apache.spark.sql.SchemaRDD also defi

[jira] [Updated] (SPARK-1271) Use Iteratable[X] in co-group and group-by signatures

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1271: --- Summary: Use Iteratable[X] in co-group and group-by signatures (was: Use Iterator[X] in co-g

[jira] [Updated] (SPARK-1271) Use Iteratable[X] in co-group and group-by signatures

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1271: --- Description: This API change will allow us to externalize these things down the road. Note th

[jira] [Updated] (SPARK-1271) Use Iterable[X] in co-group and group-by signatures

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1271: --- Summary: Use Iterable[X] in co-group and group-by signatures (was: Use Iteratable[X] in co-g

[jira] [Updated] (SPARK-1271) Use Iterable[X] in co-group and group-by signatures

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1271: --- Description: This API change will allow us to externalize these things down the road. Note th

[jira] [Commented] (SPARK-1407) EventLogging to HDFS doesn't work properly on yarn

2014-04-08 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963688#comment-13963688 ] Kan Zhang commented on SPARK-1407: -- I encountered similar issue. It is not limited to YAR

[jira] [Updated] (SPARK-1271) Use Iterable[X] in co-group and group-by signatures

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1271: --- Assignee: Holden Karau > Use Iterable[X] in co-group and group-by signatures > --

[jira] [Resolved] (SPARK-1271) Use Iterable[X] in co-group and group-by signatures

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1271. Resolution: Fixed > Use Iterable[X] in co-group and group-by signatures > -

[jira] [Commented] (SPARK-1382) NullPointerException when calling DStream.slice() before StreamingContext.start()

2014-04-08 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963743#comment-13963743 ] Shixiong Zhu commented on SPARK-1382: - PR: https://github.com/apache/spark/pull/365 >

[jira] [Resolved] (SPARK-1434) Make labelParser Java friendly.

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1434. Resolution: Fixed > Make labelParser Java friendly. > --- > >

[jira] [Commented] (SPARK-1446) Spark examples should not do a System.exit

2014-04-08 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963797#comment-13963797 ] Sandeep Singh commented on SPARK-1446: -- I want to work on this. > Spark examples sho

[jira] [Comment Edited] (SPARK-1446) Spark examples should not do a System.exit

2014-04-08 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963797#comment-13963797 ] Sandeep Singh edited comment on SPARK-1446 at 4/9/14 4:47 AM: --

[jira] [Commented] (SPARK-1157) L-BFGS Optimizer

2014-04-08 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963803#comment-13963803 ] DB Tsai commented on SPARK-1157: PR: https://github.com/apache/spark/pull/353 > L-BFGS Op

[jira] [Commented] (SPARK-1407) EventLogging to HDFS doesn't work properly on yarn

2014-04-08 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963809#comment-13963809 ] Kan Zhang commented on SPARK-1407: -- Made some change to drain SparkListenerBus' event que

[jira] [Created] (SPARK-1451) Multinomial Logistic Regression Support

2014-04-08 Thread DB Tsai (JIRA)
DB Tsai created SPARK-1451: -- Summary: Multinomial Logistic Regression Support Key: SPARK-1451 URL: https://issues.apache.org/jira/browse/SPARK-1451 Project: Spark Issue Type: New Feature C

[jira] [Resolved] (SPARK-939) Allow user jars to take precedence over Spark jars, if desired

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-939. --- Resolution: Fixed > Allow user jars to take precedence over Spark jars, if desired > -

[jira] [Commented] (SPARK-799) Windows versions of the deploy scripts

2014-04-08 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963830#comment-13963830 ] Sandeep Singh commented on SPARK-799: - all the files in the current sbin directory ? i

[jira] [Resolved] (SPARK-1390) Refactor RDD backed matrices

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1390. Resolution: Fixed > Refactor RDD backed matrices > > >