[jira] [Commented] (SPARK-1902) Spark shell prints error when :4040 port already in use

2015-07-30 Thread Eugene Morozov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647623#comment-14647623 ] Eugene Morozov commented on SPARK-1902: --- It looks like package name has changed

[jira] [Created] (SPARK-9475) Consistent hadoop config for external/*

2015-07-30 Thread Cody Koeninger (JIRA)
Cody Koeninger created SPARK-9475: - Summary: Consistent hadoop config for external/* Key: SPARK-9475 URL: https://issues.apache.org/jira/browse/SPARK-9475 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9473) Consistent hadoop config for SQL

2015-07-30 Thread Cody Koeninger (JIRA)
Cody Koeninger created SPARK-9473: - Summary: Consistent hadoop config for SQL Key: SPARK-9473 URL: https://issues.apache.org/jira/browse/SPARK-9473 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-9380) Pregel example fix in graphx-programming-guide

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9380: - Assignee: Alexander Ulanov Pregel example fix in graphx-programming-guide

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-30 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647630#comment-14647630 ] Liang-Chi Hsieh commented on SPARK-9347: It will merge different schema if the

[jira] [Assigned] (SPARK-9472) Consistent hadoop config for streaming

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9472: --- Assignee: (was: Apache Spark) Consistent hadoop config for streaming

[jira] [Assigned] (SPARK-9472) Consistent hadoop config for streaming

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9472: --- Assignee: Apache Spark Consistent hadoop config for streaming

[jira] [Updated] (SPARK-9447) Update python API to include RandomForest as classifier changes.

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9447: - Component/s: PySpark MLlib Update python API to include RandomForest as classifier

[jira] [Commented] (SPARK-9377) Shuffle tuning should discuss task size optimisation

2015-07-30 Thread Jem Tucker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647599#comment-14647599 ] Jem Tucker commented on SPARK-9377: --- Yes I will do Shuffle tuning should discuss task

[jira] [Commented] (SPARK-9377) Shuffle tuning should discuss task size optimisation

2015-07-30 Thread Jem Tucker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647600#comment-14647600 ] Jem Tucker commented on SPARK-9377: --- Yes I will do Shuffle tuning should discuss task

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-30 Thread Samphel Norden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647606#comment-14647606 ] Samphel Norden commented on SPARK-9347: --- One additional question. Assuming schema

[jira] [Created] (SPARK-9472) Consistent hadoop config for streaming

2015-07-30 Thread Cody Koeninger (JIRA)
Cody Koeninger created SPARK-9472: - Summary: Consistent hadoop config for streaming Key: SPARK-9472 URL: https://issues.apache.org/jira/browse/SPARK-9472 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-9276) ThriftServer process can't stop if using command yarn application -kill appid

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9276. -- Resolution: Not A Problem Reopen if someone can explain in more detail what the problem is

[jira] [Assigned] (SPARK-9248) Closing curly-braces should always be on their own line

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9248: --- Assignee: (was: Apache Spark) Closing curly-braces should always be on their own line

[jira] [Assigned] (SPARK-9248) Closing curly-braces should always be on their own line

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9248: --- Assignee: Apache Spark Closing curly-braces should always be on their own line

[jira] [Commented] (SPARK-9248) Closing curly-braces should always be on their own line

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647512#comment-14647512 ] Apache Spark commented on SPARK-9248: - User 'yu-iskw' has created a pull request for

[jira] [Assigned] (SPARK-8978) Implement the DirectKafkaController

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8978: --- Assignee: Apache Spark Implement the DirectKafkaController

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-30 Thread Samphel Norden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647634#comment-14647634 ] Samphel Norden commented on SPARK-9347: --- Am trying to get spark to only look at

[jira] [Commented] (SPARK-8978) Implement the DirectKafkaController

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647631#comment-14647631 ] Apache Spark commented on SPARK-8978: - User 'dragos' has created a pull request for

[jira] [Assigned] (SPARK-8978) Implement the DirectKafkaController

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8978: --- Assignee: (was: Apache Spark) Implement the DirectKafkaController

[jira] [Commented] (SPARK-9472) Consistent hadoop config for streaming

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647665#comment-14647665 ] Apache Spark commented on SPARK-9472: - User 'koeninger' has created a pull request for

[jira] [Resolved] (SPARK-4666) executor.memoryOverhead config should take a memory string

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4666. -- Resolution: Won't Fix I think this timed out and/or got subsumed in another JIRA

[jira] [Issue Comment Deleted] (SPARK-9377) Shuffle tuning should discuss task size optimisation

2015-07-30 Thread Jem Tucker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jem Tucker updated SPARK-9377: -- Comment: was deleted (was: Yes I will do) Shuffle tuning should discuss task size optimisation

[jira] [Created] (SPARK-9474) Consistent hadoop config for core

2015-07-30 Thread Cody Koeninger (JIRA)
Cody Koeninger created SPARK-9474: - Summary: Consistent hadoop config for core Key: SPARK-9474 URL: https://issues.apache.org/jira/browse/SPARK-9474 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-9377) Shuffle tuning should discuss task size optimisation

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647502#comment-14647502 ] Sean Owen commented on SPARK-9377: -- [~jem.tucker] do you want to open a PR that

[jira] [Created] (SPARK-9476) Kafka stream loses leader after 2h of operation

2015-07-30 Thread Ruben Ramalho (JIRA)
Ruben Ramalho created SPARK-9476: Summary: Kafka stream loses leader after 2h of operation Key: SPARK-9476 URL: https://issues.apache.org/jira/browse/SPARK-9476 Project: Spark Issue Type:

[jira] [Created] (SPARK-9478) Add class weights to Random Forest

2015-07-30 Thread Patrick Crenshaw (JIRA)
Patrick Crenshaw created SPARK-9478: --- Summary: Add class weights to Random Forest Key: SPARK-9478 URL: https://issues.apache.org/jira/browse/SPARK-9478 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9477) Adding IBM Platform Application Service Controller into Spark documentation as a supported Cluster Manager (beside Yarn and Mesos).

2015-07-30 Thread Stacy Pedersen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647767#comment-14647767 ] Stacy Pedersen commented on SPARK-9477: --- Hi Sean, can we not just list it as a

[jira] [Comment Edited] (SPARK-9477) Adding IBM Platform Application Service Controller into Spark documentation as a supported Cluster Manager (beside Yarn and Mesos).

2015-07-30 Thread Stacy Pedersen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647767#comment-14647767 ] Stacy Pedersen edited comment on SPARK-9477 at 7/30/15 3:16 PM:

[jira] [Commented] (SPARK-9479) ReceiverTrackerSuite fails for maven build

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647836#comment-14647836 ] Apache Spark commented on SPARK-9479: - User 'zsxwing' has created a pull request for

[jira] [Commented] (SPARK-9477) Adding IBM Platform Application Service Controller into Spark documentation as a supported Cluster Manager (beside Yarn and Mesos).

2015-07-30 Thread Stacy Pedersen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647703#comment-14647703 ] Stacy Pedersen commented on SPARK-9477: --- Here is link to the IBM Knowledge Center

[jira] [Commented] (SPARK-9477) Adding IBM Platform Application Service Controller into Spark documentation as a supported Cluster Manager (beside Yarn and Mesos).

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647748#comment-14647748 ] Sean Owen commented on SPARK-9477: -- The usual question is: does this need to live in

[jira] [Commented] (SPARK-9478) Add class weights to Random Forest

2015-07-30 Thread Patrick Crenshaw (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647772#comment-14647772 ] Patrick Crenshaw commented on SPARK-9478: - Similar to this ticket for Logistic

[jira] [Resolved] (SPARK-8998) Collect enough frequent prefixes before projection in PrefixSpan

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8998. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7783

[jira] [Assigned] (SPARK-9479) ReceiverTrackerSuite fails for maven build

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9479: --- Assignee: Apache Spark ReceiverTrackerSuite fails for maven build

[jira] [Commented] (SPARK-6885) Decision trees: predict class probabilities

2015-07-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647741#comment-14647741 ] Yanbo Liang commented on SPARK-6885: [~josephkb] I create a new version of

[jira] [Comment Edited] (SPARK-9477) Adding IBM Platform Application Service Controller into Spark documentation as a supported Cluster Manager (beside Yarn and Mesos).

2015-07-30 Thread Stacy Pedersen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647767#comment-14647767 ] Stacy Pedersen edited comment on SPARK-9477 at 7/30/15 3:24 PM:

[jira] [Created] (SPARK-9479) ReceiverTrackerSuite fails for maven build

2015-07-30 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-9479: --- Summary: ReceiverTrackerSuite fails for maven build Key: SPARK-9479 URL: https://issues.apache.org/jira/browse/SPARK-9479 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-30 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647673#comment-14647673 ] Liang-Chi Hsieh commented on SPARK-9347: Actually the newly introduced

[jira] [Resolved] (SPARK-5561) Generalize PeriodicGraphCheckpointer for RDDs

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5561. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7728

[jira] [Created] (SPARK-9477) Adding IBM Platform Application Service Controller into Spark documentation as a supported Cluster Manager (beside Yarn and Mesos).

2015-07-30 Thread Stacy Pedersen (JIRA)
Stacy Pedersen created SPARK-9477: - Summary: Adding IBM Platform Application Service Controller into Spark documentation as a supported Cluster Manager (beside Yarn and Mesos). Key: SPARK-9477 URL:

[jira] [Resolved] (SPARK-7368) add QR decomposition for RowMatrix

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7368. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 5909

[jira] [Assigned] (SPARK-9479) ReceiverTrackerSuite fails for maven build

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9479: --- Assignee: (was: Apache Spark) ReceiverTrackerSuite fails for maven build

[jira] [Commented] (SPARK-9469) TungstenSort should not do safe - unsafe conversion itself

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648309#comment-14648309 ] Apache Spark commented on SPARK-9469: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-9454) LDASuite should use vector comparisons

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9454: - Assignee: Feynman Liang LDASuite should use vector comparisons

[jira] [Updated] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9487: - Target Version/s: 1.5.0 Use the same num. worker threads in Scala/Python unit tests

[jira] [Created] (SPARK-9484) Word2Vec import/export for original binary format

2015-07-30 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9484: Summary: Word2Vec import/export for original binary format Key: SPARK-9484 URL: https://issues.apache.org/jira/browse/SPARK-9484 Project: Spark

[jira] [Commented] (SPARK-5692) Model import/export for Word2Vec

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648180#comment-14648180 ] Joseph K. Bradley commented on SPARK-5692: -- This was not, but thanks for the

[jira] [Commented] (SPARK-7583) User guide update for RegexTokenizer

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648182#comment-14648182 ] Joseph K. Bradley commented on SPARK-7583: -- Yes, please! This can go in after

[jira] [Created] (SPARK-9488) pyspark.sql.types.Row very slow when used named arguments

2015-07-30 Thread Alexis Benoist (JIRA)
Alexis Benoist created SPARK-9488: - Summary: pyspark.sql.types.Row very slow when used named arguments Key: SPARK-9488 URL: https://issues.apache.org/jira/browse/SPARK-9488 Project: Spark

[jira] [Updated] (SPARK-9488) pyspark.sql.types.Row very slow when using named arguments

2015-07-30 Thread Alexis Benoist (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexis Benoist updated SPARK-9488: -- Summary: pyspark.sql.types.Row very slow when using named arguments (was:

[jira] [Commented] (SPARK-8197) date/time function: trunc

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648351#comment-14648351 ] Apache Spark commented on SPARK-8197: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-6227) PCA and SVD for PySpark

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648192#comment-14648192 ] Joseph K. Bradley commented on SPARK-6227: -- That's great you're interested.

[jira] [Updated] (SPARK-6684) Add checkpointing to GradientBoostedTrees

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6684: - Shepherd: Xiangrui Meng Add checkpointing to GradientBoostedTrees

[jira] [Commented] (SPARK-8176) date/time function: to_date

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648350#comment-14648350 ] Apache Spark commented on SPARK-8176: - User 'davies' has created a pull request for

[jira] [Updated] (SPARK-9408) Refactor mllib/linalg.py to mllib/linalg

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9408: - Shepherd: Davies Liu (was: Xiangrui Meng) Refactor mllib/linalg.py to mllib/linalg

[jira] [Updated] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Philip Adetiloye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Adetiloye updated SPARK-9485: Description: Spark-submit throws an exception when connecting to yarn but it works when

[jira] [Commented] (SPARK-967) start-slaves.sh uses local path from master on remote slave nodes

2015-07-30 Thread David Chin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648234#comment-14648234 ] David Chin commented on SPARK-967: -- I won't create a pull request unless asked to, but I

[jira] [Commented] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Philip Adetiloye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648233#comment-14648233 ] Philip Adetiloye commented on SPARK-9485: - [~srowen] Thanks for the quick reply.

[jira] [Updated] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9485: - Shepherd: (was: MEN CHAMROEUN) Target Version/s: (was: 1.4.1) Environment:

[jira] [Comment Edited] (SPARK-967) start-slaves.sh uses local path from master on remote slave nodes

2015-07-30 Thread David Chin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648234#comment-14648234 ] David Chin edited comment on SPARK-967 at 7/30/15 8:34 PM: --- I

[jira] [Assigned] (SPARK-9486) Add aliasing to data sources to allow external packages to register themselves with Spark

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9486: --- Assignee: Apache Spark Add aliasing to data sources to allow external packages to register

[jira] [Assigned] (SPARK-9486) Add aliasing to data sources to allow external packages to register themselves with Spark

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9486: --- Assignee: (was: Apache Spark) Add aliasing to data sources to allow external packages

[jira] [Created] (SPARK-9485) Failed to connect to yarn

2015-07-30 Thread Philip Adetiloye (JIRA)
Philip Adetiloye created SPARK-9485: --- Summary: Failed to connect to yarn Key: SPARK-9485 URL: https://issues.apache.org/jira/browse/SPARK-9485 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Philip Adetiloye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648233#comment-14648233 ] Philip Adetiloye edited comment on SPARK-9485 at 7/30/15 8:16 PM:

[jira] [Comment Edited] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Philip Adetiloye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648233#comment-14648233 ] Philip Adetiloye edited comment on SPARK-9485 at 7/30/15 8:16 PM:

[jira] [Commented] (SPARK-9486) Add aliasing to data sources to allow external packages to register themselves with Spark

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648287#comment-14648287 ] Apache Spark commented on SPARK-9486: - User 'JDrit' has created a pull request for

[jira] [Commented] (SPARK-6684) Add checkpointing to GradientBoostedTrees

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648310#comment-14648310 ] Apache Spark commented on SPARK-6684: - User 'jkbradley' has created a pull request for

[jira] [Assigned] (SPARK-6684) Add checkpointing to GradientBoostedTrees

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6684: --- Assignee: Apache Spark (was: Joseph K. Bradley) Add checkpointing to GradientBoostedTrees

[jira] [Assigned] (SPARK-6684) Add checkpointing to GradientBoostedTrees

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6684: --- Assignee: Joseph K. Bradley (was: Apache Spark) Add checkpointing to GradientBoostedTrees

[jira] [Updated] (SPARK-5567) Add prediction methods to LDA

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5567: - Assignee: Feynman Liang Add prediction methods to LDA -

[jira] [Comment Edited] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Philip Adetiloye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648233#comment-14648233 ] Philip Adetiloye edited comment on SPARK-9485 at 7/30/15 8:17 PM:

[jira] [Resolved] (SPARK-5567) Add prediction methods to LDA

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-5567. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7760

[jira] [Resolved] (SPARK-9133) Add and Subtract should support date/timestamp and interval type

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9133. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7754

[jira] [Resolved] (SPARK-8194) date/time function: add_months

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8194. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7754

[jira] [Resolved] (SPARK-8186) date/time function: date_add

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8186. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7754

[jira] [Resolved] (SPARK-8187) date/time function: date_sub

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8187. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7754

[jira] [Resolved] (SPARK-9290) DateExpressionsSuite is slow to run

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9290. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7754

[jira] [Resolved] (SPARK-8198) date/time function: months_between

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8198. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7754

[jira] [Commented] (SPARK-9478) Add class weights to Random Forest

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648184#comment-14648184 ] Joseph K. Bradley commented on SPARK-9478: -- This sounds valuable. Handling it by

[jira] [Commented] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648200#comment-14648200 ] Sean Owen commented on SPARK-9485: -- I don't think this is sufficient to be a JIRA bug

[jira] [Updated] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Philip Adetiloye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Adetiloye updated SPARK-9485: Shepherd: MEN CHAMROEUN Failed to connect to yarn / spark-submit --master yarn-client

[jira] [Updated] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9481: - Shepherd: Joseph K. Bradley Assignee: Feynman Liang LocalLDAModel logLikelihood

[jira] [Updated] (SPARK-9454) LDASuite should use vector comparisons

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9454: - Shepherd: Joseph K. Bradley LDASuite should use vector comparisons

[jira] [Commented] (SPARK-9458) Avoid object allocation in prefix generation

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648308#comment-14648308 ] Apache Spark commented on SPARK-9458: - User 'rxin' has created a pull request for this

[jira] [Resolved] (SPARK-9454) LDASuite should use vector comparisons

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9454. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7775

[jira] [Created] (SPARK-9486) Add aliasing to data sources to allow external packages to register themselves with Spark

2015-07-30 Thread Joseph Batchik (JIRA)
Joseph Batchik created SPARK-9486: - Summary: Add aliasing to data sources to allow external packages to register themselves with Spark Key: SPARK-9486 URL: https://issues.apache.org/jira/browse/SPARK-9486

[jira] [Created] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2015-07-30 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9487: Summary: Use the same num. worker threads in Scala/Python unit tests Key: SPARK-9487 URL: https://issues.apache.org/jira/browse/SPARK-9487 Project: Spark

[jira] [Updated] (SPARK-4823) rowSimilarities

2015-07-30 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Debasish Das updated SPARK-4823: Attachment: SparkMeetup2015-Experiments2.pdf SparkMeetup2015-Experiments1.pdf

[jira] [Commented] (SPARK-4823) rowSimilarities

2015-07-30 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648340#comment-14648340 ] Debasish Das commented on SPARK-4823: - We did more detailed experiment for July 2015

[jira] [Assigned] (SPARK-9320) Add `summary` as a synonym for `describe`

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9320: --- Assignee: (was: Apache Spark) Add `summary` as a synonym for `describe`

[jira] [Assigned] (SPARK-9318) Add `merge` as synonym for join

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9318: --- Assignee: Apache Spark Add `merge` as synonym for join ---

[jira] [Commented] (SPARK-9320) Add `summary` as a synonym for `describe`

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648388#comment-14648388 ] Apache Spark commented on SPARK-9320: - User 'falaki' has created a pull request for

[jira] [Commented] (SPARK-9318) Add `merge` as synonym for join

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648387#comment-14648387 ] Apache Spark commented on SPARK-9318: - User 'falaki' has created a pull request for

[jira] [Assigned] (SPARK-9320) Add `summary` as a synonym for `describe`

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9320: --- Assignee: Apache Spark Add `summary` as a synonym for `describe`

[jira] [Assigned] (SPARK-9318) Add `merge` as synonym for join

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9318: --- Assignee: (was: Apache Spark) Add `merge` as synonym for join

[jira] [Assigned] (SPARK-9489) Remove compatibleWith, meetsRequirements, and needsAnySort checks from Exchange

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9489: --- Assignee: Apache Spark (was: Josh Rosen) Remove compatibleWith, meetsRequirements, and

[jira] [Commented] (SPARK-9489) Remove compatibleWith, meetsRequirements, and needsAnySort checks from Exchange

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648405#comment-14648405 ] Apache Spark commented on SPARK-9489: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-9489) Remove compatibleWith, meetsRequirements, and needsAnySort checks from Exchange

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9489: --- Assignee: Josh Rosen (was: Apache Spark) Remove compatibleWith, meetsRequirements, and

[jira] [Resolved] (SPARK-9479) ReceiverTrackerSuite fails for maven build

2015-07-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9479. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.0

  1   2   3   4   >