[jira] [Commented] (SPARK-9489) Remove compatibleWith, meetsRequirements, and needsAnySort checks from Exchange

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648405#comment-14648405 ] Apache Spark commented on SPARK-9489: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-9489) Remove compatibleWith, meetsRequirements, and needsAnySort checks from Exchange

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9489: --- Assignee: Apache Spark (was: Josh Rosen) > Remove compatibleWith, meetsRequirements, and nee

[jira] [Created] (SPARK-9489) Remove compatibleWith, meetsRequirements, and needsAnySort checks from Exchange

2015-07-30 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9489: - Summary: Remove compatibleWith, meetsRequirements, and needsAnySort checks from Exchange Key: SPARK-9489 URL: https://issues.apache.org/jira/browse/SPARK-9489 Project: Spar

[jira] [Commented] (SPARK-9320) Add `summary` as a synonym for `describe`

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648388#comment-14648388 ] Apache Spark commented on SPARK-9320: - User 'falaki' has created a pull request for th

[jira] [Assigned] (SPARK-9320) Add `summary` as a synonym for `describe`

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9320: --- Assignee: (was: Apache Spark) > Add `summary` as a synonym for `describe` > -

[jira] [Assigned] (SPARK-9318) Add `merge` as synonym for join

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9318: --- Assignee: Apache Spark > Add `merge` as synonym for join > --- >

[jira] [Commented] (SPARK-9318) Add `merge` as synonym for join

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648387#comment-14648387 ] Apache Spark commented on SPARK-9318: - User 'falaki' has created a pull request for th

[jira] [Assigned] (SPARK-9320) Add `summary` as a synonym for `describe`

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9320: --- Assignee: Apache Spark > Add `summary` as a synonym for `describe` >

[jira] [Assigned] (SPARK-9318) Add `merge` as synonym for join

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9318: --- Assignee: (was: Apache Spark) > Add `merge` as synonym for join > ---

[jira] [Updated] (SPARK-6486) Add BlockMatrix in PySpark

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6486: - Shepherd: Xiangrui Meng > Add BlockMatrix in PySpark > -- > >

[jira] [Updated] (SPARK-6486) Add BlockMatrix in PySpark

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6486: - Assignee: Mike Dusenberry > Add BlockMatrix in PySpark > -- > >

[jira] [Created] (SPARK-9488) pyspark.sql.types.Row very slow when used named arguments

2015-07-30 Thread Alexis Benoist (JIRA)
Alexis Benoist created SPARK-9488: - Summary: pyspark.sql.types.Row very slow when used named arguments Key: SPARK-9488 URL: https://issues.apache.org/jira/browse/SPARK-9488 Project: Spark Iss

[jira] [Updated] (SPARK-9488) pyspark.sql.types.Row very slow when using named arguments

2015-07-30 Thread Alexis Benoist (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexis Benoist updated SPARK-9488: -- Summary: pyspark.sql.types.Row very slow when using named arguments (was: pyspark.sql.types.Row

[jira] [Commented] (SPARK-8197) date/time function: trunc

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648351#comment-14648351 ] Apache Spark commented on SPARK-8197: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-8176) date/time function: to_date

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648350#comment-14648350 ] Apache Spark commented on SPARK-8176: - User 'davies' has created a pull request for th

[jira] [Updated] (SPARK-6684) Add checkpointing to GradientBoostedTrees

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6684: - Shepherd: Xiangrui Meng > Add checkpointing to GradientBoostedTrees >

[jira] [Updated] (SPARK-9408) Refactor mllib/linalg.py to mllib/linalg

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9408: - Shepherd: Davies Liu (was: Xiangrui Meng) > Refactor mllib/linalg.py to mllib/linalg > --

[jira] [Updated] (SPARK-4823) rowSimilarities

2015-07-30 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Debasish Das updated SPARK-4823: Attachment: SparkMeetup2015-Experiments2.pdf SparkMeetup2015-Experiments1.pdf > rowS

[jira] [Commented] (SPARK-4823) rowSimilarities

2015-07-30 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648340#comment-14648340 ] Debasish Das commented on SPARK-4823: - We did more detailed experiment for July 2015 S

[jira] [Updated] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9487: - Target Version/s: 1.5.0 > Use the same num. worker threads in Scala/Python unit tests > --

[jira] [Created] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

2015-07-30 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9487: Summary: Use the same num. worker threads in Scala/Python unit tests Key: SPARK-9487 URL: https://issues.apache.org/jira/browse/SPARK-9487 Project: Spark Is

[jira] [Assigned] (SPARK-6684) Add checkpointing to GradientBoostedTrees

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6684: --- Assignee: Joseph K. Bradley (was: Apache Spark) > Add checkpointing to GradientBoostedTrees

[jira] [Commented] (SPARK-6684) Add checkpointing to GradientBoostedTrees

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648310#comment-14648310 ] Apache Spark commented on SPARK-6684: - User 'jkbradley' has created a pull request for

[jira] [Assigned] (SPARK-6684) Add checkpointing to GradientBoostedTrees

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6684: --- Assignee: Apache Spark (was: Joseph K. Bradley) > Add checkpointing to GradientBoostedTrees

[jira] [Commented] (SPARK-9469) TungstenSort should not do safe -> unsafe conversion itself

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648309#comment-14648309 ] Apache Spark commented on SPARK-9469: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-9454) LDASuite should use vector comparisons

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9454: - Assignee: Feynman Liang > LDASuite should use vector comparisons > ---

[jira] [Updated] (SPARK-9454) LDASuite should use vector comparisons

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9454: - Shepherd: Joseph K. Bradley > LDASuite should use vector comparisons > ---

[jira] [Resolved] (SPARK-9454) LDASuite should use vector comparisons

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9454. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7775 [https

[jira] [Commented] (SPARK-9458) Avoid object allocation in prefix generation

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648308#comment-14648308 ] Apache Spark commented on SPARK-9458: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9486) Add aliasing to data sources to allow external packages to register themselves with Spark

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9486: --- Assignee: Apache Spark > Add aliasing to data sources to allow external packages to register

[jira] [Assigned] (SPARK-9486) Add aliasing to data sources to allow external packages to register themselves with Spark

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9486: --- Assignee: (was: Apache Spark) > Add aliasing to data sources to allow external packages t

[jira] [Commented] (SPARK-9486) Add aliasing to data sources to allow external packages to register themselves with Spark

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648287#comment-14648287 ] Apache Spark commented on SPARK-9486: - User 'JDrit' has created a pull request for thi

[jira] [Comment Edited] (SPARK-967) start-slaves.sh uses local path from master on remote slave nodes

2015-07-30 Thread David Chin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648234#comment-14648234 ] David Chin edited comment on SPARK-967 at 7/30/15 8:34 PM: --- I won

[jira] [Updated] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9481: - Shepherd: Joseph K. Bradley Assignee: Feynman Liang > LocalLDAModel logLikelihood > --

[jira] [Updated] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9485: - Shepherd: (was: MEN CHAMROEUN) Target Version/s: (was: 1.4.1) Environment: (wa

[jira] [Resolved] (SPARK-8186) date/time function: date_add

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8186. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7754 [https://github.com/

[jira] [Resolved] (SPARK-9133) Add and Subtract should support date/timestamp and interval type

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9133. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7754 [https://github.com/

[jira] [Resolved] (SPARK-8194) date/time function: add_months

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8194. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7754 [https://github.com/

[jira] [Resolved] (SPARK-9290) DateExpressionsSuite is slow to run

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9290. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7754 [https://github.com/

[jira] [Resolved] (SPARK-8187) date/time function: date_sub

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8187. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7754 [https://github.com/

[jira] [Resolved] (SPARK-8198) date/time function: months_between

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8198. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7754 [https://github.com/

[jira] [Updated] (SPARK-5567) Add prediction methods to LDA

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5567: - Assignee: Feynman Liang > Add prediction methods to LDA > - >

[jira] [Comment Edited] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Philip Adetiloye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648233#comment-14648233 ] Philip Adetiloye edited comment on SPARK-9485 at 7/30/15 8:17 PM: --

[jira] [Resolved] (SPARK-5567) Add prediction methods to LDA

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-5567. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7760 [https

[jira] [Comment Edited] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Philip Adetiloye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648233#comment-14648233 ] Philip Adetiloye edited comment on SPARK-9485 at 7/30/15 8:16 PM: --

[jira] [Comment Edited] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Philip Adetiloye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648233#comment-14648233 ] Philip Adetiloye edited comment on SPARK-9485 at 7/30/15 8:16 PM: --

[jira] [Commented] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Philip Adetiloye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648233#comment-14648233 ] Philip Adetiloye commented on SPARK-9485: - [~srowen] Thanks for the quick reply. I

[jira] [Commented] (SPARK-967) start-slaves.sh uses local path from master on remote slave nodes

2015-07-30 Thread David Chin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648234#comment-14648234 ] David Chin commented on SPARK-967: -- I won't create a pull request unless asked to, but I h

[jira] [Created] (SPARK-9486) Add aliasing to data sources to allow external packages to register themselves with Spark

2015-07-30 Thread Joseph Batchik (JIRA)
Joseph Batchik created SPARK-9486: - Summary: Add aliasing to data sources to allow external packages to register themselves with Spark Key: SPARK-9486 URL: https://issues.apache.org/jira/browse/SPARK-9486

[jira] [Updated] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Philip Adetiloye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Adetiloye updated SPARK-9485: Shepherd: MEN CHAMROEUN > Failed to connect to yarn / spark-submit --master yarn-client > --

[jira] [Commented] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648200#comment-14648200 ] Sean Owen commented on SPARK-9485: -- I don't think this is sufficient to be a JIRA bug rep

[jira] [Updated] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

2015-07-30 Thread Philip Adetiloye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Adetiloye updated SPARK-9485: Description: Spark-submit throws an exception when connecting to yarn but it works when us

[jira] [Created] (SPARK-9485) Failed to connect to yarn

2015-07-30 Thread Philip Adetiloye (JIRA)
Philip Adetiloye created SPARK-9485: --- Summary: Failed to connect to yarn Key: SPARK-9485 URL: https://issues.apache.org/jira/browse/SPARK-9485 Project: Spark Issue Type: Bug Compo

[jira] [Commented] (SPARK-6227) PCA and SVD for PySpark

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648192#comment-14648192 ] Joseph K. Bradley commented on SPARK-6227: -- That's great you're interested. Plea

[jira] [Commented] (SPARK-9478) Add class weights to Random Forest

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648184#comment-14648184 ] Joseph K. Bradley commented on SPARK-9478: -- This sounds valuable. Handling it by

[jira] [Commented] (SPARK-7583) User guide update for RegexTokenizer

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648182#comment-14648182 ] Joseph K. Bradley commented on SPARK-7583: -- Yes, please! This can go in after th

[jira] [Commented] (SPARK-5692) Model import/export for Word2Vec

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648180#comment-14648180 ] Joseph K. Bradley commented on SPARK-5692: -- This was not, but thanks for the remi

[jira] [Created] (SPARK-9484) Word2Vec import/export for original binary format

2015-07-30 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9484: Summary: Word2Vec import/export for original binary format Key: SPARK-9484 URL: https://issues.apache.org/jira/browse/SPARK-9484 Project: Spark Issue

[jira] [Updated] (SPARK-9483) UTF8String.getPrefix only works in little-endian order

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9483: --- Description: There are 2 bit masking and a reverse bytes that should probably be handled differently o

[jira] [Updated] (SPARK-6805) MLlib + SparkR integration for 1.5

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6805: - Description: --SparkR was merged. So let's have this umbrella JIRA for the ML pipeline API in Spa

[jira] [Updated] (SPARK-6805) MLlib + SparkR integration for 1.5

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6805: - Description: ~~SparkR was merged. So let's have this umbrella JIRA for the ML pipeline API in Spa

[jira] [Updated] (SPARK-6805) MLlib + SparkR integration for 1.5

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6805: - Assignee: Eric Liang > MLlib + SparkR integration for 1.5 > -- > >

[jira] [Updated] (SPARK-6805) MLlib + SparkR integration for 1.5

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6805: - Summary: MLlib + SparkR integration for 1.5 (was: ML Pipeline API in SparkR) > MLlib + SparkR in

[jira] [Updated] (SPARK-9463) Expose model coefficients with names in SparkR RFormula

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9463: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-6805 > Expose model coefficients wi

[jira] [Created] (SPARK-9483) UTF8String.getPrefix only works in little-endian order

2015-07-30 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9483: -- Summary: UTF8String.getPrefix only works in little-endian order Key: SPARK-9483 URL: https://issues.apache.org/jira/browse/SPARK-9483 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9463) Expose model coefficients with names in SparkR RFormula

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9463: - Assignee: Eric Liang > Expose model coefficients with names in SparkR RFormula > -

[jira] [Created] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-07-30 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9482: Summary: flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin Key: SPARK-9482 URL: https://issues.apache.org/jira/browse/SPARK-9482 Project

[jira] [Updated] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9482: - Labels: flaky-test (was: ) > flaky test: > org.apache.spark.sql.hive.execution.HiveCompatibility

[jira] [Commented] (SPARK-8497) Graph Clique(Complete Connected Sub-graph) Discovery Algorithm

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648126#comment-14648126 ] Xiangrui Meng commented on SPARK-8497: -- Please provide the algorithm you want to impl

[jira] [Commented] (SPARK-4449) specify port range in spark

2015-07-30 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648090#comment-14648090 ] Neelesh Srinivas Salian commented on SPARK-4449: I would like to pick this

[jira] [Resolved] (SPARK-8174) date/time function: unix_timestamp

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8174. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7644 [https://github.com/

[jira] [Resolved] (SPARK-8175) date/time function: from_unixtime

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8175. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7644 [https://github.com/

[jira] [Reopened] (SPARK-9282) Filter on Spark DataFrame with multiple columns

2015-07-30 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal reopened SPARK-9282: On using '&' instead of 'and', the following error occurs: Py4JError Tr

[jira] [Assigned] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9481: --- Assignee: (was: Apache Spark) > LocalLDAModel logLikelihood > ---

[jira] [Assigned] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9481: --- Assignee: Apache Spark > LocalLDAModel logLikelihood > --- > >

[jira] [Commented] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648039#comment-14648039 ] Apache Spark commented on SPARK-9481: - User 'feynmanliang' has created a pull request

[jira] [Commented] (SPARK-9437) SizeEstimator overflows for primitive arrays

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648025#comment-14648025 ] Shivaram Venkataraman commented on SPARK-9437: -- Resolved by https://github.co

[jira] [Resolved] (SPARK-9437) SizeEstimator overflows for primitive arrays

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9437. -- Resolution: Fixed Fix Version/s: 1.5.0 > SizeEstimator overflows for prim

[jira] [Resolved] (SPARK-8850) Turn unsafe mode on by default

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8850. Resolution: Fixed Fix Version/s: 1.5.0 > Turn unsafe mode on by default > ---

[jira] [Resolved] (SPARK-9388) Make log messages in ExecutorRunnable more readable

2015-07-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-9388. --- Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.5.0 > Make log mes

[jira] [Resolved] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-07-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-8297. --- Resolution: Fixed Fix Version/s: 1.5.0 > Scheduler backend is not notified in case node

[jira] [Updated] (SPARK-9361) Refactor new aggregation code to reduce the times of checking compatibility

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9361: Assignee: Liang-Chi Hsieh > Refactor new aggregation code to reduce the times of checking compatibility > --

[jira] [Resolved] (SPARK-9361) Refactor new aggregation code to reduce the times of checking compatibility

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9361. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7677 [https://github.com/apac

[jira] [Updated] (SPARK-9361) Refactor new aggregation code to reduce the times of checking compatibility

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9361: Issue Type: Sub-task (was: Improvement) Parent: SPARK-4366 > Refactor new aggregation code to reduc

[jira] [Updated] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9481: - Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-5572) > LocalLDAModel log

[jira] [Created] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9481: Summary: LocalLDAModel logLikelihood Key: SPARK-9481 URL: https://issues.apache.org/jira/browse/SPARK-9481 Project: Spark Issue Type: Sub-task Comp

[jira] [Commented] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647991#comment-14647991 ] Feynman Liang commented on SPARK-9481: -- Working on this > LocalLDAModel logLikelihoo

[jira] [Updated] (SPARK-9267) Remove highly unnecessary accumulators stringify methods

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9267: - Assignee: François Garillot > Remove highly unnecessary accumulators stringify methods > -

[jira] [Resolved] (SPARK-9267) Remove highly unnecessary accumulators stringify methods

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9267. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7678 [https://github.com/ap

[jira] [Resolved] (SPARK-9390) Create an array abstract class ArrayData and a default implementation backed by Array[Object]

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9390. Resolution: Fixed Fix Version/s: 1.5.0 > Create an array abstract class ArrayData and a defau

[jira] [Resolved] (SPARK-2089) With YARN, preferredNodeLocalityData isn't honored

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2089. -- Resolution: Won't Fix > With YARN, preferredNodeLocalityData isn't honored > --

[jira] [Updated] (SPARK-9248) Closing curly-braces should always be on their own line

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9248: - Assignee: Yu Ishikawa > Closing curly-braces should always be on their own line >

[jira] [Resolved] (SPARK-9248) Closing curly-braces should always be on their own line

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9248. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 779

[jira] [Commented] (SPARK-9077) Improve error message for decision trees when numExamples < maxCategoriesPerFeature

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647937#comment-14647937 ] Apache Spark commented on SPARK-9077: - User 'srowen' has created a pull request for th

[jira] [Assigned] (SPARK-9077) Improve error message for decision trees when numExamples < maxCategoriesPerFeature

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9077: --- Assignee: (was: Apache Spark) > Improve error message for decision trees when numExamples

[jira] [Assigned] (SPARK-9077) Improve error message for decision trees when numExamples < maxCategoriesPerFeature

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9077: --- Assignee: Apache Spark > Improve error message for decision trees when numExamples < > maxCa

[jira] [Commented] (SPARK-9477) Adding IBM Platform Application Service Controller into Spark documentation as a supported Cluster Manager (beside Yarn and Mesos).

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647910#comment-14647910 ] Sean Owen commented on SPARK-9477: -- Seems reasonable to me -- anybody else have an opinio

[jira] [Commented] (SPARK-7583) User guide update for RegexTokenizer

2015-07-30 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647904#comment-14647904 ] yuhao yang commented on SPARK-7583: --- I'd like to take a try if this is still needed. >

[jira] [Commented] (SPARK-6227) PCA and SVD for PySpark

2015-07-30 Thread K S Sreenivasa Raghavan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647893#comment-14647893 ] K S Sreenivasa Raghavan commented on SPARK-6227: Hi, I have worked with py

[jira] [Assigned] (SPARK-9480) Create an map abstract class MapData and a default implementation backed by 2 ArrayData

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9480: --- Assignee: Apache Spark > Create an map abstract class MapData and a default implementation ba

<    1   2   3   >