[jira] [Created] (SPARK-6286) Handle TASK_ERROR in TaskState

2015-03-11 Thread Iulian Dragos (JIRA)
Iulian Dragos created SPARK-6286: Summary: Handle TASK_ERROR in TaskState Key: SPARK-6286 URL: https://issues.apache.org/jira/browse/SPARK-6286 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5692) Model import/export for Word2Vec

2015-03-11 Thread ANUPAM MEDIRATTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357055#comment-14357055 ] ANUPAM MEDIRATTA commented on SPARK-5692: - Manoj Kumar, Not yet but plan to work

[jira] [Commented] (SPARK-5692) Model import/export for Word2Vec

2015-03-11 Thread ANUPAM MEDIRATTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357053#comment-14357053 ] ANUPAM MEDIRATTA commented on SPARK-5692: - Manoj Kumar, Not yet but plan to work

[jira] [Issue Comment Deleted] (SPARK-5692) Model import/export for Word2Vec

2015-03-11 Thread ANUPAM MEDIRATTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ANUPAM MEDIRATTA updated SPARK-5692: Comment: was deleted (was: Manoj Kumar, Not yet but plan to work on it over the weekend.

[jira] [Commented] (SPARK-5692) Model import/export for Word2Vec

2015-03-11 Thread ANUPAM MEDIRATTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357057#comment-14357057 ] ANUPAM MEDIRATTA commented on SPARK-5692: - Manoj Kumar, Not yet but plan to work

[jira] [Created] (SPARK-6283) Add a CassandraInputDStream to stream from a C* table

2015-03-11 Thread Helena Edelson (JIRA)
Helena Edelson created SPARK-6283: - Summary: Add a CassandraInputDStream to stream from a C* table Key: SPARK-6283 URL: https://issues.apache.org/jira/browse/SPARK-6283 Project: Spark Issue

[jira] [Updated] (SPARK-6286) Handle TASK_ERROR in TaskState

2015-03-11 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iulian Dragos updated SPARK-6286: - Labels: mesos (was: ) Handle TASK_ERROR in TaskState --

[jira] [Commented] (SPARK-6189) Pandas to DataFrame conversion should check field names for periods

2015-03-11 Thread mgdadv (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357162#comment-14357162 ] mgdadv commented on SPARK-6189: --- The current behavior really is quite confusing. In

[jira] [Commented] (SPARK-6277) Allow Hadoop configurations and env variables to be referenced in spark-defaults.conf

2015-03-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357072#comment-14357072 ] Marcelo Vanzin commented on SPARK-6277: --- Sometimes I do miss being able to reference

[jira] [Comment Edited] (SPARK-6277) Allow Hadoop configurations and env variables to be referenced in spark-defaults.conf

2015-03-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357072#comment-14357072 ] Marcelo Vanzin edited comment on SPARK-6277 at 3/11/15 3:49 PM:

[jira] [Commented] (SPARK-6189) Pandas to DataFrame conversion should check field names for periods

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357086#comment-14357086 ] Apache Spark commented on SPARK-6189: - User 'mgdadv' has created a pull request for

[jira] [Issue Comment Deleted] (SPARK-5692) Model import/export for Word2Vec

2015-03-11 Thread ANUPAM MEDIRATTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ANUPAM MEDIRATTA updated SPARK-5692: Comment: was deleted (was: Manoj Kumar, Not yet but plan to work on it over the weekend.

[jira] [Issue Comment Deleted] (SPARK-5692) Model import/export for Word2Vec

2015-03-11 Thread ANUPAM MEDIRATTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ANUPAM MEDIRATTA updated SPARK-5692: Comment: was deleted (was: Manoj Kumar, Not yet but plan to work on it over the weekend.

[jira] [Issue Comment Deleted] (SPARK-5692) Model import/export for Word2Vec

2015-03-11 Thread ANUPAM MEDIRATTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ANUPAM MEDIRATTA updated SPARK-5692: Comment: was deleted (was: Manoj Kumar, Not yet but plan to work on it over the weekend.

[jira] [Created] (SPARK-6284) Support framework authentication and role in Mesos framework

2015-03-11 Thread Timothy Chen (JIRA)
Timothy Chen created SPARK-6284: --- Summary: Support framework authentication and role in Mesos framework Key: SPARK-6284 URL: https://issues.apache.org/jira/browse/SPARK-6284 Project: Spark

[jira] [Commented] (SPARK-5692) Model import/export for Word2Vec

2015-03-11 Thread ANUPAM MEDIRATTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357054#comment-14357054 ] ANUPAM MEDIRATTA commented on SPARK-5692: - Manoj Kumar, Not yet but plan to work

[jira] [Commented] (SPARK-5692) Model import/export for Word2Vec

2015-03-11 Thread ANUPAM MEDIRATTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357056#comment-14357056 ] ANUPAM MEDIRATTA commented on SPARK-5692: - Manoj Kumar, Not yet but plan to work

[jira] [Commented] (SPARK-5692) Model import/export for Word2Vec

2015-03-11 Thread ANUPAM MEDIRATTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357058#comment-14357058 ] ANUPAM MEDIRATTA commented on SPARK-5692: - Manoj Kumar, Not yet but plan to work

[jira] [Created] (SPARK-6285) Duplicated code leads to errors

2015-03-11 Thread Iulian Dragos (JIRA)
Iulian Dragos created SPARK-6285: Summary: Duplicated code leads to errors Key: SPARK-6285 URL: https://issues.apache.org/jira/browse/SPARK-6285 Project: Spark Issue Type: Bug

[jira] [Issue Comment Deleted] (SPARK-5692) Model import/export for Word2Vec

2015-03-11 Thread ANUPAM MEDIRATTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ANUPAM MEDIRATTA updated SPARK-5692: Comment: was deleted (was: Manoj Kumar, Not yet but plan to work on it over the weekend.

[jira] [Commented] (SPARK-6284) Support framework authentication and role in Mesos framework

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357181#comment-14357181 ] Apache Spark commented on SPARK-6284: - User 'tnachen' has created a pull request for

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2015-03-11 Thread Jason Hubbard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357545#comment-14357545 ] Jason Hubbard commented on SPARK-2243: -- It also mentions changing the broadcast

[jira] [Created] (SPARK-6289) PySpark doesn't maintain SQL Types

2015-03-11 Thread Michael Nazario (JIRA)
Michael Nazario created SPARK-6289: -- Summary: PySpark doesn't maintain SQL Types Key: SPARK-6289 URL: https://issues.apache.org/jira/browse/SPARK-6289 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-6289) PySpark doesn't maintain SQL date Types

2015-03-11 Thread Michael Nazario (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Nazario updated SPARK-6289: --- Summary: PySpark doesn't maintain SQL date Types (was: PySpark doesn't maintain SQL Types)

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes

2015-03-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357627#comment-14357627 ] Josh Rosen commented on SPARK-6270: --- In the long run, my preference is to remove

[jira] [Comment Edited] (SPARK-2429) Hierarchical Implementation of KMeans

2015-03-11 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357497#comment-14357497 ] Jeremy Freeman edited comment on SPARK-2429 at 3/11/15 8:10 PM:

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

2015-03-11 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357497#comment-14357497 ] Jeremy Freeman commented on SPARK-2429: --- Thanks for the update and contribution

[jira] [Commented] (SPARK-5987) Model import/export for GaussianMixtureModel

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357502#comment-14357502 ] Apache Spark commented on SPARK-5987: - User 'MechCoder' has created a pull request for

[jira] [Commented] (SPARK-5050) Add unit test for sqdist

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357616#comment-14357616 ] Apache Spark commented on SPARK-5050: - User 'mengxr' has created a pull request for

[jira] [Commented] (SPARK-4797) Replace breezeSquaredDistance

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357617#comment-14357617 ] Apache Spark commented on SPARK-4797: - User 'mengxr' has created a pull request for

[jira] [Comment Edited] (SPARK-6206) spark-ec2 script reporting SSL error?

2015-03-11 Thread Joe O (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357260#comment-14357260 ] Joe O edited comment on SPARK-6206 at 3/11/15 5:38 PM: --- Ok close

[jira] [Resolved] (SPARK-6274) Add streaming examples showing integration with DataFrames and SQL

2015-03-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-6274. -- Resolution: Fixed Fix Version/s: 1.3.1 1.4.0 Add streaming examples

[jira] [Updated] (SPARK-6227) PCA and SVD for PySpark

2015-03-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6227: - Priority: Major (was: Minor) PCA and SVD for PySpark ---

[jira] [Commented] (SPARK-6227) PCA and SVD for PySpark

2015-03-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357354#comment-14357354 ] Joseph K. Bradley commented on SPARK-6227: -- I was about to---but then I realized

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

2015-03-11 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357367#comment-14357367 ] RJ Nowling commented on SPARK-2429: --- Hi [~yuu.ishik...@gmail.com] I think the new

[jira] [Commented] (SPARK-6282) Strange Python import error when using random() in a lambda function

2015-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357382#comment-14357382 ] Sean Owen commented on SPARK-6282: --

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2015-03-11 Thread Peter Rudenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357591#comment-14357591 ] Peter Rudenko commented on SPARK-2243: -- Unfortunatelly it doesn't work in

[jira] [Commented] (SPARK-6206) spark-ec2 script reporting SSL error?

2015-03-11 Thread Joe O (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357260#comment-14357260 ] Joe O commented on SPARK-6206: -- Ok close this one out. The problem was local configuration.

[jira] [Commented] (SPARK-5186) Vector.equals and Vector.hashCode are very inefficient and fail on SparseVectors with large size

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357272#comment-14357272 ] Apache Spark commented on SPARK-5186: - User 'mengxr' has created a pull request for

[jira] [Created] (SPARK-6288) Pyrolite calls hashCode to cache previously serialized objects

2015-03-11 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-6288: Summary: Pyrolite calls hashCode to cache previously serialized objects Key: SPARK-6288 URL: https://issues.apache.org/jira/browse/SPARK-6288 Project: Spark

[jira] [Comment Edited] (SPARK-2429) Hierarchical Implementation of KMeans

2015-03-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357380#comment-14357380 ] Joseph K. Bradley edited comment on SPARK-2429 at 3/11/15 6:47 PM:

[jira] [Commented] (SPARK-6286) Handle TASK_ERROR in TaskState

2015-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357385#comment-14357385 ] Sean Owen commented on SPARK-6286: -- Probably OK for 1.4.x. Do you know what to do with

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

2015-03-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357407#comment-14357407 ] Joseph K. Bradley commented on SPARK-2429: -- I'll try to prioritize it, though the

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2015-03-11 Thread Craig Lukasik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357463#comment-14357463 ] Craig Lukasik commented on SPARK-2243: -- The Spark Job Server uses multiple

[jira] [Commented] (SPARK-6287) Add support for dynamic allocation in the Mesos coarse-grained scheduler

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357262#comment-14357262 ] Apache Spark commented on SPARK-6287: - User 'dragos' has created a pull request for

[jira] [Commented] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

2015-03-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357335#comment-14357335 ] Joseph K. Bradley commented on SPARK-5992: -- I'm not sure what the most important

[jira] [Commented] (SPARK-6285) Duplicated code leads to errors

2015-03-11 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357297#comment-14357297 ] Iulian Dragos commented on SPARK-6285: -- According to the git commit message that

[jira] [Commented] (SPARK-6285) Duplicated code leads to errors

2015-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357388#comment-14357388 ] Sean Owen commented on SPARK-6285: -- [~lian cheng] do you think we can now remove these

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

2015-03-11 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357389#comment-14357389 ] RJ Nowling commented on SPARK-2429: --- [~josephkb] I think it would be great to get the

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

2015-03-11 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357410#comment-14357410 ] RJ Nowling commented on SPARK-2429: --- I'm familiar with the community interest but I'm

[jira] [Reopened] (SPARK-5186) Vector.equals and Vector.hashCode are very inefficient and fail on SparseVectors with large size

2015-03-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reopened SPARK-5186: -- Re-opened this issue for branch-1.2. Vector.equals and Vector.hashCode are very inefficient and

[jira] [Commented] (SPARK-6282) Strange Python import error when using random() in a lambda function

2015-03-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357364#comment-14357364 ] Joseph K. Bradley commented on SPARK-6282: -- Do you know where _winreg appears in

[jira] [Commented] (SPARK-6286) Handle TASK_ERROR in TaskState

2015-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357240#comment-14357240 ] Sean Owen commented on SPARK-6286: -- I remember looking at this -- it's a Mesos enum

[jira] [Commented] (SPARK-6189) Pandas to DataFrame conversion should check field names for periods

2015-03-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357248#comment-14357248 ] Joseph K. Bradley commented on SPARK-6189: -- Maybe it's actually OK to allow

[jira] [Closed] (SPARK-6206) spark-ec2 script reporting SSL error?

2015-03-11 Thread Joe O (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe O closed SPARK-6206. Resolution: Invalid spark-ec2 script reporting SSL error? -

[jira] [Created] (SPARK-6287) Add support for dynamic allocation in the Mesos coarse-grained scheduler

2015-03-11 Thread Iulian Dragos (JIRA)
Iulian Dragos created SPARK-6287: Summary: Add support for dynamic allocation in the Mesos coarse-grained scheduler Key: SPARK-6287 URL: https://issues.apache.org/jira/browse/SPARK-6287 Project:

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

2015-03-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357380#comment-14357380 ] Joseph K. Bradley commented on SPARK-2429: -- But as far as the old vs. new

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

2015-03-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357377#comment-14357377 ] Joseph K. Bradley commented on SPARK-2429: -- I don't think we should discourage

[jira] [Created] (SPARK-6290) spark.ml.param.Params.checkInputColumn bug upon error

2015-03-11 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-6290: Summary: spark.ml.param.Params.checkInputColumn bug upon error Key: SPARK-6290 URL: https://issues.apache.org/jira/browse/SPARK-6290 Project: Spark

[jira] [Commented] (SPARK-6297) EventLog permissions are always set to 770 which causes problems

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357905#comment-14357905 ] Apache Spark commented on SPARK-6297: - User 'lustefaniak' has created a pull request

[jira] [Commented] (SPARK-6229) Support encryption in network/common module

2015-03-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357838#comment-14357838 ] Marcelo Vanzin commented on SPARK-6229: --- /cc [~rxin] [~adav] Hey Reynold, Aaron, I

[jira] [Commented] (SPARK-6294) PySpark task may hang while call take() on in Java/Scala

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357872#comment-14357872 ] Apache Spark commented on SPARK-6294: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-6296) Add equals operator to Column (v1.3)

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357894#comment-14357894 ] Apache Spark commented on SPARK-6296: - User 'vlyubin' has created a pull request for

[jira] [Comment Edited] (SPARK-6189) Pandas to DataFrame conversion should check field names for periods

2015-03-11 Thread mgdadv (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357610#comment-14357610 ] mgdadv edited comment on SPARK-6189 at 3/11/15 10:20 PM: - While

[jira] [Commented] (SPARK-6189) Pandas to DataFrame conversion should check field names for periods

2015-03-11 Thread mgdadv (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357713#comment-14357713 ] mgdadv commented on SPARK-6189: --- To expand on the example, this works:

[jira] [Updated] (SPARK-6293) SQLContext.implicits should provide automatic conversion for RDD[Row]

2015-03-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6293: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-6116 SQLContext.implicits

[jira] [Created] (SPARK-6295) spark.ml.Evaluator should have evaluate method not taking ParamMap

2015-03-11 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-6295: Summary: spark.ml.Evaluator should have evaluate method not taking ParamMap Key: SPARK-6295 URL: https://issues.apache.org/jira/browse/SPARK-6295 Project:

[jira] [Created] (SPARK-6296) Add equals operator to Column (v1.3)

2015-03-11 Thread Volodymyr Lyubinets (JIRA)
Volodymyr Lyubinets created SPARK-6296: -- Summary: Add equals operator to Column (v1.3) Key: SPARK-6296 URL: https://issues.apache.org/jira/browse/SPARK-6296 Project: Spark Issue Type:

[jira] [Updated] (SPARK-6294) PySpark task may hang while call take() on in Java/Scala

2015-03-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6294: - Target Version/s: 1.2.2, 1.4.0, 1.3.1 (was: 1.2.2, 1.3.1) PySpark task may hang while call

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

2015-03-11 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356399#comment-14356399 ] Yu Ishikawa commented on SPARK-2429: [~rnowling] I apologize for the delay in

[jira] [Commented] (SPARK-6227) PCA and SVD for PySpark

2015-03-11 Thread Meethu Mathew (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356428#comment-14356428 ] Meethu Mathew commented on SPARK-6227: -- Interested to work on this ticket.Could

[jira] [Commented] (SPARK-6278) Mention the change of step size in the migration guide

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356447#comment-14356447 ] Apache Spark commented on SPARK-6278: - User 'mengxr' has created a pull request for

[jira] [Commented] (SPARK-6277) Allow Hadoop configurations and env variables to be referenced in spark-defaults.conf

2015-03-11 Thread Jianshi Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356478#comment-14356478 ] Jianshi Huang commented on SPARK-6277: -- I see. Not relating to hadoop config is fine,

[jira] [Created] (SPARK-6281) Support incremental updates for Graph

2015-03-11 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-6281: --- Summary: Support incremental updates for Graph Key: SPARK-6281 URL: https://issues.apache.org/jira/browse/SPARK-6281 Project: Spark Issue Type: New

[jira] [Created] (SPARK-6276) beeline client class cast exception on partitioned table Spark SQL

2015-03-11 Thread Sunil (JIRA)
Sunil created SPARK-6276: Summary: beeline client class cast exception on partitioned table Spark SQL Key: SPARK-6276 URL: https://issues.apache.org/jira/browse/SPARK-6276 Project: Spark Issue

[jira] [Created] (SPARK-6278) Mention the change of step size in the migration guide

2015-03-11 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-6278: Summary: Mention the change of step size in the migration guide Key: SPARK-6278 URL: https://issues.apache.org/jira/browse/SPARK-6278 Project: Spark Issue

[jira] [Commented] (SPARK-6022) GraphX `diff` test incorrectly operating on values (not VertexId's)

2015-03-11 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356452#comment-14356452 ] Takeshi Yamamuro commented on SPARK-6022: - Yeah, ISTM it'd be better to add set

[jira] [Commented] (SPARK-6244) Implement VectorSpace to easy create a complicated feature vector

2015-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356464#comment-14356464 ] Sean Owen commented on SPARK-6244: -- You can reuse this JIRA but you would have to modify

[jira] [Created] (SPARK-6280) Remove Akka systemName from Spark

2015-03-11 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-6280: --- Summary: Remove Akka systemName from Spark Key: SPARK-6280 URL: https://issues.apache.org/jira/browse/SPARK-6280 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-6277) Allow Hadoop configurations and env variables to be referenced in spark-defaults.conf

2015-03-11 Thread Jianshi Huang (JIRA)
Jianshi Huang created SPARK-6277: Summary: Allow Hadoop configurations and env variables to be referenced in spark-defaults.conf Key: SPARK-6277 URL: https://issues.apache.org/jira/browse/SPARK-6277

[jira] [Resolved] (SPARK-6185) Deltele repeated TOKEN. TOK_CREATEFUNCTION has existed at Line 84;

2015-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6185. -- Resolution: Duplicate Rather than make a new JIRA, you could have expanded the scope of this one by

[jira] [Created] (SPARK-6279) Miss expressions flag s at logging string

2015-03-11 Thread zzc (JIRA)
zzc created SPARK-6279: -- Summary: Miss expressions flag s at logging string Key: SPARK-6279 URL: https://issues.apache.org/jira/browse/SPARK-6279 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-6279) Miss expressions flag s at logging string

2015-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356472#comment-14356472 ] Sean Owen commented on SPARK-6279: -- (Don't bother making a JIRA for trivial issues, where

[jira] [Commented] (SPARK-4820) Spark build encounters File name too long on some encrypted filesystems

2015-03-11 Thread Theodore Vasiloudis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356688#comment-14356688 ] Theodore Vasiloudis commented on SPARK-4820: Can confirm for 1.2.1 in encfs as

[jira] [Commented] (SPARK-5499) iterative computing with 1000 iterations causes stage failure

2015-03-11 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356699#comment-14356699 ] Tien-Dung LE commented on SPARK-5499: - Many thanks for your reply. I did the same as

[jira] [Commented] (SPARK-2344) Add Fuzzy C-Means algorithm to MLlib

2015-03-11 Thread Beniamino (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356741#comment-14356741 ] Beniamino commented on SPARK-2344: -- Hi, yes the computation of the next centers are made

[jira] [Closed] (SPARK-5499) iterative computing with 1000 iterations causes stage failure

2015-03-11 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE closed SPARK-5499. --- checkpoint mechanism can solve the issue. iterative computing with 1000 iterations causes stage failure

[jira] [Commented] (SPARK-6067) Spark sql hive dynamic partitions job will fail if task fails

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356745#comment-14356745 ] Apache Spark commented on SPARK-6067: - User 'baishuo' has created a pull request for

[jira] [Commented] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

2015-03-11 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356507#comment-14356507 ] Yu Ishikawa commented on SPARK-5992: What kind of LSH algorithms should we support at

[jira] [Commented] (SPARK-6277) Allow Hadoop configurations and env variables to be referenced in spark-defaults.conf

2015-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356450#comment-14356450 ] Sean Owen commented on SPARK-6277: -- Although it sounds nice, in practice this raises a

[jira] [Commented] (SPARK-5814) Remove JBLAS from runtime dependencies

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356451#comment-14356451 ] Apache Spark commented on SPARK-5814: - User 'mengxr' has created a pull request for

[jira] [Resolved] (SPARK-4924) Factor out code to launch Spark applications into a separate library

2015-03-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4924. Resolution: Fixed Fix Version/s: 1.4.0 Glad to finally have this in. Thanks for all

[jira] [Resolved] (SPARK-3438) Support for accessing secured HDFS in Standalone Mode

2015-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3438. -- Resolution: Duplicate Support for accessing secured HDFS in Standalone Mode

[jira] [Updated] (SPARK-6279) Miss expressions flag s at logging string

2015-03-11 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zzc updated SPARK-6279: --- Description: In KafkaRDD.scala, Miss expressions flag s at logging string In logging file, it print `Beginning

[jira] [Comment Edited] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-03-11 Thread Masayoshi TSUZUKI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348309#comment-14348309 ] Masayoshi TSUZUKI edited comment on SPARK-5389 at 3/11/15 8:18 AM:

[jira] [Commented] (SPARK-6279) Miss expressions flag s at logging string

2015-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356473#comment-14356473 ] Apache Spark commented on SPARK-6279: - User 'zzcclp' has created a pull request for

[jira] [Resolved] (SPARK-6225) Resolve most build warnings, 1.3.0 edition

2015-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6225. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4950

[jira] [Resolved] (SPARK-6228) Provide SASL support in network/common module

2015-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6228. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4953

[jira] [Updated] (SPARK-6228) Provide SASL support in network/common module

2015-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6228: - Priority: Minor (was: Major) Assignee: Marcelo Vanzin Provide SASL support in network/common module

[jira] [Resolved] (SPARK-4423) Improve foreach() documentation to avoid confusion between local- and cluster-mode behavior

2015-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4423. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4696

  1   2   >