[jira] [Comment Edited] (SPARK-4964) Exactly-once + WAL-free Kafka Support in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293129#comment-14293129 ] Tathagata Das edited comment on SPARK-4964 at 1/27/15 7:53 AM:

[jira] [Comment Edited] (SPARK-4964) Exactly-once + WAL-free Kafka Support in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293129#comment-14293129 ] Tathagata Das edited comment on SPARK-4964 at 1/27/15 7:47 AM:

[jira] [Updated] (SPARK-4964) Exactly-once + WAL-free Kafka Support in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-4964: - Description: for background, see

[jira] [Updated] (SPARK-5408) MaxPermSize is ignored by ExecutorRunner and DriverRunner

[ https://issues.apache.org/jira/browse/SPARK-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5408: - Summary: MaxPermSize is ignored by ExecutorRunner and DriverRunner (was: MaxPermGen is

[jira] [Updated] (SPARK-5408) MaxPermSize is ignored by ExecutorRunner and DriverRunner

[ https://issues.apache.org/jira/browse/SPARK-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5408: - Description: ExecutorRunner and DriverRunner uses CommandUtils to build the command which

[jira] [Commented] (SPARK-5408) MaxPermSize is ignored by ExecutorRunner and DriverRunner

[ https://issues.apache.org/jira/browse/SPARK-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291585#comment-14291585 ] Jacek Lewandowski commented on SPARK-5408: -- Can anybody take a look?

[jira] [Updated] (SPARK-5406) LocalLAPACK mode in RowMatrix.computeSVD should have much smaller upper bound

[ https://issues.apache.org/jira/browse/SPARK-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-5406: -- Description: In RowMatrix.computeSVD, under LocalLAPACK mode, the code would invoke brzSvd. Yet breeze

[jira] [Updated] (SPARK-5406) LocalLAPACK mode in RowMatrix.computeSVD should have much smaller upper bound

[ https://issues.apache.org/jira/browse/SPARK-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-5406: -- Description: In RowMatrix.computeSVD, under LocalLAPACK mode, the code would invoke brzSvd. Yet breeze

[jira] [Commented] (SPARK-5300) Spark loads file partitions in inconsistent order on native filesystems

[ https://issues.apache.org/jira/browse/SPARK-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291605#comment-14291605 ] Apache Spark commented on SPARK-5300: - User 'ehiggs' has created a pull request for

[jira] [Created] (SPARK-5408) MaxPermGen is ignored by ExecutorRunner and DriverRunner

Jacek Lewandowski created SPARK-5408: Summary: MaxPermGen is ignored by ExecutorRunner and DriverRunner Key: SPARK-5408 URL: https://issues.apache.org/jira/browse/SPARK-5408 Project: Spark

[jira] [Commented] (SPARK-5408) MaxPermSize is ignored by ExecutorRunner and DriverRunner

[ https://issues.apache.org/jira/browse/SPARK-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291583#comment-14291583 ] Apache Spark commented on SPARK-5408: - User 'jacek-lewandowski' has created a pull

[jira] [Updated] (SPARK-5408) MaxPermSize is ignored by ExecutorRunner and DriverRunner

[ https://issues.apache.org/jira/browse/SPARK-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5408: - Fix Version/s: 1.2.1 1.3.0 MaxPermSize is ignored by ExecutorRunner

[jira] [Commented] (SPARK-5408) MaxPermSize is ignored by ExecutorRunner and DriverRunner

[ https://issues.apache.org/jira/browse/SPARK-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291581#comment-14291581 ] Apache Spark commented on SPARK-5408: - User 'jacek-lewandowski' has created a pull

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291710#comment-14291710 ] Kushal Datta commented on SPARK-3789: - Hi Ameet, I have created the first pull

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark application

[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291724#comment-14291724 ] Murat Eken commented on SPARK-2389: --- +1. We're using a Spark cluster as a real-time

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark application

[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291737#comment-14291737 ] Sean Owen commented on SPARK-2389: -- Why can't N front-ends talk to a process built around

[jira] [Commented] (SPARK-5399) tree Losses strings should match loss names

[ https://issues.apache.org/jira/browse/SPARK-5399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291741#comment-14291741 ] Apache Spark commented on SPARK-5399: - User 'Lewuathe' has created a pull request for

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark application

[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291755#comment-14291755 ] Murat Eken commented on SPARK-2389: --- Yes [~sowen], it's about HA for the driver. Our

[jira] [Resolved] (SPARK-4147) Reduce log4j dependency

[ https://issues.apache.org/jira/browse/SPARK-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4147. Resolution: Fixed Reduce log4j dependency --- Key:

[jira] [Updated] (SPARK-4147) Reduce log4j dependency

[ https://issues.apache.org/jira/browse/SPARK-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4147: --- Affects Version/s: 1.2.0 Reduce log4j dependency ---

[jira] [Updated] (SPARK-960) JobCancellationSuite two jobs sharing the same stage is broken

[ https://issues.apache.org/jira/browse/SPARK-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-960: - Assignee: Sean Owen JobCancellationSuite two jobs sharing the same stage is broken

[jira] [Resolved] (SPARK-960) JobCancellationSuite two jobs sharing the same stage is broken

[ https://issues.apache.org/jira/browse/SPARK-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-960. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4180

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292602#comment-14292602 ] Ameet Talwalkar commented on SPARK-3789: Unfortunately not -- I plan to use a

[jira] [Commented] (SPARK-5395) Large number of Python workers causing resource depletion

[ https://issues.apache.org/jira/browse/SPARK-5395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292630#comment-14292630 ] Sven Krasser commented on SPARK-5395: - [~mkman84], do you also see this for both

[jira] [Created] (SPARK-5412) Cannot bind Master to a specific hostname as per the documentation

Alexis Seigneurin created SPARK-5412: Summary: Cannot bind Master to a specific hostname as per the documentation Key: SPARK-5412 URL: https://issues.apache.org/jira/browse/SPARK-5412 Project:

[jira] [Updated] (SPARK-4147) Reduce log4j dependency

[ https://issues.apache.org/jira/browse/SPARK-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4147: --- Fix Version/s: 1.2.1 1.3.0 Reduce log4j dependency

[jira] [Updated] (SPARK-4147) Reduce log4j dependency

[ https://issues.apache.org/jira/browse/SPARK-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4147: --- Assignee: Sean Owen Reduce log4j dependency --- Key:

[jira] [Commented] (SPARK-926) spark_ec2 script when ssh/scp-ing should pipe UserknowHostFile to /dev/null

[ https://issues.apache.org/jira/browse/SPARK-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292549#comment-14292549 ] Josh Rosen commented on SPARK-926: -- I think it is; there's now a PR to fix this, since

[jira] [Commented] (SPARK-5395) Large number of Python workers causing resource depletion

[ https://issues.apache.org/jira/browse/SPARK-5395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292668#comment-14292668 ] Mark Khaitman commented on SPARK-5395: -- [~skrasser], I actually only managed to have

[jira] [Comment Edited] (SPARK-5395) Large number of Python workers causing resource depletion

[ https://issues.apache.org/jira/browse/SPARK-5395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292668#comment-14292668 ] Mark Khaitman edited comment on SPARK-5395 at 1/26/15 11:57 PM:

[jira] [Updated] (SPARK-5384) Vectors.sqdist return inconsistent result for sparse/dense vectors when the vectors have different lengths

[ https://issues.apache.org/jira/browse/SPARK-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5384: - Affects Version/s: (was: 1.2.1) 1.3.0 Vectors.sqdist return

[jira] [Updated] (SPARK-5384) Vectors.sqdist return inconsistent result for sparse/dense vectors when the vectors have different lengths

[ https://issues.apache.org/jira/browse/SPARK-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5384: - Target Version/s: 1.3.0 (was: 1.3.0, 1.2.1) Vectors.sqdist return inconsistent result for

[jira] [Updated] (SPARK-5384) Vectors.sqdist return inconsistent result for sparse/dense vectors when the vectors have different lengths

[ https://issues.apache.org/jira/browse/SPARK-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5384: - Target Version/s: 1.3.0, 1.2.1 (was: 1.2.1) Vectors.sqdist return inconsistent result for

[jira] [Closed] (SPARK-4589) ML add-ons to SchemaRDD

[ https://issues.apache.org/jira/browse/SPARK-4589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-4589. Resolution: Duplicate I'm closing this JIRA in favor of the DataFrame API. ML add-ons to

[jira] [Created] (SPARK-5414) Add SparkListener implementation that allows users to receive all listener events in one method

Josh Rosen created SPARK-5414: - Summary: Add SparkListener implementation that allows users to receive all listener events in one method Key: SPARK-5414 URL: https://issues.apache.org/jira/browse/SPARK-5414

[jira] [Commented] (SPARK-5413) Upgrade metrics dependency to 3.1.0

[ https://issues.apache.org/jira/browse/SPARK-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292719#comment-14292719 ] Apache Spark commented on SPARK-5413: - User 'ryan-williams' has created a pull request

[jira] [Updated] (SPARK-4979) Add streaming logistic regression

[ https://issues.apache.org/jira/browse/SPARK-4979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4979: - Target Version/s: (was: 1.3.0) Add streaming logistic regression

[jira] [Commented] (SPARK-5414) Add SparkListener implementation that allows users to receive all listener events in one method

[ https://issues.apache.org/jira/browse/SPARK-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292720#comment-14292720 ] Apache Spark commented on SPARK-5414: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-5415) Upgrade sbt to 0.13.7

[ https://issues.apache.org/jira/browse/SPARK-5415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292723#comment-14292723 ] Sean Owen commented on SPARK-5415: -- FWIW I use 0.13.7 locally and have had no problems.

[jira] [Commented] (SPARK-5415) Upgrade sbt to 0.13.7

[ https://issues.apache.org/jira/browse/SPARK-5415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292722#comment-14292722 ] Apache Spark commented on SPARK-5415: - User 'ryan-williams' has created a pull request

<    1   2