[jira] [Created] (SPARK-5033) Spark 1.1.0/1.1.1/1.2.0 can't run well in HDP on Windows

2014-12-31 Thread Rice (JIRA)
Rice created SPARK-5033: --- Summary: Spark 1.1.0/1.1.1/1.2.0 can't run well in HDP on Windows Key: SPARK-5033 URL: https://issues.apache.org/jira/browse/SPARK-5033 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-5034) Spark on Yarn within HDInsight on Windows

2014-12-31 Thread Rice (JIRA)
Rice created SPARK-5034: --- Summary: Spark on Yarn within HDInsight on Windows Key: SPARK-5034 URL: https://issues.apache.org/jira/browse/SPARK-5034 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-5032) MimaExcludes should not exclude GraphX

2014-12-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262026#comment-14262026 ] Apache Spark commented on SPARK-5032: - User 'jkbradley' has created a pull request for

[jira] [Commented] (SPARK-5033) Spark 1.1.0/1.1.1/1.2.0 can't run well in HDP on Windows

2014-12-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262041#comment-14262041 ] Sean Owen commented on SPARK-5033: -- Related to / maybe duplicate of SPARK-2221. I don't

[jira] [Commented] (SPARK-4986) Graceful shutdown for Spark Streaming does not work in Standalone cluster mode

2014-12-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262045#comment-14262045 ] Josh Rosen commented on SPARK-4986: --- I think I found one potential cause of why this

[jira] [Commented] (SPARK-5034) Spark on Yarn within HDInsight on Windows

2014-12-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262047#comment-14262047 ] Sean Owen commented on SPARK-5034: -- The message from YARN usually indicates you're asking

[jira] [Commented] (SPARK-5035) Streaming ReceiverMessage trait should extend Serializable

2014-12-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262049#comment-14262049 ] Apache Spark commented on SPARK-5035: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-2892) Socket Receiver does not stop when streaming context is stopped

2014-12-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262050#comment-14262050 ] Josh Rosen commented on SPARK-2892: --- I think that I've found the reason that this works

[jira] [Commented] (SPARK-5033) Spark 1.1.0/1.1.1/1.2.0 can't run well in HDP on Windows

2014-12-31 Thread Rice (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262053#comment-14262053 ] Rice commented on SPARK-5033: - Currently Spark 1.0.2 can run on HDP on Windows platform well.

[jira] [Commented] (SPARK-5035) Streaming ReceiverMessage trait should extend Serializable

2014-12-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262052#comment-14262052 ] Josh Rosen commented on SPARK-5035: --- This might fix both SPARK-4986 and SPARK-2892, but

[jira] [Commented] (SPARK-5034) Spark on Yarn within HDInsight on Windows

2014-12-31 Thread Rice (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262062#comment-14262062 ] Rice commented on SPARK-5034: - I met with the same issue as previous article described. When I

[jira] [Comment Edited] (SPARK-5034) Spark on Yarn within HDInsight on Windows

2014-12-31 Thread Rice (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262062#comment-14262062 ] Rice edited comment on SPARK-5034 at 12/31/14 9:43 AM: --- I met with

[jira] [Commented] (SPARK-2892) Socket Receiver does not stop when streaming context is stopped

2014-12-31 Thread Ilayaperumal Gopinathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262078#comment-14262078 ] Ilayaperumal Gopinathan commented on SPARK-2892: [~joshrosen] yeah,

[jira] [Comment Edited] (SPARK-2892) Socket Receiver does not stop when streaming context is stopped

2014-12-31 Thread Ilayaperumal Gopinathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262078#comment-14262078 ] Ilayaperumal Gopinathan edited comment on SPARK-2892 at 12/31/14 10:29 AM:

[jira] [Created] (SPARK-5036) Better support sending partial messages in Pregel API

2014-12-31 Thread sjk (JIRA)
sjk created SPARK-5036: -- Summary: Better support sending partial messages in Pregel API Key: SPARK-5036 URL: https://issues.apache.org/jira/browse/SPARK-5036 Project: Spark Issue Type: Improvement

[jira] [Issue Comment Deleted] (SPARK-2892) Socket Receiver does not stop when streaming context is stopped

2014-12-31 Thread Ilayaperumal Gopinathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilayaperumal Gopinathan updated SPARK-2892: --- Comment: was deleted (was: [~joshrosen] yeah, serialization could be the real

[jira] [Updated] (SPARK-5036) Better support sending partial messages in Pregel API

2014-12-31 Thread sjk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sjk updated SPARK-5036: --- Description: Better support sending partial messages in Pregel API 1. the reqirement In many iterative graph

[jira] [Updated] (SPARK-5036) Better support sending partial messages in Pregel API

2014-12-31 Thread sjk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sjk updated SPARK-5036: --- Attachment: s1.jpeg Better support sending partial messages in Pregel API

[jira] [Updated] (SPARK-5036) Better support sending partial messages in Pregel API

2014-12-31 Thread sjk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sjk updated SPARK-5036: --- Attachment: s2.jpeg Better support sending partial messages in Pregel API

[jira] [Commented] (SPARK-2892) Socket Receiver does not stop when streaming context is stopped

2014-12-31 Thread Ilayaperumal Gopinathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262131#comment-14262131 ] Ilayaperumal Gopinathan commented on SPARK-2892: [~joshrosen] This indeed

[jira] [Commented] (SPARK-4927) Spark does not clean up properly during long jobs.

2014-12-31 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262313#comment-14262313 ] Ilya Ganelin commented on SPARK-4927: - The below code reproduces the problem. Code

[jira] [Created] (SPARK-5037) support dynamic loading of input DStreams in pyspark streaming

2014-12-31 Thread Jascha Swisher (JIRA)
Jascha Swisher created SPARK-5037: - Summary: support dynamic loading of input DStreams in pyspark streaming Key: SPARK-5037 URL: https://issues.apache.org/jira/browse/SPARK-5037 Project: Spark

[jira] [Commented] (SPARK-5037) support dynamic loading of input DStreams in pyspark streaming

2014-12-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262334#comment-14262334 ] Apache Spark commented on SPARK-5037: - User 'industrial-sloth' has created a pull

[jira] [Updated] (SPARK-5037) support dynamic loading of input DStreams in pyspark streaming

2014-12-31 Thread Jascha Swisher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jascha Swisher updated SPARK-5037: -- Description: The scala and java streaming APIs support external InputDStreams (e.g. the

[jira] [Updated] (SPARK-1010) Update all unit tests to use SparkConf instead of system properties

2014-12-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-1010: -- Labels: backport-needed (was: ) Update all unit tests to use SparkConf instead of system properties

[jira] [Resolved] (SPARK-4726) NotSerializableException thrown on SystemDefaultHttpClient with stack not related to my functions

2014-12-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4726. --- Resolution: Invalid I'm resolving this as Invalid since it is a bug in user code and not Spark

[jira] [Commented] (SPARK-4184) Improve Spark Streaming documentation

2014-12-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262367#comment-14262367 ] Josh Rosen commented on SPARK-4184: --- Is this issue still unresolved? Improve Spark

[jira] [Created] (SPARK-5038) Add explicit return type for all implicit functions

2014-12-31 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5038: -- Summary: Add explicit return type for all implicit functions Key: SPARK-5038 URL: https://issues.apache.org/jira/browse/SPARK-5038 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5038) Add explicit return type for all implicit functions

2014-12-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262371#comment-14262371 ] Apache Spark commented on SPARK-5038: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-4184) Improve Spark Streaming documentation

2014-12-31 Thread Chris Fregly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262377#comment-14262377 ] Chris Fregly commented on SPARK-4184: - hey josh- lemme go through my notes and figure

[jira] [Commented] (SPARK-5038) Add explicit return type for all implicit functions

2014-12-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262379#comment-14262379 ] Apache Spark commented on SPARK-5038: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-5012) Python API for Gaussian Mixture Model

2014-12-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5012: - Assignee: Meethu Mathew (was: Travis Galoppo) Python API for Gaussian Mixture Model

[jira] [Commented] (SPARK-5012) Python API for Gaussian Mixture Model

2014-12-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262381#comment-14262381 ] Xiangrui Meng commented on SPARK-5012: -- Done :) Python API for Gaussian Mixture

[jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

2014-12-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4422: - Affects Version/s: (was: 1.1.1) (was: 1.0.2) In some cases,

[jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

2014-12-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4422: - Target Version/s: 1.2.0 (was: 1.2.0, 1.0.3, 1.1.2) In some cases, Vectors.fromBreeze get wrong

[jira] [Resolved] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

2014-12-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4422. -- Resolution: Fixed In some cases, Vectors.fromBreeze get wrong results.

[jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

2014-12-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4422: - Labels: (was: backport-needed) In some cases, Vectors.fromBreeze get wrong results.

[jira] [Commented] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results.

2014-12-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262382#comment-14262382 ] Xiangrui Meng commented on SPARK-4422: -- Marked as resolved. In some cases,

[jira] [Commented] (SPARK-4835) Streaming saveAs*HadoopFiles() methods may throw FileAlreadyExistsException during checkpoint recovery

2014-12-31 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262388#comment-14262388 ] Tathagata Das commented on SPARK-4835: -- Lets keep this simple for now, just disable

[jira] [Updated] (SPARK-1010) Update all unit tests to use SparkConf instead of system properties

2014-12-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-1010: -- Target Version/s: (was: 1.0.3, 1.1.2, 1.2.1) Fix Version/s: 1.2.1 1.1.2

[jira] [Resolved] (SPARK-1010) Update all unit tests to use SparkConf instead of system properties

2014-12-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-1010. --- Resolution: Fixed I've finished backporting this to all of the maintenance branches. Update all

[jira] [Resolved] (SPARK-4797) Replace breezeSquaredDistance

2014-12-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4797. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3643

[jira] [Updated] (SPARK-4797) Replace breezeSquaredDistance

2014-12-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4797: - Assignee: Liang-Chi Hsieh Replace breezeSquaredDistance -

[jira] [Resolved] (SPARK-4298) The spark-submit cannot read Main-Class from Manifest.

2014-12-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4298. --- Resolution: Fixed Fix Version/s: 1.2.1 1.1.2 1.3.0

[jira] [Created] (SPARK-5039) Spark 1.0 2.0.0-mr1-cdh4.1.2 Maven build fails due to javax.servlet.FilterRegistration's signer information errors

2014-12-31 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-5039: - Summary: Spark 1.0 2.0.0-mr1-cdh4.1.2 Maven build fails due to javax.servlet.FilterRegistration's signer information errors Key: SPARK-5039 URL:

[jira] [Created] (SPARK-5040) Support expressing unresolved attributes using $attribute name notation in SQL DSL

2014-12-31 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5040: -- Summary: Support expressing unresolved attributes using $attribute name notation in SQL DSL Key: SPARK-5040 URL: https://issues.apache.org/jira/browse/SPARK-5040

[jira] [Commented] (SPARK-4943) Parsing error for query with table name having dot

2014-12-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262412#comment-14262412 ] Michael Armbrust commented on SPARK-4943: - One possible approach here is to change

[jira] [Commented] (SPARK-5040) Support expressing unresolved attributes using $attribute name notation in SQL DSL

2014-12-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262413#comment-14262413 ] Apache Spark commented on SPARK-5040: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-5041) hive-exec jar should be generated with JDK 6

2014-12-31 Thread Ted Yu (JIRA)
Ted Yu created SPARK-5041: - Summary: hive-exec jar should be generated with JDK 6 Key: SPARK-5041 URL: https://issues.apache.org/jira/browse/SPARK-5041 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4804) StringContext method to allow using Strings for column names in catalyst DSL

2014-12-31 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-4804: --- Target Version/s: 1.3.0 (was: 1.1.0) StringContext method to allow using Strings for column names

[jira] [Commented] (SPARK-5026) PySpark rdd.randomSpit() is not documented

2014-12-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262438#comment-14262438 ] Josh Rosen commented on SPARK-5026: --- If you re-generate the docs locally, does it show

[jira] [Commented] (SPARK-4943) Parsing error for query with table name having dot

2014-12-31 Thread Alex Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262442#comment-14262442 ] Alex Liu commented on SPARK-4943: - The seq can be like {code} tableName, databaseName,

[jira] [Resolved] (SPARK-4547) OOM when making bins in BinaryClassificationMetrics

2014-12-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4547. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3702

[jira] [Commented] (SPARK-4897) Python 3 support

2014-12-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262459#comment-14262459 ] Josh Rosen commented on SPARK-4897: --- I've merged [~twneale]'s PR but there are still a

[jira] [Commented] (SPARK-1182) Sort the configuration parameters in configuration.md

2014-12-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262463#comment-14262463 ] Apache Spark commented on SPARK-1182: - User 'brennonyork' has created a pull request

[jira] [Updated] (SPARK-4586) Python API for ML Pipeline

2014-12-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4586: - Description: Add Python API to the newly added ML pipeline and parameters. The initial design doc

[jira] [Commented] (SPARK-1182) Sort the configuration parameters in configuration.md

2014-12-31 Thread Brennon York (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262465#comment-14262465 ] Brennon York commented on SPARK-1182: - All, given the PR that [~srowen] pointed out

[jira] [Commented] (SPARK-794) Remove sleep() in ClusterScheduler.stop

2014-12-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262468#comment-14262468 ] Josh Rosen commented on SPARK-794: -- It looks like this was added by

[jira] [Resolved] (SPARK-4790) Flaky test in ReceivedBlockTrackerSuite: block addition, block to batch allocation, and cleanup with write ahead log

2014-12-31 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4790. -- Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Flaky test in

[jira] [Commented] (SPARK-4286) Support External Shuffle Service with Mesos integration

2014-12-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262482#comment-14262482 ] Apache Spark commented on SPARK-4286: - User 'tnachen' has created a pull request for

[jira] [Commented] (SPARK-5039) Spark 1.0 2.0.0-mr1-cdh4.1.2 Maven build fails due to javax.servlet.FilterRegistration's signer information errors

2014-12-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262494#comment-14262494 ] Apache Spark commented on SPARK-5039: - User 'srowen' has created a pull request for

[jira] [Resolved] (SPARK-5020) GaussianMixtureModel.predictMembership() should take an RDD only

2014-12-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5020. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3854

[jira] [Commented] (SPARK-4986) Graceful shutdown for Spark Streaming does not work in Standalone cluster mode

2014-12-31 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262503#comment-14262503 ] Tathagata Das commented on SPARK-4986: -- [~koudelka] I have merged SPARK-5035, could

[jira] [Resolved] (SPARK-5035) Streaming ReceiverMessage trait should extend Serializable

2014-12-31 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-5035. -- Resolution: Fixed Fix Version/s: 1.2.1 1.1.2 1.3.0

[jira] [Updated] (SPARK-5017) GaussianMixtureEM should use SVD for Gaussian initialization

2014-12-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5017: - Assignee: Travis Galoppo GaussianMixtureEM should use SVD for Gaussian initialization

[jira] [Resolved] (SPARK-2757) Add Mima test for Spark Sink after 1.1.0 is released

2014-12-31 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-2757. -- Resolution: Fixed Fix Version/s: 1.3.0 Add Mima test for Spark Sink after 1.1.0 is

[jira] [Updated] (SPARK-2757) Add Mima test for Spark Sink after 1.1.0 is released

2014-12-31 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2757: - Summary: Add Mima test for Spark Sink after 1.1.0 is released (was: Add Mima test for Spark Sink

[jira] [Commented] (SPARK-3325) Add a parameter to the method print in class DStream.

2014-12-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262516#comment-14262516 ] Apache Spark commented on SPARK-3325: - User 'tdas' has created a pull request for this

[jira] [Created] (SPARK-5042) Updated Receiver API to make it easier to write reliable receivers that ack source

2014-12-31 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-5042: Summary: Updated Receiver API to make it easier to write reliable receivers that ack source Key: SPARK-5042 URL: https://issues.apache.org/jira/browse/SPARK-5042

[jira] [Created] (SPARK-5043) Implement updated Receiver API

2014-12-31 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-5043: Summary: Implement updated Receiver API Key: SPARK-5043 URL: https://issues.apache.org/jira/browse/SPARK-5043 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-5044) Update ReliableKafkaReceiver to use updated Receiver API

2014-12-31 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-5044: Summary: Update ReliableKafkaReceiver to use updated Receiver API Key: SPARK-5044 URL: https://issues.apache.org/jira/browse/SPARK-5044 Project: Spark Issue

[jira] [Created] (SPARK-5045) Update FlumePollingReceiver to use updated Receiver API

2014-12-31 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-5045: Summary: Update FlumePollingReceiver to use updated Receiver API Key: SPARK-5045 URL: https://issues.apache.org/jira/browse/SPARK-5045 Project: Spark Issue

[jira] [Created] (SPARK-5046) Update KinesisReceiver to use updated Receiver API

2014-12-31 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-5046: Summary: Update KinesisReceiver to use updated Receiver API Key: SPARK-5046 URL: https://issues.apache.org/jira/browse/SPARK-5046 Project: Spark Issue Type:

[jira] [Created] (SPARK-5047) Add Kafka to the Python Streaming API

2014-12-31 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-5047: Summary: Add Kafka to the Python Streaming API Key: SPARK-5047 URL: https://issues.apache.org/jira/browse/SPARK-5047 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-5048) Add Flume to the Python Streaming API

2014-12-31 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-5048: Summary: Add Flume to the Python Streaming API Key: SPARK-5048 URL: https://issues.apache.org/jira/browse/SPARK-5048 Project: Spark Issue Type: Improvement