[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2015-10-12 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-147326922 @pauloangelo sounds like your RDD is not immutable then, in which case many bets are off. RDDs are generally always the same whenever you compute them. --- If your

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2015-10-11 Thread pauloangelo
Github user pauloangelo commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-147232717 Hi all, I'm getting similar problem using kmeans clustering with Spark-1.5.1. The stacktrace is below. To overcome the problem, I'm setting runs=1,

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2015-10-11 Thread pauloangelo
Github user pauloangelo commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-147266494 My RDD comes from a HBase table, which is growing. When I suspend the row insertion, the problem doesn't happen. The RDD is cached, should the problem

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread mengxr
GitHub user mengxr opened a pull request: https://github.com/apache/spark/pull/1229 [SPARK-2251] fix concurrency issues in random sampler The following code is very likely to throw an exception: ~~~ val rdd = sc.parallelize(0 until 111, 10).sample(false, 0.1)

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-47203216 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-47203207 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-47203638 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-47203628 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-47204535 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-47204537 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16154/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-47204966 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-47204976 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-47206910 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-47206911 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16153/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-47208755 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1229#issuecomment-47208756 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16155/ --- If your

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/1229#discussion_r14252256 --- Diff: core/src/main/scala/org/apache/spark/util/random/RandomSampler.scala --- @@ -54,17 +54,17 @@ trait RandomSampler[T, U] extends Pseudorandom with

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1234#issuecomment-47254302 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1234#issuecomment-47258920 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16163/ --- If your

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1234#issuecomment-47258917 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread mengxr
Github user mengxr closed the pull request at: https://github.com/apache/spark/pull/1234 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-2251] fix concurrency issues in random ...

2014-06-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/1229 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is