[GitHub] spark pull request: SPARK-4276 fix for two working thread
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3141 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-4276 fix for two working thread
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3141#issuecomment-62452045 Mind closing this @svar29 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-4276 fix for two working thread
Github user squito commented on the pull request: https://github.com/apache/spark/pull/3141#issuecomment-62320554 I agress w/ TD, I don't think this change is necessary. I think we should close this and, @svar29 , maybe you can discuss the problem you are running into on the spark-user mailing list, hopefully we can help you out there. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-4276 fix for two working thread
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3141#issuecomment-62224082 Any thoughts? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-4276 fix for two working thread
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3141#issuecomment-62226551 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-4276 fix for two working thread
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3141#issuecomment-62227453 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-4276 fix for two working thread
GitHub user svar29 opened a pull request: https://github.com/apache/spark/pull/3141 SPARK-4276 fix for two working thread Spark streaming requires at least two working threads.But example in spark/examples/src/main/scala/org/apache/spark/examples/streaming/NetworkWordCount.scala has // Create the context with a 1 second batch size val sparkConf = new SparkConf().setAppName(NetworkWordCount) val ssc = new StreamingContext(sparkConf, Seconds(1)) which creates only 1 thread. It should have atleast 2 threads: http://spark.apache.org/docs/latest/streaming-programming-guide.html You can merge this pull request into a Git repository by running: $ git pull https://github.com/svar29/spark streaming-multiple-threads Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/3141.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3141 commit 700dfb4957dae32625cf6af2da5482775677c049 Author: Varun Sharma sharma.va...@flipkart.com Date: 2014-11-06T17:43:39Z SPARK-4276 fix for two working thread --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-4276 fix for two working thread
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3141#issuecomment-62020356 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-4276 fix for two working thread
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3141#issuecomment-62087166 Why is this change needed? IF you run the example through bin/run-example, it should the SparkConf should be automatically populated with a master of local[*], which sets the number of working threads as the number of cores in the local system. And highly likely that your system has more than 1 cores. Is there are situation where this is not working? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
