GitHub user khanm002 opened a pull request: https://github.com/apache/spark/pull/19935
Branch 0.6 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests) (If this patch involves UI changes, please attach a screenshot; otherwise, remove this) Please review http://spark.apache.org/contributing.html before opening a pull request. You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/spark branch-0.6 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/19935.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #19935 ---- commit ce143d64ed68e956248c3ba5cc310a63a79f33c8 Author: Matei Zaharia <ma...@eecs.berkeley.edu> Date: 2012-10-25T04:52:13Z Strip leading mesos:// in URLs passed to Mesos commit d3387427ce6608f53df371f9365c49062ae0dee5 Author: root <root@domu-12-31-39-05-3d-b1.compute-1.internal> Date: 2012-10-26T07:31:08Z Don't throw an error in the block manager when a block is cached on the master due to a locally computed operation commit d2b2fc229e488f961f029846c34660552468dda4 Author: Matei Zaharia <ma...@eecs.berkeley.edu> Date: 2012-11-06T23:57:38Z Made Akka timeout and message frame size configurable, and upped the defaults commit 222355e0584f52be2b0285257151f7c3f1f3f3fa Author: Thomas Dudziak <tom...@gmail.com> Date: 2012-10-22T20:10:47Z Tweaked run file to live more happily with typesafe's debian package commit ef683d4e01bc0ff3fb783bd6b1308b5e4ecd7ece Author: Josh Rosen <joshro...@eecs.berkeley.edu> Date: 2012-10-23T20:49:52Z Fix minor typos in quick start guide. commit cf0bf73d07600f92f24af7b97a2f60b12d1e4f96 Author: Josh Rosen <joshro...@eecs.berkeley.edu> Date: 2012-10-18T17:01:38Z Allow EC2 script to stop/destroy cluster after master/slave failures. commit 43465e92a934a7fc93154c97e397074707d8d803 Author: Josh Rosen <joshro...@eecs.berkeley.edu> Date: 2012-11-04T00:02:47Z Fix check for existing instances during EC2 launch. commit d20142b105acedc7074dc4edb743ea78cd851d7f Author: Shivaram Venkataraman <shiva...@eecs.berkeley.edu> Date: 2012-11-01T17:46:38Z Remove unnecessary hash-map put in MemoryStore commit 171e97af5b67dd322f787655d70baa40318dbb87 Author: Josh Rosen <joshro...@eecs.berkeley.edu> Date: 2012-10-31T06:32:38Z Cancel spot instance requests when exiting spark-ec2. commit 5acd753876eab712a3e8fbf3ae33fb4c0b978abd Author: Matei Zaharia <ma...@eecs.berkeley.edu> Date: 2012-10-21T06:33:37Z Various fixes to standalone mode and web UI: - Don't report a job as finishing multiple times - Don't show state of workers as LOADING when they're running - Show start and finish times in web UI - Sort web UI tables by ID and time by default commit 4fe0d808b0d211d7e00341a3ba95e83792c01681 Author: Imran Rashid <im...@quantifind.com> Date: 2012-11-07T23:35:51Z fix bug in getting slave id out of mesos commit a24540887c6968353db3bb9c28b23eb48a68da75 Author: Matei Zaharia <ma...@eecs.berkeley.edu> Date: 2012-11-08T08:10:13Z Merge pull request #300 from enachb/mesos_slavelost fix bug in getting slave id out of mesos commit b3b52c995a37385fc08af5837feea18bddee55a0 Author: Matei Zaharia <ma...@eecs.berkeley.edu> Date: 2012-11-08T17:53:40Z Fix for connections not being reused (from Josh Rosen) commit bb2b9ff37cd2503cc6ea82c5dd395187b0910af0 Author: Matei Zaharia <ma...@eecs.berkeley.edu> Date: 2012-11-09T07:13:12Z Added an option to spread out jobs in the standalone mode. commit e870ca50c6dbbc7bc951bb8432c4eb9b7c816c5e Author: Tathagata Das <tathagata.das1...@gmail.com> Date: 2012-11-09T22:09:37Z Fixed deadlock in BlockManager. 1. Changed the lock structure of BlockManager by replacing the 337 coarse-grained locks to use BlockInfo objects as per-block fine-grained locks. 2. Changed the MemoryStore lock structure by making the block putting threads lock on a different object (not the memory store) thus making sure putting threads minimally blocks to the getting treads. 3. Added spark.storage.ThreadingTest to stress test the BlockManager using 5 block producer and 5 block consumer threads. commit 9d5740f6bfdeb52747f70a4b6c7cb82c57b225d4 Author: Tathagata Das <tathagata.das1...@gmail.com> Date: 2012-11-09T23:46:15Z Incorporated Matei's suggestions. Tested with 5 producer(consumer) threads each doing 50k puts (gets), took 15 minutes to run, no errors or deadlocks. commit dc84ce72190f2910bced98a504fac20f305871a4 Author: root <root@ip-10-6-154-245.ec2.internal> Date: 2012-11-11T07:05:22Z Fix K-means example a little commit 9b802259cbdb743dd78323ad008848ad248d6c94 Author: Matei Zaharia <ma...@eecs.berkeley.edu> Date: 2012-11-12T05:06:57Z Detect correctly when one has disconnected from a standalone cluster. SPARK-617 #resolve commit 9d8e17dc3ca3bda8fb6042020b53245895dcf3a8 Author: Matei Zaharia <ma...@eecs.berkeley.edu> Date: 2012-11-15T06:37:05Z Fix Java/Scala home having spaces on Windows commit 889260305210a2aa16241ab6fd9a286e4e2f5a41 Author: Matei Zaharia <ma...@eecs.berkeley.edu> Date: 2012-11-15T08:10:52Z Use DNS names instead of IP addresses in standalone mode, to allow matching with data locality hints from storage systems. commit 7c1be975de95e7aa3093f442558315c7c63fe0b1 Author: Matei Zaharia <ma...@eecs.berkeley.edu> Date: 2012-11-15T20:55:34Z Change version to 0.6.1 commit 5c0835fc2e7b83a9284a40bb0f771367bb147e42 Author: Matei Zaharia <ma...@eecs.berkeley.edu> Date: 2012-11-17T04:48:35Z Doc fix commit eeb093ba54951cd4eed89f97cc3626a9218fd9b4 Author: mbautin <mbau...@gmail.com> Date: 2012-11-15T21:44:13Z SPARK-624: make the default local IP customizable commit edb91a3833fe10a5bf4c88abd0e00163b0766326 Author: mbautin <mbau...@gmail.com> Date: 2012-11-19T19:52:10Z Addressing Matei's comment: SPARK_LOCAL_IP environment variable commit 005f1ff7e908215787f3249aa96ac3a81bf9f661 Author: Matei Zaharia <ma...@eecs.berkeley.edu> Date: 2012-11-23T00:25:29Z Change version to 0.6.2-SNAPSHOT commit 87d5327887fb9cd00c38c3bc385da55f7afc0f30 Author: Charles Reiss <char...@eecs.berkeley.edu> Date: 2012-11-27T20:50:40Z Tests for MapOutputTracker. commit cfd9d4010605470023e184349b0f5412b879be36 Author: Charles Reiss <char...@eecs.berkeley.edu> Date: 2012-11-27T21:55:56Z Fix NullPointerException when unregistering a map output twice. commit 314a86af248927f059f1adc8bcb0dbb3f5ba38c7 Author: Josh Rosen <joshro...@eecs.berkeley.edu> Date: 2012-11-12T01:45:25Z Fix NullPointerException caused by unregistered map outputs. commit 4868f97489f80b2c1e4558881c389e1bb020cd4c Author: Matei Zaharia <ma...@eecs.berkeley.edu> Date: 2012-11-28T05:00:04Z Use hostname instead of IP in deploy scripts to let Akka connect properly commit 4d54aaa733658adea3bf68e489c43b2030327568 Author: Patrick Wendell <pwend...@gmail.com> Date: 2012-11-28T07:30:10Z Adding multi-jar constructor in quickstart ---- --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org