[1/2] [SPARK-2377] Python API for Streaming

2014-10-12 Thread tdas
Repository: spark Updated Branches: refs/heads/master 7a3f589ef -> 69c67abaa http://git-wip-us.apache.org/repos/asf/spark/blob/69c67aba/python/pyspark/streaming/tests.py -- diff --git a/python/pyspark/streaming/tests.py b/pyth

[2/2] git commit: [SPARK-2377] Python API for Streaming

2014-10-12 Thread tdas
[SPARK-2377] Python API for Streaming This patch brings Python API for Streaming. This patch is based on work from @giwa Author: giwa Author: Ken Takagiwa Author: Davies Liu Author: Ken Takagiwa Author: Tathagata Das Author: Ken Author: Ken Takagiwa Author: Matthew Farrellee Closes #253

git commit: [SPARK-3887] Send stracktrace in ConnectionManager error replies

2014-10-12 Thread rxin
Repository: spark Updated Branches: refs/heads/master 69c67abaa -> 18bd67c24 [SPARK-3887] Send stracktrace in ConnectionManager error replies When reporting that a remote error occurred, the ConnectionManager should also log the stacktrace of the remote exception. This PR accomplishes this by

git commit: SPARK-3716 [GraphX] Update Analytics.scala for partitionStrategy assignment

2014-10-12 Thread ankurdave
Repository: spark Updated Branches: refs/heads/branch-1.1 18ef22ab7 -> 5a21e3e7e SPARK-3716 [GraphX] Update Analytics.scala for partitionStrategy assignment Previously, when the val partitionStrategy was created it called a function in the Analytics object which was a copy of the PartitionStr

git commit: SPARK-3716 [GraphX] Update Analytics.scala for partitionStrategy assignment

2014-10-12 Thread ankurdave
Repository: spark Updated Branches: refs/heads/master 18bd67c24 -> e5be4de7b SPARK-3716 [GraphX] Update Analytics.scala for partitionStrategy assignment Previously, when the val partitionStrategy was created it called a function in the Analytics object which was a copy of the PartitionStrateg

git commit: [HOTFIX] Fix compilation error for Yarn 2.0.*-alpha

2014-10-12 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master e5be4de7b -> c86c97603 [HOTFIX] Fix compilation error for Yarn 2.0.*-alpha This was reported in https://issues.apache.org/jira/browse/SPARK-3445. There are API differences between the 0.23.* and the 2.0.*-alpha branches that are not accou

git commit: [SPARK-3121] Wrong implementation of implicit bytesWritableConverter

2014-10-12 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master c86c97603 -> fc616d51a [SPARK-3121] Wrong implementation of implicit bytesWritableConverter val path = ... //path to seq file with BytesWritable as type of both key and value val file = sc.sequenceFile[Array[Byte],Array[Byte]](path) file.t

git commit: [SPARK-3121] Wrong implementation of implicit bytesWritableConverter

2014-10-12 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 5a21e3e7e -> 0e3257906 [SPARK-3121] Wrong implementation of implicit bytesWritableConverter val path = ... //path to seq file with BytesWritable as type of both key and value val file = sc.sequenceFile[Array[Byte],Array[Byte]](path) fi

git commit: [SPARK-3121] Wrong implementation of implicit bytesWritableConverter

2014-10-12 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.0 b539b0e98 -> dc18167ee [SPARK-3121] Wrong implementation of implicit bytesWritableConverter val path = ... //path to seq file with BytesWritable as type of both key and value val file = sc.sequenceFile[Array[Byte],Array[Byte]](path) fi

git commit: [SPARK-3905][Web UI]The keys for sorting the columns of Executor page , Stage page Storage page are incorrect

2014-10-12 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 0e3257906 -> a36116c19 [SPARK-3905][Web UI]The keys for sorting the columns of Executor page ,Stage page Storage page are incorrect Author: GuoQiang Li Closes #2763 from witgo/SPARK-3905 and squashes the following commits: 17d7990 [

git commit: [SPARK-3905][Web UI]The keys for sorting the columns of Executor page , Stage page Storage page are incorrect

2014-10-12 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master fc616d51a -> b4a7fa7a6 [SPARK-3905][Web UI]The keys for sorting the columns of Executor page ,Stage page Storage page are incorrect Author: GuoQiang Li Closes #2763 from witgo/SPARK-3905 and squashes the following commits: 17d7990 [GuoQ

git commit: Add echo "Run streaming tests ..."

2014-10-12 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master b4a7fa7a6 -> d8b8c2107 Add echo "Run streaming tests ..." Author: Ken Takagiwa Closes #2778 from giwa/patch-2 and squashes the following commits: a59f9a1 [Ken Takagiwa] Add echo "Run streaming tests ..." Project: http://git-wip-us.apac

git commit: [SPARK-3899][Doc]fix wrong links in streaming doc

2014-10-12 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master d8b8c2107 -> 92e017fb8 [SPARK-3899][Doc]fix wrong links in streaming doc There are three [Custom Receiver Guide] links in streaming doc, the first is wrong. Author: w00228970 Author: wangfei Closes #2749 from scwf/streaming-doc and sq

git commit: [SPARK-3899][Doc]fix wrong links in streaming doc

2014-10-12 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 a36116c19 -> 4fc66380f [SPARK-3899][Doc]fix wrong links in streaming doc There are three [Custom Receiver Guide] links in streaming doc, the first is wrong. Author: w00228970 Author: wangfei Closes #2749 from scwf/streaming-doc an