spark git commit: [SPARK-4187] [Core] Switch to binary protocol for external shuffle service messages

Repository: spark Updated Branches: refs/heads/branch-1.2 7f86c350c - d6262fa05 [SPARK-4187] [Core] Switch to binary protocol for external shuffle service messages This PR elimiantes the network package's usage of the Java serializer and replaces it with Encodable, which is a lightweight

spark git commit: [SPARK-4187] [Core] Switch to binary protocol for external shuffle service messages

Repository: spark Updated Branches: refs/heads/master 3abdb1b24 - d4fa04e50 [SPARK-4187] [Core] Switch to binary protocol for external shuffle service messages This PR elimiantes the network package's usage of the Java serializer and replaces it with Encodable, which is a lightweight binary

[06/20] spark git commit: Scala 2.11 support with repl and all build changes.

http://git-wip-us.apache.org/repos/asf/spark/blob/4af9de7d/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala -- diff --git a/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala

[16/20] spark git commit: small correction

small correction Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/899fc3c0 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/899fc3c0 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/899fc3c0 Branch:

Git Push Summary

Repository: spark Updated Branches: refs/heads/scala-2.11-prashant [deleted] fd849b0b4 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[17/20] spark git commit: Run against scala 2.11 on jenkins.

Run against scala 2.11 on jenkins. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d7c35e2f Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d7c35e2f Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d7c35e2f

[15/20] spark git commit: Fixed build after rebasing with master. We should use ${scala.binary.version} instead of just 2.10

Fixed build after rebasing with master. We should use ${scala.binary.version} instead of just 2.10 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/eeed1a68 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/eeed1a68

[10/20] spark git commit: Scala 2.11 support with repl and all build changes.

http://git-wip-us.apache.org/repos/asf/spark/blob/4af9de7d/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkILoop.scala -- diff --git a/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkILoop.scala

[05/20] spark git commit: Scala 2.11 support with repl and all build changes.

http://git-wip-us.apache.org/repos/asf/spark/blob/4af9de7d/repl/src/main/scala/org/apache/spark/repl/SparkIMain.scala -- diff --git a/repl/src/main/scala/org/apache/spark/repl/SparkIMain.scala

[01/20] spark git commit: Changed scripts to ignore target.

Repository: spark Updated Branches: refs/heads/scala-2.11-prashant [created] fd849b0b4 Changed scripts to ignore target. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d3065ecd Tree:

[12/20] spark git commit: Code review

Code review Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/1b836d80 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/1b836d80 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/1b836d80 Branch:

[02/20] spark git commit: MAven equivalent of setting spark.executor.extraClasspath during tests.

MAven equivalent of setting spark.executor.extraClasspath during tests. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ed4f6463 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ed4f6463 Diff:

[08/20] spark git commit: Scala 2.11 support with repl and all build changes.

http://git-wip-us.apache.org/repos/asf/spark/blob/4af9de7d/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkMemberHandlers.scala -- diff --git

[11/20] spark git commit: Scala 2.11 support with repl and all build changes.

Scala 2.11 support with repl and all build changes. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4af9de7d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/4af9de7d Diff:

[18/20] spark git commit: Fixed Python Runner suite. null check should be first case in scala 2.11.

Fixed Python Runner suite. null check should be first case in scala 2.11. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/29cc4d9f Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/29cc4d9f Diff:

[14/20] spark git commit: Print an error if build for 2.10 and 2.11 is spotted.

Print an error if build for 2.10 and 2.11 is spotted. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c696f394 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c696f394 Diff:

[09/20] spark git commit: Scala 2.11 support with repl and all build changes.

http://git-wip-us.apache.org/repos/asf/spark/blob/4af9de7d/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkIMain.scala -- diff --git a/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkIMain.scala

[07/20] spark git commit: Scala 2.11 support with repl and all build changes.

http://git-wip-us.apache.org/repos/asf/spark/blob/4af9de7d/repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkIMain.scala -- diff --git a/repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkIMain.scala

[03/20] spark git commit: Setting test jars on executor classpath during tests from sbt.

Setting test jars on executor classpath during tests from sbt. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4bcf66f2 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/4bcf66f2 Diff:

[19/20] spark git commit: Testing new Hive version with shaded jline

Testing new Hive version with shaded jline Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/37d972c3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/37d972c3 Diff:

spark git commit: [SQL][DOC][Minor] Spark SQL Hive now support dynamic partitioning

Repository: spark Updated Branches: refs/heads/branch-1.2 d6262fa05 - e5b8cea7e [SQL][DOC][Minor] Spark SQL Hive now support dynamic partitioning Author: wangfei wangf...@huawei.com Closes #3127 from scwf/patch-9 and squashes the following commits: e39a560 [wangfei] now support dynamic

spark git commit: [SPARK-4225][SQL] Resorts to SparkContext.version to inspect Spark version

Repository: spark Updated Branches: refs/heads/master 636d7bcc9 - 86e9eaa3f [SPARK-4225][SQL] Resorts to SparkContext.version to inspect Spark version This PR resorts to `SparkContext.version` rather than META-INF/MANIFEST.MF in the assembly jar to inspect Spark version. Currently, when

spark git commit: [SPARK-4225][SQL] Resorts to SparkContext.version to inspect Spark version

Repository: spark Updated Branches: refs/heads/branch-1.2 e5b8cea7e - 2cd8e3e2b [SPARK-4225][SQL] Resorts to SparkContext.version to inspect Spark version This PR resorts to `SparkContext.version` rather than META-INF/MANIFEST.MF in the assembly jar to inspect Spark version. Currently, when

spark git commit: [SQL] Support ScalaReflection of schema in different universes

Repository: spark Updated Branches: refs/heads/master 86e9eaa3f - 8154ed7df [SQL] Support ScalaReflection of schema in different universes Author: Michael Armbrust mich...@databricks.com Closes #3096 from marmbrus/reflectionContext and squashes the following commits: adc221f [Michael

spark git commit: [SQL] Support ScalaReflection of schema in different universes

Repository: spark Updated Branches: refs/heads/branch-1.2 2cd8e3e2b - f1f1ae418 [SQL] Support ScalaReflection of schema in different universes Author: Michael Armbrust mich...@databricks.com Closes #3096 from marmbrus/reflectionContext and squashes the following commits: adc221f [Michael

spark git commit: [SQL] Modify keyword val location according to ordering

Repository: spark Updated Branches: refs/heads/master 8154ed7df - 68609c51a [SQL] Modify keyword val location according to ordering 'DOUBLE' should be moved before 'ELSE' according to the ordering convension Author: Jacky Li jacky.li...@gmail.com Closes #3080 from jackylk/patch-5 and

spark git commit: [SPARK-4213][SQL] ParquetFilters - No support for LT, LTE, GT, GTE operators

Repository: spark Updated Branches: refs/heads/master 68609c51a - 14c54f187 [SPARK-4213][SQL] ParquetFilters - No support for LT, LTE, GT, GTE operators Following description is quoted from JIRA: When I issue a hql query against a HiveContext where my predicate uses a column of string type

spark git commit: [SPARK-4213][SQL] ParquetFilters - No support for LT, LTE, GT, GTE operators

Repository: spark Updated Branches: refs/heads/branch-1.2 51ef8ab8e - d530c3952 [SPARK-4213][SQL] ParquetFilters - No support for LT, LTE, GT, GTE operators Following description is quoted from JIRA: When I issue a hql query against a HiveContext where my predicate uses a column of string

spark git commit: [SPARK-4272] [SQL] Add more unwrapper functions for primitive type in TableReader

Repository: spark Updated Branches: refs/heads/master 14c54f187 - 60ab80f50 [SPARK-4272] [SQL] Add more unwrapper functions for primitive type in TableReader Currently, the data unwrap only support couple of primitive types, not all, it will not cause exception, but may get some performance

spark git commit: [SPARK-4272] [SQL] Add more unwrapper functions for primitive type in TableReader

Repository: spark Updated Branches: refs/heads/branch-1.2 d530c3952 - ff1a08256 [SPARK-4272] [SQL] Add more unwrapper functions for primitive type in TableReader Currently, the data unwrap only support couple of primitive types, not all, it will not cause exception, but may get some

spark git commit: [SPARK-4270][SQL] Fix Cast from DateType to DecimalType.

Repository: spark Updated Branches: refs/heads/master 60ab80f50 - a6405c5dd [SPARK-4270][SQL] Fix Cast from DateType to DecimalType. `Cast` from `DateType` to `DecimalType` throws `NullPointerException`. Author: Takuya UESHIN ues...@happy-camper.st Closes #3134 from ueshin/issues/SPARK-4270

spark git commit: [SPARK-4203][SQL] Partition directories in random order when inserting into hive table

Repository: spark Updated Branches: refs/heads/master a6405c5dd - ac70c972a [SPARK-4203][SQL] Partition directories in random order when inserting into hive table When doing an insert into hive table with partitions the folders written to the file system are in a random order instead of the

spark git commit: [SPARK-4203][SQL] Partition directories in random order when inserting into hive table

Repository: spark Updated Branches: refs/heads/branch-1.2 684d1f0ec - c96da3676 [SPARK-4203][SQL] Partition directories in random order when inserting into hive table When doing an insert into hive table with partitions the folders written to the file system are in a random order instead of

spark git commit: [SPARK-4292][SQL] Result set iterator bug in JDBC/ODBC

Repository: spark Updated Branches: refs/heads/branch-1.2 c96da3676 - 47bd8f302 [SPARK-4292][SQL] Result set iterator bug in JDBC/ODBC select * from src, get the wrong result set as follows: ``` ... | 309 | val_309 | | 309 | val_309 | | 309 | val_309 | | 309 | val_309 | | 309 |

spark git commit: [SPARK-4292][SQL] Result set iterator bug in JDBC/ODBC

Repository: spark Updated Branches: refs/heads/master ac70c972a - d6e555244 [SPARK-4292][SQL] Result set iterator bug in JDBC/ODBC select * from src, get the wrong result set as follows: ``` ... | 309 | val_309 | | 309 | val_309 | | 309 | val_309 | | 309 | val_309 | | 309 | val_309

spark git commit: Update JavaCustomReceiver.java

Repository: spark Updated Branches: refs/heads/master d6e555244 - 7c9ec529a Update JavaCustomReceiver.java 数组下标越界 Author: xiao321 1042460...@qq.com Closes #3153 from xiao321/patch-1 and squashes the following commits: 0ed17b5 [xiao321] Update JavaCustomReceiver.java Project:

spark git commit: Update JavaCustomReceiver.java

Repository: spark Updated Branches: refs/heads/branch-1.2 47bd8f302 - 8cefb63c1 Update JavaCustomReceiver.java 数组下标越界 Author: xiao321 1042460...@qq.com Closes #3153 from xiao321/patch-1 and squashes the following commits: 0ed17b5 [xiao321] Update JavaCustomReceiver.java

spark git commit: Update JavaCustomReceiver.java

Repository: spark Updated Branches: refs/heads/branch-1.1 0a40eac25 - 4fb26df87 Update JavaCustomReceiver.java 数组下标越界 Author: xiao321 1042460...@qq.com Closes #3153 from xiao321/patch-1 and squashes the following commits: 0ed17b5 [xiao321] Update JavaCustomReceiver.java

spark git commit: Update JavaCustomReceiver.java

Repository: spark Updated Branches: refs/heads/branch-1.0 76c20cac9 - 18c8c3833 Update JavaCustomReceiver.java 数组下标越界 Author: xiao321 1042460...@qq.com Closes #3153 from xiao321/patch-1 and squashes the following commits: 0ed17b5 [xiao321] Update JavaCustomReceiver.java

spark git commit: MAINTENANCE: Automated closing of pull requests.

Repository: spark Updated Branches: refs/heads/master 7c9ec529a - 5923dd986 MAINTENANCE: Automated closing of pull requests. This commit exists to close the following pull requests on Github: Closes #3016 (close requested by 'andrewor14') Closes #2798 (close requested by 'andrewor14') Closes

spark git commit: [SPARK-4304] [PySpark] Fix sort on empty RDD

Repository: spark Updated Branches: refs/heads/master 5923dd986 - 777910979 [SPARK-4304] [PySpark] Fix sort on empty RDD This PR fix sortBy()/sortByKey() on empty RDD. This should be back ported into 1.1/1.2 Author: Davies Liu dav...@databricks.com Closes #3162 from davies/fix_sort and

spark git commit: [SPARK-4304] [PySpark] Fix sort on empty RDD

Repository: spark Updated Branches: refs/heads/branch-1.2 8cefb63c1 - 3b07c483a [SPARK-4304] [PySpark] Fix sort on empty RDD This PR fix sortBy()/sortByKey() on empty RDD. This should be back ported into 1.1/1.2 Author: Davies Liu dav...@databricks.com Closes #3162 from davies/fix_sort and

spark git commit: [SPARK-4304] [PySpark] Fix sort on empty RDD

Repository: spark Updated Branches: refs/heads/branch-1.1 4fb26df87 - 4895f6544 [SPARK-4304] [PySpark] Fix sort on empty RDD This PR fix sortBy()/sortByKey() on empty RDD. This should be back ported into 1.1/1.2 Author: Davies Liu dav...@databricks.com Closes #3162 from davies/fix_sort and

spark git commit: [SPARK-4304] [PySpark] Fix sort on empty RDD (1.0 branch)

Repository: spark Updated Branches: refs/heads/branch-1.0 18c8c3833 - d4aed266d [SPARK-4304] [PySpark] Fix sort on empty RDD (1.0 branch) This PR fix sortBy()/sortByKey() on empty RDD. This should be back ported into 1.0 Author: Davies Liu dav...@databricks.com Closes #3163 from

spark git commit: [MLLIB] [PYTHON] SPARK-4221: Expose nonnegative ALS in the python API

Repository: spark Updated Branches: refs/heads/master 777910979 - 7e9d97567 [MLLIB] [PYTHON] SPARK-4221: Expose nonnegative ALS in the python API SPARK-1553 added alternating nonnegative least squares to MLLib, however it's not possible to access it via the python API. This pull request

spark git commit: [MLLIB] [PYTHON] SPARK-4221: Expose nonnegative ALS in the python API

Repository: spark Updated Branches: refs/heads/branch-1.2 3b07c483a - 427d7911f [MLLIB] [PYTHON] SPARK-4221: Expose nonnegative ALS in the python API SPARK-1553 added alternating nonnegative least squares to MLLib, however it's not possible to access it via the python API. This pull request

spark git commit: [SPARK-4291][Build] Rename network module projects

Repository: spark Updated Branches: refs/heads/branch-1.2 427d7911f - fc51de339 [SPARK-4291][Build] Rename network module projects The names of the recently introduced network modules are inconsistent with those of the other modules in the project. We should just drop the Code suffix since