spark git commit: [SPARK-5969][PySpark] Fix descending pyspark.rdd.sortByKey.

2015-04-10 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master b9baa4cd9 -> 0375134f4 [SPARK-5969][PySpark] Fix descending pyspark.rdd.sortByKey. The samples should always be sorted in ascending order, because bisect.bisect_left is used on it. The reverse order of the result is already achieved in ra

spark git commit: [SPARK-6216] [PySpark] check the python version in worker

2015-04-10 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 0375134f4 -> 4740d6a15 [SPARK-6216] [PySpark] check the python version in worker Author: Davies Liu Closes #5404 from davies/check_version and squashes the following commits: e559248 [Davies Liu] add tests ec33b5f [Davies Liu] check the

spark git commit: [SPARK-5969][PySpark] Fix descending pyspark.rdd.sortByKey.

2015-04-10 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.3 ec3e76f1e -> 48321b83d [SPARK-5969][PySpark] Fix descending pyspark.rdd.sortByKey. The samples should always be sorted in ascending order, because bisect.bisect_left is used on it. The reverse order of the result is already achieved i

spark git commit: [SPARK-5969][PySpark] Fix descending pyspark.rdd.sortByKey.

2015-04-10 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.2 7a1583917 -> daec1c635 [SPARK-5969][PySpark] Fix descending pyspark.rdd.sortByKey. The samples should always be sorted in ascending order, because bisect.bisect_left is used on it. The reverse order of the result is already achieved i

spark git commit: [SPARK-6850] [SparkR] use one partition when we need to compare the whole result

2015-04-10 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 4740d6a15 -> 68ecdb7f9 [SPARK-6850] [SparkR] use one partition when we need to compare the whole result Author: Davies Liu Closes #5460 from davies/r_test and squashes the following commits: 0a593ce [Davies Liu] use one partition when we

spark git commit: [SPARK-6851][SQL] Create new instance for each converted parquet relation

2015-04-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 68ecdb7f9 -> 23d5f8864 [SPARK-6851][SQL] Create new instance for each converted parquet relation Otherwise we end up rewriting predicates to be trivially equal (i.e. `a#1 = a#2` -> `a#3 = a#3`), at which point the query is no longer valid.

spark git commit: [SPARK-6851][SQL] Create new instance for each converted parquet relation

2015-04-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 48321b83d -> 767f582cf [SPARK-6851][SQL] Create new instance for each converted parquet relation Otherwise we end up rewriting predicates to be trivially equal (i.e. `a#1 = a#2` -> `a#3 = a#3`), at which point the query is no longer va

[2/2] spark git commit: [SQL] [SPARK-6620] Speed up toDF() and rdd() functions by constructing converters in ScalaReflection

2015-04-10 Thread marmbrus
[SQL] [SPARK-6620] Speed up toDF() and rdd() functions by constructing converters in ScalaReflection cc marmbrus Author: Volodymyr Lyubinets Closes #5279 from vlyubin/speedup and squashes the following commits: e75a387 [Volodymyr Lyubinets] Changes to ScalaUDF 11a20ec [Volodymyr Lyubinets] Av

[1/2] spark git commit: [SQL] [SPARK-6620] Speed up toDF() and rdd() functions by constructing converters in ScalaReflection

2015-04-10 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 23d5f8864 -> 67d06880e http://git-wip-us.apache.org/repos/asf/spark/blob/67d06880/sql/catalyst/src/main/scala/org/apache/spark/sql/types/DataTypeConversions.scala -- diff --

[1/2] spark git commit: Revert "Preparing development version 1.3.2-SNAPSHOT"

2015-04-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 767f582cf -> 30d906e86 Revert "Preparing development version 1.3.2-SNAPSHOT" This reverts commit cdef7d080aa3f473f5ea06ba816c01b41a0239eb. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org

[2/2] spark git commit: Revert "Preparing Spark release v1.3.1-rc2"

2015-04-10 Thread pwendell
Revert "Preparing Spark release v1.3.1-rc2" This reverts commit 7c4473aa5a7f5de0323394aaedeefbf9738e8eb5. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/30d906e8 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/30d906

Git Push Summary

2015-04-10 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.1-rc3 [created] 3e8391327 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing Spark release v1.3.1-rc3

2015-04-10 Thread pwendell
Preparing Spark release v1.3.1-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/3e839132 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/3e839132 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/3e839132 Bra

[1/2] spark git commit: Preparing development version 1.3.2-SNAPSHOT

2015-04-10 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 30d906e86 -> ffc821e20 Preparing development version 1.3.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ffc821e2 Tree: http://git-wip-us.apache.org/repo