spark git commit: SPARK-6927 [SQL] Sorting Error when codegen on

2015-04-16 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 04e44b37c -> 5fe434335 SPARK-6927 [SQL] Sorting Error when codegen on Fix this error by adding BinaryType comparor in GenerateOrdering. JIRA https://issues.apache.org/jira/browse/SPARK-6927 Author: 云峤 Closes #5524 from kaka1992/fix-c

svn commit: r8638 - /dev/spark/spark-1.3.1-rc3/ /release/spark/spark-1.3.1/

2015-04-16 Thread pwendell
Author: pwendell Date: Thu Apr 16 23:43:24 2015 New Revision: 8638 Log: Spark 1.3.1 Added: release/spark/spark-1.3.1/ - copied from r8637, dev/spark/spark-1.3.1-rc3/ Removed: dev/spark/spark-1.3.1-rc3/ - To unsub

spark git commit: [SQL][Minor] Fix foreachUp of treenode

2015-04-16 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 6183b5e2c -> d96608674 [SQL][Minor] Fix foreachUp of treenode `foreachUp` should runs the given function recursively on [[children]] then on this node(just like transformUp). The current implementation does not follow this. This will lea

spark git commit: [SPARK-6911] [SQL] improve accessor for nested types

2015-04-16 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 5fe434335 -> 6183b5e2c [SPARK-6911] [SQL] improve accessor for nested types Support access columns by index in Python: ``` >>> df[df[0] > 3].collect() [Row(age=5, name=u'Bob')] ``` Access items in ArrayType or MapType ``` >>> df.select(df.

spark git commit: [SPARK-6966][SQL] Use correct ClassLoader for JDBC Driver

2015-04-16 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 1e43851d6 -> e5949c287 [SPARK-6966][SQL] Use correct ClassLoader for JDBC Driver Otherwise we cannot add jars with drivers after the fact. Author: Michael Armbrust Closes #5543 from marmbrus/jdbcClassloader and squashes the following com

[4/6] spark git commit: [SPARK-4897] [PySpark] Python 3 support

2015-04-16 Thread joshrosen
http://git-wip-us.apache.org/repos/asf/spark/blob/04e44b37/python/pyspark/mllib/fpm.py -- diff --git a/python/pyspark/mllib/fpm.py b/python/pyspark/mllib/fpm.py index 3aa6d79..628ccc0 100644 --- a/python/pyspark/mllib/fpm.py +++ b/

[6/6] spark git commit: [SPARK-4897] [PySpark] Python 3 support

2015-04-16 Thread joshrosen
[SPARK-4897] [PySpark] Python 3 support This PR update PySpark to support Python 3 (tested with 3.4). Known issue: unpickle array from Pyrolite is broken in Python 3, those tests are skipped. TODO: ec2/spark-ec2.py is not fully tested with python3. Author: Davies Liu Author: twneale Author:

[2/6] spark git commit: [SPARK-4897] [PySpark] Python 3 support

2015-04-16 Thread joshrosen
http://git-wip-us.apache.org/repos/asf/spark/blob/04e44b37/python/pyspark/sql/types.py -- diff --git a/python/pyspark/sql/types.py b/python/pyspark/sql/types.py deleted file mode 100644 index ef76d84..000 --- a/python/pyspark/s

spark git commit: [SPARK-6899][SQL] Fix type mismatch when using codegen with Average on DecimalType

2015-04-16 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master d96608674 -> 1e43851d6 [SPARK-6899][SQL] Fix type mismatch when using codegen with Average on DecimalType JIRA https://issues.apache.org/jira/browse/SPARK-6899 Author: Liang-Chi Hsieh Closes #5517 from viirya/fix_codegen_average and squ

[3/6] spark git commit: [SPARK-4897] [PySpark] Python 3 support

2015-04-16 Thread joshrosen
http://git-wip-us.apache.org/repos/asf/spark/blob/04e44b37/python/pyspark/sql/_types.py -- diff --git a/python/pyspark/sql/_types.py b/python/pyspark/sql/_types.py new file mode 100644 index 000..492c0cb --- /dev/null +++ b/pyt

spark git commit: [SPARK-6972][SQL] Add Coalesce to DataFrame

2015-04-16 Thread rxin
Repository: spark Updated Branches: refs/heads/master e5949c287 -> 8220d5265 [SPARK-6972][SQL] Add Coalesce to DataFrame Author: Michael Armbrust Closes #5545 from marmbrus/addCoalesce and squashes the following commits: 9fdf3f6 [Michael Armbrust] [SPARK-6972][SQL] Add Coalesce to DataFrame

svn commit: r8637 - /dev/spark/spark-1.3.1-rc3/

2015-04-16 Thread pwendell
Author: pwendell Date: Thu Apr 16 23:41:53 2015 New Revision: 8637 Log: Spark 1.3.1 RC3 Added: dev/spark/spark-1.3.1-rc3/ dev/spark/spark-1.3.1-rc3/spark-1.3.1-bin-cdh4.tgz (with props) dev/spark/spark-1.3.1-rc3/spark-1.3.1-bin-cdh4.tgz.asc (with props) dev/spark/spark-1.3.1-r

svn commit: r8636 - /dev/spark/spark-1.2.2-rc1/ /release/spark/spark-1.2.2/

2015-04-16 Thread pwendell
Author: pwendell Date: Thu Apr 16 22:59:24 2015 New Revision: 8636 Log: Spark 1.2.2 Release Added: release/spark/spark-1.2.2/ - copied from r8635, dev/spark/spark-1.2.2-rc1/ Removed: dev/spark/spark-1.2.2-rc1/ -

svn commit: r8635 - /dev/spark/spark-1.2.2-rc1/

2015-04-16 Thread pwendell
Author: pwendell Date: Thu Apr 16 22:58:43 2015 New Revision: 8635 Log: Adding Spark 1.2.2 RC1 Added: dev/spark/spark-1.2.2-rc1/ dev/spark/spark-1.2.2-rc1/spark-1.2.2-bin-cdh4.tgz (with props) dev/spark/spark-1.2.2-rc1/spark-1.2.2-bin-cdh4.tgz.asc (with props) dev/spark/spark-

Git Push Summary

2015-04-16 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.2.1-rc3 [deleted] b6eaf77d4 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-04-16 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.0-rc2 [deleted] 3af26870e - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-04-16 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.1-rc2 [deleted] 7c4473aa5 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-04-16 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.0-snapshot1 [deleted] d97bfc6f2 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-04-16 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.0-rc3 [deleted] 4aaf48d46 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-04-16 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.0-rc1 [deleted] f97b0d4a6 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-04-16 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.1-rc3 [deleted] 3e8391327 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-04-16 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.1-rc1 [deleted] 0dcb5d9f3 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-04-16 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.1 [created] 3e8391327 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-04-16 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.2.2 [created] 7531b50e4 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-04-16 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.2.2-rc1 [deleted] 7531b50e4 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-6855] [SPARKR] Set R includes to get the right collate order.

2015-04-16 Thread shivaram
Repository: spark Updated Branches: refs/heads/master ef3fb801a -> 55f553a97 [SPARK-6855] [SPARKR] Set R includes to get the right collate order. This prevents tools like devtools::document creating invalid collate orders Author: Shivaram Venkataraman Closes #5462 from shivaram/collate-orde

spark git commit: [SPARK-6934][Core] Use 'spark.akka.askTimeout' for the ask timeout

2015-04-16 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3ae37b93a -> ef3fb801a [SPARK-6934][Core] Use 'spark.akka.askTimeout' for the ask timeout Fixed my mistake in #4588 Author: zsxwing Closes #5529 from zsxwing/SPARK-6934 and squashes the following commits: 9890b2d [zsxwing] Use 'spark.ak

spark git commit: [SPARK-6694][SQL]SparkSQL CLI must be able to specify an option --database on the command line.

2015-04-16 Thread lian
Repository: spark Updated Branches: refs/heads/master de4fa6b6d -> 3ae37b93a [SPARK-6694][SQL]SparkSQL CLI must be able to specify an option --database on the command line. SparkSQL CLI has an option --database as follows. But, the option --database is ignored. ``` $ spark-sql --help : CLI o

spark git commit: [SPARK-4194] [core] Make SparkContext initialization exception-safe.

2015-04-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master 6179a9483 -> de4fa6b6d [SPARK-4194] [core] Make SparkContext initialization exception-safe. SparkContext has a very long constructor, where multiple things are initialized, multiple threads are spawned, and multiple opportunities for except

spark git commit: SPARK-4783 [CORE] System.exit() calls in SparkContext disrupt applications embedding Spark

2015-04-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master 837055059 -> 6179a9483 SPARK-4783 [CORE] System.exit() calls in SparkContext disrupt applications embedding Spark Avoid `System.exit(1)` in `TaskSchedulerImpl` and convert to `SparkException`; ensure scheduler calls `sc.stop()` even when

spark git commit: [Streaming][minor] Remove additional quote and unneeded imports

2015-04-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master 57cd1e86d -> 837055059 [Streaming][minor] Remove additional quote and unneeded imports Author: jerryshao Closes #5540 from jerryshao/minor-fix and squashes the following commits: ebaa646 [jerryshao] Minor fix Project: http://git-wip-us