spark git commit: [SPARK-6611][SQL] Add support for INTEGER as synonym of INT.

2015-04-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 198cf2a3f - 5f7b7cdab [SPARK-6611][SQL] Add support for INTEGER as synonym of INT. https://issues.apache.org/jira/browse/SPARK-6611 Author: Santiago M. Mola santiago.m...@sap.com Closes #5271 from smola/features/integer-parse and

spark git commit: [SPARK-6858][SQL] Register Java HashMap for SparkSqlSerializer

2015-04-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 3ceb810aa - 198cf2a3f [SPARK-6858][SQL] Register Java HashMap for SparkSqlSerializer Since now kyro serializer is used for `GeneralHashedRelation` whether kyro is enabled or not, it is better to register Java `HashMap` in

spark git commit: [hotfix] [build] Make sure JAVA_HOME is set for tests.

2015-04-11 Thread srowen
Repository: spark Updated Branches: refs/heads/master 95a07591b - 694aef0d7 [hotfix] [build] Make sure JAVA_HOME is set for tests. This is needed at least for YARN integration tests, since `$JAVA_HOME` is used to launch the executors. Author: Marcelo Vanzin van...@cloudera.com Closes #5441

spark git commit: [SPARK-6835] [SQL] Fix bug of Hive UDTF in Lateral View (ClassNotFound)

2015-04-11 Thread lian
Repository: spark Updated Branches: refs/heads/master 694aef0d7 - 3ceb810aa [SPARK-6835] [SQL] Fix bug of Hive UDTF in Lateral View (ClassNotFound) ```SQL select key, v from src lateral view stack(3, 1+1, 2+2, 3) d as v; ``` Will cause exception ``` java.lang.ClassNotFoundException: stack at

spark git commit: [HOTFIX] Add explicit return types to fix lint errors

2015-04-11 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 5c2844c51 - dea5dacc5 [HOTFIX] Add explicit return types to fix lint errors Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/dea5dacc Tree:

spark git commit: SPARK-6710 GraphX Fixed Wrong initial bias in GraphX SVDPlusPlus

2015-04-11 Thread rxin
Repository: spark Updated Branches: refs/heads/master dea5dacc5 - 1205f7ea6 SPARK-6710 GraphX Fixed Wrong initial bias in GraphX SVDPlusPlus Author: Michael Malak michaelma...@yahoo.com Closes #5464 from michaelmalak/master and squashes the following commits: 9d942ba [Michael Malak]

spark git commit: MAINTENANCE: Automated closing of pull requests.

2015-04-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 1205f7ea6 - 0cc8fcb4c MAINTENANCE: Automated closing of pull requests. This commit exists to close the following pull requests on Github: Closes #4994 (close requested by 'marmbrus') Closes #4995 (close requested by 'marmbrus') Closes

spark git commit: [SPARK-6677] [SQL] [PySpark] fix cached classes

2015-04-11 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.3 ea13948b9 - 8d4176132 [SPARK-6677] [SQL] [PySpark] fix cached classes It's possible to have two DataType object with same id (memory address) at different time, we should check the cached classes to verify that it's generated by

spark git commit: [SPARK-6677] [SQL] [PySpark] fix cached classes

2015-04-11 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 0cc8fcb4c - 5d8f7b9e8 [SPARK-6677] [SQL] [PySpark] fix cached classes It's possible to have two DataType object with same id (memory address) at different time, we should check the cached classes to verify that it's generated by given

spark git commit: [SPARK-6863] Fix formatting on SQL programming guide.

2015-04-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.3 ffc821e20 - ea13948b9 [SPARK-6863] Fix formatting on SQL programming guide. https://issues.apache.org/jira/browse/SPARK-6863 Author: Santiago M. Mola santiago.m...@sap.com Closes #5472 from smola/fix/sql-docs and squashes the

spark git commit: [SPARK-6863] Fix formatting on SQL programming guide.

2015-04-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 5f7b7cdab - 6437e7cc3 [SPARK-6863] Fix formatting on SQL programming guide. https://issues.apache.org/jira/browse/SPARK-6863 Author: Santiago M. Mola santiago.m...@sap.com Closes #5472 from smola/fix/sql-docs and squashes the following

spark git commit: [Minor][SQL] Fix typo in sql

2015-04-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 6437e7cc3 - 7dbd37160 [Minor][SQL] Fix typo in sql In this PR, analyser is changed to analyzer to keep a consistent naming. Some other typos are also fixed. Author: Guancheng (G.C.) Chen chenguanch...@gmail.com Closes #5474 from

spark git commit: [SPARK-6199] [SQL] Support CTE in HiveContext and SQLContext

2015-04-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 7dbd37160 - 2f5358873 [SPARK-6199] [SQL] Support CTE in HiveContext and SQLContext Author: haiyang huhaiy...@huawei.com Closes #4929 from haiyangsea/cte and squashes the following commits: 220b67d [haiyang] add golden files for cte test

spark git commit: [Spark-5068][SQL]Fix bug query data when path doesn't exist for HiveContext

2015-04-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 2f5358873 - 1f39a6111 [Spark-5068][SQL]Fix bug query data when path doesn't exist for HiveContext This PR follow up PR #3907 #3891 #4356. According to marmbrus liancheng 's comments, I try to use fs.globStatus to retrieve all

spark git commit: [SPARK-6179][SQL] Add token for SHOW PRINCIPALS role_name and SHOW TRANSACTIONS and SHOW COMPACTIONS

2015-04-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 1f39a6111 - 48cc84002 [SPARK-6179][SQL] Add token for SHOW PRINCIPALS role_name and SHOW TRANSACTIONS and SHOW COMPACTIONS [SHOW PRINCIPALS role_name] Lists all roles and users who belong to this role. Only the admin role has privilege

spark git commit: [SQL] Handle special characters in the authority of a Path's URI.

2015-04-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 352a5da42 - d2383fb5f [SQL] Handle special characters in the authority of a Path's URI. Author: Yin Huai yh...@databricks.com Closes #5381 from yhuai/parquetPath2 and squashes the following commits: fe296b4 [Yin Huai] Create new Path to

spark git commit: [SPARK-6367][SQL] Use the proper data type for those expressions that are hijacking existing data types.

2015-04-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master d2383fb5f - 6d4e854ff [SPARK-6367][SQL] Use the proper data type for those expressions that are hijacking existing data types. This PR adds internal UDTs for expressions that are hijacking existing data types. The following UDTs are

spark git commit: [SQL][minor] move `resolveGetField` into a object

2015-04-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 6d4e854ff - 5c2844c51 [SQL][minor] move `resolveGetField` into a object The method `resolveGetField` isn't belong to `LogicalPlan` logically and didn't access any members of it. Author: Wenchen Fan cloud0...@outlook.com Closes #5435