[1/2] [SPARK-2190][SQL] Specialized ColumnType for Timestamp

2014-07-21 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master db56f2df1 -> cd273a238 http://git-wip-us.apache.org/repos/asf/spark/blob/cd273a23/sql/hive/src/test/resources/golden/timestamp_2-52-de3c42ab06c17ae895fd7deaf7bd9571 -- diff

git commit: SPARK-1707. Remove unnecessary 3 second sleep in YarnClusterScheduler

2014-07-21 Thread tgraves
Repository: spark Updated Branches: refs/heads/master cd273a238 -> f89cf65d7 SPARK-1707. Remove unnecessary 3 second sleep in YarnClusterScheduler Author: Sandy Ryza Closes #634 from sryza/sandy-spark-1707 and squashes the following commits: 2f6e358 [Sandy Ryza] Default min registered execu

git commit: Revert "[SPARK-1199][REPL] Remove VALId and use the original import style for defined classes."

2014-07-21 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 480669f2b -> e0cc3843d Revert "[SPARK-1199][REPL] Remove VALId and use the original import style for defined classes." This reverts commit 6e0b7e5308263bef60120debe05577868ebaeea9. Project: http://git-wip-us.apache.org/repos/asf/spar

git commit: [SPARK-2494] [PySpark] make hash of None consistant cross machines

2014-07-21 Thread matei
Repository: spark Updated Branches: refs/heads/master f89cf65d7 -> 872538c60 [SPARK-2494] [PySpark] make hash of None consistant cross machines In CPython, hash of None is different cross machines, it will cause wrong result during shuffle. This PR will fix this. Author: Davies Liu Closes

git commit: [SPARK-2494] [PySpark] make hash of None consistant cross machines

2014-07-21 Thread matei
Repository: spark Updated Branches: refs/heads/branch-1.0 e0cc3843d -> cdcd46717 [SPARK-2494] [PySpark] make hash of None consistant cross machines In CPython, hash of None is different cross machines, it will cause wrong result during shuffle. This PR will fix this. Author: Davies Liu Clo

git commit: [SPARK-2494] [PySpark] make hash of None consistant cross machines

2014-07-21 Thread matei
Repository: spark Updated Branches: refs/heads/branch-1.0-jdbc f562fe1a3 -> 1d4103a09 [SPARK-2494] [PySpark] make hash of None consistant cross machines In CPython, hash of None is different cross machines, it will cause wrong result during shuffle. This PR will fix this. Author: Davies Liu

git commit: [SPARK-2494] [PySpark] make hash of None consistant cross machines

2014-07-21 Thread matei
Repository: spark Updated Branches: refs/heads/branch-0.9 c93f4a0c0 -> ece411921 [SPARK-2494] [PySpark] make hash of None consistant cross machines In CPython, hash of None is different cross machines, it will cause wrong result during shuffle. This PR will fix this. Author: Davies Liu Clo

git commit: Fix flakey HiveQuerySuite test

2014-07-21 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 872538c60 -> abeacffb7 Fix flakey HiveQuerySuite test Result may not be returned in the expected order, so relax that constraint. Author: Aaron Davidson Closes #1514 from aarondav/flakey and squashes the following commits: e5af823 [Aaro

git commit: [SPARK-2434][MLlib]: Warning messages that point users to original MLlib implementations added to Examples

2014-07-21 Thread meng
Repository: spark Updated Branches: refs/heads/master abeacffb7 -> a4d60208e [SPARK-2434][MLlib]: Warning messages that point users to original MLlib implementations added to Examples [SPARK-2434][MLlib]: Warning messages that refer users to the original MLlib implementations of some popular

git commit: [SPARK-2561][SQL] Fix apply schema

2014-07-21 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master a4d60208e -> 511a73140 [SPARK-2561][SQL] Fix apply schema We need to use the analyzed attributes otherwise we end up with a tree that will never resolve. Author: Michael Armbrust Closes #1470 from marmbrus/fixApplySchema and squashes th

git commit: [SPARK-2561][SQL] Fix apply schema

2014-07-21 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.0 cdcd46717 -> 84bbfbd84 [SPARK-2561][SQL] Fix apply schema We need to use the analyzed attributes otherwise we end up with a tree that will never resolve. Author: Michael Armbrust Closes #1470 from marmbrus/fixApplySchema and squashe

git commit: [SPARK-2086] Improve output of toDebugString to make shuffle boundaries more clear

2014-07-21 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 511a73140 -> c3462c656 [SPARK-2086] Improve output of toDebugString to make shuffle boundaries more clear Changes RDD.toDebugString() to show hierarchy and shuffle transformations more clearly New output: ``` (3) FlatMappedValuesRDD[325

git commit: [SPARK-2470] PEP8 fixes to PySpark

2014-07-21 Thread rxin
Repository: spark Updated Branches: refs/heads/master c3462c656 -> 5d16d5bbf [SPARK-2470] PEP8 fixes to PySpark This pull request aims to resolve all outstanding PEP8 violations in PySpark. Author: Nicholas Chammas Author: nchammas Closes #1505 from nchammas/master and squashes the followi