spark git commit: [SPARK-18035][SQL] Introduce performant and memory efficient APIs to create ArrayBasedMapData

2016-10-22 Thread lixiao
Repository: spark Updated Branches: refs/heads/master bc167a2a5 -> eff4aed1a [SPARK-18035][SQL] Introduce performant and memory efficient APIs to create ArrayBasedMapData ## What changes were proposed in this pull request? Jira: https://issues.apache.org/jira/browse/SPARK-18035 In

spark git commit: [SPARK-17698][SQL] Join predicates should not contain filter clauses

2016-10-22 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 b959dab32 -> 3d5878751 [SPARK-17698][SQL] Join predicates should not contain filter clauses ## What changes were proposed in this pull request? This is a backport of https://github.com/apache/spark/pull/15272 to 2.0 branch. Jira :

spark git commit: [SPARK-928][CORE] Add support for Unsafe-based serializer in Kryo

2016-10-22 Thread rxin
Repository: spark Updated Branches: refs/heads/master 4f1dcd3dc -> bc167a2a5 [SPARK-928][CORE] Add support for Unsafe-based serializer in Kryo ## What changes were proposed in this pull request? Now since we have migrated to Kryo-3.0.0 in https://issues.apache.org/jira/browse/SPARK-11416, we

spark git commit: [SPARK-18051][SPARK CORE] fix bug of custom PartitionCoalescer causing serialization exception

2016-10-22 Thread rxin
Repository: spark Updated Branches: refs/heads/master 5fa9f8795 -> 4f1dcd3dc [SPARK-18051][SPARK CORE] fix bug of custom PartitionCoalescer causing serialization exception ## What changes were proposed in this pull request? add a require check in `CoalescedRDD` to make sure the passed in

spark git commit: [SPARK-17123][SQL] Use type-widened encoder for DataFrame rather than existing encoder to allow type-widening from set operations

2016-10-22 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 3eca283ac -> 5fa9f8795 [SPARK-17123][SQL] Use type-widened encoder for DataFrame rather than existing encoder to allow type-widening from set operations # What changes were proposed in this pull request? This PR fixes set operations in

spark git commit: [SPARK-17986][ML] SQLTransformer should remove temporary tables

2016-10-22 Thread yliang
Repository: spark Updated Branches: refs/heads/branch-2.0 a0c03c925 -> b959dab32 [SPARK-17986][ML] SQLTransformer should remove temporary tables ## What changes were proposed in this pull request? A call to the method `SQLTransformer.transform` previously would create a temporary table and

spark git commit: [SPARK-17986][ML] SQLTransformer should remove temporary tables

2016-10-22 Thread yliang
Repository: spark Updated Branches: refs/heads/master 01b26a064 -> ab3363e9f [SPARK-17986][ML] SQLTransformer should remove temporary tables ## What changes were proposed in this pull request? A call to the method `SQLTransformer.transform` previously would create a temporary table and

spark git commit: [SPARK-17898][DOCS] repositories needs username and password

2016-10-22 Thread srowen
Repository: spark Updated Branches: refs/heads/master 625fdddac -> 01b26a064 [SPARK-17898][DOCS] repositories needs username and password ## What changes were proposed in this pull request? Document `user:password` syntax as possible means of specifying credentials for password-protected

spark git commit: [SPARK-17944][DEPLOY] sbin/start-* scripts use of `hostname -f` fail with Solaris

2016-10-22 Thread srowen
Repository: spark Updated Branches: refs/heads/master 7178c5643 -> 625fdddac [SPARK-17944][DEPLOY] sbin/start-* scripts use of `hostname -f` fail with Solaris ## What changes were proposed in this pull request? Modify sbin/start-master.sh, sbin/start-mesos-dispatcher.sh and