spark git commit: [SPARK-CORE][TEST][MINOR] Fix the wrong comment in test

2016-10-27 Thread srowen
Repository: spark Updated Branches: refs/heads/master 44c8bfda7 -> 701a9d361 [SPARK-CORE][TEST][MINOR] Fix the wrong comment in test ## What changes were proposed in this pull request? While learning core scheduler code, I found two lines of wrong comments. This PR simply corrects the commen

spark git commit: [SPARK-17813][SQL][KAFKA] Maximum data per trigger

2016-10-27 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 1a4be51d6 -> 6fb1f735f [SPARK-17813][SQL][KAFKA] Maximum data per trigger ## What changes were proposed in this pull request? maxOffsetsPerTrigger option for rate limiting, proportionally based on volume of different topicpartitions.

spark git commit: [SPARK-17813][SQL][KAFKA] Maximum data per trigger

2016-10-27 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 701a9d361 -> 104232580 [SPARK-17813][SQL][KAFKA] Maximum data per trigger ## What changes were proposed in this pull request? maxOffsetsPerTrigger option for rate limiting, proportionally based on volume of different topicpartitions. ##

spark git commit: [SPARK-17219][ML] enhanced NaN value handling in Bucketizer

2016-10-27 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 104232580 -> 0b076d4cb [SPARK-17219][ML] enhanced NaN value handling in Bucketizer ## What changes were proposed in this pull request? This PR is an enhancement of PR with commit ID:57dc326bd00cf0a49da971e9c573c48ae28acaa2. NaN is a speci

spark git commit: [SPARK-16963][SQL] Fix test "StreamExecution metadata garbage collection"

2016-10-27 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 0b076d4cb -> 79fd0cc05 [SPARK-16963][SQL] Fix test "StreamExecution metadata garbage collection" ## What changes were proposed in this pull request? A follow up PR for #14553 to fix the flaky test. It's flaky because the file list API doe

spark git commit: [SPARK-16963][SQL] Fix test "StreamExecution metadata garbage collection"

2016-10-27 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 6fb1f735f -> 578e40e3e [SPARK-16963][SQL] Fix test "StreamExecution metadata garbage collection" ## What changes were proposed in this pull request? A follow up PR for #14553 to fix the flaky test. It's flaky because the file list API

[2/2] spark git commit: [SPARK-17970][SQL] store partition spec in metastore for data source table

2016-10-27 Thread yhuai
[SPARK-17970][SQL] store partition spec in metastore for data source table ## What changes were proposed in this pull request? We should follow hive table and also store partition spec in metastore for data source table. This brings 2 benefits: 1. It's more flexible to manage the table data fil

[1/2] spark git commit: [SPARK-17970][SQL] store partition spec in metastore for data source table

2016-10-27 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 79fd0cc05 -> ccb115430 http://git-wip-us.apache.org/repos/asf/spark/blob/ccb11543/sql/hive/src/test/scala/org/apache/spark/sql/hive/PartitionProviderCompatibilitySuite.scala ---

spark git commit: [SPARK-18121][SQL] Unable to query global temp views when hive support is enabled

2016-10-27 Thread wenchen
Repository: spark Updated Branches: refs/heads/master ccb115430 -> ab5f938bc [SPARK-18121][SQL] Unable to query global temp views when hive support is enabled ## What changes were proposed in this pull request? Issue: Querying on a global temp view throws Table or view not found exception.