spark git commit: [SPARK-20945] Fix TID key not found in TaskSchedulerImpl

2017-06-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master dec9aa3b3 -> 2d39711b0 [SPARK-20945] Fix TID key not found in TaskSchedulerImpl ## What changes were proposed in this pull request? This pull request fix the TaskScheulerImpl bug in some condition. Detail see: https://issues.apache.org/jir

spark git commit: [SPARK-20930][ML] Destroy broadcasted centers after computing cost in KMeans

2017-06-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master 2d39711b0 -> 98b5ccd32 [SPARK-20930][ML] Destroy broadcasted centers after computing cost in KMeans ## What changes were proposed in this pull request? Destroy broadcasted centers after computing cost ## How was this patch tested? existing

spark git commit: [SPARK-19762][ML] Hierarchy for consolidating ML aggregator/loss code

2017-06-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master 98b5ccd32 -> 1665b5f72 [SPARK-19762][ML] Hierarchy for consolidating ML aggregator/loss code ## What changes were proposed in this pull request? JIRA: [SPARK-19762](https://issues.apache.org/jira/browse/SPARK-19762) The larger changes in

spark git commit: [SPARK-20981][SPARKSUBMIT] Add new configuration spark.jars.repositories as equivalence of --repositories

2017-06-05 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 1665b5f72 -> 06c054411 [SPARK-20981][SPARKSUBMIT] Add new configuration spark.jars.repositories as equivalence of --repositories ## What changes were proposed in this pull request? In our use case of launching Spark applications via REST

spark git commit: [SPARK-20926][SQL] Removing exposures to guava library caused by directly accessing SessionCatalog's tableRelationCache

2017-06-05 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.2 acd4481ec -> 1388fdd70 [SPARK-20926][SQL] Removing exposures to guava library caused by directly accessing SessionCatalog's tableRelationCache There could be test failures because DataStorageStrategy, HiveMetastoreCatalog and also Hi

spark git commit: [SPARK-20957][SS][TESTS] Fix o.a.s.sql.streaming.StreamingQueryManagerSuite listing

2017-06-05 Thread tdas
Repository: spark Updated Branches: refs/heads/master 06c054411 -> bc537e40a [SPARK-20957][SS][TESTS] Fix o.a.s.sql.streaming.StreamingQueryManagerSuite listing ## What changes were proposed in this pull request? When stopping StreamingQuery, StreamExecution will set `streamDeathCause` then

spark git commit: [SPARK-20957][SS][TESTS] Fix o.a.s.sql.streaming.StreamingQueryManagerSuite listing

2017-06-05 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.2 1388fdd70 -> 421d8ecb8 [SPARK-20957][SS][TESTS] Fix o.a.s.sql.streaming.StreamingQueryManagerSuite listing ## What changes were proposed in this pull request? When stopping StreamingQuery, StreamExecution will set `streamDeathCause` t

spark git commit: [SPARK-20991][SQL] BROADCAST_TIMEOUT conf should be a TimeoutConf

2017-06-05 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master bc537e40a -> 88a23d3de [SPARK-20991][SQL] BROADCAST_TIMEOUT conf should be a TimeoutConf ## What changes were proposed in this pull request? The construction of BROADCAST_TIMEOUT conf should take the TimeUnit argument as a TimeoutConf. A