spark git commit: [SPARK-18895][TESTS] Fix resource-closing-related and path-related test failures in identified ones on Windows

2016-12-16 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 4faa8a3ec -> 2bc1c9515 [SPARK-18895][TESTS] Fix resource-closing-related and path-related test failures in identified ones on Windows ## What changes were proposed in this pull request? There are several tests failing due to

spark git commit: [SPARK-18904][SS][TESTS] Merge two FileStreamSourceSuite files

2016-12-16 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 df589be54 -> d2a131a84 [SPARK-18904][SS][TESTS] Merge two FileStreamSourceSuite files ## What changes were proposed in this pull request? Merge two FileStreamSourceSuite files into one file. ## How was this patch tested? Jenkins

spark git commit: [SPARK-18904][SS][TESTS] Merge two FileStreamSourceSuite files

2016-12-16 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 295db8259 -> 4faa8a3ec [SPARK-18904][SS][TESTS] Merge two FileStreamSourceSuite files ## What changes were proposed in this pull request? Merge two FileStreamSourceSuite files into one file. ## How was this patch tested? Jenkins

spark git commit: [SPARK-17769][CORE][SCHEDULER] Some FetchFailure refactoring

2016-12-16 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 1169db44b -> 295db8259 [SPARK-17769][CORE][SCHEDULER] Some FetchFailure refactoring ## What changes were proposed in this pull request? Readability rewrites. Changed order of `failedStage.failedOnFetchAndShouldAbort(task.stageAttemptId)`

spark git commit: [SPARK-18897][SPARKR] Fix SparkR SQL Test to drop test table

2016-12-16 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 d36ed9e1d -> 1935bf446 [SPARK-18897][SPARKR] Fix SparkR SQL Test to drop test table ## What changes were proposed in this pull request? SparkR tests, `R/run-tests.sh`, succeeds only once because `test_sparkSQL.R` does not clean up

spark git commit: [SPARK-18897][SPARKR] Fix SparkR SQL Test to drop test table

2016-12-16 Thread shivaram
Repository: spark Updated Branches: refs/heads/master ed84cd068 -> 1169db44b [SPARK-18897][SPARKR] Fix SparkR SQL Test to drop test table ## What changes were proposed in this pull request? SparkR tests, `R/run-tests.sh`, succeeds only once because `test_sparkSQL.R` does not clean up the

spark git commit: [MINOR][BUILD] Fix lint-check failures and javadoc8 break

2016-12-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master f7a574a6c -> ed84cd068 [MINOR][BUILD] Fix lint-check failures and javadoc8 break ## What changes were proposed in this pull request? This PR proposes to fix lint-check failures and javadoc8 break. Few errors were introduced as below:

spark git commit: [SPARK-18708][CORE] Improvement/improve docs in spark context file

2016-12-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master 836c95b10 -> f7a574a6c [SPARK-18708][CORE] Improvement/improve docs in spark context file ## What changes were proposed in this pull request? SparkContext.scala was created a long time ago and contains several types of Scaladocs/Javadocs

spark git commit: [SPARK-18723][DOC] Expanded programming guide information on wholeTex…

2016-12-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master dc2a4d4ad -> 836c95b10 [SPARK-18723][DOC] Expanded programming guide information on wholeTex… ## What changes were proposed in this pull request? Add additional information to wholeTextFiles in the Programming Guide. Also explain

spark git commit: [SPARK-18108][SQL] Fix a schema inconsistent bug that makes a parquet reader fail to read data

2016-12-16 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.1 a73201daf -> d8ef0be83 [SPARK-18108][SQL] Fix a schema inconsistent bug that makes a parquet reader fail to read data ## What changes were proposed in this pull request? A vectorized parquet reader fails to read column data if data

spark git commit: [SPARK-18108][SQL] Fix a schema inconsistent bug that makes a parquet reader fail to read data

2016-12-16 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 53ab8fb34 -> dc2a4d4ad [SPARK-18108][SQL] Fix a schema inconsistent bug that makes a parquet reader fail to read data ## What changes were proposed in this pull request? A vectorized parquet reader fails to read column data if data schema

spark git commit: [SPARK-18742][CORE] Clarify that user-defined BroadcastFactory is not supported

2016-12-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master d7f3058e1 -> 53ab8fb34 [SPARK-18742][CORE] Clarify that user-defined BroadcastFactory is not supported ## What changes were proposed in this pull request? After SPARK-12588 Remove HTTPBroadcast [1], the one and only implementation of

spark git commit: [SPARK-18850][SS] Make StreamExecution and progress classes serializable

2016-12-16 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.1 d8548c8a7 -> a73201daf [SPARK-18850][SS] Make StreamExecution and progress classes serializable ## What changes were proposed in this pull request? This PR adds StreamingQueryWrapper to make StreamExecution and progress classes

spark git commit: [SPARK-18850][SS] Make StreamExecution and progress classes serializable

2016-12-16 Thread tdas
Repository: spark Updated Branches: refs/heads/master 78062b852 -> d7f3058e1 [SPARK-18850][SS] Make StreamExecution and progress classes serializable ## What changes were proposed in this pull request? This PR adds StreamingQueryWrapper to make StreamExecution and progress classes