spark git commit: [SPARK-19639][SPARKR][EXAMPLE] Add spark.svmLinear example and update vignettes

2017-02-17 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 15b144d2b -> 8b57ea4a1 [SPARK-19639][SPARKR][EXAMPLE] Add spark.svmLinear example and update vignettes ## What changes were proposed in this pull request? We recently add the spark.svmLinear API for SparkR. We need to add an example and u

spark git commit: [SPARK-19617][SS] Fix the race condition when starting and stopping a query quickly

2017-02-17 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 988f6d7ee -> 15b144d2b [SPARK-19617][SS] Fix the race condition when starting and stopping a query quickly ## What changes were proposed in this pull request? The streaming thread in StreamExecution uses the following ways to check if it

spark git commit: [SPARKR][EXAMPLES] update examples to stop spark session

2017-02-17 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master b40659838 -> 988f6d7ee [SPARKR][EXAMPLES] update examples to stop spark session ## What changes were proposed in this pull request? stop session at end of example ## How was this patch tested? manual Author: Felix Cheung Closes #16973

spark git commit: [SPARK-19517][SS] KafkaSource fails to initialize partition offsets

2017-02-17 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 6e3abed8f -> b083ec511 [SPARK-19517][SS] KafkaSource fails to initialize partition offsets ## What changes were proposed in this pull request? This patch fixes a bug in `KafkaSource` with the (de)serialization of the length of the JSO

spark git commit: [SPARK-18285][SPARKR] SparkR approxQuantile supports input multiple columns

2017-02-17 Thread yliang
Repository: spark Updated Branches: refs/heads/master 1a3f5f8c5 -> b40659838 [SPARK-18285][SPARKR] SparkR approxQuantile supports input multiple columns ## What changes were proposed in this pull request? SparkR ```approxQuantile``` supports input multiple columns. ## How was this patch teste

spark git commit: [SPARK-19517][SS] KafkaSource fails to initialize partition offsets

2017-02-17 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 4cc06f4eb -> 1a3f5f8c5 [SPARK-19517][SS] KafkaSource fails to initialize partition offsets ## What changes were proposed in this pull request? This patch fixes a bug in `KafkaSource` with the (de)serialization of the length of the JSON st

spark git commit: [SPARK-18986][CORE] ExternalAppendOnlyMap shouldn't fail when forced to spill before calling its iterator

2017-02-17 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 3d0c3af0a -> 4cc06f4eb [SPARK-18986][CORE] ExternalAppendOnlyMap shouldn't fail when forced to spill before calling its iterator ## What changes were proposed in this pull request? `ExternalAppendOnlyMap.forceSpill` now uses an assert to

spark git commit: [SPARK-19500] [SQL] Fix off-by-one bug in BytesToBytesMap

2017-02-17 Thread davies
Repository: spark Updated Branches: refs/heads/branch-2.0 29268125e -> 5c3e56fd2 [SPARK-19500] [SQL] Fix off-by-one bug in BytesToBytesMap ## What changes were proposed in this pull request? Radix sort require that half of array as free (as temporary space), so we use 0.5 as the scale factor

spark git commit: [SPARK-19500] [SQL] Fix off-by-one bug in BytesToBytesMap

2017-02-17 Thread davies
Repository: spark Updated Branches: refs/heads/branch-2.1 55958bcd1 -> 6e3abed8f [SPARK-19500] [SQL] Fix off-by-one bug in BytesToBytesMap ## What changes were proposed in this pull request? Radix sort require that half of array as free (as temporary space), so we use 0.5 as the scale factor

spark git commit: [SPARK-19500] [SQL] Fix off-by-one bug in BytesToBytesMap

2017-02-17 Thread davies
Repository: spark Updated Branches: refs/heads/master 021062af0 -> 3d0c3af0a [SPARK-19500] [SQL] Fix off-by-one bug in BytesToBytesMap ## What changes were proposed in this pull request? Radix sort require that half of array as free (as temporary space), so we use 0.5 as the scale factor to

spark git commit: [SPARK-19622][WEBUI] Fix a http error in a paged table when using a `Go` button to search.

2017-02-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 252dd05f0 -> 55958bcd1 [SPARK-19622][WEBUI] Fix a http error in a paged table when using a `Go` button to search. ## What changes were proposed in this pull request? The search function of paged table is not available because of we do

spark git commit: [SPARK-19622][WEBUI] Fix a http error in a paged table when using a `Go` button to search.

2017-02-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master 9d2d2204c -> 021062af0 [SPARK-19622][WEBUI] Fix a http error in a paged table when using a `Go` button to search. ## What changes were proposed in this pull request? The search function of paged table is not available because of we don't

spark git commit: [MINOR][PYTHON] Fix typo docstring: 'top' -> 'topic'

2017-02-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master ed338f727 -> 9d2d2204c [MINOR][PYTHON] Fix typo docstring: 'top' -> 'topic' ## What changes were proposed in this pull request? Fix typo in docstring. Author: Rolando Espinoza Closes #16967 from rolando/pyspark-doc-typo. Project: http

spark git commit: [BUILD] Close stale PRs

2017-02-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master 54d23599d -> ed338f727 [BUILD] Close stale PRs ## What changes were proposed in this pull request? This PR proposes to close stale PRs. What I mean by "stale" here includes that there are some review comments by reviewers but the author