spark git commit: [SPARK-18396][HISTORYSERVER] Duration" column makes search result confused, maybe we should make it unsearchable

2016-11-14 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 d554c02f4 -> 518dc1e1e [SPARK-18396][HISTORYSERVER] Duration" column makes search result confused, maybe we should make it unsearchable ## What changes were proposed in this pull request? When we search data in History Server, it will

spark git commit: [SPARK-18427][DOC] Update docs of mllib.KMeans

2016-11-15 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 a0125fd68 -> 0762c0ceb [SPARK-18427][DOC] Update docs of mllib.KMeans ## What changes were proposed in this pull request? 1,Remove `runs` from docs of mllib.KMeans 2,Add notes for `k` according to comments in sources ## How was this pat

spark git commit: [SPARK-18427][DOC] Update docs of mllib.KMeans

2016-11-15 Thread srowen
Repository: spark Updated Branches: refs/heads/master d89bfc923 -> 33be4da53 [SPARK-18427][DOC] Update docs of mllib.KMeans ## What changes were proposed in this pull request? 1,Remove `runs` from docs of mllib.KMeans 2,Add notes for `k` according to comments in sources ## How was this patch t

[1/3] spark-website git commit: Use site.baseurl, not site.url, to work with Jekyll 3.3. Require Jekyll 3.3. Again commit HTML consistent with Jekyll 3.3 output. Fix date problem with news posts that

2016-11-15 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 4e10a1ac1 -> d82e37220 http://git-wip-us.apache.org/repos/asf/spark-website/blob/d82e3722/site/releases/spark-release-1-1-0.html -- diff --git a/site/releases/spar

[3/3] spark-website git commit: Use site.baseurl, not site.url, to work with Jekyll 3.3. Require Jekyll 3.3. Again commit HTML consistent with Jekyll 3.3 output. Fix date problem with news posts that

2016-11-15 Thread srowen
Use site.baseurl, not site.url, to work with Jekyll 3.3. Require Jekyll 3.3. Again commit HTML consistent with Jekyll 3.3 output. Fix date problem with news posts that set date: by removing date:. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apach

[2/3] spark-website git commit: Use site.baseurl, not site.url, to work with Jekyll 3.3. Require Jekyll 3.3. Again commit HTML consistent with Jekyll 3.3 output. Fix date problem with news posts that

2016-11-15 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/d82e3722/news/_posts/2015-10-02-spark-1-5-1-released.md -- diff --git a/news/_posts/2015-10-02-spark-1-5-1-released.md b/news/_posts/2015-10-02-spark-1-5-1-released.md inde

[2/2] spark-website git commit: Fix broken link to bootstrap JS

2016-11-15 Thread srowen
Fix broken link to bootstrap JS Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/c693f2a7 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/c693f2a7 Diff: http://git-wip-us.apache.org/repos/asf/spa

[1/2] spark-website git commit: Fix broken link to bootstrap JS

2016-11-15 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site d82e37220 -> c693f2a7d http://git-wip-us.apache.org/repos/asf/spark-website/blob/c693f2a7/site/releases/spark-release-1-5-2.html -- diff --git a/site/releases/spar

spark git commit: [DOC][MINOR] Kafka doc: breakup into lines

2016-11-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master 74f5c2176 -> 3e01f1282 [DOC][MINOR] Kafka doc: breakup into lines ## Before ![before](https://cloud.githubusercontent.com/assets/15843379/20340231/99b039fe-ac1b-11e6-9ba9-b44582427459.png) ## After ![after](https://cloud.githubuserconten

spark git commit: [DOC][MINOR] Kafka doc: breakup into lines

2016-11-16 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 b18c5a9b9 -> 4567db9da [DOC][MINOR] Kafka doc: breakup into lines ## Before ![before](https://cloud.githubusercontent.com/assets/15843379/20340231/99b039fe-ac1b-11e6-9ba9-b44582427459.png) ## After ![after](https://cloud.githubuserco

spark git commit: [SPARK-18400][STREAMING] NPE when resharding Kinesis Stream

2016-11-16 Thread srowen
his patch tested? Existing tests Author: Sean Owen Closes #15882 from srowen/SPARK-18400. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/43a26899 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/43a26899 Diff: http://

spark git commit: [SPARK-18400][STREAMING] NPE when resharding Kinesis Stream

2016-11-16 Thread srowen
his patch tested? Existing tests Author: Sean Owen Closes #15882 from srowen/SPARK-18400. (cherry picked from commit 43a26899e5dd2364297eaf8985bd68367e4735a7) Signed-off-by: Sean Owen Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/sp

spark git commit: [SPARK-18400][STREAMING] NPE when resharding Kinesis Stream

2016-11-16 Thread srowen
his patch tested? Existing tests Author: Sean Owen Closes #15882 from srowen/SPARK-18400. (cherry picked from commit 43a26899e5dd2364297eaf8985bd68367e4735a7) Signed-off-by: Sean Owen Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/sp

spark git commit: [SPARK-18410][STREAMING] Add structured kafka example

2016-11-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master 43a26899e -> e6145772e [SPARK-18410][STREAMING] Add structured kafka example ## What changes were proposed in this pull request? This PR provides structured kafka wordcount examples ## How was this patch tested? Author: uncleGen Closes

spark git commit: [SPARK-18410][STREAMING] Add structured kafka example

2016-11-16 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 a94659cee -> 6b2301b89 [SPARK-18410][STREAMING] Add structured kafka example ## What changes were proposed in this pull request? This PR provides structured kafka wordcount examples ## How was this patch tested? Author: uncleGen Cl

spark git commit: [MINOR][DOC] Fix typos in the 'configuration', 'monitoring' and 'sql-programming-guide' documentation

2016-11-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master e6145772e -> 241e04bc0 [MINOR][DOC] Fix typos in the 'configuration', 'monitoring' and 'sql-programming-guide' documentation ## What changes were proposed in this pull request? Fix typos in the 'configuration', 'monitoring' and 'sql-progr

spark git commit: [MINOR][DOC] Fix typos in the 'configuration', 'monitoring' and 'sql-programming-guide' documentation

2016-11-16 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 6b2301b89 -> 820847008 [MINOR][DOC] Fix typos in the 'configuration', 'monitoring' and 'sql-programming-guide' documentation ## What changes were proposed in this pull request? Fix typos in the 'configuration', 'monitoring' and 'sql-p

spark git commit: [SPARK-18446][ML][DOCS] Add links to API docs for ML algos

2016-11-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master c68f1a38a -> a75e3fe92 [SPARK-18446][ML][DOCS] Add links to API docs for ML algos ## What changes were proposed in this pull request? Add links to API docs for ML algos ## How was this patch tested? Manual checking for the API links Author

spark git commit: [SPARK-18446][ML][DOCS] Add links to API docs for ML algos

2016-11-16 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 6b6eb4e52 -> 416bc3dd3 [SPARK-18446][ML][DOCS] Add links to API docs for ML algos ## What changes were proposed in this pull request? Add links to API docs for ML algos ## How was this patch tested? Manual checking for the API links Au

spark git commit: [SPARK-18420][BUILD] Fix the errors caused by lint check in Java

2016-11-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master a75e3fe92 -> 7569cf6cb [SPARK-18420][BUILD] Fix the errors caused by lint check in Java ## What changes were proposed in this pull request? Small fix, fix the errors caused by lint check in Java - Clear unused objects and `UnusedImports`.

spark git commit: [SPARK-18420][BUILD] Fix the errors caused by lint check in Java

2016-11-16 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 416bc3dd3 -> b0ae87123 [SPARK-18420][BUILD] Fix the errors caused by lint check in Java Small fix, fix the errors caused by lint check in Java - Clear unused objects and `UnusedImports`. - Add comments around the method `finalize` of `

spark git commit: [YARN][DOC] Remove non-Yarn specific configurations from running-on-yarn.md

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 014fceee0 -> 2ee4fc889 [YARN][DOC] Remove non-Yarn specific configurations from running-on-yarn.md ## What changes were proposed in this pull request? Remove `spark.driver.memory`, `spark.executor.memory`, `spark.driver.cores`, and `

spark git commit: [YARN][DOC] Remove non-Yarn specific configurations from running-on-yarn.md

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master 07b3f045c -> a3cac7bd8 [YARN][DOC] Remove non-Yarn specific configurations from running-on-yarn.md ## What changes were proposed in this pull request? Remove `spark.driver.memory`, `spark.executor.memory`, `spark.driver.cores`, and `spar

spark git commit: [SPARK-18365][DOCS] Improve Sample Method Documentation

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master a3cac7bd8 -> 49b6f456a [SPARK-18365][DOCS] Improve Sample Method Documentation ## What changes were proposed in this pull request? I found the documentation for the sample method to be confusing, this adds more clarification across all la

spark git commit: [SPARK-18365][DOCS] Improve Sample Method Documentation

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 2ee4fc889 -> 4fcecb4cf [SPARK-18365][DOCS] Improve Sample Method Documentation ## What changes were proposed in this pull request? I found the documentation for the sample method to be confusing, this adds more clarification across al

spark git commit: [SPARK-17462][MLLIB]use VersionUtils to parse Spark version strings

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master 49b6f456a -> de77c6775 [SPARK-17462][MLLIB]use VersionUtils to parse Spark version strings ## What changes were proposed in this pull request? Several places in MLlib use custom regexes or other approaches to parse Spark versions. Those s

spark git commit: [SPARK-17462][MLLIB]use VersionUtils to parse Spark version strings

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 4fcecb4cf -> 42777b1b3 [SPARK-17462][MLLIB]use VersionUtils to parse Spark version strings ## What changes were proposed in this pull request? Several places in MLlib use custom regexes or other approaches to parse Spark versions. Tho

spark git commit: [SPARK-18480][DOCS] Fix wrong links for ML guide docs

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master de77c6775 -> cdaf4ce9f [SPARK-18480][DOCS] Fix wrong links for ML guide docs ## What changes were proposed in this pull request? 1, There are two `[Graph.partitionBy]` in `graphx-programming-guide.md`, the first one had no effert. 2, `Data

spark git commit: [SPARK-18480][DOCS] Fix wrong links for ML guide docs

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 42777b1b3 -> 536a21593 [SPARK-18480][DOCS] Fix wrong links for ML guide docs ## What changes were proposed in this pull request? 1, There are two `[Graph.partitionBy]` in `graphx-programming-guide.md`, the first one had no effert. 2, `

spark git commit: [SPARK-18490][SQL] duplication nodename extrainfo for ShuffleExchange

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master cdaf4ce9f -> b0aa1aa1a [SPARK-18490][SQL] duplication nodename extrainfo for ShuffleExchange ## What changes were proposed in this pull request? In ShuffleExchange, the nodename's extraInfo are the same when exchangeCoordinator.isEstim

spark git commit: [SPARK-18490][SQL] duplication nodename extrainfo for ShuffleExchange

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 536a21593 -> 978798880 [SPARK-18490][SQL] duplication nodename extrainfo for ShuffleExchange ## What changes were proposed in this pull request? In ShuffleExchange, the nodename's extraInfo are the same when exchangeCoordinator.isE

spark-website git commit: Expand guidance on SO and mailing lists, per discussion

2016-11-18 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 8781cd3c4 -> 80a543b56 Expand guidance on SO and mailing lists, per discussion Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/80a543b5 Tree:

spark git commit: [SPARK-18422][CORE] Fix wholeTextFiles test to pass on Windows in JavaAPISuite

2016-11-18 Thread srowen
Repository: spark Updated Branches: refs/heads/master 795e9fc92 -> 40d59ff5e [SPARK-18422][CORE] Fix wholeTextFiles test to pass on Windows in JavaAPISuite ## What changes were proposed in this pull request? This PR fixes the test `wholeTextFiles` in `JavaAPISuite.java`. This is failed due t

spark git commit: [SPARK-18422][CORE] Fix wholeTextFiles test to pass on Windows in JavaAPISuite

2016-11-18 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 ec622eb7e -> 6717981e4 [SPARK-18422][CORE] Fix wholeTextFiles test to pass on Windows in JavaAPISuite ## What changes were proposed in this pull request? This PR fixes the test `wholeTextFiles` in `JavaAPISuite.java`. This is failed d

spark git commit: [SPARK-18448][CORE] SparkSession should implement java.lang.AutoCloseable like JavaSparkContext

2016-11-19 Thread srowen
his makes it usable in Java in try-with-resources, as suggested by ash211 (`Closeable` extends `AutoCloseable` BTW) ## How was this patch tested? Existing tests Author: Sean Owen Closes #15932 from srowen/SPARK-18448. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: h

spark git commit: [SPARK-18448][CORE] SparkSession should implement java.lang.AutoCloseable like JavaSparkContext

2016-11-19 Thread srowen
top()`. This makes it usable in Java in try-with-resources, as suggested by ash211 (`Closeable` extends `AutoCloseable` BTW) ## How was this patch tested? Existing tests Author: Sean Owen Closes #15932 from srowen/SPARK-18448. (cherry picked from commit db9fb9baacbf8640dd37a507b7450db727c7e

[2/3] spark git commit: [SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that`/`'''Note:'''` across Scala/Java API documentation

2016-11-19 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/d5b1d5fc/external/kafka-0-8/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala -- diff --git a/external/kafka-0-8/src/main/scala/org/apache/spark/streaming/kafka/Kafk

[3/3] spark git commit: [SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that`/`'''Note:'''` across Scala/Java API documentation

2016-11-19 Thread srowen
[SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that`/`'''Note:'''` across Scala/Java API documentation ## What changes were proposed in this pull request? It seems in Scala/Java, - `Note:` - `NOTE:` - `Note that` - `'''Note:'''` - `note` This PR proposes to fix those to

[1/3] spark git commit: [SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that`/`'''Note:'''` across Scala/Java API documentation

2016-11-19 Thread srowen
Repository: spark Updated Branches: refs/heads/master db9fb9baa -> d5b1d5fc8 http://git-wip-us.apache.org/repos/asf/spark/blob/d5b1d5fc/python/pyspark/rdd.py -- diff --git a/python/pyspark/rdd.py b/python/pyspark/rdd.py index a

[2/3] spark git commit: [SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that`/`'''Note:'''` across Scala/Java API documentation

2016-11-19 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/4b396a65/external/kafka-0-8/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala -- diff --git a/external/kafka-0-8/src/main/scala/org/apache/spark/streaming/kafka/Kafk

[1/3] spark git commit: [SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that`/`'''Note:'''` across Scala/Java API documentation

2016-11-19 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 693401be2 -> 4b396a654 http://git-wip-us.apache.org/repos/asf/spark/blob/4b396a65/python/pyspark/rdd.py -- diff --git a/python/pyspark/rdd.py b/python/pyspark/rdd.py ind

[3/3] spark git commit: [SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that`/`'''Note:'''` across Scala/Java API documentation

2016-11-19 Thread srowen
[SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that`/`'''Note:'''` across Scala/Java API documentation It seems in Scala/Java, - `Note:` - `NOTE:` - `Note that` - `'''Note:'''` - `note` This PR proposes to fix those to `note` to be consistent. **Before** - Scala ![201

spark git commit: [SPARK-18353][CORE] spark.rpc.askTimeout defalut value is not 120s

2016-11-19 Thread srowen
out spark.rpc.askTimeout default ## How was this patch tested? Existing tests Author: Sean Owen Closes #15833 from srowen/SPARK-18353. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8b1e1088 Tree: http://git-wip-us.apache.org/repos/asf/sp

spark git commit: [SPARK-18353][CORE] spark.rpc.askTimeout defalut value is not 120s

2016-11-19 Thread srowen
out spark.rpc.askTimeout default ## How was this patch tested? Existing tests Author: Sean Owen Closes #15833 from srowen/SPARK-18353. (cherry picked from commit 8b1e1088eb274fb15260cd5d6d9508d42837a4d6) Signed-off-by: Sean Owen Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://

spark-website git commit: (Again again) make web site HTML consistent with latest jekyll output

2016-11-19 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 80a543b56 -> 59fca9b5c (Again again) make web site HTML consistent with latest jekyll output Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/5

spark git commit: [SPARK-18448][CORE] Fix @since 2.1.0 on new SparkSession.close() method

2016-11-19 Thread srowen
com/apache/spark/pull/15932 because it was back-ported to 2.1 instead of just master as originally planned. Author: Sean Owen Closes #15938 from srowen/SPARK-18448.2. (cherry picked from commit ded5fefb6f5c0a97bf3d7fa1c0494dc434b6ee40) Signed-off-by: Sean Owen Project: http://git-wip-us.apache.

spark git commit: [SPARK-18448][CORE] Fix @since 2.1.0 on new SparkSession.close() method

2016-11-19 Thread srowen
che/spark/pull/15932 because it was back-ported to 2.1 instead of just master as originally planned. Author: Sean Owen Closes #15938 from srowen/SPARK-18448.2. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ded5fefb Tree: h

spark-website git commit: remove broken links from the documentation site

2016-11-19 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 59fca9b5c -> d85c53c4d remove broken links from the documentation site Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/d85c53c4 Tree: http://g

spark git commit: [SPARK-3359][BUILD][DOCS] Print examples and disable group and tparam tags in javadoc

2016-11-20 Thread srowen
Repository: spark Updated Branches: refs/heads/master 7ca7a6352 -> c528812ce [SPARK-3359][BUILD][DOCS] Print examples and disable group and tparam tags in javadoc ## What changes were proposed in this pull request? This PR proposes/fixes two things. - Remove many errors to generate javadoc

spark git commit: [SPARK-3359][BUILD][DOCS] Print examples and disable group and tparam tags in javadoc

2016-11-20 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 063da0c8d -> bc3e7b3b8 [SPARK-3359][BUILD][DOCS] Print examples and disable group and tparam tags in javadoc ## What changes were proposed in this pull request? This PR proposes/fixes two things. - Remove many errors to generate java

spark-website git commit: Add Spark 2.0.2 to documentation.html

2016-11-20 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site d85c53c4d -> 3529c3f19 Add Spark 2.0.2 to documentation.html Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/3529c3f1 Tree: http://git-wip-us.

[1/2] spark-website git commit: Update sitemap and make it partly auto-generate; fix site URL

2016-11-20 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 3529c3f19 -> 8d0a10ae0 http://git-wip-us.apache.org/repos/asf/spark-website/blob/8d0a10ae/sitemap.xml -- diff --git a/sitemap.xml b/sitemap.xml index c2b271e..ac3b

[2/2] spark-website git commit: Update sitemap and make it partly auto-generate; fix site URL

2016-11-20 Thread srowen
Update sitemap and make it partly auto-generate; fix site URL Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/8d0a10ae Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/8d0a10ae Diff: http://git-w

spark-website git commit: Fix doc link and touch up sitemap; mostly an excuse to trigger github sync again

2016-11-20 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 8d0a10ae0 -> e45462a52 Fix doc link and touch up sitemap; mostly an excuse to trigger github sync again Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-websi

spark-website git commit: Updated FAQ to point to Community Page / StackOverflow

2016-11-21 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site e45462a52 -> d10414f83 Updated FAQ to point to Community Page / StackOverflow Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/d10414f8 Tree: h

spark-website git commit: add Pull Request Template

2016-11-21 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site d10414f83 -> 46fb91025 add Pull Request Template Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/46fb9102 Tree: http://git-wip-us.apache.org/r

spark git commit: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-21 Thread srowen
Repository: spark Updated Branches: refs/heads/master 9f262ae16 -> 07beb5d21 [SPARK-18413][SQL] Add `maxConnections` JDBCOption ## What changes were proposed in this pull request? This PR adds a new JDBCOption `maxConnections` which means the maximum number of simultaneous JDBC connections a

[3/6] spark-website git commit: Port wiki page Committers to committers.html, Contributing to Spark and Code Style Guide to contributing.html, Third Party Projects and Additional Language Bindings to

2016-11-21 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0744e8fd/site/news/spark-summit-agenda-posted.html -- diff --git a/site/news/spark-summit-agenda-posted.html b/site/news/spark-summit-agenda-posted.html index 2970d73..2ba4

[1/6] spark-website git commit: Port wiki page Committers to committers.html, Contributing to Spark and Code Style Guide to contributing.html, Third Party Projects and Additional Language Bindings to

2016-11-21 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 46fb91025 -> 0744e8fdd http://git-wip-us.apache.org/repos/asf/spark-website/blob/0744e8fd/site/third-party-projects.html -- diff --git a/site/third-party-projects.

[5/6] spark-website git commit: Port wiki page Committers to committers.html, Contributing to Spark and Code Style Guide to contributing.html, Third Party Projects and Additional Language Bindings to

2016-11-21 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0744e8fd/site/community.html -- diff --git a/site/community.html b/site/community.html index fe4aa35..1a5e80f 100644 --- a/site/community.html +++ b/site/community.html @@ -

[2/6] spark-website git commit: Port wiki page Committers to committers.html, Contributing to Spark and Code Style Guide to contributing.html, Third Party Projects and Additional Language Bindings to

2016-11-21 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0744e8fd/site/releases/spark-release-0-7-2.html -- diff --git a/site/releases/spark-release-0-7-2.html b/site/releases/spark-release-0-7-2.html index 2506300..0ccc6a9 10064

[4/6] spark-website git commit: Port wiki page Committers to committers.html, Contributing to Spark and Code Style Guide to contributing.html, Third Party Projects and Additional Language Bindings to

2016-11-21 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0744e8fd/site/news/spark-0-7-2-released.html -- diff --git a/site/news/spark-0-7-2-released.html b/site/news/spark-0-7-2-released.html index 06f1766..12c8d35 100644 --- a/s

[6/6] spark-website git commit: Port wiki page Committers to committers.html, Contributing to Spark and Code Style Guide to contributing.html, Third Party Projects and Additional Language Bindings to

2016-11-21 Thread srowen
Port wiki page Committers to committers.html, Contributing to Spark and Code Style Guide to contributing.html, Third Party Projects and Additional Language Bindings to third-party-projects.html, Powered By to powered-by.html Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Com

spark git commit: [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that` across R API documentation

2016-11-22 Thread srowen
Repository: spark Updated Branches: refs/heads/master acb971577 -> 4922f9cdc [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that` across R API documentation ## What changes were proposed in this pull request? It seems in R, there are - `Note:` - `NOTE:` - `Note that` This P

spark git commit: [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that` across R API documentation

2016-11-22 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 c70214075 -> 63aa01ffe [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that` across R API documentation ## What changes were proposed in this pull request? It seems in R, there are - `Note:` - `NOTE:` - `Note that` Th

spark git commit: [SPARK-18447][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that` across Python API documentation

2016-11-22 Thread srowen
Repository: spark Updated Branches: refs/heads/master 4922f9cdc -> 933a6548d [SPARK-18447][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that` across Python API documentation ## What changes were proposed in this pull request? It seems in Python, there are - `Note:` - `NOTE:` - `Note tha

spark git commit: [SPARK-18447][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that` across Python API documentation

2016-11-22 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 63aa01ffe -> 36cd10d19 [SPARK-18447][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that` across Python API documentation ## What changes were proposed in this pull request? It seems in Python, there are - `Note:` - `NOTE:` - `Note

[4/5] spark-website git commit: Port wiki Useful Developer Tools and Profiling Spark Apps to /developer-tools.html; port Spark Versioning Policy and main wiki to /versioning-policy.html; port Preparin

2016-11-23 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/cf21826b/site/news/announcing-the-first-spark-summit.html -- diff --git a/site/news/announcing-the-first-spark-summit.html b/site/news/announcing-the-first-spark-summit.htm

[2/5] spark-website git commit: Port wiki Useful Developer Tools and Profiling Spark Apps to /developer-tools.html; port Spark Versioning Policy and main wiki to /versioning-policy.html; port Preparin

2016-11-23 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/cf21826b/site/release-process.html -- diff --git a/site/release-process.html b/site/release-process.html new file mode 100644 index 000..c19c40a --- /dev/null +++ b/site

[3/5] spark-website git commit: Port wiki Useful Developer Tools and Profiling Spark Apps to /developer-tools.html; port Spark Versioning Policy and main wiki to /versioning-policy.html; port Preparin

2016-11-23 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/cf21826b/site/news/spark-accepted-into-apache-incubator.html -- diff --git a/site/news/spark-accepted-into-apache-incubator.html b/site/news/spark-accepted-into-apache-incu

[5/5] spark-website git commit: Port wiki Useful Developer Tools and Profiling Spark Apps to /developer-tools.html; port Spark Versioning Policy and main wiki to /versioning-policy.html; port Preparin

2016-11-23 Thread srowen
Port wiki Useful Developer Tools and Profiling Spark Apps to /developer-tools.html; port Spark Versioning Policy and main wiki to /versioning-policy.html; port Preparing Spark Releases to /release-process.html; rearrange menu with new Developer menu Project: http://git-wip-us.apache.org/repos/

[1/5] spark-website git commit: Port wiki Useful Developer Tools and Profiling Spark Apps to /developer-tools.html; port Spark Versioning Policy and main wiki to /versioning-policy.html; port Preparin

2016-11-23 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 0744e8fdd -> cf21826be http://git-wip-us.apache.org/repos/asf/spark-website/blob/cf21826b/site/releases/spark-release-1-6-0.html -- diff --git a/site/releases/spar

spark git commit: [SPARK-18073][DOCS][WIP] Migrate wiki to spark.apache.org web site

2016-11-23 Thread srowen
org. ## How was this patch tested? Doc builds Author: Sean Owen Closes #15967 from srowen/SPARK-18073.1. (cherry picked from commit 7e0cd1d9b168286386f15e9b55988733476ae2bb) Signed-off-by: Sean Owen Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/re

spark git commit: [SPARK-18073][DOCS][WIP] Migrate wiki to spark.apache.org web site

2016-11-23 Thread srowen
How was this patch tested? Doc builds Author: Sean Owen Closes #15967 from srowen/SPARK-18073.1. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7e0cd1d9 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/7e0cd1d9 D

spark-website git commit: Add chat rooms to community links

2016-11-23 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site cf21826be -> 9418d7be6 Add chat rooms to community links Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/9418d7be Tree: http://git-wip-us.apac

spark-website git commit: Manually patch ec2-scripts.html file, missing from 2.0.1, 2.0.2 docs

2016-11-24 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 9418d7be6 -> 8d5d77c65 Manually patch ec2-scripts.html file, missing from 2.0.1, 2.0.2 docs Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/8d

spark git commit: [SPARK-18575][WEB] Keep same style: adjust the position of driver log links

2016-11-25 Thread srowen
Repository: spark Updated Branches: refs/heads/master a367d5ff0 -> f58a8aa20 [SPARK-18575][WEB] Keep same style: adjust the position of driver log links ## What changes were proposed in this pull request? NOT BUG, just adjust the position of driver log link to keep the same style with other

spark git commit: [SPARK-18575][WEB] Keep same style: adjust the position of driver log links

2016-11-25 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 a7f414561 -> 57dbc682d [SPARK-18575][WEB] Keep same style: adjust the position of driver log links ## What changes were proposed in this pull request? NOT BUG, just adjust the position of driver log link to keep the same style with ot

spark git commit: [SPARK-18119][SPARK-CORE] Namenode safemode check is only performed on one namenode which can stuck the startup of SparkHistory server

2016-11-25 Thread srowen
Repository: spark Updated Branches: refs/heads/master f58a8aa20 -> f42db0c0c [SPARK-18119][SPARK-CORE] Namenode safemode check is only performed on one namenode which can stuck the startup of SparkHistory server ## What changes were proposed in this pull request? Instead of using the setSafe

spark git commit: [SPARK-18119][SPARK-CORE] Namenode safemode check is only performed on one namenode which can stuck the startup of SparkHistory server

2016-11-25 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 57dbc682d -> a49dfa93e [SPARK-18119][SPARK-CORE] Namenode safemode check is only performed on one namenode which can stuck the startup of SparkHistory server ## What changes were proposed in this pull request? Instead of using the set

[1/3] spark git commit: [SPARK-3359][BUILD][DOCS] More changes to resolve javadoc 8 errors that will help unidoc/genjavadoc compatibility

2016-11-25 Thread srowen
Repository: spark Updated Branches: refs/heads/master f42db0c0c -> 51b1c1551 http://git-wip-us.apache.org/repos/asf/spark/blob/51b1c155/mllib/src/main/scala/org/apache/spark/mllib/util/MLUtils.scala -- diff --git a/mllib/src/ma

[2/3] spark git commit: [SPARK-3359][BUILD][DOCS] More changes to resolve javadoc 8 errors that will help unidoc/genjavadoc compatibility

2016-11-25 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/51b1c155/mllib/src/main/scala/org/apache/spark/ml/optim/IterativelyReweightedLeastSquares.scala -- diff --git a/mllib/src/main/scala/org/apache/spark/ml/optim/IterativelyReweighted

[2/3] spark git commit: [SPARK-3359][BUILD][DOCS] More changes to resolve javadoc 8 errors that will help unidoc/genjavadoc compatibility

2016-11-25 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/69856f28/mllib/src/main/scala/org/apache/spark/ml/optim/IterativelyReweightedLeastSquares.scala -- diff --git a/mllib/src/main/scala/org/apache/spark/ml/optim/IterativelyReweighted

[3/3] spark git commit: [SPARK-3359][BUILD][DOCS] More changes to resolve javadoc 8 errors that will help unidoc/genjavadoc compatibility

2016-11-25 Thread srowen
[SPARK-3359][BUILD][DOCS] More changes to resolve javadoc 8 errors that will help unidoc/genjavadoc compatibility ## What changes were proposed in this pull request? This PR only tries to fix things that looks pretty straightforward and were fixed in other previous PRs before. This PR roughly

[3/3] spark git commit: [SPARK-3359][BUILD][DOCS] More changes to resolve javadoc 8 errors that will help unidoc/genjavadoc compatibility

2016-11-25 Thread srowen
[SPARK-3359][BUILD][DOCS] More changes to resolve javadoc 8 errors that will help unidoc/genjavadoc compatibility ## What changes were proposed in this pull request? This PR only tries to fix things that looks pretty straightforward and were fixed in other previous PRs before. This PR roughly

[1/3] spark git commit: [SPARK-3359][BUILD][DOCS] More changes to resolve javadoc 8 errors that will help unidoc/genjavadoc compatibility

2016-11-25 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 a49dfa93e -> 69856f283 http://git-wip-us.apache.org/repos/asf/spark/blob/69856f28/mllib/src/main/scala/org/apache/spark/mllib/util/MLUtils.scala -- diff --git a/mllib/sr

spark git commit: [SPARK-18356][ML] Improve MLKmeans Performance

2016-11-25 Thread srowen
Repository: spark Updated Branches: refs/heads/master 5ecdc7c5c -> 445d4d9e1 [SPARK-18356][ML] Improve MLKmeans Performance ## What changes were proposed in this pull request? Spark Kmeans fit() doesn't cache the RDD which generates a lot of warnings : WARN KMeans: The input data is not dire

spark git commit: [WIP][SQL][DOC] Fix incorrect `code` tag

2016-11-26 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 830ee1345 -> ff699332c [WIP][SQL][DOC] Fix incorrect `code` tag ## What changes were proposed in this pull request? This PR is to fix incorrect `code` tag in `sql-programming-guide.md` ## How was this patch tested? Manually. Author: W

spark git commit: [WIP][SQL][DOC] Fix incorrect `code` tag

2016-11-26 Thread srowen
Repository: spark Updated Branches: refs/heads/master c4a7eef0c -> f4a98e421 [WIP][SQL][DOC] Fix incorrect `code` tag ## What changes were proposed in this pull request? This PR is to fix incorrect `code` tag in `sql-programming-guide.md` ## How was this patch tested? Manually. Author: Weiqi

[1/4] spark git commit: [SPARK-3359][DOCS] Make javadoc8 working for unidoc/genjavadoc compatibility in Java API documentation

2016-11-29 Thread srowen
Repository: spark Updated Branches: refs/heads/master 7d5cb3af7 -> f830bb917 http://git-wip-us.apache.org/repos/asf/spark/blob/f830bb91/sql/core/src/main/scala/org/apache/spark/sql/jdbc/JdbcDialects.scala -- diff --git a/sql/c

[2/4] spark git commit: [SPARK-3359][DOCS] Make javadoc8 working for unidoc/genjavadoc compatibility in Java API documentation

2016-11-29 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/f830bb91/mllib/src/main/scala/org/apache/spark/mllib/tree/configuration/BoostingStrategy.scala -- diff --git a/mllib/src/main/scala/org/apache/spark/mllib/tree/configuration/Boosti

[3/4] spark git commit: [SPARK-3359][DOCS] Make javadoc8 working for unidoc/genjavadoc compatibility in Java API documentation

2016-11-29 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/f830bb91/mllib/src/main/scala/org/apache/spark/ml/feature/QuantileDiscretizer.scala -- diff --git a/mllib/src/main/scala/org/apache/spark/ml/feature/QuantileDiscretizer.scala b/ml

[4/4] spark git commit: [SPARK-3359][DOCS] Make javadoc8 working for unidoc/genjavadoc compatibility in Java API documentation

2016-11-29 Thread srowen
[SPARK-3359][DOCS] Make javadoc8 working for unidoc/genjavadoc compatibility in Java API documentation ## What changes were proposed in this pull request? This PR make `sbt unidoc` complete with Java 8. This PR roughly includes several fixes as below: - Fix unrecognisable class and method link

[4/4] spark git commit: [SPARK-3359][DOCS] Make javadoc8 working for unidoc/genjavadoc compatibility in Java API documentation

2016-11-29 Thread srowen
[SPARK-3359][DOCS] Make javadoc8 working for unidoc/genjavadoc compatibility in Java API documentation ## What changes were proposed in this pull request? This PR make `sbt unidoc` complete with Java 8. This PR roughly includes several fixes as below: - Fix unrecognisable class and method link

[2/4] spark git commit: [SPARK-3359][DOCS] Make javadoc8 working for unidoc/genjavadoc compatibility in Java API documentation

2016-11-29 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/84b2af22/mllib/src/main/scala/org/apache/spark/mllib/tree/configuration/BoostingStrategy.scala -- diff --git a/mllib/src/main/scala/org/apache/spark/mllib/tree/configuration/Boosti

[1/4] spark git commit: [SPARK-3359][DOCS] Make javadoc8 working for unidoc/genjavadoc compatibility in Java API documentation

2016-11-29 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 06a56df22 -> 84b2af229 http://git-wip-us.apache.org/repos/asf/spark/blob/84b2af22/sql/core/src/main/scala/org/apache/spark/sql/jdbc/JdbcDialects.scala -- diff --git a/s

[3/4] spark git commit: [SPARK-3359][DOCS] Make javadoc8 working for unidoc/genjavadoc compatibility in Java API documentation

2016-11-29 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/84b2af22/mllib/src/main/scala/org/apache/spark/ml/feature/QuantileDiscretizer.scala -- diff --git a/mllib/src/main/scala/org/apache/spark/ml/feature/QuantileDiscretizer.scala b/ml

spark git commit: [MINOR][DOCS] Updates to the Accumulator example in the programming guide. Fixed typos, AccumulatorV2 in Java

2016-11-29 Thread srowen
Repository: spark Updated Branches: refs/heads/master f830bb917 -> f045d9dad [MINOR][DOCS] Updates to the Accumulator example in the programming guide. Fixed typos, AccumulatorV2 in Java ## What changes were proposed in this pull request? This pull request contains updates to Scala and Java

spark git commit: [MINOR][DOCS] Updates to the Accumulator example in the programming guide. Fixed typos, AccumulatorV2 in Java

2016-11-29 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 84b2af229 -> 124944ab6 [MINOR][DOCS] Updates to the Accumulator example in the programming guide. Fixed typos, AccumulatorV2 in Java ## What changes were proposed in this pull request? This pull request contains updates to Scala and J

spark git commit: [SPARK-18615][DOCS] Switch to multi-line doc to avoid a genjavadoc bug for backticks

2016-11-29 Thread srowen
Repository: spark Updated Branches: refs/heads/master f045d9dad -> 1a870090e [SPARK-18615][DOCS] Switch to multi-line doc to avoid a genjavadoc bug for backticks ## What changes were proposed in this pull request? Currently, single line comment does not mark down backticks to `..` but print

<    13   14   15   16   17   18   19   20   21   22   >