[GitHub] spark pull request: [SPARK-11274][SQL] Text data source support fo...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9240#issuecomment-150512794 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11274][SQL] Text data source support fo...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9240#issuecomment-150512844 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11243] [SQL] zero out padding bytes in ...

2015-10-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9217 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11243] [SQL] zero out padding bytes in ...

2015-10-23 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9217#issuecomment-150511744 Thanks. I've merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-10-23 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-150511647 @aray Thanks a lot for updating this. To help api design, can you take a look at other frameworks and see what their signatures look like? --- If your project is set up f

[GitHub] spark pull request: [SPARK-11243] [SQL] zero out padding bytes in ...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9217#issuecomment-150511031 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11243] [SQL] zero out padding bytes in ...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9217#issuecomment-150511033 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11243] [SQL] zero out padding bytes in ...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9217#issuecomment-150510875 **[Test build #44207 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44207/consoleFull)** for PR 9217 at commit [`9ff3f66`](https://git

[GitHub] spark pull request: [SPARK-10277][MLlib][PySpark] Add @since annot...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8684#issuecomment-150507472 **[Test build #44214 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44214/consoleFull)** for PR 8684 at commit [`e1e75a5`](https://gith

[GitHub] spark pull request: [SPARK-11271][Core] Use Spark BitSet instead o...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9243#issuecomment-150506790 **[Test build #44213 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44213/consoleFull)** for PR 9243 at commit [`392975d`](https://gith

[GitHub] spark pull request: [SPARK-10277][MLlib][PySpark] Add @since annot...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8684#issuecomment-150506081 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10947] [SQL] With schema inference from...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9245#issuecomment-150506040 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-10277][MLlib][PySpark] Add @since annot...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8684#issuecomment-150506121 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11276][CORE] SizeEstimator prevents cla...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9244#issuecomment-150506052 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-10947] [SQL] With schema inference from...

2015-10-23 Thread stephend-realitymine
GitHub user stephend-realitymine opened a pull request: https://github.com/apache/spark/pull/9245 [SPARK-10947] [SQL] With schema inference from JSON into a Dataframe, add option to infer all primitive object types as strings Currently, when a schema is inferred from a JSON fil

[GitHub] spark pull request: [SPARK-11271][Core] Use Spark BitSet instead o...

2015-10-23 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9243#issuecomment-150505415 Why is an uncompressed bitset using less space than a compressed one? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHu

[GitHub] spark pull request: [SPARK-10382] Make example code in user guide ...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9109#issuecomment-150505202 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-10382] Make example code in user guide ...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9109#issuecomment-150505200 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11276][CORE] SizeEstimator prevents cla...

2015-10-23 Thread SemMulder
GitHub user SemMulder opened a pull request: https://github.com/apache/spark/pull/9244 [SPARK-11276][CORE] SizeEstimator prevents class unloading The SizeEstimator keeps a cache of ClassInfos but this cache uses Class objects as keys. Which results in strong references to the Cl

[GitHub] spark pull request: [SPARK-10382] Make example code in user guide ...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9109#issuecomment-150504956 **[Test build #44212 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44212/consoleFull)** for PR 9109 at commit [`8557977`](https://git

[GitHub] spark pull request: [SPARK-11194] [SQL] Use MutableURLClassLoader ...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9170#issuecomment-150504857 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-11194] [SQL] Use MutableURLClassLoader ...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9170#issuecomment-150504855 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11194] [SQL] Use MutableURLClassLoader ...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9170#issuecomment-150504667 **[Test build #44208 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44208/consoleFull)** for PR 9170 at commit [`65f0a4c`](https://git

[GitHub] spark pull request: Fix typo "Received" to "Receiver" in streaming...

2015-10-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9242 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11271][Core] Use Spark BitSet instead o...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9243#issuecomment-150504119 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11271][Core] Use Spark BitSet instead o...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9243#issuecomment-150504102 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: Fix typo "Received" to "Receiver" in streaming...

2015-10-23 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9242#issuecomment-150503566 Thanks - I've merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [SPARK-11271][Core] Use Spark BitSet instead o...

2015-10-23 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/9243 [SPARK-11271][Core] Use Spark BitSet instead of RoaringBitmap to reduce memory usage JIRA: https://issues.apache.org/jira/browse/SPARK-11271 As reported in the JIRA ticket, when there are to

[GitHub] spark pull request: [SPARK-10382] Make example code in user guide ...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9109#issuecomment-150501534 **[Test build #44212 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44212/consoleFull)** for PR 9109 at commit [`8557977`](https://gith

[GitHub] spark pull request: [SPARK-10997] [core] Add "client mode" to nett...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9210#issuecomment-150500253 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-10382] Make example code in user guide ...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9109#issuecomment-150500190 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10997] [core] Add "client mode" to nett...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9210#issuecomment-150500153 **[Test build #44199 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44199/consoleFull)** for PR 9210 at commit [`11d9092`](https://git

[GitHub] spark pull request: [SPARK-10997] [core] Add "client mode" to nett...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9210#issuecomment-150500252 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request: [SPARK-10382] Make example code in user guide ...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9109#issuecomment-150500211 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10382] [POC] Make example code in user ...

2015-10-23 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/9109#discussion_r42840074 --- Diff: docs/_plugins/include_example.rb --- @@ -0,0 +1,79 @@ +require 'liquid' +require 'pygments' + +module Jekyll + class IncludeExa

[GitHub] spark pull request: [SPARK-11274][SQL] Text data source support fo...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9240#issuecomment-150497226 **[Test build #44211 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44211/consoleFull)** for PR 9240 at commit [`906845b`](https://gith

[GitHub] spark pull request: [SPARK-11274][SQL] Text data source support fo...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9240#issuecomment-150496706 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11274][SQL] Text data source support fo...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9240#issuecomment-150496694 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10997] [core] Add "client mode" to nett...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9210#issuecomment-150496646 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10997] [core] Add "client mode" to nett...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9210#issuecomment-150496647 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-10997] [core] Add "client mode" to nett...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9210#issuecomment-150496548 **[Test build #44200 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44200/consoleFull)** for PR 9210 at commit [`418b472`](https://git

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9127#issuecomment-150496567 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9127#issuecomment-150496568 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9127#issuecomment-150496521 **[Test build #44209 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44209/consoleFull)** for PR 9127 at commit [`e874a45`](https://git

[GitHub] spark pull request: SPARK-11258 Remove quadratic runtime complexit...

2015-10-23 Thread FRosner
Github user FRosner commented on the pull request: https://github.com/apache/spark/pull/9222#issuecomment-150494394 @sun-rui so there is an existing R test case for this method? In the end I just did a refactoring so existing tests should not break. The idea of unit tests howe

[GitHub] spark pull request: SPARK-11258 Remove quadratic runtime complexit...

2015-10-23 Thread FRosner
Github user FRosner commented on the pull request: https://github.com/apache/spark/pull/9222#issuecomment-150494201 @felixcheung the ticket is mentioning two numbers (https://issues.apache.org/jira/browse/SPARK-11258#) in the description. For a small data frame it is already a speedup

[GitHub] spark pull request: [SPARK-10382] [POC] Make example code in user ...

2015-10-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/9109#discussion_r42838196 --- Diff: docs/_plugins/include_example.rb --- @@ -0,0 +1,79 @@ +require 'liquid' +require 'pygments' + +module Jekyll + class IncludeExamp

[GitHub] spark pull request: [SPARK-10382] [POC] Make example code in user ...

2015-10-23 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/9109#issuecomment-150493909 Yes, it looks good. Please remove the example, add Apache header, then remove `[POC]` from the PR title. It should be good to go. --- If your project is set up for it, y

[GitHub] spark pull request: [SPARK-10382] [POC] Make example code in user ...

2015-10-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/9109#discussion_r42838120 --- Diff: docs/_plugins/include_example.rb --- @@ -0,0 +1,79 @@ +require 'liquid' --- End diff -- Could you add Apache header? See `copy_api_di

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9127#issuecomment-150493422 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9127#issuecomment-150493424 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-10984] [WIP] Simplify *MemoryManager cl...

2015-10-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9127#issuecomment-150493379 **[Test build #44205 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44205/consoleFull)** for PR 9127 at commit [`a7e8320`](https://git

[GitHub] spark pull request: [SPARK-11273][SQL] Move ArrayData/MapData/Data...

2015-10-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9239 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

<    3   4   5   6   7   8