[GitHub] spark pull request: [SPARK-7120][SPARK-7121] Closure cleaner nesti...

2015-05-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5685 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7120][SPARK-7121] Closure cleaner nesti...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5685#issuecomment-98322628 [Test build #31654 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31654/consoleFull) for PR 5685 at commit [`cd46230`](https://gith

[GitHub] spark pull request: [SPARK-7120][SPARK-7121] Closure cleaner nesti...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5685#issuecomment-98322643 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/316

[GitHub] spark pull request: [SPARK-7120][SPARK-7121] Closure cleaner nesti...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5685#issuecomment-98322642 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5859#issuecomment-98320137 [Test build #31653 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31653/consoleFull) for PR 5859 at commit [`f9aa9ce`](https://gith

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5859#issuecomment-98320140 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/316

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5859#issuecomment-98320139 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5859 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5859#issuecomment-98320005 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/316

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5859#issuecomment-98320002 [Test build #31651 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31651/consoleFull) for PR 5859 at commit [`4b25056`](https://gith

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5859#issuecomment-98320004 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-4122][STREAMING] Add a library that can...

2015-05-01 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/2994#issuecomment-98318497 I have not tested it. Go ahead and try it out and let me know. On Friday, May 1, 2015, Pavan Sudheendra wrote: > @harishreedharan

[GitHub] spark pull request: [SPARK-7318] DStream incorrectly cleans RDD in...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5860#issuecomment-98317537 [Test build #31655 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31655/consoleFull) for PR 5860 at commit [`67eeff4`](https://gith

[GitHub] spark pull request: [SPARK-7318] DStream incorrectly cleans RDD in...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5860#issuecomment-98317565 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/316

[GitHub] spark pull request: [SPARK-7318] DStream incorrectly cleans RDD in...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5860#issuecomment-98317562 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7149] [SQL] Fix system default alias pr...

2015-05-01 Thread haiyangsea
Github user haiyangsea commented on the pull request: https://github.com/apache/spark/pull/5861#issuecomment-98316844 @rxin "having-condition" contains "-" operator. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-4122][STREAMING] Add a library that can...

2015-05-01 Thread 91pavan
Github user 91pavan commented on the pull request: https://github.com/apache/spark/pull/2994#issuecomment-98316465 @harishreedharan Any chance I can use your version from the Spark Java API? --- If your project is set up for it, you can reply to this email and have your reply appear o

[GitHub] spark pull request: [SPARK-7214] Reserve space for unrolling even ...

2015-05-01 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5784#issuecomment-98313148 cc @andrewor14 who worked a lot on this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-7149] [SQL] Fix system default alias pr...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5861#issuecomment-98311958 [Test build #31658 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31658/consoleFull) for PR 5861 at commit [`620473e`](https://githu

[GitHub] spark pull request: [SPARK-7149] [SQL] Fix system default alias pr...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5861#issuecomment-98311408 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7149] [SQL] Fix system default alias pr...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5861#issuecomment-98311397 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7294][SQL] ADD BETWEEN

2015-05-01 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5839#issuecomment-98311425 Jenkins, ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-7294][SQL] ADD BETWEEN

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5839#discussion_r29545478 --- Diff: python/pyspark/sql/dataframe.py --- @@ -1289,6 +1289,17 @@ def cast(self, dataType): raise TypeError("unexpected type: %s" % type(dataT

[GitHub] spark pull request: [SPARK-7149] [SQL] Fix system default alias pr...

2015-05-01 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5861#issuecomment-98310852 Is having-condition invalid? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [SPARK-7149] [SQL] Fix system default alias pr...

2015-05-01 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5861#issuecomment-98310901 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-7296][WebUI] Timeline view for Stage pa...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5843#issuecomment-98309223 [Test build #31650 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31650/consoleFull) for PR 5843 at commit [`2a9e376`](https://gith

[GitHub] spark pull request: [SPARK-7296][WebUI] Timeline view for Stage pa...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5843#issuecomment-98309228 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/316

[GitHub] spark pull request: [SPARK-7296][WebUI] Timeline view for Stage pa...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5843#issuecomment-98309227 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545440 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala --- @@ -0,0 +1,172 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-6368][SQL][Follow-up] Use Serializer2 i...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5849#issuecomment-98308816 [Test build #31657 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31657/consoleFull) for PR 5849 at commit [`8627238`](https://githu

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545433 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/package.scala --- @@ -0,0 +1,30 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-6368][SQL][Follow-up] Use Serializer2 i...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5849#issuecomment-98308335 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545432 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ReflectionMagic.scala --- @@ -0,0 +1,200 @@ +/* + * Licensed to the Apache Software F

[GitHub] spark pull request: [SPARK-6368][SQL][Follow-up] Use Serializer2 i...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5849#issuecomment-98308283 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545422 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala --- @@ -0,0 +1,172 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545405 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala --- @@ -0,0 +1,172 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545397 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientWrapper.scala --- @@ -0,0 +1,392 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545395 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientWrapper.scala --- @@ -0,0 +1,392 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545380 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientWrapper.scala --- @@ -0,0 +1,392 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-7149] [SQL] Fix system default alias pr...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5861#issuecomment-98308017 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545366 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientWrapper.scala --- @@ -0,0 +1,392 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-7149] [SQL] Fix system default alias pr...

2015-05-01 Thread haiyangsea
GitHub user haiyangsea opened a pull request: https://github.com/apache/spark/pull/5861 [SPARK-7149] [SQL] Fix system default alias problem executing the following sql statement will throw exception: ```sql select key as havingCondition from testData group by key having

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545347 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientWrapper.scala --- @@ -0,0 +1,392 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545342 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientWrapper.scala --- @@ -0,0 +1,392 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-6954] [YARN] ExecutorAllocationManager ...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5856#issuecomment-98307838 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/316

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545336 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientWrapper.scala --- @@ -0,0 +1,392 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-6954] [YARN] ExecutorAllocationManager ...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5856#issuecomment-98307837 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-6954] [YARN] ExecutorAllocationManager ...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5856#issuecomment-98307833 [Test build #31648 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31648/consoleFull) for PR 5856 at commit [`1cb517a`](https://gith

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545328 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientWrapper.scala --- @@ -0,0 +1,392 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-7318] DStream incorrectly cleans RDD in...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5860#issuecomment-98307765 [Test build #31655 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31655/consoleFull) for PR 5860 at commit [`67eeff4`](https://githu

[GitHub] spark pull request: [SPARK-7007][core] Add a metric source for Exe...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5589#issuecomment-98307673 [Test build #31656 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31656/consoleFull) for PR 5589 at commit [`104d155`](https://githu

[GitHub] spark pull request: [SPARK-6939][Streaming][WebUI] Add timeline an...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5533#issuecomment-98307682 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/316

[GitHub] spark pull request: [SPARK-6939][Streaming][WebUI] Add timeline an...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5533#issuecomment-98307676 [Test build #31649 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31649/consoleFull) for PR 5533 at commit [`3be4b7a`](https://gith

[GitHub] spark pull request: [SPARK-7007][core] Add a metric source for Exe...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5589#issuecomment-98307647 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6939][Streaming][WebUI] Add timeline an...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5533#issuecomment-98307681 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7318] DStream incorrectly cleans RDD in...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5860#issuecomment-98307646 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7318] DStream incorrectly cleans RDD in...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5860#issuecomment-98307639 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7007][core] Add a metric source for Exe...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5589#issuecomment-98307640 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7243][SQL] Contingency Tables for DataF...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5842#discussion_r29545319 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/stat/StatFunctions.scala --- @@ -77,4 +78,42 @@ private[sql] object StatFunctions {

[GitHub] spark pull request: [SPARK-7318] DStream incorrectly cleans RDD in...

2015-05-01 Thread andrewor14
GitHub user andrewor14 opened a pull request: https://github.com/apache/spark/pull/5860 [SPARK-7318] DStream incorrectly cleans RDD instead of closures I added a check in `ClosureCleaner#clean` to fail fast if this is detected in the future. You can merge this pull request into a G

[GitHub] spark pull request: [SPARK-7007][core] Add a metric source for Exe...

2015-05-01 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/5589#issuecomment-98307617 @andrewor14 @sryza , thanks a lot for your comments, I just rebase the codes, please review it. --- If your project is set up for it, you can reply to this email and h

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545301 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientWrapper.scala --- @@ -0,0 +1,392 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545297 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientWrapper.scala --- @@ -0,0 +1,392 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-7120][SPARK-7121] Closure cleaner nesti...

2015-05-01 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/5685#issuecomment-98307502 @andrewor14 okay makes sense. Thanks for all the hard work on this andrew LGTM pending tests. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-7243][SQL] Contingency Tables for DataF...

2015-05-01 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/5842#discussion_r29545291 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/stat/StatFunctions.scala --- @@ -77,4 +78,42 @@ private[sql] object StatFunctions {

[GitHub] spark pull request: [SPARK-7120][SPARK-7121] Closure cleaner nesti...

2015-05-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/5685#issuecomment-98307469 It turns out that in streaming we currently pass an RDD into `ClosureCleaner#clean` so we can't do the type safety check that you supported @pwendell. I will fix this

[GitHub] spark pull request: [SPARK-7243][SQL] Contingency Tables for DataF...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5842#discussion_r29545263 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/stat/StatFunctions.scala --- @@ -77,4 +78,42 @@ private[sql] object StatFunctions {

[GitHub] spark pull request: [SPARK-7243][SQL] Contingency Tables for DataF...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5842#discussion_r29545262 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/stat/StatFunctions.scala --- @@ -77,4 +78,42 @@ private[sql] object StatFunctions {

[GitHub] spark pull request: [SPARK-7120][SPARK-7121] Closure cleaner nesti...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5685#issuecomment-98307278 [Test build #31654 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31654/consoleFull) for PR 5685 at commit [`cd46230`](https://githu

[GitHub] spark pull request: [SPARK-7120][SPARK-7121] Closure cleaner nesti...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5685#issuecomment-98306661 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7120][SPARK-7121] Closure cleaner nesti...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5685#issuecomment-98306615 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7241] Pearson correlation for DataFrame...

2015-05-01 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5858#issuecomment-98304079 I will let @mengxr comment on the math part. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7241] Pearson correlation for DataFrame...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5858#discussion_r29545209 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameStatSuite.scala --- @@ -43,7 +43,15 @@ class DataFrameStatSuite extends FunSuite { val

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5859#issuecomment-98303294 [Test build #31653 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31653/consoleFull) for PR 5859 at commit [`f9aa9ce`](https://githu

[GitHub] spark pull request: [SPARK-7243][SQL] Contingency Tables for DataF...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5842#issuecomment-98303042 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/316

[GitHub] spark pull request: [SPARK-7241] Pearson correlation for DataFrame...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5858#discussion_r29545205 --- Diff: python/pyspark/sql/dataframe.py --- @@ -875,6 +875,25 @@ def fillna(self, value, subset=None): return DataFrame(self._jdf.na().fi

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5859#issuecomment-98302936 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5859#issuecomment-98302973 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7243][SQL] Contingency Tables for DataF...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5842#issuecomment-98303037 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7243][SQL] Contingency Tables for DataF...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5842#issuecomment-98302968 [Test build #31647 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31647/consoleFull) for PR 5842 at commit [`6805df8`](https://gith

[GitHub] spark pull request: [SPARK-7241] Pearson correlation for DataFrame...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5858#discussion_r29545190 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameStatFunctions.scala --- @@ -28,6 +28,32 @@ import org.apache.spark.sql.execution.stat._ fina

[GitHub] spark pull request: [SPARK-7241] Pearson correlation for DataFrame...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5858#discussion_r29545194 --- Diff: python/pyspark/sql/dataframe.py --- @@ -875,6 +875,25 @@ def fillna(self, value, subset=None): return DataFrame(self._jdf.na().fi

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545186 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientInterface.scala --- @@ -0,0 +1,149 @@ +/* + * Licensed to the Apache Software F

[GitHub] spark pull request: [SPARK-6907][SQL] Isolated client for HiveMeta...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5851#discussion_r29545181 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientInterface.scala --- @@ -0,0 +1,149 @@ +/* + * Licensed to the Apache Software F

[GitHub] spark pull request: [SPARK-7241] Pearson correlation for DataFrame...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5858#issuecomment-98302301 [Test build #31652 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31652/consoleFull) for PR 5858 at commit [`4fe693b`](https://githu

[GitHub] spark pull request: [SPARK-7241] Pearson correlation for DataFrame...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5858#issuecomment-98302295 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7241] Pearson correlation for DataFrame...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5858#issuecomment-98302293 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7241] Pearson correlation for DataFrame...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5858#issuecomment-98302115 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/316

[GitHub] spark pull request: [SPARK-7241] Pearson correlation for DataFrame...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5858#issuecomment-98302114 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7241] Pearson correlation for DataFrame...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5858#issuecomment-98302103 [Test build #31646 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31646/consoleFull) for PR 5858 at commit [`a682d06`](https://gith

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5859#discussion_r29545101 --- Diff: python/pyspark/sql/dataframe.py --- @@ -1344,6 +1362,11 @@ def cov(self, col1, col2): cov.__doc__ = DataFrame.cov.__doc__ +

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5859#discussion_r29545099 --- Diff: python/pyspark/sql/dataframe.py --- @@ -889,6 +889,24 @@ def cov(self, col1, col2): raise ValueError("col2 should be a string.")

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5859#discussion_r29545089 --- Diff: python/pyspark/sql/dataframe.py --- @@ -889,6 +889,24 @@ def cov(self, col1, col2): raise ValueError("col2 should be a string.")

[GitHub] spark pull request: spark-7300 remove temporary directories after ...

2015-05-01 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/5834#issuecomment-98301075 Please change the tile of PR to follow the paradigm like others :). --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request: [SPARK-7317] [Shuffle] Expose shuffle handle

2015-05-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5857 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5859#issuecomment-98300894 [Test build #31651 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31651/consoleFull) for PR 5859 at commit [`4b25056`](https://githu

[GitHub] spark pull request: [SPARK-7317] [Shuffle] Expose shuffle handle

2015-05-01 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5857#issuecomment-98300892 LGTM. Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5859#issuecomment-98300854 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5859#issuecomment-98300847 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-7242] added python api for freqItems in...

2015-05-01 Thread brkyvz
GitHub user brkyvz opened a pull request: https://github.com/apache/spark/pull/5859 [SPARK-7242] added python api for freqItems in DataFrames The python api for DataFrame's plus addressed your comments from previous PR. @rxin You can merge this pull request into a Git reposito

  1   2   3   4   5   6   7   8   9   10   >