[GitHub] spark pull request: [SPARK-12204][SPARKR] Implement drop method fo...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10201#issuecomment-164370649 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12204][SPARKR] Implement drop method fo...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10201#issuecomment-164370651 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12204][SPARKR] Implement drop method fo...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10201#issuecomment-164370532 **[Test build #47647 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47647/consoleFull)** for PR 10201 at commit [`14215d3`](https://g

[GitHub] spark pull request: [SPARK-12311][CORE] Restore previous value of ...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10289#issuecomment-164369953 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-12168][SPARKR] Add automated tests for ...

2015-12-13 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/10171#issuecomment-164369645 To avoid the interference of user loaded packages for this test, we may: 1. Add --vanilla option to R when running tests; 2. or is it possible to pick only confli

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10244#issuecomment-164369503 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10244#issuecomment-164369500 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10244#issuecomment-164369418 **[Test build #47644 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47644/consoleFull)** for PR 10244 at commit [`3c1d982`](https://g

[GitHub] spark pull request: [SPARK-12311][CORE] Restore previous value of ...

2015-12-13 Thread kiszk
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/10289 [SPARK-12311][CORE] Restore previous value of "os.arch" property in test suites after forcing to set specific value to "os.arch" property Restore the original value of os.arch property after each tes

[GitHub] spark pull request: [SPARK-12204][SPARKR] Implement drop method fo...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10201#issuecomment-164368190 **[Test build #47647 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47647/consoleFull)** for PR 10201 at commit [`14215d3`](https://gi

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-164368067 **[Test build #47645 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47645/consoleFull)** for PR 8880 at commit [`ad24010`](https://gith

[GitHub] spark pull request: [SPARK-12057] [SQL] Prevent failure on corrupt...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10288#issuecomment-164367756 **[Test build #47646 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47646/consoleFull)** for PR 10288 at commit [`9971300`](https://gi

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-13 Thread winningsix
Github user winningsix commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-164366860 Hi @vanzin, could you help me review the updated patches? In the updated patch, the following changes come: 1. I added test for shuffle encryption with compressio

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10244#issuecomment-164366213 **[Test build #47644 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47644/consoleFull)** for PR 10244 at commit [`3c1d982`](https://gi

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-13 Thread winningsix
Github user winningsix commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r47466929 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnShuffleEncryptionSuite.scala --- @@ -0,0 +1,226 @@ +/* + * Licensed to the Apache S

[GitHub] spark pull request: [SPARK-12275][SQL] No plan for BroadcastHint i...

2015-12-13 Thread yucai
Github user yucai commented on the pull request: https://github.com/apache/spark/pull/10265#issuecomment-164365408 @yhuai sure, I will do that ASAP. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12215][ML][DOC] User guide section for ...

2015-12-13 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/10244#issuecomment-164365254 @jkbradley thank you for reviewing it. I modified some a few points. Can you review it again? - Include the import statments of JavaKMeansExample in the doc - Si

[GitHub] spark pull request: [SPARK-12275][SQL] No plan for BroadcastHint i...

2015-12-13 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/10265#issuecomment-164365167 @yucai can you create a 1.5 backport for this one? There was a conflict when I tried to merge it to branch 1.5. It will be good to have a pr for the backport and make sur

[GitHub] spark pull request: [SPARK-12275][SQL] No plan for BroadcastHint i...

2015-12-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10265 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12275][SQL] No plan for BroadcastHint i...

2015-12-13 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/10265#issuecomment-164364398 Thanks! Merging to 1.5, 1.6, and master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] spark pull request: [SPARK-8641][SQL] Native Spark Window function...

2015-12-13 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9819#discussion_r47466167 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala --- @@ -246,85 +260,238 @@ object SpecifiedWindowFrame

[GitHub] spark pull request: [SPARK-8641][SQL] Native Spark Window function...

2015-12-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/9819#discussion_r47465939 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/Window.scala --- @@ -736,15 +691,148 @@ private[execution] final class UnboundedFollowing

[GitHub] spark pull request: [SPARK-12213] [SQL] use multiple partitions fo...

2015-12-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10228 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12275][SQL] No plan for BroadcastHint i...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10265#issuecomment-164361133 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12275][SQL] No plan for BroadcastHint i...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10265#issuecomment-164360991 **[Test build #47642 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47642/consoleFull)** for PR 10265 at commit [`1b8d570`](https://g

[GitHub] spark pull request: [SPARK-12275][SQL] No plan for BroadcastHint i...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10265#issuecomment-164361130 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-8641][SQL] Native Spark Window function...

2015-12-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/9819#discussion_r47465844 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala --- @@ -246,85 +260,238 @@ object SpecifiedWindowF

[GitHub] spark pull request: [SPARK-12213] [SQL] use multiple partitions fo...

2015-12-13 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/10228#issuecomment-164360720 Cool. I am merging this one to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark pull request: [SPARK-8641][SQL] Native Spark Window function...

2015-12-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/9819#discussion_r47465641 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala --- @@ -246,85 +260,238 @@ object SpecifiedWindowF

[GitHub] spark pull request: [SPARK-12204][SPARKR] Implement drop method fo...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10201#issuecomment-164359997 **[Test build #47643 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47643/consoleFull)** for PR 10201 at commit [`e6e9f10`](https://g

[GitHub] spark pull request: [SPARK-12204][SPARKR] Implement drop method fo...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10201#issuecomment-164360023 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12204][SPARKR] Implement drop method fo...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10201#issuecomment-164360026 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-8641][SQL] Native Spark Window function...

2015-12-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/9819#discussion_r47465384 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1097,6 +1118,42 @@ class Analyzer( }

[GitHub] spark pull request: [SPARK-8641][SQL] Native Spark Window function...

2015-12-13 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9819#issuecomment-164359275 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request: [SPARK-12288] [SQL] Support UnsafeRow in Coale...

2015-12-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/10285#discussion_r47465230 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala --- @@ -263,6 +265,10 @@ case class Except(left: SparkPlan, right: Sp

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-164358418 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12293][SQL] Support UnsafeRow in LocalT...

2015-12-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/10283#discussion_r47465100 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala --- @@ -604,7 +606,9 @@ class SQLContext private[sql]( val className = bean

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-164358420 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-164358352 **[Test build #47640 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47640/consoleFull)** for PR 8880 at commit [`2b3220a`](https://git

[GitHub] spark pull request: [SPARK-12057] [SQL] Prevent failure on corrupt...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10288#issuecomment-164358201 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12057] [SQL] Prevent failure on corrupt...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10288#issuecomment-164358206 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12057] [SQL] Prevent failure on corrupt...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10288#issuecomment-164358154 **[Test build #47641 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47641/consoleFull)** for PR 10288 at commit [`d8722bb`](https://g

[GitHub] spark pull request: [SPARK-12293][SQL] Support UnsafeRow in LocalT...

2015-12-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/10283#discussion_r47464971 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -937,8 +937,9 @@ object DecimalAggregates extends Rul

[GitHub] spark pull request: [SPARK-12204][SPARKR] Implement drop method fo...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10201#issuecomment-164357016 **[Test build #47643 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47643/consoleFull)** for PR 10201 at commit [`e6e9f10`](https://gi

[GitHub] spark pull request: [SPARK-12213] [SQL] use multiple partitions fo...

2015-12-13 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/10228#issuecomment-164356726 @yhuai LGTM. Yea, lets merge this one, I'll create a ticket for the distinct rules --- If your project is set up for it, you can reply to this email and have your r

[GitHub] spark pull request: [SPARK-12288] [SQL] Support UnsafeRow in Coale...

2015-12-13 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/10285#discussion_r47464659 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/RowFormatConvertersSuite.scala --- @@ -58,6 +58,48 @@ class RowFormatConvertersSuite extends

[GitHub] spark pull request: [SPARK-12204][SPARKR] Implement drop method fo...

2015-12-13 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/10201#issuecomment-164356661 @felixcheung, @shivaram, documentation for withColumn changed. please take a review --- If your project is set up for it, you can reply to this email and have your rep

[GitHub] spark pull request: [SPARK-12288] [SQL] Support UnsafeRow in Coale...

2015-12-13 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/10285#discussion_r47464584 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala --- @@ -263,6 +265,10 @@ case class Except(left: SparkPlan, right: Spark

[GitHub] spark pull request: [SPARK-8641][SQL] Native Spark Window function...

2015-12-13 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9819#discussion_r47464485 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala --- @@ -120,6 +121,19 @@ sealed trait FrameBoundary {

[GitHub] spark pull request: [SPARK-8641][SQL] Native Spark Window function...

2015-12-13 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9819#discussion_r47464465 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -70,15 +70,32 @@ trait CheckAnalysis {

[GitHub] spark pull request: [SPARK-12288] [SQL] Support UnsafeRow in Coale...

2015-12-13 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/10285#discussion_r47464475 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala --- @@ -263,6 +265,10 @@ case class Except(left: SparkPlan, right: Sp

[GitHub] spark pull request: [SPARK-8641][SQL] Native Spark Window function...

2015-12-13 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9819#discussion_r47464437 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -70,15 +70,32 @@ trait CheckAnalysis {

[GitHub] spark pull request: [SPARK-8641][SQL] Native Spark Window function...

2015-12-13 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9819#discussion_r47464278 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/Window.scala --- @@ -736,15 +691,156 @@ private[execution] final class UnboundedFollowingWind

[GitHub] spark pull request: [SPARK-12281][Core]Fix a race condition when r...

2015-12-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10269 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12281][Core]Fix a race condition when r...

2015-12-13 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10269#issuecomment-164351154 Merging to master & 1.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2015-12-13 Thread zjffdu
Github user zjffdu commented on the pull request: https://github.com/apache/spark/pull/10242#issuecomment-164351234 @yanboliang Could you help review it ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark pull request: [Spark-12260][wip][Streaming]Graceful Shutdown...

2015-12-13 Thread mwws
Github user mwws commented on a diff in the pull request: https://github.com/apache/spark/pull/10252#discussion_r47463413 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/Demo.scala --- @@ -0,0 +1,94 @@ +/* --- End diff -- Yes, I will remove this file a

[GitHub] spark pull request: [SPARK-12275][SQL] No plan for BroadcastHint i...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10265#issuecomment-164346090 **[Test build #47642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47642/consoleFull)** for PR 10265 at commit [`1b8d570`](https://gi

[GitHub] spark pull request: [SPARK-12275][SQL] No plan for BroadcastHint i...

2015-12-13 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/10265#issuecomment-164344648 When merge this, let's also merge it to branch 1.5, 1.6, and master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHu

[GitHub] spark pull request: [SPARK-12275][SQL] No plan for BroadcastHint i...

2015-12-13 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/10265#issuecomment-164344594 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request: [SPARK-12275][SQL] No plan for BroadcastHint i...

2015-12-13 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/10265#issuecomment-164344218 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-12275][SQL] No plan for BroadcastHint i...

2015-12-13 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/10265#issuecomment-164344211 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark pull request: [SPARK-12057] [SQL] Prevent failure on corrupt...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10288#issuecomment-164344002 **[Test build #47641 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47641/consoleFull)** for PR 10288 at commit [`d8722bb`](https://gi

[GitHub] spark pull request: [SPARK-12310] [SparkR] Add write.json and writ...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10281#issuecomment-164343894 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12310] [SparkR] Add write.json and writ...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10281#issuecomment-164343893 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12310] [SparkR] Add write.json and writ...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10281#issuecomment-164343853 **[Test build #47638 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47638/consoleFull)** for PR 10281 at commit [`50d442e`](https://g

[GitHub] spark pull request: [SPARK-6518][MLlib][Example][DOC] Add example ...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9952#issuecomment-164343732 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-6518][MLlib][Example][DOC] Add example ...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9952#issuecomment-164343734 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-12314][SQL] isnull operator not pushed ...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10286#issuecomment-164343601 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-6518][MLlib][Example][DOC] Add example ...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9952#issuecomment-164343681 **[Test build #47639 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47639/consoleFull)** for PR 9952 at commit [`7c36c1d`](https://git

[GitHub] spark pull request: [SPARK-12314][SQL] isnull operator not pushed ...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10286#issuecomment-164343602 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12314][SQL] isnull operator not pushed ...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10286#issuecomment-164343546 **[Test build #47635 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47635/consoleFull)** for PR 10286 at commit [`ff9d8b2`](https://g

[GitHub] spark pull request: [SPARK-12057] [SQL] Prevent failure on corrupt...

2015-12-13 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/10288#issuecomment-164343229 @simplyianm @srowen I create this PR based on #10043. Please see https://github.com/yhuai/spark/commit/d8722bb30d347fa97c7d358284eb433edb1be6ec for my change. This PR s

[GitHub] spark pull request: [SPARK-12057] [SQL] Prevent failure on corrupt...

2015-12-13 Thread yhuai
GitHub user yhuai opened a pull request: https://github.com/apache/spark/pull/10288 [SPARK-12057] [SQL] Prevent failure on corrupt JSON records This PR makes JSON parser and schema inference handle more cases where we have unparsed records. It is based on #10043. The last commit fix

[GitHub] spark pull request: [SPARK-12315][SQL] isnotnull operator not push...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10287#issuecomment-164342853 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12315][SQL] isnotnull operator not push...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10287#issuecomment-164342850 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12315][SQL] isnotnull operator not push...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10287#issuecomment-164342804 **[Test build #47636 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47636/consoleFull)** for PR 10287 at commit [`eacb4ea`](https://g

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-164342801 **[Test build #47640 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47640/consoleFull)** for PR 8880 at commit [`2b3220a`](https://gith

[GitHub] spark pull request: [SPARK-6518][MLlib][Example][DOC] Add example ...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9952#issuecomment-164342390 **[Test build #47639 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47639/consoleFull)** for PR 9952 at commit [`7c36c1d`](https://gith

[GitHub] spark pull request: [SPARK-12310] [SparkR] Add write.json and writ...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10281#issuecomment-164342424 **[Test build #47638 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47638/consoleFull)** for PR 10281 at commit [`50d442e`](https://gi

[GitHub] spark pull request: [SPARK-6518][MLlib][Example][DOC] Add example ...

2015-12-13 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/9952#issuecomment-164341602 Oh, I'm terribly sorry about that. Pushing the update was failed - Modified what you pointed out - Add a Java example and its doc --- If your project is set

[GitHub] spark pull request: [SPARK-12275][SQL] No plan for BroadcastHint i...

2015-12-13 Thread yucai
Github user yucai commented on the pull request: https://github.com/apache/spark/pull/10265#issuecomment-164339684 @andrewor14 , @yhuai could you kindly help re-trigger testing? Much thanks! --- If your project is set up for it, you can reply to this email and have your reply appear o

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-164334538 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-164334536 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-164334532 **[Test build #47637 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47637/consoleFull)** for PR 8880 at commit [`f88f011`](https://git

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-164334418 **[Test build #47637 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47637/consoleFull)** for PR 8880 at commit [`f88f011`](https://gith

[GitHub] spark pull request: [SPARK-12186] [WEB UI] Send the complete reque...

2015-12-13 Thread mindprince
Github user mindprince commented on the pull request: https://github.com/apache/spark/pull/10180#issuecomment-164333244 Can someone review this or if it seems okay, merge it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark pull request: [SPARK-12288] [SQL] Support UnsafeRow in Coale...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10285#issuecomment-164333106 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12288] [SQL] Support UnsafeRow in Coale...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10285#issuecomment-164333105 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12288] [SQL] Support UnsafeRow in Coale...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10285#issuecomment-164333027 **[Test build #47633 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47633/consoleFull)** for PR 10285 at commit [`cbb2c59`](https://g

[GitHub] spark pull request: [SPARK-12314][SQL] isnull operator not pushed ...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10286#issuecomment-164332710 **[Test build #47635 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47635/consoleFull)** for PR 10286 at commit [`ff9d8b2`](https://gi

[GitHub] spark pull request: [SPARK-12315][SQL] isnotnull operator not push...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10287#issuecomment-164332700 **[Test build #47636 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47636/consoleFull)** for PR 10287 at commit [`eacb4ea`](https://gi

[GitHub] spark pull request: [SPARK-12310] [SparkR] Add write.json and writ...

2015-12-13 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/10281#discussion_r47458826 --- Diff: R/pkg/inst/tests/testthat/test_sparkSQL.R --- @@ -1448,23 +1457,28 @@ test_that("write.df() on DataFrame and works with read.parquet", {

[GitHub] spark pull request: [SPARK-12293][SQL] Support UnsafeRow in LocalT...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10283#issuecomment-164332095 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12293][SQL] Support UnsafeRow in LocalT...

2015-12-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10283#issuecomment-164332075 **[Test build #47634 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47634/consoleFull)** for PR 10283 at commit [`a0a991a`](https://g

[GitHub] spark pull request: [SPARK-12293][SQL] Support UnsafeRow in LocalT...

2015-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10283#issuecomment-164332096 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12315][SQL] isnotnull operator not push...

2015-12-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10287#issuecomment-164331892 Actually the test for this PR is not correctly being tested with the result but I just added it just like the other predicate tests. I will correct the test as soon

[GitHub] spark pull request: [SPARK-12314][SQL] isnull operator not pushed ...

2015-12-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10286#issuecomment-164331911 Actually the test for this PR is not correctly being tested with the result but I just added it just like the other predicate tests. I will correct the test as soon

[GitHub] spark pull request: [SPARK-12315][SQL] isnotnull operator not push...

2015-12-13 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/10287 [SPARK-12315][SQL] isnotnull operator not pushed down for JDBC datasource. `IsNotNull` filter is not being pushed down for JDBC datasource. It looks it is SQL standard according to [SQ

[GitHub] spark pull request: [SPARK-12310] [SparkR] Add write.json and writ...

2015-12-13 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/10281#discussion_r47458635 --- Diff: R/pkg/inst/tests/testthat/test_sparkSQL.R --- @@ -371,13 +371,13 @@ test_that("Collect DataFrame with complex types", { expect_equal(bob$h

  1   2   3   >