[GitHub] spark pull request: [SPARK-12072][PYTHON][SQL][WIP] Python jdf dat...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11856#issuecomment-201486208 **[Test build #54209 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54209/consoleFull)** for PR 11856 at commit [`9fe40fe`](https://gi

[GitHub] spark pull request: [DO_NOT_MERGE]Reproduce DataFrameReaderWriterS...

2016-03-25 Thread zsxwing
Github user zsxwing closed the pull request at: https://github.com/apache/spark/pull/11922 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] spark pull request: [MINOR][SQL] Fix substr/substring testcases.

2016-03-25 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/11963#issuecomment-201483944 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark pull request: [SPARK-14073][Streaming][test-maven]Move flume...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11895#issuecomment-201483546 **[Test build #54208 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54208/consoleFull)** for PR 11895 at commit [`f5d5976`](https://gi

[GitHub] spark pull request: [SPARK-13149][SQL][FOLLOWUP]Make FileStreamSou...

2016-03-25 Thread zsxwing
Github user zsxwing closed the pull request at: https://github.com/apache/spark/pull/11162 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] spark pull request: [SPARK-14073][Streaming][test-maven]Move flume...

2016-03-25 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11895#issuecomment-201482647 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11940 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201480383 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201480105 Merging to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201480375 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14119][SPARK-14120][SPARK-14122][SQL] T...

2016-03-25 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/11948#issuecomment-201480224 Thanks for the PR! It will be great if we can make it clear what command is not supported. From the current error message, we only know there are features that we do not

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201479663 **[Test build #54203 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54203/consoleFull)** for PR 11940 at commit [`45f1452`](https://g

[GitHub] spark pull request: [SPARK-14152] [ML] [PySpark] MultilayerPercept...

2016-03-25 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/11952#issuecomment-201477882 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-14164][MLLIB] Improve input layer valid...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11964#issuecomment-201475663 **[Test build #54207 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54207/consoleFull)** for PR 11964 at commit [`8cd2d85`](https://gi

[GitHub] spark pull request: [SPARK-14164] Improve input layer validation t...

2016-03-25 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/11964 [SPARK-14164] Improve input layer validation to MultilayerPerceptronClassifier ## What changes were proposed in this pull request? This issue improves an input layer validation and r

[GitHub] spark pull request: SPARK-14091 [core] Consider improving performa...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11911#issuecomment-201471915 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: SPARK-14091 [core] Consider improving performa...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11911#issuecomment-201471906 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: SPARK-14091 [core] Consider improving performa...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11911#issuecomment-201470871 **[Test build #54195 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54195/consoleFull)** for PR 11911 at commit [`f59c85f`](https://g

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201471322 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201471316 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201469930 **[Test build #54198 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54198/consoleFull)** for PR 11940 at commit [`d8dcd04`](https://g

[GitHub] spark pull request: [SPARK-14119][SPARK-14120][SPARK-14122][SQL] T...

2016-03-25 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/11948#issuecomment-201468856 updated --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request: [SPARK-14137][SPARK-14150][SQL] Infer IsNotNul...

2016-03-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11953 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-14137][SPARK-14150][SQL] Infer IsNotNul...

2016-03-25 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11953#issuecomment-201461105 Merging this into master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201461192 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201461196 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14089][CORE][MLLIB] Remove methods that...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11910#issuecomment-201460911 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14089][CORE][MLLIB] Remove methods that...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11910#issuecomment-201460905 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201460511 **[Test build #54200 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54200/consoleFull)** for PR 11940 at commit [`9809acf`](https://g

[GitHub] spark pull request: [SPARK-14089][CORE][MLLIB] Remove methods that...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11910#issuecomment-201460251 **[Test build #54193 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54193/consoleFull)** for PR 11910 at commit [`631c44c`](https://g

[GitHub] spark pull request: [SPARK-14062][Yarn] Fix log4j and upload metri...

2016-03-25 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/11885#issuecomment-201455646 LGTM, just need to fix the env variable thing one way or another. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-14062][Yarn] Fix log4j and upload metri...

2016-03-25 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11885#discussion_r57482682 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -549,6 +549,21 @@ private[spark] class Client( appMasterOnly = true)

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201451635 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201451629 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201450909 **[Test build #54197 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54197/consoleFull)** for PR 11940 at commit [`37343ca`](https://g

[GitHub] spark pull request: [SPARK-12555][SQL] Result should not be corrup...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11623#issuecomment-201450575 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12555][SQL] Result should not be corrup...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11623#issuecomment-201450580 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12555][SQL] Result should not be corrup...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11623#issuecomment-201449787 **[Test build #54192 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54192/consoleFull)** for PR 11623 at commit [`c0e73cd`](https://g

[GitHub] spark pull request: [MINOR][SQL] Fix substr/substring testcases.

2016-03-25 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/11963#issuecomment-201449332 CC @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-12072][PYTHON][SQL][WIP] Python jdf dat...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11856#issuecomment-201449446 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12072][PYTHON][SQL][WIP] Python jdf dat...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11856#issuecomment-201449335 **[Test build #54205 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54205/consoleFull)** for PR 11856 at commit [`5eeacc9`](https://g

[GitHub] spark pull request: [SPARK-12072][PYTHON][SQL][WIP] Python jdf dat...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11856#issuecomment-201449451 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14137][SPARK-14150][SQL] Infer IsNotNul...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11953#issuecomment-201448647 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14137][SPARK-14150][SQL] Infer IsNotNul...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11953#issuecomment-201448643 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14137][SPARK-14150][SQL] Infer IsNotNul...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11953#issuecomment-201447516 **[Test build #54191 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54191/consoleFull)** for PR 11953 at commit [`2f43d41`](https://g

[GitHub] spark pull request: [MINOR][SQL] Fix substr/substring testcases.

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11963#issuecomment-201446477 **[Test build #54206 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54206/consoleFull)** for PR 11963 at commit [`758a8a8`](https://gi

[GitHub] spark pull request: [MINOR][SQL] Fix substr/substring testcases.

2016-03-25 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/11963 [MINOR][SQL] Fix substr/substring testcases. ## What changes were proposed in this pull request? This PR fixes the following two testcases in order to test the correct usages. ``

[GitHub] spark pull request: [SPARK-12072][PYTHON][SQL][WIP] Python jdf dat...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11856#issuecomment-201440520 **[Test build #54205 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54205/consoleFull)** for PR 11856 at commit [`5eeacc9`](https://gi

[GitHub] spark pull request: [SPARK-14109][SQL] Fix HDFSMetadataLog to fall...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11925#issuecomment-201439988 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14109][SQL] Fix HDFSMetadataLog to fall...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11925#issuecomment-201439993 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14109][SQL] Fix HDFSMetadataLog to fall...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11925#issuecomment-201439602 **[Test build #54194 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54194/consoleFull)** for PR 11925 at commit [`5eb63b6`](https://g

[GitHub] spark pull request: [SPARK-12343][YARN] Simplify Yarn client and c...

2016-03-25 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/11603#issuecomment-201437129 Mostly good, just a few comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [SPARK-14135] Add off-heap storage memory book...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11942#issuecomment-201436077 **[Test build #54204 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54204/consoleFull)** for PR 11942 at commit [`c3d0f61`](https://gi

[GitHub] spark pull request: [SPARK-14135] Add off-heap storage memory book...

2016-03-25 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/11942#issuecomment-201435769 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12343][YARN] Simplify Yarn client and c...

2016-03-25 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11603#discussion_r57479046 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1264,7 +1266,7 @@ object Client extends Logging { val secondar

[GitHub] spark pull request: [SPARK-12443][SQL] encoderFor should support D...

2016-03-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10399 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12443][SQL] encoderFor should support D...

2016-03-25 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/10399#issuecomment-201433854 Thanks, merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-12343][YARN] Simplify Yarn client and c...

2016-03-25 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11603#discussion_r57478478 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -510,10 +516,12 @@ private[spark] class Client( * (3) whether to add

[GitHub] spark pull request: [SQL][HOTFIX] Fix flakiness in StateStoreRDDSu...

2016-03-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11924 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SQL][HOTFIX] Fix flakiness in StateStoreRDDSu...

2016-03-25 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11924#issuecomment-201431779 Let's merge it now as it fails several times per day. Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-13579][build][wip] Stop building the ma...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11796#issuecomment-201431676 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13579][build][wip] Stop building the ma...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11796#issuecomment-201431670 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13579][build][wip] Stop building the ma...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11796#issuecomment-201430662 **[Test build #54185 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54185/consoleFull)** for PR 11796 at commit [`976ce2c`](https://g

[GitHub] spark pull request: [SPARK-12343][YARN] Simplify Yarn client and c...

2016-03-25 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11603#discussion_r57477923 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -480,25 +495,16 @@ private[spark] class Client( } /**

[GitHub] spark pull request: [SPARK-14098][SQL][WIP] Generate Java code tha...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11956#issuecomment-201426171 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14098][SQL][WIP] Generate Java code tha...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11956#issuecomment-201426182 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14098][SQL][WIP] Generate Java code tha...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11956#issuecomment-201425493 **[Test build #54178 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54178/consoleFull)** for PR 11956 at commit [`c26cead`](https://g

[GitHub] spark pull request: [SPARK-12343][YARN] Simplify Yarn client and c...

2016-03-25 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11603#discussion_r57477150 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMasterArguments.scala --- @@ -101,12 +91,8 @@ class ApplicationMasterArguments(val args

[GitHub] spark pull request: [SPARK-12343][YARN] Simplify Yarn client and c...

2016-03-25 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11603#discussion_r57476945 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -33,6 +34,10 @@ package object config { private[spark] val DRIVER_U

[GitHub] spark pull request: [SPARK-14144][SQL] Explicitly identify/catch U...

2016-03-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11950 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-14135] Add off-heap storage memory book...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11942#issuecomment-201418364 **[Test build #54201 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54201/consoleFull)** for PR 11942 at commit [`c3d0f61`](https://g

[GitHub] spark pull request: [SPARK-14135] Add off-heap storage memory book...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11942#issuecomment-201418469 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14135] Add off-heap storage memory book...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11942#issuecomment-201418463 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201417804 **[Test build #54203 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54203/consoleFull)** for PR 11940 at commit [`45f1452`](https://gi

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201415819 I'm going to merge this one after tests pass to unblock other PRs. Will address further comments in another PR. --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201414609 > I see; so how about simplifying things a bit. Can I suggest that you change the name of the variable to shouldInterruptThread or something that more explicitly says t

[GitHub] spark pull request: [SPARK-14135] Add off-heap storage memory book...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11942#issuecomment-201408099 **[Test build #54201 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54201/consoleFull)** for PR 11942 at commit [`c3d0f61`](https://gi

[GitHub] spark pull request: [SPARK-13241] [Web UI] Added long values for d...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11326#issuecomment-201408109 **[Test build #54202 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54202/consoleFull)** for PR 11326 at commit [`c20035c`](https://gi

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201407257 > Since L157 calls microBatchThread.interrupt(), it's safe I see; so how about simplifying things a bit. Can I suggest that you change the name of the variable t

[GitHub] spark pull request: [SPARK-14161] [SQL] Native Parsing for DDL Com...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11962#issuecomment-201405643 **[Test build #54199 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54199/consoleFull)** for PR 11962 at commit [`8f20e5a`](https://gi

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201405645 **[Test build #54200 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54200/consoleFull)** for PR 11940 at commit [`9809acf`](https://gi

[GitHub] spark pull request: [SPARK-14161] [SQL] Native Parsing for DDL Com...

2016-03-25 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/11962#issuecomment-201405785 cc @yhuai @hvanhovell @viirya Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-14161] [SQL] Native Parsing for DDL Com...

2016-03-25 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/11962 [SPARK-14161] [SQL] Native Parsing for DDL Comand Drop Database What changes were proposed in this pull request? Based on the Hive DDL document https://cwiki.apache.org/confluence/displ

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201404121 > Is that because there are multiple calls to runUninterruptiblyInMicroBatchThread, and you want to keep the interrupted status across those calls? If that's the case,

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/11940#discussion_r57473579 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -101,6 +102,65 @@ class StreamExecution( private

[GitHub] spark pull request: [SPARK-13241] [Web UI] Added long values for d...

2016-03-25 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/11326#discussion_r57473060 --- Diff: core/src/test/scala/org/apache/spark/deploy/history/HistoryServerSuite.scala --- @@ -157,12 +157,14 @@ class HistoryServerSuite extends SparkFunS

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201401173 **[Test build #54198 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54198/consoleFull)** for PR 11940 at commit [`d8dcd04`](https://gi

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201401202 > It should not change interrupted to false if Thread.interrupted() returns false Is that because there are multiple calls to `runUninterruptiblyInMicroBatchThr

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201400855 This logic is a little complex. Could you add some unit tests to make sure this is correct? --- If your project is set up for it, you can reply to this email and have yo

[GitHub] spark pull request: [SPARK-14073][Streaming][test-maven]Move flume...

2016-03-25 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/11895#issuecomment-201398249 LGTM once we fix the maven test issues. Thanks for taking care of this! --- If your project is set up for it, you can reply to this email and have your reply appear on G

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/11940#discussion_r57472410 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -228,13 +288,17 @@ class StreamExecution( comm

[GitHub] spark pull request: [SPARK-14135] Add off-heap storage memory book...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11942#issuecomment-201399544 **[Test build #54196 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54196/consoleFull)** for PR 11942 at commit [`61d220b`](https://g

[GitHub] spark pull request: [SPARK-14135] Add off-heap storage memory book...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11942#issuecomment-201399555 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14135] Add off-heap storage memory book...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11942#issuecomment-201399560 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201399466 @vanzin Oh, no... `interrupted = Thread.interrupted()` is wrong. It should not change `interrupted` to `false` if `Thread.interrupted()` returns false. Reverting it.

[GitHub] spark pull request: [SPARK-13241] [Web UI] Added long values for d...

2016-03-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/11326#discussion_r57471934 --- Diff: core/src/test/scala/org/apache/spark/deploy/history/HistoryServerSuite.scala --- @@ -157,12 +157,14 @@ class HistoryServerSuite extends SparkFunSuit

[GitHub] spark pull request: [SPARK-13241] [Web UI] Added long values for d...

2016-03-25 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/11326#discussion_r57471730 --- Diff: core/src/test/scala/org/apache/spark/deploy/history/HistoryServerSuite.scala --- @@ -157,12 +157,14 @@ class HistoryServerSuite extends SparkFunS

[GitHub] spark pull request: [SPARK-14135] Add off-heap storage memory book...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11942#issuecomment-201397074 **[Test build #54196 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54196/consoleFull)** for PR 11942 at commit [`61d220b`](https://gi

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201397068 **[Test build #54197 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54197/consoleFull)** for PR 11940 at commit [`37343ca`](https://gi

[GitHub] spark pull request: [SPARK-14131][SQL]Add a workaround for HADOOP-...

2016-03-25 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/11940#issuecomment-201393496 LGTM; looking at the code after my comment I think the shorter code is safe, but that's a super minor thing anyway. --- If your project is set up for it, you can reply

<    1   2   3   4   5   6   7   >