[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116558337 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116590951 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8694][WebUI]Defer executing drawTaskAss...

2015-06-29 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/7071#issuecomment-116596423 I have never seen the situation you mentioned even when there are 1 tasks. The contents below the timeline are rendered immediately with my browser (Chrome,

[GitHub] spark pull request: SPARK-8374] [YARN] Job frequently hangs after ...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7083#issuecomment-116610617 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Spark-8703] [ML] Add CountVectorizer as a ml ...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7084#issuecomment-116639479 [Test build #35982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35982/consoleFull) for PR 7084 at commit

[GitHub] spark pull request: [SPARK-6263][MLLIB] Python MLlib API missing i...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5707#issuecomment-116645394 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116652861 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Spark-8703] [ML] Add CountVectorizer as a ml ...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7084#issuecomment-116652920 [Test build #35981 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35981/console) for PR 7084 at commit

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/6982#discussion_r33461668 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -245,13 +254,26 @@ abstract class UnaryExpression

[GitHub] spark pull request: [SPARK-8693][Project Infra]: profiles and goal...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7085#issuecomment-116661837 [Test build #35986 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35986/consoleFull) for PR 7085 at commit

[GitHub] spark pull request: [SPARK-6263][MLLIB] Python MLlib API missing i...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5707#issuecomment-116668972 [Test build #35983 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35983/console) for PR 5707 at commit

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-06-29 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/5423#discussion_r33465613 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -220,9 +220,9 @@ private[spark] object JettyUtils extends Logging {

[GitHub] spark pull request: [SPARK-6263][MLLIB] Python MLlib API missing i...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5707#issuecomment-116669107 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-06-29 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/5423#discussion_r33466420 --- Diff: yarn/history/src/main/scala/org/apache/spark/deploy/history/yarn/YarnHistoryProvider.scala --- @@ -0,0 +1,1015 @@ +/* + * Licensed

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-06-29 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/5423#discussion_r33465769 --- Diff: yarn/history/src/main/scala/org/apache/spark/deploy/history/yarn/YarnEventListener.scala --- @@ -0,0 +1,133 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-116674849 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/7082#issuecomment-116682495 Oh, I see. could you file another one as a separate issue? Opened a JIRA for this issue: https://issues.apache.org/jira/browse/SPARK-8705 --- If your project

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-06-29 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/5423#discussion_r33467960 --- Diff: yarn/history/src/main/scala/org/apache/spark/deploy/history/yarn/YarnHistoryProvider.scala --- @@ -0,0 +1,1015 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-8402][MLLIB] DP Means Clustering

2015-06-29 Thread FlytxtRnD
Github user FlytxtRnD commented on the pull request: https://github.com/apache/spark/pull/6880#issuecomment-116645007 @mengxr Could you please say your comments on this PR ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-6263][MLLIB] Python MLlib API missing i...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5707#issuecomment-116645468 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/7082#issuecomment-116657416 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7082#issuecomment-116658293 [Test build #35985 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35985/consoleFull) for PR 7082 at commit

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7082#issuecomment-116657944 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8704] [ML] [PySpark] Add additional met...

2015-06-29 Thread MechCoder
Github user MechCoder commented on the pull request: https://github.com/apache/spark/pull/7086#issuecomment-116664808 This breaks `model.transform(doc).collect()` for `Word2Vec` but I do not understand why. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-8405][WebUI] Show executor logs on Web ...

2015-06-29 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/7033#issuecomment-116664781 Unfortunately YARN --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-06-29 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/5423#discussion_r33465661 --- Diff: docs/monitoring.md --- @@ -256,6 +256,157 @@ still required, though there is only one application available. Eg. to see the running

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/7082#issuecomment-116669695 LGTM. After test #35985 pass, I'll merge this into `master`. Thanks @zsxwing for your contribution! --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-116670483 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-116670346 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-6735:[YARN] Adding properties to disable...

2015-06-29 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/5449#issuecomment-116689661 @twinkle-sachdeva do you have time to address at Sandy's comments --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: SPARK-8374] [YARN] Job frequently hangs after ...

2015-06-29 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/7083#issuecomment-116693495 @xuchenCN can you add the first [ to the description before jira number --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-29 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-116698303 @tgravescs, I think the problem of shipping R itself is that R executable is platform specific. Also it may require OS specific installation before running R (not

[GitHub] spark pull request: [SPARK-7013][ML][test]Add unit test for spark....

2015-06-29 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/6665#discussion_r33459310 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/StandardScalerSuite.scala --- @@ -0,0 +1,108 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [CORE] [SPARK-6593] Provide option for HadoopR...

2015-06-29 Thread tigerquoll
Github user tigerquoll commented on the pull request: https://github.com/apache/spark/pull/5250#issuecomment-116651383 Correct. Cheers,Dale. Date: Fri, 19 Jun 2015 06:01:26 -0700 From: notificati...@github.com To: sp...@noreply.github.com CC:

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116654128 [Test build #35984 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35984/consoleFull) for PR 6982 at commit

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread sarutak
Github user sarutak commented on a diff in the pull request: https://github.com/apache/spark/pull/7082#discussion_r33462776 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala --- @@ -572,55 +572,55 @@ private[ui] class StagePage(parent: StagesTab) extends

[GitHub] spark pull request: [SPARK-8693][Project Infra]: profiles and goal...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7085#issuecomment-116660962 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116660971 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8704] [ML] [PySpark] Add additional met...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7086#issuecomment-116662430 [Test build #35988 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35988/consoleFull) for PR 7086 at commit

[GitHub] spark pull request: [SPARK-8704] [ML] [PySpark] Add additional met...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7086#issuecomment-116662264 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Spark-8703] [ML] Add CountVectorizer as a ml ...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7084#issuecomment-116663360 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-06-29 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/5423#discussion_r33466020 --- Diff: yarn/history/src/main/scala/org/apache/spark/deploy/history/yarn/YarnHistoryProvider.scala --- @@ -0,0 +1,1015 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-116673790 [Test build #35989 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35989/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-8704] [ML] [PySpark] Add additional met...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7086#issuecomment-116680056 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-4449][Core]Specify port range in spark

2015-06-29 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/5722#issuecomment-116688294 I haven't been keeping up with this. @vanzin @srowen do you have further comments on this? --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [Spark-8703] [ML] Add CountVectorizer as a ml ...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7084#issuecomment-116638087 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Spark-8703] [ML] Add CountVectorizer as a ml ...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7084#issuecomment-116638157 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8700][ML] Disable feature scaling in Lo...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7080#issuecomment-116638244 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8700][ML] Disable feature scaling in Lo...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7080#issuecomment-116638099 [Test build #35976 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35976/console) for PR 7080 at commit

[GitHub] spark pull request: [SPARK-8405][WebUI] Show executor logs on Web ...

2015-06-29 Thread carsonwang
Github user carsonwang commented on the pull request: https://github.com/apache/spark/pull/7033#issuecomment-116643570 After configuring yarn.log.server.url in yarn-site.xml, the log url will be redirected to MR job history server to show the spark log. This means the user has to

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-06-29 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/5423#discussion_r33459858 --- Diff: yarn/history/src/main/scala/org/apache/spark/deploy/history/yarn/YarnHistoryProvider.scala --- @@ -0,0 +1,1015 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-8693][Project Infra]: profiles and goal...

2015-06-29 Thread brennonyork
GitHub user brennonyork opened a pull request: https://github.com/apache/spark/pull/7085 [SPARK-8693][Project Infra]: profiles and goals are not printed in a nice way Hotfix to correct formatting errors of print statements within the dev and jenkins builds. Error looks like:

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116661524 [Test build #35987 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35987/consoleFull) for PR 6982 at commit

[GitHub] spark pull request: [SPARK-8704] [ML] [PySpark] Add additional met...

2015-06-29 Thread MechCoder
GitHub user MechCoder opened a pull request: https://github.com/apache/spark/pull/7086 [SPARK-8704] [ML] [PySpark] Add additional methods to wrappers in ml.pyspark.feature Add std, mean to StandardScalerModel getVectors, findSynonyms to Word2Vec Model setFeatures and

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-06-29 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/5423#issuecomment-116667971 Thanks for sitting down to review it; it has grown to handle the end to end problem, auth, unreliable endpoints, etc, where some complexity is always the curse.

[GitHub] spark pull request: [SPARK-8704] [ML] [PySpark] Add additional met...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7086#issuecomment-116679844 [Test build #35988 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35988/console) for PR 7086 at commit

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-06-29 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/5423#discussion_r33467225 --- Diff: yarn/history/src/main/scala/org/apache/spark/deploy/history/yarn/YarnHistoryProvider.scala --- @@ -0,0 +1,1015 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-8618] Obtain hbase token retries many t...

2015-06-29 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/7007#discussion_r33467275 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1258,10 +1258,17 @@ object Client extends Logging {

[GitHub] spark pull request: [SPARK-6263][MLLIB] Python MLlib API missing i...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5707#issuecomment-116646719 [Test build #35983 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35983/consoleFull) for PR 5707 at commit

[GitHub] spark pull request: [Spark-8703] [ML] Add CountVectorizer as a ml ...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7084#issuecomment-116652988 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116652902 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/7082#discussion_r33462112 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala --- @@ -572,55 +572,55 @@ private[ui] class StagePage(parent: StagesTab) extends

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7082#issuecomment-116656454 [Test build #979 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/979/console) for PR 7082 at commit

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7082#issuecomment-116657924 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7082#issuecomment-116659288 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7082#issuecomment-116659244 [Test build #35980 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35980/console) for PR 7082 at commit

[GitHub] spark pull request: [SPARK-8693][Project Infra]: profiles and goal...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7085#issuecomment-116661002 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116661050 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4666] Improve YarnAllocator's parsing o...

2015-06-29 Thread ilganeli
Github user ilganeli commented on the pull request: https://github.com/apache/spark/pull/3525#issuecomment-116662486 @srowen @JoshRosen I think this should be refactored to use the updates from #5574 but I don't think #5574 resolves this on its own because of the need to handle the

[GitHub] spark pull request: [Spark-8703] [ML] Add CountVectorizer as a ml ...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7084#issuecomment-116663308 [Test build #35982 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35982/console) for PR 7084 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-116674814 [Test build #35989 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35989/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-8618] Obtain hbase token retries many t...

2015-06-29 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/7007#issuecomment-116670907 What is the use case for adding hbase jars but not the configuration? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-8625] [Core] Propagate user exceptions ...

2015-06-29 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7014#discussion_r33468301 --- Diff: core/src/main/scala/org/apache/spark/TaskEndReason.scala --- @@ -97,11 +101,17 @@ case class ExceptionFailure( description: String,

[GitHub] spark pull request: [SPARK-8657] [YARN] Simplify method addResourc...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7053#issuecomment-116591124 [Test build #976 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/976/consoleFull) for PR 7053 at commit

[GitHub] spark pull request: [SPARK-7871][SQL]Improve the outputPartitionin...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6413#issuecomment-116591217 [Test build #35975 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35975/consoleFull) for PR 6413 at commit

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7082#issuecomment-116621564 [Test build #979 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/979/consoleFull) for PR 7082 at commit

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/7082#issuecomment-116630589 Oh, I see. could you file another one as a separate issue? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-8700][ML] Disable feature scaling in Lo...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7080#issuecomment-116591832 [Test build #35976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35976/consoleFull) for PR 7080 at commit

[GitHub] spark pull request: [SPARK-8590][SQL] add code gen for ExtractValu...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6982#issuecomment-116591859 [Test build #35979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35979/consoleFull) for PR 6982 at commit

[GitHub] spark pull request: [SPARK-8701][Streaming][WebUI] Add input metad...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7081#issuecomment-116621962 [Test build #35977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35977/console) for PR 7081 at commit

[GitHub] spark pull request: [SPARK-8701][Streaming][WebUI] Add input metad...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7081#issuecomment-116621984 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8625] [Core] Propagate user exceptions ...

2015-06-29 Thread tomwhite
Github user tomwhite commented on a diff in the pull request: https://github.com/apache/spark/pull/7014#discussion_r33454836 --- Diff: core/src/main/scala/org/apache/spark/TaskEndReason.scala --- @@ -97,11 +101,17 @@ case class ExceptionFailure( description: String,

[GitHub] spark pull request: [Spark-8703] [ML] Add CountVectorizer as a ml ...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7084#issuecomment-116628270 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Spark-8703] [ML] Add CountVectorizer as a ml ...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7084#issuecomment-116628338 [Test build #35981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35981/consoleFull) for PR 7084 at commit

[GitHub] spark pull request: [Spark-8703] [ML] Add CountVectorizer as a ml ...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7084#issuecomment-116628258 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7871][SQL]Improve the outputPartitionin...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6413#issuecomment-116628777 [Test build #35975 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35975/console) for PR 6413 at commit

[GitHub] spark pull request: [SPARK-7871][SQL]Improve the outputPartitionin...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6413#issuecomment-116628800 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread sarutak
Github user sarutak commented on a diff in the pull request: https://github.com/apache/spark/pull/7082#discussion_r33457314 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala --- @@ -572,55 +572,55 @@ private[ui] class StagePage(parent: StagesTab) extends

[GitHub] spark pull request: [SPARK-8657] [YARN] Fail to upload conf archiv...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7055#issuecomment-116630838 [Test build #977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/977/consoleFull) for PR 7055 at commit

[GitHub] spark pull request: [SPARK-7735] [pyspark] Raise Exception on non-...

2015-06-29 Thread megatron-me-uk
Github user megatron-me-uk commented on a diff in the pull request: https://github.com/apache/spark/pull/6262#discussion_r33448014 --- Diff: python/pyspark/tests.py --- @@ -874,6 +874,15 @@ def test_sortByKey_uses_all_partitions_not_only_first_and_last(self): for

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/7082#issuecomment-116612731 @sarutak I also find another issue in the console. Because `System.currentTimeMillis()` is not accurate for tasks that only need several milliseconds, sometimes

[GitHub] spark pull request: [SPARK-8701][Streaming][WebUI] Add input metad...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7081#issuecomment-116592009 [Test build #35977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35977/consoleFull) for PR 7081 at commit

[GitHub] spark pull request: [SPARK-8214][SQL]Add function hex

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6976#issuecomment-116591873 [Test build #35978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35978/consoleFull) for PR 6976 at commit

[GitHub] spark pull request: SPARK-8374] [YARN] Job frequently hangs after ...

2015-06-29 Thread xuchenCN
GitHub user xuchenCN opened a pull request: https://github.com/apache/spark/pull/7083 SPARK-8374] [YARN] Job frequently hangs after YARN preemption Issue description [SPARK-8374](https://issues.apache.org/jira/browse/SPARK-8374) Application starve because YARN scheduler

[GitHub] spark pull request: [SPARK-8702][WebUI]Avoid massive concating str...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7082#issuecomment-116609513 [Test build #35980 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35980/consoleFull) for PR 7082 at commit

[GitHub] spark pull request: [SPARK-8214][SQL]Add function hex

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6976#issuecomment-116629588 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-7889 Jobs progress of apps on complete p...

2015-06-29 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-116592795 I like the selenium test; it could be combined with the provider i wrote which lets us programmatically create our own history, so add changes we can look for.

[GitHub] spark pull request: [SPARK-8214][SQL]Add function hex

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6976#issuecomment-116629493 [Test build #35978 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35978/console) for PR 6976 at commit

[GitHub] spark pull request: [SPARK-8657] [YARN] Fail to upload conf archiv...

2015-06-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7055#issuecomment-116591021 [Test build #977 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/977/consoleFull) for PR 7055 at commit

[GitHub] spark pull request: [SPARK-8700][ML] Disable feature scaling in Lo...

2015-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7080#issuecomment-116590952 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

  1   2   3   4   5   6   7   8   9   10   >