[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-22 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21268 thanks @vanzin. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-21 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/21268 Merging to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-17 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21268 @vanzin thanks for your review. I checked the comment you mentioned. My understanding is that the property `spark.ui.proxyBase` is used by Oozie and in particular it is set bu the AM of

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21268 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90698/ Test PASSed. ---

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21268 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21268 **[Test build #90698 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90698/testReport)** for PR 21268 at commit

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21268 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21268 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3275/

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-16 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/21268 BTW you could probably avoid the plumbing (and noise) by using a DynamicVariable but that feels too hacky and brittle, so I actually prefer this. ---

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21268 **[Test build #90698 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90698/testReport)** for PR 21268 at commit

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-16 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/21268 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-16 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/21268 I took a look and it looks ok. I'm just confused about the YARN comments, since the AM does not set anything (the YARN NM will set the `APPLICATION_WEB_PROXY_BASE` env variable, but nothing else

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-15 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21268 @vanzin do you happen to have any time for checking this please? Thanks. --- - To unsubscribe, e-mail:

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-09 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21268 @vanzin may you please take a look at this too? Thanks. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-09 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21268 @jerryshao I don't think we can miss them. The main change here is the `uiRoot` requires the `request` object. So if you miss to provide it the object, it doesn't compile. All the other changes

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-09 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/21268 I'm still thinking this change requires so many updates across the whole project, and we may miss it in future if someone add new codes. Though I'm not familiar with knox, my question is that

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-09 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21268 Thanks for your comment @jerryshao. Unfortunately I don't think so. Since through the SHS you can access all the other pages, all of them have to support the proper detection of the proxy base as

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/21268 The changes here seems affect so many places, I'm wondering if there's any other way to minimize the changes? --- - To

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21268 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90369/ Test PASSed. ---

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21268 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21268 **[Test build #90369 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90369/testReport)** for PR 21268 at commit

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21268 @nrchakradhar if the load balancer fills the header `X-Forwarded-Context` with the proper base path, then this will work. ---

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21268 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3040/

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread nrchakradhar
Github user nrchakradhar commented on the issue: https://github.com/apache/spark/pull/21268 @mgaido91 Just a query. Is this specific to Knox only or will it work when the HistoryServer UI is proxied by different load balancer? ---

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21268 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21268 **[Test build #90369 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90369/testReport)** for PR 21268 at commit

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21268 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21268 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90366/ Test FAILed. ---

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21268 **[Test build #90366 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90366/testReport)** for PR 21268 at commit

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21268 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3038/

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21268 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21268 **[Test build #90366 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90366/testReport)** for PR 21268 at commit

[GitHub] spark issue #21268: [SPARK-24209][SHS] Automatic retrieve proxyBase from Kno...

2018-05-08 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21268 @jerryshao may you please review this when you have time? Thanks. --- - To unsubscribe, e-mail: