[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046007#comment-15046007 ] Vinod Kumar Vavilapalli commented on YARN-3368: --- bq. In order to advance the work faster, I propose to create a new branch (YARN-3368), so more people can participate development/discussion. All UI-related code changes will be in a separated folder "hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui". +1. > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: (Dec 3 2015) yarn-ui-screenshots.zip, (POC, Aug-2015)) > yarn-ui-screenshots.zip > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042263#comment-15042263 ] Jian He commented on YARN-3368: --- +1 to create the branch now. > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: (Dec 3 2015) yarn-ui-screenshots.zip, (POC, Aug-2015)) > yarn-ui-screenshots.zip > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041879#comment-15041879 ] Li Lu commented on YARN-3368: - +1 for a new branch. We can merge with the progress in this branch periodically with the YARN-2928 branch to build the UI for ATS v2 in YARN-2928 branch. > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: (Dec 3 2015) yarn-ui-screenshots.zip, (POC, Aug-2015)) > yarn-ui-screenshots.zip > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15039532#comment-15039532 ] Wangda Tan commented on YARN-3368: -- Hi guys, Some updates of the new YARN web UI works: - Rewrote the UI framework (Still using Ember.JS) so new pages/charts can be added easier. - Finished scheduler page, which contains a select-able queue hierarchy view and also related scheduler information. - Finished apps table, app page, app-attempt page and also timeline view of app-attempts/containers. - Finished cluster overview page, which contains several charts to show overview of the cluster (such as total memory, total apps, etc.) Attached screenshots to demostrate latest changes. There're still many pending tasks - Finalize design. - Page of node managers' view. - Bugs / hardcoded configurations. In order to advance the work faster, I propose to create a new branch (YARN-3368), so more people can participate development/discussion. All UI-related code changes will be in a separated folder "hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui". Thanks for [~Sreenath], [~vinodkv], [~jianhe], [~gtCarrera] for supports and suggestions. Thoughts? > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: (Dec 3 2015) yarn-ui-screenshots.zip > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15039537#comment-15039537 ] Wangda Tan commented on YARN-3368: -- This task depends on some fixes of REST APIs, which is tracked by YARN-4417. > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: (Dec 3 2015) yarn-ui-screenshots.zip, (POC, Aug-2015)) > yarn-ui-screenshots.zip > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728906#comment-14728906 ] Naganarasimha G R commented on YARN-3368: - Hi Well came across an issue while installing as per the readme.md in ubuntu 14.04, 64 bit took little alternate steps to get it running (but in other Ubuntu setup steps in Readme.md was sufficient) * sudo apt-get update * sudo apt-get install nodejs * sudo apt-get install npm test following commands, node --help npm --help If the output is not coming then we can follow below steps : *sudo apt-get remove npm *sudo apt-get remove nodejs *wget http://nodejs.org/dist/v0.12.0/node-v0.12.7-linux-x64.tar.gz *sudo tar -C /usr/local --strip-components 1 -xzf node-v0.12.7-linux-x64.tar.gz verify *ls -l /usr/local/bin/node *ls -l /usr/local/bin/npm * sudo npm install bower -g * sudo npm install -g ember-cli * cd /hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui * npm install && bower install no changes in yarn-app.js as per the configuration default settings of "http://localhost:1337/localhost:8088; should work * sudo npm install -g corsproxy * nohup corsproxy > corsproxy.log 2>&1 & * ember serve * visit "http://localhost:4200; > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: Applications-table-Screenshot.png, > Queue-Hierarchy-Screenshot.png, YARN-3368.poc.1.patch > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729009#comment-14729009 ] Varun Saxena commented on YARN-3368: I have the exact same Ubuntu version and did not face any issues. For installing ember though, I followed steps on the ember js website(same as readme). That in turn gives a link for installing nodejs(given below). https://github.com/nodejs/node-v0.x-archive/wiki/Installing-Node.js-via-package-manager > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: Applications-table-Screenshot.png, > Queue-Hierarchy-Screenshot.png, YARN-3368.poc.1.patch > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729013#comment-14729013 ] Varun Saxena commented on YARN-3368: I think the reason you faced issues and I didnt may be because of the way installation of nodejs was done. > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: Applications-table-Screenshot.png, > Queue-Hierarchy-Screenshot.png, YARN-3368.poc.1.patch > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14725753#comment-14725753 ] Wangda Tan commented on YARN-3368: -- [~kasha], My thought for this: we should include this in branch-2 to avoid divergence between trunk and branch-2, UI code should be relatively independent. New UI/old UI should be able to run together without affecting each other, and the new UI will be disabled by default. I'm not quite sure what did you mean by "it would break folks who scrape the site today." Thanks, > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: Applications-table-Screenshot.png, > Queue-Hierarchy-Screenshot.png, YARN-3368.poc.1.patch > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14725779#comment-14725779 ] Vinod Kumar Vavilapalli commented on YARN-3368: --- bq. When the patch is ready, do we intend to include this only in trunk I think we should get this into trunk, even if at the beginning as a separate non-integrated module, so that things like YARN-2928 UI can make progress. Branch-2 can wait for more progress on all fronts. > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: Applications-table-Screenshot.png, > Queue-Hierarchy-Screenshot.png, YARN-3368.poc.1.patch > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14725879#comment-14725879 ] Wangda Tan commented on YARN-3368: -- bq. I think we should get this into trunk, even if at the beginning as a separate non-integrated module, so that things like YARN-2928 UI can make progress. Branch-2 can wait for more progress on all fronts. Make sense to me. > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: Applications-table-Screenshot.png, > Queue-Hierarchy-Screenshot.png, YARN-3368.poc.1.patch > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726290#comment-14726290 ] Karthik Kambatla commented on YARN-3368: If one could turn it off, I am comfortable pulling this into branch-2 when it is ready. > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: Applications-table-Screenshot.png, > Queue-Hierarchy-Screenshot.png, YARN-3368.poc.1.patch > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726323#comment-14726323 ] Wangda Tan commented on YARN-3368: -- Thanks [~kasha]. > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: Applications-table-Screenshot.png, > Queue-Hierarchy-Screenshot.png, YARN-3368.poc.1.patch > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14725563#comment-14725563 ] Karthik Kambatla commented on YARN-3368: Looks neat. Thanks for working on this, Wangda. bq. This is a WIP project, nobody should use it in production. When the patch is ready, do we intend to include this only in trunk? Or, are you considering branch-2 as well. While it is definitely an improvement, it would break folks who scrape the site today. > Improve YARN web UI > --- > > Key: YARN-3368 > URL: https://issues.apache.org/jira/browse/YARN-3368 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: Jian He > Attachments: Applications-table-Screenshot.png, > Queue-Hierarchy-Screenshot.png, YARN-3368.poc.1.patch > > > The goal is to improve YARN UI for better usability. > We may take advantage of some existing front-end frameworks to build a > fancier, easier-to-use UI. > The old UI continue to exist until we feel it's ready to flip to the new UI. > This serves as an umbrella jira to track the tasks. we can do this in a > branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662545#comment-14662545 ] Li Lu commented on YARN-3368: - Hi [~jianhe] thanks for opening this JIRA. Right now on the YARN-2928 branch we're trying to build the web UI for ATS v2. We also have our currently proposed RESTful web services in YARN-3814 and will definitely add more. This said, I'm wondering if it's fine to use the on-going ATS v2's web UI as an experimental place for the new UI? We can try out the front end tools as well as our new web services when we build the new UI. If this proposal looks good, maybe we can link some ATS v2 web UI JIRAs here? Comments and suggestions are more than welcome! Improve YARN web UI --- Key: YARN-3368 URL: https://issues.apache.org/jira/browse/YARN-3368 Project: Hadoop YARN Issue Type: Improvement Reporter: Jian He The goal is to improve YARN UI for better usability. We may take advantage of some existing front-end frameworks to build a fancier, easier-to-use UI. The old UI continue to exist until we feel it's ready to flip to the new UI. This serves as an umbrella jira to track the tasks. we can do this in a branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14368820#comment-14368820 ] Steve Loughran commented on YARN-3368: -- This relates to YARN-2031 having full REST access to AMs. currently when some conditions are met (e.g. client attempting to GET from an AM that is still to launch, or completed) the RM proxy redirects to human-centric error pages, which confuses REST client apps. If there was a REST view, it'd be good to hook up (or at least have an option to) REST clients in a way which provided meaningful HTTP error codes in such situations, rather than just HTML text Improve YARN web UI --- Key: YARN-3368 URL: https://issues.apache.org/jira/browse/YARN-3368 Project: Hadoop YARN Issue Type: Improvement Reporter: Jian He The goal is to improve YARN UI for better usability. We may take advantage of some existing front-end frameworks to build a fancier, easier-to-use UI. The old UI continue to exist until we feel it's ready to flip to the new UI. This serves as an umbrella jira to track the tasks. we can do this in a branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370738#comment-14370738 ] Jian He commented on YARN-3368: --- Yes, we should refine the current web service and also expose the stuff that is missing. The intention is to build a nicer UI using some front-end tools like Bootstrap. yes, it can be on branch. Improve YARN web UI --- Key: YARN-3368 URL: https://issues.apache.org/jira/browse/YARN-3368 Project: Hadoop YARN Issue Type: Improvement Reporter: Jian He The goal is to improve YARN UI for better usability. We may take advantage of some existing front-end frameworks to build a fancier, easier-to-use UI. The old UI continue to exist until we feel it's ready to flip to the new UI. This serves as an umbrella jira to track the tasks. we can do this in a branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14369743#comment-14369743 ] Karthik Kambatla commented on YARN-3368: I would like for us to define the scope for this JIRA, and assume this will be worked on a branch? Improve YARN web UI --- Key: YARN-3368 URL: https://issues.apache.org/jira/browse/YARN-3368 Project: Hadoop YARN Issue Type: Improvement Reporter: Jian He The goal is to improve YARN UI for better usability. We may take advantage of some existing front-end frameworks to build a fancier, easier-to-use UI. The old UI continue to exist until we feel it's ready to flip to the new UI. This serves as an umbrella jira to track the tasks. we can do this in a branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3368) Improve YARN web UI
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14368269#comment-14368269 ] Jian He commented on YARN-3368: --- we may expose information through the web service and have the client make rest call to retrieve the data and render that on the UI. Improve YARN web UI --- Key: YARN-3368 URL: https://issues.apache.org/jira/browse/YARN-3368 Project: Hadoop YARN Issue Type: Improvement Reporter: Jian He The goal is to improve YARN UI for better usability. We may take advantage of some existing front-end frameworks to build a fancier, easier-to-use UI. The old UI continue to exist until we feel it's ready to flip to the new UI. This serves as an umbrella jira to track the tasks. we can do this in a branch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
