[jira] [Commented] (YARN-3500) Optimize ResourceManager Web loading speed
[ https://issues.apache.org/jira/browse/YARN-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606262#comment-14606262 ] Ravi Prakash commented on YARN-3500: I'm not sure *why* it was moved to client side. Maybe [~vicaya] knows? > Optimize ResourceManager Web loading speed > -- > > Key: YARN-3500 > URL: https://issues.apache.org/jira/browse/YARN-3500 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Peter Shi > > after running 10k jobs, resoucemanager webui load speed become slow. As > server side send 10k jobs information in one response, parsing and rendering > page will cost a long time. Current paging logic is done in browser side. > This issue makes server side to do the paging logic, so that the loading will > be fast. > Loading 10k jobs costs 55 sec. loading 2k costs 7 sec -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3500) Optimize ResourceManager Web loading speed
[ https://issues.apache.org/jira/browse/YARN-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605245#comment-14605245 ] Peter Shi commented on YARN-3500: - [~kasha] - i think we can do server side paging by passing the application ranges to server. [~raviprak] - do you know why the paging was moved to client side?? Because of the server side load can not be controlled? > Optimize ResourceManager Web loading speed > -- > > Key: YARN-3500 > URL: https://issues.apache.org/jira/browse/YARN-3500 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Peter Shi > > after running 10k jobs, resoucemanager webui load speed become slow. As > server side send 10k jobs information in one response, parsing and rendering > page will cost a long time. Current paging logic is done in browser side. > This issue makes server side to do the paging logic, so that the loading will > be fast. > Loading 10k jobs costs 55 sec. loading 2k costs 7 sec -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3500) Optimize ResourceManager Web loading speed
[ https://issues.apache.org/jira/browse/YARN-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503294#comment-14503294 ] Ravi Prakash commented on YARN-3500: We have gone back and forth on paging server side and client side. The earlier UI used to be paged server side. For some reason, paging was moved to client side. One of them was that even for 10k jobs, the amount of JSON data was pretty small. [~shihaoliang] Have you profiled where those 55 seconds were spent? How much of that was network transfer? Personally I like server side paging, specially if we default to showing a LOT of jobs. I'd be in favor of [Server-side Datatables|https://www.datatables.net/examples/data_sources/server_side.html] (but it may require a lot of effort). > Optimize ResourceManager Web loading speed > -- > > Key: YARN-3500 > URL: https://issues.apache.org/jira/browse/YARN-3500 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Peter Shi > > after running 10k jobs, resoucemanager webui load speed become slow. As > server side send 10k jobs information in one response, parsing and rendering > page will cost a long time. Current paging logic is done in browser side. > This issue makes server side to do the paging logic, so that the loading will > be fast. > Loading 10k jobs costs 55 sec. loading 2k costs 7 sec -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3500) Optimize ResourceManager Web loading speed
[ https://issues.apache.org/jira/browse/YARN-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500162#comment-14500162 ] Karthik Kambatla commented on YARN-3500: [~shihaoliang] - do you have a patch in mind? > Optimize ResourceManager Web loading speed > -- > > Key: YARN-3500 > URL: https://issues.apache.org/jira/browse/YARN-3500 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Peter Shi > > after running 10k jobs, resoucemanager webui load speed become slow. As > server side send 10k jobs information in one response, parsing and rendering > page will cost a long time. Current paging logic is done in browser side. > This issue makes server side to do the paging logic, so that the loading will > be fast. > Loading 10k jobs costs 55 sec. loading 2k costs 7 sec -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3500) Optimize ResourceManager Web loading speed
[ https://issues.apache.org/jira/browse/YARN-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499297#comment-14499297 ] Peter Shi commented on YARN-3500: - Yes, i have mark 3499 with duplicate > Optimize ResourceManager Web loading speed > -- > > Key: YARN-3500 > URL: https://issues.apache.org/jira/browse/YARN-3500 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Peter Shi >Priority: Minor > > after running 10k jobs, resoucemanager webui load speed become slow. As > server side send 10k jobs information in one response, parsing and rendering > page will cost a long time. Current paging logic is done in browser side. > This issue makes server side to do the paging logic, so that the loading will > be fast. > Loading 10k jobs costs 55 sec. loading 2k costs 7 sec -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3500) Optimize ResourceManager Web loading speed
[ https://issues.apache.org/jira/browse/YARN-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499183#comment-14499183 ] Naganarasimha G R commented on YARN-3500: - I think by mistake submitter raised the same issue twice this & yarn-3499 > Optimize ResourceManager Web loading speed > -- > > Key: YARN-3500 > URL: https://issues.apache.org/jira/browse/YARN-3500 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Peter Shi >Priority: Minor > > after running 10k jobs, resoucemanager webui load speed become slow. As > server side send 10k jobs information in one response, parsing and rendering > page will cost a long time. Current paging logic is done in browser side. > This issue makes server side to do the paging logic, so that the loading will > be fast. > Loading 10k jobs costs 55 sec. loading 2k costs 7 sec -- This message was sent by Atlassian JIRA (v6.3.4#6332)
