[jira] [Updated] (HIVE-14030) LLAP: implement LLAP UI as a separate service - part 2 - multi llap nodes
[ https://issues.apache.org/jira/browse/HIVE-14030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuya OZAWA updated HIVE-14030: -- Attachment: HIVE-14030.1.patch Thank you for assign to me. I attach WIP patch. This metrics monitor can access from HiveServer2 WebUI's "llap-metrics.html" or "LLAP Monitor" menu item. In this patch has two problem. First, this UI not been able to view some of the items. Look like Item name of some of the JMX has been changed. But single node ui does not follow. Now, I aggregate and displayed the same items. Second, if running a large number of the daemon, scroll becomes longer. I want to discuss how to resolve this problems . In the next patch, I will modify these problems. > LLAP: implement LLAP UI as a separate service - part 2 - multi llap nodes > - > > Key: HIVE-14030 > URL: https://issues.apache.org/jira/browse/HIVE-14030 > Project: Hive > Issue Type: Improvement > Components: llap >Reporter: Yuta Imai >Assignee: Yuya OZAWA > Attachments: HIVE-14030.1.patch > > > So far we have done single node LLAP UI on HIVE-11526. We are going to add > multi nodes capability for this UI so we can have a cluster wide metrics at a > glance. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HIVE-11526) LLAP: implement LLAP UI as a separate service
[ https://issues.apache.org/jira/browse/HIVE-11526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuya OZAWA reassigned HIVE-11526: - Assignee: Yuya OZAWA (was: Kai Sasaki) > LLAP: implement LLAP UI as a separate service > - > > Key: HIVE-11526 > URL: https://issues.apache.org/jira/browse/HIVE-11526 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Yuya OZAWA > Attachments: llap_monitor_design.pdf > > > The specifics are vague at this point. > Hadoop metrics can be output, as well as metrics we collect and output in > jmx, as well as those we collect per fragment and log right now. > This service can do LLAP-specific views, and per-query aggregation. > [~gopalv] may have some information on how to reuse existing solutions for > part of the work. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HIVE-11650) Create LLAP Monitor Daemon class and launch scripts
[ https://issues.apache.org/jira/browse/HIVE-11650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuya OZAWA reassigned HIVE-11650: - Assignee: Yuya OZAWA (was: Kai Sasaki) > Create LLAP Monitor Daemon class and launch scripts > --- > > Key: HIVE-11650 > URL: https://issues.apache.org/jira/browse/HIVE-11650 > Project: Hive > Issue Type: Sub-task >Affects Versions: llap >Reporter: Kai Sasaki >Assignee: Yuya OZAWA > Attachments: HIVE-11650-llap.00.patch, Screen Shot 2015-08-26 at > 16.54.35.png, example.patch > > > This JIRA for creating LLAP Monitor Daemon class and related launching > scripts for slider package. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11526) LLAP: implement LLAP UI as a separate service
[ https://issues.apache.org/jira/browse/HIVE-11526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039639#comment-15039639 ] Yuya OZAWA commented on HIVE-11526: --- Now status, running Monitoring web ui and Metrics Collector. Collector can get jmx metrics and it stored memory, but I will it use hadoop metrics2. Web service using hadoop webapp and diplay this metrics HTML table. And now I choosing plot library. > LLAP: implement LLAP UI as a separate service > - > > Key: HIVE-11526 > URL: https://issues.apache.org/jira/browse/HIVE-11526 > Project: Hive > Issue Type: Sub-task > Components: llap >Reporter: Sergey Shelukhin >Assignee: Yuya OZAWA > Attachments: llap_monitor_design.pdf > > > The specifics are vague at this point. > Hadoop metrics can be output, as well as metrics we collect and output in > jmx, as well as those we collect per fragment and log right now. > This service can do LLAP-specific views, and per-query aggregation. > [~gopalv] may have some information on how to reuse existing solutions for > part of the work. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11526) LLAP: implement LLAP UI as a separate service
[ https://issues.apache.org/jira/browse/HIVE-11526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuya OZAWA updated HIVE-11526: -- Attachment: HIVE-11526.patch I attached first patch. > LLAP: implement LLAP UI as a separate service > - > > Key: HIVE-11526 > URL: https://issues.apache.org/jira/browse/HIVE-11526 > Project: Hive > Issue Type: Sub-task > Components: llap >Reporter: Sergey Shelukhin >Assignee: Yuya OZAWA > Attachments: HIVE-11526.patch, llap_monitor_design.pdf > > > The specifics are vague at this point. > Hadoop metrics can be output, as well as metrics we collect and output in > jmx, as well as those we collect per fragment and log right now. > This service can do LLAP-specific views, and per-query aggregation. > [~gopalv] may have some information on how to reuse existing solutions for > part of the work. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11526) LLAP: implement LLAP UI as a separate service
[ https://issues.apache.org/jira/browse/HIVE-11526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15136520#comment-15136520 ] Yuya OZAWA commented on HIVE-11526: --- It can look single node metrics. http://:/webapps/llap/metrics.html port is hive.llap.daemon.web.port(default:15002) > LLAP: implement LLAP UI as a separate service > - > > Key: HIVE-11526 > URL: https://issues.apache.org/jira/browse/HIVE-11526 > Project: Hive > Issue Type: Sub-task > Components: llap >Reporter: Sergey Shelukhin >Assignee: Yuya OZAWA > Attachments: HIVE-11526.patch, llap_monitor_design.pdf > > > The specifics are vague at this point. > Hadoop metrics can be output, as well as metrics we collect and output in > jmx, as well as those we collect per fragment and log right now. > This service can do LLAP-specific views, and per-query aggregation. > [~gopalv] may have some information on how to reuse existing solutions for > part of the work. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11526) LLAP: implement LLAP UI as a separate service
[ https://issues.apache.org/jira/browse/HIVE-11526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuya OZAWA updated HIVE-11526: -- Attachment: HIVE-11526.2.patch Add inline plot using jquery.sparkline Remove Executor cup time and user time > LLAP: implement LLAP UI as a separate service > - > > Key: HIVE-11526 > URL: https://issues.apache.org/jira/browse/HIVE-11526 > Project: Hive > Issue Type: Sub-task > Components: llap >Reporter: Sergey Shelukhin >Assignee: Yuya OZAWA > Attachments: HIVE-11526.2.patch, HIVE-11526.patch, > llap_monitor_design.pdf > > > The specifics are vague at this point. > Hadoop metrics can be output, as well as metrics we collect and output in > jmx, as well as those we collect per fragment and log right now. > This service can do LLAP-specific views, and per-query aggregation. > [~gopalv] may have some information on how to reuse existing solutions for > part of the work. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11526) LLAP: implement LLAP UI as a separate service
[ https://issues.apache.org/jira/browse/HIVE-11526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuya OZAWA updated HIVE-11526: -- Status: Patch Available (was: Open) > LLAP: implement LLAP UI as a separate service > - > > Key: HIVE-11526 > URL: https://issues.apache.org/jira/browse/HIVE-11526 > Project: Hive > Issue Type: Sub-task > Components: llap >Reporter: Sergey Shelukhin >Assignee: Yuya OZAWA > Attachments: HIVE-11526.2.patch, HIVE-11526.3.patch, > HIVE-11526.patch, llap_monitor_design.pdf > > > The specifics are vague at this point. > Hadoop metrics can be output, as well as metrics we collect and output in > jmx, as well as those we collect per fragment and log right now. > This service can do LLAP-specific views, and per-query aggregation. > [~gopalv] may have some information on how to reuse existing solutions for > part of the work. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11526) LLAP: implement LLAP UI as a separate service
[ https://issues.apache.org/jira/browse/HIVE-11526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15150093#comment-15150093 ] Yuya OZAWA commented on HIVE-11526: --- Thank you for chack and .3 patch. > LLAP: implement LLAP UI as a separate service > - > > Key: HIVE-11526 > URL: https://issues.apache.org/jira/browse/HIVE-11526 > Project: Hive > Issue Type: Sub-task > Components: llap >Reporter: Sergey Shelukhin >Assignee: Yuya OZAWA > Attachments: HIVE-11526.2.patch, HIVE-11526.3.patch, > HIVE-11526.patch, llap_monitor_design.pdf > > > The specifics are vague at this point. > Hadoop metrics can be output, as well as metrics we collect and output in > jmx, as well as those we collect per fragment and log right now. > This service can do LLAP-specific views, and per-query aggregation. > [~gopalv] may have some information on how to reuse existing solutions for > part of the work. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11530) push limit thru outer join
[ https://issues.apache.org/jira/browse/HIVE-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698897#comment-14698897 ] Yuya OZAWA commented on HIVE-11530: --- Hi Sergey Shelukhin. I want to try this jira. Could you assign to me? Thank you. > push limit thru outer join > -- > > Key: HIVE-11530 > URL: https://issues.apache.org/jira/browse/HIVE-11530 > Project: Hive > Issue Type: Improvement > Components: Logical Optimizer >Reporter: Sergey Shelukhin > > When the query has a left or right outer join with limit, we can push the > limit into the left/right side of the join. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
