[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-27 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304829#comment-15304829 ] Szehon Ho commented on HIVE-13376: -- Sounds like a good plan to me, thanks for digging into this. > HoS

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303395#comment-15303395 ] Xuefu Zhang commented on HIVE-13376: Sounds good to me, [~lirui]. Disabling

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-26 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303379#comment-15303379 ] Rui Li commented on HIVE-13376: --- [~xuefuz], [~szehon] - I just did more tests about this and want to correct

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302634#comment-15302634 ] Xuefu Zhang commented on HIVE-13376: [~lirui], There are some suggestions in HIVE-12569, including

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302623#comment-15302623 ] Szehon Ho commented on HIVE-13376: -- Sorry I thought this interval only controlled logging and not the

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-26 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301613#comment-15301613 ] Rui Li commented on HIVE-13376: --- Hi [~xuefuz], I just briefly looked at the code. Although there're switches

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300301#comment-15300301 ] Xuefu Zhang commented on HIVE-13376: Yeah. I meant that maybe we don't need to change the interval.

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300260#comment-15300260 ] Rui Li commented on HIVE-13376: --- Spark checks the app state and then (optionally) logs the state report. No

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300039#comment-15300039 ] Xuefu Zhang commented on HIVE-13376: I think the issue is about logging, not about state checking. I

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-05-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299669#comment-15299669 ] Rui Li commented on HIVE-13376: --- I think the default 60s interval is a little too long. Spark will at least

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-03-31 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15221135#comment-15221135 ] Hive QA commented on HIVE-13376: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-03-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219230#comment-15219230 ] Xuefu Zhang commented on HIVE-13376: +1 on my side too. As a side note, this is a dupe of HIVE-12569,

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-03-30 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219163#comment-15219163 ] Rui Li commented on HIVE-13376: --- Thanks [~szehon] for the update. +1. > HoS emits too many logs with

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-03-29 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217289#comment-15217289 ] Rui Li commented on HIVE-13376: --- Thanks [~szehon] for the fix! I found the config in spark code but not in

[jira] [Commented] (HIVE-13376) HoS emits too many logs with application state

2016-03-29 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217131#comment-15217131 ] Szehon Ho commented on HIVE-13376: -- Actually I made a mistake, this is controlled by the spark-submit.