[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304829#comment-15304829
]
Szehon Ho commented on HIVE-13376:
--
Sounds like a good plan to me, thanks for digging into this.
> HoS
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303395#comment-15303395
]
Xuefu Zhang commented on HIVE-13376:
Sounds good to me, [~lirui]. Disabling
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303379#comment-15303379
]
Rui Li commented on HIVE-13376:
---
[~xuefuz], [~szehon] - I just did more tests about this and want to correct
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302634#comment-15302634
]
Xuefu Zhang commented on HIVE-13376:
[~lirui], There are some suggestions in HIVE-12569, including
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302623#comment-15302623
]
Szehon Ho commented on HIVE-13376:
--
Sorry I thought this interval only controlled logging and not the
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301613#comment-15301613
]
Rui Li commented on HIVE-13376:
---
Hi [~xuefuz], I just briefly looked at the code. Although there're switches
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300301#comment-15300301
]
Xuefu Zhang commented on HIVE-13376:
Yeah. I meant that maybe we don't need to change the interval.
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300260#comment-15300260
]
Rui Li commented on HIVE-13376:
---
Spark checks the app state and then (optionally) logs the state report. No
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300039#comment-15300039
]
Xuefu Zhang commented on HIVE-13376:
I think the issue is about logging, not about state checking. I
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299669#comment-15299669
]
Rui Li commented on HIVE-13376:
---
I think the default 60s interval is a little too long. Spark will at least
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15221135#comment-15221135
]
Hive QA commented on HIVE-13376:
Here are the results of testing the latest attachment:
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219230#comment-15219230
]
Xuefu Zhang commented on HIVE-13376:
+1 on my side too. As a side note, this is a dupe of HIVE-12569,
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219163#comment-15219163
]
Rui Li commented on HIVE-13376:
---
Thanks [~szehon] for the update.
+1.
> HoS emits too many logs with
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217289#comment-15217289
]
Rui Li commented on HIVE-13376:
---
Thanks [~szehon] for the fix!
I found the config in spark code but not in
[
https://issues.apache.org/jira/browse/HIVE-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217131#comment-15217131
]
Szehon Ho commented on HIVE-13376:
--
Actually I made a mistake, this is controlled by the spark-submit.
15 matches
Mail list logo