[
https://issues.apache.org/jira/browse/HIVE-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HIVE-2858:
------------------------------
Attachment: HIVE-2858.D2223.1.patch
kevinwilfong requested code review of "HIVE-2858 [jira] Cache remote map reduce
job stack traces for additional logging".
Reviewers: JIRA
https://issues.apache.org/jira/browse/HIVE-2858
Modified the JobDebugger and TaskLogProcessor to parse out stack traces from
failed task logs. These are stored in a mapping from job ID to stack traces in
the SessionState.
Currently we are parsing the task logs for failed jobs for information to
display to the user in the CLI. In addition, we could parse those logs for
stack traces and store e them in the SessionState. This way, when we log
failed queries, these will give us a decent idea of why those queries failed.
TEST PLAN
EMPTY
REVISION DETAIL
https://reviews.facebook.net/D2223
AFFECTED FILES
conf/hive-default.xml.template
build-common.xml
common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
ql/src/test/results/clientnegative/mapreduce_stack_trace_turnoff.q.out
ql/src/test/results/clientnegative/mapreduce_stack_trace.q.out
ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifySessionStateStackTracesHook.java
ql/src/test/queries/clientnegative/mapreduce_stack_trace.q
ql/src/test/queries/clientnegative/mapreduce_stack_trace_turnoff.q
ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
ql/src/java/org/apache/hadoop/hive/ql/exec/JobDebugger.java
ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java
ql/src/java/org/apache/hadoop/hive/ql/exec/errors/TaskLogProcessor.java
ql/src/java/org/apache/hadoop/hive/ql/Driver.java
MANAGE HERALD DIFFERENTIAL RULES
https://reviews.facebook.net/herald/view/differential/
WHY DID I GET THIS EMAIL?
https://reviews.facebook.net/herald/transcript/4875/
Tip: use the X-Herald-Rules header to filter Herald messages in your client.
> Cache remote map reduce job stack traces for additional logging
> ---------------------------------------------------------------
>
> Key: HIVE-2858
> URL: https://issues.apache.org/jira/browse/HIVE-2858
> Project: Hive
> Issue Type: Improvement
> Components: Logging
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Attachments: HIVE-2858.D2223.1.patch
>
>
> Currently we are parsing the task logs for failed jobs for information to
> display to the user in the CLI. In addition, we could parse those logs for
> stack traces and store e them in the SessionState. This way, when we log
> failed queries, these will give us a decent idea of why those queries failed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
