[jira] [Updated] (MAPREDUCE-6248) Allow users to get the MR job information for distcp
[
https://issues.apache.org/jira/browse/MAPREDUCE-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kumar Vavilapalli updated MAPREDUCE-6248:
---
Resolution: Fixed
Fix Version/s: 2.7.0
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Committed this to trunk and branch-2. Thanks Jing!
Allow users to get the MR job information for distcp
Key: MAPREDUCE-6248
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6248
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: distcp
Reporter: Jing Zhao
Assignee: Jing Zhao
Fix For: 2.7.0
Attachments: MAPREDUCE-6248.000.patch, MAPREDUCE-6248.001.patch
Currently the DistCp is acting as a tool and the corresponding MapReduce Job
is created and used inside of its {{execute}} method. It is thus difficult
for external services to query its progress and counters. It may be helpful
to persist the job id into a file inside its staging directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6248) Allow users to get the MR job information for distcp
[
https://issues.apache.org/jira/browse/MAPREDUCE-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhao updated MAPREDUCE-6248:
-
Attachment: MAPREDUCE-6248.001.patch
Thanks for the review, Vinod! Update the patch to address your comments. Now
DistCp keeps its constructor, {{run}} (overriding {{Tool}}), and {{execute}}
(which has been called by downstream applications) as public. Also two
additional public methods are added: {{createAndSubmitJob}} and
{{waitForJobCompletion}}.
Allow users to get the MR job information for distcp
Key: MAPREDUCE-6248
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6248
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: distcp
Reporter: Jing Zhao
Assignee: Jing Zhao
Attachments: MAPREDUCE-6248.000.patch, MAPREDUCE-6248.001.patch
Currently the DistCp is acting as a tool and the corresponding MapReduce Job
is created and used inside of its {{execute}} method. It is thus difficult
for external services to query its progress and counters. It may be helpful
to persist the job id into a file inside its staging directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6248) Allow users to get the MR job information for distcp
[
https://issues.apache.org/jira/browse/MAPREDUCE-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhao updated MAPREDUCE-6248:
-
Status: Patch Available (was: Open)
Allow users to get the MR job information for distcp
Key: MAPREDUCE-6248
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6248
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: distcp
Reporter: Jing Zhao
Assignee: Jing Zhao
Attachments: MAPREDUCE-6248.000.patch
Currently the DistCp is acting as a tool and the corresponding MapReduce Job
is created and used inside of its {{execute}} method. It is thus difficult
for external services to query its progress and counters. It may be helpful
to persist the job id into a file inside its staging directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6248) Allow users to get the MR job information for distcp
[
https://issues.apache.org/jira/browse/MAPREDUCE-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhao updated MAPREDUCE-6248:
-
Summary: Allow users to get the MR job information for distcp (was:
Persist DistCp job id in the staging directory)
Allow users to get the MR job information for distcp
Key: MAPREDUCE-6248
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6248
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: distcp
Reporter: Jing Zhao
Assignee: Jing Zhao
Attachments: MAPREDUCE-6248.000.patch
Currently the DistCp is acting as a tool and the corresponding MapReduce Job
is created and used inside of its {{execute}} method. It is thus difficult
for external services to query its progress and counters. It may be helpful
to persist the job id into a file inside its staging directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
