[ https://issues.apache.org/jira/browse/HADOOP-7209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238846#comment-13238846 ]
Daniel Dai commented on HADOOP-7209: ------------------------------------ The use case is user invoke rmdir from Pig script. If exception is thrown, the entire Pig script stop running. This might be expected behavior for some users, but other users just want to make sure the output path is removed before launching the mapreduce job, they don't want to fail the script. Currently Pig have a native implementation for the second case, but it would be much better FsShell provides this. > Extensions to FsShell > --------------------- > > Key: HADOOP-7209 > URL: https://issues.apache.org/jira/browse/HADOOP-7209 > Project: Hadoop Common > Issue Type: Improvement > Affects Versions: 0.20.3 > Reporter: Olga Natkovich > Assignee: Daryn Sharp > Fix For: 0.24.0 > > > Our project, Pig, exposes FsShell functionality to our end users through a > shell command. We want to use this command with no modifications to make sure > that whether you work with HDFS through Hadoop or Pig you get identical > semantics. > The main concern that has been recently raised by our users is that there is > no way to ignore certain failures that they consider to be benign, for > instance, removing a non-existent directory. > We have 2 asks related to this issue: > (1) Meaningful error code returned from FsShell (we use java class) so that > we can take different actions on different errors > (2) Unix like ways to tell the command to ignore certain behavior. Here are > the commands that we would like to be expanded/implemented: > * rm -f > * rmdir ---ignore-fail-on-non-empty > * mkdir -p -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira