Hi Shailendra,
How important is your data? I think the patch is not doing anything for you
because it prevents the error from happening, but it will not fix it if it
has already happened. Maybe you can try these directions from a previous
thread on the list, but make sure you backup your edits file first. What
you need to do is either create the directory
"/user/nutch/mycrawl/segments/20070109142516/parse_text",
or if it is being created, but in the wrong order, you need to move the
instruction to create it to before all the children files and directories
are created. Good luck!
Here are the steps:
This happened to me too, but the problem was the OP_MKDIR instructions
were in the wrong order. That is, in the edits file the parent
directory was created after the child. Maybe you should check to see
if that's the case.
I fixed it by using vi in combination with xxd. When you have the
file open in vi, press escape and issue the command "%!xxd". This
will convert the binary file to hexadecimal. Then you can search
through and perform the necessary edits. I don't remember what the
bytes were, but it was something like opcode, length of path (in
binary), path. After you're done, issue the command "%!xxd -r" to
revert it to binary. Remember to back up your files when you do this!
I also had to kick off a trailing byte that got tagged on for some
reason during the binary/hex conversion.
On 1/17/07, Shailendra Mudgal <[EMAIL PROTECTED]> wrote:
Hi,
I changed hadoop-0.9.1 with the hadoop-0.10.1 and still getting the error.
one more thing also i tried, i applied patch
http://issues.apache.org/jira/secure/attachment/12347815/namenodelocking1.patch
after this also it is not working..
Is there any idea ?
Regards,
Shailendra
On 1/17/07, Shailendra Mudgal <[EMAIL PROTECTED]> wrote:
>
> Hi Sean,
>
> Thanks for your prompt reply. Here is the error output.
>
>
> 2007-01-17 16:32:32,254 ERROR dfs.NameNode -
java.io.FileNotFoundException:
> Parent path does not exist:
> /user/nutch/mycrawl/segments/20070109142516/parse_text/part-00001
> at org.apache.hadoop.dfs.FSDirectory$INode.addNode(
> FSDirectory.java:186)
> at org.apache.hadoop.dfs.FSDirectory.unprotectedMkdir(
> FSDirectory.java:714)
> at org.apache.hadoop.dfs.FSEditLog.loadFSEdits (FSEditLog.java
> :254)
> at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:191)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(
FSDirectory.java
> :320)
> at org.apache.hadoop.dfs.FSNamesystem .<init>(FSNamesystem.java
> :226)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:142)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:134)
> at org.apache.hadoop.dfs.NameNode.main (NameNode.java:585)
>
>
> Thanks and Regards,
> ~Shailendra
>
> On 1/17/07, Sean Dean <[EMAIL PROTECTED] > wrote:
> >
> > According to JIRA, that was fixed in version 0.10 of Hadoop and the
> > latest Nutch trunk includes 0.10.1 so you might want to try that
before
> > anything else.
> >
> > If that still doesn't work, or your not willing to try that can you
post
> > the complete error output from your logs?
> >
> >
> > ----- Original Message ----
> > From: Shailendra Mudgal <[EMAIL PROTECTED]>
> > To: [email protected]
> > Sent: Wednesday, January 17, 2007 3:26:03 AM
> > Subject: NameNode throws FileNotFoundException: Parent path does not
> > exist on startup
> >
> >
> > Hi all,
> > I am running nutch-0.9 with hadoop-0.9.1.
> > While starting the name node i was getting an exception and after that
> > name
> > node was not responding to any of the client's request.
> >
> > When i searched forum in this regard ,i found a patch on
> > *HADOOP-745<http://issues.apache.org/jira/browse/HADOOP-745 >
> > .
> > *I applied the successfully and compiled the 0.9.1's code. and then
> > replaced
> > the hadoop-0.9.1.jar with the hadoop-0.9.2-dev.jar.
> >
> > Again i tried to start the dfs by calling start.dfs and still i am
> > getting
> > the same error on same filesystem. I don't want to use the same
> > filesystem
> > as it already contains some data.
> >
> > Does anybody have the idea in this regards??
> >
> > Thanks and regards,
> > ~Shailendra
> >
>
>
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general
