My experience running with the Java API is that subdirectories in the input path do cause an exception, so the streaming file input processing must be different.
Jeff Eastman > -----Original Message----- > From: Norbert Burger [mailto:[EMAIL PROTECTED] > Sent: Tuesday, April 01, 2008 9:46 AM > To: core-user@hadoop.apache.org > Cc: [EMAIL PROTECTED] > Subject: Re: Hadoop input path - can it have subdirectories > > Yes, this is fine, at least for Hadoop Streaming. I specify the root of > my > logs directory as my -input parameter, and Hadoop correctly finds all of > child directories. What's the error you're seeing? Is a stack trace > available? > > Norbert > > On Tue, Apr 1, 2008 at 12:15 PM, Tarandeep Singh <[EMAIL PROTECTED]> > wrote: > > > Hi, > > > > Can I give a directory (having subdirectories) as input path to Hadoop > > Map-Reduce Job. > > I tried, but got error. > > > > Can Hadoop recursively traverse the input directory and collect all > > the file names or the input path has to be just a directory containing > > files (and no sub-directories) ? > > > > -Taran > >
