Re: Determining input record directory using Streaming...

2009-06-23 Thread Bo Shi
Jason, do you know offhand when this feature was introduced? .18.x? Thanks, Bo On Mon, Jun 22, 2009 at 10:58 PM, jason hadoop wrote: > Check the process environment for your streaming tasks, generally the > configuration variables are exported into the process environment. > > The Mapper input f

Re: Does HDFS provide a way to append A file to B ?

2009-03-17 Thread Bo Shi
what about an identity mapper taking A and B as inputs? this will likely mix rows of A and B together though... On Tue, Mar 17, 2009 at 7:35 PM, Steve Gao wrote: > BTW, I am using hadoop 0.17.0 and jdk 1.6 > > --- On Tue, 3/17/09, Steve Gao wrote: > From: Steve Gao > Subject: Does HDFS provide

copyFromLocal strangeness

2008-05-06 Thread Bo Shi
attempt to use copyFromLocal an hour after this incident was successful. Further, is there a way to specify that failed copies not leave artifacts? In this particular case, a size 0 file ONE-2008-05-05-14.gz was left on the grid. -- Bo Shi (207) 469-8264 (M) 25 Kingston St, 5th Fl Boston, MA 02111