@Kartheek, Great :-) ----- Original Message ----- From: kartheek muthyala <kartheek0...@gmail.com> Date: Monday, September 26, 2011 12:06 pm Subject: Re: HDFS file into Blocks To: common-user@hadoop.apache.org
> @Uma, > Thanks alot!!. > I have found the flow... > Thanks, > Kartheek. > > On Mon, Sep 26, 2011 at 10:03 AM, He Chen <airb...@gmail.com> wrote: > > > Hi > > > > It is interesting that a guy from Huawei is also working on > Hadoop project. > > :) > > > > Chen > > > > On Sun, Sep 25, 2011 at 11:29 PM, Uma Maheswara Rao G 72686 < > > mahesw...@huawei.com> wrote: > > > > > > > > Hi, > > > > > > You can find the Code in DFSOutputStream.java > > > Here there will be one thread DataStreamer thread. This > thread will pick > > > the packets from DataQueue and write on to the sockets. > > > Before this, when actually writing the chunks, based on the > block size > > > parameter passed from client, it will set the last packet > parameter in > > > Packet. > > > If the streamer thread finds that is the last block then it > end the > > block. > > > That means it will close the socket which were used for witing > the block. > > > Streamer thread repeat the loops. When it find there is no > sockets open > > > then it will again create the pipeline for the next block. > > > Go throgh the flow from writeChunk in DFSOutputStream.java, where > > exactly > > > enqueing the packets in dataQueue. > > > > > > Regards, > > > Uma > > > ----- Original Message ----- > > > From: kartheek muthyala <kartheek0...@gmail.com> > > > Date: Sunday, September 25, 2011 11:06 am > > > Subject: HDFS file into Blocks > > > To: common-user@hadoop.apache.org > > > > > > > Hi all, > > > > I am working around the code to understand where HDFS > divides a > > > > file into > > > > blocks. Can anyone point me to this section of the code? > > > > Thanks, > > > > Kartheek > > > > > > > > > >
