questions about HDFS file access synchronization

appreciate very much the input from experts in the mailing list. Thanks a lot! Best regards, Zhang Bingjun (Eddy) E-mail: eddym...@gmail.com, bing...@nus.edu.sg, bing...@comp.nus.edu.sg Tel No: +65-96188110 (M)

Re: questions about HDFS file access synchronization

ile access synchronization, we may go for HBase. Thanks again for your reply! It is really inspiring. Please shot your comments if I am wrong in any points. :) Best regards, Zhang Bingjun (Eddy) E-mail: eddym...@gmail.com, bing...@nus.edu.sg, bing...@comp.nus.edu.sg Tel No: +65-96188110 (M) On Thu, A

Mount WebDav in Linux for HDFS-0.20.1

ver, I still got this error message. Could you and anyone give me some hints on this problem? How could I solve it? Very much appreciate your help! Best regards, Zhang Bingjun (Eddy) E-mail: eddym...@gmail.com, bing...@nus.edu.sg, bing...@comp.nus.edu.sg Tel No: +65-96188110 (M)

Re: Mount WebDav in Linux for HDFS-0.20.1

? What I am trying to do is to mount HDFS as a local directory in Ubuntu. Do you think fuse-dfs is the best option so far? Thank you so much for your input! Best regards, Zhang Bingjun (Eddy) E-mail: eddym...@gmail.com, bing...@nus.edu.sg, bing...@comp.nus.edu.sg Tel No: +65-96188110 (M) On Tue

Re: Mount WebDav in Linux for HDFS-0.20.1

h for your help! Best regards, Zhang Bingjun (Eddy) E-mail: eddym...@gmail.com, bing...@nus.edu.sg, bing...@comp.nus.edu.sg Tel No: +65-96188110 (M) On Tue, Oct 27, 2009 at 7:19 PM, Huy Phan wrote: > Hi Zhang, > I didn't play much with fuse-dfs, in my opinion, memory leak is something

Re: Mount WebDav in Linux for HDFS-0.20.1

ance wise. Thanks a lot for your quick help! Best regards, Zhang Bingjun (Eddy) E-mail: eddym...@gmail.com, bing...@nus.edu.sg, bing...@comp.nus.edu.sg Tel No: +65-96188110 (M) On Wed, Oct 28, 2009 at 9:22 AM, Huy Phan wrote: > Hi Zhang, > I applied my patch to davfs2-1.4.0 and it's wo

Re: Mount WebDav in Linux for HDFS-0.20.1

FUSE implementation to HDFS. Thanks to all! Best regards, Zhang Bingjun (Eddy) E-mail: eddym...@gmail.com, bing...@nus.edu.sg, bing...@comp.nus.edu.sg Tel No: +65-96188110 (M) On Wed, Oct 28, 2009 at 1:51 PM, Zhang Bingjun (Eddy) wrote: > Dear Huy Phan, > > Thanks a lot! > > It seems

too many 100% mapper does not complete / finish / commit

ata into HDFS, I suspect the stuck mappers has something to do with the MapReduce framework code? Any input will be appreciated. Thanks a lot! Best regards, Zhang Bingjun (Eddy) E-mail: eddym...@gmail.com, bing...@nus.edu.sg, bing...@comp.nus.edu.sg Tel No: +65-96188110 (M)

Re: too many 100% mapper does not complete / finish / commit

ly be helpful to people on the list. Amogh Best regards, Zhang Bingjun (Eddy) E-mail: eddym...@gmail.com, bing...@nus.edu.sg, bing...@comp.nus.edu.sg Tel No: +65-96188110 (M) On Mon, Nov 2, 2009 at 4:51 PM, Palleti, Pallavi < pallavi.pall...@corp.aol.com> wrote: > Hi Eddy, > > I f

Re: too many 100% mapper does not complete / finish / commit

orary/_attempt_200911021416_0001_m_91_0/part-m-00091 This is the temporary file of a 100% mapper without completion. Any clues on this? Best regards, Zhang Bingjun (Eddy) E-mail: eddym...@gmail.com, bing...@nus.edu.sg, bing...@comp.nus.edu.sg Tel No: +65-96188110 (M) On Mon, Nov 2, 2009 at 6:

Re: too many 100% mapper does not complete / finish / commit

ill also try to enable DEBUG mode of hadoop. Could you share some info on starting an hadoop deamon or the whole hadoop cluster in debug mode? Thanks a lot! Best regards, Zhang Bingjun (Eddy) E-mail: eddym...@gmail.com, bing...@nus.edu.sg, bing...@comp.nus.edu.sg Tel No: +65-96188110 (M) On Mon, N