RE: How to compile fuse-dfs
Yes, all those commands works fine but I need to copy a file to the hdfs Thanks again. Xavier -Original Message- From: Pete Wyckoff [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 11, 2008 11:26 AM To: core-user@hadoop.apache.org Subject: Re: How to compile fuse-dfs But, to be clear, you can do mv, rm, mkdir, rmdir. On 3/11/08 10:24 AM, "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> wrote: > Thanks Pete. I'll be waiting for 0.17 then
Re: How to compile fuse-dfs
But, to be clear, you can do mv, rm, mkdir, rmdir. On 3/11/08 10:24 AM, "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> wrote: > Thanks Pete. I'll be waiting for 0.17 then
RE: How to compile fuse-dfs
Thanks Pete. I'll be waiting for 0.17 then Xavier -Original Message- From: Pete Wyckoff [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 11, 2008 11:16 AM To: QUINTUNA Xavier RD-ILAB-SSF; core-user@hadoop.apache.org Subject: Re: How to compile fuse-dfs Oh sorry xavier - you can't write to DFS - although you shouldn't be getting an exception. It should return an IO error but create an empty file. Fuse_dfs relies on appends working in DFS and since this didn't make it into 16, we'll have to wait for 0.17 for this to work. I will look at this error though. -- pete On 3/11/08 10:03 AM, "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> wrote: > dfs,138549488,'FLV',4096) Exception in thread "Thread-7" > java.nio.BufferOverflowException
Re: How to compile fuse-dfs
Oh sorry xavier - you can't write to DFS - although you shouldn't be getting an exception. It should return an IO error but create an empty file. Fuse_dfs relies on appends working in DFS and since this didn't make it into 16, we'll have to wait for 0.17 for this to work. I will look at this error though. -- pete On 3/11/08 10:03 AM, "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> wrote: > dfs,138549488,'FLV',4096) Exception in thread "Thread-7" > java.nio.BufferOverflowException
RE: How to compile fuse-dfs
Hi Pete, I was able to compile the fuse_dfs.c. Thanks. But now I have another question for you. I'm able to read a file but I'm not able to copy a file to the hdfs. I wonder if you solve this problem? And How? In my logs I have this message hdfsWrite(dfs,138549488,'FLV',4096) Exception in thread "Thread-7" java.nio.BufferOverflowException at java.nio.Buffer.nextPutIndex(Buffer.java:425) at java.nio.HeapByteBuffer.putInt(HeapByteBuffer.java:347) at org.apache.hadoop.dfs.DFSClient$DFSOutputStream$Packet.writeInt(DFSClien t.java:1537) at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.writeChunk(DFSClient.jav a:2128) at org.apache.hadoop.fs.FSOutputSummer.writeChecksumChunk(FSOutputSummer.ja va:141) at org.apache.hadoop.fs.FSOutputSummer.write1(FSOutputSummer.java:100) at org.apache.hadoop.fs.FSOutputSummer.write(FSOutputSummer.java:86) at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutput Stream.java:41) at java.io.DataOutputStream.write(DataOutputStream.java:90) at java.io.FilterOutputStream.write(FilterOutputStream.java:80) Call to org.apache.hadoop.fs.FSDataOutputStream::write failed! ./fuse_dfs[14561]: ERROR: fuse problem - could not write all the bytes for /user/xavier/movie/le_plat.flv -1!=4096fuse_dfs.c:702 08/03/11 10:57:50 WARN fs.DFSClient: DataStreamer Exception: java.io.IOException: BlockSize 0 is smaller than data size. Offset of packet in block 0 Aborting file /user/xavier/movie/le_plat.flv --- I really appreciate your help Xavier -Original Message- From: Pete Wyckoff [mailto:[EMAIL PROTECTED] Sent: Monday, March 10, 2008 7:43 PM To: core-user@hadoop.apache.org Subject: Re: How to compile fuse-dfs Hi Xavier, If you run ./bootsrap.sh does it not create a Makefile for you? There is a bug in the Makefile that hardcodes it to amd64. I will look at this. What kernel are you using and what HW? --pete On 3/10/08 2:23 PM, "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> wrote: > Hi everybody, > > I'm trying to compile fuse-dfs but I have problems. I don't have a lot > of experience with C++. > I would like to know: > Is it a clear readme file with the instructions to compile, install > fuse-dfs? > Do I need to replace fuse_dfs.c with the one in > fuse-dfs/src/fuse_dfs.c? > Do I need to set up different flag if I'm using a i386 or 86 machine? > Which one and Where? > Which make file do I need to use to compile the code? > > > > Thanks > > Xavier > > >
Re: How to compile fuse-dfs
Hi Xavier, If you run ./bootsrap.sh does it not create a Makefile for you? There is a bug in the Makefile that hardcodes it to amd64. I will look at this. What kernel are you using and what HW? --pete On 3/10/08 2:23 PM, "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> wrote: > Hi everybody, > > I'm trying to compile fuse-dfs but I have problems. I don't have a lot > of experience with C++. > I would like to know: > Is it a clear readme file with the instructions to compile, install > fuse-dfs? > Do I need to replace fuse_dfs.c with the one in > fuse-dfs/src/fuse_dfs.c? > Do I need to set up different flag if I'm using a i386 or 86 machine? > Which one and Where? > Which make file do I need to use to compile the code? > > > > Thanks > > Xavier > > >
How to compile fuse-dfs
Hi everybody, I'm trying to compile fuse-dfs but I have problems. I don't have a lot of experience with C++. I would like to know: Is it a clear readme file with the instructions to compile, install fuse-dfs? Do I need to replace fuse_dfs.c with the one in fuse-dfs/src/fuse_dfs.c? Do I need to set up different flag if I'm using a i386 or 86 machine? Which one and Where? Which make file do I need to use to compile the code? Thanks Xavier
