RE: How do I copy files from my linux file system to HDFS using a java prog?

2008-05-01 Thread Babu, Suresh
Try this program. Modify the HDFS configuration, if it is different from the default. import java.io.File; import java.io.IOException; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.FileStatus; import org.apache.hadoop.fs.FileSystem; import org.apache.hadoop.fs.FSDataIn

RE: How do I copy files from my linux file system to HDFS using a java prog?

2008-05-06 Thread Babu, Suresh
a java prog? Thanks Suresh. But even this program reads and writes from the HDFS. What i need to do is read from my normal local linux harddrive and write to the HDFS. I'm sorry if I misunderstood your program. Thanks for replying. :) Babu, Suresh wrote: > > > Try this progr

Handling closing of the HDFS file by application in case of interrupts

2008-05-20 Thread Babu, Suresh
Hi, I have written an application(in JAVA and C) which reads contents from Standard input (stdin) and writes to a file in HDFS (filesystem). In HDFS the contents of the file are not committed(or seen) until the file is closed explicitly. The problem is my application is run on unix environmen

No exception received by application on HDFS restart

2008-07-18 Thread Babu, Suresh
Hi, I have written client application in java, which writes Apache log data to HDFS Cluster. When the HDFS cluster is brought down, the client attempts to connect to the Cluster. I have a few issues regarding the same. 1) When the HDFS cluster is brought down, the Application does not get an