You can do like this.
Configuration conf = getConf();
FileSystem fs = FileSystem.get(conf);
FileStatus[] fstatus = fs.listStatus(new Path(...));
String generatedFile;
for (int i=0; i<fstatus.length; i++) {
generatedFile = fstatus[i].getPath().getName();
System.out.println("File Name : " + generatedFile);
}
On 2/5/15, xeonmailinglist <xeonmailingl...@gmail.com> wrote:
> Hi,
>
> I want to list files in the HDFS using the |FileUtil.listFiles| but all
> I get is IOException errors. The code, error and the output is below.
> How I list files in HDFS?
>
> |Exception in thread "main" java.io.IOException: Invalid directory or I/O
> error occurred for dir: /outputmp
> |
>
> I have this code
>
> | try{
> File[] mapOutputFiles = FileUtil.listFiles(new
> File("webhdfs://hadoop-coc-1/outputmp/"));
> System.out.println("1 success: " + mapOutputFiles.length);
> } catch (Exception e) {
> System.out.println("1 failed");
> }
>
> try {
> File[] mapOutputFiles2 = FileUtil.listFiles(new
> File("webhdfs://hadoop-coc-1/outputmp"));
> System.out.println("2 success: " + mapOutputFiles2.length);
> } catch (Exception e) {
> System.out.println("2 failed");
> }
>
> try {
> File[] mapOutputFiles3 = FileUtil.listFiles(new
> File("/outputmp"));
> System.out.println("3 success: " + mapOutputFiles3.length);
> } catch (Exception e) {
> System.out.println("3 failed");
> }
> try {
> File[] mapOutputFiles4 = FileUtil.listFiles(new
> File("/outputmp/"));
> System.out.println("4 success: " + mapOutputFiles4.length);
> } catch (Exception e) {
> System.out.println("4 failed");
> }
> |
>
> The output
>
> |1 failed
> 2 failed
> 3 failed
> 4 failed
> |
>
> The output exists
>
> |vagrant@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -ls /outputmp
> Found 2 items
> -rw-r--r-- 2 vagrant supergroup 0 2015-02-05 15:50
> /outputmp/_SUCCESS
> -rw-r--r-- 2 vagrant supergroup 12 2015-02-05 15:50
> /outputmp/part-m-00000
> vagrant@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -ls
> webhdfs://hadoop-coc-1/outputmp
> Found 2 items
> -rw-r--r-- 2 vagrant supergroup 0 2015-02-05 15:50
> webhdfs://hadoop-coc-1/outputmp/_SUCCESS
> -rw-r--r-- 2 vagrant supergroup 12 2015-02-05 15:50
> webhdfs://hadoop-coc-1/outputmp/part-m-00000
> vagrant@hadoop-coc-1:~/Programs/hadoop$
> |
>
>
>
