Re: hadoop-hdfs-fuse missing?

2015-07-22 Thread Chris Nauroth
Hello Caesar, Since this is a question specific to a vendor's distribution and how to consume their packaging, I recommend taking the question to the vendor's own forums. Questions about how to use fuse-dfs or build it from Apache source definitely would be a good fit for this list though.

Re: NNBench on external HDFS

2015-07-22 Thread Chris Nauroth
Hi Alexander, Your NNBench usage looks basically correct, but NNBench is not a standard Hadoop tool. It does not implement the org.apache.hadoop.util.Tool interface, it does not execute through org.apache.hadoop.util.ToolRunner, and therefore it does not support the command line arguments that a

Web based file manager for HDFS?

2015-07-22 Thread Caesar Samsi
Hello, I'm looking for a web based file manager, simple enough to upload and download files (text and binary). I would appreciate if you have pointers to one. I'm running Hadoop HDFS (i.e. non CDH or Hortonworks which I understand have it). Thank you, Caesar.

Sorting the inputSplits

2015-07-22 Thread Nishanth S
Hey folks, Is their a way to sort the input splits in map reduce.We have a case where there are two files file1 and file2 in the input directory.Since we have custominputformat which has issplittable return false always each of these files would be processed by a different mapper.How could

Re: fuse-dfs

2015-07-22 Thread Chris Nauroth
The only fuse-dfs documentation I'm aware of is here: https://github.com/apache/hadoop/tree/release-2.7.1/hadoop-hdfs-project/hadoop-hdfs/src/main/native/fuse-dfs/doc (This is a link into the source for the recent 2.7.1 release.) Unfortunately, this is somewhat outdated. I can tell because the

NNBench on external HDFS

2015-07-22 Thread Alexander Striffeler
Hi all I'm pretty new to the Hadoop environment and I'm about performing some micro benchmarks. In particular, I'm struggling with executing NNBench against an external File System: hadoop jar /usr/hdp/2.2.6.0-2800/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-tests.jar nnbench

Terasort query

2015-07-22 Thread mohanpothula
I have setup 3 node cluster each node having 100GB for configured VM on 3 nodes . When I did Terasort first time ,very less space reserved for NonHDFS , due to that blocks are corrupted on 3 nodes .Again I had setup the cluster with 300GB on each node . To get HDFS size use the below command on

Re: Web based file manager for HDFS?

2015-07-22 Thread Tatsuo Kawasaki
Hi Caesar, Let's try Hue if you can use WebHDFS or HttpFs. http://gethue.com Hue has a web based file manager and Hive/Impala query editor, etc. Thanks, -- Tatsuo 2015/07/23 3:22、Caesar Samsi cmsa...@hotmail.com のメッセージ: Hello, I’m looking for a web based file manager, simple enough to

Streaming and the TotalOrderPartitioner

2015-07-22 Thread Nikoli Dryden
Hi, Is there a nice way to use the TotalOrderPartitioner through the Hadoop streaming interface? It can be specified just fine with the -partitioner option, but I cannot find a way to generate the partition file from streaming. Is there a way to generate it from the streaming interface? Or