Re: free some space on data volume

2015-02-16 Thread Ulul
Hi Check out the two last comments for HDFS-1312 : https://issues.apache.org/jira/browse/HDFS-1312 If you can't afford to wipe out DN data and rebalance, you can try out the proposed script (after non-prod testing obviously) Ulul Le 16/02/2015 09:52, Georgi Ivanov a écrit : Hi, I need to

Re: Question about mapp Task and reducer Task

2015-02-16 Thread Ulul
Hi As a general rule you should follow distro's recommendations, especially if you have paid support from Hortonworks. I have a non-critical, unsupported production cluster onto which I'll run small jobs and intend to test the feature but I haven't tried yet so I can't give you feedback

Re: Copying many files to HDFS

2015-02-16 Thread Kevin
Johny, NiFi looks interesting but I can't really grasp how it will help me. If you could provided some example code or a more detail explanation of how you set up a topology, then that would be great. On Fri, Feb 13, 2015 at 10:38 AM, johny casanova pcgamer2...@outlook.com wrote: Hi Kevin,

Re: Copying many files to HDFS

2015-02-16 Thread Alexander Pivovarov
Hi Kevin, What is network throughput btw 1. NFS server and client machine? 2. client machine and dananodes? Alex On Feb 13, 2015 5:29 AM, Kevin kevin.macksa...@gmail.com wrote: Hi, I am setting up a Hadoop cluster (CDH5.1.3) and I need to copy a thousand or so files into HDFS, which totals

free some space on data volume

2015-02-16 Thread Georgi Ivanov
Hi, I need to free some space on one of the data directories on one server. I have 2 data volumes : /data/1 and /data/2 One of the hard drives was broken, and after we replaced it, i ran a rebalance. The problem is i forgot to change the policy to FreeSpace (insted of default round-robin).