A quick question about replication factor

Hi Hadoopers, If I configure the replication factor to be 3 in the configuration file, then how many blocks of the same have been stored? Three or Four. bit1...@163.com

Re: A quick question about replication factor

3 On Thu, Dec 18, 2014 at 7:10 PM, bit1...@163.com bit1...@163.com wrote: Hi Hadoopers, If I configure the replication factor to be 3 in the configuration file, then how many blocks of the same have been stored? Three or Four. -- bit1...@163.com

Re: about replication

hello, I think u r newbie.You need to work on to learn from scratch. Please do not mind.whatever u try to think hadoop should be like this, ur concept is totally wrong. but,your effort is positive. My suggestion is try to learn on ubuntu os.Windows is not good enough for hadoop. Follow the link

Re: about replication

thanks. yes , i am newbie. however, i need windows setup. let me surely refer the doc and link which u sent but i need this to be working ... can you please help regards

Re: about replication

hi, i have gone high level through the doc and seems very promising. really nice but can you please help me on this issue . i need to do PoC first and get the demo out regards On Tue, Aug 6, 2013 at 11:49 AM, Irfan Sayed irfu.sa...@gmail.com wrote: thanks. yes , i am newbie. however, i

Re: about replication

*You are wrong at this:* Administrator@DFS-DC /cygdrive/c/hadoop-1.1.2/hadoop-1.1.2/bin $ ./hadoop dfs -copyFromLocal /cygdrive/c/Users/Administrator/Desktop/hadoop-1.1.2.tar /wksp copyFromLocal: File /cygdrive/c/Users/Administrator/Desktop/hadoop-1.1.2.tar does not exist. Administrator@DFS-DC

about replication

hi, i have setup the two node apache hadoop cluster on windows environment one is namenode and another is datanode everything is working fine. one thing which i need to know is , how the replication starts if i create a.txt in namenode , how it will be appeared in datanodes please suggest

Re: about replication

Hello Irfan, You can find all the answers from HDFS architecture guidehttp://hadoop.apache.org/docs/stable/hdfs_design.html. See the section Data Organizationhttp://hadoop.apache.org/docs/stable/hdfs_design.html#Data+Organizationin particular for this question. Warm Regards, Tariq

Re: about replication

thanks mohammad i ran the below command on NameNode $ ./hadoop dfs -mkdir /wksp and the wksp dir got created in c:\ ( as i have windows environment) now , when i log in to one of the DataNode , then i am not able to see c:\wksp any issue ? please suggest regards On Mon, Aug 5, 2013 at

Re: about replication

You cannot physically see the HDFS files and directories through local FS. Either use HDFS shell or HDFS webUI(namenode_machine:50070). Warm Regards, Tariq cloudfront.blogspot.com On Mon, Aug 5, 2013 at 4:46 PM, Irfan Sayed irfu.sa...@gmail.com wrote: thanks mohammad i ran the below command

Re: about replication

thanks. please refer below: Administrator@DFS-DC /cygdrive/c/hadoop-1.1.2/hadoop-1.1.2/bin $ ./hadoop dfs -ls /wksp Found 1 items drwxr-xr-x - Administrator Domain 0 2013-08-05 16:58 /wksp/New folder Administrator@DFS-DC /cygdrive/c/hadoop-1.1.2/hadoop-1.1.2/bin $ same command if i

Re: about replication

You can not physically access the datanode.You have to understand it to logically and it really happens. Type jps command to check ur datanode was started or not. when user stores the file into hdfs ,the request is goes to datanode and datanode will divide the file into number of blocks. Each

Re: about replication

thanks. i verified, datanode is up and running i ran the below command: Administrator@DFS-DC /cygdrive/c/hadoop-1.1.2/hadoop-1.1.2/bin $ ./hadoop dfs -copyFromLocal C:\\Users\\Administrator\\Desktop\\hadoop-1.1.2.tar /wksp copyFromLocal: File C:/Users/Administrator/Desktop/hadoop-1.1.2.tar does