Re: Need help understanding Hadoop Architecture

2011-10-31 Thread oleksiy
know the format in this case. that's it :) panamamike wrote: > > > > oleksiy wrote: >> >> Hello, >> >> I would suggest you to read at least this piece of info: >> http://hadoop.apache.org/common/docs/r0.20.204.0/hdfs_design.html#NameNode+and+DataNodes >

Re: Need help understanding Hadoop Architecture

2011-10-26 Thread oleksiy
. Also I would suggest good book " http://www.amazon.com/Hadoop-Definitive-Guide-Tom-White/dp/1449389732 Tom White - Hadoop. The Definitive Guide - 2010, 2nd Edition " There you definitely find all answers on your questions. Regards, Oleksiy panamamike wrote: > > I'm new to

Re: running sqoop on hadoop cluster

2011-10-24 Thread oleksiy
Hello, As for the first question, I can say that you can understand where is the master node by looking at "masters" file in the "conf" folder of hadoop. There you specify master node. firantika wrote: > > Hi All, > i'm newbie on hadoop, > > if i installed hadoop on 2 node, where is hdfs runn

Run hadoop Map/Reduce app from another machine

2011-10-05 Thread oleksiy
Hello, I'm trying to find a way how to run hadoop MapReduce app from another machine. For instance I have *.jar file with MapReduce app it works ok when I run it from command line for instance using this command: "hadoop jar /usr/joe/wordcount.jar org.myorg.WordCount /usr/joe/wordcount/input /usr

Architectural question

2011-04-10 Thread oleksiy
Hi all, I have some architectural question. For my app I have persistent 50 GB data, which stored in HDFS, data is simple CSV format file. Also for my app which should be run over this (50 GB) data I have 10 GB input data also CSV format. Persistent data and input data don't have commons keys. In