machines) and divide 300
insertion tasks between them,
I need some hint to progress faster,
1- as i know we dont need to Reduser, just Mapper in enough.
2- so wee need just implement Mapper class with needed code.
Please let me know if there is any point,
Best Regards
Masoud
way to increase number of reducers?
Thanks
Masoud
Thanks for reply,
as you know in this way we will have n final result too,
is this any way to increase the number of Reducer for fast computation
but have only one final result?
B.S
Masoud
On 03/20/2012 07:02 PM, bejoy.had...@gmail.com wrote:
Hi Mausoud
Set -D mapred.reduce.tasks=n; ie
Hi all,
we have this problem:
org.apache.hadoop.ipc.Client: Retrying connect to server:
master/*.*.*.*:9000. Already tried 0 time(s).
and for 9001 is same problem too, we opened these port on master firewall.
We use NAT to setup our Linux network.
Let me know your ideas,
Thanks,
Masoud
Dear Harsh,
Master can do password less ssh to all slaves,
form slaves we can connect to the master for example by ping or on port
80 by http.
but via hadoop, slaves can not connect to master in port 9001, 9000,
we opened these port on server too.
Thanks,
Masoud
On 03/16/2012 06:04 PM, Harsh
on master.
We use NAT to setup our Linux network.
Let me know your ideas,
Thanks,
Masoud
This is not about using Puppet to setup hadoop cluster, just about
single node and cluster (2 node) setup in normal way.
Thanks,
Masoud
On 03/12/2012 02:59 PM, tousif wrote:
http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/
On Mon, Mar 12, 2012
Patai,
as you know unfortunately Puppet is not open source and free version
only support 10 nodes,
I think we have to setup our stack manually.. haha
Thanks
On 03/13/2012 02:43 AM, Patai Sangbutsarakum wrote:
Masoud,
this are where I started off.
https://github.com/seanhead
Dear Joey,
Really thankful for your great help,
I hope could find docs there too,
Best Regards,
Masoud
On 03/13/2012 10:35 AM, Joey Echeverria wrote:
Masoud,
I know that the Puppet Labs website is confusing, but puppet is open
source and has no node limit. You can download it from here
Dear Patai,
Thanks for your reply.
we need only to install hadoop no Hbase or other tools,
Could you please introduce some useful sites or docs to use puppet for
setting up hadoop cluster?
Thanks.
Masoud.
On 03/10/2012 04:30 PM, Patai Sangbutsarakum wrote:
We did 2pb clusters by puppet
Hi all,
As we know setting up hadoop cluster contains doing different settings
in all machines, so time consuming and non effective.
anybody knows about setting up a hadoop cluster easily?
some ways such as puppet does not have enough docs or clear road map.
Thanks,
B.S
Hi all,
I installed hadoop in a pilot cluster with 3 machines and now going to
make our actual cluster with 32 nodes.
as you know setting up hadoop separately in every nodes is time
consuming and not perfect way.
whats the best way or tool to setup hadoop cluster (expect cloudera)?
Thanks,
in all machines.
Let me know your idea,
B.S,
Masoud.
on it since hadoop manage all things,
overall result is our goal in hadoop based computation,
I hope it could be helpful.
Good Luck,
Masoud,
On 01/30/2012 06:07 PM, praveenesh kumar wrote:
@ Harsh -
Yeah, mapred.task.timeout is the valid option. but for some reasons, its
not happening the way it should
Hi,
I suggest you Fedora, in my opinion its more powerful than other
distribution.
i have run hadoop on it without any problem,
good luck
On 01/27/2012 06:15 PM, Sujit Dhamale wrote:
Hi All,
I am new to Hadoop,
Can any one tell me which is the best Linux Operating system used for
installing
Dear All,
any one did it before: map/reduce by C# Hadoop ???
As you know for developing map/reduce app in hadoop we should extend and
implement special map and reduce abstract classes and interfaces,
and Hadoop pipes is for C++ not C#. The question is what we should do
for C#?
*IS IT RIGHT
, at 2:31 PM, Masoud wrote:
Dear All,
any one did it before: map/reduce by C# Hadoop ???
As you know for developing map/reduce app in hadoop we should extend and
implement special map and reduce abstract classes and interfaces,
and Hadoop pipes is for C++ not C#. The question is what we should do
.
Masoud
On 11/03/2011 08:34 PM, Uma Maheswara Rao G 72686 wrote:
it wont disply any thing on console.
If you get any error while exceuting the command, then only it will disply on
console. In your case it might executed successfully.
Still you are facing same problem with TT startup?
Regards,
Uma
, . im playing with this issue
around 4 days but no result.
BS.
Masoud
On 11/03/2011 08:19 PM, Joey Echeverria wrote:
What are the permissions on \tmp\hadoop-cyg_server\mapred\local\ttprivate?
Which user owns that directory?
Which user are you starting you TaskTracker as?
-Joey
On Wed, Nov
.
To: common-user@hadoop.apache.org
Hi
I have problem in running hadoop under cygwin 1.7
only tasktracker ran by cyg_server user and so make some problems,
so any idea please???
BS.
Masoud.
permission for mentioned folder in error message,
Maybe its a bug and should fixed in source code.,
Any idea please.
Thanks,
Masoud.
On 11/01/2011 08:12 PM, Rita wrote:
Why ?
The beauty of hadoop is its OS agnostic. What is your native operating
system? I am sure you have a version of JDK
1.7
only tasktracker ran by cyg_server user and so make some problems,
so any idea please???
BS.
Masoud.
cygwin JUST tasktracker run by cyg_server user, Permission
denied .
To: common-user@hadoop.apache.org
Hi
I have problem in running hadoop under cygwin 1.7
only tasktracker ran by cyg_server user and so make some problems,
so any idea please???
BS.
Masoud.
Hi
Anybody ran hadoop on cygwin for development purpose???
Did you have any problem in running tasktracker?
Thanks
Hi
I have problem in running hadoop under cygwin 1.7
only tasktracker ran by cyg_server user and so make some problems,
so any idea please???
BS.
Masoud.
Dear Harsh
I know it, but when i can set it?
i couldn't find the place.
thanks
On 10/28/2011 04:53 PM, Harsh J wrote:
Masoud,
You can change your temp-files location by overriding hadoop.tmp.dir
with your desired, proper path. Hopefully, that should help you.
On Fri, Oct 28, 2011 at 12:04 PM
I did it before , but not working, ill try again ..
cygwin got crazy, really.
i have another problem to add JAVA_HOME to cygwin.
Thanks
On 10/28/2011 05:09 PM, Harsh J wrote:
Masoud,
You can set hadoop.tmp.dir in core-site.xml inside your
$HADOOP_HOME/conf directory.
On Fri, Oct 28, 2011
Hi
When i run hadoop under cygwin,except tasktracker all daemons starts well.
this is the log file error message:
ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker
because
java.io.IOException: Failed to set permissions of path:
Hi,
I'm trying to setup a hadoop development node on windows.
as you know an eclipse plugin released by Hadoop 0.20.204,
Do you know this plugin is match with which version of eclipse? is it
working on 3.7?
Thanks,
BS.
Dear friends,
I have copied my hadoop conf file from {hadoop_inst_dir} to other place.
When i define this new place by explicit address -e.g,
/home/masoud/software/hadoop-conf- in {hadoop_inst_dir}/bin/hadoop every
thing is OK, but when I define it by implicit addressing-e.g,
../../hadoop
On 10/19/2011 06:19 PM, Masoud wrote:
Dear friends,
I have copied my hadoop conf file from {hadoop_inst_dir} to other
place. When i define this new place by explicit address -e.g,
/home/masoud/software/hadoop-conf- in {hadoop_inst_dir}/bin/hadoop
every thing is OK, but when I de
I found
- and only using windows as *development platform* in pseudo-distributed
mode.
AM I RIGHT in 1 and 2? please correct or verify them.
Thanks,
BS.
Masoud,
2011/9/28 Steve Loughran ste...@apache.org
On 28/09/11 04:19, Hamedani, Masoud wrote:
Special Thanks for your help Arko,
You mean in Hadoop
existing systems and programs with it.
as you mentioned we should move all of our data to Linux systems, and
execute existing C# codes in Linux and only use windows for
development same as before.
Am I right?
Thanks,
B.S
Masoud.
2011/9/28 Arko Provo Mukherjee arkoprovomukher...@gmail.com
Hi
Thanks for your nice help Arko,
maybe because im new in hadoop i cant get some of points,
im studying hadoop manual more deeply to have better info.
B.S
Masoud.
2011/9/28 Arko Provo Mukherjee arkoprovomukher...@gmail.com
Hi,
You necessarily don't need to execute the C# codes on Linux.
You
34 matches
Mail list logo
