Re: Multi-Cluster Setup

2014-07-04 Thread fab wol
://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-hdfs/Federation.html Regards, Rahul Chaudhari On Thu, Jul 3, 2014 at 9:06 PM, fab wol darkwoll...@gmail.com wrote: Hey Nitin, I'm not talking about concept-wise. I'm takling about how to actually do it technically and how to set it up. Imagine

Multi-Cluster Setup

2014-07-03 Thread fab wol
hey everyone, MapR is offering the possibility to acces from one cluster (e.g. a compute only cluster without much storage capabilities) another cluster's HDFS/MapRFS (see http://doc.mapr.com/display/MapR/mapr-clusters.conf). In times of Hadoop-as-a-Service this becomes very interesting. Is this

Re: Multi-Cluster Setup

2014-07-03 Thread fab wol
HDFS and do not run tasktrackers on them. Start bunch of machines with High RAM and high CPUs but no storage. Only thing to worry then would be network bandwidth to carry data from hdfs to tasks and back to hdfs. On Thu, Jul 3, 2014 at 8:29 PM, fab wol darkwoll...@gmail.com wrote: hey

Re: Job initialization failed: java.lang.NullPointerException at resolveAndAddToTopology

2013-10-14 Thread fab wol
Solutions Software Engineer 100 Sandusky Street | 2nd Floor | Pittsburgh, PA 15212 Google Voice: 412-256-8556 | www.rdx.com On Fri, Oct 11, 2013 at 8:52 AM, fab wol darkwoll...@gmail.com wrote: this line: 2013-10-11 10:24:53,033 ERROR org.apache.hadoop.security.UserGroupInformation

Job initialization failed: java.lang.NullPointerException at resolveAndAddToTopology

2013-10-11 Thread fab wol
Hey everyone, I've got supplied with a decent ten node CDH 4.4 cluster, only 7 days old, and someone tried some HBase stuff on it. Now I wanted to try some MR Stuff on it, but starting a Job is already not possible (even the wordcount example). The error log of the jobtracker produces a log 700k

Re: Job initialization failed: java.lang.NullPointerException at resolveAndAddToTopology

2013-10-11 Thread fab wol
-256-8556 | www.rdx.com On Fri, Oct 11, 2013 at 7:59 AM, fab wol darkwoll...@gmail.com wrote: Hey everyone, I've got supplied with a decent ten node CDH 4.4 cluster, only 7 days old, and someone tried some HBase stuff on it. Now I wanted to try some MR Stuff on it, but starting a Job is already