Re: Phase level Scheduling algorithm in heterogeneous cluster

Regarding the implementation - without knowing much about the algorithm - I would guess you would at minimum need to implement a new scheduler - see here

Phase level Scheduling algorithm in heterogeneous cluster

Hi, I'm trying to deploy PRISM algorithm which proposed in IEEE paper title "prism: Fine-Grained Resource-Aware Scheduling for MapReduce", for phase level scheduling work  in homogeneous cluster.I'm stack with first step how to implement this algorithm and configure it, which parts i have to

Re: Running a script/executable stored in HDFS from a mapper

Perhaps you want to look at Hadoop Streaming? https://hadoop.apache.org/docs/r2.7.1/hadoop-streaming/HadoopStreaming.html On Fri, Apr 21, 2017 at 12:30 AM, Philippe Kernévez wrote: > Hi Evelina, > > Files in HDFS are not executable. > You first need to copy it on a local tmp

Re: Noob question about Hadoop job that writes output to HBase

The Hadoop version that I use is 2.7.1 and the Hbase version is 1.2.5. I can do any operation from the HBase shell. On Fri, Apr 21, 2017 at 8:01 AM, evelina dumitrescu < evelina.a.dumitre...@gmail.com> wrote: > Hi, > > I am new to Hadoop and Hbase. > I was trying to make a small proof-of-concept

Re: Running a script/executable stored in HDFS from a mapper

Hi Evelina, Files in HDFS are not executable. You first need to copy it on a local tmp disk then run it (or may be load it in the mapper depending on your case). Regards, Philippe On Fri, Apr 21, 2017 at 7:29 AM, evelina dumitrescu < evelina.a.dumitre...@gmail.com> wrote: > Hi, > > Is it