Hadoop Cluster Initialization Fail

Hi, I kind of cleared the logs at /var/logs with rm -rf. I know this was a stupid move. Now the cluster does not start throwing an error.: "HTTP ERROR 403 Problem accessing /cmf/process/920/logs. Reason: Server returned HTTP response code:500 for URL http://xx:9000/process/920-hdfs-NAMENODE

How to use HPROF for rhadoop jobs ?

t;); conf.set("mapred.task.profile.maps", "0-2"); conf.set("mapred.task.profile.reduces", ""); // no reduces Job job = new Job(conf, "Max temperature"); Can some one provide an example code which shows how HPROF is used in rhadoop jobs. Thanks Rohit Sarewar

OpenCL with Hadoop

Hi All How do I use OpenCL(for GPU compute) with Hadoop ? It would be great if someone could share a sample code. Thanks & Regards Rohit Sarewar

Access HDFS from OpenCL

from HDFS ? How can I trigger OpenCL codes from my Java map reduce codes ? It would be great if someone could share a sample code. Thanks& Regards Rohit Sarewar

Map task failed: No protocol specified

? Regards Rohit Sarewar

How does Kerberos work with Hadoop ?

I am looking for an explanation of Kerberos working with Hadoop cluster . I need to know how KDC is used by hdfs and mapred. (Something like this :- An example of kerberos with mail server , https://www.youtube.com/watch?v=KD2Q-2ToloE) Please help!

How does Kerberos work with Hadoop ?

I am looking for an explanation of Kerberos working with Hadoop cluster . I need to know how KDC is used by hdfs and mapred. (Something like this :- An example of kerberos with mail server , https://www.youtube.com/watch?v=KD2Q-2ToloE) How the name node and data node are prone to attacks ? What a

Re: How does Kerberos work with Hadoop ?

d the hadoop security design doc which you can find at > https://issues.apache.org/jira/browse/HADOOP-4487 > > HTH, > +Vinod Kumar Vavilapalli > Hortonworks Inc. > http://hortonworks.com/ > > On Feb 21, 2013, at 11:02 AM, rohit sarewar wrote: > > > I am looking for a

What is the difference between delegation token and Job token in Hadoop?

Delegation token and job token seems similar to me. I need to understand the exact difference between them ? What is the difference between delegation token and Job token in Hadoop ?

Submit RHadoop job using Ozzie in Cloudera Manager

Hi All I am using Cloudera Manager 4.5 . As of now I can submit MR jobs using Oozie. Can we submit Rhadoop jobs using Ozzie in Cloudera Manager ?

Re: Submit RHadoop job using Ozzie in Cloudera Manager

and rhdfs packages installed on all nodes? > > For hadoop it doesnt matter what type of job is till you have libraries it > needs to run in the cluster. > > Submitting any job would be fine. > > Thanks > > > On Fri, Mar 8, 2013 at 9:46 PM, rohit sarewar wrote: > >> H

CDH4 installation along with MRv1 from tarball

use these config files? I am unable to start NAMENODE and DATANODE services from this. What are the required config changes ? Can any one guide me to the proper link which has all installation steps ? Please Help. Thanks Rohit Sarewar * *

Re: CDH4 installation along with MRv1 from tarball

< jens.scheidtm...@gmail.com> wrote: > Rohit, > > What are you trying to achieve with two different complete versions of > hadoop? > > Thanks, > > Jens > > > > 2013/3/18 rohit sarewar > >> Need some guidance on CDH4 installation from tarball

Redirecting to job history server fails in MapReduceV2

at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDeleg ... 16 more Regards Rohit Sarewar

Re: Hadoop Streaming: How to parition output into subfolders?

Hi Rex Please explore multiple outputs <https://hadoop.apache.org/docs/r2.4.1/api/org/apache/hadoop/mapreduce/lib/output/MultipleOutputs.html> . Regards Rohit Sarewar On Thu, Jan 21, 2016 at 5:13 AM, Rex X wrote: > Dear all, > > To be specific, for example, given > >