Re: error copying file from local to hadoop fs

Your cluster is not running properly. Can you do jps and see if all services are running. JT NN DN etc On Fri, Mar 29, 2013 at 6:07 PM, Ravi Chandran wrote: > hi, > I am trying to copy a local text file into hadoop fs using -copyFromLocal > option, but i am getting error: > > 13/03/29 03:02:

Re: Cartesian product in hadoop

Hi, Can you have a look at http://pig.apache.org/docs/r0.11.1/basic.html#cross Thanks On Thu, Apr 18, 2013 at 7:47 PM, zheyi rong wrote: > Dear all, > > I am writing to kindly ask for ideas of doing cartesian product in hadoop. > Specifically, now I have two datasets, each of which contains

Re: How to change default 1024 open files in Linux

Quickly check http://hbase.apache.org/book/configuration.html#os Read about ulimit On Tue, May 7, 2013 at 8:57 PM, Aditya exalter wrote: > How to change default 1024 open files in Linux >

Re: Issue with data Copy from CDH3 to CDH4

A bit unrelated but yet similar. Copy to sequence files data from cdh3 to cdh4 cluster. http://feedly.com/k/14KMYIk Thanks Jagat On May 25, 2013 1:50 PM, "samir das mohapatra" wrote: > Hi all, > > We tried to pull the data from upstream cluster(cdh3) which is > running cdh3 to down stream

Re: hi

Please run $ jps This command will show all running Hadoop daemons and then you can find whats wrong :) On Fri, May 31, 2013 at 8:25 PM, Mohammad Tariq wrote: > Hello sumit, > > Make sure all the Hadoop daemons are running . > > Warm Regards, > Tariq > cloudfront.blogspot.com > > > On

Re: MRunit DOWNLOAD URLs are unavailable

http://mrunit.apache.org/general/downloads.html On Jun 16, 2013 8:20 PM, "YouPeng Yang" wrote: > HI All > > I want to report that MRunit DOWNLOAD URLs are unavailable。 > http://www.apache.org/dyn/closer.cgi/incubator/mrunit/ > > Could anyone give me another available URL > > Regard > >

Latest disctcp code

Hi, Which branch of Hadoop has latest Disctp code. The branch-1 mentions something like distcp2 https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1/src/tools/org/apache/hadoop/tools/distcp2/util/DistCpUtils.java The trunk has no mention of distcp2 http://svn.apache.org/repos/asf/h

Re: Latest disctcp code

ave a new feature introduced in branch-1. > All new features must go to the trunk first, before being back-ported > into maintained release branches. > > On Tue, Jul 2, 2013 at 3:19 PM, Jagat Singh wrote: > > Hi, > > > > Which branch of Hadoop has latest Disctp code. >

Re: getting errors on datanode/tasktracker logs

Can you try with 1.6 java also. With just starting daemons you are getting this error ? I suppose this is your test cluster. You seems to be having error similar to below link https://forums.oracle.com/message/10371413 On 10/08/2013 4:48 AM, "Jitendra Yadav" wrote: > Hi, > > I'm getting below

Re: getting errors on datanode/tasktracker logs

fferent Hadoop version. > > I'm bit confused about this issue in our test env. Is this an issue > with java 1.7 version or Hadoop 1.1.2 version release? > > Regards > > On 8/10/13, Jagat Singh wrote: > > Can you try with 1.6 java also. > > > > With just st

Re: How to specify delimiter in Hive select query

This is not possible till hive 0.10 in hive 0.11 there is patch to do.this. You can insert to some temp.table with required delimiter or use some pig action to.replace afterwards. Or best use hive 0.11 On 24/08/2013 10:45 AM, "Shailesh Samudrala" wrote: > I'm querying a Hive table on my cluster

Re: Apache Hadoop cluster monitoring

Would add hannibal for hbase bird eye view On 28/08/2013 12:45 PM, "Viswanathan J" wrote: > Hi, > > What are the best monitoring tools for hadoop other than JT and NN default > UIs. > > Please share the doc for configuring in production cluster. > > Any tools that can be configured through nagios

Re: Searching algorithm in Hadoop

Going through cloudera search functionality would be useful for you. Have a look at solr also you can integrate it with hadoop On 03/09/2013 9:39 PM, "Devika Rankhambe" wrote: > hello hadoopers, > I need to do search files in distributed database Storage.. I need to > develope front end GUI and

Re: Hadoop is hardcoded the prot into 8020

Hi How your fs.default.name looks like Thanks, Jagat Hi while running the hadoop on pseudo distributed mode ,If i am configure the name port value is not 8020 ,It is not working .When I changed the port into 8020 hadoop is working fine.So I would like to know whether the port 8020 is hard codd

Re:

Hi Jamal, Streaming also supports sharing files with workers See here http://hadoop.apache.org/docs/stable/streaming.html#Working+with+Large+Files+and+Archives Thanks On Sat, Sep 21, 2013 at 6:50 AM, jamal sasha wrote: > Hi, > So in native hadoop streaming, how do i send a helper file..

Re: modify HDFS

Hi, What issue you having. I Wrote it about here , might help you Import it into eclipse as maven project http://jugnu-life.blogspot.com.au/2013/09/build-and-compile-hadoop-from-source.html?m=1 Thanks On 01/10/2013 11:56 PM, "Karim Awara" wrote: > Hi, > > I want to modify the source code of

Re: Hadoop graphing tools

Hi , You should look at pentaho or talend tools . Connect via hiveserver and plot charts Thanks On 15/10/2013 2:04 PM, "Xuri Nagarin" wrote: > Hi, > > I am looking for some simple graphing tools to use with Hadoop (bar or > line chart). Most google searches for "hadoop graphing" turns up resul

Re: Which is hdfs?

Both are inside hdfs One file is under your name other is under system user hdfs name. Hadoop fs command says i am accessing hdfs. Read about hdfs append in 2.x version. On 09/12/2013 6:22 PM, "unmesha sreeveni" wrote: > Can anyone tell me what is the difference between the below details > >

Re: hadoop-fuse

Did you downloaded fuse libraries , they are not part of hadoop dist. --- Sent from Mobile , short and crisp. On 13-Aug-2012 5:10 PM, "Rishabh Agrawal" wrote: > Hello, > > > > I am new to hadoop and I have following question: > > > > I have installed hadoop-0.20.0 on a single node clust

Re: Understanding of the hadoop distribution system (tuning)

multiple nodes depending on available slots. Did you check job tracker page while execution is taking place , there you can see at which node its being processed. You can go to Running tasks page. Regards, Jagat Singh On Tue, Sep 11, 2012 at 11:56 AM, Elaine Gan wrote: > Hi, > > I

Re: what's the default reducer number?

Just to add the name is depreciated in new Hadoop Try to find mapreduce.job.reduces On Tue, Sep 11, 2012 at 9:43 PM, Bejoy Ks wrote: > Hi Lin > > The default values for all the properties are in > core-default.xml > hdfs-default.xml and > mapred-default.xml > > > Regards > Bejoy KS > > > On Tu

Re: feel puzzled at HDFS group permissions check

What are your groups and users in Namenode and JT On Thu, Nov 8, 2012 at 7:00 PM, rongshen.long wrote: > ** > ** > hi, > I set the mode of a directory on hdfs to 'rwxrwx---' ,however, I was > denied to access the directory by dfs shell as a user in the same > group . Did I make a mistake? > > [r

Re: Can I switch the IP/host of NN without losing the filesystem?

Yes your data is safe. On Sun, Jan 6, 2013 at 6:41 PM, Jianhui Zhang wrote: > Hadoop version: hadoop-0.20.205.0 > > My NN machine has 2 IP addresses and 2 hostnames assigned to them > respectively. I have configured "fs.default.name" using one of the > hostnames and used the cluster for a while

Re: new to hadoop and first question

Can you please post your conf files On Mon, Jan 7, 2013 at 8:11 PM, Prabu wrote: > Jim the Standing Bear writes: > > > > > Hi, > > > > I am new to hadoop, and tried to setup a distributed hadoop system. > > But when I tried to run the example job, it stack dumped with the > > following except

Re: Hadoop NON DFS space

:) Check whats consuming space other then core OS files. Check temp spaces and other areas On Wed, Jan 16, 2013 at 6:53 PM, Harsh J wrote: > Wipe your OS out. > > Please read: http://search-hadoop.com/m/9Qwi9UgMOe > > > On Wed, Jan 16, 2013 at 1:16 PM, Vikas Jadhav wrote: > >> >> how to remo

Re: Application of Cloudera Hadoop for Dataset analysis

running SQL type of queries you can see HIVE tool For running machine learning algo see Mahout You can also write own custom Java code for queries. Just start with initial install , shout here at mailing list when ever you are struck. Welcome to magical world of data. Regards, Jagat Singh On

Re: [Hadoop-Help]About Map-Reduce implementation

Hi, Please read basics on how hadoop works. Then start your hands on with map reduce coding. The tool which has been made for you is flume , but don't see tool till you complete above two steps. Good luck , keep us posted. Regards, Jagat Singh --- Sent from Mobile , short and

Mainframe to ASCII conversion

libraries such as [2] or [3] to do the conversion. Thank you for your time and guidance. Regards, Jagat Singh 1) http://docs.oracle.com/javase/6/docs/technotes/guides/intl/encoding.doc.html 2) http://sourceforge.net/projects/jrecord/ 3) http://sourceforge.net/projects/cb2java/

Re: How to install Oozie 3.3.1 on Hadoop 1.1.1

Hi, I can see that in pom.xml the supported hadoop version is 1.0.1 You can try to build your self with version you want to see if it works. Also try to ask your question on oozie mailing list. Regards, Jagat Singh On Sat, Feb 16, 2013 at 12:45 PM, Hemanth Yamijala < yh

Re: Tests to be done to check a library if it works on Hadoop MapReduce framework

nks, Jagat Singh On Fri, Feb 22, 2013 at 7:43 PM, Varsha Raveendran < varsha.raveend...@gmail.com> wrote: > Hi! > > I am at present using Hadoop 1.1.1 . > > In the mrunit website [ > https://cwiki.apache.org/confluence/display/MRUNIT/MRUnit+Tutorial] it > is given

Re: Tests to be done to check a library if it works on Hadoop MapReduce framework

Hi I have updated the tutorial with maven discussion. https://cwiki.apache.org/confluence/display/MRUNIT/MRUnit+Tutorial Please share what others doubt you have while using mrunit , i can update the tutorial accordingly. Thanks, Jagat Singh On Fri, Feb 22, 2013 at 7:49 PM, Jagat Singh wrote

Re: How to take Whole Database From RDBMS to HDFS Instead of Table/Table

You might want to read this http://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_import_all_tables_literal On Wed, Feb 27, 2013 at 10:09 PM, samir das mohapatra < samir.help...@gmail.com> wrote: > Hi All, > >Using sqoop how to take entire database table into HDFS insted of

Re: About Windows Installer

Hi, By default there is no msi or exe installer. However Windows support for Hadoop has improved. https://www.hadooponazure.com/ The above link might be of interest to you. Regards, Jagat Singh On Sat, Mar 2, 2013 at 9:45 PM, Mayur Patil wrote: > Hello, > > I have noticed

Re: Files in hadoop.

Hi, Its what you want to do with data. Most of people keep data there and many others use and run various types of queries on it. Many generate temporary data and delete after running analysis. There is no unique answer for this , its what you need to do. Regards, Jagat Singh On Mon, Mar 4

Re: Submit RHadoop job using Ozzie in Cloudera Manager

Hi Do you have rmr and rhdfs packages installed on all nodes? For hadoop it doesnt matter what type of job is till you have libraries it needs to run in the cluster. Submitting any job would be fine. Thanks On Fri, Mar 8, 2013 at 9:46 PM, rohit sarewar wrote: > Hi All > I am using Cloudera Ma

Re: How to Archive the Task Logs (Stdout, Stderr, Syslogs)

Hello, You should be looking at Flume. Its made for this http://flume.apache.org/ Thanks, Jagat Singh On Tue, Mar 19, 2013 at 9:03 PM, Christian Schneider < cschneiderpub...@gmail.com> wrote: > Hi, > I found out that these logs are stored directly at the TaskNodes. > > We

Re: R on hadoop

Hi, Please see RHadoop and RMR https://www.google.com.au/search?q=rhadoop+installation Thanks, Jagat Singh On Tue, Mar 25, 2014 at 7:19 AM, Siddharth Tiwari wrote: > Hi team any docummentation around installing r on hadoop > > Sent from my iPhone >

Re: Appending to HDFS file

What is value of dfs.support.append in hdfs-site.cml https://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml On Sat, Aug 23, 2014 at 1:41 AM, rab ra wrote: > Hello, > > I am currently using Hadoop 2.4.1.I am running a MR job using hadoop > streaming utility. >

Re: Programatic way to recursively chmod a directory

I did not try this. What is the error or return code when you use FileUtil https://hadoop.apache.org/docs/stable/api/org/apache/hadoop/fs/FileUtil.html#chmod(java.lang.String, java.lang.String, boolean) chmod public static int *chmod*

Re: Hadoop Handy Commands

This should be good start https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/CommandsManual.html On Thu, Feb 26, 2015 at 9:19 AM, Krish Donald wrote: > Hi, > > Does anybody ahs Hadoop related commands list which comes really handy > when needed? > > If yes, please share.

Re: YARN Exceptions

What is this error User edhdtaesvc not found Are you using any user with that name ? On Sat, Apr 25, 2015 at 3:21 PM, Kumar Jayapal wrote: > Hi, > > I am getting the following error while running sqoop import script. > > can any one please help in resolving this issue. > > > > 15/04/25 03:12

Single node Hortonworks 2.3 VM and Hue 3.8.1 Oozie job submission stuck in Prep state

Hi, I am using single node virtual machine from Hortonworks 2.3 I have configured Hue on the same machine and whenever i submit any job via oozie all go to pending state. I can see the shared library present in the folder [hue@sandbox oozie]$ hadoop fs -ls /user/oozie/share/lib Found 3 items

Where is web server configuration file for Resource manager

Hi, We are running Hadoop 2.6 I want to know where is the web server config (e.g jetty.xml) which is used by Resource Manager server. The problem i am looking for fix is that our security team told to configure web server such that it does not exposes its IP on using following command telnet re