Ravi, > So back to my original question, how can I use hadoop inside hbase?
Hadoop and HBase are separate software. I could try to explain this to you in detail but perhaps the answer would just be confusing. It is as simple as this: If you want to use Hadoop, then you must install Hadoop. Please see http://wiki.apache.org/hadoop/GettingStartedWithHadoop - Andy ----- Original Message ---- > From: Ravi <[email protected]> > To: [email protected] > Sent: Thu, December 17, 2009 7:34:50 PM > Subject: Re: Can I use hadoop inside hbase? > > > I installed hbase as described here: > http://hadoop.apache.org/hbase/docs/current/cygwin.html > > I am only using it for development purposes only, hence no concerns > about performance etc. I can bet millions of people would love an easier > windows install for development/experimentation purposes. > > So back to my original question, how can I use hadoop inside hbase? > > > > Andrew Purtell wrote: > > I should also add that HBase running in standalone mode without Hadoop is > > only > useful for limited testing and I don't recommend it. > > > > - Andy > > > > On Sun Nov 29th, 2009 5:39 PM PST Andrew Purtell wrote: > > > >> If you want to run Hadoop commands, then you must install Hadoop of > >> course. > Please see http://wiki.apache.org/hadoop/GettingStartedWithHadoop > >> > >> HBase does not have a Windows distribution per se, so I am a little > >> confused > about just what you have installed. I presume you downloaded the HBase > release > tarball. > >> > >> - Andy > >> > >> > >> On Sun Nov 29th, 2009 3:57 PM PST Ravi wrote: > >> > >>> > >>> I am using the windows distribution, it must have come with hadoop built > >>> in > as I did not install hadoop separately. The distribution however does not > have > any hadoop commands or shell scripts. > >>> > >>> So looks like this is a hbase windows distribution issue? > >>> > >>> > >>> Andrew Purtell wrote: > >>>> To run HBase you must have installed Hadoop underneath. The Hadoop top > level command line script 'bin/hadoop' is available in your Hadoop > installation. > Just put the Hadoop bin/ dir on the path along with the HBase bin/ dir. > >>>> You can also run some Hadoop applications using the HBase command > >>>> script, > but that is missing the shortcuts, e.g. instead of > >>>> > >>>> hadoop fs -copyFromLocal ... > >>>> > >>>> it is > >>>> hbase org.apache.hadoop.fs.FsShell -copyFromLocal ... > >>>> > >>>> This will work for DFS but for other filesystems which need supporting > >>>> jars > in lib/, your mileage will vary. Just put the Hadoop bin/ dir on the path > along > with the HBase bin/ dir and use the appropriate one for the circumstances. > >>>> - Andy > >>>> > >>>> > >>>> > >>>> ________________________________ > >>>> From: Ravi > >>>> To: [email protected] > >>>> Sent: Sun, November 29, 2009 8:28:58 AM > >>>> Subject: Re: Can I use hadoop inside hbase? > >>>> > >>>> Thanks for the quick clarification Jeff. > >>>> > >>>> In hbase distribution, I am unable to find hadoop command to load files > into DFS. How do I add hadoop commands to hbase distribution? > >>>> > >>>> > >>>> Jeff Zhang wrote: > >>>>> Of course, you can. I run my pig script on the cluster and run hbase on > the > >>>>> same cluster, it works fine. > >>>>> > >>>>> Jeff Zhang > >>>>> > >>>>> > >>>>> On Sat, Nov 28, 2009 at 9:45 PM, Ravi wrote: > >>>>> > >>>>>> If I setup a hbase cluster, say with 10 nodes, can I also use the same > >>>>>> cluster for my distributed program using the hadoop running underneath > >>>>>> hbase? > >>>>>> > >>>>>> Essentially the thought is to use underlying hadoop for two purposes, > data > >>>>>> as well as logic. > >>>>>> > >>>>>> Any thoughts? > >>>>>> > >>>>>> > >>>> > >>>> > >> > >> > >> > > > > > > > > > >
