Re: Cygwin not working with Hadoop and Eclipse Plugin
Try using virtual box/vmware and downloading either an image that has hadoop on it or a linux image and installing it there. Good luck James. On 2011-07-26, at 12:33 PM, A Df wrote: > Dear All: > > I am trying to run Hadoop on Windows 7 so as to test programs before moving > to Unix/Linux. I have downloaded the Hadoop 0.20.2 and Eclipse 3.6 because I > want to use the plugin. I am also using cygwin. However, I set the > environment variable for JAVA_HOME and added the > c:\cygwin\bin;c:\cygwin\usr\bin to the PATH variable but I still get the > error below when trying to start the Hadoop. This is based on the > instructions to edit the file conf/hadoop-env.sh to define at least JAVA_HOME > to be the root of your Java installation which I changed to "export > JAVA_HOME=/cygdrive/c/Program\ Files\ \(x86\)/Java/jdk1.6.0_26" with no > success. I added the \ to escape special characters. > > > Error: > bin/hadoop: line 258: /cygdrive/c/Program: No such file or directory > > > I also wanted to find out which is the stable release of Hadoop and which > version of Eclipse and the Plugin should I use? So far almost every tutorial > I have seen from Googling shows different versions like on: > http://developer.yahoo.com/hadoop/tutorial/index.html > OR > http://v-lad.org/Tutorials/Hadoop/00%20-%20Intro.html > > In Eclipse the WordCount project has 42 errors because it will not recognize > the "import org.apache.." in the code. > > > I wanted to test on Windows first to get a feel of Hadoop since I am new to > it and also because I am newbie Unix/Linux user. I have been trying to follow > the tutorials shown at the link above but each time I run into errors with > the plugin or not recognizing the import or JAVA_HOME not set. Please can I > get some help. Thanks > > Cheers > A Df
Re: Cygwin not working with Hadoop and Eclipse Plugin
A Df, (Inlines) On Wed, Jul 27, 2011 at 12:03 AM, A Df wrote: > Dear All: > > I am trying to run Hadoop on Windows 7 so as to test programs before moving > to Unix/Linux. I have downloaded the Hadoop 0.20.2 and Eclipse 3.6 because I > want to use the plugin. I am also using cygwin. However, I set the > environment variable for JAVA_HOME and added the > c:\cygwin\bin;c:\cygwin\usr\bin to the PATH variable but I still get the > error below when trying to start the Hadoop. This is based on the > instructions to edit the file conf/hadoop-env.sh to define at least JAVA_HOME > to be the root of your Java installation which I changed to "export > JAVA_HOME=/cygdrive/c/Program\ Files\ \(x86\)/Java/jdk1.6.0_26" with no > success. I added the \ to escape special characters. This looks fine. > Error: > bin/hadoop: line 258: /cygdrive/c/Program: No such file or directory I've encountered this before, its harmless. Your problem lies elsewhere. Is the Cygwin's bin/ directory on your Windows path? What errors do you get on submit? > I also wanted to find out which is the stable release of Hadoop and which > version of Eclipse and the Plugin should I use? So far almost every tutorial > I have seen from Googling shows different versions like on: > http://developer.yahoo.com/hadoop/tutorial/index.html > OR > http://v-lad.org/Tutorials/Hadoop/00%20-%20Intro.html > > In Eclipse the WordCount project has 42 errors because it will not recognize > the "import org.apache.." in the code. The last known version I'd heard had a no-complains, fully-working eclipse plugin along with it was Hadoop 0.20.2 (although stable is 203, I've seen lots of issues pop up with eclipse plugin from members on the ML, but someone else can comment better on if its fixed for 204 or is a non-issue). I've used this one personally on Windows myself and things work. I think there was just one issue one could encounter somehow and I'd covered it in a blog post some time ago, here: http://www.harshj.com/2010/07/18/making-the-eclipse-plugin-work-for-hadoop/ Beyond that, the tutorial at v-lad.org is the one I'd recommend following. It has worked well for me over time. > I wanted to test on Windows first to get a feel of Hadoop since I am new to > it and also because I am newbie Unix/Linux user. I have been trying to follow > the tutorials shown at the link above but each time I run into errors with > the plugin or not recognizing the import or JAVA_HOME not set. Please can I > get some help. Thanks I'd say use Linux when/where possible. A VM is a good choice as well, as James pointed out above, if your hardware can handle it. Also checkout the Karmasphere's community edition tools @ http://karmasphere.com/Download/register-for-community-edition.html -- They require registration but were good to start with when I'd tried them ~1 year ago. Should be better now. Not sure if they are F/OSS but surely good tools. -- Harsh J Get CDH and more: http://www.cloudera.com/hadoop
RE: Cygwin not working with Hadoop and Eclipse Plugin
Hi A Df, I haven't set up Hadoop under cygwin, but I use cygwin a lot. One thing I would suggest is to use the bash shell in cygwin and use the following format for the $PATH additions: PATH=$PATH:/cygdrive/c/cygwin/bin:/cygdrive/c/cygwin/usr/bin My understanding is that the stable version of Hadoop is 0.20.203. Thanks, -Eric > -Original Message- > From: A Df [mailto:abbey_dragonfor...@yahoo.com] > Sent: Tuesday, July 26, 2011 1:34 PM > To: common-user@hadoop.apache.org > Subject: Cygwin not working with Hadoop and Eclipse Plugin > > Dear All: > > I am trying to run Hadoop on Windows 7 so as to test programs before > moving to Unix/Linux. I have downloaded the Hadoop 0.20.2 and Eclipse 3.6 > because I want to use the plugin. I am also using cygwin. However, I set > the environment variable for JAVA_HOME and added the > c:\cygwin\bin;c:\cygwin\usr\bin to the PATH variable but I still get the > error below when trying to start the Hadoop. This is based on the > instructions to edit the file conf/hadoop-env.sh to define at least > JAVA_HOME to be the root of your Java installation which I changed to > "export JAVA_HOME=/cygdrive/c/Program\ Files\ \(x86\)/Java/jdk1.6.0_26" > with no success. I added the \ to escape special characters. > > > Error: > bin/hadoop: line 258: /cygdrive/c/Program: No such file or directory > > > I also wanted to find out which is the stable release of Hadoop and which > version of Eclipse and the Plugin should I use? So far almost every > tutorial I have seen from Googling shows different versions like on: > http://developer.yahoo.com/hadoop/tutorial/index.html > OR > http://v-lad.org/Tutorials/Hadoop/00%20-%20Intro.html > > In Eclipse the WordCount project has 42 errors because it will not > recognize the "import org.apache.." in the code. > > > I wanted to test on Windows first to get a feel of Hadoop since I am new > to it and also because I am newbie Unix/Linux user. I have been trying to > follow the tutorials shown at the link above but each time I run into > errors with the plugin or not recognizing the import or JAVA_HOME not set. > Please can I get some help. Thanks > > Cheers > A Df
Re: Cygwin not working with Hadoop and Eclipse Plugin
A Df, Try reinstalling java to a friendlier location (without spaces) - c:\java rather than c:\Program Files - it's parsing on the space is what it appears from the error message ~ I've encountered this very same problem. JAVA_HOME to be the root of your Java installation which I changed to > "export JAVA_HOME=/cygdrive/c/Program\ Files\ \(x86\)/Java/jdk1.6.0_26" with > no success. I added the \ to escape special characters. EF On Tue, Jul 26, 2011 at 12:33 PM, A Df wrote: > Dear All: > > I am trying to run Hadoop on Windows 7 so as to test programs before moving > to Unix/Linux. I have downloaded the Hadoop 0.20.2 and Eclipse 3.6 because I > want to use the plugin. I am also using cygwin. However, I set the > environment variable for JAVA_HOME and added the > c:\cygwin\bin;c:\cygwin\usr\bin to the PATH variable but I still get the > error below when trying to start the Hadoop. This is based on the > instructions to edit the file conf/hadoop-env.sh to define at least > JAVA_HOME to be the root of your Java installation which I changed to > "export JAVA_HOME=/cygdrive/c/Program\ Files\ \(x86\)/Java/jdk1.6.0_26" with > no success. I added the \ to escape special characters. > > > Error: > bin/hadoop: line 258: /cygdrive/c/Program: No such file or directory > > > I also wanted to find out which is the stable release of Hadoop and which > version of Eclipse and the Plugin should I use? So far almost every tutorial > I have seen from Googling shows different versions like on: > http://developer.yahoo.com/hadoop/tutorial/index.html > OR > http://v-lad.org/Tutorials/Hadoop/00%20-%20Intro.html > > In Eclipse the WordCount project has 42 errors because it will not > recognize the "import org.apache.." in the code. > > > I wanted to test on Windows first to get a feel of Hadoop since I am new to > it and also because I am newbie Unix/Linux user. I have been trying to > follow the tutorials shown at the link above but each time I run into errors > with the plugin or not recognizing the import or JAVA_HOME not set. Please > can I get some help. Thanks > > Cheers > A Df > -- *Eric Fiala* *Fiala Consulting* T: 403.828.1117 E: e...@fiala.ca http://www.fiala.ca
Re: Cygwin not working with Hadoop and Eclipse Plugin
Harsh: See (inline at the **) I hope its easy to follow and for the other responses, I was not sure how to respond to get everything into one. Sorry for top posting! Eric where would I put the line below and explain in newbie terms, thanks: PATH=$PATH:/cygdrive/c/cygwin/bin:/cygdrive/c/cygwin/usr/bin EF: I will try to reinstall Java and yes the spaces gives problems. :( Cheers, A Df > >From: Harsh J >To: common-user@hadoop.apache.org; A Df >Sent: Tuesday, 26 July 2011, 20:25 >Subject: Re: Cygwin not working with Hadoop and Eclipse Plugin > >A Df, > >(Inlines) > >On Wed, Jul 27, 2011 at 12:03 AM, A Df wrote: >> Dear All: >> >> I am trying to run Hadoop on Windows 7 so as to test programs before moving >> to Unix/Linux. I have downloaded the Hadoop 0.20.2 and Eclipse 3.6 because I >> want to use the plugin. I am also using cygwin. However, I set the >> environment variable for JAVA_HOME and added the >> c:\cygwin\bin;c:\cygwin\usr\bin to the PATH variable but I still get the >> error below when trying to start the Hadoop. This is based on the >> instructions to edit the file conf/hadoop-env.sh to define at least >> JAVA_HOME to be the root of your Java installation which I changed to >> "export JAVA_HOME=/cygdrive/c/Program\ Files\ \(x86\)/Java/jdk1.6.0_26" with >> no success. I added the \ to escape special characters. > >This looks fine. > >> Error: >> bin/hadoop: line 258: /cygdrive/c/Program: No such file or directory > >I've encountered this before, its harmless. Your problem lies >elsewhere. Is the Cygwin's bin/ directory on your Windows path? What >errors do you get on submit? > >> I also wanted to find out which is the stable release of Hadoop and which >> version of Eclipse and the Plugin should I use? So far almost every tutorial >> I have seen from Googling shows different versions like on: >> http://developer.yahoo.com/hadoop/tutorial/index.html >> OR >> http://v-lad.org/Tutorials/Hadoop/00%20-%20Intro.html >> >> In Eclipse the WordCount project has 42 errors because it will not recognize >> the "import org.apache.." in the code. > >The last known version I'd heard had a no-complains, fully-working >eclipse plugin along with it was Hadoop 0.20.2 (although stable is >203, I've seen lots of issues pop up with eclipse plugin from members >on the ML, but someone else can comment better on if its fixed for 204 >or is a non-issue). I've used this one personally on Windows myself >and things work. I think there was just one issue one could encounter >somehow and I'd covered it in a blog post some time ago, here: >http://www.harshj.com/2010/07/18/making-the-eclipse-plugin-work-for-hadoop/ > >** I tried to use the patch but my cygwin gives the error: "bash: patch: >command not found" > >Beyond that, the tutorial at v-lad.org is the one I'd recommend >following. It has worked well for me over time. > >** yes, the screenshots and instructions are easy to follow just that I seem >to always have a problem with the plugin or cygwin > >> I wanted to test on Windows first to get a feel of Hadoop since I am new to >> it and also because I am newbie Unix/Linux user. I have been trying to >> follow the tutorials shown at the link above but each time I run into errors >> with the plugin or not recognizing the import or JAVA_HOME not set. Please >> can I get some help. Thanks > >I'd say use Linux when/where possible. A VM is a good choice as well, >as James pointed out above, if your hardware can handle it. > >** Harsh and James, I tried the vmware from the Yahoo tutorial but I had >problems with the plugin too. > >Also checkout the Karmasphere's community edition tools @ >http://karmasphere.com/Download/register-for-community-edition.html -- >They require registration but were good to start with when I'd tried >them ~1 year ago. Should be better now. Not sure if they are F/OSS but >surely good tools. > >** looks good, thanks I will give it a try tomorrow >-- >Harsh J >Get CDH and more: http://www.cloudera.com/hadoop > > >
Re: Cygwin not working with Hadoop and Eclipse Plugin
A Df, On Wed, Jul 27, 2011 at 1:42 AM, A Df wrote: > Harsh: > > See (inline at the **) I hope its easy to follow and for the other responses, > I was not sure how to respond to get everything into one. Sorry for top > posting! Np! I don't strongly enforce a style of reply so long as it is visible, and readable :) > > Eric where would I put the line below and explain in newbie terms, thanks: > PATH=$PATH:/cygdrive/c/cygwin/bin:/cygdrive/c/cygwin/usr/bin You'd set this in your Windows environment. A good guide (googled link): http://geekswithblogs.net/renso/archive/2009/10/21/how-to-set-the-windows-path-in-windows-7.aspx >>The last known version I'd heard had a no-complains, fully-working >>eclipse plugin along with it was Hadoop 0.20.2 (although stable is >>203, I've seen lots of issues pop up with eclipse plugin from members >>on the ML, but someone else can comment better on if its fixed for 204 >>or is a non-issue). I've used this one personally on Windows myself >>and things work. I think there was just one issue one could encounter >>somehow and I'd covered it in a blog post some time ago, here: >>http://www.harshj.com/2010/07/18/making-the-eclipse-plugin-work-for-hadoop/ >> >>** I tried to use the patch but my cygwin gives the error: "bash: patch: >>command not found" Feared you may face it. You need to install the patch program from Cygwin's package manager/installer. I believe the package name is (iirc): patchutils >>Beyond that, the tutorial at v-lad.org is the one I'd recommend >>following. It has worked well for me over time. >> >>** yes, the screenshots and instructions are easy to follow just that I seem >>to always have a problem with the plugin or cygwin What specific error do you get when you load the plugin or start the daemons via cygwin shell, etc.? Its easier for folks to answer if they see an error message, or a stacktrace. >>> I wanted to test on Windows first to get a feel of Hadoop since I am new to >>> it and also because I am newbie Unix/Linux user. I have been trying to >>> follow the tutorials shown at the link above but each time I run into >>> errors with the plugin or not recognizing the import or JAVA_HOME not set. >>> Please can I get some help. Thanks >> >>I'd say use Linux when/where possible. A VM is a good choice as well, >>as James pointed out above, if your hardware can handle it. >> >>** Harsh and James, I tried the vmware from the Yahoo tutorial but I had >>problems with the plugin too. You can setup a raw linux VM, and install stuff atop. I've had better success with the VMs Cloudera offers: https://ccp.cloudera.com/display/SUPPORT/Cloudera's+Hadoop+Demo+VM (They come ready with the whole stack). But basically it all boils down to using a Linux VM, wherever you source it from. -- Harsh J
Re: Cygwin not working with Hadoop and Eclipse Plugin
See (inline at ***) Cheers, A Df > >From: Harsh J >To: common-user@hadoop.apache.org; A Df >Sent: Tuesday, 26 July 2011, 21:29 >Subject: Re: Cygwin not working with Hadoop and Eclipse Plugin > >A Df, > >On Wed, Jul 27, 2011 at 1:42 AM, A Df wrote: >> Harsh: >> >> See (inline at the **) I hope its easy to follow and for the other >> responses, I was not sure how to respond to get everything into one. Sorry >> for top posting! > >Np! I don't strongly enforce a style of reply so long as it is >visible, and readable :) > >> >> Eric where would I put the line below and explain in newbie terms, thanks: >> PATH=$PATH:/cygdrive/c/cygwin/bin:/cygdrive/c/cygwin/usr/bin > >*** I have added it to the PATH variable as >"$PATH:/cygdrive/c/cygwin/bin:/cygdrive/c/cygwin/usr/bin", I hope this is >correct. > >You'd set this in your Windows environment. A good guide (googled >link): >http://geekswithblogs.net/renso/archive/2009/10/21/how-to-set-the-windows-path-in-windows-7.aspx > >>>The last known version I'd heard had a no-complains, fully-working >>>eclipse plugin along with it was Hadoop 0.20.2 (although stable is >>>203, I've seen lots of issues pop up with eclipse plugin from members >>>on the ML, but someone else can comment better on if its fixed for 204 >>>or is a non-issue). I've used this one personally on Windows myself >>>and things work. I think there was just one issue one could encounter >>>somehow and I'd covered it in a blog post some time ago, here: >>>http://www.harshj.com/2010/07/18/making-the-eclipse-plugin-work-for-hadoop/ >>> >>>** I tried to use the patch but my cygwin gives the error: "bash: patch: >>>command not found" > >Feared you may face it. You need to install the patch program from >Cygwin's package manager/installer. I believe the package name is >(iirc): patchutils > >*** I installed the patchutils but now when I reach the ant command it gives >error: "bash: ant: command not found". I searched for a ant plugin but I don't >see any. How do I get to run the line "ant -Declipse.home=$ECLIPSE_HOME binary"? > >>>Beyond that, the tutorial at v-lad.org is the one I'd recommend >>>following. It has worked well for me over time. >>> >>>** yes, the screenshots and instructions are easy to follow just that I seem >>>to always have a problem with the plugin or cygwin > >What specific error do you get when you load the plugin or start the >daemons via cygwin shell, etc.? Its easier for folks to answer if they >see an error message, or a stacktrace. > >>>> I wanted to test on Windows first to get a feel of Hadoop since I am new >>>> to it and also because I am newbie Unix/Linux user. I have been trying to >>>> follow the tutorials shown at the link above but each time I run into >>>> errors with the plugin or not recognizing the import or JAVA_HOME not set. >>>> Please can I get some help. Thanks >>> >>>I'd say use Linux when/where possible. A VM is a good choice as well, >>>as James pointed out above, if your hardware can handle it. >>> >>>** Harsh and James, I tried the vmware from the Yahoo tutorial but I had >>>problems with the plugin too. > >You can setup a raw linux VM, and install stuff atop. I've had better >success with the VMs Cloudera offers: >https://ccp.cloudera.com/display/SUPPORT/Cloudera's+Hadoop+Demo+VM >(They come ready with the whole stack). But basically it all boils >down to using a Linux VM, wherever you source it from. > >-- >Harsh J > > >
