>> Java is supposed to be Write Once - Run Anywhere, but a lot of java projects >> seem to forget that.
It's not that Hadoop developers forgot this goal, but that Java 6 doesn't support some system-level disk i/o operations that HDFS needs. This left us a choice of coding JNI calls (requiring a Windows-specific C/C++ compile environment) or making outcalls to a Windows-specific shell. Cygwin is free, and provides a solution (admittedly imperfect) for both alternatives: - Gnu C++ (free, standard libraries) instead of requiring MSVC (expensive, and Windows-centric libraries) - unix-like shell veneer These choices allow the small amount of platform-specific code needed in Hadoop to be reasonably similar cross-platform, instead of radically different for Windows and Unix platforms. That is an attempt to be as-consistent-as-possible with the ideal of platform independence. They also allow the vast majority of non-Windows developers working on Hadoop to take some responsibility for keeping the Windows version working instead of claiming they don't understand Windows-specific coding. When we move to Java 7, we may be able to eliminate a lot of the cruft in the Windows support. If you would like to help in that effort, your contributions would be greatly appreciated! :-) Best, --Matt On Jun 10, 2011, at 7:23 AM, Bible, Landy wrote: Hi Raja, I'm currently running HDFS on Windows 7 desktops. I had to create a hadoop.bat that provided the same functionality of the shell scripts, and some Java Service Wrapper configs to run the DataNodes and NameNode as windows services. Once I get my system more functional I plan to do a write up about how I did it, but it wasn't too difficult. I'd also like to see Hadoop become less platform dependent. Java is supposed to be Write Once - Run Anywhere, but a lot of java projects seem to forget that. So far, I've been unable to make MapReduce work correctly. The services run, but things don't work, however I suspect that this is due to DNS not working correctly in my environment. -Landy -----Original Message----- From: Raja Nagendra Kumar [mailto:nagendra.r...@tejasoft.com] Sent: Friday, June 10, 2011 12:38 AM To: core-u...@hadoop.apache.org Subject: Hadoop on windows with bat and ant scripts Hi, I see hadoop would need unix (on windows with Cygwin) to run. It would be much nice if Hadoop gets away from the shell scripts though appropriate ant scripts or with java Admin Console kind of model. Then it becomes lighter for development. Are there any known plans or am I missing some thing..:) Regards, Raja Nagendra Kumar, C.T.O www.tejasoft.com -- View this message in context: http://old.nabble.com/Hadoop-on-windows-with-bat-and-ant-scripts-tp31815353p31815353.html Sent from the Hadoop core-user mailing list archive at Nabble.com.
