Currently Windows is not a supported production platform for Hadoop. You
should run all of your daemons on Linux machines. You can move your data to
HDFS on those nodes easily, the C# piece you can use Hadoop Streaming (
http://hadoop.apache.org/common/docs/r0.20.2/streaming.html#Hadoop+Streaming)
to leverage the code you already have written., and if you have trouble it
shouldn't be too bad to port over to Java.
Therefore you shouldn't have to do much re-work. I hope this helps.
Best,
Linden
On Tue, Sep 27, 2011 at 11:19 PM, Hamedani, Masoud <
mas...@agape.hanyang.ac.kr> wrote:
> Special Thanks for your help Arko,
>
> You mean in Hadoop, NameNode, DataNodes, JobTracker, TaskTrackers and all
> the clusters should deployed on Linux machines???
> We have lots of data (on windows OS) and code (written in C#) for data
> mining, we wana to use Hadoop and make connection between
> our existing systems and programs with it.
> as you mentioned we should move all of our data to Linux systems, and
> execute existing C# codes in Linux and only use windows for
> development same as before.
> Am I right?
>
> Thanks,
> B.S
> Masoud.
>
> 2011/9/28 Arko Provo Mukherjee <arkoprovomukher...@gmail.com>
>
> > Hi,
> >
> > A development platform is the system (s) which are used mainly for the
> > developers to write / unit test code for the project.
> >
> > There are generally NO end users in the Development system.
> >
> > Production platform is where the end users actually work and the
> > project is generally moved here only after it is tested in one / more
> > test platforms.
> >
> > Typically, if the developer is the end user, which it is in some
> > cases, (even more likely for University projects) there's generally no
> > need to make your project run on separate production or test
> > system(s).
> >
> > The documentation means that you can use Hadoop in WIn32 for
> > developing your code, but finally if you use that code and then run
> > production boxes on Win32 (i.e end users are using a Win32 Hadoop
> > system), then that is not supported.
> >
> > Correct me guys if I am wrong.
> >
> > Thanks & regards
> > Arko
> >
> > On Tue, Sep 27, 2011 at 9:32 PM, Hamedani, Masoud
> > <mas...@agape.hanyang.ac.kr> wrote:
> > > Dear Friends,
> > >
> > > Im new in hadoop for an important data mining university research, i
> saw
> > > these sentences in different hadoop related docs:
> > >
> > > { Win32 is supported as a *development platform* not as a *production
> > > platform*, but Linux supported both. }
> > >
> > > whats difference between *development platform and * *production
> platform
> > > ???
> > > *it means dataNode and nameNode??
> > >
> > > Thanks,
> > > B.S
> > >
> >
>
--
Linden Hillenbrand
Customer Operations Engineer
Phone: 650.644.3900 x4946
Email: lin...@cloudera.com
Twitter: @lhillenbrand
Data: http://www.cloudera.com
