Re: calling mapreduce from webservice

2014-04-21 Thread girish hilage
Thanks. I will check if I can use Play.   - Girish From: Mohan Radhakrishnan radhakrishnan.mo...@gmail.com To: user@hadoop.apache.org Sent: Saturday, April 19, 2014 7:27 AM Subject: Re: calling mapreduce from webservice Play framework is reactive and uses

calling mapreduce from webservice

2014-04-18 Thread girish hilage
Hi,    This is just to check with you, if it is possible to call MR jobs from Java Webservices.    If yes, then could you please help me by pointing to some resouces/docs.    Actually, what I intend to do is create a Web UI with some functionality which would call MR jobs and present the

Re: calling mapreduce from webservice

2014-04-18 Thread Shahab Yunus
Question: M/R jobs are supposed to run for a long time. They are essentially batch processes. Do you plan to keep the Web UI blocked for that while? Or are you looking for asynchronous invocation of the M/R job? Or are you thinking about building sort of an Admin UI (e.g. PigLipstick) What exactly

Re: calling mapreduce from webservice

2014-04-18 Thread Shahab Yunus
As far as I know there is no API to kick of M/R jobs. There is for M/R v2, a REST API to get status of jobs: http://hadoop.apache.org/docs/r2.3.0/hadoop-yarn/hadoop-yarn-site/MapredAppMasterRest.html#Mapreduce_Application_Master_Info_API I would say that you have invoke M/R jobs in your middle

Re: calling mapreduce from webservice

2014-04-18 Thread Mohan Radhakrishnan
Play framework is reactive and uses push channels. It may be useful here if the UI has to be asynchronous and reactive. Mohan On Sat, Apr 19, 2014 at 4:37 AM, Shahab Yunus shahab.yu...@gmail.comwrote: As far as I know there is no API to kick of M/R jobs. There is for M/R v2, a REST API to