Please take a look at Alek and Jimmy's paper on ML in Pig; there are also a few presentations they did on this, here's one from the Hadoop Summit: https://speakerdeck.com/u/lintool/p/large-scale-machine-learning-at-twitter
Note also that Ted Dunning has taken some of the stuff we open-sourced that allows us to do this, and hooked it up with Mahout feature vectors: https://github.com/tdunning/pig-vector (we do something quite similar internally, using the same base libraries). -Dmitriy On Thu, Sep 6, 2012 at 12:27 AM, Manish Bhoge <manishbh...@rocketmail.com> wrote: > Thanks Siddharth this is really new stuff for me. > Sent from my BlackBerry, pls excuse typo > > -----Original Message----- > From: Siddharth Tiwari <siddharth.tiw...@tcs.com> > Date: Thu, 6 Sep 2012 03:38:58 > To: <user@pig.apache.org>; <anurag.gul...@aexp.com> > Reply-To: user@pig.apache.org > Subject: Re: Machine Learning + Pig? > > HI Anurag, > > Yes its offcourse possible. > Infact there are numerous implementations by twitter on pig as it saves them > from a lot of java coding. > Infact we are also working for AEXP on ML over Hadoop. > You can try googling about mnesia, pignlproc, and there are many more > implementations. Primarily clustering and classification. > > > -----"Anurag Gulati" <anurag.gul...@aexp.com> wrote: ----- > To: "user@pig.apache.org" <user@pig.apache.org> > From: "Anurag Gulati" <anurag.gul...@aexp.com> > Date: 09/06/2012 02:59AM > Subject: Machine Learning + Pig? > > Hello Everyone! > > I was wondering if there are any resources that show Machine Learning > Algorithms implemented in Pig. > > Thanks for your Help! > > -Anurag G. > > American Express made the following annotations on Wed Sep 05 2012 14:28:25 > > ****************************************************************************** > > "This message and any attachments are solely for the intended recipient and > may contain confidential or privileged information. If you are not the > intended recipient, any disclosure, copying, use, or distribution of the > information included in this message and any attachments is prohibited. If > you have received this communication in error, please notify us by reply > e-mail and immediately and permanently delete this message and any > attachments. Thank you." > > American Express a ajouté le commentaire suivant le Wed Sep 05 2012 14:28:25 > > Ce courrier et toute pièce jointe qu'il contient sont réservés au seul > destinataire indiqué et peuvent renfermer des renseignements confidentiels et > privilégiés. Si vous n'êtes pas le destinataire prévu, toute divulgation, > duplication, utilisation ou distribution du courrier ou de toute pièce jointe > est interdite. Si vous avez reçu cette communication par erreur, veuillez > nous en aviser par courrier et détruire immédiatement le courrier et les > pièces jointes. Merci. > > ****************************************************************************** > ------------------------------------------------------------------------------- > > =====-----=====-----===== > Notice: The information contained in this e-mail > message and/or attachments to it may contain > confidential or privileged information. If you are > not the intended recipient, any dissemination, use, > review, distribution, printing or copying of the > information contained in this e-mail message > and/or attachments to it are strictly prohibited. If > you have received this communication in error, > please notify us by reply e-mail or telephone and > immediately and permanently delete the message > and any attachments. Thank you > > >
