Re: Developing, Testing, Distributing

On 04/07/2011 03:39 AM, Guy Doulberg wrote: Hey, I have been developing Map/Red jars for a while now, and I am still not comfortable with the developing environment I gathered for myself (and the team) I am curious how other Hadoop developers out-there, are developing their jobs... What IDE y

Re: Developing, Testing, Distributing

> How do you test your code, which Unit test libraries your using, how do you > run your automatic tests after you have finished the development? > Do you have test/qa/staging environments beside the dev and the production? > How do you keep it similar to the production > Code reuse - how do you

RE: Developing, Testing, Distributing

Thanks for your answers, I checked cascading for a while, It was easy to get started and to do the tutorial, I really liked the modeling of pipes, cogroups and so on... But when I tried to implement a real life project, things has become too complicated to me, things didn't go the way I expec

Re: Developing, Testing, Distributing

> But when I tried to implement a real life project, things has become too > complicated to me, things didn't go the way I expected them to go, > I had to implement it using plain map/redapi as with any framework (in Java), it takes time to find the best practices. many of which are docum

Re: Developing, Testing, Distributing

Did you try Pig ? It drastically reduces boiler plate code for common operations like, Join, Group, Cogroup, Filter, Projection, Order Pig also gives you some advanced stuff like Multi-query optimization that is ugly to code my hand and difficult to maintain. Most of the people that I know, don'

Re: Developing, Testing, Distributing

I use IntelliJ, though Eclipse works too. I don't have any Hadoop-specific plug-ins; both IDEs are just set up as vanilla Java programming environments. Chapter 5 of *Hadoop: the Definitive Guide *has a good overview of testing methodology. It's what I f

Re: Developing, Testing, Distributing

(Resent with -hadoopuser. Apologize if you receive multiple copies.) From: "Tsz Wo (Nicholas), Sze" To: common-user@hadoop.apache.org Sent: Fri, April 8, 2011 11:08:22 AM Subject: Re: Developing, Testing, Distributing First of all, I a

Re: Developing, Testing, Distributing

First of all, I am a Hadoop contributor and I am familiar with the Hadoop code base/build mechanism. Here is what I do: Q1: What IDE you are using, Eclipse. Q2: What plugins to the IDE you are using No plugins. Q3: How do you test your code, which Unit test libraries your using, how do you

‏‏RE: Developing, Testing, Distributing

Thanks, I think I will try your way of developing (replacing the ant) ‏‏מאת: Tsz Wo (Nicholas), Sze [s29752-hadoopgene...@yahoo.com] ‏‏נשלח: ‏‏יום שישי 08 אפריל 2011 21:08 ‏‏אל: common-user@hadoop.apache.org ‏‏נושא: Re: Developing, Testing, Distributing