Re: development environment for hadoop core

2013-01-21 Thread Colin McCabe
Hi Erik, Eclipse can run junit tests very rapidly. If you want a shorter test cycle, that's one way to get it. There is also Maven-shell, which reduces some of the overhead of starting Maven. But I haven't used it so I can't really comment. cheers, Colin On Mon, Jan 21, 2013 at 8:36 AM, Erik

Re: development environment for hadoop core

2013-01-21 Thread Erik Paulson
On Wed, Jan 16, 2013 at 7:31 AM, Glen Mazza wrote: > On 01/15/2013 06:50 PM, Erik Paulson wrote: > >> Hello - >> >> I'm curious what Hadoop developers use for their day-to-day hacking on >> Hadoop. I'm talking changes to the Hadoop libraries and daemons, and not >> developing Map-Reduce jobs or u

Re: development environment for hadoop core

2013-01-16 Thread Hitesh Shah
On Jan 16, 2013, at 6:17 AM, Gopal Vijayaraghavan wrote: > So, this is a question I have for everyone else. > > How do I change the hadoop version of an entire build, so that I can > name it something unique & use it in other builds in maven (-SNAPSHOT > doesn't cut it, since occasionally mvn wi

Re: development environment for hadoop core

2013-01-16 Thread Gopal Vijayaraghavan
Not quite an advance developer, but I learnt some shortcuts for my dev cycle along the way. > I've checked out Hadoop, made minor changes and built it with Maven, and > tracked down the resulting artifacts in a target/ directory that I could > deploy. Is this typically how a cloudera/hortonworks/m

Re: development environment for hadoop core

2013-01-16 Thread Glen Mazza
On 01/15/2013 06:50 PM, Erik Paulson wrote: Hello - I'm curious what Hadoop developers use for their day-to-day hacking on Hadoop. I'm talking changes to the Hadoop libraries and daemons, and not developing Map-Reduce jobs or using using the HDFS Client libraries to talk to a filesystem from an

Re: development environment for hadoop core

2013-01-16 Thread Steve Loughran
My setup ( I work from home) # OS/X laptop w/ 30" monitor # FTTC broadband, 55Mbit/s down, 15+ up -it's the upload bandwidth that really helps development: http://www.flickr.com/photos/steve_l/8050751551/ # IntelliJ IDEA IDE, settings edited for a 2GB Heap # Maven on the command line for builds #

Re: development environment for hadoop core

2013-01-15 Thread Surenkumar Nihalani
I use Eclipse. I haven't figured out how to run and use mvn from it. I just use it as a editor. I have a git repo in commons/src. A branch for each jira. I rebase on branches to keep pulling in svn updates on branches. On Jan 15, 2013, at 9:08 PM, Andy Isaacson wrote: > On Tue, Jan 15, 2013

Re: development environment for hadoop core

2013-01-15 Thread Andy Isaacson
On Tue, Jan 15, 2013 at 3:50 PM, Erik Paulson wrote: > I'm curious what Hadoop developers use for their day-to-day hacking on > Hadoop. I'm talking changes to the Hadoop libraries and daemons, and not > developing Map-Reduce jobs or using using the HDFS Client libraries to talk > to a filesystem f

Re: development environment for hadoop core

2013-01-15 Thread Todd Lipcon
Hi Erik, When I started out on Hadoop development, I used to use emacs for most of my development. I eventually "saw the light" and switched to eclipse with a bunch of emacs keybindings - using an IDE is really handy in Java for functions like "find callers of", quick navigation to types, etc. eta

development environment for hadoop core

2013-01-15 Thread Erik Paulson
Hello - I'm curious what Hadoop developers use for their day-to-day hacking on Hadoop. I'm talking changes to the Hadoop libraries and daemons, and not developing Map-Reduce jobs or using using the HDFS Client libraries to talk to a filesystem from an application. I've checked out Hadoop, made mi