Re: Extending ClusterMapReduceTestCase

2009-04-15 Thread czero
ng tests on, it >> is >> very nice, as you can interact via the web ui. >> Especially since the virtual cluster stuff is somewhat flaky under >> windows. >> >> I have a question in to the editor about the sample code. >> >> >> >> On Tue, Ap

Re: Extending ClusterMapReduceTestCase

2009-04-14 Thread czero
insisting on word to > recent > for crossover. > > On Mon, Apr 13, 2009 at 9:16 AM, czero wrote: > >> >> Sry, I forgot to include the not-IntelliJ-console output :) >> >> 09/04/13 12:07:14 ERROR mapred.MiniMRCluster: Job tracker crashed >

Re: Extending ClusterMapReduceTestCase

2009-04-13 Thread czero
has the log4j.properties in it. I also tried running the same test with hadoop-core/test 0.19.0 - same thing. Thanks again, bc czero wrote: > > Hey all, > > I'm also extending the ClusterMapReduceTestCase and having a bit of > trouble as well. > > Currently I

Re: Extending ClusterMapReduceTestCase

2009-04-13 Thread czero
Hey all, I'm also extending the ClusterMapReduceTestCase and having a bit of trouble as well. Currently I'm getting : Starting DataNode 0 with dfs.data.dir: build/test/data/dfs/data/data1,build/test/data/dfs/data/data2 Starting DataNode 1 with dfs.data.dir: build/test/data/dfs/data/data3,build/

Forcing particular nodes to perform m/r tasks?

2008-08-18 Thread czero
There might be a better way around this problem, and I'm all ears (eyes?) if you see one - but I'm running in a bit of a snag... Currently, we're running in millions of lines of log data and writing the parsed output into H2 (embedded) instances distributed across all nodes local file systems. T