Re: Potential race condition (Hadoop 18.3)

2009-03-02 Thread Ryan Shih
Koji - That looks like it did the trick - we're smooth sailing now. Thanks a lot! On Mon, Mar 2, 2009 at 2:02 PM, Ryan Shih wrote: > Koji - That makes a lot of sense. The two tasks are probably stepping over > each other. I'll give it a try and let you know how it goes. >

Re: Potential race condition (Hadoop 18.3)

2009-03-02 Thread Ryan Shih
xt()) { >AggregateRecord m = values.next(); >accum.extend(m); >} >AggregateRecord ar = mapRequestData(accum); >if(ar != null) { > System.out.println("REDUCER: " + key + " " + > k

Re: Potential race condition (Hadoop 18.3)

2009-03-02 Thread Ryan Shih
WorkOutputPath. > > http://hadoop.apache.org/core/docs/r0.18.3/api/org/apache/hadoop/mapred/ > FileOutputFormat.html#getWorkOutputPath(org.apache.hadoop.mapred.JobConf<http://hadoop.apache.org/core/docs/r0.18.3/api/org/apache/hadoop/mapred/%0AFileOutputFormat.html#getWorkOutputPath%28org

Potential race condition (Hadoop 18.3)

2009-03-02 Thread Ryan Shih
Hi - I'm not sure yet, but I think I might be hitting a race condition in Hadoop 18.3. What seems to happen is that in the reduce phase, some of my tasks perform speculative execution but when the initial task completes successfully, it sends a kill to the new task started. After all is said and do

Re: mysql metastore problems

2009-02-23 Thread Ryan Shih
Please ignore the last message, I must have responded to an older hive message and it put in the Hadoop core mailing list instead. I've reposted on the hive user list. On Mon, Feb 23, 2009 at 5:29 PM, Ryan Shih wrote: > Hi, I'm having some problems setting up the metastore usin

mysql metastore problems

2009-02-23 Thread Ryan Shih
Hi, I'm having some problems setting up the metastore using mysql. I've browsed the message archives, but don't see anything that helps. My configuration files, look like: **<>** hive.metastore.local true this is local store hive.metastore.warehous

Re: Multiple master nodes

2008-07-29 Thread Ryan Shih
esting has had consistent and reliable results. > > > > -paul > > > On Tue, Jul 29, 2008 at 1:54 PM, Ryan Shih <[EMAIL PROTECTED]> wrote: > > > Dear Hadoop Community -- > > > > I am wondering if it is already possible or in the plans to add > cap

Multiple master nodes

2008-07-29 Thread Ryan Shih
Dear Hadoop Community -- I am wondering if it is already possible or in the plans to add capability for multiple master nodes. I'm in a situation where I have a master node that may potentially be in a less than ideal execution and networking environment. For this reason, it's possible that the ma