Here's a thought: What's the value of having tests in a "clear environment" when you have just said you will never use a "clear environment"?
If you want tests comparable with other folks, the clear environment makes sense: if the benchmarks are for tuning for your site, you really better factor in the "white noise" somehow. My suggestion would be to use cgroups and isolate the process from each other to the extent possible. Remember the interference to go both ways: do you want your PHP gateways to slow down / stutter if someone writes a crazy MR job? This is what cgroups are designed for. Brian On Mar 2, 2011, at 9:39 PM, Ted Dunning wrote: > It will be very difficult to do. If you have n machines running 4 different > things, you will probably get better results segregating tasks as much as > possible. Interactions can be very subtle and can have major impact on > performance in a few cases. > > Hadoop, in general, will use a lot of the resources if they appear to be > available. The intent, after all, is to run batch jobs absolutely as fast > as your hardware can handle. > > On Wed, Mar 2, 2011 at 7:31 PM, liupei <liu...@xingcloud.com> wrote: > >> Hi, >> >> I'd like to tune params in hadoop config for my job. But my current cluster >> runs lot of other processes such as mongod, php gateways and some other >> routine hadoop jobs. It is impossible to stop all to get a clear environment >> for testing. Is there any way to get reliable results for my tuning in such >> a mixture environment? >> >> Thanks >> >>
smime.p7s
Description: S/MIME cryptographic signature
