I also see a lot of "noise" in my logs. I don't remember seeing this
before though it did not see to effect speed of my tests. I wonder if
this is somehow related to the test changes that happened recently.
________________________________
From: pi song [mailto:[EMAIL PROTECTED]
Sent: Monday, May 12, 2008 7:30 AM
To: [email protected]
Subject: Re: Slow unit testing
After looking at the log files:-
1) It is not between tests but within the tests. Just my screen
is updating too slowly.
2) My log files look very messy. Is your file as messy as mine?
Pi
On Tue, May 13, 2008 at 12:20 AM, pi song <[EMAIL PROTECTED]>
wrote:
This started to happen since the introduction of
Hadoop16 (which includes changes in HOD). The time shown in ANT-Junit is
not accurate. What I can see here is that time spent doing nothing
between each tests is long but not taken into account.
Is it possible to be something to do with connecting to
HOD?
[junit] Tests run: 8, Failures: 0, Errors: 0, Time
elapsed: 262.014 sec
[junit] Running
org.apache.pig.test.TestFilterOpString
[junit] Tests run: 6, Failures: 0, Errors: 0, Time
elapsed: 234.839 sec
[junit] Running org.apache.pig.test.TestGrunt
[junit] Tests run: 1, Failures: 0, Errors: 0, Time
elapsed: 0.159 sec
Pi
On Tue, May 13, 2008 at 12:15 AM, pi song
<[EMAIL PROTECTED]> wrote:
Already more than 40 minutes.
On Tue, May 13, 2008 at 12:10 AM, Olga Natkovich
<[EMAIL PROTECTED]> wrote:
I run the tests on the regular basis and
don't see a proble. MR tests
take about 20 minites for me. How long
does it take for you?
Olga
> -----Original Message-----
> From: pi song
[mailto:[EMAIL PROTECTED]
> Sent: Monday, May 12, 2008 6:57 AM
> To: [email protected]
> Subject: Slow unit testing
>
> It has been a while since we moved
from Hadoop15 to Hadoop16
> that all the MapReduce unit tests run
significantly slower
> than before (at least 2-3x).
> What is the reason behind this? Is
there a way to fix?
>
> Since everyone has to run at least a
full test before
> submitting a patch.
> This is not productive from
developer's point of view.
>
> Pi
>
