Yea, I think that's the right way to do it, since the regression updates can
get very bulky and it would be hard to pick the actual code changes out of
the noise.

Steve

On Thu, Apr 9, 2009 at 9:36 PM, Korey Sewell <ksew...@umich.edu> wrote:

> Okay thanks, things are starting to look better.
>
> Also, when we make changes that will affect regressions, do we typically
> want to commit the change and the regression-updates in different
> changesets?
>
>
> On Thu, Apr 9, 2009 at 11:40 PM, Steve Reinhardt <ste...@gmail.com> wrote:
>
>> The right command to update the reference outputs would be:
>>
>> scons update_ref=y
>> build/ALPHA_SE/tests/fast/quick/00.hello/alpha/linux/inorder.timing
>>
>> Let me know if it doesn't work after you do that.
>>
>> Also note that scons won't rerun the test if none of its dependencies
>> (e.g., the m5 binary) has changed; it will just print out the result of the
>> last run if it thinks it's up to date.  To force the test to be run you have
>> to delete all the files in the test dir (under build/*/tests).
>>
>> Steve
>>
>> On Thu, Apr 9, 2009 at 8:31 PM, Korey Sewell <ksew...@umich.edu> wrote:
>>
>>> OK, so I still have a few more questions on getting the regressions to
>>> work me:
>>> 1. How do you enforce a particular test gets run?
>>> ===
>>> --> M5 seems to recognize my regression but fails without actually
>>> running the test. All I get is:
>>> "scons: Building targets ...
>>> ***** build/ALPHA_SE/tests/fast/quick/00.hello/alpha/linux/inorder-timing
>>> FAILED!"
>>> But no actual run of the test.
>>>
>>> I should be seeing a "Running test ..." somewhere but I'm not. Anyone
>>> know why?
>>>
>>> So far I've done this:
>>> -creating directory and files in 00.hello folder
>>> -added config file in tests/configs
>>> -added config to tests/SConscript
>>>
>>>
>>> 2. How do you update stats for a regression?
>>> ===
>>> I tried "scons
>>> build/ALPHA_SE/tests/fast/quick/00.hello/alpha/linux/inorder.timing
>>> --update" but the update option doesnt get recognized. This may be a symptom
>>> of my previous question, but in general, how can I update the regression
>>> stats?
>>>
>>> Thanks for the help. The sooner I can get a hold of this the sooner I can
>>> get stuff I've worked on 'stable' in the tree.
>>>
>>> -Korey
>>>
>>>
>>>
>>> On Thu, Apr 9, 2009 at 8:50 PM, Korey Sewell <ksew...@umich.edu> wrote:
>>>
>>>> n/m....Just took a little digging....
>>>>
>>>> If anyone wants to do this, you need to look in the m5/tests/SConscript
>>>> file and add your CPU-model to the script toward the bottom around line
>>>> 265...
>>>>
>>>>
>>>> On Thu, Apr 9, 2009 at 12:54 PM, Korey Sewell <ksew...@umich.edu>wrote:
>>>>
>>>>> If I would like to add a new regression test for the InOrder model what
>>>>> are the steps? The WIKI entry I wrote is painfully outdated.
>>>>>
>>>>> So far, I've collected the stats from m5.fast & placed them in the
>>>>> correct folder (quick/hello/ref/inorder-timing).
>>>>>
>>>>> What do I need to to get M5 to recognize this regression when we say:
>>>>> scons build/ALPHA_SE/tests/debug/quick
>>>>> ???
>>>>>
>>>>> Hopefully, adding regressions will allow me not to spend inordinate
>>>>> amounts of time merging new stuff :) !!!
>>>>>
>>>>> --
>>>>> ----------
>>>>> Korey L Sewell
>>>>> Graduate Student - PhD Candidate
>>>>> Computer Science & Engineering
>>>>> University of Michigan
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> ----------
>>>> Korey L Sewell
>>>> Graduate Student - PhD Candidate
>>>> Computer Science & Engineering
>>>> University of Michigan
>>>>
>>>
>>>
>>>
>>> --
>>> ----------
>>> Korey L Sewell
>>> Graduate Student - PhD Candidate
>>> Computer Science & Engineering
>>> University of Michigan
>>>
>>> _______________________________________________
>>> m5-dev mailing list
>>> m5-dev@m5sim.org
>>> http://m5sim.org/mailman/listinfo/m5-dev
>>>
>>>
>>
>> _______________________________________________
>> m5-dev mailing list
>> m5-dev@m5sim.org
>> http://m5sim.org/mailman/listinfo/m5-dev
>>
>>
>
>
> --
> ----------
> Korey L Sewell
> Graduate Student - PhD Candidate
> Computer Science & Engineering
> University of Michigan
>
> _______________________________________________
> m5-dev mailing list
> m5-dev@m5sim.org
> http://m5sim.org/mailman/listinfo/m5-dev
>
>
_______________________________________________
m5-dev mailing list
m5-dev@m5sim.org
http://m5sim.org/mailman/listinfo/m5-dev

Reply via email to