Thanks for these suggestions. Numdiff might be good, but I don't think I'm allowed to include anything GPL in the distribution. Maybe I will have to write my own as Bill suggests.
-----Original Message----- From: cmake-boun...@cmake.org [mailto:cmake-boun...@cmake.org] On Behalf Of Thompson, K T Sent: Tuesday, May 21, 2013 11:40 AM To: cmake@cmake.org Subject: Re: [CMake] Some ctest question Jim, You might consider using numdiff (http://www.nongnu.org/numdiff/). We use this tool to compare test output to a gold standard file where the output has mixed text and floating point values. -kt > -----Original Message----- > From: cmake-boun...@cmake.org [mailto:cmake-boun...@cmake.org] On > Behalf Of Bill Hoffman > Sent: Tuesday, May 21, 2013 12:33 PM > To: cmake@cmake.org > Subject: Re: [CMake] Some ctest question > > On 5/19/2013 4:46 PM, Leek, Jim wrote: > > Unfortunately, I don't think that's powerful enough. The test > > results consist of about 100 lines of floating point numbers mixed > > in with text. I would like to make sure that all of those floating > > point numbers are "correct" (Within 1% would probably be close > > enough.) Unfortunately, since this is the first time this code has > > ever had automated testing, it doesn't have an output format that > > makes it easy to see the numbers without parsing out the text. So > > for now I'm just using diff to check everything. I don't think a 1 > > line regular expression could allow me to check every floating point > > in the file for correctness... > > Would I would do is create a diff program that gets compiled during > the build and then use that to do the check. I assume if it floating > point stuff you will want to do some sort of fuzzy equal based on the > expected range of the data. If you test your code on more than one > platform that will be required to get the test to pass. For VTK and > ITK we use image difference programs that check valid images with test images. > > -Bill > > -- > > Powered by www.kitware.com > > Visit other Kitware open-source projects at > http://www.kitware.com/opensource/opensource.html > > Please keep messages on-topic and check the CMake FAQ at: > http://www.cmake.org/Wiki/CMake_FAQ > > Follow this link to subscribe/unsubscribe: > http://www.cmake.org/mailman/listinfo/cmake -- Powered by www.kitware.com Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ Follow this link to subscribe/unsubscribe: http://www.cmake.org/mailman/listinfo/cmake -- Powered by www.kitware.com Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ Follow this link to subscribe/unsubscribe: http://www.cmake.org/mailman/listinfo/cmake