Re: [CMake] CDash questions
The way I’m doing this now is the following: a) I edit the CMakeList.txt file(s) and follow the procedure to create an Xcode IDE project. This project contains a bunch of targets including ALL_BUILD, RUN_TESTS, and Experimental - among others You should not have to edit the CMakeLists file to create an Xcode IDE project... The CMakeLists file should be written so that it may be used with any CMake generator, and then, to create an Xcode project, you would simply run: cd /path/to/build cmake -G Xcode /path/to/source a) I expect to see a list of all the test runs - or at least the the last run from each site. ... What do I have to do to get a list of all test runs from all sites for all dates. By default, the main CDash page shows only results that have been submitted since the most recently past nightly start time. To show other days, you click on previous and next. To show multiple days, you have to use a filtered view with a Build Time field. Click on Show Filters Use a filter of Build Time is before now Click Apply Click Create Hyperlink to create a link to this filtered view (Yields something like this: http://my.cdash.org/index.php?project=Safe+Numericsfiltercount=1showfilters=1field1=buildstarttime/datecompare1=84value1=now ) You won't want to see *everything* after you have more than a few hundred submissions to your project's CDash page... it will be too slow to retrieve and render all the results unless you use a limit. Use Build Time is after 2 weeks ago to see everything from the last two weeks. b) The whole setup is quite confusing. I would like to think that if if users of this library include the CTestConfig.cmake file that I give them ... They will be able to submit their test results in the same way I just did. Am I correct in my understanding of this? Yes, that's correct. They don't have to include anything -- you can just have the CTestConfig file next to the CMakeLists file, and include(CTest) in your CMakeLists file. Also I have some other questions which are not really related to my specific problem but rather to what the purpose of CDash actually is. a) Is it a system for gathering and recording the results of test runs made from different client configurations b) or is it a system for running tests on the actual server hardware c) or is it a system for automatically downloading projects to a client machine and running the tests and posting the results. Alas, it is only a) -- none of your code is run on the CDash server. CDash simply stores, organizes and presents the results you send it from a machine that does the building and testing. You can set up a CDash@home client machine... a machine that connects to the cdash server and requests a job. But then you also have to run something that schedules builds for these client machines, or ping the server through a CDash api call to instruct it to farm out a job to a waiting client. It seems that it’s all three - but this is not at all clear from the documentation. Do you mean the wiki pages? Or something on cdash.org? I sort of conclude this from the information that the myCDash server requests regarding how to run the tests, where is the code repository, etc. The code repository info is so CDash can show links to changes (on the viewUpdates and viewChanges pages) if there's a web viewer for the repo. It's also used when constructing scripts to send to the CDash@home clients. a) I have a programming library for Safe integegers see http://rrsd.com/blincubator.com/bi_library/safe-numerics/ b) I want users to be able to download the library, run the tests, check the results, if they want, submit them to the my.cdash server c) I want all other users to see these results so we can get an idea of the variety of platforms the tests have been run and where they might have failed. Am I doing this right? Am I missing anything? Seems reasoanble to me. You're on the right track... Let us know if you have further questions. HTH, David C. -- Powered by www.kitware.com Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ Kitware offers various services to support the CMake community. For more information on each offering, please visit: CMake Support: http://cmake.org/cmake/help/support.html CMake Consulting: http://cmake.org/cmake/help/consulting.html CMake Training Courses: http://cmake.org/cmake/help/training.html Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Follow this link to subscribe/unsubscribe: http://www.cmake.org/mailman/listinfo/cmake
[CMake] CDash questions
I’ve spent quite a bit of time going through the CDash Documentation at http://public.kitware.com/Wiki/CDash . In spite of the fact that it seems I’ve been able to get this to work (project = Safe Numerics), I have a lot of questions: The way I’m doing this now is the following: a) I edit the CMakeList.txt file(s) and follow the procedure to create an Xcode IDE project. This project contains a bunch of targets including ALL_BUILD, RUN_TESTS, and Experimental - among others b) I build the target ALL_BUILD from the IDE - works as expected c) I build the target RUN_TESTS from the IDE - find - runs a makefile which runs all the tests. d) I build “Experimental” which seems to submit the test results to the my.cdash server. This seems good as the page http://my.cdash.org/index.php?project=Safe+Numericsdate=2014-04-21# shows the results from the test run and I can on the various parts of the display to get the build type, build machine etc …. So this looks good. But I have a few questions: a) I expect to see a list of all the test runs - or at least the the last run from each site. But the display comes up blank until I click “Previous” at which time it display the test runs from the previous day. What do I have to do to get a list of all test runs from all sites for all dates. b) The whole setup is quite confusing. I would like to think that if if users of this library include the CTestConfig.cmake file that I give them - ie ## This file should be placed in the root directory of your project. ## Then modify the CMakeLists.txt file in the root directory of your ## project to incorporate the testing dashboard. ## # The following are required to uses Dart and the Cdash dashboard ## ENABLE_TESTING() ## INCLUDE(CTest) set(CTEST_PROJECT_NAME Safe Numerics) set(CTEST_NIGHTLY_START_TIME 01:00:00 UTC) set(CTEST_DROP_METHOD http) set(CTEST_DROP_SITE my.cdash.org) set(CTEST_DROP_LOCATION /submit.php?project=Safe+Numerics) set(CTEST_DROP_SITE_CDASH TRUE) They will be able to submit their test results in the same way I just did. Am I correct in my understanding of this? Also I have some other questions which are not really related to my specific problem but rather to what the purpose of CDash actually is. a) Is it a system for gathering and recording the results of test runs made from different client configurations b) or is it a system for running tests on the actual server hardware c) or is it a system for automatically downloading projects to a client machine and running the tests and posting the results. It seems that it’s all three - but this is not at all clear from the documentation. I sort of conclude this from the information that the myCDash server requests regarding how to run the tests, where is the code repository, etc. For what it’s worth - here is what I need: a) I have a programming library for Safe integegers - see http://rrsd.com/blincubator.com/bi_library/safe-numerics/ b) I want users to be able to download the library, run the tests, check the results, if they want, submit them to the my.cdash server c) I want all other users to see these results so we can get an idea of the variety of platforms the tests have been run and where they might have failed. Am I doing this right? Am I missing anything? Robert Ramey Robert Ramey Software Development (805)569-3793 ra...@rrsd.com www.rrsd.com -- Powered by www.kitware.com Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ Kitware offers various services to support the CMake community. For more information on each offering, please visit: CMake Support: http://cmake.org/cmake/help/support.html CMake Consulting: http://cmake.org/cmake/help/consulting.html CMake Training Courses: http://cmake.org/cmake/help/training.html Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Follow this link to subscribe/unsubscribe: http://www.cmake.org/mailman/listinfo/cmake
[CMake] CDash questions
Hi, I'm currently in the process of setting up automatic builds using CMake, CTest and CDash So far I've got builds working, and subprojects seem to be successfully implemented, but there are a few things it would be useful to know. 1) Is there a way to quickly remove multiple builds from the dashboard? since I'm currently still setting up scripts I'm doing a lot of builds to test things, and with so many builds on the dashboard, it can be hard to see the wood for the trees... which brings me on to question 2.. 2) It seems that the default display (when I just select the dashboard link) shows some sort of cumulation of warnings and errors from a previous set of builds. a) is that correct behaviour? In which case, what is the starting point of the cummulative? Is it all builds since the nightly build time? b) Can I change it? I don't want to see how many errors I've had today, I want to see how many errors there were in the last build done on that system. 3) Currently, though the builds are on a per subproject basis, and configure is also called on that basis, the configuration is always for the whole project, is there a standard method for passing a subproject option to the CMake for my CMake scripts to configure subprojects individually (giving more useful information in the configuration columns of the subprojects. 4) Submission times are an hour out. Daylight savings time is not being applied somewhere... any clues where I should look? thanks in advance Jon -- Powered by www.kitware.com Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ Follow this link to subscribe/unsubscribe: http://www.cmake.org/mailman/listinfo/cmake
Re: [CMake] CDash questions
4) Submission times are an hour out. Daylight savings time is not being
applied somewhere... any clues where I should look?
Add
'ini_set('date.timezone', 'CEST');'
to your
cdash/config.local.php
and fill in your local timezone abbreviation string or 'UTC+-x'(here
CEST ≘ Central European Summer Time)!
--
Powered by www.kitware.com
Please keep messages on-topic and check the CMake FAQ at:
http://www.cmake.org/Wiki/CMake_FAQ
Kitware offers various services to support the CMake community. For more
information on each offering, please visit:
CMake Support: http://cmake.org/cmake/help/support.html
CMake Consulting: http://cmake.org/cmake/help/consulting.html
CMake Training Courses: http://cmake.org/cmake/help/training.html
Visit other Kitware open-source projects at
http://www.kitware.com/opensource/opensource.html
Follow this link to subscribe/unsubscribe:
http://www.cmake.org/mailman/listinfo/cmake
Re: [CMake] CDash questions
4) Submission times are an hour out. Daylight savings time is not being
applied somewhere... any clues where I should look?
Add
'ini_set('date.timezone', 'CEST');'
to your
cdash/config.local.php
and fill in your local timezone abbreviation string or 'UTC+-x'(here
CEST ≘ Central European Summer Time)!
And don't forget your local timezone when setting the 'Nightly
Starttime' (Edit Project-Testing) of your project(s)!
--
Powered by www.kitware.com
Please keep messages on-topic and check the CMake FAQ at:
http://www.cmake.org/Wiki/CMake_FAQ
Kitware offers various services to support the CMake community. For more
information on each offering, please visit:
CMake Support: http://cmake.org/cmake/help/support.html
CMake Consulting: http://cmake.org/cmake/help/consulting.html
CMake Training Courses: http://cmake.org/cmake/help/training.html
Visit other Kitware open-source projects at
http://www.kitware.com/opensource/opensource.html
Follow this link to subscribe/unsubscribe:
http://www.cmake.org/mailman/listinfo/cmake
