Re: [CMake] ctest/cdash question
David Of course. So simple, I just tried it and it works, that will save me a lot of script tweaking. Thanks very much JB On 06/09/14 03:18, David Cole dlrd...@aol.com wrote: Not off topic at all. Try start, test, submit, test, submit. Should work. Start is the thing that writes a new time stamp tag, and all that follows should be associated with the most recent start's tag. HTH, David C. On Sep 5, 2014, at 5:07 PM, Biddiscombe, John A. biddi...@cscs.ch wrote: Sorry if this is off topic for the list. If I ctest –D ExperimentalStart ctest –D ExperimentalTest –R test1 ctest –D ExperimentalSubmit Then ctest –D ExperimentalStart ctest –D ExperimentalTest –R test2 ctest –D ExperimentalSubmit It appears as two entries on the dashboard, but I’d like to have both together like this ctest –D ExperimentalStart ctest –D ExperimentalTest –R test1 ctest –D ExperimentalTest –R test2 ctest –D ExperimentalSubmit Except that the test2 xml overwrites the test1 xml And I can’t run ctest –D ExperimentalTest –R test1|test2 Because it comes from multiple scripts that are triggered independently. So the question becomes … is it possible to run tests separately, but have them merged into one test submission on the Cdash dashboard? (I tried a simple xml merge of the files, but it didn’t work as expected, so I thought I’d ask here before spending more time no it) Thanks JB -- John Biddiscombe,email:biddisco @.at.@ cscs.ch http://www.cscs.ch/ CSCS, Swiss National Supercomputing Centre | Tel: +41 (91) 610.82.07 Via Trevano 131, 6900 Lugano, Switzerland | Fax: +41 (91) 610.82.82 -- Powered by www.kitware.com Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ Kitware offers various services to support the CMake community. For more information on each offering, please visit: CMake Support: http://cmake.org/cmake/help/support.html CMake Consulting: http://cmake.org/cmake/help/consulting.html CMake Training Courses: http://cmake.org/cmake/help/training.html Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Follow this link to subscribe/unsubscribe: http://public.kitware.com/mailman/listinfo/cmake -- Powered by www.kitware.com Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ Kitware offers various services to support the CMake community. For more information on each offering, please visit: CMake Support: http://cmake.org/cmake/help/support.html CMake Consulting: http://cmake.org/cmake/help/consulting.html CMake Training Courses: http://cmake.org/cmake/help/training.html Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Follow this link to subscribe/unsubscribe: http://public.kitware.com/mailman/listinfo/cmake
Re: [CMake] ctest/cdash question
You're welcome. One caveat to mention with this sort of submit pattern (submitting multiple build or test chunks to a single row on the CDash dashboard) is that it messes up the incremental +n/-n compare-to-previous-submission numbers of build warnings and errors, and number of test passes and failures. CDash computes those numbers based on the assumption that a submit ought to be compared to the previous submit... But that's only true in the default submission pattern of sending one set of build results and one set of test results for a single row. When you send multiples, the +/- numbers become irrelevant noise with the current CDash. It could probably be fixed to reflect this submit pattern, as well, but this is work that has yet to be done. D -- Powered by www.kitware.com Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ Kitware offers various services to support the CMake community. For more information on each offering, please visit: CMake Support: http://cmake.org/cmake/help/support.html CMake Consulting: http://cmake.org/cmake/help/consulting.html CMake Training Courses: http://cmake.org/cmake/help/training.html Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Follow this link to subscribe/unsubscribe: http://public.kitware.com/mailman/listinfo/cmake
Re: [CMake] ctest/cdash question
David OK, understood. Currently, the buildbot is running 145 unit tests, then 52 regression tests in separate steps, every dashboard line has +145 and -52 respectively so the +/- numbers can’t get much worse! My dashboard is 1.8.2 which dates back a few years. Just seeing the red/green (and one row per machine) will already be helpful. Yours JB On 06/09/14 11:32, David Cole dlrd...@aol.com wrote: You're welcome. One caveat to mention with this sort of submit pattern (submitting multiple build or test chunks to a single row on the CDash dashboard) is that it messes up the incremental +n/-n compare-to-previous-submission numbers of build warnings and errors, and number of test passes and failures. CDash computes those numbers based on the assumption that a submit ought to be compared to the previous submit... But that's only true in the default submission pattern of sending one set of build results and one set of test results for a single row. When you send multiples, the +/- numbers become irrelevant noise with the current CDash. It could probably be fixed to reflect this submit pattern, as well, but this is work that has yet to be done. D -- Powered by www.kitware.com Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ Kitware offers various services to support the CMake community. For more information on each offering, please visit: CMake Support: http://cmake.org/cmake/help/support.html CMake Consulting: http://cmake.org/cmake/help/consulting.html CMake Training Courses: http://cmake.org/cmake/help/training.html Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Follow this link to subscribe/unsubscribe: http://public.kitware.com/mailman/listinfo/cmake
[CMake] ctest/cdash question
Sorry if this is off topic for the list. If I ctest –D ExperimentalStart ctest –D ExperimentalTest –R test1 ctest –D ExperimentalSubmit Then ctest –D ExperimentalStart ctest –D ExperimentalTest –R test2 ctest –D ExperimentalSubmit It appears as two entries on the dashboard, but I’d like to have both together like this ctest –D ExperimentalStart ctest –D ExperimentalTest –R test1 ctest –D ExperimentalTest –R test2 ctest –D ExperimentalSubmit Except that the test2 xml overwrites the test1 xml And I can’t run ctest –D ExperimentalTest –R test1|test2 Because it comes from multiple scripts that are triggered independently. So the question becomes … is it possible to run tests separately, but have them merged into one test submission on the Cdash dashboard? (I tried a simple xml merge of the files, but it didn’t work as expected, so I thought I’d ask here before spending more time no it) Thanks JB -- John Biddiscombe,email:biddisco @.at.@ cscs.ch http://www.cscs.ch/ CSCS, Swiss National Supercomputing Centre | Tel: +41 (91) 610.82.07 Via Trevano 131, 6900 Lugano, Switzerland | Fax: +41 (91) 610.82.82 -- Powered by www.kitware.com Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ Kitware offers various services to support the CMake community. For more information on each offering, please visit: CMake Support: http://cmake.org/cmake/help/support.html CMake Consulting: http://cmake.org/cmake/help/consulting.html CMake Training Courses: http://cmake.org/cmake/help/training.html Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Follow this link to subscribe/unsubscribe: http://public.kitware.com/mailman/listinfo/cmake
Re: [CMake] ctest/cdash question
Not off topic at all. Try start, test, submit, test, submit. Should work. Start is the thing that writes a new time stamp tag, and all that follows should be associated with the most recent start's tag. HTH, David C. On Sep 5, 2014, at 5:07 PM, Biddiscombe, John A. biddi...@cscs.ch wrote: Sorry if this is off topic for the list. If I ctest –D ExperimentalStart ctest –D ExperimentalTest –R test1 ctest –D ExperimentalSubmit Then ctest –D ExperimentalStart ctest –D ExperimentalTest –R test2 ctest –D ExperimentalSubmit It appears as two entries on the dashboard, but I’d like to have both together like this ctest –D ExperimentalStart ctest –D ExperimentalTest –R test1 ctest –D ExperimentalTest –R test2 ctest –D ExperimentalSubmit Except that the test2 xml overwrites the test1 xml And I can’t run ctest –D ExperimentalTest –R test1|test2 Because it comes from multiple scripts that are triggered independently. So the question becomes … is it possible to run tests separately, but have them merged into one test submission on the Cdash dashboard? (I tried a simple xml merge of the files, but it didn’t work as expected, so I thought I’d ask here before spending more time no it) Thanks JB -- John Biddiscombe,email:biddisco @.at.@ cscs.ch http://www.cscs.ch/ CSCS, Swiss National Supercomputing Centre | Tel: +41 (91) 610.82.07 Via Trevano 131, 6900 Lugano, Switzerland | Fax: +41 (91) 610.82.82 -- Powered by www.kitware.com Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ Kitware offers various services to support the CMake community. For more information on each offering, please visit: CMake Support: http://cmake.org/cmake/help/support.html CMake Consulting: http://cmake.org/cmake/help/consulting.html CMake Training Courses: http://cmake.org/cmake/help/training.html Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Follow this link to subscribe/unsubscribe: http://public.kitware.com/mailman/listinfo/cmake -- Powered by www.kitware.com Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ Kitware offers various services to support the CMake community. For more information on each offering, please visit: CMake Support: http://cmake.org/cmake/help/support.html CMake Consulting: http://cmake.org/cmake/help/consulting.html CMake Training Courses: http://cmake.org/cmake/help/training.html Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html Follow this link to subscribe/unsubscribe: http://public.kitware.com/mailman/listinfo/cmake
