Re: Display of job results

2022-02-02 Thread 'christop...@googlemail.com' via Jenkins Users
Thank you very much for the reply.

I'd totally agree when we'd talk about unit test results alone. However 
Ranorex is a GUI-test tool used for integration or acceptance tests that 
only outputs its results in junit file format.
OK, I'll live with it for the moment.


ullrich...@gmail.com schrieb am Mittwoch, 2. Februar 2022 um 13:58:46 UTC+1:

>
>
> Am 01.02.2022 um 22:27 schrieb 'christop...@googlemail.com' via Jenkins 
> Users :
>
> [...]
>
>
> Any recommendations how I can improve that situation? Is there a way to 
> realize some of these ideas:
> - customize position of a plugin output in the job view
>
>
> This is one of the major drawbacks of Jenkins UI in the moment and there 
> is no workaround available yet. We started a new plugin that tries to solve 
> this problem with https://muuri.dev on a new page but this promising 
> approach still needs to be implemented for the old views.
>  
>
>  - split display of xunit test results per tool?
>
>
> This is also not possible right now. I am using this approach in the 
> warnings plugin and plan to make this concept available for coverage data 
> as well. But for unit tests this is not planned yet. I’m also not sure if 
> that information actually is so helpful: if a test fails then I am not 
> really not that interested in which suite it failed.  
>
>  
> What about the ranorex plugin itself? I do have a number of ranorex test 
> executables and these are called by a script from the build system. I do 
> not want to replicate a list in jenkins scripts. That's why I don't like to 
> use the ranorex plugin here.
>
> Thanks for reading up to here and many thanks in advance for any advice!
> Regards,
> Christoph
>
> -- 
> You received this message because you are subscribed to the Google Groups 
> "Jenkins Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to jenkinsci-use...@googlegroups.com.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/jenkinsci-users/5c0dc622-e9c0-498b-9d8d-8bac93caace6n%40googlegroups.com
>  
> 
> .
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/cef11e48-5d55-46ee-b6c3-f33c25e5d941n%40googlegroups.com.


Re: Display of job results

2022-02-02 Thread Ullrich Hafner


> Am 01.02.2022 um 22:27 schrieb 'christop...@googlemail.com' via Jenkins Users 
> :
> 
> [...]
> 
> Any recommendations how I can improve that situation? Is there a way to 
> realize some of these ideas:
> - customize position of a plugin output in the job view

This is one of the major drawbacks of Jenkins UI in the moment and there is no 
workaround available yet. We started a new plugin that tries to solve this 
problem with https://muuri.dev  on a new page but this 
promising approach still needs to be implemented for the old views.
 
>  - split display of xunit test results per tool?

This is also not possible right now. I am using this approach in the warnings 
plugin and plan to make this concept available for coverage data as well. But 
for unit tests this is not planned yet. I’m also not sure if that information 
actually is so helpful: if a test fails then I am not really not that 
interested in which suite it failed.  

>  
> What about the ranorex plugin itself? I do have a number of ranorex test 
> executables and these are called by a script from the build system. I do not 
> want to replicate a list in jenkins scripts. That's why I don't like to use 
> the ranorex plugin here.
> 
> Thanks for reading up to here and many thanks in advance for any advice!
> Regards,
> Christoph
> 
> -- 
> You received this message because you are subscribed to the Google Groups 
> "Jenkins Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to jenkinsci-users+unsubscr...@googlegroups.com 
> .
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/jenkinsci-users/5c0dc622-e9c0-498b-9d8d-8bac93caace6n%40googlegroups.com
>  
> .

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/08878689-D443-4AEA-8B28-C2F6EF4DA303%40gmail.com.


Display of job results

2022-02-01 Thread 'christop...@googlemail.com' via Jenkins Users
Hi,

I am building and testing a C/C++ application on Windows with jenkins using 
declarative pipeline and a bit of scripts in a library.
I am using these tools:
cppcheck
googletest
robotframework
ranorex
I am using warnings-ng for the compiler warnings, taskscanner and cppcheck 
and I am pretty happy with the output and results display of these part.
I am using the robotframework plugin for the robotfamework output. Well, 
it's a little different with a different style but all-in-all a good 
display with everything you need: everything in one place, good integration 
with all information provided by robotframework.
My worst problem results from the unittests and ranorex as I only found the 
xunit plugin to read the input.
First issue:
the xunit test results are located far away from all the other outputs at 
the very bottom of the job display. Even below the job list.
Second issue: I'd like to separate results of Unit-Tests and acceptance 
tests but did not find a way (yet?). xUnit is mixing all tests in one big 
list. When I step into a test, I only have the name of the step that 
executed the test.
Third issue: for Ranorex I'd like to have the pdf report as part of the 
test result as well. At the moment it's far away in the artifacts without 
any direct link (or embedded like with robotframework).

Any recommendations how I can improve that situation? Is there a way to 
realize some of these ideas:
- customize position of a plugin output in the job view
 - split display of xunit test results per tool?
 
What about the ranorex plugin itself? I do have a number of ranorex test 
executables and these are called by a script from the build system. I do 
not want to replicate a list in jenkins scripts. That's why I don't like to 
use the ranorex plugin here.

Thanks for reading up to here and many thanks in advance for any advice!
Regards,
Christoph

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/5c0dc622-e9c0-498b-9d8d-8bac93caace6n%40googlegroups.com.