[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread captainhypert...@gmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Captain Hypertext commented on  JENKINS-57615  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
 Yes, I know.  Please explain how the PHPUnit-3.x parser works better than the JUnit parser for parsing JUnit logs, or at least refer me to the author or proper documentation.  This is definitely not a phpUnit issue, this bug is an issue with the PHPUnit parser in xUnit.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.199543.1558537186000.9577.1558563480072%40Atlassian.JIRA.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread nfalc...@hotmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Nikolas Falco commented on  JENKINS-57615  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
 phpunit --log-junit produces a JUnit report.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.199543.1558537186000.9573.1558562880082%40Atlassian.JIRA.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread captainhypert...@gmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Captain Hypertext commented on  JENKINS-57615  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
 Yes, but this does not address my issue.  My issue is with the PHPUnit-3.x parser, which works fine except for this bug.  I am not using the JUnit parser.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.199543.1558537186000.9571.1558562580134%40Atlassian.JIRA.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread nfalc...@hotmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Nikolas Falco commented on  JENKINS-57615  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
 The case is the same of other similar issue. The point is that PHPUnit does not produce a supported JUnit format. They declare to produce a format junit task like but is not true. The reason of issue https://github.com/sebastianbergmann/phpunit/issues/3162 where they would standardize the format in output. In the Wiki is explained how to setup "In case you are using a non java tools that declares to produce a JUnit compatible report" (search the string between "")  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.199543.1558537186000.9569.1558561980103%40Atlassian.JIRA.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread captainhypert...@gmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Captain Hypertext commented on  JENKINS-57615  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
 Yes, I did think it was weird how things were fixed when I just switched the parser away from JUnit to PHPUnit, but hey, it works for everything except these cases.  The log types available for my version of PHPUnit is: junit, teamcity, testdox-html, testdox-text, testdox-xml, and reverse-list.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.199543.1558537186000.9561.1558559220085%40Atlassian.JIRA.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread captainhypert...@gmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Captain Hypertext commented on  JENKINS-57615  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
 I had to switch from JUnit because it stopped parsing after we upgraded.  I think it's related to JENKINS-51919, it kept failing to parse because of the attributes PHPUnit includes such as "assertions", along with several more.  So I switched to PHPUnit-3.x (PHPUnit-4.x was not listed as an option, and my version of PHPUnit is 6, so I'm confused about that...).  I'll see if I can get one of those report files for you.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.199543.1558537186000.9553.1558558620102%40Atlassian.JIRA.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread nfalc...@hotmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Nikolas Falco edited a comment on  JENKINS-57615  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
 I see that in the config.xml you are running "phpunit --log-junit .." that by [documentation here|https://phpunit.readthedocs.io/en/8.1/logging.html] it produce a "JUnit Ant like". You had  configure to  configured  PHPUnit  parser style  as report type  that means it expects  to parse  a different format.Change PHPUnit 4.x -> JUnit and hope  that  the JUnit produced is a really Ant  style  task format  like the documentation describe  (https://github . com/sebastianbergmann/phpunit/issues/3162).  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.199543.1558537186000.9551.1558558440202%40Atlassian.JIRA.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread nfalc...@hotmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Nikolas Falco closed an issue as Not A Defect  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 Jenkins /  JENKINS-57615  
 
 
  xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
Change By: 
 Nikolas Falco  
 
 
Status: 
 Open Closed  
 
 
Resolution: 
 Not A Defect  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.199543.1558537186000.9540.1558558200177%40Atlassian.JIRA.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread nfalc...@hotmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Nikolas Falco commented on  JENKINS-57615  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
 I see that in the config.xml you are running "phpunit --log-junit .." that by documentation here it produce a "JUnit Ant like". You had configure to PHPUnit parser style that means it expects a different format. Change PHPUnit 4.x -> JUnit and hope the JUnit produced is a really Ant style like the documentation describe.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.199543.1558537186000.9538.1558558140099%40Atlassian.JIRA.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread nfalc...@hotmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Nikolas Falco commented on  JENKINS-57615  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
 Ok I understand, could you post to me the report file?  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.199543.1558537186000.9530.1558557420118%40Atlassian.JIRA.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread captainhypert...@gmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Captain Hypertext commented on  JENKINS-57615  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
 Nikolas Falco - Just uploaded my job's config.xml  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.199543.1558537186000.9152.1558539180175%40Atlassian.JIRA.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread captainhypert...@gmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Captain Hypertext updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 Jenkins /  JENKINS-57615  
 
 
  xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
Change By: 
 Captain Hypertext  
 
 
Attachment: 
 config.xml  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.199543.1558537186000.9150.1558539180145%40Atlassian.JIRA.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread nfalc...@hotmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Nikolas Falco commented on  JENKINS-57615  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
 Could you post your job configuration? I would know your xunit step configuration.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.199543.1558537186000.9071.1558537980143%40Atlassian.JIRA.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread captainhypert...@gmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Captain Hypertext updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 Jenkins /  JENKINS-57615  
 
 
  xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
Change By: 
 Captain Hypertext  
 

  
 
 
 
 

 
 I'm using the latest version of the xUnit plugin (2.3.3) with the PHPUnit-3.x parser. It fails on a few tests because it can't parse the xml file, and it gives a somewhat misleading error:{noformat} WARNING: The file 'myresult.xml' is an invalid file.   WARNING: At line 7261 of file:myresult.xml:cvc-complex-type.2.4.d: Invalid content was found starting with element 'system-out'. No child element is expected at this point.   FATAL: The result file 'myresult.xml' for the metric 'PHPUnit' is not valid. The result file has been skipped.{noformat}This seems to be happening because the test was skipped, but still had system output. Here's an example:{noformat}Some debug info...{noformat}In this case there's a bunch of setup happening in the base class before the test even runs (which will ultimately be skipped), which is echoing out debug information. This system output is useful for debugging, and inconsequential to the result of the tests. I can alter my tests to not output anything, but parsing shouldn't fail here, or should at least produce a meaningful error message.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)  
 

  
 

   





-- 
You received this message 

[JIRA] (JENKINS-57615) xUnit fails to parse PHPUnit output when a skipped test also has system output

2019-05-22 Thread captainhypert...@gmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Captain Hypertext created an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 Jenkins /  JENKINS-57615  
 
 
  xUnit fails to parse PHPUnit output when a skipped test also has system output   
 

  
 
 
 
 

 
Issue Type: 
  Bug  
 
 
Assignee: 
 Nikolas Falco  
 
 
Components: 
 xunit-plugin  
 
 
Created: 
 2019-05-22 14:59  
 
 
Priority: 
  Minor  
 
 
Reporter: 
 Captain Hypertext  
 

  
 
 
 
 

 
 I'm using the latest version of the xUnit plugin (2.3.3) with the PHPUnit-3.x parser. It fails on a few tests because it can't parse the xml file, and it gives a somewhat misleading error: 

 
 WARNING: The file 'myresult.xml' is an invalid file. WARNING: At line 7261 of file:myresult.xml:cvc-complex-type.2.4.d: Invalid content was found starting with element 'system-out'. No child element is expected at this point. FATAL: The result file 'myresult.xml' for the metric 'PHPUnit' is not valid. The result file has been skipped. 

 This seems to be happening because the test was skipped, but still had system output. Here's an example: 

 


Some debug info...
 

 In this case there's a bunch of setup happening in the base class before the test even runs (which will ultimately be skipped), which is echoing out debug information. This system output is useful for debugging, and inconsequential to the result of the tests. I can alter my tests to not output anything, but parsing shouldn't fail here, or should at least produce a meaningful error message.