RE: Surefire and testing plugin issue

[Tim Wu T]

Never used maven "testng" plugin to run the test case, maybe you mean the 
dependency is testng?

Surefire plugin could support different test engine, testng/junit3/junit4.

Br,
Tim

-Original Message-
From: Subramanian Olagappan [mailto:osu...@gmail.com] 
Sent: den 27 september 2014 17:08
To: users@maven.apache.org
Subject: Surefire and testing plugin issue

Hi,

I am using maven-surefire-plugin version 2.17 and testng plugin version
6.3.1 (jdk version is 1.7 ). Some of our tests are failing and in the 
testng-results.xml file it is reported as fail. The issue is "maven" is 
reporting the failed tests as "skipped" and the final build status is SUCCESS.

Has anyone faced this issue ? if so what is the soln.

I tried with "surefire-testng" plugin instead of "testng" plugin. With this 
change, maven is properly reporting the failed tests and the final build is 
reported as FAIL

What is the difference between testng and surefire-testng plugin , I don't see 
any mention in the surefire plugin page, so I am not sure if it is correct to 
use this plugin.

Any help is appreciated

Thanks,
Subbu

Re: Surefire and testing plugin issue

[Subramanian Olagappan]

The issue was in the test case and we found the soln.

http://rolf-engelhard.de/2011/10/fail-instead-of-skip-a-test-when-testngs-dataprovider-throws-an-exception/

Thanks Karl

Regards,
Subbu

On Sat, Sep 27, 2014 at 9:11 PM, Karl Heinz Marbaise 
wrote:

> Hi,
>
>
> >
>
>> This is the testng plugin version mentioned in maven-surefire-plugin page.
>>
>> http://maven.apache.org/surefire/maven-surefire-
>> plugin/examples/testng.html
>>
>
> This is not a plugin it's simply the dependency which you should have in
> your project if you are using TestNG...
>
>
>
>> I tried with the latest 6.8.8 and the issue still exists.
>> 
>> ...
>> ...
>> 
>>  
>> ...
>> ...
>> ...
>>  
>>  org.apache.maven.plugins
>>  maven-surefire-plugin
>>  2.17
>>  
>> 
>>  
>> ...
>> ...
>> ...
>> 
>>
>>  
>>  
>>  org.testng
>>  testng
>>  6.3.1
>>  test
>>  
>>
>> Thanks,
>> Subbu
>>
>>
> Ah...
>
> Using dependencyManagement is intended to define versions...but it will
> not define a real dependency...
> If you need have a dependency you need to add the following in your pom
> file:
>
>
> 
>   
> org.testng
> testng
>   
>   ...
> 
>
>
> This is the indicator for maven-surefire-plugin to use the appropriate
> TestNG driver withn surefire to run tests with TestNG..
>
>
>  On Sat, Sep 27, 2014 at 8:54 PM, Karl Heinz Marbaise > > wrote:
>>
>> Hi,
>>
>>
>> >> Hi,
>>
>>
>> I am using maven-surefire-plugin version 2.17 and testng
>> plugin version
>> 6.3.1 (jdk version is 1.7 ).
>>
>>
>> so ok so far you are using maven-surefire-plugin 2.17 and have
>> configured a dependency to testng in version 6.3.1?
>> First why are you using such an old version of TestNG..(2011?)...
>>
>> Furthermore there is no testng plugin
>>
>> Can you show your pom file which you are using otherwise it's hard
>> to guess what's wrong...
>>
>>
>>
>>
>> Some of our tests are failing and in the
>>
>> testng-results.xml file it is reported as fail. The issue is
>> "maven" is
>> reporting the failed tests as "skipped" and the final build
>> status is
>> SUCCESS.
>>
>> Has anyone faced this issue ? if so what is the soln.
>>
>> I tried with "surefire-testng" plugin instead of "testng"
>> plugin. With
>> this change, maven is properly reporting the failed tests
>> and the final
>> build is reported as FAIL
>>
>> What is the difference between testng and surefire-testng
>> plugin , I don't
>> see any mention in the surefire plugin page, so I am not
>> sure if it is
>> correct to use this plugin.
>>
>> Any help is appreciated
>>
>>
>> Kind regards
>> Karl-Heinz Marbaise
>>
>>
> Kind regards
> Karl-Heinz Marbaise
>

Re: Surefire and testing plugin issue

[Karl Heinz Marbaise]

Hi,


>

This is the testng plugin version mentioned in maven-surefire-plugin page.

http://maven.apache.org/surefire/maven-surefire-plugin/examples/testng.html


This is not a plugin it's simply the dependency which you should have in 
your project if you are using TestNG...




I tried with the latest 6.8.8 and the issue still exists.

...
...

 
...
...
...
 
 org.apache.maven.plugins
 maven-surefire-plugin
 2.17
 

 
...
...
...

   
 
 
 org.testng
 testng
 6.3.1
 test
 

Thanks,
Subbu



Ah...

Using dependencyManagement is intended to define versions...but it will 
not define a real dependency...
If you need have a dependency you need to add the following in your pom 
file:




  
org.testng
testng
  
  ...



This is the indicator for maven-surefire-plugin to use the appropriate 
TestNG driver withn surefire to run tests with TestNG..




On Sat, Sep 27, 2014 at 8:54 PM, Karl Heinz Marbaise mailto:khmarba...@gmx.de>> wrote:

Hi,


>> Hi,


I am using maven-surefire-plugin version 2.17 and testng
plugin version
6.3.1 (jdk version is 1.7 ).


so ok so far you are using maven-surefire-plugin 2.17 and have
configured a dependency to testng in version 6.3.1?
First why are you using such an old version of TestNG..(2011?)...

Furthermore there is no testng plugin

Can you show your pom file which you are using otherwise it's hard
to guess what's wrong...




Some of our tests are failing and in the

testng-results.xml file it is reported as fail. The issue is
"maven" is
reporting the failed tests as "skipped" and the final build
status is
SUCCESS.

Has anyone faced this issue ? if so what is the soln.

I tried with "surefire-testng" plugin instead of "testng"
plugin. With
this change, maven is properly reporting the failed tests
and the final
build is reported as FAIL

What is the difference between testng and surefire-testng
plugin , I don't
see any mention in the surefire plugin page, so I am not
sure if it is
correct to use this plugin.

Any help is appreciated


Kind regards
Karl-Heinz Marbaise



Kind regards
Karl-Heinz Marbaise

-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org

Re: Surefire and testing plugin issue

[Subramanian Olagappan]

Karl,

This is the testng plugin version mentioned in maven-surefire-plugin page.

http://maven.apache.org/surefire/maven-surefire-plugin/examples/testng.html

I tried with the latest 6.8.8 and the issue still exists.

...
...
   

...
...
...

org.apache.maven.plugins
maven-surefire-plugin
2.17

   

...
...
...

  


org.testng
testng
6.3.1
test


Thanks,
Subbu

On Sat, Sep 27, 2014 at 8:54 PM, Karl Heinz Marbaise 
wrote:

> Hi,
>
>
> >> Hi,
>
>>
>>> I am using maven-surefire-plugin version 2.17 and testng plugin version
>>> 6.3.1 (jdk version is 1.7 ).
>>>
>>
> so ok so far you are using maven-surefire-plugin 2.17 and have configured
> a dependency to testng in version 6.3.1?
> First why are you using such an old version of TestNG..(2011?)...
>
> Furthermore there is no testng plugin
>
> Can you show your pom file which you are using otherwise it's hard to
> guess what's wrong...
>
>
>
>
>  Some of our tests are failing and in the
>>
>>> testng-results.xml file it is reported as fail. The issue is "maven" is
>>> reporting the failed tests as "skipped" and the final build status is
>>> SUCCESS.
>>>
>>> Has anyone faced this issue ? if so what is the soln.
>>>
>>> I tried with "surefire-testng" plugin instead of "testng" plugin. With
>>> this change, maven is properly reporting the failed tests and the final
>>> build is reported as FAIL
>>>
>>> What is the difference between testng and surefire-testng plugin , I
>>> don't
>>> see any mention in the surefire plugin page, so I am not sure if it is
>>> correct to use this plugin.
>>>
>>> Any help is appreciated
>>>
>>>
> Kind regards
> Karl-Heinz Marbaise
>
>
>
>
> -
> To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
> For additional commands, e-mail: users-h...@maven.apache.org
>
>

Re: Surefire and testing plugin issue

[Karl Heinz Marbaise]

Hi,


>> Hi,


I am using maven-surefire-plugin version 2.17 and testng plugin version
6.3.1 (jdk version is 1.7 ).


so ok so far you are using maven-surefire-plugin 2.17 and have 
configured a dependency to testng in version 6.3.1?

First why are you using such an old version of TestNG..(2011?)...

Furthermore there is no testng plugin

Can you show your pom file which you are using otherwise it's hard to 
guess what's wrong...






Some of our tests are failing and in the

testng-results.xml file it is reported as fail. The issue is "maven" is
reporting the failed tests as "skipped" and the final build status is
SUCCESS.

Has anyone faced this issue ? if so what is the soln.

I tried with "surefire-testng" plugin instead of "testng" plugin. With
this change, maven is properly reporting the failed tests and the final
build is reported as FAIL

What is the difference between testng and surefire-testng plugin , I don't
see any mention in the surefire plugin page, so I am not sure if it is
correct to use this plugin.

Any help is appreciated



Kind regards
Karl-Heinz Marbaise




-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org

Re: Surefire and testing plugin issue

[Subramanian Olagappan]

Sending it again sorry for the spam

On Sat, Sep 27, 2014 at 8:37 PM, Subramanian Olagappan 
wrote:

> Hi,
>
> I am using maven-surefire-plugin version 2.17 and testng plugin version
> 6.3.1 (jdk version is 1.7 ). Some of our tests are failing and in the
> testng-results.xml file it is reported as fail. The issue is "maven" is
> reporting the failed tests as "skipped" and the final build status is
> SUCCESS.
>
> Has anyone faced this issue ? if so what is the soln.
>
> I tried with "surefire-testng" plugin instead of "testng" plugin. With
> this change, maven is properly reporting the failed tests and the final
> build is reported as FAIL
>
> What is the difference between testng and surefire-testng plugin , I don't
> see any mention in the surefire plugin page, so I am not sure if it is
> correct to use this plugin.
>
> Any help is appreciated
>
> Thanks,
> Subbu
>