Hi Isuru,

I have tried listing all the classes in testng.xml, but the listed order is
not preserved in execution. I am further investigating it. If we get it to
work, we can follow this approach, IMO. This is a one time task, there is
no overhead. We just need to list our new test classes in testng.xml.

Thanks,
Raj.

On Wed, Nov 25, 2015 at 6:18 PM, Rajkumar Rajaratnam <rajkum...@wso2.com>
wrote:

> Let me have a look at it. We didn't get the timeout issue locally, it only
> happens in jenkins builder.
>
> @Akila, +1 to add other groups as dependencies in server restart testcase.
>
> Thanks,
> Raj.
>
> On Wed, Nov 25, 2015 at 4:52 PM, Isuru Haththotuwa <isu...@apache.org>
> wrote:
>
>> I see that we have upgraded TestNG version [1]. Do we still have the
>> issue where the tests are run in parallel, even if we specify not to?
>>
>> [1]. https://issues.apache.org/jira/browse/STRATOS-1627
>>
>> On Wed, Nov 25, 2015 at 4:23 PM, Akila Ravihansa Perera <
>> raviha...@wso2.com> wrote:
>>
>>> Hi Gayan,
>>>
>>> I don't think timeout value is the root cause here. It already has a
>>> timeout value of 300000 (5mins). Can you check the
>>> stratos-integration.log and see whether Stratos restart test case was
>>> executed in middle of this test case?
>>>
>>> I noticed that Stratos restart test case only depends on
>>> "stratos.application.deployment" test group. But there are bunch of other
>>> test cases in the suite (including IaasProviderAttributeTestCase) that
>>> belongs to different test groups. We might need to add dependencies to
>>> those as well. I'm working on this now.
>>>
>> Without defining dependencies between test cases, if we specifically list
>> the classes in the test-suite-all.xml, it should run the test sequentially
>> AFAIU. Currently we have only specified the package.
>>
>>>
>>> Thanks.
>>>
>>> On Wed, Nov 25, 2015 at 3:20 PM, Gayan Gunarathne <gay...@wso2.com>
>>> wrote:
>>>
>>>>
>>>> With the release build I found that IaasProviderAttributeTestCase
>>>> failed due to the time-out[1]. Seems this is intermittent. I have increased
>>>> the timeout of that test case by introducing separate timeout value for
>>>> that test case.I will trigger another build with that.
>>>>
>>>>
>>>> [1]
>>>> [INFO]
>>>> testIaasProviderAttributes(org.apache.stratos.integration.tests.iaas.IaasProviderAttributeTestCase)
>>>>  Time elapsed: 85.196 sec  <<< FAILURE!
>>>> [INFO] org.testng.internal.thread.ThreadTimeoutException: Method
>>>> org.testng.internal.TestNGMethod.testIaasProviderAttributes() didn't finish
>>>> within the time-out 300000
>>>> [INFO] at java.lang.Thread.sleep(Native Method)
>>>> [INFO] at
>>>> org.apache.stratos.integration.common.TopologyHandler.assertApplicationStatus(TopologyHandler.java:240)
>>>> [INFO] at
>>>> org.apache.stratos.integration.tests.iaas.IaasProviderAttributeTestCase.testIaasProviderAttributes(IaasProviderAttributeTestCase.java:133)
>>>> [INFO]
>>>> [INFO]
>>>> [INFO] Results :
>>>> [INFO]
>>>> [INFO] Failed tests:
>>>> [INFO]   IaasProviderAttributeTestCase.testIaasProviderAttributes:133 ยป
>>>> ThreadTimeout M...
>>>>
>>>> Thanks,
>>>> Gayan
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> Gayan Gunarathne
>>>> Technical Lead, WSO2 Inc. (http://wso2.com)
>>>> Committer & PMC Member, Apache Stratos
>>>> email : gay...@wso2.com  | mobile : +94 775030545 <%2B94%20766819985>
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> Akila Ravihansa Perera
>>> WSO2 Inc.;  http://wso2.com/
>>>
>>> Blog:
>>> http://ravihansa3000.blogspot.com
>>>
>>> --
>>> <http://ravihansa3000.blogspot.com>
>>> <http://ravihansa3000.blogspot.com>
>>> Thanks and Regards,
>>>
>>> Isuru H.
>>> <http://ravihansa3000.blogspot.com>
>>> +94 716 358 048 <http://ravihansa3000.blogspot.com>* <http://wso2.com/>*
>>>
>>>
>>> * <http://wso2.com/>*
>>>
>>>
>>>
>
>
> --
> Rajkumar Rajaratnam
> Committer & PMC Member, Apache Stratos
> Software Engineer, WSO2
>
> Mobile : +94777568639
> Blog : rajkumarr.com
>



-- 
Rajkumar Rajaratnam
Committer & PMC Member, Apache Stratos
Software Engineer, WSO2

Mobile : +94777568639
Blog : rajkumarr.com

Reply via email to