[ https://jira.codehaus.org/browse/JBEHAVE-770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=297208#comment-297208 ]
joachim nilsson commented on JBEHAVE-770: ----------------------------------------- Tricky error since unit tests fails in random order. See 5 run results below: ---------------------------------------------------------- Failed tests: shouldBeFastUsingGroovy(org.jbehave.core.embedder.MetaFilterBehaviour): should be less than half a second for 1000 matches on a simple case shouldMatchCompositeStepsWhenStepParameterIsProvided(org.jbehave.core.steps.CompositeStepCandidateBehaviour): shouldMatchCompositeStepsAndCreateComposedStepsUsingMatchedParameters(org.jbehave.core.steps.CompositeStepCandidateBehaviour): shouldMatchCompositeStepsAndCreateComposedStepsUsingNamedParameters(org.jbehave.core.steps.CompositeStepCandidateBehaviour): shouldMatchAndIdentifyPendingAnnotatedSteps(org.jbehave.core.steps.StepCandidateBehaviour): Tests run: 453, Failures: 5, Errors: 0, Skipped: 1 ---------------------------------------------------------- Failed tests: shouldMatchCompositeStepsAndCreateComposedStepsUsingMatchedParameters(org.jbehave.core.steps.CompositeStepCandidateBehaviour): shouldMatchCompositeStepsAndCreateComposedStepsUsingNamedParameters(org.jbehave.core.steps.CompositeStepCandidateBehaviour): Tests run: 453, Failures: 2, Errors: 0, Skipped: 1 ---------------------------------------------------------- Failed tests: shouldMatchCompositeStepsAndCreateComposedStepsUsingMatchedParameters(org.jbehave.core.steps.CompositeStepCandidateBehaviour): shouldMatchCompositeStepsAndCreateComposedStepsUsingNamedParameters(org.jbehave.core.steps.CompositeStepCandidateBehaviour): Tests in error: shouldPerformStepsInDryRunMode(org.jbehave.core.steps.StepCandidateBehaviour): No starting word found for step 'Given foo named xyz' of type 'WHEN' amongst '{GIVEN=Given, AND=And, IGNORABLE=!--, THEN=Then, WHEN=When}' shouldCreateStepsOfDifferentTypesWithSameMatchingPattern(org.jbehave.core.steps.StepCandidateBehaviour): No starting word found for step 'Given foo named xyz' of type 'WHEN' amongst '{GIVEN=Given, AND=And, IGNORABLE=!--, THEN=Then, WHEN=When}' Tests run: 453, Failures: 2, Errors: 2, Skipped: 1 ---------------------------------------------------------- Failed tests: shouldMatchCompositeStepsAndCreateComposedStepsUsingMatchedParameters(org.jbehave.core.steps.CompositeStepCandidateBehaviour): shouldMatchCompositeStepsAndCreateComposedStepsUsingNamedParameters(org.jbehave.core.steps.CompositeStepCandidateBehaviour): shouldMatchAndIdentifyPendingAnnotatedSteps(org.jbehave.core.steps.StepCandidateBehaviour): Tests run: 453, Failures: 3, Errors: 0, Skipped: 1 ---------------------------------------------------------- Failed tests: shouldMatchCompositeStepsWhenStepParameterIsProvided(org.jbehave.core.steps.CompositeStepCandidateBehaviour): Tests in error: shouldPerformStepsInDryRunMode(org.jbehave.core.steps.StepCandidateBehaviour): No starting word found for step 'Given foo named xyz' of type 'WHEN' amongst '{AND=And, GIVEN=Given, IGNORABLE=!--, THEN=Then, WHEN=When}' shouldCreateStepsOfDifferentTypesWithSameMatchingPattern(org.jbehave.core.steps.StepCandidateBehaviour): No starting word found for step 'Given foo named xyz' of type 'WHEN' amongst '{AND=And, GIVEN=Given, IGNORABLE=!--, THEN=Then, WHEN=When}' Tests run: 453, Failures: 1, Errors: 2, Skipped: 1 ---------------------------------------------------------- > Testcases expects order in result from getMethods() > ---------------------------------------------------- > > Key: JBEHAVE-770 > URL: https://jira.codehaus.org/browse/JBEHAVE-770 > Project: JBehave > Issue Type: Bug > Components: Core > Environment: Found the issue using Win7(x64) and Java7u2. > Reporter: joachim nilsson > Priority: Minor > Attachments: > 0001-testcase-bugfix-Corrected-testcases-that-were-using-.patch > > > Testcases in CompositeStepCandidateBehaviour and StepCandidateBehaviour uses > the resulting list from getMethods() and expected results to be in > declaration order. > According to Javadoc of java.lang.Class.getMethods(): > "Returns an array ... The elements in the array returned are not sorted and > are not in any particular order..." > Correction attached, making use of an extraction method to find the desired > CandidateStep in the test. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://jira.codehaus.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira --------------------------------------------------------------------- To unsubscribe from this list, please visit: http://xircles.codehaus.org/manage_email