The problem is that the list is waiting on Timer events to do the dragScroll (like in many other UI's when you drag off the edge of something and it starts scrolling). Mustella lacks the infrastructure to perfectly control the number of timer events during the test run.
The only idea I have to fix it is to implement this infrastructure, but it feels like more work than I want to do right now. On 12/26/13 11:25 PM, "Erik de Bruin" <e...@ixsoftware.nl> wrote: >This test: > >gumbo/components/ListDragDrop/events/SparkDNDList_events >ListAbcDND1_dragComplete Failed CompareBitmap(body:step 16) compare >returned[object BitmapData] > >Fails every now and then. It's the only test to do so. There is not >pattern to the failure, not one specific set of players or something. > >Is there a way to maybe give this test some more 'tolerance', maybe? > >EdB > > > >On Thu, Dec 26, 2013 at 12:59 PM, <flex.muste...@gmail.com> wrote: >> flex-sdk_mustella - Build # 631 - Failure: >> >> http://flex-mustella.cloudapp.net/job/flex-sdk_mustella/631/ >> >> Changes for Build #631 >> >> >> -------------------------------- >> >> [...truncated 94658 lines...] >> [java] new test file: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_ModuleUsage.swf >> [java] ******** cmdArr before: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >> [java] >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_ModuleUsage.swf >> [java] ******** moreParameters before: >> [java] ******** cmdArr after: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >> [java] >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_ModuleUsage.swf >> [java] getting directory from the swf file >> [java] derived directory: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs >> [java] Launching: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_ModuleUsage.swf Launching: >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_ModuleUsage.swf >> [java] USING directory: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs >> [java] time: 06:58:48.570 >> [java] waited 2100 >> [java] ClobberProcess, it was already null >> [java] SCRIPTDONE! 06:58:52.573 >> [java] GET /ScriptComplete?0 HTTP/1.1 >> [java] Before Wait loop 06:58:52.573 waiting = 0 >> [java] After Wait loop 06:58:52.573 waiting = 0 >> [java] clobberProcess false >> [java] Total Results so far: 29 >> [java] waited 2100 >> [java] ClobberProcess, it was already null >> [java] Grab log, do parse = false >> [java] Grabbing the log from: >>C:\Users\ApacheFlex\AppData/Roaming\Macromedia/Flash >>Player/Logs/flashlog.txt to: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_ModuleUsage.log >> [java] new test file: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_actualLocaleIDName.swf >> [java] ******** cmdArr before: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >> [java] >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_actualLocaleIDName.swf >> [java] ******** moreParameters before: >> [java] ******** cmdArr after: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >> [java] >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_actualLocaleIDName.swf >> [java] getting directory from the swf file >> [java] derived directory: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs >> [java] Launching: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_actualLocaleIDName.swf Launching: >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_actualLocaleIDName.swf >> [java] USING directory: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs >> [java] time: 06:58:54.998 >> [java] SCRIPTDONE! 06:58:58.148 >> [java] GET /ScriptComplete?0 HTTP/1.1 >> [java] Before Wait loop 06:58:58.148 waiting = 0 >> [java] After Wait loop 06:58:58.148 waiting = 0 >> [java] clobberProcess false >> [java] Total Results so far: 30 >> [java] Grab log, do parse = false >> [java] Grabbing the log from: >>C:\Users\ApacheFlex\AppData/Roaming\Macromedia/Flash >>Player/Logs/flashlog.txt to: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_actualLocaleIDName.log >> [java] new test file: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_constructor.swf >> [java] ******** cmdArr before: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >> [java] >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_constructor.swf >> [java] ******** moreParameters before: >> [java] ******** cmdArr after: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >> [java] >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_constructor.swf >> [java] getting directory from the swf file >> [java] derived directory: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs >> [java] Launching: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_constructor.swf Launching: >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_constructor.swf >> [java] USING directory: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs >> [java] time: 06:59:00.546 >> [java] waited 2100 >> [java] ClobberProcess, it was already null >> [java] SCRIPTDONE! 06:59:03.643 >> [java] GET /ScriptComplete?0 HTTP/1.1 >> [java] Before Wait loop 06:59:03.643 waiting = 0 >> [java] After Wait loop 06:59:03.643 waiting = 0 >> [java] clobberProcess false >> [java] Total Results so far: 31 >> [java] Grab log, do parse = false >> [java] Grabbing the log from: >>C:\Users\ApacheFlex\AppData/Roaming\Macromedia/Flash >>Player/Logs/flashlog.txt to: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_constructor.log >> [java] new test file: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_currencyISOCode.swf >> [java] ******** cmdArr before: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >> [java] >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_currencyISOCode.swf >> [java] ******** moreParameters before: >> [java] ******** cmdArr after: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >> [java] >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_currencyISOCode.swf >> [java] getting directory from the swf file >> [java] derived directory: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs >> [java] Launching: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_currencyISOCode.swf Launching: >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_currencyISOCode.swf >> [java] USING directory: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs >> [java] time: 06:59:06.050 >> [java] waited 2100 >> [java] ClobberProcess, it was already null >> [java] SCRIPTDONE! 06:59:09.113 >> [java] GET /ScriptComplete?0 HTTP/1.1 >> [java] Before Wait loop 06:59:09.113 waiting = 0 >> [java] After Wait loop 06:59:09.113 waiting = 0 >> [java] clobberProcess false >> [java] Total Results so far: 32 >> [java] Grab log, do parse = false >> [java] Grabbing the log from: >>C:\Users\ApacheFlex\AppData/Roaming\Macromedia/Flash >>Player/Logs/flashlog.txt to: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_currencyISOCode.log >> [java] new test file: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_fallback_Properties.swf >> [java] ******** cmdArr before: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >> [java] >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_fallback_Properties.swf >> [java] ******** moreParameters before: >> [java] ******** cmdArr after: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >> [java] >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_fallback_Properties.swf >> [java] getting directory from the swf file >> [java] derived directory: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs >> [java] Launching: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_fallback_Properties.swf Launching: >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_fallback_Properties.swf >> [java] USING directory: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs >> [java] time: 06:59:11.498 >> [java] waited 2100 >> [java] ClobberProcess, it was already null >> [java] SCRIPTDONE! 06:59:14.735 >> [java] GET /ScriptComplete?0 HTTP/1.1 >> [java] Before Wait loop 06:59:14.735 waiting = 0 >> [java] After Wait loop 06:59:14.735 waiting = 0 >> [java] clobberProcess false >> [java] Total Results so far: 33 >> [java] Grab log, do parse = false >> [java] Grabbing the log from: >>C:\Users\ApacheFlex\AppData/Roaming\Macromedia/Flash >>Player/Logs/flashlog.txt to: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_fallback_Properties.log >> [java] new test file: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_validate_style_module_global.swf >> [java] ******** cmdArr before: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >> [java] >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_validate_style_module_global.swf >> [java] ******** moreParameters before: >> [java] ******** cmdArr after: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >> [java] >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_validate_style_module_global.swf >> [java] getting directory from the swf file >> [java] derived directory: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs >> [java] Launching: >> [java] >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_validate_style_module_global.swf >>Launching: >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_validate_style_module_global.swf >> [java] USING directory: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs >> [java] time: 06:59:17.151 >> [java] waited 2100 >> [java] ClobberProcess, it was already null >> [java] SCRIPTDONE! 06:59:20.755 >> [java] GET /ScriptComplete?0 HTTP/1.1 >> [java] Before Wait loop 06:59:20.755 waiting = 0 >> [java] After Wait loop 06:59:20.755 waiting = 0 >> [java] clobberProcess false >> [java] Total Results so far: 34 >> [java] waited 2100 >> [java] ClobberProcess, it was already null >> [java] Grab log, do parse = false >> [java] Grabbing the log from: >>C:\Users\ApacheFlex\AppData/Roaming\Macromedia/Flash >>Player/Logs/flashlog.txt to: >>C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\tests\spark\validat >>ors\CurrencyValidator\SWFs\CV_validate_style_module_global.log >> [java] at the end of main >> [java] Shutting down the results server >> [java] shutting down the baseline server >> [java] done waiting for results...bye >> [java] ===================================================== >> [java] Passes: 33 >> [java] Fails: 1 >> [java] ===================================================== >> [java] >> [java] ===================================================== >> [java] ===================================================== >> [java] Passed: >> [java] ===================================================== >> [java] MarshallPlan/ManagerTests/MP_CursorManager_Tests >>MP_CursorManager_SetCursor_EmbeddedImage Passed >> [java] components/Alert/Properties/Alert_Properties >>Alert_layoutDirection_direction_rtl_with_alertIcon Passed >> [java] components/Alert/Styles/Alert_Styles Alert_letterSpacing >>Passed >> [java] components/Alert/Styles/Alert_Styles Alert_buttonStyleName >>Passed >> [java] components/Alert/Styles/Alert_Styles Alert_messageStyleName >>Passed >> [java] components/Alert/Styles/Alert_Styles Alert_titleStyleName >>Passed >> [java] components/Alert/Styles/Alert_Styles >>Alert_embedded_font_verdana Passed >> [java] components/Alert/Styles/Alert_Styles >>Alert_embedded_font_verdana_italic Passed >> [java] components/Alert/Styles/Alert_Styles >>Alert_embedded_font_verdana_bold Passed >> [java] >>containers/tabnavigator/Styles/TabNavigator_Styles_SkinStates >>TabNavigator_Styles_SkinStates_runtime_SWF_mouseOver_NonselectedTab >>Passed >> [java] >>gumbo/components/Application/properties/Application_Properties >>Application_Properties_skin_test7 Passed >> [java] gumbo/components/Image/styles/Image_styles_smoothingQuality >>Image_Scale_stretch_smoothingQuality_high Passed >> [java] gumbo/components/ListDragDrop/events/SparkDNDList_events >>ListAbcDND1_dragDrop Passed >> [java] itemRenderers/Halo/List/test_scripts/List_itemEditor >>DateFieldItemEditor_Scrolling Passed >> [java] itemRenderers/Halo/List/test_scripts/List_itemRenderer >>DateFieldRenderer_Scrolling Passed >> [java] >>itemRenderers/Spark/List/test_scripts/List_itemRenderer_spark >>DateFieldRenderer_Scrolling Passed >> [java] spark/core/fxg/properties/fxgtemplate_tester >>transforms_color_transform_rect_rect_fills_strokes_color_transform Passed >> [java] spark/styles/local/borderStyles_typeSelector_tester >>borderColor_runtime_as_haloTextInput Passed >> [java] spark/styles/local/compiler_styles_tests_tester >>contentBackgroundColor_super_typeSelector Passed >> [java] spark/styles/global/contentBackgroundAlpha_tester >>contentBackgroundAlpha_inheritance_Application Passed >> [java] spark/styles/local/cornerRadius_typeSelector_tester >>cornerRadius_visualverification_classSelector Passed >> [java] spark/styles/local/dropShadowVisible_css_tester >>dropShadowVisible_css_sparkPanel Passed >> [java] spark/styles/local/focusBlendMode_typeSelector_tester >>focus_contentBackgroundAlpha_0_TextArea_TextInput Passed >> [java] spark/styles/local/focus_tester >>focusThickness_classSelector Passed >> [java] spark/styles/local/focus_mxml_tester focusAlpha_mxml Passed >> [java] spark/styles/local/paddingStyles_tester >>paddingRight_change_runtime_AS_SparkTextInput Passed >> [java] spark/styles/local/spark_application_background_tester >>spark_Panel_backgroundColor_backgroundAlpha_mxml_getStyle Passed >> [java] >>spark/validators/CurrencyValidator/Others/CV_ModuleUsage_tester >>CV_ModuleUsage_actualLocaleIDName_test_1 Passed >> [java] >>spark/validators/CurrencyValidator/Properties/CV_actualLocaleIDName_teste >>r CV_actualLocaleIDName_default_test_1 Passed >> [java] >>spark/validators/CurrencyValidator/Methods/CV_constructor_tester >>CV_Constructor_noLocaleSet_test_1 Passed >> [java] >>spark/validators/CurrencyValidator/Properties/CV_currencyISOCode_tester >>CV_currencyISOCode_default_test_1 Passed >> [java] >>spark/validators/CurrencyValidator/Fallback/CV_fallback_Properties_tester >> CV_fallback_get_currencyISOCode_inline_nolocale_test_1 Passed >> [java] >>spark/validators/CurrencyValidator/Methods/CV_validate_style_module_globa >>l_tester CV_validate_default_validateResult_script_invalid_60 Passed >> [java] ===================================================== >> [java] Failed: >> [java] ===================================================== >> [java] gumbo/components/ListDragDrop/events/SparkDNDList_events >>ListAbcDND1_dragComplete Failed CompareBitmap(body:step 16) compare >>returned[object BitmapData] >> [java] >> [java] >> [java] ===================================================== >> [java] Passes: 33 >> [java] Fails: 1 >> [java] ===================================================== >> [java] >> [java] >> [java] Wrote summary to results.txt >> [java] Wrote failures to failures.txt >> >> BUILD FAILED >> C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\build.xml:1538: >>The following error occurred while executing this line: >> C:\jenkins_slave\workspace\flex-sdk_mustella\mustella\build.xml:1656: >>Java returned: 1 >> >> Total time: 7 minutes 23 seconds >> >> >> >> ============ JENKINS MUSTELLA RUN REPORT ============ >> >> Date and time: 12-26-2013 11:59 >> >> Settings: >> player.version = 12.0 >> air.version = 4 >> FLASHPLAYER_DEBUGGER = >>C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win_ >>32.exe >> AIR_HOME = C:\ApacheFlex\dependencies\AdobeAIRSDK\4 >> >> Build: >> type = main >> command = -timeout=60000 >> set = -all >> >> Log: >> - Made Cygwin ignore carriage returns >> - Cleaned up 'local.properties' files from previous runs >> - Set FLASH_VERSION to '12.0' and AIR_VERSION to '4' >> - Set AIR_HOME to 'C:\ApacheFlex\dependencies\AdobeAIRSDK\4' >> - Set FLASHPLAYER_DEBUGGER to >>'C:\ApacheFlex\dependencies\FlashPlayer_Debug\flashplayer12-0_debugsa_win >>_32.exe' >> - Ran 'clean', 'main' and 'other.locales' ant targets to prepare the >>SDK for testing >> - Ran Mustella on the SDK with these parameters: '-timeout=60000 -all' >> - Some tests failed: running '-failures' >> - Some of tests failed, even after running '-failures'... >> >> >> ===================================================== >> >> >> >> Build step 'Execute shell' marked build as failure >> Email was triggered for: Failure >> Sending email for trigger: Failure >> >> >> (sent from ext-email) > > > >-- >Ix Multimedia Software > >Jan Luykenstraat 27 >3521 VB Utrecht > >T. 06-51952295 >I. www.ixsoftware.nl
