Quality Summary --------------------------------------- QA complete the regression testing for Crosswalk Lite 10.39.237.1 on Android. Test suites finally packed successfully thanks to the major regression(Fixed XWALK-4279<https://crosswalk-project.org/jira/browse/XWALK-4279>) got fixed. Two Crosswalk lite features initializing XWalkView asynchronously(XWLK-3971<https://crosswalk-project.org/jira/browse/XWALK-3971>) and LZMA (XWALK-3810<https://crosswalk-project.org/jira/browse/XWALK-3810>) got verified. One new issue reported: unable to get the ‘Contacts’ permission(XWALK-4339<https://crosswalk-project.org/jira/browse/XWALK-4339>). The overall test results: Test Scope
Total TCs Run rate Pass Rate Pass Rate of Executed Diff W/ Lite 10.39.235.1 Diff W/ 15.43.355.0(canary) Comment Use Cases 131 99% 76% 76% +44% -14% One new lite issues reported: unable to get the ‘Contacts’ permission(XWALK-4339<https://crosswalk-project.org/jira/browse/XWALK-4339>) Total 131 99% 76% 76% +44% -14% New Issue: - XWALK-4339<https://crosswalk-project.org/jira/browse/XWALK-4339> P2 [REG]Unable to get the "Contacts" permission on Android OS User Experience Evaluation Table User experience check points App Source Test Result Diff W/ Lite 10.39.235.1 Smooth Installation Process http://html5test.com/ LZMA compression: compress 12M -- Progress bar UI: works fine -- Decompression time: 11 seconds -- HTML5 Support http://html5test.com/ Crosswalk Mini: 464 -- Crosswalk 15.43.355.0: 517 -- First Launch Time Comparison Crosswalk: Hangonman Crosswalk 15.43.355.0: 2 seconds -- Crosswalk Mini: Hangonman Crosswalk Mini: 11 seconds -- Native App: WeChat Native App: 1 second -- App Screen Rotation https://crosswalk-project.org/ The Rotation function works well, both for Apps with English and Chinese language. -- m.ctrip.com (in Chinese) m.mogujie.com (in Chinese) Frame Rate http://ie.microsoft.com/testdrive/performance/fishietank/ 58 FPS/100 fish: 48 FPS -- Crosswalk Lite Use Cases Testing Details Component Total TCs Android IA Diff W/ Lite 10.39.235.1 Diff W/ 15.43.355.0(canary) Comments WRT 29 □□□□□□62% +62% -32% XWALK-3330<https://crosswalk-project.org/jira/browse/XWALK-3330> Crosswalk sets input type date in US format even if the locale is FR XWALK-3108<https://crosswalk-project.org/jira/browse/XWALK-3108> E/chromium: [ERROR:runtime_javascript_dialog_manager.cc(64)] Not implemented reached in virtual void xwalk::RuntimeJavaScriptDialogManager::CancelActiveAndPendingDialogs(content::WebContents*) XWALK-3594<https://crosswalk-project.org/jira/browse/XWALK-3594> WIN DEATH when press "back" key from chrome://gpu link Diff with Crosswalk canary 15.43.355.0 due to the test scope are different and found some specific issues for lite: XWALK-3883<https://crosswalk-project.org/jira/browse/XWALK-3883> [REG] The menu bar is displayed when launching the fullscreen App XWALK-3450<https://crosswalk-project.org/jira/browse/XWALK-3450> The video page is displayed abnormally on crosswalk Mini XWALK-2498<https://crosswalk-project.org/jira/browse/XWALK-2498> [REG] "Ssl Certification Error Alert" pop up repeatedly when access the untrusted security certificate website XWALK-4339<https://crosswalk-project.org/jira/browse/XWALK-4339> [REG]Unable to get the "Contacts" permission on Android OS Remote debugging is disabled by default on Crosswalk Lite(XWALK-4337<https://crosswalk-project.org/jira/browse/XWALK-4337>) Diff with lite 10.39.235.1 due to XWALK-4279<https://crosswalk-project.org/jira/browse/XWALK-4279> fixed W3C API 60 □□□□□□□78% -- -11% XWALK-2660<https://crosswalk-project.org/jira/browse/XWALK-2660> [REG]It is not available for label type="file" which load resource file failed on Android OS XWALK-2663<https://crosswalk-project.org/jira/browse/XWALK-2663> flex-flow and justify-content attribute in flexbox can not completely finished rendering effect when running the "flexibleBox" component XWALK-837<https://crosswalk-project.org/jira/browse/XWALK-837> Security Error occurs when calling requestFilesystem method on Android OS XWALK-2666<https://crosswalk-project.org/jira/browse/XWALK-2666> Fail to get correct type of devicemotion.acceleration.x/y/z and devicemotion.rotationRate.alpha when running the "W3C/Deviceorientation" on some devices XWALK-1693<https://crosswalk-project.org/jira/browse/XWALK-1693> Fail to get correct value of “connection status” when running “Use Case/BrowserState” on Android OS XWALK-1457<https://crosswalk-project.org/jira/browse/XWALK-1457> No selection list displayed in the input when running “Use Case/Input” on Android OS Diff with Crosswalk canary15.43.355.0 due to four lite specific issues reported: XWALK-4280<https://crosswalk-project.org/jira/browse/XWALK-4280> [REG]Fail to get location informaiton of latitude and longitude position on android XWALK-4281<https://crosswalk-project.org/jira/browse/XWALK-4281> [REG]No response after clicking 'Request Show Presentation' button of webapi usecase/Presentation XWALK-4282<https://crosswalk-project.org/jira/browse/XWALK-4282> [REG]Fail to get navigator.system or xwalk.experimental.system property XWALK-4283<https://crosswalk-project.org/jira/browse/XWALK-4283> [REG]navigator.getUserMedia got undefined when running webapi usecase/CameraviaUserMedia Presentation is disabled by default on Crosswalk Lite(XWALK-4281<https://crosswalk-project.org/jira/browse/XWALK-4281>) Embedding API 21 □□□□□□□□81% +81% -- XWALK-2012<https://crosswalk-project.org/jira/browse/XWALK-2012> Incorrect z-order when using multiple Android XWalk webviews (won’t fix) XWALK-3897<https://crosswalk-project.org/jira/browse/XWALK-3897> Fail to load the external link when clicking the link with '_blank' target on XWALK-4262<https://crosswalk-project.org/jira/browse/XWALK-4262>[REG]Multiple TextureViews display abnormally on Android Choose file doesn’t work on Crosswalk lite, same as XWALK-2660<https://crosswalk-project.org/jira/browse/XWALK-2660> [REG]It is not available for label type="file" which load resource file failed on Android OS Got improvement due to XWALK-4279<https://crosswalk-project.org/jira/browse/XWALK-4279> fixed Embedding API Async 21 □□□□□□□□81% +81% -- XWALK-2012<https://crosswalk-project.org/jira/browse/XWALK-2012> Incorrect z-order when using multiple Android XWalk webviews (won’t fix) XWALK-3897<https://crosswalk-project.org/jira/browse/XWALK-3897> Fail to load the external link when clicking the link with '_blank' target on XWALK-4262<https://crosswalk-project.org/jira/browse/XWALK-4262>[REG]Multiple TextureViews display abnormally on Android Choose file doesn’t work on Crosswalk lite, same as XWALK-2660<https://crosswalk-project.org/jira/browse/XWALK-2660> [REG]It is not available for label type="file" which load resource file failed on Android OS Got improvement due to XWALK-4279<https://crosswalk-project.org/jira/browse/XWALK-4279> fixed Verify Issues: ----------------------- XWALK-4279<https://crosswalk-project.org/jira/browse/XWALK-4279> [REG][usecase]Failed to pack Crosswalk lite usecase suites by using make.py Crosswalk Lite build for Android: https://download.01.org/crosswalk/releases/crosswalk-lite/android/canary/10.39.237.1/ Github Test Suite Links: https://github.com/crosswalk-project/crosswalk-test-suite/ Operating System: Android Image version: 4.2.2/4.4.4 Test Environment ----------------------- l Crosswalk Android: o IA phone: ZTE V975 o IA Tablet (Baytrail T): Asus Memo Pad8 Thanks Crosswalk QA
_______________________________________________ Crosswalk-dev mailing list Crosswalk-dev@lists.crosswalk-project.org https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
