Quality Summary ------------------------------------------- QA complete Crosswalk App Tools Testing based on Commit ID 7a4be8641ee33911a700601c11452dca4dc6fefb. Glad to see that Output in logfile does not be abbreviated (fixed APPTOOLS-213<https://crosswalk-project.org/jira/browse/APPTOOLS-213>). However, one new issue found: Fail to build project when set "name" to special characters in manifest for Windows platform (APPTOOLS-338<https://crosswalk-project.org/jira/browse/APPTOOLS-338>). The overall test results:
New Issues: ----------------------- APPTOOLS-338<https://crosswalk-project.org/jira/browse/APPTOOLS-338> P2 [Apptools] Fail to build project when set "name" to special characters in manifest for Windows platform. Verified Issues: ----------------------- APPTOOLS-213<https://crosswalk-project.org/jira/browse/APPTOOLS-213> P2 Do not abbreviate paths when running silently / non-interactive. Test Scope Windows 8.1 Windows 10 OS X Deepin Android Usecase Test Comment Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) App Tools & Manifest Android 32-bit Tests (Embedded) N/A N/A N/A 283 95% -- 283 95% -- N/A N/A N/A 39 92% -- Bugs Exist: APPTOOLS-113<https://crosswalk-project.org/jira/browse/APPTOOLS-113>, APPTOOLS-2<https://crosswalk-project.org/jira/browse/APPTOOLS-2>, APPTOOLS-62<https://crosswalk-project.org/jira/browse/APPTOOLS-62>, APPTOOLS-296<https://crosswalk-project.org/jira/browse/APPTOOLS-296>, APPTOOLS-146<https://crosswalk-project.org/jira/browse/APPTOOLS-146>, APPTOOLS-59<https://crosswalk-project.org/jira/browse/APPTOOLS-59>, APPTOOLS-232<https://crosswalk-project.org/jira/browse/APPTOOLS-232> App Tools & Manifest Android 32-bit Tests (Shared) N/A N/A N/A 283 95% -- 283 95% -- N/A N/A N/A 39 92% -- Bugs Exist: APPTOOLS-113<https://crosswalk-project.org/jira/browse/APPTOOLS-113>, APPTOOLS-2<https://crosswalk-project.org/jira/browse/APPTOOLS-2>, APPTOOLS-62<https://crosswalk-project.org/jira/browse/APPTOOLS-62>, APPTOOLS-296<https://crosswalk-project.org/jira/browse/APPTOOLS-296>, APPTOOLS-146<https://crosswalk-project.org/jira/browse/APPTOOLS-146>, APPTOOLS-59<https://crosswalk-project.org/jira/browse/APPTOOLS-59>, APPTOOLS-232<https://crosswalk-project.org/jira/browse/APPTOOLS-232> App Tools & Manifest Android 64-bit Tests (Embedded) N/A N/A N/A 283 95% -- 283 95% -- N/A N/A N/A 39 92% -- Bugs Exist: APPTOOLS-113<https://crosswalk-project.org/jira/browse/APPTOOLS-113>, APPTOOLS-2<https://crosswalk-project.org/jira/browse/APPTOOLS-2>, APPTOOLS-62<https://crosswalk-project.org/jira/browse/APPTOOLS-62>, APPTOOLS-296<https://crosswalk-project.org/jira/browse/APPTOOLS-296>, APPTOOLS-146<https://crosswalk-project.org/jira/browse/APPTOOLS-146>, APPTOOLS-59<https://crosswalk-project.org/jira/browse/APPTOOLS-59>, APPTOOLS-232<https://crosswalk-project.org/jira/browse/APPTOOLS-232> App Tools & Manifest Android 64-bit Tests (Shared) N/A N/A N/A 283 95% 283 95% -- N/A N/A N/A 39 92% -- Bugs Exist: APPTOOLS-113<https://crosswalk-project.org/jira/browse/APPTOOLS-113>, APPTOOLS-2<https://crosswalk-project.org/jira/browse/APPTOOLS-2>, APPTOOLS-62<https://crosswalk-project.org/jira/browse/APPTOOLS-62>, APPTOOLS-296<https://crosswalk-project.org/jira/browse/APPTOOLS-296>, APPTOOLS-146<https://crosswalk-project.org/jira/browse/APPTOOLS-146>, APPTOOLS-59<https://crosswalk-project.org/jira/browse/APPTOOLS-59>, APPTOOLS-232<https://crosswalk-project.org/jira/browse/APPTOOLS-232> App Tools SampleApp Tests N/A N/A N/A 10 100% -- 10 100% -- 2 100% -- N/A N/A N/A App Tools UseCase Tests (windows/ios/deepin) N/A N/A N/A 23 96% -- 8 63% -- 7 71% -- N/A N/A N/A Bugs exist: APPTOOLS-2<https://crosswalk-project.org/jira/browse/APPTOOLS-2>, APPTOOLS-178<https://crosswalk-project.org/jira/browse/APPTOOLS-178>, APPTOOLS-62<https://crosswalk-project.org/jira/browse/APPTOOLS-62>, APPTOOLS-4<https://crosswalk-project.org/jira/browse/APPTOOLS-4>, APPTOOLS-170<https://crosswalk-project.org/jira/browse/APPTOOLS-170>, XWALK-6529<https://crosswalk-project.org/jira/browse/XWALK-6529> App Tools & Manifest Windows Tests 151 91% +8% 151 91% +8% N/A N/A N/A N/A N/A N/A N/A N/A N/A Bugs exist: APPTOOLS-59<https://crosswalk-project.org/jira/browse/APPTOOLS-59>, APPTOOLS-62<https://crosswalk-project.org/jira/browse/APPTOOLS-62>, APPTOOLS-53<https://crosswalk-project.org/jira/browse/APPTOOLS-53>, APPTOOLS-338<https://crosswalk-project.org/jira/browse/APPTOOLS-338> Got improvement due to case number increased. Total 151 91% +8% 1316 95% +1% 1150 95% -- 9 78% -- 156 92% -- Got improvement due to case number increased. (*) instead of the previous test commit id: 41077b6c47fcb154055ef3aaa13eb77b173891eb Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools Release Tag or Commit ID: 7a4be8641ee33911a700601c11452dca4dc6fefb Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Release Tag or Commit ID: c5212e631dc37807be394dd2c86fa0dad9c42767 iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: abd046da6a127142b01a87e2343f52f0c79bd215 Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/ Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/beta/19.49.514.1/ Crosswalk Binary on Windows: https://download.01.org/crosswalk/releases/crosswalk/windows/beta/19.49.514.1/ Test Environment: ----------------------- Android host: Ivy Bridge Desktop, Ubuntu 14, Windows 8.1,Windows10 Android device: ASUS Memo Pad 8, Xiaomi Pad 2,Nexus 5, Nexus 9 iOS host: MacBook Pro 10.11 with XCode 7.3 iOS device: iPad mini 9.3 iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Linux/Deepin desktop: Deepin 2015 x86_64 with Chinese Linux/Deepin backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list Crosswalk-dev@lists.crosswalk-project.org https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
