Re: Announcing new test platform "Android 7.0 x86"
These tests run under normal GeckoView e10s mode, with one parent activity process and one child service process. It should be very similar to desktop e10s tests in terms of what tests run in which process. Cheers, Jim On Sat, Nov 3, 2018, 4:01 AM Ehsan Akhgari wrote: > Thanks a lot, this is great news! > > What's the process model configuration for this testing platform? Do these > tests run in single process mode or are they running in some e10s like > environment? Is there some documentation that explains what runs in which > process? > > Thanks, > Ehsan > > On Thu, Nov 1, 2018 at 5:44 PM Geoffrey Brown wrote: > > > This week some familiar tier 1 test suites began running on a new test > > platform labelled "Android 7.0 x86" on treeherder. Only a few test suites > > are running so far; more are planned. > > > > Like the existing "Android 4.2" and "Android 4.3" test platforms, these > > tests run in an Android emulator running in a docker container (the same > > Ubuntu-based image used for linux64 tests). The new platform runs an x86 > > emulator using kvm acceleration, enabling tests to run much, much faster > > than on the older platforms. As a bonus, the new platform uses Android > 7.0 > > ("Nougat", API 24) - more modern, more relevant. > > > > This test platform was added to support geckoview testing. Tests run in > the > > geckoview-based TestRunnerActivity (not Firefox for Android). > > > > To reproduce the main elements of this test environment locally: > > - build for Android x86 (mozconfig with --target=i686-linux-android) > > - 'mach android-emulator' or explicitly 'mach android-emulator --version > > x86-7.0' > > - install the geckoview androidTest apk > > - run your test command using --app to specify the geckoview test app, > > something like 'mach mochitest ... --app=org.mozilla.geckoview.test' > > > > Great thanks to the many people who have helped enable this test > platform, > > especially :wcosta for help with taskcluster and :jchen for investigating > > test failures. > > ___ > > dev-platform mailing list > > dev-platform@lists.mozilla.org > > https://lists.mozilla.org/listinfo/dev-platform > > > > > -- > Ehsan > ___ > dev-platform mailing list > dev-platform@lists.mozilla.org > https://lists.mozilla.org/listinfo/dev-platform > On Sat, Nov 3, 2018, 4:01 AM Ehsan Akhgari wrote: > Thanks a lot, this is great news! > > What's the process model configuration for this testing platform? Do these > tests run in single process mode or are they running in some e10s like > environment? Is there some documentation that explains what runs in which > process? > > Thanks, > Ehsan > > On Thu, Nov 1, 2018 at 5:44 PM Geoffrey Brown wrote: > > > This week some familiar tier 1 test suites began running on a new test > > platform labelled "Android 7.0 x86" on treeherder. Only a few test suites > > are running so far; more are planned. > > > > Like the existing "Android 4.2" and "Android 4.3" test platforms, these > > tests run in an Android emulator running in a docker container (the same > > Ubuntu-based image used for linux64 tests). The new platform runs an x86 > > emulator using kvm acceleration, enabling tests to run much, much faster > > than on the older platforms. As a bonus, the new platform uses Android > 7.0 > > ("Nougat", API 24) - more modern, more relevant. > > > > This test platform was added to support geckoview testing. Tests run in > the > > geckoview-based TestRunnerActivity (not Firefox for Android). > > > > To reproduce the main elements of this test environment locally: > > - build for Android x86 (mozconfig with --target=i686-linux-android) > > - 'mach android-emulator' or explicitly 'mach android-emulator --version > > x86-7.0' > > - install the geckoview androidTest apk > > - run your test command using --app to specify the geckoview test app, > > something like 'mach mochitest ... --app=org.mozilla.geckoview.test' > > > > Great thanks to the many people who have helped enable this test > platform, > > especially :wcosta for help with taskcluster and :jchen for investigating > > test failures. > > ___ > > dev-platform mailing list > > dev-platform@lists.mozilla.org > > https://lists.mozilla.org/listinfo/dev-platform > > > > > -- > Ehsan > ___ > dev-platform mailing list > dev-platform@lists.mozilla.org > https://lists.mozilla.org/listinfo/dev-platform > ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Re: Announcing new test platform "Android 7.0 x86"
Thanks a lot, this is great news! What's the process model configuration for this testing platform? Do these tests run in single process mode or are they running in some e10s like environment? Is there some documentation that explains what runs in which process? Thanks, Ehsan On Thu, Nov 1, 2018 at 5:44 PM Geoffrey Brown wrote: > This week some familiar tier 1 test suites began running on a new test > platform labelled "Android 7.0 x86" on treeherder. Only a few test suites > are running so far; more are planned. > > Like the existing "Android 4.2" and "Android 4.3" test platforms, these > tests run in an Android emulator running in a docker container (the same > Ubuntu-based image used for linux64 tests). The new platform runs an x86 > emulator using kvm acceleration, enabling tests to run much, much faster > than on the older platforms. As a bonus, the new platform uses Android 7.0 > ("Nougat", API 24) - more modern, more relevant. > > This test platform was added to support geckoview testing. Tests run in the > geckoview-based TestRunnerActivity (not Firefox for Android). > > To reproduce the main elements of this test environment locally: > - build for Android x86 (mozconfig with --target=i686-linux-android) > - 'mach android-emulator' or explicitly 'mach android-emulator --version > x86-7.0' > - install the geckoview androidTest apk > - run your test command using --app to specify the geckoview test app, > something like 'mach mochitest ... --app=org.mozilla.geckoview.test' > > Great thanks to the many people who have helped enable this test platform, > especially :wcosta for help with taskcluster and :jchen for investigating > test failures. > ___ > dev-platform mailing list > dev-platform@lists.mozilla.org > https://lists.mozilla.org/listinfo/dev-platform > -- Ehsan ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Re: Announcing new test platform "Android 7.0 x86"
I'm also excited to see this up and running, as it will probably be quite useful with testing webrender on android. Thank you! On Thu, Nov 1, 2018 at 6:40 PM Chris Peterson wrote: > > On 2018-11-01 3:06 PM, Nicholas Alexander wrote: > >> Like the existing "Android 4.2" and "Android 4.3" test platforms, these > >> tests run in an Android emulator running in a docker container (the same > >> Ubuntu-based image used for linux64 tests). The new platform runs an x86 > >> emulator using kvm acceleration, enabling tests to run much, much faster > >> than on the older platforms. As a bonus, the new platform uses Android 7.0 > >> ("Nougat", API 24) - more modern, more relevant. > >> > > This is incredibly awesome news! For those not in the know, the reason > > this is so noteworthy is that most cloud-based hosts don't expose KVM > > acceleration, since it can be a sec concern. In particular, AWS doesn't > > expose KVM to most (all?) instances. There's an awful lot of plumbing > > required to get jobs running in different cloud hosts... but here we are. > > Our Android test coverage has been sparse in the past because slow ARM > emulators and devices were a bottleneck. Being able to run Android tests > on x86 at "desktop speed" means we can greatly improve our test coverage > on Android! > ___ > dev-platform mailing list > dev-platform@lists.mozilla.org > https://lists.mozilla.org/listinfo/dev-platform ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Re: Announcing new test platform "Android 7.0 x86"
On 2018-11-01 3:06 PM, Nicholas Alexander wrote: Like the existing "Android 4.2" and "Android 4.3" test platforms, these tests run in an Android emulator running in a docker container (the same Ubuntu-based image used for linux64 tests). The new platform runs an x86 emulator using kvm acceleration, enabling tests to run much, much faster than on the older platforms. As a bonus, the new platform uses Android 7.0 ("Nougat", API 24) - more modern, more relevant. This is incredibly awesome news! For those not in the know, the reason this is so noteworthy is that most cloud-based hosts don't expose KVM acceleration, since it can be a sec concern. In particular, AWS doesn't expose KVM to most (all?) instances. There's an awful lot of plumbing required to get jobs running in different cloud hosts... but here we are. Our Android test coverage has been sparse in the past because slow ARM emulators and devices were a bottleneck. Being able to run Android tests on x86 at "desktop speed" means we can greatly improve our test coverage on Android! ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Re: Announcing new test platform "Android 7.0 x86"
On Thu, Nov 1, 2018 at 2:44 PM Geoffrey Brown wrote: > This week some familiar tier 1 test suites began running on a new test > platform labelled "Android 7.0 x86" on treeherder. Only a few test suites > are running so far; more are planned. > > Like the existing "Android 4.2" and "Android 4.3" test platforms, these > tests run in an Android emulator running in a docker container (the same > Ubuntu-based image used for linux64 tests). The new platform runs an x86 > emulator using kvm acceleration, enabling tests to run much, much faster > than on the older platforms. As a bonus, the new platform uses Android 7.0 > ("Nougat", API 24) - more modern, more relevant. > This is incredibly awesome news! For those not in the know, the reason this is so noteworthy is that most cloud-based hosts don't expose KVM acceleration, since it can be a sec concern. In particular, AWS doesn't expose KVM to most (all?) instances. There's an awful lot of plumbing required to get jobs running in different cloud hosts... but here we are. Bravo to everybody involved! Nick ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Announcing new test platform "Android 7.0 x86"
This week some familiar tier 1 test suites began running on a new test platform labelled "Android 7.0 x86" on treeherder. Only a few test suites are running so far; more are planned. Like the existing "Android 4.2" and "Android 4.3" test platforms, these tests run in an Android emulator running in a docker container (the same Ubuntu-based image used for linux64 tests). The new platform runs an x86 emulator using kvm acceleration, enabling tests to run much, much faster than on the older platforms. As a bonus, the new platform uses Android 7.0 ("Nougat", API 24) - more modern, more relevant. This test platform was added to support geckoview testing. Tests run in the geckoview-based TestRunnerActivity (not Firefox for Android). To reproduce the main elements of this test environment locally: - build for Android x86 (mozconfig with --target=i686-linux-android) - 'mach android-emulator' or explicitly 'mach android-emulator --version x86-7.0' - install the geckoview androidTest apk - run your test command using --app to specify the geckoview test app, something like 'mach mochitest ... --app=org.mozilla.geckoview.test' Great thanks to the many people who have helped enable this test platform, especially :wcosta for help with taskcluster and :jchen for investigating test failures. ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform