Re: Announcing new test platform "Android 7.0 x86"

2018-11-04 Thread Jim Chen
These tests run under normal GeckoView e10s mode, with one parent activity
process and one child service process. It should be very similar to desktop
e10s tests in terms of what tests run in which process.

Cheers,
Jim


On Sat, Nov 3, 2018, 4:01 AM Ehsan Akhgari  wrote:

> Thanks a lot, this is great news!
>
> What's the process model configuration for this testing platform?  Do these
> tests run in single process mode or are they running in some e10s like
> environment?  Is there some documentation that explains what runs in which
> process?
>
> Thanks,
> Ehsan
>
> On Thu, Nov 1, 2018 at 5:44 PM Geoffrey Brown  wrote:
>
> > This week some familiar tier 1 test suites began running on a new test
> > platform labelled "Android 7.0 x86" on treeherder. Only a few test suites
> > are running so far; more are planned.
> >
> > Like the existing "Android 4.2" and "Android 4.3" test platforms, these
> > tests run in an Android emulator running in a docker container (the same
> > Ubuntu-based image used for linux64 tests).  The new platform runs an x86
> > emulator using kvm acceleration, enabling tests to run much, much faster
> > than on the older platforms. As a bonus, the new platform uses Android
> 7.0
> > ("Nougat", API 24) - more modern, more relevant.
> >
> > This test platform was added to support geckoview testing. Tests run in
> the
> > geckoview-based TestRunnerActivity (not Firefox for Android).
> >
> > To reproduce the main elements of this test environment locally:
> >  - build for Android x86 (mozconfig with --target=i686-linux-android)
> >  - 'mach android-emulator' or explicitly 'mach android-emulator --version
> > x86-7.0'
> >  - install the geckoview androidTest apk
> >  - run your test command using --app to specify the geckoview test app,
> > something like 'mach mochitest ... --app=org.mozilla.geckoview.test'
> >
> > Great thanks to the many people who have helped enable this test
> platform,
> > especially :wcosta for help with taskcluster and :jchen for investigating
> > test failures.
> > ___
> > dev-platform mailing list
> > dev-platform@lists.mozilla.org
> > https://lists.mozilla.org/listinfo/dev-platform
> >
>
>
> --
> Ehsan
> ___
> dev-platform mailing list
> dev-platform@lists.mozilla.org
> https://lists.mozilla.org/listinfo/dev-platform
>

On Sat, Nov 3, 2018, 4:01 AM Ehsan Akhgari  wrote:

> Thanks a lot, this is great news!
>
> What's the process model configuration for this testing platform?  Do these
> tests run in single process mode or are they running in some e10s like
> environment?  Is there some documentation that explains what runs in which
> process?
>
> Thanks,
> Ehsan
>
> On Thu, Nov 1, 2018 at 5:44 PM Geoffrey Brown  wrote:
>
> > This week some familiar tier 1 test suites began running on a new test
> > platform labelled "Android 7.0 x86" on treeherder. Only a few test suites
> > are running so far; more are planned.
> >
> > Like the existing "Android 4.2" and "Android 4.3" test platforms, these
> > tests run in an Android emulator running in a docker container (the same
> > Ubuntu-based image used for linux64 tests).  The new platform runs an x86
> > emulator using kvm acceleration, enabling tests to run much, much faster
> > than on the older platforms. As a bonus, the new platform uses Android
> 7.0
> > ("Nougat", API 24) - more modern, more relevant.
> >
> > This test platform was added to support geckoview testing. Tests run in
> the
> > geckoview-based TestRunnerActivity (not Firefox for Android).
> >
> > To reproduce the main elements of this test environment locally:
> >  - build for Android x86 (mozconfig with --target=i686-linux-android)
> >  - 'mach android-emulator' or explicitly 'mach android-emulator --version
> > x86-7.0'
> >  - install the geckoview androidTest apk
> >  - run your test command using --app to specify the geckoview test app,
> > something like 'mach mochitest ... --app=org.mozilla.geckoview.test'
> >
> > Great thanks to the many people who have helped enable this test
> platform,
> > especially :wcosta for help with taskcluster and :jchen for investigating
> > test failures.
> > ___
> > dev-platform mailing list
> > dev-platform@lists.mozilla.org
> > https://lists.mozilla.org/listinfo/dev-platform
> >
>
>
> --
> Ehsan
> ___
> dev-platform mailing list
> dev-platform@lists.mozilla.org
> https://lists.mozilla.org/listinfo/dev-platform
>
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform


Re: Announcing new test platform "Android 7.0 x86"

2018-11-02 Thread Ehsan Akhgari
Thanks a lot, this is great news!

What's the process model configuration for this testing platform?  Do these
tests run in single process mode or are they running in some e10s like
environment?  Is there some documentation that explains what runs in which
process?

Thanks,
Ehsan

On Thu, Nov 1, 2018 at 5:44 PM Geoffrey Brown  wrote:

> This week some familiar tier 1 test suites began running on a new test
> platform labelled "Android 7.0 x86" on treeherder. Only a few test suites
> are running so far; more are planned.
>
> Like the existing "Android 4.2" and "Android 4.3" test platforms, these
> tests run in an Android emulator running in a docker container (the same
> Ubuntu-based image used for linux64 tests).  The new platform runs an x86
> emulator using kvm acceleration, enabling tests to run much, much faster
> than on the older platforms. As a bonus, the new platform uses Android 7.0
> ("Nougat", API 24) - more modern, more relevant.
>
> This test platform was added to support geckoview testing. Tests run in the
> geckoview-based TestRunnerActivity (not Firefox for Android).
>
> To reproduce the main elements of this test environment locally:
>  - build for Android x86 (mozconfig with --target=i686-linux-android)
>  - 'mach android-emulator' or explicitly 'mach android-emulator --version
> x86-7.0'
>  - install the geckoview androidTest apk
>  - run your test command using --app to specify the geckoview test app,
> something like 'mach mochitest ... --app=org.mozilla.geckoview.test'
>
> Great thanks to the many people who have helped enable this test platform,
> especially :wcosta for help with taskcluster and :jchen for investigating
> test failures.
> ___
> dev-platform mailing list
> dev-platform@lists.mozilla.org
> https://lists.mozilla.org/listinfo/dev-platform
>


-- 
Ehsan
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform


Re: Announcing new test platform "Android 7.0 x86"

2018-11-02 Thread Kartikaya Gupta
I'm also excited to see this up and running, as it will probably be
quite useful with testing webrender on android. Thank you!
On Thu, Nov 1, 2018 at 6:40 PM Chris Peterson  wrote:
>
> On 2018-11-01 3:06 PM, Nicholas Alexander wrote:
> >> Like the existing "Android 4.2" and "Android 4.3" test platforms, these
> >> tests run in an Android emulator running in a docker container (the same
> >> Ubuntu-based image used for linux64 tests).  The new platform runs an x86
> >> emulator using kvm acceleration, enabling tests to run much, much faster
> >> than on the older platforms. As a bonus, the new platform uses Android 7.0
> >> ("Nougat", API 24) - more modern, more relevant.
> >>
> > This is incredibly awesome news!  For those not in the know, the reason
> > this is so noteworthy is that most cloud-based hosts don't expose KVM
> > acceleration, since it can be a sec concern.  In particular, AWS doesn't
> > expose KVM to most (all?) instances.  There's an awful lot of plumbing
> > required to get jobs running in different cloud hosts... but here we are.
>
> Our Android test coverage has been sparse in the past because slow ARM
> emulators and devices were a bottleneck. Being able to run Android tests
> on x86 at "desktop speed" means we can greatly improve our test coverage
> on Android!
> ___
> dev-platform mailing list
> dev-platform@lists.mozilla.org
> https://lists.mozilla.org/listinfo/dev-platform
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform


Re: Announcing new test platform "Android 7.0 x86"

2018-11-01 Thread Chris Peterson

On 2018-11-01 3:06 PM, Nicholas Alexander wrote:

Like the existing "Android 4.2" and "Android 4.3" test platforms, these
tests run in an Android emulator running in a docker container (the same
Ubuntu-based image used for linux64 tests).  The new platform runs an x86
emulator using kvm acceleration, enabling tests to run much, much faster
than on the older platforms. As a bonus, the new platform uses Android 7.0
("Nougat", API 24) - more modern, more relevant.


This is incredibly awesome news!  For those not in the know, the reason
this is so noteworthy is that most cloud-based hosts don't expose KVM
acceleration, since it can be a sec concern.  In particular, AWS doesn't
expose KVM to most (all?) instances.  There's an awful lot of plumbing
required to get jobs running in different cloud hosts... but here we are.


Our Android test coverage has been sparse in the past because slow ARM 
emulators and devices were a bottleneck. Being able to run Android tests 
on x86 at "desktop speed" means we can greatly improve our test coverage 
on Android!

___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform


Re: Announcing new test platform "Android 7.0 x86"

2018-11-01 Thread Nicholas Alexander
On Thu, Nov 1, 2018 at 2:44 PM Geoffrey Brown  wrote:

> This week some familiar tier 1 test suites began running on a new test
> platform labelled "Android 7.0 x86" on treeherder. Only a few test suites
> are running so far; more are planned.
>
> Like the existing "Android 4.2" and "Android 4.3" test platforms, these
> tests run in an Android emulator running in a docker container (the same
> Ubuntu-based image used for linux64 tests).  The new platform runs an x86
> emulator using kvm acceleration, enabling tests to run much, much faster
> than on the older platforms. As a bonus, the new platform uses Android 7.0
> ("Nougat", API 24) - more modern, more relevant.
>

This is incredibly awesome news!  For those not in the know, the reason
this is so noteworthy is that most cloud-based hosts don't expose KVM
acceleration, since it can be a sec concern.  In particular, AWS doesn't
expose KVM to most (all?) instances.  There's an awful lot of plumbing
required to get jobs running in different cloud hosts... but here we are.

Bravo to everybody involved!
Nick
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform


Announcing new test platform "Android 7.0 x86"

2018-11-01 Thread Geoffrey Brown
This week some familiar tier 1 test suites began running on a new test
platform labelled "Android 7.0 x86" on treeherder. Only a few test suites
are running so far; more are planned.

Like the existing "Android 4.2" and "Android 4.3" test platforms, these
tests run in an Android emulator running in a docker container (the same
Ubuntu-based image used for linux64 tests).  The new platform runs an x86
emulator using kvm acceleration, enabling tests to run much, much faster
than on the older platforms. As a bonus, the new platform uses Android 7.0
("Nougat", API 24) - more modern, more relevant.

This test platform was added to support geckoview testing. Tests run in the
geckoview-based TestRunnerActivity (not Firefox for Android).

To reproduce the main elements of this test environment locally:
 - build for Android x86 (mozconfig with --target=i686-linux-android)
 - 'mach android-emulator' or explicitly 'mach android-emulator --version
x86-7.0'
 - install the geckoview androidTest apk
 - run your test command using --app to specify the geckoview test app,
something like 'mach mochitest ... --app=org.mozilla.geckoview.test'

Great thanks to the many people who have helped enable this test platform,
especially :wcosta for help with taskcluster and :jchen for investigating
test failures.
___
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform