On Wed, Nov 16, 2016 at 12:27 AM, <lgrat...@gmail.com> wrote: > I'm a developer on the Microsoft Visual C++ compiler (code optimizer) and I'm > looking into extending our test suite with popular open-source projects. This > helps us to find bugs earlier, ensuring that these projects are not broken > by frontend or backend changes. It also helps the projects themselves, by > making upgrades to the never compiler easier - ideally without any problems.
Hi. Exciting that you're trying out our code! > 1. What is the latest version of Visual Studio that should be used? I tried > first VS2015 Update 3 and there seems to be a C++ error about "constexpr". > Next I tried Update 2 and that one finishes the build. The current release source builds with VS2015 update 2. We're building the development tree with VS2015 update 3. We have a 12-week stabilization period for each release branch, but the main development tree should always compile, although there may be occasional test failures. You might consider using that for easier communication with our developers and quicker testing of new C++ features. That code is available form https://github.com/mozilla/gecko-dev or https://hg.mozilla.org/mozilla-central > 2. What are the tests that should be run to test correctness? The idea here > is to ensure that new optimizations don't introduce new bugs, which should be > exposed by new test failures in Firefox. I looked over the QA Automated > testing page and there seem to be a lot of different test suites - running > all is probably not feasible. Is there a subset that is run when a checkin is > done, for example? Tests expected to fail should be marked so in the tree, so as long as you use the mach test harness, that should be fine. There are intermittents and some environment/driver-dependent issues though. I'm not an expert on our testing, especially on Windows, but I'd start with gtest, check-spidermonkey, mochitest and crashtest. reftests can be brittle. You can see the currently passing tests at https://treeherder.mozilla.org/#/jobs?repo=mozilla-release or https://treeherder.mozilla.org/#/jobs?repo=mozilla-central for the current development tree. > 3. What Windows OS do you use for testing? Window 10, Windows 8, etc? Any > other configuration work needed, such as disabling the antivirus/firewall? We build on Windows 8, Windows XP (possibly actually NT 2008?) and Windows 2012 aws images. Look for `B` jobs on the treeherder site linked above. Once you have a copy of the source and the build environment, no network access should be necessary. Hope that helps, and thanks for your interest in Firefox! Cheers, -r _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
