Nice Rickroll there, Andrew. 😆👍 On Tue, Apr 1, 2025 at 10:42 AM 'Andrew Halberstadt' via dev-platform@mozilla.org <dev-platform@mozilla.org> wrote:
> Welcome to the February/March edition of the Engineering Effectiveness > Newsletter! The Engineering Effectiveness org makes it easy to develop, > test and release Mozilla software at scale. See below for some highlights, > then read on for more detailed info! > Highlights > > - > > A ton of progress has been made planning out the GCP -> Azure migration > <https://www.youtube.com/watch?v=dQw4w9WgXcQ>, putting us in a great > spot to kick the project off in H2. > - > > The Taskcluster team is now officially part of Engineering > Effectiveness. > - > > As highlighted in September, we ran a trial period where the > Taskcluster team would be closer to Release Engineering. The trial > period > has proven to be successful. > - > > The Data Loss Prevention > > <https://hacks.mozilla.org/2025/03/improving-firefox-stability-in-the-enterprise-by-reducing-dll-injection/> > feature reached the 1.0 milestone after getting a green status from QA. > This is a major milestone and DLP is now scheduled to ship in Firefox 138. > - > > Four new language pairs are now live in Firefox Desktop: > - > > en -> zh-Hans (Translations into Simplified Chinese) > - > > en -> ja (Translations into Japanese) > - > > en -> ko (Translations into Korean) > - > > en -> ar (Translations into Arabic) > - > > In Firefox-CI, generic-worker > <https://docs.taskcluster.net/docs/reference/workers/generic-worker> > can now run tasks using the deprecated docker-worker > <https://docs.taskcluster.net/docs/reference/workers/docker-worker> > payload format. This means that the > <https://github.com/taskcluster/taskcluster/pull/7510> last > <https://github.com/taskcluster/taskcluster/pull/7547> features > <https://github.com/taskcluster/taskcluster/pull/7505> are complete > and parity has been achieved, paving the way to update our ancient CI > workers to something modern, performant and secure. > > Contributors > > - > > David Turner contributed a script to scrape symbols for Raspberry Pi OS > <https://bugzilla.mozilla.org/show_bug.cgi?id=1953892> > - > > Ujas Thakkar added a new feature in the backend of Tasckluster: Audit > changes <https://github.com/taskcluster/taskcluster/pull/7419> (like > when a secret is changed). This was a long standing request > <https://github.com/taskcluster/taskcluster/issues/5438>, notably for > security audits. The next step is to implement the UI which Ujas has > already started to implement > <https://github.com/taskcluster/taskcluster/pull/7590>. > > Detailed Project UpdatesBuild System and Mach Environment > > - > > Alexandre Lissy updated mach configure to automatically download > <https://bugzilla.mozilla.org/show_bug.cgi?id=1947388> updates of the > JDK. > - > > Serge Guelton moved product configuration from a shell script to a > key/value configuration file > <https://bugzilla.mozilla.org/show_bug.cgi?id=1943612> as part of > moving away from autoconf-based configure. > > Crash Management > > - > > Alex Franchuk has set up daily ingestion of crash ping > symbolication/signatures into BigQuery, so that you can now access crash > signatures and stack traces in places like Redash. The table is > moz-fx-data-shared-prod.crash_ping_ingest_external.ingest_output, and > may be joined on document_id and submission_timestamp (example > > <https://sql.telemetry.mozilla.org/queries/106396/source?p_channel=release&p_os=%5B%22Android%22%2C%22Windows%22%2C%22Linux%22%2C%22Mac%22%5D> > ). > - > > All nightly and beta pings are ingested, however 10k release pings > per process-type are randomly sampled. > - > > Serge Guelton improved the accuracy of crash reports > <https://bugzilla.mozilla.org/show_bug.cgi?id=1945507> for failures > involving mfbt. > - > > Chris Martin added support for recording > <https://bugzilla.mozilla.org/show_bug.cgi?id=1950364> and analyzing > > <https://github.com/rust-minidump/rust-minidump/commit/e51c87d57808d56e22f8ab812d2c0f4a78fe3e14> > non-fatal errors during minidump generation. > - > > Chris Martin added made it possible for child processes to transfer > their auxiliary vector to the crash generator > <https://bugzilla.mozilla.org/show_bug.cgi?id=1909470>, making > minidump generation more robust on Linux and Android. > - > > Brian Tsoi landed and enabled client-side memory testing > <https://bugzilla.mozilla.org/show_bug.cgi?id=1948349> in the crash > reporter client, this allows the client to detect faulty memory on user > machines. > > Firefox-CI, Taskcluster and Treeherder > > - > > Pete Moore and Matt Boris finished implementing the > <https://github.com/taskcluster/taskcluster/pull/7510> last > <https://github.com/taskcluster/taskcluster/pull/7547> features > <https://github.com/taskcluster/taskcluster/pull/7505> of d2g > (docker-worker to generic-worker). Docker-worker is the oldest type of > worker. While unmaintained for many years, it’s still a central piece of > the Firefox CI instance, powering literally all tasks that can run in a > Linux container. > - > > Julien Cristau started to test d2g against Firefox tests. > - > > Ben Hearsum is using some of the new features in Firefox > Translations <https://github.com/mozilla/translations/pull/700>. > - > > Yarik greatly improved Taskcluster’s ability to manage various launch > configs <https://github.com/taskcluster/taskcluster/pull/7266> within > a worker pool. This prevents pools with broken configurations or within a > datacenter experiencing an outage from picking up tasks > > <https://github.com/taskcluster/taskcluster-rfcs/blob/main/rfcs/0191-worker-manager-launch-configs.md> > . > - > > Andrew Halberstadt created a Looker board > <https://mozilla.cloud.looker.com/boards/156> for the Firefox-CI ETL, > which includes a new dashboard > <https://mozilla.cloud.looker.com/dashboards/2174> tracking some basic > metrics over time. > - > > Joel Maher has finished migrating windows 11 tests > <https://bugzilla.mozilla.org/show_bug.cgi?id=1936396> from Oct 2022 > update to Oct 2024 update > - > > Sheriffs, Sebastian Hengst and Joel Maher have migrated MacOSX tests > from 10.15 to 14.70. A small subset still runs on version 10.15 for > compatibility testing. > > OS Integration and Security > > - > > David Parks and Greg Stoll pushed our Data Loss Prevention > > <https://hacks.mozilla.org/2025/03/improving-firefox-stability-in-the-enterprise-by-reducing-dll-injection/> > (DLP) project to reach the 1.0 milestone with green status from QA. This is > a major milestone and DLP is now scheduled to ship in Firefox 138. > > PDF.js > > - > > Calixte implemented the ability to sign PDFs, with the option of > saving signatures for later use. > - > > - > > Ujjwal Sharma implemented automatically identifying URLs in PDFs that > are not marked as URLs, fixing an 11 year old bug > <https://bugzilla.mozilla.org/show_bug.cgi?id=1019475>. > - > > Nicolò Ribaudo added support for rendering high-resolution partial > page views <https://github.com/mozilla/pdf.js/pull/19128>. PDF.js was > previously falling back to CSS zoom for high zoom levels, with very > blurry rendering <https://bugzilla.mozilla.org/show_bug.cgi?id=1492303>. > Sometimes, rendering was even failing completely because of too large > canvas sizes <https://bugzilla.mozilla.org/show_bug.cgi?id=1713266>. > - > > This work fixed two long standing bugs (7 years old and 4 years > old) with dozens of duplicates across GitHub and Bugzilla. > - > > Calixte added support for color management through ICC profiles > <https://github.com/mozilla/pdf.js/pull/19620> by compiling Mozilla's qcms > <https://github.com/FirefoxGraphics/qcms>library into WASM. This was a 12 > year old request <https://bugzilla.mozilla.org/show_bug.cgi?id=860023>. > > Firefox Translations > > - > > Evgeny Pavlov has successfully trained four models that are now > released in Firefox Desktop. > - > > en -> zh-Hans (Translations into Simplified Chinese) > - > > en -> ja (Translations into Japanese) > - > > en -> ko (Translations into Korean) > - > > en -> ar (Translations into Arabic) > - > > Greg Tatum built out a model registry page for all of our trained > models to make it easier to retrain models and track assets. > - > > Greg Tatum updated the graph > > <https://docs.google.com/presentation/d/1HkypImI_hbA3n1ljU57ZPAzW8PuQqdv2wrXqj688KtQ/edit?slide=id.p#slide=id.p> > describing the training pipeline with new documentation > - > > Greg Tatum has been working on simplifying the pipeline for > re-training languages to make the pipeline more robust, easier to use, and > to have less waste by re-using existing assets. Pictured here is the same > graph as above, but with just training a new student model, reducing > training costs by 10x in some cases. > - > > Greg Tatum landed new language identification rules > <https://bugzilla.mozilla.org/show_bug.cgi?id=1859081> to reduce the > amount of false positives to offer a translation. These popups can be > disruptive for users, so we now only offer translations when we are > positive that the language is correct. > - > > Erik Nordin added documentation > <https://bugzilla.mozilla.org/show_bug.cgi?id=1941657> on running > Translations end-to-end and performance tests. > - > > Erik Nordin fixed an issue > <https://bugzilla.mozilla.org/show_bug.cgi?id=1946964> that > temporarily broke Translations in Nightly after migrating the > TranslationsEngine from using JSWindowActors to instead use > JSProcessActors. > - > > Erik Nordin fixed several of the highest-frequency intermittent test > failures within the Translations test suite bug 1946901 > <https://bugzilla.mozilla.org/show_bug.cgi?id=1946901>, bug 1943516 > <https://bugzilla.mozilla.org/show_bug.cgi?id=1943516> and bug 1917161 > <https://bugzilla.mozilla.org/show_bug.cgi?id=1917161>. > - > > Erik Nordin modified the Translations performance tests > <https://bugzilla.mozilla.org/show_bug.cgi?id=1947840> to track both > the peak memory usage as well as the stabilized memory usage within the > Inference Process. > - > > Erik Nordin made it possible > <https://bugzilla.mozilla.org/show_bug.cgi?id=1954789> to live-upgrade > models from a shared-vocab format to a split-vocab format in Firefox > without breaking Translations for users. > - > > Erik Nordin implemented > <https://bugzilla.mozilla.org/show_bug.cgi?id=1947431> JavaScript > DecompressionStream > <https://developer.mozilla.org/en-US/docs/Web/API/DecompressionStream> > API for the Zstandard <https://facebook.github.io/zstd/> format, > available within privileged contexts in Firefox. The speed of Zstandard > decompression is drastically faster than the other supported formats, and > will allow us to migrate the Translations ecosystem to decompress models on > the fly, reducing download sizes and times, as well as reducing required > on-device storage for models at virtually no impact to felt user > performance. > > > - > > Erik Nordin designed an Outreachy <https://www.outreachy.org/> > internship project that will help us migrate all of our models to the > zstandard compression format, and is actively searching for an intern to > help with the work. > > Power use > > - > > Nika Layzell, Greg Stoll and others on OS Integration helped reduce > energy use and improve battery > <https://bugzilla.mozilla.org/show_bug.cgi?id=1895985#c10> life on > Apple Silicon laptops by moving background tabs to energy efficient > cores <https://bugzilla.mozilla.org/show_bug.cgi?id=1895985>. > > Phabricator , moz-phab, and Lando > > - > > Connor Sheehan made Lando autoformatting use mach format after Gijs > landed changes to enable formatting-only updates > <https://bugzilla.mozilla.org/show_bug.cgi?id=1949576> in the ESlint > linter. > - > > Connor Sheehan merged all the changes from production Lando into the > new Lando. > - > > Zeid transitioned all Mercurial repositories (except try) to the new > Lando. > > Release Engineering and Release Management > > - > > Gabriel Bustamante landed the patches to start shipping Linux/ARM64 > builds on Firefox 136. > - > > This received some positive press > <https://www.theregister.com/2025/03/04/firefox_136/> from The > Register > - > > Heitor Neiva has expired old Firefox partials > <https://bugzilla.mozilla.org/show_bug.cgi?id=1929964> (specifically > versions prior to 100.0). Approximately 1.6 million files were removed from > our archive, freeing up around 17.9 TBs of cloud storage. > - > > Bastien Orivel semi-automatically uploaded Fenix 137 to the Samsung > Galaxy Store. After many years of manual uploads, Bastien is getting the > publication there automated. > - > > Next steps are to work through the remaining errors and integrate > the Taskcluster task in release promotion. > - > > Pascal updated whattrainisitnow.com to reflect our extended support of > ESR 115 until September and created new API endpoints for the webcompat > team. > - > > Release Management shipped 2 major releases (Fx135 & Fx136) and 6 dot > releases, including a chemspill and 2 dot releases to respond to major > webcompat incidents. > - > > 136.0.3 was released to address a webcompat incident. It shipped > during Fx137 RC week, requiring additional work to delay the Fx137 merge > day. > - > > 136.04, 128,9.1, and 11.21.1 were chemspill releases. The time from > having a reviewed patch to a 100% rollout release was ~19 hours. > > Version Control > > - > > Julien Cristau and Connor Sheehan put up a Web Application Firewall to > protect hg.mozilla.org from DDOS attacks. > > Mercurial to Git project > > - > > The repository location has been decided: > https://github.com/mozilla-firefox/firefox > - > > https://github.com/mozilla/firefox redirects to > mozilla-firefox/firefox > - > > While the repository exists, it is currently empty and is not > guaranteed to produce a runnable Firefox. However, the code is > guaranteed > to be bug free! > - > > The new version of Lando, which brings multiple improvements in > addition to Git landing support, has a new memorable home and is now live: > https://lando.moz.tools/ > - > > Project status: Firefox Git Migration Update > > <https://docs.google.com/document/d/1tNAhM6jnHwP14wrLr0-A44GR8mOP_fFnbXqefPGVcbQ> > - > > Project roadmap > > <https://mozilla-hub.atlassian.net/jira/plans/1292/scenarios/1294/timeline?vid=2279> > > > Thanks for reading and see you in two months! > > -- > You received this message because you are subscribed to the Google Groups " > dev-platform@mozilla.org" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to dev-platform+unsubscr...@mozilla.org. > To view this discussion visit > https://groups.google.com/a/mozilla.org/d/msgid/dev-platform/CAAJAz%2B7LesYmQ4iFxzBfJNCOSh2W6e48DxOrwTfWb-82Rq3xEw%40mail.gmail.com > <https://groups.google.com/a/mozilla.org/d/msgid/dev-platform/CAAJAz%2B7LesYmQ4iFxzBfJNCOSh2W6e48DxOrwTfWb-82Rq3xEw%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > -- *Bob Hood *(he/him) ・ Media and Graphics Engineering Manager, Mozilla Corporation *bh...@mozilla.com <bh...@mozilla.com> ・ Slack: @Bob ・ cell/text: +1-719-625-2373 <+1-719-625-2373>* -- You received this message because you are subscribed to the Google Groups "dev-platform@mozilla.org" group. To unsubscribe from this group and stop receiving emails from it, send an email to dev-platform+unsubscr...@mozilla.org. To view this discussion visit https://groups.google.com/a/mozilla.org/d/msgid/dev-platform/CAMYHb4Be05MM1y46EhfHx5j4YUPjZx-ponpmWEoDz7NX-s%2Bk4g%40mail.gmail.com.
