Deploying more robust hg-git replication for gecko

2013-08-30 Thread John O'Duinn
(cross-posting to make sure this is not missed; please respond in dev-planning or bug#847727) tl,dr: we're moving replication of gecko+gaia repos to more robust systems. This email gives quick status, and summary of rollout plan. In the rush to B2G 1.0 release, we had to quickly stand up r

Re: Getting the current release version

2013-08-30 Thread Mike Hommey
On Fri, Aug 30, 2013 at 03:16:27PM +0100, Ed Morley wrote: > On 30 August 2013 15:14:54, Ed Morley wrote: > >For platform: > >https://hg.mozilla.org/releases/mozilla-release/file/tip/config/milestone.txt > > > >For Firefox (and yeah currently the same as platform): > >https://hg.mozilla.org/release

Re: Proposal: Removing make targets for running tests

2013-08-30 Thread Gregory Szorc
On 8/30/13 5:03 PM, ISHIKAWA,chiaki wrote: (2013/08/31 6:16), Joshua Cranmer 🐧 wrote: On 8/30/2013 3:59 PM, Gregory Szorc wrote: Aside from obvious "I don't want to change" complaints, are there any objections to this change? Is anyone not able to run the mach testing commands today? Are there

Re: Proposal: Removing make targets for running tests

2013-08-30 Thread ISHIKAWA,chiaki
(2013/08/31 6:16), Joshua Cranmer 🐧 wrote: On 8/30/2013 3:59 PM, Gregory Szorc wrote: Aside from obvious "I don't want to change" complaints, are there any objections to this change? Is anyone not able to run the mach testing commands today? Are there features missing from the mach commands? P

Re: How to debug Gecko on Linux?

2013-08-30 Thread Neil
Steve Fink wrote: On Mon 19 Aug 2013 01:15:51 PM PDT, Neil wrote: Does Linux have a debugging story? On Windows x86 I can happily let the application run and when it crashes I click Debug and WinDbg is launched for me, and I can inspect the crash state and possibly fix things up and resume

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Jed Davis
On Fri, Aug 30, 2013 at 10:58:25AM +0200, Julian Seward wrote: > What we have works, but is less than ideal in a number of ways: > > (1) It's slow. CFI/EXIDX unwinding with Breakpad costs about 6600 > instructions/frame, or around 120+K/instructions per stack trace. > That makes it infeas

Re: Proposal: Removing make targets for running tests

2013-08-30 Thread Joshua Cranmer 🐧
On 8/30/2013 3:59 PM, Gregory Szorc wrote: Aside from obvious "I don't want to change" complaints, are there any objections to this change? Is anyone not able to run the mach testing commands today? Are there features missing from the mach commands? Please file bugs! Mach and comm-central do

Proposal: Removing make targets for running tests

2013-08-30 Thread Gregory Szorc
tl;dr the tree currently allows you to run tests via make targets and mach. The mach commands are more intuitive and easier to support going forward, so I'm proposing we remove support for using make targets to run tests. Please take the survey at http://www.surveymonkey.com/s/H5LB2GF to respon

Refcounting threadsafety assertions are now fatal in opt builds.

2013-08-30 Thread Kyle Huey
The assertions that we have to catch refcounting objects on the wrong thread are now fatal in opt builds. This change is scoped to the nightly channel to avoid performance penalties on builds that are widely used, and will not propagate to aurora. See bug 907914 for more details. The motivation

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Adam Roach
On 8/30/13 13:41, Anne van Kesteren wrote: Where did the text file come from? There's a source somewhere... And these days that's hardly how people create content anyway. Maybe not for the content _you_ consume, but the Internet is a bit larger than our ivory tower. Check out, for example:

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Mike Hoye
On 2013-08-30 3:17 PM, Adam Roach wrote: On 8/30/13 14:11, Adam Roach wrote: ...helping the user understand why the headline they're trying to read renders as "Ð' Ð"оÑ?дÑfме пÑEURедложили оÑ,обÑEURаÑ,ÑOE "Ð?обелÑ?" Ñf Ðz(бамÑ< " rather than "? ??? ?? ???

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Adam Roach
On 8/30/13 12:24, Mike Hoye wrote: On 2013-08-30 11:17 AM, Adam Roach wrote: It seems to me that there's an important balance here between (a) letting developers discover their configuration error and (b) allowing users to render misconfigured content without specialized knowledge. For what

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Adam Roach
On 8/30/13 14:11, Adam Roach wrote: ...helping the user understand why the headline they're trying to read renders as "Ð' Ð"оÑ?дÑfме пÑEURедложили оÑ,обÑEURаÑ,ÑOE "Ð?обелÑ?" Ñf Ðz(бамÑ< " rather than "? ??? ?? "??" ? ?". Well, *there's* a h

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Anne van Kesteren
On Fri, Aug 30, 2013 at 7:33 PM, Joshua Cranmer 🐧 wrote: > The problem I have with this approach is that it assumes that the page is > authored by someone who definitively knows the charset, which is not a > scenario which universally holds. Suppose you have a page that serves up the > contents of

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Joshua Cranmer 🐧
On 8/30/2013 4:01 AM, Anne van Kesteren wrote: On Fri, Aug 30, 2013 at 9:40 AM, Gervase Markham wrote: We don't want people to try and move to UTF-8, but move back because they haven't figured out how (or are technically unable) to label it correctly and "it comes out all wrong". You also don'

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Steve Fink
On 08/30/2013 06:27 AM, Nathan Froyd wrote: > - Original Message - >> On 08/30/2013 11:07 AM, Robert O'Callahan wrote: >>> Being able to sample uniformly whether or not the thread is in a syscall is >>> important sometimes, so let's not lose that. >> I am not proposing to lose that facility

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Anne van Kesteren
On Fri, Aug 30, 2013 at 6:31 PM, Chris Peterson wrote: > Is there a less error-prone default we can recommend to Linux distribution > packagers? Maybe we can squelch the problem upstream instead of adding > browser hacks. The number of web server and distro packagers we would need > to reach out t

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Chris Peterson
On 8/30/13 3:03 AM, Henri Sivonen wrote: Telemetry data suggests that these days the more common reason for seeing mojibake is that there is an encoding declaration but it is wrong. My guess is that this arises from Linux distributions silently changing their Apache defaults to send a charset pa

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Mike Hoye
On 2013-08-30 11:17 AM, Adam Roach wrote: It seems to me that there's an important balance here between (a) letting developers discover their configuration error and (b) allowing users to render misconfigured content without specialized knowledge. For what it's worth Internet Explorer handled

Re: Getting the current release version

2013-08-30 Thread Reuben Morais
On Aug 30, 2013, at 1:35 PM, Eric Shepherd wrote: > On 2013-08-30 16:13:50 +, Jesper Kristensen said: > >> I use http://svn.mozilla.org/libs/product-details/json/firefox_versions.json >> I use that because that was what the download button on www.mozilla.org did. >> I don't know if the downl

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Ehsan Akhgari
On 2013-08-30 11:07 AM, Nathan Froyd wrote: - Original Message - Nevermind, I think your solution is talking about function addresses, not stack frames. If you think my solution is talking about function addresses, then I have explained something poorly. Why do you think it is talkin

Re: Getting the current release version

2013-08-30 Thread Eric Shepherd
On 2013-08-30 16:13:50 +, Jesper Kristensen said: I use http://svn.mozilla.org/libs/product-details/json/firefox_versions.json I use that because that was what the download button on www.mozilla.org did. I don't know if the download button still uses that resource. This is an interesting

Re: Getting the current release version

2013-08-30 Thread Robert Helmer
On Fri, Aug 30, 2013 at 10:07 AM, Gregory Szorc wrote: > On 8/30/13 7:09 AM, Eric Shepherd wrote: > >> This is sort-of-kind-of platform related, but only indirectly, so let me >> know if there's a better place to ask this question, please. >> >> If a web page needs to be able to display the curre

Re: Getting the current release version

2013-08-30 Thread Wil Clouser
On Fri, Aug 30, 2013 at 01:45:51PM -0300, Reuben Morais wrote: > On Aug 30, 2013, at 1:35 PM, Eric Shepherd wrote: > > On 2013-08-30 16:13:50 +, Jesper Kristensen said: > > > >> I use > >> http://svn.mozilla.org/libs/product-details/json/firefox_versions.json > >> I use that because that was

Re: Getting the current release version

2013-08-30 Thread Gregory Szorc
On 8/30/13 7:09 AM, Eric Shepherd wrote: This is sort-of-kind-of platform related, but only indirectly, so let me know if there's a better place to ask this question, please. If a web page needs to be able to display the current release version of Gecko, is there a place we can pull that informa

Re: Getting the current release version

2013-08-30 Thread Eric Shepherd
On 2013-08-30 16:01:21 +, Axel Hecht said: This is going to be off by one release for one week out of 6, though. We're doing the beta-release migration at release minus a week and a day, i.e., we're migrating on Sept 9, and release on Sept 17: https://mail.mozilla.com/home/ake...@mozilla

Re: Getting the current release version

2013-08-30 Thread Bhavana Bajaj
Hey all, product-details on svn would be the right place to that information. Release Management updates these every time we have a new version out for Desktop/Mobile across all release channels - Aurora,Beta,Release(including dot release :) ). Here is the wiki with details on exact changes we

Re: Getting the current release version

2013-08-30 Thread Jesper Kristensen
I use http://svn.mozilla.org/libs/product-details/json/firefox_versions.json I use that because that was what the download button on www.mozilla.org did. I don't know if the download button still uses that resource. Den 30-08-2013 16:09Eric Shepherd skrev: This is sort-of-kind-of platform rel

Re: Getting the current release version

2013-08-30 Thread Axel Hecht
On 8/30/13 4:14 PM, Ed Morley wrote: On 30 August 2013 15:09:08, Eric Shepherd wrote: This could even be a place in the source code we could pull up a MXR link and peel out of the code. I just don't know where in the code to get it. For platform: https://hg.mozilla.org/releases/mozilla-release

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Adam Roach
On 8/30/13 05:08, Nicholas Nethercote wrote: On Fri, Aug 30, 2013 at 8:03 PM, Henri Sivonen wrote: I think we should encourage Web authors to use UTF-8 *and* to *declare* it. I'm no expert on this stuff, but Henri's point sure sound sensible to me. It seems to me that there's an important

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Nathan Froyd
- Original Message - > Nevermind, I think your solution is talking about function addresses, > not stack frames. If you think my solution is talking about function addresses, then I have explained something poorly. Why do you think it is talking about function addresses? -Nathan __

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Ehsan Akhgari
On 2013-08-30 10:16 AM, Nathan Froyd wrote: - Original Message - Depending on how deep the call stack is and how frequently we push and pop stack frames, being able to not unwind some number of frames can be a significant savings. Isn't this assuming that the stack frames are unique? H

Re: Getting the current release version

2013-08-30 Thread Eric Shepherd
On 2013-08-30 14:14:54 +, Ed Morley said: For platform: https://hg.mozilla.org/releases/mozilla-release/file/tip/config/milestone.txt For Firefox (and yeah currently the same as platform): https://hg.mozilla.org/releases/mozilla-release/file/tip/browser/config/version.txt This is exact

Re: Getting the current release version

2013-08-30 Thread Ed Morley
On 30 August 2013 15:14:54, Ed Morley wrote: For platform: https://hg.mozilla.org/releases/mozilla-release/file/tip/config/milestone.txt For Firefox (and yeah currently the same as platform): https://hg.mozilla.org/releases/mozilla-release/file/tip/browser/config/version.txt (Although you'll w

Re: Getting the current release version

2013-08-30 Thread Johnathan Nightingale
(I like Ed's answer more, though) On Aug 30, 2013, at 10:17 AM, Johnathan Nightingale wrote: > I don't know if it will serve your purposes, but wiki.mo does have: > > https://wiki.mozilla.org/Template:CURRENT_VERSION > > and derivatives: > > https://wiki.mozilla.org/Template:BETA_VERSION > htt

Re: Getting the current release version

2013-08-30 Thread Johnathan Nightingale
I don't know if it will serve your purposes, but wiki.mo does have: https://wiki.mozilla.org/Template:CURRENT_VERSION and derivatives: https://wiki.mozilla.org/Template:BETA_VERSION https://wiki.mozilla.org/Template:AURORA_VERSION https://wiki.mozilla.org/Template:CENTRAL_VERSION Doesn't do poi

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Nathan Froyd
- Original Message - > > Depending on how deep the call stack is and how frequently we push and pop > > stack frames, being able to not unwind some number of frames can be a > > significant savings. > > Isn't this assuming that the stack frames are unique? How would you handle > recursion

Re: Getting the current release version

2013-08-30 Thread Ed Morley
On 30 August 2013 15:09:08, Eric Shepherd wrote: This could even be a place in the source code we could pull up a MXR link and peel out of the code. I just don't know where in the code to get it. For platform: https://hg.mozilla.org/releases/mozilla-release/file/tip/config/milestone.txt For Fi

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Henri Sivonen
On Fri, Aug 30, 2013 at 4:31 PM, Aryeh Gregor wrote: > In particular, you need to decide on the encoding before you start > running any user script, because you don't want document.characterSet > etc. to change once it might have already been accessed. For > performance reasons, we want to be abl

Getting the current release version

2013-08-30 Thread Eric Shepherd
This is sort-of-kind-of platform related, but only indirectly, so let me know if there's a better place to ask this question, please. If a web page needs to be able to display the current release version of Gecko, is there a place we can pull that information from, so that the content doesn't

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Ehsan Akhgari
On Fri, Aug 30, 2013 at 9:27 AM, Nathan Froyd wrote: > - Original Message - > > On 08/30/2013 11:07 AM, Robert O'Callahan wrote: > > > Being able to sample uniformly whether or not the thread is in a > syscall is > > > important sometimes, so let's not lose that. > > > > I am not proposin

Re: In 2 hours, our virtual doc sprint starts!

2013-08-30 Thread Eric Shepherd
On 2013-08-30 13:07:14 +, Jean-Yves Perrier said: You didn't forget our monthly Virtual Doc Sprint starting in about 2 hours in #devmo! Even if late, join us! https://wiki.mozilla.org/MDN/Doc_sprints/2013August Ping us on #devmo for anything. And if you don't "write English", please con

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Aryeh Gregor
On Fri, Aug 30, 2013 at 1:03 PM, Henri Sivonen wrote: > This is true if you run the heuristic over the entire byte stream. > Unfortunately, since we support incremental loading of HTML (and will > have to continue to do so), we don't have the entire byte stream > available at the time when we nee

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Nathan Froyd
- Original Message - > On 08/30/2013 11:07 AM, Robert O'Callahan wrote: > > Being able to sample uniformly whether or not the thread is in a syscall is > > important sometimes, so let's not lose that. > > I am not proposing to lose that facility. Am only proposing (really, > merely parrot

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Jeff Muizelaar
On 2013-08-30, at 4:58 AM, Julian Seward wrote: > I am very tempted to create a new custom unwind library designed > specifically to support SPS. It needs to be fast, lower-footprint, > and multithreaded. Unlike Breakpad, it will -- at least initially -- > avoid supporting all Tier 1 targets, a

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Nicholas Nethercote
On Fri, Aug 30, 2013 at 8:03 PM, Henri Sivonen wrote: > > I think we should encourage Web authors to use UTF-8 *and* to *declare* it. I'm no expert on this stuff, but Henri's point sure sound sensible to me. Nick ___ dev-platform mailing list dev-plat

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Henri Sivonen
On Thu, Aug 29, 2013 at 9:41 PM, Zack Weinberg wrote: > All the discussion of fallback character encodings has reminded me of an > issue I've been meaning to bring up for some time: As a user of the en-US > localization, nowadays the overwhelmingly most common situation where I see > mojibake is w

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Robert O'Callahan
On Fri, Aug 30, 2013 at 9:41 PM, Julian Seward wrote: > That said, AFAICS the core problem is that once a thread blocks and we drop > the sampling rate, we have no obvious (direct, notification-based) way to > know when it has resumed, and hence are in danger of losing high-frequency > samples in

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Julian Seward
On 08/30/2013 11:07 AM, Robert O'Callahan wrote: > Being able to sample uniformly whether or not the thread is in a syscall is > important sometimes, so let's not lose that. I am not proposing to lose that facility. Am only proposing (really, merely parroting Taras' suggestion) that it would be n

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Robert O'Callahan
On Fri, Aug 30, 2013 at 8:58 PM, Julian Seward wrote: > I am not sure how to deal with (4). Really it's completely unrelated > to the unwind mechanism -- it has to do with SPS' sampling policy at > the level above. There have been some ideas floated around to detect > when a thread is in a sysc

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Anne van Kesteren
On Fri, Aug 30, 2013 at 9:40 AM, Gervase Markham wrote: > We don't want people to try and move to UTF-8, but move back because > they haven't figured out how (or are technically unable) to label it > correctly and "it comes out all wrong". You also don't want it to be wrong half of the time. Give

Should we build a new in-process unwind library?

2013-08-30 Thread Julian Seward
For a while now, Fennec and Linux-desktop nightlies have had the built-in SPS-based time profiling using native stack unwinding. The unwinding is done using our in-tree Breakpad copy, which includes a bunch of speedup patches that are slowly making their way upstream. What we have works, but is

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Gervase Markham
On 29/08/13 19:41, Zack Weinberg wrote: > All the discussion of fallback character encodings has reminded me of an > issue I've been meaning to bring up for some time: As a user of the > en-US localization, nowadays the overwhelmingly most common situation > where I see mojibake is when a site puts