Re: e10s is now enabled by default for Nightly!
On Friday, November 7, 2014 4:39:28 PM UTC-6, Gijs Kruitbosch wrote: Are we currently planning to let this default ride into aurora in 2 weeks' time? ~ Gijs Lots of bugs to fix before we roll out. We're currently finishing up milestone 4 bugs. m5/m6 block rollout to aurora, m7/m8 block rollout to beta. We triage new bugs twice a week so we'll be adding / adjusting these lists over time since m7/m8 are still largely unfilled. If you have free time, or just run into something that bugs you that we don't have as a priority, please dive in and try to fix it. Everyone should start familiarizing themselves with the idiosyncrasies of debugging three processes at once, it'll be the norm this spring. (..and just you wait until we turn on process-per-domain!) M4 bugs: http://is.gd/XKZkQ5 M5 bugs: http://is.gd/7MuzQK M6 bugs: http://is.gd/yOVr9r (aurora uplift when completed) M7 bugs: http://is.gd/ckXKll M8 bugs: http://is.gd/jUNCg5 Jim ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Re: e10s is now enabled by default for Nightly!
On 11/6/2014 7:27 PM, Chris Peterson wrote: The patch is on mozilla-inbound and ought to hit mozilla-central in time for tomorrow's Nightly build. \o/ https://hg.mozilla.org/integration/mozilla-inbound/rev/a75897e664dd e10s will not ride the trains to Aurora 36. Talos and unit tests will continue to run for e10s and non-e10s until e10s hits the Release channel. Some known problems: * IME and a11y will disable e10s until support is completed * Some performance problems with Adblock Plus * Bug 947030 - Ghostery add-on does not block trackers * Bug 972507 - BugzillaJS add-on does not work [1] * Bug 1008768 - LastPass add-on does not fill in form fields * Bug 1014986 - HTTPS Everywhere add-on breaks HTTP redirects * Bug 1042680 - Tree Style Tabs add-on does not work * Bug 1042195 - 1Password add-on does not work * Bug 1058542 - NoScript add-on does not work * Bug 1093161 - Searching from address bar does not work the first time Bug 1067042 - [e10s]bookmarking an e10s tab results in a blank name ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Re: e10s is now enabled by default for Nightly!
On Sun, Nov 9, 2014 at 12:29 AM, jmath...@mozilla.com wrote: Everyone should start familiarizing themselves with the idiosyncrasies of debugging three processes at once, it'll be the norm this spring. Three? I've only seen two... (..and just you wait until we turn on process-per-domain!) Let's have some conversations about memory consumption before doing that, please :) Nick ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Re: e10s is now enabled by default for Nightly!
On Sun, Nov 09, 2014 at 08:03:44AM +1100, Nicholas Nethercote wrote: On Sun, Nov 9, 2014 at 12:29 AM, jmath...@mozilla.com wrote: Everyone should start familiarizing themselves with the idiosyncrasies of debugging three processes at once, it'll be the norm this spring. Three? I've only seen two... (..and just you wait until we turn on process-per-domain!) Let's have some conversations about memory consumption before doing that, please :) BTW, does AWSY deal with e10s? Mike ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Re: e10s is now enabled by default for Nightly!
On 11/8/14 1:03 PM, Nicholas Nethercote wrote: On Sun, Nov 9, 2014 at 12:29 AM, jmath...@mozilla.com wrote: Everyone should start familiarizing themselves with the idiosyncrasies of debugging three processes at once, it'll be the norm this spring. Three? I've only seen two... Chrome, Content, Plugin(s). Justin ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Re: Intent to ship: Web Speech API - Speech Recognition with Pocketsphinx
Thanks Nick, I appreciate your help. I created two versions of Fennec apk: one [1] with the english models bundled (43.7 mb), and other [2] without it (34.6mb). This was the mozconfig I used [3] Actually, I had a conversation with Jonas Sicking some months ago and we agreed that the ideal scenario about this is to allow the user to download the package for the language he prefer from some sort of preferences screen, instead ship them bundled into the apk. [1] https://www.dropbox.com/s/6snv6e3mqqcs4zi/fennec-34.0a1.en-US.android-arm.apk?dl=0 [2] https://www.dropbox.com/s/zxxop34unj21r1s/fennec-35.0a1.en-US.android-arm.apk?dl=0 [3] #DEBUG #ac_add_options --enable-debug #ac_add_options --enable-trace-malloc #ac_add_options --enable-accessibility #ac_add_options --enable-signmar ac_add_options --disable-tests # android options ac_add_options --enable-application=mobile/android ac_add_options --with-android-ndk=/Volumes/extra/android-ndk-r8e/ ac_add_options --with-android-sdk=/Volumes/extra/android-sdk-macosx/platforms/android-19/ # FOR ARM ac_add_options --target=arm-linux-androideabi mk_add_options MOZ_OBJDIR=./obj-arm-linux-androideabi-debug # FOR 386 #ac_add_options --target=i386-linux-android #mk_add_options MOZ_OBJDIR=./objdir-droid-i386 On Thu, Oct 30, 2014 at 9:36 PM, Nick Alexander nalexan...@mozilla.com wrote: On 2014-10-30, 4:18 PM, Andre Natal wrote: I've been researching speech recognition in Firefox for two years. First SpeechRTC, then emscripten, and now Web Speech API with CMU pocketsphinx [1] embedded in Gecko C++ layer, project that I had the luck to develop for Google Summer of Code with the mentoring of Olli Pettay, Guilherme Gonçalves, Steven Lee, Randell Jesup plus others and with the management of Sandip Kamat. The implementation already works in B2G, Fennec and all FF desktop versions, and the first language supported will be english. The API and implementation are in conformity with W3C standard [2]. The preference to enable it is: media.webspeech.service.default = pocketsphinx First, Andre, let me offer my congratulations on getting this project to this point. We've talked a few times and I've always been impressed. Can you point me at Fennec try builds? I vaguely recall that these speech recognition approaches require large pattern matching files, and I'd like to see what including the Speech API does to the Fennec APK size. We're pushing pretty hard on reducing our APK size right now because we believe it's a big barrier to entry and especially to upgrading older devices. Nick ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Re: Intent to ship: Web Speech API - Speech Recognition with Pocketsphinx
Hi Olli, How much does Pocketsphinx increase binary size? or download size? In the past was suggested to avoid ship the models with packages, but yes to create a preferences panel in the apps to allow the user to download the models he wants to. About the size of pocketsphinx libraries itself, in mac os, they sum ~ 2.3 mb [1]. I don't know which type of compression the build system does when compiling/packaging, but should be efficient enough. [1] MacBook-Air-de-AndreNatal:gecko-dev andrenatal$ ls -lsa /usr/local/lib/libsphinxbase.a 2184 -rw-r--r-- 1 root admin 1114840 Jul 7 14:39 /usr/local/lib/libsphinxbase.a MacBook-Air-de-AndreNatal:gecko-dev andrenatal$ ls -lsa /usr/local/lib/libpocketsphinx.a 2352 -rw-r--r-- 1 root admin 1201240 Jul 7 14:52 /usr/local/lib/libpocketsphinx.a When the pref is enabled, how much does it use memory on desktop, what about on b2g? On b2g, it uses memory only after the decoder be activated and loaded the models. I did a profile in Zte Open C and here is the report [2] and here the exact snapshot [3]. Seems ~ 21 mb is used after load the models. In desktop mac os Nightly, the memory usage was of ~11mb. [2] https://www.dropbox.com/s/cf1drl3thkf6mp1/memory-reports?dl=0 [3] https://www.dropbox.com/s/1rt6z9t5h30whn0/Vaani_b2g_openc.png?dl=0 -Olli On 10/31/2014 01:18 AM, Andre Natal wrote: I've been researching speech recognition in Firefox for two years. First SpeechRTC, then emscripten, and now Web Speech API with CMU pocketsphinx [1] embedded in Gecko C++ layer, project that I had the luck to develop for Google Summer of Code with the mentoring of Olli Pettay, Guilherme Gonçalves, Steven Lee, Randell Jesup plus others and with the management of Sandip Kamat. The implementation already works in B2G, Fennec and all FF desktop versions, and the first language supported will be english. The API and implementation are in conformity with W3C standard [2]. The preference to enable it is: media.webspeech.service.default = pocketsphinx The required patches for achieve this are: - Import pocketsphinx sources in Gecko. Bug 1051146 [3] - Embed english models. Bug 1065911 [4] - Change SpeechGrammarList to store grammars inside SpeechGrammar objects. Bug 1088336 [5] - Creation of a SpeechRecognitionService for Pocketsphinx. Bug 1051148 [6] Also, other important features that we don't have patches yet: - Relax VAD strategy to be les strict and avoid stop in the middle of speech when speaking low volume phonemes [7] - Integrate or develop a grapheme to phoneme algorithm to realtime generator when compiling grammars [8] - Inlcude and build models for other languages [9] - Continuous and wordspotting recognition [10] The wip repo is here [11] and this Air Mozilla video [12] plus this wiki has more detailed info [13]. At this comment you can see a cpu usage on flame while recognition is happening [14] I wish to hear your comments. Thanks, Andre Natal [1] http://cmusphinx.sourceforge.net/ [2] https://dvcs.w3.org/hg/speech-api/raw-file/tip/speechapi.html [3] https://bugzilla.mozilla.org/show_bug.cgi?id=1051146 [4] https://bugzilla.mozilla.org/show_bug.cgi?id=1065911 [5] https://bugzilla.mozilla.org/show_bug.cgi?id=1088336 [6] https://bugzilla.mozilla.org/show_bug.cgi?id=1051148 [7] https://bugzilla.mozilla.org/show_bug.cgi?id=1051604 [8] https://bugzilla.mozilla.org/show_bug.cgi?id=1051554 [9] https://bugzilla.mozilla.org/show_bug.cgi?id=1065904 and https://bugzilla.mozilla.org/show_bug.cgi?id=1051607 [10] https://bugzilla.mozilla.org/show_bug.cgi?id=967896 [11] https://github.com/andrenatal/gecko-dev [12] https://air.mozilla.org/mozilla-weekly-project-meeting-20141027/ (Jump to 12:00) [13] https://wiki.mozilla.org/SpeechRTC_-_Speech_enabling_the_open_web [14] https://bugzilla.mozilla.org/show_bug.cgi?id=1051148#c14 ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
Re: Intent to ship: Web Speech API - Speech Recognition with Pocketsphinx
Hi Chris. For new languages, after the decoder get integrated inside gecko, you only need to build new models (acoustic and language), since the decoder is language agnostic. The procedure of model building is the same for every language: in pretty big picture, you need to record thousands of hours of spoken phrases covering all phones of the aimed language from people of different genders age, regions, accents and etc... all this data is compiled and transformed in the acoustic model. For the language model, you need to build a phonetic dictionary for that language, to then allow tools that do grapheme-to-phoneme (like phonetisaurus [1], e.g.) generate real-time phonetic representations of the words input in your grammar. Build models it is not a trivial task, and requires a closer work between speech engineers and linguists. Pocketsphinx offers some models besides English [2] and they have useful tutorials about acoustic [3] and language [4] model creation. Thanks, Andre [1] https://code.google.com/p/phonetisaurus/ [2] http://sourceforge.net/projects/cmusphinx/files/Acoustic%20and%20Language%20Models/ [3] http://cmusphinx.sourceforge.net/wiki/tutorialam?s[]=acoustics[]=models [4] http://cmusphinx.sourceforge.net/wiki/tutoriallm On Thu, Oct 30, 2014 at 10:45 PM, Chris Hofmann chofm...@mozilla.com wrote: On 10/30/14 5:24 PM, smaug wrote: On 10/31/2014 02:21 AM, smaug wrote: Intent to ship is too strong for this. We need to first have implementation landed and tested ;) I wouldn't ship the implementation in desktop FF without plenty of more testing. But I guess the question is what people think about shipping the pocketspinx + API, even if disabled by default. Andre, we need some numbers here. How much does Pocketsphinx increase binary size? or download size? When the pref is enabled, how much does it use memory on desktop, what about on b2g? This is important work and the competition is ramping quicky after many years of promises about this year being the year of voice recognition. We will probably fall behind quickly if we don't get something going here in the next year. Can you also talk a bit about what the plan and set of challenges look like for expanding the supported languages, and how these would impact the numbers ollie has asked for? The place we really need this is b2g, but phones are only shipping in international markets right now so english only is not all that helpful. -chofmann -Olli On 10/31/2014 01:18 AM, Andre Natal wrote: I've been researching speech recognition in Firefox for two years. First SpeechRTC, then emscripten, and now Web Speech API with CMU pocketsphinx [1] embedded in Gecko C++ layer, project that I had the luck to develop for Google Summer of Code with the mentoring of Olli Pettay, Guilherme Gonçalves, Steven Lee, Randell Jesup plus others and with the management of Sandip Kamat. The implementation already works in B2G, Fennec and all FF desktop versions, and the first language supported will be english. The API and implementation are in conformity with W3C standard [2]. The preference to enable it is: media.webspeech.service.default = pocketsphinx The required patches for achieve this are: - Import pocketsphinx sources in Gecko. Bug 1051146 [3] - Embed english models. Bug 1065911 [4] - Change SpeechGrammarList to store grammars inside SpeechGrammar objects. Bug 1088336 [5] - Creation of a SpeechRecognitionService for Pocketsphinx. Bug 1051148 [6] Also, other important features that we don't have patches yet: - Relax VAD strategy to be les strict and avoid stop in the middle of speech when speaking low volume phonemes [7] - Integrate or develop a grapheme to phoneme algorithm to realtime generator when compiling grammars [8] - Inlcude and build models for other languages [9] - Continuous and wordspotting recognition [10] The wip repo is here [11] and this Air Mozilla video [12] plus this wiki has more detailed info [13]. At this comment you can see a cpu usage on flame while recognition is happening [14] I wish to hear your comments. Thanks, Andre Natal [1] http://cmusphinx.sourceforge.net/ [2] https://dvcs.w3.org/hg/speech-api/raw-file/tip/speechapi.html [3] https://bugzilla.mozilla.org/show_bug.cgi?id=1051146 [4] https://bugzilla.mozilla.org/show_bug.cgi?id=1065911 [5] https://bugzilla.mozilla.org/show_bug.cgi?id=1088336 [6] https://bugzilla.mozilla.org/show_bug.cgi?id=1051148 [7] https://bugzilla.mozilla.org/show_bug.cgi?id=1051604 [8] https://bugzilla.mozilla.org/show_bug.cgi?id=1051554 [9] https://bugzilla.mozilla.org/show_bug.cgi?id=1065904 and https://bugzilla.mozilla.org/show_bug.cgi?id=1051607 [10] https://bugzilla.mozilla.org/show_bug.cgi?id=967896 [11] https://github.com/andrenatal/gecko-dev [12] https://air.mozilla.org/mozilla-weekly-project-meeting-20141027/ (Jump to 12:00) [13]
Re: Intent to ship: Web Speech API - Speech Recognition with Pocketsphinx
Thank you Chris, sure we can do it! Here we have a straightforward page with all objects and methods for the Speech API we are aiming to do: https://github.com/andrenatal/webspeechapi/blob/gh-pages/index_clean.html Maybe we can start from it. Thanks! Andre On Mon, Nov 3, 2014 at 9:58 AM, Chris Mills cmi...@mozilla.com wrote: Awesome to see this mail, Andre! And remember that we do have the pages set up on MDN ready to be filled in also. https://developer.mozilla.org/en-US/docs/Web/API/Web_Speech_API Once this is shipped, do you think we can find some time to start collaborating on these docs? Chris Mills Senior tech writer || Mozilla developer.mozilla.org || MDN cmi...@mozilla.com || @chrisdavidmills On 31 Oct 2014, at 02:27, Marco Chen mc...@mozilla.com wrote: Hi Andre, It is a nice work and expect the voice recognition on B2G. Beside this final result, I am also interesting in the reason of you migrate from SpeechRTC - emscripten - Web Speech API. Could you also share what is the factor triggered these transition? Then that can be the lesson learn for us. ex: SpeechRTC - voice recognition can't be performed on local. emscripten - performance issue? or license issue? or ? Thanks, Sincerely yours. - Original Message - From: Andre Natal ana...@gmail.com To: dev-platform@lists.mozilla.org, Sandip Kamat ska...@mozilla.com, Olli.Pettay opet...@mozilla.com Sent: Friday, October 31, 2014 7:18:06 AM Subject: Intent to ship: Web Speech API - Speech Recognition with Pocketsphinx I've been researching speech recognition in Firefox for two years. First SpeechRTC, then emscripten, and now Web Speech API with CMU pocketsphinx [1] embedded in Gecko C++ layer, project that I had the luck to develop for Google Summer of Code with the mentoring of Olli Pettay, Guilherme Gonçalves, Steven Lee, Randell Jesup plus others and with the management of Sandip Kamat. The implementation already works in B2G, Fennec and all FF desktop versions, and the first language supported will be english. The API and implementation are in conformity with W3C standard [2]. The preference to enable it is: media.webspeech.service.default = pocketsphinx The required patches for achieve this are: - Import pocketsphinx sources in Gecko. Bug 1051146 [3] - Embed english models. Bug 1065911 [4] - Change SpeechGrammarList to store grammars inside SpeechGrammar objects. Bug 1088336 [5] - Creation of a SpeechRecognitionService for Pocketsphinx. Bug 1051148 [6] Also, other important features that we don't have patches yet: - Relax VAD strategy to be les strict and avoid stop in the middle of speech when speaking low volume phonemes [7] - Integrate or develop a grapheme to phoneme algorithm to realtime generator when compiling grammars [8] - Inlcude and build models for other languages [9] - Continuous and wordspotting recognition [10] The wip repo is here [11] and this Air Mozilla video [12] plus this wiki has more detailed info [13]. At this comment you can see a cpu usage on flame while recognition is happening [14] I wish to hear your comments. Thanks, Andre Natal [1] http://cmusphinx.sourceforge.net/ [2] https://dvcs.w3.org/hg/speech-api/raw-file/tip/speechapi.html [3] https://bugzilla.mozilla.org/show_bug.cgi?id=1051146 [4] https://bugzilla.mozilla.org/show_bug.cgi?id=1065911 [5] https://bugzilla.mozilla.org/show_bug.cgi?id=1088336 [6] https://bugzilla.mozilla.org/show_bug.cgi?id=1051148 [7] https://bugzilla.mozilla.org/show_bug.cgi?id=1051604 [8] https://bugzilla.mozilla.org/show_bug.cgi?id=1051554 [9] https://bugzilla.mozilla.org/show_bug.cgi?id=1065904 and https://bugzilla.mozilla.org/show_bug.cgi?id=1051607 [10] https://bugzilla.mozilla.org/show_bug.cgi?id=967896 [11] https://github.com/andrenatal/gecko-dev [12] https://air.mozilla.org/mozilla-weekly-project-meeting-20141027/ (Jump to 12:00) [13] https://wiki.mozilla.org/SpeechRTC_-_Speech_enabling_the_open_web [14] https://bugzilla.mozilla.org/show_bug.cgi?id=1051148#c14 ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
