Re: [WikimediaMobile] [Wikimedia-l] Wikipedia Zero in Google search result

2013-08-28 Thread Adam Baso
(cross-posted on mobile-l) Update: I have been checking on the indexed link count over the last couple of months, and it has been roughly constant. Upon another check in the past week, it looked like it was time to go ahead with the robots.txt update. Just yesterday, the start of a robots.txt en

Re: [WikimediaMobile] [Wikimedia-l] Wikipedia Zero in Google search result

2013-06-26 Thread Adam Baso
(cross-posted on mobile-l) Okay, looks like the index of zero.wikipedia.org pages in Google has shrunk by some 20 million entries. Nonetheless, a number of really old pages (e.g., going back to 6-May-2013) are still in the Google index with article text. I'll set a reminder to check on the Google

Re: [WikimediaMobile] [Wikimedia-l] Wikipedia Zero in Google search result

2013-06-18 Thread Adam Baso
Update: We've added an enhancement to Wikipedia Zero so that if a user who isn't on a participating carrier network navigates to a Wikipedia Zero page on .zero.wikipedia.org, such as http://en.zero.wikipedia.org/wiki/Muse_%28band%29 , the user will be presented an option to visit the canonical URL

Re: [WikimediaMobile] [Wikimedia-l] Wikipedia Zero in Google search result

2013-05-29 Thread Erik Moeller
On Wed, May 29, 2013 at 8:10 AM, Federico Leva (Nemo) wrote: > I don't know if there's a general bug report about canonical URLs & co. > indexing, but there's one about Google messing up with 301/302 redirects > which is spreading quite a bit lately. Erik wrote them to no avail some time > ago. >

Re: [WikimediaMobile] [Wikimedia-l] Wikipedia Zero in Google search result

2013-05-29 Thread Federico Leva (Nemo)
I don't know if there's a general bug report about canonical URLs & co. indexing, but there's one about Google messing up with 301/302 redirects which is spreading quite a bit lately. Erik wrote them to no avail some time ago. https://bugzilla.wikimedia.org/show_bug.cgi?id=26115 Nemo

Re: [WikimediaMobile] [Wikimedia-l] Wikipedia Zero in Google search result

2013-05-28 Thread Yuri Astrakhan
Does it make sense to get rid of zero altogether? We could keep zero for the known IP ranges of our partners, but for everyone else do an automatic redirect to "m"? And yes, I think we should get rid of "m" too, but that's a separate discussion. On Tue, May 28, 2013 at 9:26 PM, Adam Baso wrote:

Re: [WikimediaMobile] [Wikimedia-l] Wikipedia Zero in Google search result

2013-05-28 Thread Adam Baso
All, My mistake. The pages in Google's index that I used for sampling - the ones that have "Sorry, ..." in their description in Google search results - are cached pages. I assumed incorrectly that those pages were based on recent indexing (e.g., in the past few days). I think we can actually stic

Re: [WikimediaMobile] [Wikimedia-l] Wikipedia Zero in Google search result

2013-05-28 Thread James Alexander
Sorry for the double post: For what it's worth It does not appear that we have a canonical url appearing on most pages. Mobile has canonical pointing to the main site but neither zero or the main site have a canonical expressly stated. James Alexander Legal and Community Advocacy Wikimedia Fo

Re: [WikimediaMobile] [Wikimedia-l] Wikipedia Zero in Google search result

2013-05-28 Thread James Alexander
At some level there seems to be a change in google (or our) settings that are doing this everywhere. I've also been seeing a lot of links indexed and appearing in google as the primary domain too (wikipedia.org/wiki/Bostonrather then en.wikipedia.org/wiki/Boston, seen it on Wikivoyage as well and I

Re: [WikimediaMobile] [Wikimedia-l] Wikipedia Zero in Google search result

2013-05-28 Thread Adam Baso
Hello All, We had shelved my patch, patch 64629 , in hopes that an earlier patch, patch 61809(bug 35233 ), would resolve the issue naturally as Google re-indexed. But i