[Wikitech-l] Raw page view no longer showing language links for some pages?

2013-03-09 Thread Brian Cassidy
Hello,

I'm the co-author of the WWW::Wikipedia Perl module (
https://metacpan.org/release/WWW-Wikipedia). It programmatically parses the
raw source of a Wikipedia page.

Of late, a few changes in behaviour have been reported to me -- all related
to the "language" functionality.

As it turns out a number of pages are no longer returning the language
links in the raw source code like they used to. The canonical test for us
was to load "Russia" in English, then grab the Russian link. As you can
see, the page for "Russia" no longer has those links (which can normally be
seen down the left-hand side of the real page):

http://en.wikipedia.org/w/index.php?title=Russia&action=raw

A shorter example is the page for "Rotation"

http://en.wikipedia.org/w/index.php?title=Rotation&action=raw

I did find that some pages still have language links. See this one for
"Babushka"

http://en.wikipedia.org/w/index.php?title=Babushka&action=raw

Has there been some change that no longer outputs those links in some
instances, or is this an actual bug?

I apologize that this wasn't sent to some official bug tracker, but I
couldn't find that info off-hand from the Wikipedia site.

Thanks in advance,

-- 
Brian Cassidy (brian.cass...@gmail.com)
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Raw page view no longer showing language links for some pages?

2013-03-09 Thread Yuri Astrakhan
Brian, due to the recent introduction of wikidata.org, most language links
are now stored there.

Regardless, you should try to avoid getting langlinks from the raw source,
because it wastes a lot of bandwidth. Please consider using mediawiki
APIto get just the data you need.
For example, for langlinks, use this query:

http://en.wikipedia.org/w/api.php?action=query&prop=langlinks&titles=Russia&lllimit=max&format=jsonfm
(change jsonfm to json in your code)

Using this method you can request langlinks for multiple titles in one
request.



On Sat, Mar 9, 2013 at 10:00 PM, Brian Cassidy wrote:

> Hello,
>
> I'm the co-author of the WWW::Wikipedia Perl module (
> https://metacpan.org/release/WWW-Wikipedia). It programmatically parses
> the
> raw source of a Wikipedia page.
>
> Of late, a few changes in behaviour have been reported to me -- all related
> to the "language" functionality.
>
> As it turns out a number of pages are no longer returning the language
> links in the raw source code like they used to. The canonical test for us
> was to load "Russia" in English, then grab the Russian link. As you can
> see, the page for "Russia" no longer has those links (which can normally be
> seen down the left-hand side of the real page):
>
> http://en.wikipedia.org/w/index.php?title=Russia&action=raw
>
> A shorter example is the page for "Rotation"
>
> http://en.wikipedia.org/w/index.php?title=Rotation&action=raw
>
> I did find that some pages still have language links. See this one for
> "Babushka"
>
> http://en.wikipedia.org/w/index.php?title=Babushka&action=raw
>
> Has there been some change that no longer outputs those links in some
> instances, or is this an actual bug?
>
> I apologize that this wasn't sent to some official bug tracker, but I
> couldn't find that info off-hand from the Wikipedia site.
>
> Thanks in advance,
>
> --
> Brian Cassidy (brian.cass...@gmail.com)
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Raw page view no longer showing language links for some pages?

2013-03-21 Thread Sumana Harihareswara
On 03/09/2013 10:00 PM, Brian Cassidy wrote:
> Hello,
> 
> I'm the co-author of the WWW::Wikipedia Perl module (
> https://metacpan.org/release/WWW-Wikipedia). It programmatically parses the
> raw source of a Wikipedia page.
> 
> Of late, a few changes in behaviour have been reported to me -- all related
> to the "language" functionality.
> 
> As it turns out a number of pages are no longer returning the language
> links in the raw source code like they used to. The canonical test for us
> was to load "Russia" in English, then grab the Russian link. As you can
> see, the page for "Russia" no longer has those links (which can normally be
> seen down the left-hand side of the real page):
> 
> http://en.wikipedia.org/w/index.php?title=Russia&action=raw
> 
> A shorter example is the page for "Rotation"
> 
> http://en.wikipedia.org/w/index.php?title=Rotation&action=raw
> 
> I did find that some pages still have language links. See this one for
> "Babushka"
> 
> http://en.wikipedia.org/w/index.php?title=Babushka&action=raw
> 
> Has there been some change that no longer outputs those links in some
> instances, or is this an actual bug?
> 
> I apologize that this wasn't sent to some official bug tracker, but I
> couldn't find that info off-hand from the Wikipedia site.
> 
> Thanks in advance,

Brian, thanks for your note.

Here's our recent blog post on how to file a bug report or feature
request in our Bugzilla installation:
https://blog.wikimedia.org/2013/03/18/how-to-create-a-good-first-bug-report/

If you find that the API doesn't give you some of what you need for
WWW::Wikipedia, please do file a bug.  Thanks!
-- 
Sumana Harihareswara
Engineering Community Manager
Wikimedia Foundation

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] Raw page view no longer showing language links for some pages?

2013-03-21 Thread Yuri Astrakhan
This is all due to the introduction of Wikidata .


On Thu, Mar 21, 2013 at 12:32 PM, Sumana Harihareswara <
suma...@wikimedia.org> wrote:

> On 03/09/2013 10:00 PM, Brian Cassidy wrote:
> > Hello,
> >
> > I'm the co-author of the WWW::Wikipedia Perl module (
> > https://metacpan.org/release/WWW-Wikipedia). It programmatically parses
> the
> > raw source of a Wikipedia page.
> >
> > Of late, a few changes in behaviour have been reported to me -- all
> related
> > to the "language" functionality.
> >
> > As it turns out a number of pages are no longer returning the language
> > links in the raw source code like they used to. The canonical test for us
> > was to load "Russia" in English, then grab the Russian link. As you can
> > see, the page for "Russia" no longer has those links (which can normally
> be
> > seen down the left-hand side of the real page):
> >
> > http://en.wikipedia.org/w/index.php?title=Russia&action=raw
> >
> > A shorter example is the page for "Rotation"
> >
> > http://en.wikipedia.org/w/index.php?title=Rotation&action=raw
> >
> > I did find that some pages still have language links. See this one for
> > "Babushka"
> >
> > http://en.wikipedia.org/w/index.php?title=Babushka&action=raw
> >
> > Has there been some change that no longer outputs those links in some
> > instances, or is this an actual bug?
> >
> > I apologize that this wasn't sent to some official bug tracker, but I
> > couldn't find that info off-hand from the Wikipedia site.
> >
> > Thanks in advance,
>
> Brian, thanks for your note.
>
> Here's our recent blog post on how to file a bug report or feature
> request in our Bugzilla installation:
>
> https://blog.wikimedia.org/2013/03/18/how-to-create-a-good-first-bug-report/
>
> If you find that the API doesn't give you some of what you need for
> WWW::Wikipedia, please do file a bug.  Thanks!
> --
> Sumana Harihareswara
> Engineering Community Manager
> Wikimedia Foundation
>
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l