[Wikidata] Language codes for Chinese

2019-06-19 Thread Vladimir Ryabtsev
Hello,

I am looking for the list of supported language codes for variations of
Chinese. So far in API responses I found these:

zh
zh-cn
zh-hans
zh-hant
zh-hk
zh-tw
zh-mo
zh-sg

"Configure" link in "more languages" section leads to this page:
https://www.wikidata.org/wiki/Help:Navigating_Wikidata/User_Options#Babel_extension
Which in turn refers to
https://meta.wikimedia.org/wiki/Table_of_Wikimedia_projects#Projects_per_language_codes
But apparently there is no such values as 'zh-cn', 'zh-nans' etc.

How can I get the COMPLETE list of language codes (desirably with
description) for Chinese that is supported by Wikidata?

Best regards,
Vlad
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Scaling Wikidata Query Service

2019-06-19 Thread Finn Aarup Nielsen


Changing the subject a bit:

I am surprised to see how many SPARQL requests go to the endpoint when 
performing a ShEx validation with the shex-simple Toolforge tool. They 
are all very simple and quickly complete. For each Wikidata item tested, 
one of our tests [1] requests tens of times. That is, testing 100 
Wikidata items may yield thousands of requests to the endpoint in rapid 
succession.


I suppose that given the simple SPARQL queries, these kinds of requests 
might not load WDQS very much.



[1] 
https://tools.wmflabs.org/shex-simple/wikidata/packages/shex-webapp/doc/shex-simple.html?data=Endpoint:%20https://query.wikidata.org/sparql&hideData&manifest=[]&textMapIsSparqlQuery&schemaURL=%2F%2Fwww.wikidata.org%2Fwiki%2FSpecial%3AEntitySchemaText%2FE65



Finn
http://people.compute.dtu.dk/faan/

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Overload of query.wikidata.org (Guillaume Lederrey)

2019-06-19 Thread Tim Finin
I've been using wdtaxonomy
 happily
for many months on my macbook running 10.14.5. Starting yesterday, every
call I make (e.g., "wdtaxonomy -c Q5") produces an immediate "SPARQL
request failed" message.

Might these requests be blocked now because of the new WDQS policies?

Tim
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Language codes for Chinese

2019-06-19 Thread Vladimir Ryabtsev
Thanks everybody, that was very helpful! Still I have some more questions.

Indeed, I need to know all possible languages for
labels/descriptions/aliases that can be returned by API. I need it to group
Chinese languages, probably just separate simplified and traditional
writing.
I found that the web UI supports only these variations of Chinese: zh,
zh-classical, lzh, zh-hans, zh-hant, zh-yue, yue, nan.
It does NOT support zh-cn, zh-hk, zh-mo, zh-sg, zh-tw. At least when I use
Babel extension like {{#babel:en-5|ru-N|zh-cn-0|zh-tw-0}} it does NOT
create lines for these languages. Still, there ARE labels in zh-cn, zh-tw
etc.

1. So the first question is how are labels/aliases for these code are being
populated? Is it through API only?
2. Imre Samu (or anyone who knows it), when you say "zh-yue = yue;
zh-min-nan = nan; zh-classical= lzh", do you mean API automatically treats
them equivalently? Say I wrote a label in yue, will the API return me both
yue and zh-yue when I query it (and reversely editing zh-yue will affect
yue)?
3. What about pure zh? Is it treated as a separate language for
labels/aliases/descriptions or unites al sub-languages?

Vlad

вт, 18 июн. 2019 г. в 23:30, Lucas Werkmeister :

> On 19.06.19 07:17, Federico Leva (Nemo) wrote:
> > Vladimir Ryabtsev, 19/06/19 03:04:
> >> How can I get the COMPLETE list of language codes (desirably with
> >> description) for Chinese that is supported by Wikidata?
> >
> > Languages supported by a MediaWiki instance are expected to be all
> > listed at siprop=languages in the API:
> > 
> > <
> https://www.wikidata.org/w/api.php?action=query&meta=siteinfo&siprop=languages
> >
> >
>
> There’s also a separate API for all the languages Wikibase supports. For
> labels/descriptions/aliases, that’s currently the same list
> (
> https://www.wikidata.org/w/api.php?action=query&meta=wbcontentlanguages&wbclcontext=term&formatversion=2
> ),
> but for monolingual text there are some additional languages
> (
> https://www.wikidata.org/w/api.php?action=query&meta=wbcontentlanguages&wbclcontext=monolingualtext&formatversion=2
> ).
>
> Cheers,
> Lucas
>
>
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata] Planned filename change for Wikidata RDF entity dumps

2019-06-19 Thread Stas Malyshev
Hi!

As outlined in https://phabricator.wikimedia.org/T226153, we are
planning to change filename scheme for Wikidata RDF entity dumps, by
removing the "-BETA" suffix from the filename. The Wikidata RDF ontology
is not beta anymore and dumps have been working stable for a while now,
so it's time to drop the beta mark from the name. It may take a week or
two for the change to propagate and be applied to dumps, but if your
tools depend on exact naming, please prepare them for the eventual
change in the name.

Note that links like
https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.nt.gz would
still be pointing to the right files, and if all you care is downloading
the latest dump, using these links is always recommended.

We will send another message once the change has been implemented and
deployed.

Thanks,
-- 
Stas Malyshev
smalys...@wikimedia.org

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata