Re: [Wikidata] Wikidata geo-coordinates

[Jeroen De Dauw]

Hey,

While this won't help you for data from the SPARQL endpoint, the Geo
library can be of use when
working with coordinates from Wikidata/Wikibase.

https://github.com/DataValues/Geo/

This library is used by Wikibase and can thus both parse the coordinates
coming from the wiki software
and format coordinates to a format the wiki software supports. This library
is also used by
Semantic MediaWiki [0] and the Maps extension [1], so aids interoperability
there as well.

[0] https://www.semantic-mediawiki.org
[1] https://github.com/JeroenDeDauw/Maps#maps

Cheers

--
Jeroen De Dauw | www.EntropyWins.wtf  |
www.Professional.Wiki 
Software Crafter | Entrepreneur | Speaker | Strategist | Contributor
to Wikimedia
and Open Source
~=[,,_,,]:3
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Wikidata geo-coordinates

[Ettore RIZZA]

Is there an elegant way to get data out of wikidata in a format that you
can then fill back into another Wikibase without the pain of such
conversions (like splitting coordinates, changing columns, changing the
prefixes...)

It would probably be easier for you to get longitude and latitude
separately, but if I understand correctly the SPARQL query is not the most
straightforward: https://w.wiki/7ny

Cheers,

Ettore Rizza


On Mon, 2 Sep 2019 at 21:34, Olaf Simons 
wrote:

> Cool,
>
> that is a very useful link for us to keep an eye on!
>
> Thanks,
> Olaf
>
>
> > Jan Macura  hat am 2. September 2019 um 21:22
> geschrieben:
> >
> >
> > On Mon, 2 Sep 2019 at 21:11, Olaf Simons  >
> > wrote:
> >
> > > This might be then the central thing to have in the next QueryService
> > > Version: In addition to the present download formats an option to get
> a csv
> > > or tsv output that can be put into QuickStatements for another Wikibase
> > > without tedious conversions.
> > >
> >
> > Well, this is probably more on the QuickStatements site, to allow input
> in
> > a form of WKT...
> >
> >
> > > We will have more and more people with Wikibase installations who will
> use
> > > Wikidata (or other Wikibases) as data source for their platforms.
> > >
> >
> >  Of course. And this is what is currently (yet a bit confusingly) called
> > Federation: https://www.wikidata.org/wiki/Wikidata:Federation_input
> >
> > Best regards,
> >  Jan
> > ___
> > Wikidata mailing list
> > Wikidata@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/wikidata
>
> Dr. Olaf Simons
> Forschungszentrum Gotha der Universität Erfurt
> Schloss Friedenstein, Pagenhaus
> 99867 Gotha
>
> Büro: +49-361-737-1722
> Mobil: +49-179-5196880
>
> Privat: Hauptmarkt 17b/ 99867 Gotha
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Wikidata geo-coordinates

[Olaf Simons]

Cool, 

that is a very useful link for us to keep an eye on!

Thanks,
Olaf


> Jan Macura  hat am 2. September 2019 um 21:22 
> geschrieben:
> 
> 
> On Mon, 2 Sep 2019 at 21:11, Olaf Simons 
> wrote:
> 
> > This might be then the central thing to have in the next QueryService
> > Version: In addition to the present download formats an option to get a csv
> > or tsv output that can be put into QuickStatements for another Wikibase
> > without tedious conversions.
> >
> 
> Well, this is probably more on the QuickStatements site, to allow input in
> a form of WKT...
> 
> 
> > We will have more and more people with Wikibase installations who will use
> > Wikidata (or other Wikibases) as data source for their platforms.
> >
> 
>  Of course. And this is what is currently (yet a bit confusingly) called
> Federation: https://www.wikidata.org/wiki/Wikidata:Federation_input
> 
> Best regards,
>  Jan
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata

Dr. Olaf Simons
Forschungszentrum Gotha der Universität Erfurt
Schloss Friedenstein, Pagenhaus
99867 Gotha

Büro: +49-361-737-1722
Mobil: +49-179-5196880

Privat: Hauptmarkt 17b/ 99867 Gotha

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Wikidata geo-coordinates

[Jan Macura]

On Mon, 2 Sep 2019 at 21:11, Olaf Simons 
wrote:

> This might be then the central thing to have in the next QueryService
> Version: In addition to the present download formats an option to get a csv
> or tsv output that can be put into QuickStatements for another Wikibase
> without tedious conversions.
>

Well, this is probably more on the QuickStatements site, to allow input in
a form of WKT...


> We will have more and more people with Wikibase installations who will use
> Wikidata (or other Wikibases) as data source for their platforms.
>

 Of course. And this is what is currently (yet a bit confusingly) called
Federation: https://www.wikidata.org/wiki/Wikidata:Federation_input

Best regards,
 Jan
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Wikidata geo-coordinates

[Jan Macura]

I am afraid that those questions does not have as simple and
straight-forward answers as the first one...

On Mon, 2 Sep 2019 at 17:39, Olaf Simons 
wrote:

> Is there an elegant way to get data out of wikidata in a format that you
> can then fill back into another Wikibase without the pain of such
> conversions (like splitting coordinates, changing columns, changing the
> prefixes...)
>

I quite agree with what Eugene has written -- it depends what is elegant
for you. Sadly, I have no experience with other Wikibase instances, so I
have no idea how the input for it might look like. But SPARQL has quite
useful string functions that might come handy in this case:
https://en.wikibooks.org/wiki/SPARQL/Expressions_and_Functions#Functions_on_Strings


> Question 2 is related: When you extract dates with the QueryService that
> will change just years like 1971  from 1971-00-00 into 1971-01-01 dates. I
> felt unable to tell whether such a date was just a year or actually a
> January 1 entry. Is there a way to get the exact date as it has been put in
> to Wikibase back from the QueryService?
>

Sorry, I am not familiar with the date representations in Wikibase enough
to provide a meaningful answer.

Best regards,
 Jan
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Wikidata geo-coordinates

[Olaf Simons]

This might be then the central thing to have in the next QueryService Version: 
In addition to the present download formats an option to get a csv or tsv 
output that can be put into QuickStatements for another Wikibase without 
tedious conversions.

We will have more and more people with Wikibase installations who will use 
Wikidata (or other Wikibases) as data source for their platforms.

Maybe I can inspire Magnus...
Thanks,

Olaf

> Eugene Alvin Villar  hat am 2. September 2019 um 17:56 
> geschrieben:
> 
> 
> On Mon, Sep 2, 2019, 11:39 PM Olaf Simons, 
> wrote:
> 
> > Is there an elegant way to get data out of wikidata in a format that you
> > can then fill back into another Wikibase without the pain of such
> > conversions (like splitting coordinates, changing columns, changing the
> > prefixes...)
> >
> 
> Depends on how elegant you want it to be but it won't be trivial. If you
> want to get data from WDQS, you can use any of the available SPARQL
> text/regex manipulation functions to convert the WKT format into a
> different format.
> 
> Question 2 is related: When you extract dates with the QueryService that
> > will change just years like 1971  from 1971-00-00 into 1971-01-01 dates. I
> > felt unable to tell whether such a date was just a year or actually a
> > January 1 entry. Is there a way to get the exact date as it has been put in
> > to Wikibase back from the QueryService?
> >
> 
> Again, this is not trivial. You need to also query the datePrecision field
> of the date value and that means querying for the actual date statement and
> not just the simple value that the usual SPARQL queries provide. Then based
> on the datePrecision value (I think 9 is for year precision vs. 11 for day
> precision), you can then truncate the date to just the year.
> 
> >
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata

Dr. Olaf Simons
Forschungszentrum Gotha der Universität Erfurt
Schloss Friedenstein, Pagenhaus
99867 Gotha

Büro: +49-361-737-1722
Mobil: +49-179-5196880

Privat: Hauptmarkt 17b/ 99867 Gotha

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Wikidata geo-coordinates

[Sebastian Hellmann]

Hi Olaf

https://databus.dbpedia.org/dbpedia/wikidata/geo-coordinates/2019.08.01 
has monthly (around the 7th) extractions of Wikidata's geo-coordinates.


The website still has a bug and the download links are currently not 
displayed any more at the bottom. But you can query for the latest version.


https://databus.dbpedia.org/yasgui/

PREFIX dataid: 
PREFIX dct: 
PREFIX dcat:  

SELECT ?downloadURL ?sha256sum WHERE {
        ?dataset dataid:artifact 
 .

    ?dataset dcat:distribution/dcat:downloadURL ?downloadURL .
    ?dataset dcat:distribution/dataid:sha256sum ?sha256sum .
        ?dataset dct:hasVersion ?version .

} ORDER BY DESC (?version) LIMIT 1

-- Sebastian


On 02.09.19 17:56, Eugene Alvin Villar wrote:
On Mon, Sep 2, 2019, 11:39 PM Olaf Simons, 
> wrote:


Is there an elegant way to get data out of wikidata in a format
that you can then fill back into another Wikibase without the pain
of such conversions (like splitting coordinates, changing columns,
changing the prefixes...)


Depends on how elegant you want it to be but it won't be trivial. If 
you want to get data from WDQS, you can use any of the available 
SPARQL text/regex manipulation functions to convert the WKT format 
into a different format.


Question 2 is related: When you extract dates with the
QueryService that will change just years like 1971  from
1971-00-00 into 1971-01-01 dates. I felt unable to tell whether
such a date was just a year or actually a January 1 entry. Is
there a way to get the exact date as it has been put in to
Wikibase back from the QueryService?


Again, this is not trivial. You need to also query the datePrecision 
field of the date value and that means querying for the actual date 
statement and not just the simple value that the usual SPARQL queries 
provide. Then based on the datePrecision value (I think 9 is for year 
precision vs. 11 for day precision), you can then truncate the date to 
just the year.



___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

--
All the best,
Sebastian Hellmann

Director of Knowledge Integration and Linked Data Technologies (KILT) 
Competence Center

at the Institute for Applied Informatics (InfAI) at Leipzig University
Executive Director of the DBpedia Association
Projects: http://dbpedia.org, http://nlp2rdf.org, 
http://linguistics.okfn.org, https://www.w3.org/community/ld4lt 


Homepage: http://aksw.org/SebastianHellmann
Research Group: http://aksw.org
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Wikidata geo-coordinates

[Eugene Alvin Villar]

On Mon, Sep 2, 2019, 11:39 PM Olaf Simons, 
wrote:

> Is there an elegant way to get data out of wikidata in a format that you
> can then fill back into another Wikibase without the pain of such
> conversions (like splitting coordinates, changing columns, changing the
> prefixes...)
>

Depends on how elegant you want it to be but it won't be trivial. If you
want to get data from WDQS, you can use any of the available SPARQL
text/regex manipulation functions to convert the WKT format into a
different format.

Question 2 is related: When you extract dates with the QueryService that
> will change just years like 1971  from 1971-00-00 into 1971-01-01 dates. I
> felt unable to tell whether such a date was just a year or actually a
> January 1 entry. Is there a way to get the exact date as it has been put in
> to Wikibase back from the QueryService?
>

Again, this is not trivial. You need to also query the datePrecision field
of the date value and that means querying for the actual date statement and
not just the simple value that the usual SPARQL queries provide. Then based
on the datePrecision value (I think 9 is for year precision vs. 11 for day
precision), you can then truncate the date to just the year.

>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Wikidata geo-coordinates

[Olaf Simons]

Thank you Jan for the swift answer
(I wish I had known before this morning's first data input...)



allow me 2 follow-up questions:

Is there an elegant way to get data out of wikidata in a format that you can 
then fill back into another Wikibase without the pain of such conversions (like 
splitting coordinates, changing columns, changing the prefixes...)

Question 2 is related: When you extract dates with the QueryService that will 
change just years like 1971  from 1971-00-00 into 1971-01-01 dates. I felt 
unable to tell whether such a date was just a year or actually a January 1 
entry. Is there a way to get the exact date as it has been put in to Wikibase 
back from the QueryService?

All my thanks,
Olaf





> Jan Macura  hat am 2. September 2019 um 12:20 
> geschrieben:
> 
> 
> Hello Olaf,
> 
> this is a simple one. As it is common in natural language to present the
> world coordinates in order of [latitude, longitude], WKT standard
> ,
> which is used to represent coordinates in the SPARQL endpoint, on the other
> hand, expects an order of [x, y], which in this case means [longitude,
> latitude].
> For more info, see https://en.wikipedia.org/wiki/OGC_GeoSPARQL and
> https://stackoverflow.com/questions/18636564/lat-long-or-long-lat
> 
> So it is a desired behaviour, not a bug ;-)
> 
> Best regards,
>  Jan
> 
> On Mon, 2 Sep 2019 at 12:06, Olaf Simons 
> wrote:
> 
> > I am trying to synchronise FactGrid data with Wikidata.
> >
> > A strange question: If I run a SPARQL search such as this one:
> >
> >
> > https://query.wikidata.org/#SELECT%20%3FGemeinde_in_Deutschland%20%3FGemeinde_in_DeutschlandLabel%20%3Fgeographische_Koordinaten%20WHERE%20%7B%0A%20%20SERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22%5BAUTO_LANGUAGE%5D%2Cen%22.%20%7D%0A%20%20%3FGemeinde_in_Deutschland%20wdt%3AP31%20wd%3AQ262166.%0A%20%20OPTIONAL%20%7B%20%3FGemeinde_in_Deutschland%20wdt%3AP625%20%3Fgeographische_Koordinaten.%20%7D%0A%7D
> >
> > I get the coordinates with what looks like swapped values:
> >
> > "Point(10.7183 50.9489)" on the QueryService table output
> > "50°56'56"N, 10°43'6"E" on P625 at the respective Wikidata Item Q6986
> >
> > any idea why this is so?
> >
> > Best,
> > Olaf
> >
> >
> >
> >
> > Dr. Olaf Simons
> > Forschungszentrum Gotha der Universität Erfurt
> > Schloss Friedenstein, Pagenhaus
> > 99867 Gotha
> >
> > Büro: +49-361-737-1722
> > Mobil: +49-179-5196880
> >
> > Privat: Hauptmarkt 17b/ 99867 Gotha
> >
> > ___
> > Wikidata mailing list
> > Wikidata@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/wikidata
> >
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata

Dr. Olaf Simons
Forschungszentrum Gotha der Universität Erfurt
Schloss Friedenstein, Pagenhaus
99867 Gotha

Büro: +49-361-737-1722
Mobil: +49-179-5196880

Privat: Hauptmarkt 17b/ 99867 Gotha

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Wikidata geo-coordinates

[Jan Macura]

Hello Olaf,

this is a simple one. As it is common in natural language to present the
world coordinates in order of [latitude, longitude], WKT standard
,
which is used to represent coordinates in the SPARQL endpoint, on the other
hand, expects an order of [x, y], which in this case means [longitude,
latitude].
For more info, see https://en.wikipedia.org/wiki/OGC_GeoSPARQL and
https://stackoverflow.com/questions/18636564/lat-long-or-long-lat

So it is a desired behaviour, not a bug ;-)

Best regards,
 Jan

On Mon, 2 Sep 2019 at 12:06, Olaf Simons 
wrote:

> I am trying to synchronise FactGrid data with Wikidata.
>
> A strange question: If I run a SPARQL search such as this one:
>
>
> https://query.wikidata.org/#SELECT%20%3FGemeinde_in_Deutschland%20%3FGemeinde_in_DeutschlandLabel%20%3Fgeographische_Koordinaten%20WHERE%20%7B%0A%20%20SERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22%5BAUTO_LANGUAGE%5D%2Cen%22.%20%7D%0A%20%20%3FGemeinde_in_Deutschland%20wdt%3AP31%20wd%3AQ262166.%0A%20%20OPTIONAL%20%7B%20%3FGemeinde_in_Deutschland%20wdt%3AP625%20%3Fgeographische_Koordinaten.%20%7D%0A%7D
>
> I get the coordinates with what looks like swapped values:
>
> "Point(10.7183 50.9489)" on the QueryService table output
> "50°56'56"N, 10°43'6"E" on P625 at the respective Wikidata Item Q6986
>
> any idea why this is so?
>
> Best,
> Olaf
>
>
>
>
> Dr. Olaf Simons
> Forschungszentrum Gotha der Universität Erfurt
> Schloss Friedenstein, Pagenhaus
> 99867 Gotha
>
> Büro: +49-361-737-1722
> Mobil: +49-179-5196880
>
> Privat: Hauptmarkt 17b/ 99867 Gotha
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

[Wikidata] Wikidata geo-coordinates

[Olaf Simons]

I am trying to synchronise FactGrid data with Wikidata.

A strange question: If I run a SPARQL search such as this one:

https://query.wikidata.org/#SELECT%20%3FGemeinde_in_Deutschland%20%3FGemeinde_in_DeutschlandLabel%20%3Fgeographische_Koordinaten%20WHERE%20%7B%0A%20%20SERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22%5BAUTO_LANGUAGE%5D%2Cen%22.%20%7D%0A%20%20%3FGemeinde_in_Deutschland%20wdt%3AP31%20wd%3AQ262166.%0A%20%20OPTIONAL%20%7B%20%3FGemeinde_in_Deutschland%20wdt%3AP625%20%3Fgeographische_Koordinaten.%20%7D%0A%7D

I get the coordinates with what looks like swapped values:

"Point(10.7183 50.9489)" on the QueryService table output
"50°56'56"N, 10°43'6"E" on P625 at the respective Wikidata Item Q6986 

any idea why this is so?

Best,
Olaf




Dr. Olaf Simons
Forschungszentrum Gotha der Universität Erfurt
Schloss Friedenstein, Pagenhaus
99867 Gotha

Büro: +49-361-737-1722
Mobil: +49-179-5196880

Privat: Hauptmarkt 17b/ 99867 Gotha

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata