[Wikidata-bugs] [Maniphest] [Commented On] T214378: Check simple format constraints (no grouping) in PHP instead of SPARQL

2019-10-04 Thread sbassett 
sbassett added a comment.


  @RazShuty @Addshore @Lucas_Werkmeister_WMDE - Sorry for the (very) delayed 
response here.  Due to a healthy amount of organizational shift, the 
#security-team  is just 
now getting our Phab works boards in order to review these kinds of items more 
consistently.  For now, it's  still probably best to find one of us on IRC 
(most of us run bouncers or use IRCCloud) or email us if there are any 
lingering tasks like this.
  
  Regarding this task, specifically:
  
  > However, the majority of user-provided regexes we’re interested in (76%) do 
not contain any parentheses, which means they cannot contain any groups and 
their star height must be 0 or 1. Unless I’m mistaken, this should mean we can 
safely evaluate them via preg_match, and the evaluation time should not explode.
  
  I feel like this is a generally safe assumption to make in eliminating large 
swaths of likely benign regexp patterns, assuming someone doesn't create an 
enormously lengthy regular expression pattern which might suffer from other 
performance-related issues.  In addition to parentheses, I'd guess that any 
occurrences of unbound repetition operators (`+`, `*`, `{n,}`) might further 
help to classify potentially dangerous regexp patterns.  Of course static 
analysis to determine the safety of regexp patterns is fairly difficult if not 
impossible in certain situations, so additional solutions involving sandboxing, 
limiting memory usage, etc. as discussed on the parent task would certainly be 
encouraged as best practices by the #security-team 
.

TASK DETAIL
  https://phabricator.wikimedia.org/T214378

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: sbassett
Cc: sbassett, Addshore, RazShuty, JBennett, Ladsgroup, Aklapper, 
Lucas_Werkmeister_WMDE, darthmon_wmde, Dsharpe, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, EBjune, LawExplorer, _jensen, rosalieper, Agabi10, 
Jonas, Wong128hk, Luke081515, Wikidata-bugs, aude, Bawolff, Lydia_Pintscher, 
csteipp, Mbch331, Rxy, Jay8g, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Re: [Wikidata] Full-text / autocomplete search on labels

2019-10-04 Thread Lucas Werkmeister 
It matches the German descriptions (German „einst“ = English “once”,
“formerly” – the results are described as having been civil rights
activists in the GDR).

On 04.10.19 16:55, Tim Thompson wrote:
> Great to learn about these features/extensions. However, I'm confused
> by the results in Lucas's example query for WikibaseCirrusSearch. How
> is the string "einst" being matched here?
>
> Thanks,
> Tim
>
> --
> Tim A. Thompson
> Discovery Metadata Librarian
> Yale University Library
>
> On Fri, Oct 4, 2019 at 8:54 AM Lucas Werkmeister
> mailto:m...@lucaswerkmeister.de>> wrote:
>
> If you use regular search rather than entity search, you can use
> WikibaseCirrusSearch
> 
> 
> search keywords like "haswbstatement:P31=Q5". Note that this uses
> a different kind of search, though – I think it only matches full
> words (after stemming and other transformations?), not prefixes.
> Query Link
> 
> 
>
> Cheers,
> Lucas
>
> On 04.10.19 10:22, Ettore RIZZA wrote:
>> Forgot to mention: you can do the same search using the API
>> only: 
>> https://www.wikidata.org/w/api.php?action=wbsearchentities=einst=en=json
>>
>>
>> But not sure you can easily filter the results by "instance of".
>>
>> Ettore Rizza
>>
>>
>> On Fri, 4 Oct 2019 at 10:15, Ettore RIZZA > > wrote:
>>
>> Hello Thomas,
>>
>> You can perform a full text search with the API, but not yet
>> with SPARQL AFAIK. However, it is possible to call the API in
>> a SPARQL query. For example, here is a query
>> 
>> 
>> that looks for "human (Q5)"  whose label contains the string
>> "einst".
>>
>> Hope this helps,
>>
>> Ettore Rizza
>>
>>
>> On Fri, 4 Oct 2019 at 09:58, Thomas Francart
>> > > wrote:
>>
>> Hello
>>
>> I understand the wikidata SPARQL label service only
>> fetches the labels, but does not allow to search/filter
>> on them; labels are also available in regulare rdfs:label
>> on which a FILTER can be made.
>> However I would like to do full-text search over labels,
>> to e.g. feed an autocomplete search field, actually just
>> like the usual top-right wikidata search field does. I
>> would also be interested to combine this with a criteria
>> on "instance of", to search only on instances of a given
>> class.
>>
>> Can I do that efficiently using the Wikidata SPARQL
>> service ? or is there a separate API I could use ?
>> (exemple welcome)
>>
>> Thanks
>> Thomas
>>
>> -- 
>> *
>> *
>> *Thomas Francart* -*SPARNA*
>> Web de _données_ | Architecture de l'_information_ |
>> Accès aux _connaissances_
>> blog : blog.sparna.fr , site :
>> sparna.fr , linkedin :
>> fr.linkedin.com/in/thomasfrancart
>> 
>> tel :  +33 (0)6.71.11.25.97, skype : francartthomas
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> 
>>

[Wikidata-bugs] [Maniphest] [Commented On] T194023: Expose siteGlobalID in Lua

2019-10-04 Thread gerritbot 
gerritbot added a comment.


  Change 540925 had a related patch set uploaded (by Hoo man; owner: Hoo man):
  [mediawiki/extensions/Wikibase@master] Add "mw.wikibase.getGlobalSiteId"
  
  https://gerrit.wikimedia.org/r/540925

TASK DETAIL
  https://phabricator.wikimedia.org/T194023

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Aklapper, Anomie, Lydia_Pintscher, thiemowmde, hoo, darthmon_wmde, 
DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T194023: Expose siteGlobalID in Lua

2019-10-04 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T194023

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Aklapper, Anomie, Lydia_Pintscher, thiemowmde, hoo, Hook696, Daryl-TTMG, 
RomaAmorRoma, 0010318400, E.S.A-Sheild, darthmon_wmde, Meekrab2012, 
joker88john, DannyS712, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Status] T208329: Gadget with SPARQL services and the Content Security Policy ?

2019-10-04 Thread sbassett 
sbassett changed the task status from "Open" to "Stalled".
sbassett triaged this task as "Normal" priority.
sbassett moved this task from Backlog to Waiting on the Security-Team board.

TASK DETAIL
  https://phabricator.wikimedia.org/T208329

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1179/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: sbassett
Cc: Bawolff, EBjune, Smalyshev, Addshore, Aklapper, Karima, darthmon_wmde, 
JFishback_WMF, Dsharpe, DannyS712, Nandana, sbassett, Lahi, Gq86, 
GoranSMilovanovic, QZanden, HJiang-WMF, LawExplorer, _jensen, rosalieper, 
dpatrick, Wong128hk, Luke081515, Wikidata-bugs, aude, GWicke, 
Stype_and_Co.-WMF, DerHexer, Jalexander, Parent5446, Anomie, Grunny, MaxSem, 
csteipp, Mbch331, Rxy, Jay8g, Krenair, Legoktm, chasemp
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T214378: Check simple format constraints (no grouping) in PHP instead of SPARQL

2019-10-04 Thread Jcross 
Jcross triaged this task as "Normal" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T214378

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1179/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jcross
Cc: Addshore, RazShuty, JBennett, Ladsgroup, Aklapper, Lucas_Werkmeister_WMDE, 
darthmon_wmde, Dsharpe, DannyS712, Nandana, sbassett, Lahi, Gq86, 
GoranSMilovanovic, QZanden, EBjune, LawExplorer, _jensen, rosalieper, Agabi10, 
Jonas, Wong128hk, Luke081515, Wikidata-bugs, aude, Bawolff, Lydia_Pintscher, 
csteipp, Mbch331, Rxy, Jay8g, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T234631: Setting up a wikibase for WikidataCon2019

2019-10-04 Thread Andrawaag 
Andrawaag updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T234631

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Andrawaag
Cc: Aklapper, Lea_Lacroix_WMDE, Andrawaag, darthmon_wmde, Jelabra, DannyS712, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Asahiko, Wikidata-bugs, aude, Addshore, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T234631: Setting up a wikibase for WikidataCon2019

2019-10-04 Thread Andrawaag 
Andrawaag created this task.
Andrawaag added a project: Wikibase-Containers.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  For WikidataCon we have created a Wikibase instance available at 
  Wikibase: http://185.54.115.247:8181/wiki/Main_Page
  WBQS: http://185.54.115.247:8282/
  
  The wikibase is still under development, suggestions and question are welcome 
here.

TASK DETAIL
  https://phabricator.wikimedia.org/T234631

WORKBOARD
  https://phabricator.wikimedia.org/project/board/3079/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Andrawaag
Cc: Aklapper, Lea_Lacroix_WMDE, Andrawaag, darthmon_wmde, Jelabra, DannyS712, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Asahiko, Wikidata-bugs, aude, Addshore, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Re: [Wikidata] Full-text / autocomplete search on labels

2019-10-04 Thread Kingsley Idehen 
On 10/4/19 10:57 AM, Kingsley Idehen wrote:
> On 10/4/19 3:58 AM, Thomas Francart wrote:
>> Hello
>>
>> I understand the wikidata SPARQL label service only fetches the
>> labels, but does not allow to search/filter on them; labels are also
>> available in regulare rdfs:label on which a FILTER can be made.
>> However I would like to do full-text search over labels, to e.g. feed
>> an autocomplete search field, actually just like the usual top-right
>> wikidata search field does. I would also be interested to combine
>> this with a criteria on "instance of", to search only on instances of
>> a given class.
>>
>> Can I do that efficiently using the Wikidata SPARQL service ? or is
>> there a separate API I could use ? (exemple welcome)
>>
>> Thanks
>> Thomas
>>
>> -- 
>> *
>> *
>> *Thomas Francart* -*SPARNA*
>> Web de _données_ | Architecture de l'_information_ | Accès aux
>> _connaissances_
>> blog : blog.sparna.fr , site : sparna.fr
>> , linkedin : fr.linkedin.com/in/thomasfrancart
>> 
>> tel :  +33 (0)6.71.11.25.97, skype : francartthomas
>
>
> Hi Thomas,
>
> Remember, we also publish a SPARQL Endpoint for Wikdata access [1].
> You can repeat your tests there too.
>
> Example (note that the retry loop indicates resources limits of this
> particular instance setup):
>
> Search on "Paris"
>
> http://wikidata.demo.openlinksw.com/fct/facet.vsp?qxml=%3C%3Fxml%20version%3D%221.0%22%20encoding%3D%22UTF-8%22%20%3F%3E%3Cquery%20inference%3D%22%22%20same-as%3D%22%22%20view3%3D%22%22%20s-term%3D%22%22%20c-term%3D%22%22%3E%3Ctext%3EParis%3C%2Ftext%3E%3Cview%20type%3D%22text-d%22%20limit%3D%2220%22%20offset%3D%22%22%20%2F%3E%3C%2Fquery%3E
> 
>
> Config:
>
> OpenLink Virtuoso version 08.03.3315 as of Sep 4 2019, on Linux
> (x86_64-generic-linux-glibc25), Single-Server Edition (378 GB total
> memory)
>
> Same thing using the LOD Cloud cache instance, where data is a little
> out of date also:
>
> http://lod.openlinksw.com/fct/facet.vsp?qxml=%3C%3Fxml%20version%3D%221.0%22%20encoding%3D%22UTF-8%22%20%3F%3E%3Cquery%20inference%3D%22%22%20same-as%3D%22%22%20view3%3D%22%22%20s-term%3D%22%22%20c-term%3D%22%22%3E%3Ctext%3EParis%3C%2Ftext%3E%3Cview%20type%3D%22text-d%22%20limit%3D%2220%22%20offset%3D%22%22%20%2F%3E%3C%2Fquery%3E
>
> Config:
>
> OpenLink Virtuoso version 07.20.3224 as of Dec 19 2017, on Linux
> (i686-generic-linux-glibc212-64), Cluster Edition (4 server processes,
> 756 GB total memory)
>
> Links
>
> [1] http://wikidata.demo.openlinksw.com/fct
>
> [2] http://wikidata.demo.openlinksw.com/sparql
>
>
> -- 
> Regards,
>
> Kingsley Idehen 
> Founder & CEO 
> OpenLink Software   
> Home Page: http://www.openlinksw.com
> Community Support: https://community.openlinksw.com
> Weblogs (Blogs):
> Company Blog: https://medium.com/openlink-software-blog
> Virtuoso Blog: https://medium.com/virtuoso-blog
> Data Access Drivers Blog: 
> https://medium.com/openlink-odbc-jdbc-ado-net-data-access-drivers
>
> Personal Weblogs (Blogs):
> Medium Blog: https://medium.com/@kidehen
> Legacy Blogs: http://www.openlinksw.com/blog/~kidehen/
>   http://kidehen.blogspot.com
>
> Profile Pages:
> Pinterest: https://www.pinterest.com/kidehen/
> Quora: https://www.quora.com/profile/Kingsley-Uyi-Idehen
> Twitter: https://twitter.com/kidehen
> Google+: https://plus.google.com/+KingsleyIdehen/about
> LinkedIn: http://www.linkedin.com/in/kidehen
>
> Web Identities (WebID):
> Personal: http://kingsley.idehen.net/public_home/kidehen/profile.ttl#i
> : 
> http://id.myopenlink.net/DAV/home/KingsleyUyiIdehen/Public/kingsley.ttl#this
>

SPARQL Query variants:

Wikidata SPARQL Endpoint at http://wikidata.demo.openlinksw.com/sparql :

https://wikidata.demo.openlinksw.com/sparql?default-graph-uri==%0D%0Aselect+%3Fs+%3Fo+%0D%0Awhere+%0D%0A++%7B+%0D%0A++graph+%3Fg+%0D%0A++%7B+%0D%0A+%3Fs+rdfs%3Alabel+%3Fo+.%0D%0A+%3Fo+bif%3Acontains++%27%22Paris%22%27++.%0D%0A+filter+%28lang%28%3Fo%29+%3D+%22en%22%29%0D%0A%0D%0A++%7D%0D%0A%0D%0A++%7D%0D%0A%0D%0Alimit+100+=text%2Fhtml_redir_for_subjs=121_redir_for_hrefs==3_void=on_unconnected=on=+Run+Query+


-- 
Regards,

Kingsley Idehen   
Founder & CEO 
OpenLink Software   
Home Page: http://www.openlinksw.com
Community Support: https://community.openlinksw.com
Weblogs (Blogs):
Company Blog: https://medium.com/openlink-software-blog
Virtuoso Blog: https://medium.com/virtuoso-blog
Data Access Drivers Blog: 
https://medium.com/openlink-odbc-jdbc-ado-net-data-access-drivers

Personal Weblogs (Blogs):
Medium Blog:

Re: [Wikidata] Full-text / autocomplete search on labels

2019-10-04 Thread Kingsley Idehen 
On 10/4/19 3:58 AM, Thomas Francart wrote:
> Hello
>
> I understand the wikidata SPARQL label service only fetches the
> labels, but does not allow to search/filter on them; labels are also
> available in regulare rdfs:label on which a FILTER can be made.
> However I would like to do full-text search over labels, to e.g. feed
> an autocomplete search field, actually just like the usual top-right
> wikidata search field does. I would also be interested to combine this
> with a criteria on "instance of", to search only on instances of a
> given class.
>
> Can I do that efficiently using the Wikidata SPARQL service ? or is
> there a separate API I could use ? (exemple welcome)
>
> Thanks
> Thomas
>
> -- 
> *
> *
> *Thomas Francart* -*SPARNA*
> Web de _données_ | Architecture de l'_information_ | Accès aux
> _connaissances_
> blog : blog.sparna.fr , site : sparna.fr
> , linkedin : fr.linkedin.com/in/thomasfrancart
> 
> tel :  +33 (0)6.71.11.25.97, skype : francartthomas


Hi Thomas,

Remember, we also publish a SPARQL Endpoint for Wikdata access [1]. You
can repeat your tests there too.

Example (note that the retry loop indicates resources limits of this
particular instance setup):

Search on "Paris"

http://wikidata.demo.openlinksw.com/fct/facet.vsp?qxml=%3C%3Fxml%20version%3D%221.0%22%20encoding%3D%22UTF-8%22%20%3F%3E%3Cquery%20inference%3D%22%22%20same-as%3D%22%22%20view3%3D%22%22%20s-term%3D%22%22%20c-term%3D%22%22%3E%3Ctext%3EParis%3C%2Ftext%3E%3Cview%20type%3D%22text-d%22%20limit%3D%2220%22%20offset%3D%22%22%20%2F%3E%3C%2Fquery%3E


Config:

OpenLink Virtuoso version 08.03.3315 as of Sep 4 2019, on Linux
(x86_64-generic-linux-glibc25), Single-Server Edition (378 GB total memory)

Same thing using the LOD Cloud cache instance, where data is a little
out of date also:

http://lod.openlinksw.com/fct/facet.vsp?qxml=%3C%3Fxml%20version%3D%221.0%22%20encoding%3D%22UTF-8%22%20%3F%3E%3Cquery%20inference%3D%22%22%20same-as%3D%22%22%20view3%3D%22%22%20s-term%3D%22%22%20c-term%3D%22%22%3E%3Ctext%3EParis%3C%2Ftext%3E%3Cview%20type%3D%22text-d%22%20limit%3D%2220%22%20offset%3D%22%22%20%2F%3E%3C%2Fquery%3E

Config:

OpenLink Virtuoso version 07.20.3224 as of Dec 19 2017, on Linux
(i686-generic-linux-glibc212-64), Cluster Edition (4 server processes,
756 GB total memory)

Links

[1] http://wikidata.demo.openlinksw.com/fct

[2] http://wikidata.demo.openlinksw.com/sparql


-- 
Regards,

Kingsley Idehen   
Founder & CEO 
OpenLink Software   
Home Page: http://www.openlinksw.com
Community Support: https://community.openlinksw.com
Weblogs (Blogs):
Company Blog: https://medium.com/openlink-software-blog
Virtuoso Blog: https://medium.com/virtuoso-blog
Data Access Drivers Blog: 
https://medium.com/openlink-odbc-jdbc-ado-net-data-access-drivers

Personal Weblogs (Blogs):
Medium Blog: https://medium.com/@kidehen
Legacy Blogs: http://www.openlinksw.com/blog/~kidehen/
  http://kidehen.blogspot.com

Profile Pages:
Pinterest: https://www.pinterest.com/kidehen/
Quora: https://www.quora.com/profile/Kingsley-Uyi-Idehen
Twitter: https://twitter.com/kidehen
Google+: https://plus.google.com/+KingsleyIdehen/about
LinkedIn: http://www.linkedin.com/in/kidehen

Web Identities (WebID):
Personal: http://kingsley.idehen.net/public_home/kidehen/profile.ttl#i
: 
http://id.myopenlink.net/DAV/home/KingsleyUyiIdehen/Public/kingsley.ttl#this



smime.p7s
Description: S/MIME Cryptographic Signature
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Full-text / autocomplete search on labels

2019-10-04 Thread Tim Thompson 
Great to learn about these features/extensions. However, I'm confused by
the results in Lucas's example query for WikibaseCirrusSearch. How is the
string "einst" being matched here?

Thanks,
Tim

--
Tim A. Thompson
Discovery Metadata Librarian
Yale University Library

On Fri, Oct 4, 2019 at 8:54 AM Lucas Werkmeister 
wrote:

> If you use regular search rather than entity search, you can use
> WikibaseCirrusSearch
> 
> search keywords like "haswbstatement:P31=Q5". Note that this uses a
> different kind of search, though – I think it only matches full words
> (after stemming and other transformations?), not prefixes. Query Link
> 
>
> Cheers,
> Lucas
> On 04.10.19 10:22, Ettore RIZZA wrote:
>
> Forgot to mention: you can do the same search using the API only:
> https://www.wikidata.org/w/api.php?action=wbsearchentities=einst=en=json
>
> But not sure you can easily filter the results by "instance of".
>
> Ettore Rizza
>
>
> On Fri, 4 Oct 2019 at 10:15, Ettore RIZZA  wrote:
>
>> Hello Thomas,
>>
>> You can perform a full text search with the API, but not yet with SPARQL
>> AFAIK. However, it is possible to call the API in a SPARQL query. For
>> example, here is a query
>> 
>> that looks for "human (Q5)"  whose label contains the string "einst".
>>
>> Hope this helps,
>>
>> Ettore Rizza
>>
>>
>> On Fri, 4 Oct 2019 at 09:58, Thomas Francart 
>> wrote:
>>
>>> Hello
>>>
>>> I understand the wikidata SPARQL label service only fetches the labels,
>>> but does not allow to search/filter on them; labels are also available in
>>> regulare rdfs:label on which a FILTER can be made.
>>> However I would like to do full-text search over labels, to e.g. feed an
>>> autocomplete search field, actually just like the usual top-right wikidata
>>> search field does. I would also be interested to combine this with a
>>> criteria on "instance of", to search only on instances of a given class.
>>>
>>> Can I do that efficiently using the Wikidata SPARQL service ? or is
>>> there a separate API I could use ? (exemple welcome)
>>>
>>> Thanks
>>> Thomas
>>>
>>> --
>>>
>>> *Thomas Francart* -* SPARNA*
>>> Web de *données* | Architecture de l'*information* | Accès aux
>>> *connaissances*
>>> blog : blog.sparna.fr, site : sparna.fr, linkedin :
>>> fr.linkedin.com/in/thomasfrancart
>>> tel :  +33 (0)6.71.11.25.97, skype : francartthomas
>>> ___
>>> Wikidata mailing list
>>> Wikidata@lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>>
>>
> ___
> Wikidata mailing 
> listWikidata@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/wikidata
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata-tech] Installing Wikibase Cirrus Search

2019-10-04 Thread David Causse 
Please see my responses below

On Fri, Oct 4, 2019 at 3:41 PM Thad Guidry  wrote:

> Hi Michael,
>
> It's the official signup page here?
> https://lists.wikimedia.org/mailman/listinfo/Wikimedia-search
>
> No it is here: https://lists.wikimedia.org/mailman/listinfo/discovery


>
>> On Mon, Sep 30, 2019 at 11:27 AM Kévin Bois <
>> kevin.b...@biblissima-condorcet.fr> wrote:
>>
>>> Hello,
>>>
>>> I'm having a hard time setting up Cirrus Search on my Mediawiki /
>>> Wikibase instance, I'm quite confused so I thought I could ask for some
>>> help. :)
>>>
>>> First, I followed the instructions to install both CirrusSearch and
>>> WikibaseCirrusSearch (WBCS) extensions, but I don't really know what my
>>> LocalSettings.php config file should look like.
>>> On one hand, CirrusSearch asks for this option`$wgSearchType =
>>> 'CirrusSearch';`, on the other hand WBCS asks for `$wgWBCSUseCirrus =
>>> true;`. When I put them both, I get a php error : 
>>> `mediawiki/extensions/CirrusSearch/includes/Profile/SearchProfileService.php:
>>> A profile repository type rescore named wikibase_base is already registered.
>>> `
>>> 1/ So, do I need only one of them or is something else missing in my
>>> config file ? I might have missed a step in the installation ?
>>> 2/ The weird thing is, if I remove one of the two option, the search is
>>> somewhat working and is different than before using CirrusSearch, but
>>> autocompletion seems off, as it autocomplete only strings like "Item:QXXX"
>>> where XXX is the QID. I would have expected an autocomplete on item labels,
>>> not on QIDs like on Wikidata
>>> 3/ I'm not sure either if I have to fire some CirrusSearch maintenance
>>> scripts when I'm toying around with WBCS options in LocalSettings.php,
>>> because it appears that WBCS extension doesn't have any.
>>>
>>> I apology in advance because I'm pretty sure this is a confusing post,
>>> but there are quite a lot of questions in my head. :)
>>>
>>
1/ It is very probable that the version of the wikibase code that is
installed still contain the CirrusSearch integration code.
This code has been extracted in WikibaseCirrusSearch but during a
transition period we kept the same code in both extensions (Wikibase and
WikibaseCirrusSearch), enabling this code in both Wikibase and
WikibaseCirrusSearch might lead to such error.
If my assumption is correct setting "disableCirrus" to true in the Wikibase
settings array might solve the problem as it will disable the CirrusSearch
integration code present in Wikibase letting the one present in
WikibaseCirrusSearch works (enabled with $wgWBCSUseCirrus = true).
If not: having the exact version (or git revision hash) of these 3
extensions will help.

2/ By removing one of the two options you'll certainly end-up
enabling/disabling CirrusSearch

3/ Yes in general you should run updateSearchIndexConfig.php and
forceSearchIndex.php when enabling the extension, please see the README
file in Cirrus, there are no specific maint script for the wikibase cirrus
integration.

Hope it helps,

David.
___
Wikidata-tech mailing list
Wikidata-tech@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata] Full-text / autocomplete search on labels

2019-10-04 Thread Thomas Francart 
Ettore, Lucas, thanks a lof for your answers, that's what I was looking for.
Searching for an entity based on a label + language (and optionally
additionnal criteria like instance of) looks like a reasonable use-case,
this could be "packaged" inside magic triples to make this feature directly
available in SPARQL (as other triplestores with full-text/index-based
search are doing).

Cheers
Thomas

Le ven. 4 oct. 2019 à 14:55, Lucas Werkmeister  a
écrit :

> If you use regular search rather than entity search, you can use
> WikibaseCirrusSearch
> 
> search keywords like "haswbstatement:P31=Q5". Note that this uses a
> different kind of search, though – I think it only matches full words
> (after stemming and other transformations?), not prefixes. Query Link
> 
>
> Cheers,
> Lucas
> On 04.10.19 10:22, Ettore RIZZA wrote:
>
> Forgot to mention: you can do the same search using the API only:
> https://www.wikidata.org/w/api.php?action=wbsearchentities=einst=en=json
>
> But not sure you can easily filter the results by "instance of".
>
> Ettore Rizza
>
>
> On Fri, 4 Oct 2019 at 10:15, Ettore RIZZA  wrote:
>
>> Hello Thomas,
>>
>> You can perform a full text search with the API, but not yet with SPARQL
>> AFAIK. However, it is possible to call the API in a SPARQL query. For
>> example, here is a query
>> 
>> that looks for "human (Q5)"  whose label contains the string "einst".
>>
>> Hope this helps,
>>
>> Ettore Rizza
>>
>>
>> On Fri, 4 Oct 2019 at 09:58, Thomas Francart 
>> wrote:
>>
>>> Hello
>>>
>>> I understand the wikidata SPARQL label service only fetches the labels,
>>> but does not allow to search/filter on them; labels are also available in
>>> regulare rdfs:label on which a FILTER can be made.
>>> However I would like to do full-text search over labels, to e.g. feed an
>>> autocomplete search field, actually just like the usual top-right wikidata
>>> search field does. I would also be interested to combine this with a
>>> criteria on "instance of", to search only on instances of a given class.
>>>
>>> Can I do that efficiently using the Wikidata SPARQL service ? or is
>>> there a separate API I could use ? (exemple welcome)
>>>
>>> Thanks
>>> Thomas
>>>
>>> --
>>>
>>> *Thomas Francart* -* SPARNA*
>>> Web de *données* | Architecture de l'*information* | Accès aux
>>> *connaissances*
>>> blog : blog.sparna.fr, site : sparna.fr, linkedin :
>>> fr.linkedin.com/in/thomasfrancart
>>> tel :  +33 (0)6.71.11.25.97, skype : francartthomas
>>> ___
>>> Wikidata mailing list
>>> Wikidata@lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>>
>>
> ___
> Wikidata mailing 
> listWikidata@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/wikidata
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>


-- 

*Thomas Francart* -* SPARNA*
Web de *données* | Architecture de l'*information* | Accès aux
*connaissances*
blog : blog.sparna.fr, site : sparna.fr, linkedin :
fr.linkedin.com/in/thomasfrancart
tel :  +33 (0)6.71.11.25.97, skype : francartthomas
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata-tech] Installing Wikibase Cirrus Search

2019-10-04 Thread Thad Guidry 
Hi Michael,

It's the official signup page here?
https://lists.wikimedia.org/mailman/listinfo/Wikimedia-search

If not, then perhaps there needs to be a bit of cleanup on the Mailing
lists page:  https://meta.wikimedia.org/wiki/Mailing_lists/Overview
where I saw a few mentions of "discovery".

Thad
https://www.linkedin.com/in/thadguidry/


On Fri, Oct 4, 2019 at 8:29 AM Michael Holloway 
wrote:

> Hello Kevin,
>
> Yes, WikibaseCirrusSearch can be tricky to install.  I'd recommend asking
> your question again on the Search and Discovery mailing list (
> discov...@lists.wikimedia.org), where it's more likely to reach a member
> of the Wikimedia Search Platform Team, who are most likely to be able to
> help.
>
> Good luck!
> Michael
>
> On Mon, Sep 30, 2019 at 11:27 AM Kévin Bois <
> kevin.b...@biblissima-condorcet.fr> wrote:
>
>> Hello,
>>
>> I'm having a hard time setting up Cirrus Search on my Mediawiki /
>> Wikibase instance, I'm quite confused so I thought I could ask for some
>> help. :)
>>
>> First, I followed the instructions to install both CirrusSearch and
>> WikibaseCirrusSearch (WBCS) extensions, but I don't really know what my
>> LocalSettings.php config file should look like.
>> On one hand, CirrusSearch asks for this option`$wgSearchType =
>> 'CirrusSearch';`, on the other hand WBCS asks for `$wgWBCSUseCirrus =
>> true;`. When I put them both, I get a php error : 
>> `mediawiki/extensions/CirrusSearch/includes/Profile/SearchProfileService.php:
>> A profile repository type rescore named wikibase_base is already registered.
>> `
>> 1/ So, do I need only one of them or is something else missing in my
>> config file ? I might have missed a step in the installation ?
>> 2/ The weird thing is, if I remove one of the two option, the search is
>> somewhat working and is different than before using CirrusSearch, but
>> autocompletion seems off, as it autocomplete only strings like "Item:QXXX"
>> where XXX is the QID. I would have expected an autocomplete on item labels,
>> not on QIDs like on Wikidata
>> 3/ I'm not sure either if I have to fire some CirrusSearch maintenance
>> scripts when I'm toying around with WBCS options in LocalSettings.php,
>> because it appears that WBCS extension doesn't have any.
>>
>> I apology in advance because I'm pretty sure this is a confusing post,
>> but there are quite a lot of questions in my head. :)
>>
>> Kevin
>> ___
>> Wikidata-tech mailing list
>> Wikidata-tech@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata-tech
>>
>
>
> --
> Michael Holloway
> Software Engineer, Product Infrastructure
> ___
> Wikidata-tech mailing list
> Wikidata-tech@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata-tech
>
___
Wikidata-tech mailing list
Wikidata-tech@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata] Full-text / autocomplete search on labels

2019-10-04 Thread Thad Guidry 
A few things of note:
1. the label service adds its variables very late during query evaluation;
at the point where you try to FILTER on ?humanLabel, the label service
hasn’t created that variable yet.
2. the label service isn’t the only way to get an item’s label. Labels are
also stored as regular triples, using the predicate rdfs:label. Of course,
this means all labels, not just English ones; if we only want English
labels, we’ll have to filter on the language of the label:
3. One can also use FILTER with a regular expression. In the following
example

SELECT ?item ?itemLabel ?bblidWHERE {
?item wdt:P2580 ?bblid .
SERVICE wikibase:label { bd:serviceParam wikibase:language
"[AUTO_LANGUAGE],en" }
FILTER(!REGEX(STR(?bblid), "[\\.q]")) }

Read thoroughly the FILTER section in the Wikidata:SPARQL tutorial
 to read
more about options above and others FILTER functions available.

Here's some extra example's:

https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples#Scholarly_articles_with_%22Zika%22_in_the_item_label

https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples#Actors_whose_Spanish_label_ends_with_%E2%80%9C_(actor)%E2%80%9D

https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples#Distribution_of_names_of_human_settlements_ending_in_%22-ow%22_or_%22-itz%22_in_Germany

https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples#Rock_bands_that_start_with_%22M%22

Thad
https://www.linkedin.com/in/thadguidry/


On Fri, Oct 4, 2019 at 6:09 AM Houcemeddine A. Turki <
turkiabdelwa...@hotmail.fr> wrote:

> Dear Mr.,
> I thank you for the query. This is absolutely useful to ameliorate data
> mining methods for Wikidata. I always said that Wikidata Query Service is
> still misused.
> Yours Sincerely,
> Houcemeddine Turki (he/him)
> Medical Student, Faculty of Medicine of Sfax, University of Sfax, Tunisia
> GLAM, Research and Education Coordinator, Wikimedia TN User Group
> Member, Wiki Project Med
> Member, WikiIndaba Steering Committee
> Member, Wikimedia and Library User Group Steering Committee
> 
> +21629499418
>
>
>  Message d'origine 
> De : Ettore RIZZA 
> Date : 2019/10/04 09:15 (GMT+01:00)
> À : Discussion list for the Wikidata project 
>
> Objet : Re: [Wikidata] Full-text / autocomplete search on labels
>
> Hello Thomas,
>
> You can perform a full text search with the API, but not yet with SPARQL
> AFAIK. However, it is possible to call the API in a SPARQL query. For
> example, here is a query
> 
> that looks for "human (Q5)"  whose label contains the string "einst".
>
> Hope this helps,
>
> Ettore Rizza
>
>
> On Fri, 4 Oct 2019 at 09:58, Thomas Francart 
> wrote:
>
>> Hello
>>
>> I understand the wikidata SPARQL label service only fetches the labels,
>> but does not allow to search/filter on them; labels are also available in
>> regulare rdfs:label on which a FILTER can be made.
>> However I would like to do full-text search over labels, to e.g. feed an
>> autocomplete search field, actually just like the usual top-right wikidata
>> search field does. I would also be interested to combine this with a
>> criteria on "instance of", to search only on instances of a given class.
>>
>> Can I do that efficiently using the Wikidata SPARQL service ? or is there
>> a separate API I could use ? (exemple welcome)
>>
>> Thanks
>> Thomas
>>
>> --
>>
>> *Thomas Francart* -* SPARNA*
>> Web de *données* | Architecture de l'*information* | Accès aux
>> *connaissances*
>> blog : blog.sparna.fr, site : sparna.fr, linkedin :
>> fr.linkedin.com/in/thomasfrancart
>> tel :  +33 (0)6.71.11.25.97, skype : francartthomas
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org

Re: [Wikidata-tech] Installing Wikibase Cirrus Search

2019-10-04 Thread Michael Holloway 
Hello Kevin,

Yes, WikibaseCirrusSearch can be tricky to install.  I'd recommend asking
your question again on the Search and Discovery mailing list (
discov...@lists.wikimedia.org), where it's more likely to reach a member of
the Wikimedia Search Platform Team, who are most likely to be able to help.

Good luck!
Michael

On Mon, Sep 30, 2019 at 11:27 AM Kévin Bois <
kevin.b...@biblissima-condorcet.fr> wrote:

> Hello,
>
> I'm having a hard time setting up Cirrus Search on my Mediawiki / Wikibase
> instance, I'm quite confused so I thought I could ask for some help. :)
>
> First, I followed the instructions to install both CirrusSearch and
> WikibaseCirrusSearch (WBCS) extensions, but I don't really know what my
> LocalSettings.php config file should look like.
> On one hand, CirrusSearch asks for this option`$wgSearchType =
> 'CirrusSearch';`, on the other hand WBCS asks for `$wgWBCSUseCirrus =
> true;`. When I put them both, I get a php error : 
> `mediawiki/extensions/CirrusSearch/includes/Profile/SearchProfileService.php:
> A profile repository type rescore named wikibase_base is already registered.
> `
> 1/ So, do I need only one of them or is something else missing in my
> config file ? I might have missed a step in the installation ?
> 2/ The weird thing is, if I remove one of the two option, the search is
> somewhat working and is different than before using CirrusSearch, but
> autocompletion seems off, as it autocomplete only strings like "Item:QXXX"
> where XXX is the QID. I would have expected an autocomplete on item labels,
> not on QIDs like on Wikidata
> 3/ I'm not sure either if I have to fire some CirrusSearch maintenance
> scripts when I'm toying around with WBCS options in LocalSettings.php,
> because it appears that WBCS extension doesn't have any.
>
> I apology in advance because I'm pretty sure this is a confusing post, but
> there are quite a lot of questions in my head. :)
>
> Kevin
> ___
> Wikidata-tech mailing list
> Wikidata-tech@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata-tech
>


-- 
Michael Holloway
Software Engineer, Product Infrastructure
___
Wikidata-tech mailing list
Wikidata-tech@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata] Full-text / autocomplete search on labels

2019-10-04 Thread Lucas Werkmeister 
If you use regular search rather than entity search, you can use
WikibaseCirrusSearch

search keywords like "haswbstatement:P31=Q5". Note that this uses a
different kind of search, though – I think it only matches full words
(after stemming and other transformations?), not prefixes. Query Link


Cheers,
Lucas

On 04.10.19 10:22, Ettore RIZZA wrote:
> Forgot to mention: you can do the same search using the API
> only: 
> https://www.wikidata.org/w/api.php?action=wbsearchentities=einst=en=json
>
>
> But not sure you can easily filter the results by "instance of".
>
> Ettore Rizza
>
>
> On Fri, 4 Oct 2019 at 10:15, Ettore RIZZA  > wrote:
>
> Hello Thomas,
>
> You can perform a full text search with the API, but not yet with
> SPARQL AFAIK. However, it is possible to call the API in a SPARQL
> query. For example, here is a query
> 
> 
> that looks for "human (Q5)"  whose label contains the string "einst".
>
> Hope this helps,
>
> Ettore Rizza
>
>
> On Fri, 4 Oct 2019 at 09:58, Thomas Francart
> mailto:thomas.franc...@sparna.fr>> wrote:
>
> Hello
>
> I understand the wikidata SPARQL label service only fetches
> the labels, but does not allow to search/filter on them;
> labels are also available in regulare rdfs:label on which a
> FILTER can be made.
> However I would like to do full-text search over labels, to
> e.g. feed an autocomplete search field, actually just like the
> usual top-right wikidata search field does. I would also be
> interested to combine this with a criteria on "instance of",
> to search only on instances of a given class.
>
> Can I do that efficiently using the Wikidata SPARQL service ?
> or is there a separate API I could use ? (exemple welcome)
>
> Thanks
> Thomas
>
> -- 
> *
> *
> *Thomas Francart* -*SPARNA*
> Web de _données_ | Architecture de l'_information_ | Accès aux
> _connaissances_
> blog : blog.sparna.fr , site :
> sparna.fr , linkedin :
> fr.linkedin.com/in/thomasfrancart
> 
> tel :  +33 (0)6.71.11.25.97, skype : francartthomas
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org 
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

[Wikidata-bugs] [Maniphest] [Updated] T233219: Merge config modules to their parent

2019-10-04 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T233219

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup, gerritbot
Cc: Aklapper, Ladsgroup, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, 
E.S.A-Sheild, darthmon_wmde, Meekrab2012, joker88john, DannyS712, CucyNoiD, 
Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, 
Adrian1985, Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, 
GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, 
LawExplorer, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T233219: Merge config modules to their parent

2019-10-04 Thread gerritbot 
gerritbot added a comment.


  Change 540844 had a related patch set uploaded (by Ladsgroup; owner: 
Ladsgroup):
  [mediawiki/extensions/WikibaseLexeme@master] Drop 
LexemeLanguageCodePropertyIdConfig
  
  https://gerrit.wikimedia.org/r/540844

TASK DETAIL
  https://phabricator.wikimedia.org/T233219

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup, gerritbot
Cc: Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Re: [Wikidata] Full-text / autocomplete search on labels

2019-10-04 Thread Houcemeddine A. Turki 
Dear Mr.,
I thank you for your efforts. I ask if a tutorial about merging Wikidata API 
with Wikidata Query Service or about doing federated queries with Wikidata 
Query Service can be done.
Yours Sincerely,
Houcemeddine Turki (he/him)
Medical Student, Faculty of Medicine of Sfax, University of Sfax, Tunisia
GLAM, Research and Education Coordinator, Wikimedia TN User Group
Member, Wiki Project Med
Member, WikiIndaba Steering Committee
Member, Wikimedia and Library User Group Steering Committee

+21629499418


 Message d'origine 
De : "Houcemeddine A. Turki" 
Date : 2019/10/04 12:09 (GMT+01:00)
À : Ettore RIZZA , Discussion list for the Wikidata 
project 
Objet : Re: [Wikidata] Full-text / autocomplete search on labels

Dear Mr.,
I thank you for the query. This is absolutely useful to ameliorate data mining 
methods for Wikidata. I always said that Wikidata Query Service is still 
misused.
Yours Sincerely,
Houcemeddine Turki (he/him)
Medical Student, Faculty of Medicine of Sfax, University of Sfax, Tunisia
GLAM, Research and Education Coordinator, Wikimedia TN User Group
Member, Wiki Project Med
Member, WikiIndaba Steering Committee
Member, Wikimedia and Library User Group Steering Committee

+21629499418


 Message d'origine 
De : Ettore RIZZA 
Date : 2019/10/04 09:15 (GMT+01:00)
À : Discussion list for the Wikidata project 
Objet : Re: [Wikidata] Full-text / autocomplete search on labels

Hello Thomas,

You can perform a full text search with the API, but not yet with SPARQL AFAIK. 
However, it is possible to call the API in a SPARQL query. For example, here is 
a 
query
 that looks for "human (Q5)"  whose label contains the string "einst".

Hope this helps,

Ettore Rizza


On Fri, 4 Oct 2019 at 09:58, Thomas Francart 
mailto:thomas.franc...@sparna.fr>> wrote:
Hello

I understand the wikidata SPARQL label service only fetches the labels, but 
does not allow to search/filter on them; labels are also available in regulare 
rdfs:label on which a FILTER can be made.
However I would like to do full-text search over labels, to e.g. feed an 
autocomplete search field, actually just like the usual top-right wikidata 
search field does. I would also be interested to combine this with a criteria 
on "instance of", to search only on instances of a given class.

Can I do that efficiently using the Wikidata SPARQL service ? or is there a 
separate API I could use ? (exemple welcome)

Thanks
Thomas

--

Thomas Francart - SPARNA
Web de données | Architecture de l'information | Accès aux connaissances
blog : blog.sparna.fr, site : 
sparna.fr, linkedin : 
fr.linkedin.com/in/thomasfrancart
tel :  +33 (0)6.71.11.25.97, skype : francartthomas
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Full-text / autocomplete search on labels

2019-10-04 Thread Houcemeddine A. Turki 
Dear Mr.,
I thank you for the query. This is absolutely useful to ameliorate data mining 
methods for Wikidata. I always said that Wikidata Query Service is still 
misused.
Yours Sincerely,
Houcemeddine Turki (he/him)
Medical Student, Faculty of Medicine of Sfax, University of Sfax, Tunisia
GLAM, Research and Education Coordinator, Wikimedia TN User Group
Member, Wiki Project Med
Member, WikiIndaba Steering Committee
Member, Wikimedia and Library User Group Steering Committee

+21629499418


 Message d'origine 
De : Ettore RIZZA 
Date : 2019/10/04 09:15 (GMT+01:00)
À : Discussion list for the Wikidata project 
Objet : Re: [Wikidata] Full-text / autocomplete search on labels

Hello Thomas,

You can perform a full text search with the API, but not yet with SPARQL AFAIK. 
However, it is possible to call the API in a SPARQL query. For example, here is 
a 
query
 that looks for "human (Q5)"  whose label contains the string "einst".

Hope this helps,

Ettore Rizza


On Fri, 4 Oct 2019 at 09:58, Thomas Francart 
mailto:thomas.franc...@sparna.fr>> wrote:
Hello

I understand the wikidata SPARQL label service only fetches the labels, but 
does not allow to search/filter on them; labels are also available in regulare 
rdfs:label on which a FILTER can be made.
However I would like to do full-text search over labels, to e.g. feed an 
autocomplete search field, actually just like the usual top-right wikidata 
search field does. I would also be interested to combine this with a criteria 
on "instance of", to search only on instances of a given class.

Can I do that efficiently using the Wikidata SPARQL service ? or is there a 
separate API I could use ? (exemple welcome)

Thanks
Thomas

--

Thomas Francart - SPARNA
Web de données | Architecture de l'information | Accès aux connaissances
blog : blog.sparna.fr, site : 
sparna.fr, linkedin : 
fr.linkedin.com/in/thomasfrancart
tel :  +33 (0)6.71.11.25.97, skype : francartthomas
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

[Wikidata-bugs] [Maniphest] [Closed] T232465: List of WikibaseLexeme javascript entry points and other modules that can't be dropped

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T232465

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Rosalie_WMDE, alaa_wmde, Jakob_WMDE, Ladsgroup, darthmon_wmde, DannyS712, 
Nandana, Mringgaard, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Wikidata-bugs, aude, Lydia_Pintscher, Darkdadaah, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T232729: Identify root modules of special pages in Wikibase

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T232729

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Ladsgroup, Aklapper, Jakob_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T232731: Wikibase: identify lazy loaded RL modules

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T232731

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Rosalie_WMDE, Aklapper, Jakob_WMDE, darthmon_wmde, DannyS712, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T232823: Move entitysearch module into a package module

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T232823

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jakob_WMDE, Ladsgroup
Cc: Aklapper, Jakob_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T232728: Create a dependency graph of existing RL modules

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T232728

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Agabi10, Rosalie_WMDE, Ladsgroup, Aklapper, Jakob_WMDE, darthmon_wmde, 
DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T232732: Create custom RL module for loading test files through packageFiles

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T232732

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jakob_WMDE, Ladsgroup
Cc: Aklapper, Jakob_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T232733: Move dependencies of Special:NewLexeme into packageFiles

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T232733

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jakob_WMDE, Ladsgroup
Cc: Aklapper, Jakob_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233013: Merge depencies into wikibase.lexeme.view.ControllerViewfactory

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233013

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233001: Move wikibase.lexeme.special.NewLexeme.styles into wikibase.lexeme.special.NewLexeme

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233001

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Aklapper, Jakob_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233150: Merge dependencies into wikibase.dataTypeStore

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233195: Merge 'wikibase.lexeme.datamodel.LexemeSubEntityId' into 'jquery.wikibase.lexemeformview'

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233195

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Aklapper, Rosalie_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233015: Merge 'wikibase.serialization.TermSerializer' into 'wikibase.serialization.TermMapSerializer'

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233015

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Rosalie_WMDE, Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T232824: Move wikibase.serialization into a package module

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T232824

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Aklapper, Jakob_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233018: Merge dependencies into wikibase.serialization.EntityDeserializer

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233018

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jakob_WMDE, Ladsgroup
Cc: Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233218: Merge direct dependencies of wikibase.ui.entityViewInit

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233218

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jakob_WMDE, Ladsgroup
Cc: Aklapper, Ladsgroup, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, 
E.S.A-Sheild, darthmon_wmde, Meekrab2012, joker88john, DannyS712, CucyNoiD, 
Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, 
Adrian1985, Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, 
GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, 
LawExplorer, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233110: Merge wikibase.lexeme.widgets.itemSelectorWrapper into wikibase.lexeme.widgets.LanguageAndLexicalCategoryWidget

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233110

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Aklapper, Rosalie_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233462: List of modules that are shared between several entry points

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233462

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Rosalie_WMDE, Jakob_WMDE, Aklapper, Ladsgroup, darthmon_wmde, DannyS712, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T233605: Merge shared dependencies of entityViewInit and LexemeView

2019-10-04 Thread Ladsgroup 
Ladsgroup closed subtask T233705: Merge StatementGroupSetDeserializer 
dependencies as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T233605

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233334: Merge sense/form dependencies of jquery.wikibase.lexemeview

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T24

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233216: Merge direct dependencies into lexeme-header

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233216

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Rosalie_WMDE, Aklapper, Jakob_WMDE, darthmon_wmde, DannyS712, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233212: Merge wikibase.api.RepoApi and wikibase.api.getLocationAgnosticMwApi

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233212

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Rosalie_WMDE, Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233217: Start untangling valueview

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".
Restricted Application added a project: Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T233217

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jakob_WMDE, Ladsgroup
Cc: Aklapper, Jakob_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233601: Merge some jquery.ui modules for Wikibase

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233601

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233705: Merge StatementGroupSetDeserializer dependencies

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233705

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jakob_WMDE, Ladsgroup
Cc: Aklapper, Jakob_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233224: Untangle dependencies of wikibase.lexeme.ViewFactoryFactory

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233224

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233775: merge wikibase.lexeme.widgets.LanguageSelectorWrapper into wikibase.lexeme.widgets.GlossWidget

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233775

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Aklapper, Rosalie_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233782: merge wikibase.lexeme.store.actions to wikibase.lexeme.store

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233782

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Aklapper, Rosalie_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233776: merge wikibase.lexeme.store.mutation into wikibase.lexeme.store

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233776

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Aklapper, Rosalie_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T233913: Finish merging modules into wikibase.lexeme.lexemeview

2019-10-04 Thread Ladsgroup 
Ladsgroup closed subtask T233912: Drop wikibase.lexeme.lexemeview.viewhook as 
Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T233913

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Rosalie_WMDE, Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233910: Redo the broken valueview patch

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233910

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jakob_WMDE, Ladsgroup
Cc: Aklapper, Jakob_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233916: Drop wikibase.lexeme.store

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233916

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Ladsgroup, Aklapper, Rosalie_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233786: merge wikibase.lexeme.store.mutationTypes into wikibase.lexeme.store

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233786

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Aklapper, Rosalie_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T233913: Finish merging modules into wikibase.lexeme.lexemeview

2019-10-04 Thread Ladsgroup 
Ladsgroup closed subtask T233916: Drop wikibase.lexeme.store as 
Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T233913

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Rosalie_WMDE, Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233912: Drop wikibase.lexeme.lexemeview.viewhook

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233912

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Aklapper, Rosalie_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T233913: Finish merging modules into wikibase.lexeme.lexemeview

2019-10-04 Thread Ladsgroup 
Ladsgroup closed subtask T233919: Drop 
wikibase.lexeme.widgets.InvalidLanguageIndicator  as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T233913

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Rosalie_WMDE, Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T233919: Drop wikibase.lexeme.widgets.InvalidLanguageIndicator

2019-10-04 Thread Ladsgroup 
Ladsgroup closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T233919

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rosalie_WMDE, Ladsgroup
Cc: Ladsgroup, Aklapper, Rosalie_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T233790: Untangle datamodel dependency tree

2019-10-04 Thread Ladsgroup 
Ladsgroup added a comment.


  BTW. Looking at current graph of Wikibase dependencies, it's very obvious how 
much this work is needed:
  F30543312: G.png 

TASK DETAIL
  https://phabricator.wikimedia.org/T233790

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jakob_WMDE, Ladsgroup
Cc: Ladsgroup, Aklapper, Jakob_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T233792: Merge dependencies into jquery.view.ViewFactory

2019-10-04 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T233792

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup, gerritbot
Cc: Rosalie_WMDE, Aklapper, Ladsgroup, Hook696, Daryl-TTMG, RomaAmorRoma, 
0010318400, E.S.A-Sheild, darthmon_wmde, Meekrab2012, joker88john, DannyS712, 
CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, 
Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, 
Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, 
LawExplorer, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, Wikidata-bugs, 
aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T233792: Merge dependencies into jquery.view.ViewFactory

2019-10-04 Thread gerritbot 
gerritbot added a comment.


  Change 540838 had a related patch set uploaded (by Ladsgroup; owner: 
Ladsgroup):
  [mediawiki/extensions/Wikibase@master] [WIP] Merge jquery.ui.toggler into its 
parent
  
  https://gerrit.wikimedia.org/r/540838

TASK DETAIL
  https://phabricator.wikimedia.org/T233792

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup, gerritbot
Cc: Rosalie_WMDE, Aklapper, Ladsgroup, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T182147: more convenience functions for Lua

2019-10-04 Thread hoo 
hoo added a comment.


  In T182147#5541549 , 
@Thayts wrote:
  
  > It would be convenient if there were a function or variable to get the 
current wiki's site ID from, something like "`mw.site.siteId`".
  
  That is tracked in T194023: Expose siteGlobalID in Lua 
.

TASK DETAIL
  https://phabricator.wikimedia.org/T182147

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: hoo
Cc: Thayts, Simon_Villeneuve, Pigsonthewing, Lea_Lacroix_WMDE, jberkel, 
RolandUnger, Agabi10, RexxS, Vriullop, MisterSynergy, Ghuron, Uzume, putnik, 
Jonas, aude, hoo, Ladsgroup, Tpt, thiemowmde, eranroz, Aklapper, 
Lydia_Pintscher, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, 
Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Re: [Wikidata] Full-text / autocomplete search on labels

2019-10-04 Thread Amirouche Boubekki 
Hello all,

Le ven. 4 oct. 2019 à 09:58, Thomas Francart
 a écrit :
>
> Hello
>
> I understand the wikidata SPARQL label service only fetches the labels, but 
> does not allow to search/filter on them; labels are also available in 
> regulare rdfs:label on which a FILTER can be made.

See Etorre Rizza answer about filtering.

> However I would like to do full-text search over labels, to e.g. feed an 
> autocomplete search field,

I understand what you want to do but that is not called "full-text
search". FTS means "inside the text" or "all the text" that does not
apply to concept search or wikification.

The most common term for this kind of search is called "fuzzy search"
or "spell checking" or "autocomplete". The basic algorithm is to
search terms using prefixes of the input query.

More on that later 

---

Amirouche ~ amz3 ~ https://hyper.dev

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

[Wikidata-bugs] [Maniphest] [Updated] T189026: IndexPager::buildQueryInfo (contributions page unfiltered) query needs tuning

2019-10-04 Thread Marostegui 
Marostegui added a project: mariadb-optimizer-bug.

TASK DETAIL
  https://phabricator.wikimedia.org/T189026

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Anomie, Marostegui
Cc: gerritbot, Marostegui, Anomie, Aklapper, jcrespo, darthmon_wmde, DannyS712, 
Nandana, Banyek, Rayssa-, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
Minhnv-2809, TerraCodes, _jensen, rosalieper, Agabi10, Wikidata-bugs, aude, 
Dinoguy1000, Mbch331, Jay8g, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Re: [Wikidata] Full-text / autocomplete search on labels

2019-10-04 Thread Ettore RIZZA 
Forgot to mention: you can do the same search using the API only:
https://www.wikidata.org/w/api.php?action=wbsearchentities=einst=en=json

But not sure you can easily filter the results by "instance of".

Ettore Rizza


On Fri, 4 Oct 2019 at 10:15, Ettore RIZZA  wrote:

> Hello Thomas,
>
> You can perform a full text search with the API, but not yet with SPARQL
> AFAIK. However, it is possible to call the API in a SPARQL query. For
> example, here is a query
> 
> that looks for "human (Q5)"  whose label contains the string "einst".
>
> Hope this helps,
>
> Ettore Rizza
>
>
> On Fri, 4 Oct 2019 at 09:58, Thomas Francart 
> wrote:
>
>> Hello
>>
>> I understand the wikidata SPARQL label service only fetches the labels,
>> but does not allow to search/filter on them; labels are also available in
>> regulare rdfs:label on which a FILTER can be made.
>> However I would like to do full-text search over labels, to e.g. feed an
>> autocomplete search field, actually just like the usual top-right wikidata
>> search field does. I would also be interested to combine this with a
>> criteria on "instance of", to search only on instances of a given class.
>>
>> Can I do that efficiently using the Wikidata SPARQL service ? or is there
>> a separate API I could use ? (exemple welcome)
>>
>> Thanks
>> Thomas
>>
>> --
>>
>> *Thomas Francart* -* SPARNA*
>> Web de *données* | Architecture de l'*information* | Accès aux
>> *connaissances*
>> blog : blog.sparna.fr, site : sparna.fr, linkedin :
>> fr.linkedin.com/in/thomasfrancart
>> tel :  +33 (0)6.71.11.25.97, skype : francartthomas
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Full-text / autocomplete search on labels

2019-10-04 Thread Ettore RIZZA 
Hello Thomas,

You can perform a full text search with the API, but not yet with SPARQL
AFAIK. However, it is possible to call the API in a SPARQL query. For
example, here is a query

that looks for "human (Q5)"  whose label contains the string "einst".

Hope this helps,

Ettore Rizza


On Fri, 4 Oct 2019 at 09:58, Thomas Francart 
wrote:

> Hello
>
> I understand the wikidata SPARQL label service only fetches the labels,
> but does not allow to search/filter on them; labels are also available in
> regulare rdfs:label on which a FILTER can be made.
> However I would like to do full-text search over labels, to e.g. feed an
> autocomplete search field, actually just like the usual top-right wikidata
> search field does. I would also be interested to combine this with a
> criteria on "instance of", to search only on instances of a given class.
>
> Can I do that efficiently using the Wikidata SPARQL service ? or is there
> a separate API I could use ? (exemple welcome)
>
> Thanks
> Thomas
>
> --
>
> *Thomas Francart* -* SPARNA*
> Web de *données* | Architecture de l'*information* | Accès aux
> *connaissances*
> blog : blog.sparna.fr, site : sparna.fr, linkedin :
> fr.linkedin.com/in/thomasfrancart
> tel :  +33 (0)6.71.11.25.97, skype : francartthomas
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

[Wikidata] Full-text / autocomplete search on labels

2019-10-04 Thread Thomas Francart 
Hello

I understand the wikidata SPARQL label service only fetches the labels, but
does not allow to search/filter on them; labels are also available in
regulare rdfs:label on which a FILTER can be made.
However I would like to do full-text search over labels, to e.g. feed an
autocomplete search field, actually just like the usual top-right wikidata
search field does. I would also be interested to combine this with a
criteria on "instance of", to search only on instances of a given class.

Can I do that efficiently using the Wikidata SPARQL service ? or is there a
separate API I could use ? (exemple welcome)

Thanks
Thomas

-- 

*Thomas Francart* -* SPARNA*
Web de *données* | Architecture de l'*information* | Accès aux
*connaissances*
blog : blog.sparna.fr, site : sparna.fr, linkedin :
fr.linkedin.com/in/thomasfrancart
tel :  +33 (0)6.71.11.25.97, skype : francartthomas
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata