[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

Mvolz added a comment. In T206613#5311274 , @Smalyshev wrote: > I've reindexed testwikidata last week, the patch should already be there. Oh great, looks like it works!

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

Smalyshev added a comment. I've reindexed testwikidata last week, the patch should already be there. TASK DETAIL https://phabricator.wikimedia.org/T206613 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: EBernhardson, WMDE-leszek,

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

Mvolz added a comment. We're going to try to deploy this first on test.wikidata, can this be reindexed as well? Or do they both get re-indexed at the same time? TASK DETAIL https://phabricator.wikimedia.org/T206613 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

Mvolz added a comment. No worries; I wasn't aware the train was broken and wondered if the reindexing had to be triggered manually or something, thanks for the update! TASK DETAIL https://phabricator.wikimedia.org/T206613 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

Mvolz added a comment. In T206613#5235476 , @Smalyshev wrote: > Now after it's deployed reindex will be needed. Do you know when this will be? TASK DETAIL https://phabricator.wikimedia.org/T206613 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

Mvolz added a comment. Also I should point out that using an indexed search is *much* better performance wise! In T206613#5235476 , @Smalyshev wrote: > Now after it's deployed reindex will be needed. Yay! Thank you! TASK

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

gerritbot added a comment. Change 514198 **merged** by jenkins-bot: [mediawiki/extensions/WikibaseCirrusSearch@master] Add case-insenstitive subfield for statement field https://gerrit.wikimedia.org/r/514198 TASK DETAIL https://phabricator.wikimedia.org/T206613 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

dcausse added a comment. @Smalyshev I totally agree, I was suggesting a UX where a first attempt search would try to match using the haswbstatement keyword (switched to case insensitive) and then a second try could be made using the fulltext mode if the first attempt is unsuccessful. TASK

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

Smalyshev added a comment. @dcausse agree but I think it still makes sense to make it case insensitive, since most data there are either case-insensitive or at least case there is rarely used to distinguish between things (i.e. having `pcbi.100123` in one item and `PCBI.100123` in another

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

dcausse added a comment. we should also note we index this data in the main filter field which means that for searches that are unlikely to be ambiguous (IDs and such) one could simply search for 10.1371/journal.pcbi.1002947

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

dcausse added a comment. @Smalyshev switching the main field for statements to `lowercase_keyword` won't break anything, it's like a new field it'll be taken into account just after the next reindex. I would advise against a new field here, the cardinality would nearly double. TASK DETAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

gerritbot added a comment. Change 514198 had a related patch set uploaded (by Smalyshev; owner: Smalyshev): [mediawiki/extensions/WikibaseCirrusSearch@master] Add case-insenstitive subfield for statement field https://gerrit.wikimedia.org/r/514198 TASK DETAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

Mvolz added a comment. In T206613#4664719, @Smalyshev wrote: I don't think removing case sensitivity would be a lot of manual work, but it will require a reindex to change the index. I'm not sure why we decided on it being case-sensitive, I'll try to figure it out and if there's no reason we can

[Wikidata-bugs] [Maniphest] [Commented On] T206613: Search of wikidata string property values using haswbstatement is case sensitive

Multichill added a comment. @Smalyshev what do you think? I haven't run into this myself. My feeling is that case insensitive is probably better, but would that require a lot of work?TASK DETAILhttps://phabricator.wikimedia.org/T206613EMAIL