Hello, This is an update to our previous announcement about data value normalization when saving edits.
We’d like to announce an additional significant change in this area. Together with the previously announced normalization of Commons media values, we also implemented Unicode normalization of string values (regardless of data type, i.e. for properties of data type string, external identifier, URL, etc.): they are now always saved in Unicode Normalization Form C (NFC, aka Normalization Form Canonical Composition). Note that, just as for Commons media normalization, this only applies to new edits, and existing data in Wikidata could still be in non-normalized form. Cheers, Lucas Werkmeister Am Mo., 23. Aug. 2021 um 13:48 Uhr schrieb Lucas Werkmeister < lucas.werkmeis...@wikimedia.de>: > Hello, > > As you may know, Wikibase currently does not normalize pagenames/filenames > on save (e.g. underscores in the input for properties of datatype Commons > media are allowed). At the same time, Wikidata’s quality constraints > extension > <https://www.mediawiki.org/wiki/Extension:WikibaseQualityConstraints> > triggers a constraint violation after saving, if underscores are used. This > is by design as to long-established > <https://www.wikidata.org/wiki/Template:Constraint:Commons_link> > Community practices. As a result, this inconsistency leaves users with > unnecessary manual work. > > We will update Wikibase so that when a new edit is saved via UI or API, > and a pagename/filename is added or changed in that edit, then this > pagename/filename will be normalized on save ("My file_name.jpg" -> "My > file name.jpg"). > > More generally, the breaking change is that a user of the Wikibase API may > send one data value when saving an edit, and get back a slightly different > (normalized) data value after the edit was made: it is no longer the case > that data values are either saved unmodified or totally rejected (e.g. if a > file doesn’t exist on Commons). Since this guarantee is being removed with > this breaking change announcement, we may introduce further normalizations > in the future and only announce them as significant changes, not breaking > changes. > > The change is currently available on test.wikidata.org and > test-commons.wikimedia.org. It will be deployed on Wikidata on or shortly > after September 6th. If you have any questions or feedback, please feel > free to let us know in this ticket > <https://phabricator.wikimedia.org/T251480>. > > Cheers, > Lucas Werkmeister > > -- > Lucas Werkmeister (he/er) > Full Stack Developer > > Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin > Phone: +49 (0)30 219 158 26-0 > https://wikimedia.de > > Imagine a world in which every single human being can freely share in the > sum of all knowledge. Help us to achieve our vision! > https://spenden.wikimedia.de > > Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. > Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter > der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für > Körperschaften I Berlin, Steuernummer 27/029/42207. > -- Lucas Werkmeister (he/er) Full Stack Developer Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin Phone: +49 (0)30 219 158 26-0 https://wikimedia.de Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us to achieve our vision! https://spenden.wikimedia.de Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.
_______________________________________________ Wikidata-tech mailing list -- wikidata-tech@lists.wikimedia.org To unsubscribe send an email to wikidata-tech-le...@lists.wikimedia.org