[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 Aaron Schulz changed: What|Removed |Added Status|NEW |RESOLVED Resolution|--- |FIXED --- Comment #16 from Aaron Schulz --- A script was run to fix all of these image/oldimage rows (completed April 29). -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 --- Comment #15 from Aaron Schulz --- *** Bug 17070 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 Aaron Schulz changed: What|Removed |Added CC||azat...@gmail.com --- Comment #14 from Aaron Schulz --- *** Bug 49841 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 Nemo_bis changed: What|Removed |Added CC||bhartsho...@wikimedia.org, ||federicol...@tiscali.it Component|General/Unknown |Media storage -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 --- Comment #13 from Aaron Schulz 2012-03-28 17:29:34 UTC --- A race condition involving a lack of locking was fixed (which previously allowed mixed up metadata for two rows). -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 Mark A. Hershberger changed: What|Removed |Added Blocks||34755 -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 --- Comment #12 from Aaron Schulz 2012-02-29 22:50:23 UTC --- (In reply to comment #11) > We can now fix this for individual broken cases as of r54328. Underlying cause > of why they're wrong might need fixing still? More script updates in r112736. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 Platonides changed: What|Removed |Added Keywords||shell -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 Jimmy Xu changed: What|Removed |Added Blocks||23529 -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 Guillaume Paumier changed: What|Removed |Added CC||gpaum...@wikimedia.org Priority|High|Normal -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 Chad H. changed: What|Removed |Added CC||innocentkil...@gmail.com --- Comment #11 from Chad H. 2009-08-03 23:47:18 UTC --- We can now fix this for individual broken cases as of r54328. Underlying cause of why they're wrong might need fixing still? -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 --- Comment #10 from Aaron Schulz 2009-07-27 08:32:05 UTC --- (In reply to comment #9) > (In reply to comment #8) > > (In reply to comment #5) > > > populateSha1 wouldn't fix anything, since it only works on files which > > > don't > > > have hash in the db. These files do have a hash, although it's wrong. > > > > Adding an overwrite mode sounds trivial. > Running a maintenance script every time a particular image has a hash issue is > impractical. There should be a way to re-generate the hash without requiring a > re-upload or command-line access. Regardless of whether the maintenance script > is adjusted (which it probably should be). Obviously. But we can use to retroactively fix the numerous wrong values, once the reason for the keys getting stuck is found. A sha-1 purge link shouldn't be needed unless something is just flat broken...users shouldn't be expected to deal with that. It could be a temporary stop-gap solution if all else fails though... -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 --- Comment #9 from MZMcBride 2009-07-27 08:26:32 UTC --- (In reply to comment #8) > (In reply to comment #5) > > populateSha1 wouldn't fix anything, since it only works on files which don't > > have hash in the db. These files do have a hash, although it's wrong. > > Adding an overwrite mode sounds trivial. Running a maintenance script every time a particular image has a hash issue is impractical. There should be a way to re-generate the hash without requiring a re-upload or command-line access. Regardless of whether the maintenance script is adjusted (which it probably should be). -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 --- Comment #8 from Aaron Schulz 2009-07-27 05:41:45 UTC --- (In reply to comment #5) > populateSha1 wouldn't fix anything, since it only works on files which don't > have hash in the db. These files do have a hash, although it's wrong. Adding an overwrite mode sounds trivial. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 --- Comment #7 from Platonides 2009-07-26 22:38:09 UTC --- I don't think so. It's simply that the hash wasn't expected to be wrong. But note that sometimes the wrong hash is on an old image version. So you would need to iterate all images recaulculating its hash (luckily they are usually few image versions). I would prefer seeing an API module for doing purges. Or simply seeing the sysadmins purge those entries. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 --- Comment #6 from MZMcBride 2009-07-26 22:06:02 UTC --- Why not just make ?action=purge re-calculate the hash? Is it too expensive or something? -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 --- Comment #5 from Platonides 2009-07-26 22:00:47 UTC --- populateSha1 wouldn't fix anything, since it only works on files which don't have hash in the db. These files do have a hash, although it's wrong. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 Aaron Schulz changed: What|Removed |Added CC||jschulz_4...@msn.com --- Comment #4 from Aaron Schulz 2009-07-26 20:46:36 UTC --- (In reply to comment #2) > Adding to database cleanup tracking bug 16660. > Can populateSha1 be run again in the meantime? -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 --- Comment #3 from Platonides 2009-02-04 23:53:56 UTC --- I have been studying the hashes of commons images. The errors can be sorted very clearly. There're images where the hash of an older version got 'stuck'. The image sha1 wasn't updated on reuploading? With the hash of the empty string it is much more common. It's normal that when the image had a broken version it got the empty hash, but it keeps on the current version, even through several uploads. Something which happens less with normal images. There's however a worse case, where the metadata is right but the old version listed is not there. There's a file as history but its contents are the same as the current version (or another newer version). *The old version was silently lost*. So not only should they be searched on backups, but we must make sure that whatever bug produced it is fixed. Images using hash of older version: http://commons.wikimedia.org/wiki/File:Agrigento-Domestic-Quarter-flickr.jpg Use hash of older version (77d4c7822a2f1e971d8cc7cf9b4b56a97cec9649), not theirs (ea8dff9bd8c3daeb33f8c40a4e8dfe2acf6db177) http://commons.wikimedia.org/wiki/File:Agrigento-Temple-of-Concord-flickr-1.jpg ec985ed8bdf283f11e6b861d7fe0720d29142798 35d96c5d2b05f2ce81cd752ab862bf63dcd28964 http://commons.wikimedia.org/wiki/File:CD_F%C3%83%C2%A1tima.svg http://commons.wikimedia.org/wiki/File:Cabo_Vil%C3%83%C2%A1n._Camari%C3%83%C2%B1as._Galiza.jpg http://commons.wikimedia.org/wiki/File:Horchata_de_chufa.jpg http://commons.wikimedia.org/wiki/File:Karina_Bacchi2.jpg http://commons.wikimedia.org/wiki/File:Lid_Susa_Louvre_MAOS499.jpg http://commons.wikimedia.org/wiki/File:NZ_Red_Admiral_%28Vanessa_gonerilla%29-4.jpg http://commons.wikimedia.org/wiki/File:Vinbergs_kyrka.jpg Hash of empty file: Seems related to use hash of older file, all of them they have an older version missing http://upload.wikimedia.org/wikipedia/commons/archive/5/5d/20090117210820%215von10.png http://commons.wikimedia.org/wiki/File:Alfred_de_Musset.jpg 9e3753864bef9c18f8d75194136bfa71c440a2cd http://commons.wikimedia.org/wiki/File:Blason-fr-en-Saint-Moreil.svg http://commons.wikimedia.org/wiki/File:Clock_UT%2b7.png http://commons.wikimedia.org/wiki/File:Codex_egberti_-_egbert.jpg http://commons.wikimedia.org/wiki/File:Cross.png http://commons.wikimedia.org/wiki/File:Cutty_sark_October_2003.jpg http://commons.wikimedia.org/wiki/File:DNAn+1_C.svg http://commons.wikimedia.org/wiki/File:DNAn+1_T.svg http://commons.wikimedia.org/wiki/File:Dalmenyhouse_lighter.jpg http://commons.wikimedia.org/wiki/File:EtaCarinae.jpg [but there's an intermediate version with right hash!] http://commons.wikimedia.org/wiki/File:GeorgeWBush.jpg [intermediate existing versions] http://commons.wikimedia.org/wiki/File:Hallingkast.jpg http://commons.wikimedia.org/wiki/File:Harlekin_Columbine_Tivoli_Denmark.jpg http://commons.wikimedia.org/wiki/File:Herb_Korybut.jpg http://commons.wikimedia.org/wiki/File:IsleofWightmap_1945.jpg http://commons.wikimedia.org/wiki/File:Jarzabczy_Wierch_a2.jpg http://commons.wikimedia.org/wiki/File:Kit_body_scga06.png http://commons.wikimedia.org/wiki/File:Lilium_bulbiferum_mg-k.jpg http://commons.wikimedia.org/wiki/File:Maisonmaton.jpg http://commons.wikimedia.org/wiki/File:Macaronesia.jpg http://commons.wikimedia.org/wiki/File:Monarch_caterpillar_and_egg.jpg http://commons.wikimedia.org/wiki/File:Montelbaanstoren_01.jpg http://commons.wikimedia.org/wiki/File:Multi-colored_Wild_Lantana_Camara_3.JPG http://commons.wikimedia.org/wiki/File:Ponte_de_Amizade_of_Macau.JPG http://commons.wikimedia.org/wiki/File:Rhoen_montaner_Laubwald_mg-k.jpg http://commons.wikimedia.org/wiki/File:Rosa_omeiensis_f._pteracantha_-_Bagatelle05.jpg http://commons.wikimedia.org/wiki/File:STS_114_day_before_launch.jpg http://commons.wikimedia.org/wiki/File:Space_Shuttle_Enterprise_747_takeoff.ogg http://commons.wikimedia.org/wiki/File:Starr_Miconia_calvescens0.jpg http://commons.wikimedia.org/wiki/File:TexasFM1950.png http://commons.wikimedia.org/wiki/File:Voiceless_bilabial_plosive.ogg http://commons.wikimedia.org/wiki/File:Volvo480doppel.jpg http://commons.wikimedia.org/wiki/File:Wikinews_Brief_June_13,_2005_0500_UTC.ogg http://commons.wikimedia.org/wiki/File:William_Phips_03.jpg http://commons.wikimedia.org/wiki/File:Wind-power-small-scale.jpg Images where the file storing the old version in fact contain a copy of the current one http://upload.wikimedia.org/wikipedia/commons/archive/2/2e/20080920140529!Auguste_victoria_axb02.jpg File exists, but metadata shows us that current file is wrong (it's a copy of the smaller, current version) http://upload.wikimedia.org/wikipedia/commons/archive/2/23/20080924123236!Banner_Porta_Westfalica.svg http://upload.wikimedia.org/wikipedia/commons/archive/3/32/2008110104!Beseda01.jpg http://upload.wikimedia.org/wikipedia/commons/archive/5/59/20080111081832!Brakteat01.jpg http://upload.wikimedi
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 Brion Vibber changed: What|Removed |Added Blocks||16660 --- Comment #2 from Brion Vibber 2009-01-31 01:34:43 UTC --- Adding to database cleanup tracking bug 16660. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 17057] Images with wrong SHA1
https://bugzilla.wikimedia.org/show_bug.cgi?id=17057 Platonides changed: What|Removed |Added CC||platoni...@gmail.com Summary|Unusually high number of|Images with wrong SHA1 |file SHA1 hash collisions | -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
