[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Michelle Lee Kosik kosi...@mail.com changed: What|Removed |Added CC||kosi...@mail.com -- You are receiving this mail because: You are watching all bug changes. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #39 from Vitaliy Filippov vita...@yourcmc.ru --- By the way, I think I'll try to move these import/export changes to an extension. The only precondition is this patch: https://gerrit.wikimedia.org/r/#/c/34338/ (change old image timestamps to include their own version, not the archiving timestamp) Most of other changes can be easily extracted to an extension. I think it will be simpler to install and use, and it won't require long review process for my codebomb :) -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 DaSch da...@daschmedia.de changed: What|Removed |Added CC||da...@daschmedia.de --- Comment #38 from DaSch da...@daschmedia.de --- when improving Import maybe somebody could consider looking on this bug 22077 just an idea :) -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #37 from Vitaliy Filippov vita...@yourcmc.ru 2012-11-20 18:17:41 UTC --- OK, I've pushed it to Gerrit. 1) Change old image timestamps: https://gerrit.wikimedia.org/r/#/c/34338/ 2) Quick fix for Bug 37209 - without it importing doesn't work: https://gerrit.wikimedia.org/r/#/c/34339/ 3) Main part of import/export patch: https://gerrit.wikimedia.org/r/#/c/34340/ -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Vitaliy Filippov vita...@yourcmc.ru changed: What|Removed |Added Attachment #10267|0 |1 is obsolete|| --- Comment #35 from Vitaliy Filippov vita...@yourcmc.ru 2012-03-23 15:12:08 UTC --- Created attachment 10312 -- https://bugzilla.wikimedia.org/attachment.cgi?id=10312 Updated patch for svn 114100 Updated the patch (one small bugfix, use $title[0] instead of $this-title in the error message). -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #36 from Sumana Harihareswara suma...@panix.com 2012-03-23 18:07:22 UTC --- Vitaliy, just wanted to check in and suggest that you get https://www.mediawiki.org/wiki/Git/Workflow a Git/Gerrit account! That'll make it easier to get your patches reviewed. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Vitaliy Filippov vita...@yourcmc.ru changed: What|Removed |Added Attachment #9544|0 |1 is obsolete|| --- Comment #33 from Vitaliy Filippov vita...@yourcmc.ru 2012-03-19 09:36:56 UTC --- Created attachment 10267 -- https://bugzilla.wikimedia.org/attachment.cgi?id=10267 Patch for svn 114100 Rebased the patch again... Please review it someone! -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Vitaliy Filippov vita...@yourcmc.ru changed: What|Removed |Added Attachment #7223|0 |1 is obsolete|| --- Comment #34 from Vitaliy Filippov vita...@yourcmc.ru 2012-03-19 09:37:25 UTC --- Created attachment 10268 -- https://bugzilla.wikimedia.org/attachment.cgi?id=10268 Updated maintenance tool -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Vitaliy Filippov vita...@yourcmc.ru changed: What|Removed |Added Attachment #8386|0 |1 is obsolete|| --- Comment #31 from Vitaliy Filippov vita...@yourcmc.ru 2011-11-24 16:47:03 UTC --- Created attachment 9544 -- https://bugzilla.wikimedia.org/attachment.cgi?id=9544 ZIP support + rebase the patch to r104165 The new version of patch: * Rebased to r104165... (again and again...) * ZIP support, used instead of multipart/related by default. Old multipart/related is also supported, partly as an example of multiple archive formats * Added reporting of imported upload count * Recent changes are now restored during import (so the post-import state looks almost exactly same as in the source wiki) * FileRepo part does not need changes anymore, thanks to Bryan Tong Minh! :) * There was a bug in trunk - sha1 was compared with sha1base36 in Import.php * A note about addPages() / addPagesExec() in SpecialExport: they're static because they are useful for MW extensions, for example for a BatchEditor extension we have. I understand that the code maybe isn't perfect... But see, previous versions of MediaWiki also don't have perfect code in export/import part. :) And one more thing about backwards compatibility, ZIP and etc etc etc: all efforts to maintain backwards compatibility with MW 1.18 are useless anyway, because old XML parser didn't allow differences in the element hierarchy, even if all the difference is a single added element, and it bails out with strange errors in this case. So I still suggest archives as the primary dump format, not the XML with base64-encoded parts :) -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #32 from Reedy s...@reedyboy.net 2011-11-24 19:04:08 UTC --- Be nice to get it in for you before the patches go stale again! -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Reedy s...@reedyboy.net changed: What|Removed |Added Attachment #7223|application/octet-stream|text/plain mime type|| -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #29 from Reedy s...@reedyboy.net 2011-11-20 18:25:22 UTC --- For A maintenance tool to change oldimage filenames, that really needs rewriting to use our Maintenance classes Legacy code not using it isn't so bad, but adding new files that don't isn't a good way forward -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #30 from Vitaliy Filippov vita...@yourcmc.ru 2011-11-20 23:18:13 UTC --- I agree, it anyway needs change for that 'T' letter :) -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #28 from Vitaliy Filippov vita...@yourcmc.ru 2011-11-16 11:37:20 UTC --- Created attachment 9466 -- https://bugzilla.wikimedia.org/attachment.cgi?id=9466 Patch for archive filenames I see the changes to the import xml reader happened in the meantime. So I need to rebase my patch against trunk again. Additionally, I still want to add archive support instead of or in addition to base64 encoding inside xml, because the latter increases file size by 30%, which could be sensitive even on medium installations :) - Now, I just want to submit patch for archive file names. I suggest a prepended 'T' letter for backwards compatibility noted by Tim. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Vitaliy Filippov vita...@yourcmc.ru changed: What|Removed |Added Version|1.14.x |unspecified -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Mark A. Hershberger m...@everybody.org changed: What|Removed |Added Attachment #8386|0 |1 is patch|| Attachment #8386|application/octet-stream|text/plain mime type|| -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #27 from Vitaliy Filippov vita...@yourcmc.ru 2011-10-31 12:32:11 UTC --- Sorry, didn't see the comments - dnsrbl.net has gone mad and was blocking all email on my server :) Not fully, I've just implemented ZIP support by now, this required reworking writers/filters/readers, so now I have several questions to the devs: 1. What was the original idea besides Dump*Filters ? My opinion is that it's absolutely irrational to filter the pages AFTER loading them from the DB, plus DumpFilters weren't actually used in export, so I've removed them - is that OK ? 2. Also I don't truly understand the idea of having separate methods for write* (writeOpenPage, writeClosePage, etc) in DumpOutput. Was it supposed to allow easy switching of underlying stream format from XML to something other? I think it's useless as there is no other dump format by now :) so it's not designed for the real needs of other format. So it's also removed :) 3. Also, in the new version of patch, I always use temporary files to read/write dump archives, so the support for streaming gzip/bzip2/etc filters is also removed. But, my opinion is that it's also not a big problem - there's support for ZIP anyway. 4. Now, the import code doesn't restore recent changes for page edits/creations. I think it must restore them for consistency and I've implemented that - is it OK? 5. Also I don't fully understand the purpose of setting revision callbacks to methods of self in WikiImporter :) what's that purpose? 6. ImportStringSource - was this supposed to be really used somewhere? -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Sumana Harihareswara suma...@panix.com changed: What|Removed |Added CC||suma...@panix.com --- Comment #26 from Sumana Harihareswara suma...@panix.com 2011-10-07 19:12:43 UTC --- Vitaliy, have you had time to revise your patch? -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Tim Starling tstarl...@wikimedia.org changed: What|Removed |Added CC||tstarl...@wikimedia.org --- Comment #24 from Tim Starling tstarl...@wikimedia.org 2011-08-26 06:01:50 UTC --- Conformance to the site style http://www.mediawiki.org/wiki/Manual:Coding_conventions is a requirement for core code contributions. I'm not sure what the point is of this multipart/related document type: is there some client that can read it? The exports appear to be sent out with HTTP headers specifying Content-Type: application/xml, but with a body that is plainly not XML, rather it is this MIME message format with headers embedded in the body text. It seems like zip would have been a better choice. The wording of the messages which enable this multipart format certainly don't warn the user that what they are going to get will be so exotic. What does this: /*op-patch|TS|2010-04-26|HaloACL|SafeTitle|start*/ signify? It is wrapped around some strange-looking code. Is it meant to be there? The 5000-page limit in SpecialExport::getPagesFromCategory() appears to have been removed without explanation. Also, SpecialExport::rgetPagesFromCategory() appears to have no recursion depth limit. It's probably feasible to use the upload timestamp of the old image version to generate the archive name, but it would need to be done with a bit more care and analysis than I see here. For example, LocalFileRestoreBatch::execute() appears to need patching. Deployment would be difficult since it would break if MediaWiki is downgraded or run with multiple versions on the same database. It would be simpler, and head off potential future problems with analysis of image filesystems, if the archive names could be changed to a completely different regime, adding some marker to show whether they were generated the old way or the new way. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #25 from Vitaliy Filippov vita...@yourcmc.ru 2011-08-26 16:43:29 UTC --- (In reply to comment #24) Conformance to the site style http://www.mediawiki.org/wiki/Manual:Coding_conventions is a requirement for core code contributions. I'll run my modifications through the tool. I'm not sure what the point is of this multipart/related document type: is there some client that can read it? The exports appear to be sent out with HTTP headers specifying Content-Type: application/xml, but with a body that is plainly not XML, rather it is this MIME message format with headers embedded in the body text. It seems like zip would have been a better choice. The wording of the messages which enable this multipart format certainly don't warn the user that what they are going to get will be so exotic. Oh, thanks. I've not thinked about zip. I agree that multipart is very exotic. For some reason, it was the first archive type I thinked of. What does this: /*op-patch|TS|2010-04-26|HaloACL|SafeTitle|start*/ signify? It is wrapped around some strange-looking code. Is it meant to be there? No... It's from other patch (access control extension). Sorry. The 5000-page limit in SpecialExport::getPagesFromCategory() appears to have been removed without explanation. Also, SpecialExport::rgetPagesFromCategory() appears to have no recursion depth limit. I think any hard-coded limits are bad, and they were hard-coded... I've just removed them as it seemed the easiest way. Recursion limit is harmful for small/intranet MW installations - users often create deep category hierarchies and want to export them :) and there is relatively little amount of pages, so the performance doesn't count. 5000 pages limit is harmful for example for exporting full wiki content. These limits should probably be on parametrized on $wgSomething... It's probably feasible to use the upload timestamp of the old image version to generate the archive name, but it would need to be done with a bit more care and analysis than I see here. For example, LocalFileRestoreBatch::execute() appears to need patching. Deployment would be difficult since it would break if MediaWiki is downgraded or run with multiple versions on the same database. It would be simpler, and head off potential future problems with analysis of image filesystems, if the archive names could be changed to a completely different regime, adding some marker to show whether they were generated the old way or the new way. Very reasonable. I'll change my modifications according to these remarks. Zip is really a very good idea :) -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #22 from Vitaliy Filippov vita...@yourcmc.ru 2011-05-22 08:04:39 UTC --- Compatible, but increases the size :) -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #23 from Vitaliy Filippov vita...@yourcmc.ru 2011-05-22 08:05:45 UTC --- I have absolutely no idea what would break So you won't change it at all? -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #21 from Bryan Tong Minh bryan.tongm...@gmail.com 2011-05-21 13:45:36 UTC --- (In reply to comment #20) Oh, thanks, sorry for the delay. I've seen your changes now. One remark: I've also seen there is now base64 export added? I understand this is for the sake of backwards compatibility, but it's not very optimal. Maybe leave it as an option? I don't understand. The base64 is backwards compatible if you parse with an XML parser. Perhaps, but changing this may lead to unexpected breakage, which I don't feel inclined to search for. What for example? Or is it completely :) unexpected so you have no idea about it? I have absolutely no idea what would break, but I know MediaWiki well enough that something will break. I'll try to rebase the patch against the new trunk with your WIP. That's fine. However, I don't think that I will have time to review and commit the patch, so somebody else should review it then. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #20 from Vitaliy Filippov vita...@yourcmc.ru 2011-05-20 11:23:15 UTC --- Oh, thanks, sorry for the delay. I've seen your changes now. One remark: I've also seen there is now base64 export added? I understand this is for the sake of backwards compatibility, but it's not very optimal. Maybe leave it as an option? Perhaps, but changing this may lead to unexpected breakage, which I don't feel inclined to search for. What for example? Or is it completely :) unexpected so you have no idea about it? --- Also, I recently made some changes in the page selection mechanism. The use cases were: - deny export of pages marked with some category - allow incremental export, i.e. correct export of pages which were changed since given time. So, changes were: - moved used image, template and page links selection into page selection box (and rewritten the code optimizing it - each title is no more loaded ); so that export exports ONLY pages that are in textbox now, and link selection is done using add pages; - added a NOT-category filter for page selection box (Add pages:), which is applied AFTER selection of image, template and page links, and which is applied to the full list in the textbox, not only to added pages; - changed the behaviour of modification date filter - it is now also applied after all, just like NOT-category. So it allows to build page lists for incremental replication/export. All this can be seen on, for example, http://wiki.4intra.net/ as an example. --- I'll try to rebase the patch against the new trunk with your WIP. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Vitaliy Filippov vita...@yourcmc.ru changed: What|Removed |Added Attachment #8193|0 |1 is obsolete|| --- Comment #17 from Vitaliy Filippov vita...@yourcmc.ru 2011-04-07 14:36:28 UTC --- Created attachment 8386 -- https://bugzilla.wikimedia.org/attachment.cgi?id=8386 Rebase to 85617 + fix no history for uploads + use sha1base36 -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #18 from Vitaliy Filippov vita...@yourcmc.ru 2011-04-07 14:37:58 UTC --- Any progress on review? I see there were some changes to import.php and specialexport.php in trunk... -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #19 from Bryan Tong Minh bryan.tongm...@gmail.com 2011-04-07 20:24:43 UTC --- I've started with implementing the required FileRepo changes in r85635. I've heavily modified your patch to match our coding standards. I have moved most logic from LocalFile to OldLocalFile, because that means that we can use things like $this-getRel() etc. I will next look at the multipart/related parts of the patch. (In reply to comment #14) Thanks everybody for remarks :) (In reply to comment #13) I retract that. The timestamp part of the filename is the timestamp when the file was moved into the archive, not the timestamp when the file was originally uploaded. Yeah, originally it is. But I personally don't understand the practical sense of this. The time when the file was moved into the archive is usually equal to or 1-2 second relative to the time when a new version of the same file was uploaded. So each version contains timestamp of another, moreover, not always an accurate one. I think versions should be independent, and should not form such linked lists. Perhaps, but changing this may lead to unexpected breakage, which I don't feel inclined to search for. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Vitaliy Filippov vita...@yourcmc.ru changed: What|Removed |Added Attachment #7870|0 |1 is obsolete|| --- Comment #15 from Vitaliy Filippov vita...@yourcmc.ru 2011-02-22 15:53:34 UTC --- Created attachment 8193 -- https://bugzilla.wikimedia.org/attachment.cgi?id=8193 Rebase patch for new trunk MW (svn 82606) Rebase patch to svn 82606 + add corrections from comment 12 by Bryan Tong Minh. From now, all these patches will be available at: http://code.google.com/p/mediawiki4intranet/source/browse/?r=files#hg%2Fimport-export-patch -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #16 from Vitaliy Filippov vita...@yourcmc.ru 2011-02-22 15:58:59 UTC --- Also forgot to mention that in new version of patch, the insertion of empty marker revisions to imported pages is now disabled, because it leads to very fancy bugs, in particular, infinitely duplicated revisions without changes in the case of 2-way (vice-versa?) replication between two wikis. One sees a change, imports it, adds a newer marker revision, then other sees this revision in export file, imports it, etc... -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Vitaliy Filippov vita...@yourcmc.ru changed: What|Removed |Added Attachment #7601|0 |1 is obsolete|| --- Comment #9 from Vitaliy Filippov vita...@yourcmc.ru 2010-11-26 16:14:04 UTC --- Created attachment 7870 -- https://bugzilla.wikimedia.org/attachment.cgi?id=7870 Patch for trunk MediaWiki (svn 77332) Updated the patch for the trunk + added some checks and ability to export very large files using 1MB buffer. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Vitaliy Filippov vita...@yourcmc.ru changed: What|Removed |Added Attachment #7870|0 |1 is patch|| Attachment #7870|application/octet-stream|text/plain mime type|| -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Max Semenik maxsem.w...@gmail.com changed: What|Removed |Added CC||bryan.tongm...@gmail.com --- Comment #10 from Max Semenik maxsem.w...@gmail.com 2010-11-26 16:47:49 UTC --- Bryan, can you poke at this? -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #11 from Max Semenik maxsem.w...@gmail.com 2010-11-26 16:53:46 UTC --- A few comments: font color=red is a big no-no, use span class=error $dbw-immediateCommit(); immediate*() are deprecated, use just begin() and commit() -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881
--- Comment #12 from Bryan Tong Minh bryan.tongm...@gmail.com 2010-11-26
20:55:42 UTC ---
Comments only on the filerepo part:
+global $wgUser;
File repo should never ever ever ever use globals like $wgUser. Pass the user
object as a function argument, similar to LocalFile::upload
+$dstPath = $this-repo-getZonePath('public') . '/archive/' .
$this-getHashPath() . $dstName;
[...]
+$dstName = gmdate( 'YmdHis', wfTimestamp( TS_UNIX, $timestamp ) ) .
'!' . $this-getName();
You are essentially duplicating this from LocalFile::publish. The archive name
generation should be moved to a separate function, which is called by both
publish() and recordOldUpload().
E.g. $dstName = $this-generateArchiveName( $timestamp );
I find it strange that you are doing path generation in recordOldUpload(). Is
there a specific reason you are not doing that in the caller and pass the
entire archive name? That would seem a bit more logical to me.
+/* Original gmdate( 'YmdHis' ) is not corrent AT ALL! */
+/* It gives an inconsistency: file name has one timestamp and database
row has another. */
Correct, we should fix that anyway.
+$props['timestamp'] = wfTimestamp( TS_MW, $timestamp );
You should use $dbw-timestamp( $timestamp )
I don't know the import/export code at all, so I won't comment on that.
In general good work. You are on a good way to finally get upload
importing/exporting available.
--
Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #13 from Bryan Tong Minh bryan.tongm...@gmail.com 2010-11-26 21:06:30 UTC --- (In reply to comment #12) +/* Original gmdate( 'YmdHis' ) is not corrent AT ALL! */ +/* It gives an inconsistency: file name has one timestamp and database row has another. */ Correct, we should fix that anyway. I retract that. The timestamp part of the filename is the timestamp when the file was moved into the archive, not the timestamp when the file was originally uploaded. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #14 from Vitaliy Filippov vita...@yourcmc.ru 2010-11-26 23:27:34 UTC --- Thanks everybody for remarks :) (In reply to comment #13) I retract that. The timestamp part of the filename is the timestamp when the file was moved into the archive, not the timestamp when the file was originally uploaded. Yeah, originally it is. But I personally don't understand the practical sense of this. The time when the file was moved into the archive is usually equal to or 1-2 second relative to the time when a new version of the same file was uploaded. So each version contains timestamp of another, moreover, not always an accurate one. I think versions should be independent, and should not form such linked lists. (In reply to comment #12) I find it strange that you are doing path generation in recordOldUpload(). Is there a specific reason you are not doing that in the caller and pass the entire archive name? That would seem a bit more logical to me. Do you mean concatenating $dstPath instead of passing it as a parameter to recordOldUpload()? If so, recordOldUpload() uses $dstName as the value of oi_archive_name DB column, that's the reason. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Reedy s...@reedyboy.net changed: What|Removed |Added Summary|Greatly improved Export and |Greatly improved Export and |Import for 1.14.1 (will |Import |port into trunk if needed) | -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import for 1.14.1 (will port into trunk if needed)
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #8 from Vitaliy Filippov vita...@yourcmc.ru 2010-07-28 12:21:57 UTC --- Created an attachment (id=7601) -- (https://bugzilla.wikimedia.org/attachment.cgi?id=7601) Patch for Trunk MediaWiki (svn70079) Good news everyone ! :-) I ported my patch to MediaWiki 1.17 trunk (svn revision 70079). Can you give it some review please ? -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import for 1.14.1 (will port into trunk if needed)
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Reedy s...@reedyboy.net changed: What|Removed |Added Attachment #7222|0 |1 is obsolete|| -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import for 1.14.1 (will port into trunk if needed)
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Reedy s...@reedyboy.net changed: What|Removed |Added Attachment #7222|application/octet-stream|text/plain mime type|| Attachment #7222|0 |1 is patch|| -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import for 1.14.1 (will port into trunk if needed)
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #7 from Vitaliy Filippov vita...@yourcmc.ru 2010-04-21 08:29:38 UTC --- I will definitely update the patch to run against trunk when I'll have time to do it :) by now, you can only try live demonstration on URLs above... -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import for 1.14.1 (will port into trunk if needed)
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Siebrand s.mazel...@xs4all.nl changed: What|Removed |Added Status|NEW |RESOLVED CC||s.mazel...@xs4all.nl Resolution||INVALID --- Comment #5 from Siebrand s.mazel...@xs4all.nl 2010-04-21 00:52:14 CEST --- No new functionality will be added to already released versions. Please provide a patch for trunk and reopen on submit. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import for 1.14.1 (will port into trunk if needed)
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Chad H. innocentkil...@gmail.com changed: What|Removed |Added Status|RESOLVED|REOPENED Resolution|INVALID | --- Comment #6 from Chad H. innocentkil...@gmail.com 2010-04-21 00:57:10 UTC --- Outdated patches are no reason to resolve INVALID. Patch can be updated to run against trunk, -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import for 1.14.1 (will port into trunk if needed)
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #3 from Vitaliy Filippov vita...@yourcmc.ru 2010-03-19 12:01:53 UTC --- P.S: If you want to see it in action, go to our external corporate Wiki: http://lib.custis.ru/Special:Export or my own wiki: http://yourcmc.ru/wiki/Special:Export The patch is applied to both of them. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import for 1.14.1 (will port into trunk soon)
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 --- Comment #1 from Vitaliy Filippov vita...@yourcmc.ru 2010-03-18 13:43:24 UTC --- Created an attachment (id=7223) -- (https://bugzilla.wikimedia.org/attachment.cgi?id=7223) A maintenance tool to change oldimage filenames -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import for 1.14.1 (will port into trunk soon)
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Chad H. innocentkil...@gmail.com changed: What|Removed |Added Keywords||need-review, patch CC||innocentkil...@gmail.com -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 22881] Greatly improved Export and Import for 1.14.1 (will port into trunk if needed)
https://bugzilla.wikimedia.org/show_bug.cgi?id=22881 Vitaliy Filippov vita...@yourcmc.ru changed: What|Removed |Added Summary|Greatly improved Export and |Greatly improved Export and |Import for 1.14.1 (will |Import for 1.14.1 (will |port into trunk soon) |port into trunk if needed) --- Comment #2 from Vitaliy Filippov vita...@yourcmc.ru 2010-03-18 14:18:32 UTC --- Also this patch fixes Bug 9108. I'll add this bug as a See Also to all related bugs. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
