[Bug 38136] [SMW] Patch: SMW_refreshData.php delay time * 100 causes high server load
https://bugzilla.wikimedia.org/show_bug.cgi?id=38136 Markus Krötzsch changed: What|Removed |Added Status|NEW |RESOLVED Resolution||FIXED --- Comment #4 from Markus Krötzsch 2012-10-17 16:27:59 UTC --- Fixed in https://gerrit.wikimedia.org/r/#/c/28370/ as suggested. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 38136] [SMW] Patch: SMW_refreshData.php delay time * 100 causes high server load
https://bugzilla.wikimedia.org/show_bug.cgi?id=38136 Andre Klapper changed: What|Removed |Added Keywords|patch-need-review | -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 38136] [SMW] Patch: SMW_refreshData.php delay time * 100 causes high server load
https://bugzilla.wikimedia.org/show_bug.cgi?id=38136 Andre Klapper changed: What|Removed |Added Attachment #10816|0 |1 is patch|| Attachment #10816|application/octet-stream|text/plain mime type|| --- Comment #3 from Andre Klapper 2012-09-12 15:50:02 UTC --- Comment on attachment 10816 --> https://bugzilla.wikimedia.org/attachment.cgi?id=10816 Patch resolving the "bug". [Correcting MIME Type and setting patch flag] -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 38136] [SMW] Patch: SMW_refreshData.php delay time * 100 causes high server load
https://bugzilla.wikimedia.org/show_bug.cgi?id=38136 --- Comment #2 from badon 2012-07-08 01:20:22 UTC --- The refresh script testing we did was all done at a nice value of 19. It only takes a few seconds at most to process each page, with the typical time being about 0.5 to 1.5 seconds. You may be correct that the problem is at the database level, but I'm not sure about that. I don't think any one feature of SMW or SMW page is responsible. The MediaWiki job queue will have similar effects, but it provides a --maxtime option that ends the run if it takes too long. I typically use --maxtime to give 1/3 to 2/3 of each minute to the job queue (if there are jobs to run), depending on the visitor traffic load. For a casual SMW refresh, I am using a 10 second to 20 second delay after processing each ID, so the load is negligible over the 1 or 2 weeks that it runs. Let me know if there's anything I could do better with my patch, for the next time I do one. I like commenting code in detail so it is self-documenting. Would it be alright if some of my patches are just code comments? -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 38136] [SMW] Patch: SMW_refreshData.php delay time * 100 causes high server load
https://bugzilla.wikimedia.org/show_bug.cgi?id=38136 --- Comment #1 from Markus Krötzsch 2012-07-06 11:40:35 UTC --- Thanks for the patch. We should integrate this (I did not do this yet, but I wanted to give you a quick reply at least). The original reason for using batches of 100 was that individual pages are usually so quick to process that a delay after each seemed unnecessary. We can change this. However, if you have problems with 100 pages, you might already have problems with 1 page (often, there are many more short/simple pages than "slow" pages). Maybe try running your update script with a larger nice value to avoid it from blocking more important processes. This only has effect if the problem is not in the database system (which applies the same priority to all queries). If your problems persist, esp. if it is due to the MySQL part of the processing, then it would be nice to know why exactly your pages need so much CPU for refreshing. We are currently looking into storage optimizations and are interested in testing their efficacy on sites that have one or the other performance issue. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 38136] [SMW] Patch: SMW_refreshData.php delay time * 100 causes high server load
https://bugzilla.wikimedia.org/show_bug.cgi?id=38136 badon changed: What|Removed |Added Keywords||patch, patch-need-review -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
