https://bugzilla.wikimedia.org/show_bug.cgi?id=47283
Web browser: ---
Bug ID: 47283
Summary: Reduce memory footprint of Change objects by zipping
diffs
Product: MediaWiki extensions
Version: unspecified
Hardware: All
OS: All
Status: NEW
Severity: normal
Priority: Unprioritized
Component: WikidataClient
Assignee: wikidata-b...@lists.wikimedia.org
Reporter: daniel.kinz...@wikimedia.de
CC: wikidata-b...@lists.wikimedia.org
Classification: Unclassified
Mobile Platform: ---
This is to alleviate the issue raised by bug 46763, namely that
ChangeNotificationJob runs out of memory when trying to load (hundreds of
thousands of) Change objects from the database.
A considerable amount of memory may be taken up by the diff contained in the
Change object, especially if the change is not an atomic edit but a complex
edit (from a bot, or a big undo, etc).
To reduce the memory footprint, the diff should only be unserialized on demand,
and the unserialized version should not be kept around (or only be kept in the
Change object if this was explicitly requested, for speed).
In addition, the (serialized) diff should be compressed (if larger than some
constant minimum, refer to our memcached interface for reference).
--
You are receiving this mail because:
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
