| Pchelolo added a comment. |
Currently on kafka-main machines the disk utiliation is really low, so I think we can easily do it without kafka-jumbo.
dsh --group kafka_eqiad --remoteshell ssh -- 'df -h' | grep '/srv'
/dev/md1 7.2T 737G 6.1T 11% /srv /dev/md1 7.2T 736G 6.1T 11% /srv /dev/md1 7.2T 822G 6.0T 12% /srv dsh --group kafka_codfw --remoteshell ssh -- 'df -h' | grep '/srv' /dev/md1 7.2T 361G 6.5T 6% /srv /dev/md1 7.2T 362G 6.5T 6% /srv /dev/md1 7.2T 362G 6.5T 6% /srv
Event increasing 3 times gets us at max 33% disk utilization with should be ok.
Since we only need super-high retention for a subset of topics (not needed for jobs, retry topics, internal topics etc) ideally these could be topic-level configs, but we don't currently have proper support for specifying per-topic configuration T157092
TASK DETAIL
EMAIL PREFERENCES
To: Pchelolo
Cc: elukey, Ottomata, Aklapper, Nuria, Ladsgroup, Pchelolo, JAllemandou, Smalyshev, Lahi, Gq86, Vacio, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, Nirmos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, Krenair, jeremyb
Cc: elukey, Ottomata, Aklapper, Nuria, Ladsgroup, Pchelolo, JAllemandou, Smalyshev, Lahi, Gq86, Vacio, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, Nirmos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, Krenair, jeremyb
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
