[Wikidata-bugs] [Maniphest] [Commented On] T104879: Define the details of the hardware we need to run WDQS
Smalyshev added a comment. Initial estimate: - 64G RAM at least - SSD drive. DB size is about 70G now, if we have a spare server setup then anything over 100-150G should be sufficient - Since queries are somewhat parallelized, as many cores as possible (dual 4-core?) TASK DETAIL https://phabricator.wikimedia.org/T104879 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Joe, Smalyshev Cc: Manybubbles, Smalyshev, Joe, Matanya, Aklapper, jkroll, Wikidata-bugs, Jdouglas, RobH, aude, mark, JanZerebecki, faidon, fgiunchedi, Dzahn, chasemp, Malyacko, Krenair, P.Copp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104879: Define the details of the hardware we need to run WDQS
Jdouglas added a subscriber: Jdouglas. Jdouglas added a comment. What are the requirements that this hardware is needed to satisfy? TASK DETAIL https://phabricator.wikimedia.org/T104879 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Joe, Jdouglas Cc: Jdouglas, Manybubbles, Smalyshev, Joe, Matanya, Aklapper, jkroll, Wikidata-bugs, RobH, aude, mark, JanZerebecki, faidon, fgiunchedi, Dzahn, chasemp, Malyacko, Krenair, P.Copp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104879: Define the details of the hardware we need to run WDQS
Jdouglas added a comment. Awesome, thanks! I'll copy them into the task description. TASK DETAIL https://phabricator.wikimedia.org/T104879 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev, Jdouglas Cc: Jdouglas, Manybubbles, Smalyshev, Joe, Matanya, Aklapper, jkroll, Wikidata-bugs, RobH, aude, mark, JanZerebecki, faidon, fgiunchedi, Dzahn, chasemp, Malyacko, Krenair, P.Copp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104879: Define the details of the hardware we need to run WDQS
Joe added a comment. Just as a note - labs instances are incredibly slower than production hardware. IOPS are horrible, in particular, so if we just need 3x as an IO performance, we should be able to pull it off with non-ssd disks as well. TASK DETAIL https://phabricator.wikimedia.org/T104879 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev, Joe Cc: Jdouglas, Manybubbles, Smalyshev, Joe, Matanya, Aklapper, jkroll, Wikidata-bugs, RobH, aude, mark, JanZerebecki, faidon, fgiunchedi, Dzahn, chasemp, Malyacko, Krenair, P.Copp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104879: Define the details of the hardware we need to run WDQS
Smalyshev added a comment. Blazegraph recommendations: https://wiki.blazegraph.com/wiki/index.php/Hardware_Configuration TASK DETAIL https://phabricator.wikimedia.org/T104879 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jdouglas, Manybubbles, Smalyshev, Joe, Matanya, Aklapper, jkroll, Wikidata-bugs, RobH, aude, mark, JanZerebecki, faidon, fgiunchedi, Dzahn, chasemp, Malyacko, Krenair, P.Copp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104879: Define the details of the hardware we need to run WDQS
Smalyshev added a comment. Based on the above, I think what we need is: - 64G memory - 300 G SSD - 4-8 cores TASK DETAIL https://phabricator.wikimedia.org/T104879 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jdouglas, Manybubbles, Smalyshev, Joe, Matanya, Aklapper, jkroll, Wikidata-bugs, RobH, aude, mark, JanZerebecki, faidon, fgiunchedi, Dzahn, chasemp, Malyacko, Krenair, P.Copp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs