[Wikidata-bugs] [Maniphest] T294297: Q2:(Need By: End of Q2) rack/setup/install wdqs20[09,10,11]

2021-10-25 Thread RobH
RobH assigned this task to Papaul. RobH moved this task from Backlog to Racking Tasks on the ops-codfw board. TASK DETAIL https://phabricator.wikimedia.org/T294297 WORKBOARD https://phabricator.wikimedia.org/project/board/955/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] T294297: Q2:(Need By: End of Q2) rack/setup/install wdqs20[09,10,11]

2021-10-25 Thread RobH
RobH added a parent task: Unknown Object (Task). TASK DETAIL https://phabricator.wikimedia.org/T294297 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RobH Cc: Aklapper, RobH, MPhamWMF, CBogen, Namenlos314, Gq86, Lucas_Werkmeister_WMDE, EBjune

[Wikidata-bugs] [Maniphest] T294297: Q2:(Need By: End of Q2) rack/setup/install wdqs20[09,10,11]

2021-10-25 Thread RobH
RobH renamed this task from "(Need By: TBD) rack/setup/install wdqs20[09,10,11]" to "Q2:(Need By: End of Q2) rack/setup/install wdqs20[09,10,11]". TASK DETAIL https://phabricator.wikimedia.org/T294297 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/pa

[Wikidata-bugs] [Maniphest] T294297: (Need By: TBD) rack/setup/install wdqs20[09,10,11]

2021-10-25 Thread RobH
RobH created this task. RobH added projects: DC-Ops, ops-codfw, Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION This task will track the racking, setup, and OS installation of wdqs20[09,10,11] Hostname / Racking / Installation Details

[Wikidata-bugs] [Maniphest] T263125: Check for errors on wdqs1009 disks

2020-09-30 Thread RobH
RobH added a comment. IRC update from my chat with @gehel: wdqs1009 is not in production, but a non user facing test server. We can do our hdparm testing of secure erasure without affecting users. If we nuke the server, it can simply be reimaged. When Chris is ready to swap

[Wikidata-bugs] [Maniphest] T263125: Check for errors on wdqs1009 disks

2020-09-30 Thread RobH
RobH added a comment. I've pulled the TSR and submitted SR1038301301 for dispatching a replacement SSD to eqiad. This is now over to Chris for receipt and installation/return of defective SSD. Since the failing SSD is currently working, we need to attempt to securely erase it before

[Wikidata-bugs] [Maniphest] [Unblock] T221631: Dedicated servers on WMCS to test WDQS scalability strategy

2020-01-22 Thread RobH
RobH closed subtask T232654: eqiad: three clouvirt-wdqs servers for WDQS testing as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T221631 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Andrew, RobH Cc: Iamamz3, GreenReaper, RazShuty

[Wikidata-bugs] [Maniphest] [Commented On] T221632: Storage capacity upgrade for WDQS

2019-07-09 Thread RobH
RobH added a comment. I'd like to note that I'm against the trend of our raid configurations becoming raid0 per node, and relying on horizontal node redundancy over disk redundancy. Losing a single disk in a raid0 node invalidates the entire node, making it a single point of urgency

[Wikidata-bugs] [Maniphest] [Updated] T202780: add SSDs to wdqs1003

2018-09-05 Thread RobH
RobH shifted this object from the Restricted Space space to the S1 Public space.RobH edited projects, added ops-eqiad; removed procurement. TASK DETAILhttps://phabricator.wikimedia.org/T202780EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Cmjohnson, RobHCc

[Wikidata-bugs] [Maniphest] [Retitled] T202778: add ssds to wdqs2003

2018-08-24 Thread RobH
RobH renamed this task from "add more ssds to wdqs2003" to "add ssds to wdqs2003". TASK DETAILhttps://phabricator.wikimedia.org/T202778EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Papaul, RobHCc: Aklapper, mark, faidon, Addshore, Sma

[Wikidata-bugs] [Maniphest] [Commented On] T196485: WDQS diskspace is low

2018-08-24 Thread RobH
RobH added a comment. Please note all sub-tasks for additions to the wdqs cluster have been created and are linked off this task. Next steps are for coordination with @Gehel and onsites to add the disks. As the disks are hot swap addtions (not replacements), it shouldnt result in any downtime

[Wikidata-bugs] [Maniphest] [Created] T202779: add SSDs to wdqs100[45]

2018-08-24 Thread RobH
RobH created this task.RobH triaged this task as "Normal" priority.RobH added projects: Wikidata, Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint, Discovery, Operations, ops-eqiad. TASK DESCRIPTIONThis task will be used to coordinate a time between @Gehel and @Cmjohn

[Wikidata-bugs] [Maniphest] [Updated] T202778: add more ssds to wdqs2003

2018-08-24 Thread RobH
RobH added a project: ops-codfw. TASK DETAILhttps://phabricator.wikimedia.org/T202778EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Papaul, RobHCc: Aklapper, mark, faidon, Addshore, Smalyshev, RobH, Papaul, Gehel, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Updated] T202777: add SSDs to wdqs200[12]

2018-08-24 Thread RobH
RobH added a project: ops-codfw. TASK DETAILhttps://phabricator.wikimedia.org/T202777EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Papaul, RobHCc: Aklapper, mark, faidon, Addshore, Smalyshev, RobH, Papaul, Gehel, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Created] T202778: add more ssds to wdqs2003

2018-08-24 Thread RobH
RobH created this task.RobH triaged this task as "Normal" priority.RobH added projects: Wikidata, Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint, Discovery, Operations.Restricted Application added a subscriber: Aklapper. TASK DESCRIPTIONThis task will be used to coordin

[Wikidata-bugs] [Maniphest] [Created] T202777: add SSDs to wdqs200[12]

2018-08-24 Thread RobH
RobH created this task.RobH triaged this task as "Normal" priority.RobH added projects: Wikidata, Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint, Discovery, Operations.Restricted Application added a subscriber: Aklapper. TASK DESCRIPTIONThis task will be used to coordin

[Wikidata-bugs] [Maniphest] [Unblock] T196485: WDQS diskspace is low

2018-08-06 Thread RobH
RobH closed subtask T186526: codfw/eqiad: WDQS storage increase as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T196485EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobHCc: RobH, Aklapper, Gehel, Smalyshev, AndyTan, Davinaclare77, Qtn

[Wikidata-bugs] [Maniphest] [Commented On] T196485: WDQS diskspace is low

2018-07-02 Thread RobH
RobH added a comment. In T196485#4258384, @Gehel wrote: We have a "sleeping" task to order new disks: T186526 This has been resolved, as there are now 4 sub-tasks off it for the ordering of the ssds for each of the hosts listed in this task. As they are #procurement tasks, they are

[Wikidata-bugs] [Maniphest] [Unblock] T196485: WDQS diskspace is low

2018-07-02 Thread RobH
RobH closed subtask T186526: codfw/eqiad: WDQS storage increase as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T196485EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobHCc: Aklapper, Gehel, Smalyshev, AndyTan, Davinaclare77, Qtn1293,

[Wikidata-bugs] [Maniphest] [Closed] T195797: Stas needs root access on WDQS test cluster

2018-06-04 Thread RobH
RobH closed this task as "Resolved".RobH claimed this task.RobH added a comment. These patches have been merged, and should be live shortly on hosts!TASK DETAILhttps://phabricator.wikimedia.org/T195797EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T195797: Stas needs root access on WDQS test cluster

2018-06-04 Thread RobH
RobH added subscribers: MoritzMuehlenhoff, RobH.RobH added a comment. Please note this was approved in today's SRE team meeting. I'll go ahead and start merging @MoritzMuehlenhoff's patches.TASK DETAILhttps://phabricator.wikimedia.org/T195797EMAIL PREFERENCEShttps://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] [Edited] T194184: rack/setup/install wdqs10[09|10].eqiad.wmnet

2018-05-08 Thread RobH
RobH updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...Racking Proposal: Currently, there are 7 other wdqs systems (wdqs1002-1008). Of those 7, only 1 (wdqs2002) is out of warranty. As such, we should attempt to place the two new wdqs systems in racks other than

[Wikidata-bugs] [Maniphest] [Created] T194184: rack/setup/install wdqs10[09|10].eqiad.wmnet

2018-05-08 Thread RobH
RobH created this task.RobH triaged this task as "Normal" priority.RobH added projects: Wikidata-Query-Service, Discovery-Search, Operations, Wikidata, Discovery, Epic, Discovery-Wikidata-Query-Service-Sprint, ops-eqiad. TASK DESCRIPTIONThis task will track the racking, setup, and in

[Wikidata-bugs] [Maniphest] [Triaged] T193473: Add HTTPS support to wdqs-internal service

2018-05-03 Thread RobH
RobH triaged this task as "Normal" priority.RobH added a comment. As part of SRE clinic duty, I'm reviewing all unassigned, needs triage tasks in #operations and attempting to review if any are critical, or if they are normal priority. This task appears to be normal priority, and

[Wikidata-bugs] [Maniphest] [Triaged] T193733: Move dispatching of wikidata to a dedicated node

2018-05-03 Thread RobH
RobH triaged this task as "Normal" priority.RobH added a comment. As part of SRE clinic duty, I'm reviewing all unassigned, needs triage tasks in #operations and attempting to review if any are critical, or if they are normal priority. This task appears to be normal priority, and

[Wikidata-bugs] [Maniphest] [Unblock] T192452: Find out how many external uses the wbcheckconstraints API action has

2018-04-30 Thread RobH
RobH closed subtask T190415: Requesting access to stats machines for Lucas Werkmeister as "Declined". TASK DETAILhttps://phabricator.wikimedia.org/T192452EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobHCc: Lucas_Werkmeister_WMDE, Aklapper,

[Wikidata-bugs] [Maniphest] [Commented On] T188045: wdqs1004 broken

2018-03-12 Thread RobH
RobH added a comment. In T188045#4045150, @Platonides wrote: Well, if the server itself is needed, it will be doing its work with a different IP address than the one of wdqs1004, since it would have been suffering the same connection issues as wdqs1004 (just the other half time). The other

[Wikidata-bugs] [Maniphest] [Commented On] T188045: wdqs1004 broken

2018-03-12 Thread RobH
RobH added a comment. Ok, I misparsed all of that. So next steps: Chris traces out and sees what is connected to ge-4/0/18. It somehow has the same IP address as wdqs1004 and is just sitting there. If we can, we shut down that server. If we cannot, we fix dns so its pointing correctly

[Wikidata-bugs] [Maniphest] [Commented On] T188045: wdqs1004 broken

2018-03-09 Thread RobH
RobH added a comment. So I can see @Gehel asked: In T188045#4009517, @Gehel wrote: @Cmjohnson this looks like an issue with the physical connection. Could you try moving the cable to another port on the switch so that we can eliminate that possibility? In T188045#4014592, @Cmjohnson wrote

[Wikidata-bugs] [Maniphest] [Commented On] T186526: Increase storage space for Wikidata Query Service

2018-02-14 Thread RobH
RobH added a comment. Actually, each of the wdqs systems is mildly different, and may have different ssds and capacities. I'm moving this task into S4 #procurement, since it'll include pricing discussion.TASK DETAILhttps://phabricator.wikimedia.org/T186526EMAIL PREFERENCEShttps

[Wikidata-bugs] [Maniphest] [Claimed] T186526: Increase storage space for Wikidata Query Service

2018-02-13 Thread RobH
RobH claimed this task.RobH added a comment. I'll request quotation from the vendor for adding SSDS. I'll make a sub-task in #procurement, since it will contain pricing info.TASK DETAILhttps://phabricator.wikimedia.org/T186526EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Triaged] T186713: Setup a WDQS test cluster on real hardware

2018-02-08 Thread RobH
RobH triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T186713EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobHCc: Aklapper, EBjune, Smalyshev, Gehel, Davinaclare77, Qtn1293, Lahi, Gq86, Dar

[Wikidata-bugs] [Maniphest] [Commented On] T186526: Increase storage space for Wikidata Query Service

2018-02-05 Thread RobH
RobH added a comment. I'd advise we purchase the SSDs from the system manufacturers, so they would be covered under the system warranty. I can get pricing, but it'll need to go in an S4 task (since pricing isn't public info.) I don't recommend using third party SSDs, since they won't be covered

[Wikidata-bugs] [Maniphest] [Edited] T182991: New WDQS clusters eqiad + codfw

2017-12-18 Thread RobH
RobH updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...All quotations will be on the sub-task for the codfw system purchase, task T183201. NOT on this task. Please see sub-task T183201 for all followup. Please seeOnce the codfw quotation is agreed upon, @robh will make

[Wikidata-bugs] [Maniphest] [Blocker] T178492: Create a more controlled WDQS cluster

2017-12-18 Thread RobH
RobH changed the status of subtask T182991: New WDQS clusters eqiad + codfw from "Open" to "Stalled". TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobHCc: Daniel_Mietchen, BBlack, Lyd

[Wikidata-bugs] [Maniphest] [Changed Status] T182991: New WDQS clusters eqiad + codfw

2017-12-18 Thread RobH
RobH changed the task status from "Open" to "Stalled".RobH triaged this task as "Normal" priority.RobH updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...@EBjune can you confirm we have a budget for this? == Details for hw-request/procure

[Wikidata-bugs] [Maniphest] [Closed] T178271: Allow Kirk and Martijn (JClarity) access to our WDQS production servers

2017-11-27 Thread RobH
RobH closed this task as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T178271EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, RobHCc: MoritzMuehlenhoff, RStallman-legalteam, Karianna, debt, EBjune, Gehel, Aklapper,

[Wikidata-bugs] [Maniphest] [Commented On] T171210: rack/setup/install wdqs100[45].eqiad.wmnet

2017-08-28 Thread RobH
RobH added a comment. I've assigned this to @Gehel as both hosts are now online and ready for service implementation.TASK DETAILhttps://phabricator.wikimedia.org/T171210EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, RobHCc: gerritbot, PokestarFan

[Wikidata-bugs] [Maniphest] [Reassigned] T171210: rack/setup/install wdqs100[45].eqiad.wmnet

2017-08-28 Thread RobH
RobH reassigned this task from RobH to Gehel.RobH removed projects: Patch-For-Review, ops-eqiad.RobH updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] - handoff for service implementation...[x] - OS installation [x] - puppet/salt accept/initial run [x] - handoff

[Wikidata-bugs] [Maniphest] [Edited] T171210: rack/setup/install wdqs100[45].eqiad.wmnet

2017-08-28 Thread RobH
RobH updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] - operations/puppet update (install_server at minimum, other files if possible) [x] - OS installation [x] - puppet/salt accept/initial run...[x] - operations/puppet update (install_server at minimum, other files

[Wikidata-bugs] [Maniphest] [Claimed] T171210: rack/setup/install wdqs100[45].eqiad.wmnet

2017-08-28 Thread RobH
RobH claimed this task. TASK DETAILhttps://phabricator.wikimedia.org/T171210EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobHCc: gerritbot, PokestarFan, Aklapper, Gehel, Smalyshev, Cmjohnson, RobH, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0

[Wikidata-bugs] [Maniphest] [Commented On] T172798: allow wdqs-admins to pool / depool wdqs servers

2017-08-21 Thread RobH
RobH added a comment. This access request was reviewed and approved in today's (2017-08-21) operations team meeting. Giving these admins the rights to depool and repool individual systems within their purview was granted.TASK DETAILhttps://phabricator.wikimedia.org/T172798EMAIL PREFERENCEShttps

[Wikidata-bugs] [Maniphest] [Reassigned] T171210: rack/setup/install wdqs100[45].eqiad.wmnet

2017-08-03 Thread RobH
RobH reassigned this task from RobH to Cmjohnson.RobH added a comment. So wdqs1004 shows a link, and I'll proceed to install it. I can login to mgmt on wdqs1005, but its actual network port shows link down: Interface Admin Link Description ge-3/0/3updown wdqs1005 @Cmjohnson

[Wikidata-bugs] [Maniphest] [Edited] T171210: rack/setup/install wdqs100[45].eqiad.wmnet

2017-07-20 Thread RobH
RobH updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...Racking Proposal: These shouldn't be in any racks with existing wdqs systems (if possible), so do NOT place in a4 (wdqs1001). Place in any other 1GbE rack, since these use internal subnets. No two wdqs systems should

[Wikidata-bugs] [Maniphest] [Edited] T171210: rack/setup/install wdqs100[45].eqiad.wmnet

2017-07-20 Thread RobH
RobH updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...Racking Proposal: These shouldn't be in any racks with existing wdqs systems (if possible), so do NOT place in a4 (wdqs1001). Place in any other 1GbE rack, since these use internal subnets. No two wdqs systems should

[Wikidata-bugs] [Maniphest] [Edited] T171210: rack/setup/install wdqs100[45].eqiad.wmnet

2017-07-20 Thread RobH
RobH updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...Racking Proposal: These shouldn't be in any racks with existing wdqs systems (if possible), so do NOT place in a4 (wdqs1001). Place in any other 1GbE rack, so do NOT place in d3since these use internal subnets

[Wikidata-bugs] [Maniphest] [Created] T171210: rack/setup/install wdqs100[45].eqiad.wmnet

2017-07-20 Thread RobH
RobH created this task.RobH added projects: Wikidata-Query-Service, Operations, Wikidata, Discovery, Discovery-Search (Current work).Herald added a subscriber: Aklapper. TASK DESCRIPTIONThis task will track the racking and setup of wdqs100[45].eqiad.wmnet. Racking Proposal: These shouldn't

[Wikidata-bugs] [Maniphest] [Commented On] T166780: Replace wdqs100[12] servers as they are getting old

2017-06-02 Thread RobH
RobH added a comment. As these have SSDs, their lead time will extend past this fiscal year, and into next. I'll get quotes started.TASK DETAILhttps://phabricator.wikimedia.org/T166780EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobHCc: Smalyshev, Gehel

[Wikidata-bugs] [Maniphest] [Closed] T148747: Estimate hardware requirements for WDQS upgrade

2016-12-16 Thread RobH
RobH closed this task as "Resolved".RobH added a comment. As both wdqs expansion systems have been ordered and have setup tasks, I'm resolving this hardware-request.TASK DETAILhttps://phabricator.wikimedia.org/T148747EMAIL PREFERENCEShttps://phabricator.wikimedia.org/sett

[Wikidata-bugs] [Maniphest] [Block] T148747: Estimate hardware requirements for WDQS upgrade

2016-12-14 Thread RobH
RobH reopened subtask Unknown Object (Task) as "Open". TASK DETAILhttps://phabricator.wikimedia.org/T148747EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Deskana, RobHCc: OakleyAlways1, RobH, mark, K4-713, Sjoerddebruin, Gehel, Aklapper, Deskana,

[Wikidata-bugs] [Maniphest] [Edited] T152644: rack/setup/install wdqs2003

2016-12-14 Thread RobH
RobH edited the task description. (Show Details) EDIT DETAILS...[x] - install_module update (same partitioning as wdqs200[12] if possible)...TASK DETAILhttps://phabricator.wikimedia.org/T152644EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Papaul, RobHCc

[Wikidata-bugs] [Maniphest] [Commented On] T152644: rack/setup/install wdqs2003

2016-12-14 Thread RobH
RobH added a comment. All of the install_module and dns changes that @Papaul put in gerrit for review have been merged live on cluster, @Papaul can continue with the installation.TASK DETAILhttps://phabricator.wikimedia.org/T152644EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Unblock] T152644: rack/setup/install wdqs2003

2016-12-14 Thread RobH
RobH closed subtask T153094: wdqs2003 switch port configuration as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T152644EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Papaul, RobHCc: Southparkfan, Smalyshev, Aklapper, Deskana, mark

[Wikidata-bugs] [Maniphest] [Closed] T153094: wdqs2003 switch port configuration

2016-12-14 Thread RobH
RobH closed this task as "Resolved".RobH added a comment. network port enabled, description set, and put in the internal vlan.TASK DETAILhttps://phabricator.wikimedia.org/T153094EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobHCc: Gehel, RobH,

[Wikidata-bugs] [Maniphest] [Created] T152644: rack/setup/install wdqs2003

2016-12-07 Thread RobH
RobH created this task.RobH added projects: Discovery, Wikidata-Query-Service, Wikidata, Operations, ops-codfw.Herald added a subscriber: Southparkfan. TASK DESCRIPTIONThis task will track the racking and setup of the new system host ordered on T149351 as wdqs2003. wdqs2001 is racked in c5

[Wikidata-bugs] [Maniphest] [Created] T152643: rack/setup/install wdqs1003

2016-12-07 Thread RobH
RobH created this task.RobH added projects: Discovery, Wikidata-Query-Service, Wikidata, Operations, ops-eqiad.Herald added a subscriber: Southparkfan. TASK DESCRIPTIONThis task will track the racking and setup of the new system host ordered on T149351 as wdqs1003. wdqs1001 is racked in d3

[Wikidata-bugs] [Maniphest] [Changed Status] T148747: Estimate hardware requirements for WDQS upgrade

2016-10-31 Thread RobH
RobH added subscribers: K4-713, mark, RobH.RobH changed the task status from "Open" to "Stalled".RobH added a comment. I received an IRC notice from Mark to start working on this, from an out of band coversation between @mark and @K4-713. I've created the sub-tasks in the #

[Wikidata-bugs] [Maniphest] [Block] T148747: Estimate hardware requirements for WDQS upgrade

2016-10-27 Thread RobH
RobH created subtask T149351: codfw/eqiad: (1 each) wdqs cluster expansion. TASK DETAILhttps://phabricator.wikimedia.org/T148747EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Deskana, RobHCc: Sjoerddebruin, Gehel, Aklapper, Deskana, Smalyshev, mschwarzer

[Wikidata-bugs] [Maniphest] [Created] T149351: codfw/eqiad: (1 each) wdqs cluster expansion

2016-10-27 Thread RobH
RobH created this task.RobH added projects: Discovery, Wikidata-Query-Service, Wikidata, Operations, procurement. TASK DESCRIPTIONThis task will track the quote(s) and order(s) for expanding the wdqs cluster in both codfw and eqiad. These systems were most recently ordered for codfw on T139482

[Wikidata-bugs] [Maniphest] [Closed] T138637: codfw: (2) wqds200[12] systems

2016-09-20 Thread RobH
RobH closed this task as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T138637EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobHCc: Sjoerddebruin, hoo, RobH, Aklapper, Joe, Gehel, Zppix, Smalyshev, mschwarzer, Avner, debt, D3r1c

[Wikidata-bugs] [Maniphest] [Unblock] T124862: Deploy WDQS nodes on codfw

2016-09-20 Thread RobH
RobH closed subtask T138637: codfw: (2) wqds200[12] systems as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T124862EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobHCc: hoo, Gehel, Tfinc, Deskana, Joe, EBernhardson, Aklapper,

[Wikidata-bugs] [Maniphest] [Updated] T138637: codfw: (2) wqds200[12] systems

2016-07-06 Thread RobH
RobH added a subtask: Unknown Object (Task). TASK DETAILhttps://phabricator.wikimedia.org/T138637EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobHCc: hoo, RobH, Aklapper, Joe, Gehel, Zppix, Smalyshev, Avner, debt, D3r1ck01, Jonas, FloNight, Xmlizer, Izno

[Wikidata-bugs] [Maniphest] [Retitled] T138637: codfw: (2) wqds200[12] systems

2016-07-06 Thread RobH
RobH changed the title from "Hardware request for codfw WDQS server" to "codfw: (2) wqds200[12] systems".RobH claimed this task. TASK DETAILhttps://phabricator.wikimedia.org/T138637EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobHCc:

[Wikidata-bugs] [Maniphest] [Updated] T138637: Hardware request for codfw WDQS server

2016-07-06 Thread RobH
RobH added a comment. wdqs100[12] have the following hardware: Dell PowerEdge R420 Dual Intel(R) Xeon(R) CPU E5-2440 0 @ 2.40GHz (6 cores) 96GB RAM SSDs in a hw raid10 to total 500GB space currently 4 * 300GB We have no spares in any site to match this specification right now. I'll create

[Wikidata-bugs] [Maniphest] [Updated] T134017: Create Wikipedia Jamaican

2016-06-22 Thread RobH
RobH added a blocking task: T135029: adywiki and jamwiki are missing the associated *_p databases with appropriate views. TASK DETAILhttps://phabricator.wikimedia.org/T134017EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobHCc: RobH, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] [Commented On] T134017: Create Wikipedia Jamaican

2016-06-16 Thread RobH
RobH added a comment. It sounds like a database script, and therefore falls to @jcrespo? (I don't want to leave this sitting with no attention, so just checking if he would be best.) I've pinged him about this via IRC.TASK DETAILhttps://phabricator.wikimedia.org/T134017EMAIL PREFERENCEShttps

[Wikidata-bugs] [Maniphest] [Commented On] T120712: install two Intel 320 Series SSDSA2CW300G3 2.5" 300GB each in wdqs1001/wdqs1002

2016-05-09 Thread RobH
RobH added a comment. I imagine the smaller capacity disks were installed by accident, as we have on shelf spares of that model SSD in both capacities. TASK DETAIL https://phabricator.wikimedia.org/T120712 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Commented On] T120714: implement wdqs1001/1002 disk upgrades (extend lvm)

2016-03-15 Thread RobH
RobH added a comment. That works for me, and I'll be around that entire week to assist on the operations end of things. Would we be able to include the re-image in that downtime window, or are we not certain about that quite yet? TASK DETAIL https://phabricator.wikimedia.org/T120714

[Wikidata-bugs] [Maniphest] [Commented On] T120714: implement wdqs1001/1002 disk upgrades (extend lvm)

2016-03-14 Thread RobH
RobH added a comment. Barring any issues during the reimagine (as long as nothing breaks) it can typically be reinstalled in around an hour. This includes enabling the new disks, adding/updating the partman recipe (which we can do the bulk of before downtime), reinstalling the OS

[Wikidata-bugs] [Maniphest] [Commented On] T120714: implement wdqs1001/1002 disk upgrades (extend lvm)

2016-03-14 Thread RobH
RobH added a comment. At first glance, neither of these is showing the extra disks. It turns out these have the H310 controller, which means we need to enable the disks in the controller. If this was a typical raid controller, I just would do this while they are in service. The H310

[Wikidata-bugs] [Maniphest] [Unblock] T114443: EventBus MVP

2015-12-16 Thread RobH
RobH closed blocking task T114191: Setup a 2 server Kafka instance in both eqiad and codfw for reliable purge streams as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T114443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Otto

[Wikidata-bugs] [Maniphest] [Commented On] T119579: Additional diskspace of wdqs1001/wdqs1002

2015-12-07 Thread RobH
RobH added a comment. Well, we have @Mark's approval to use the on-site spares for this (as we have plenty.) Now the only question is how best to implement. We could do as @Joe suggests and add the two additional disks as raid1 and extend the LVM onto them. Ideally, we setup future installs

[Wikidata-bugs] [Maniphest] [Commented On] T119579: Additional diskspace of wdqs1001/wdqs1002

2015-12-07 Thread RobH
RobH added a comment. My issue is if we toss these in as a raid1 and extend the LVM, that is NOT how we would typically install it from scratch. So when these systems eventually upgrade and reinstall the distro, it'll involve changing the raid setup and potentially mount points, etc... I

[Wikidata-bugs] [Maniphest] [Commented On] T119579: Additional diskspace of wdqs1001/wdqs1002

2015-12-07 Thread RobH
RobH added a comment. That sounds reasonable to me. I'll create the sub-tasks for the on-site installation of the disks and implementation of both raid1 and space + future reimage. TASK DETAIL https://phabricator.wikimedia.org/T119579 EMAIL PREFERENCES https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] [Created] T120712: install two Intel 320 Series SSDSA2CW300G3 2.5" 300GB each in wdqs1001/wdqs1002

2015-12-07 Thread RobH
RobH created this task. RobH assigned this task to Cmjohnson. RobH added subscribers: RobH, mark, fgiunchedi, hoo, Aklapper, Joe, StudiesWorld, Smalyshev, Cmjohnson. RobH added projects: Discovery, Wikidata-Query-Service, Wikidata, operations, ops-eqiad. TASK DESCRIPTION @cmjohnson

[Wikidata-bugs] [Maniphest] [Closed] T119579: Additional diskspace of wdqs1001/wdqs1002

2015-12-07 Thread RobH
RobH closed this task as "Resolved". RobH added a comment. Resolving this task as the onsite task now exists. TASK DETAIL https://phabricator.wikimedia.org/T119579 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RobH Cc: RobH, mark, fgiun

[Wikidata-bugs] [Maniphest] [Created] T120714: implement wdqs1001/1002 disk upgrades (extend lvm)

2015-12-07 Thread RobH
RobH created this task. RobH added subscribers: Cmjohnson, Smalyshev, StudiesWorld, Joe, Aklapper, hoo, fgiunchedi, mark, RobH. RobH added projects: operations, Wikidata, Wikidata-Query-Service, Discovery. TASK DESCRIPTION Once T120712 is completed, the newly installed disks will need

[Wikidata-bugs] [Maniphest] [Assigned] T119579: Additional diskspace of wdqs1001/wdqs1002

2015-12-02 Thread RobH
RobH added subscribers: mark, RobH. RobH assigned this task to Smalyshev. RobH added a comment. Ok some working notes: Both wdqs1001/wdqs1002 are Dell Poweredge R420s that have space for 8 total SFF (2.5") disks. We presently have dual 300GB installed into each. robh@wdqs1002:~$

[Wikidata-bugs] [Maniphest] [Commented On] T119579: Additional diskspace of wdqs1001/wdqs1002

2015-12-02 Thread RobH
RobH added a comment. It would require a reimage to replace the raid1 with a raid10. However, it would be the best option in the long run, as a raid10 can then have additional disk pairs added without reimage. (So adding any further disks in the future shouldn't require reimage, as long

[Wikidata-bugs] [Maniphest] [Changed Project Column] T119579: Additional diskspace of wdqs1001/wdqs1002

2015-12-02 Thread RobH
RobH moved this task to In Discussion / Review on the hardware-requests workboard. TASK DETAIL https://phabricator.wikimedia.org/T119579 WORKBOARD https://phabricator.wikimedia.org/project/board/1014/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Closed] T112892: [Bug] analytics stat1002 xmldatadumps wikidata entities symlink incorrect

2015-09-22 Thread RobH
RobH closed this task as "Resolved" by committing rOPUPfb35e11d8ce4: Make link in dataset relative. TASK DETAIL https://phabricator.wikimedia.org/T112892 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: JanZerebecki, RobH Cc: gerritbot

[Wikidata-bugs] [Maniphest] [Changed Project Column] T86561: Wikidata Query Service hardware

2015-07-15 Thread RobH
RobH moved this task to Allocation/Ordering on the hardware-requests workboard. TASK DETAIL https://phabricator.wikimedia.org/T86561 WORKBOARD https://phabricator.wikimedia.org/project/board/1014/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Changed Project Column] T86561: Wikidata Query Service hardware

2015-07-15 Thread RobH
RobH moved this task to In Discussion on the hardware-requests workboard. TASK DETAIL https://phabricator.wikimedia.org/T86561 WORKBOARD https://phabricator.wikimedia.org/project/board/1014/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Joe

[Wikidata-bugs] [Maniphest] [Updated] T86561: Wikidata Query Service hardware

2015-07-15 Thread RobH
RobH added a project: hardware-requests. RobH added a subscriber: RobH. TASK DETAIL https://phabricator.wikimedia.org/T86561 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Joe, RobH Cc: RobH, Matanya, faidon, mark, JanZerebecki, Aklapper, Joe

[Wikidata-bugs] [Maniphest] [Updated] T86561: Wikidata Query Service hardware

2015-07-15 Thread RobH
RobH added a comment. Update from IRC discussion: We'll be allocating two systems for this: Dell PowerEdge https://phabricator.wikimedia.org/diffusion/EPBO/, Dual Intel Xeon https://phabricator.wikimedia.org/E5-2440, 64GB Memory, Dual 300GB SSD, H310 Mini Raid Card wmf3543 - currently in d3

[Wikidata-bugs] [Maniphest] [Changed Project Column] T105185: Need deploy rights for Wikidata Query Service

2015-07-10 Thread RobH
RobH moved this task to In Review on the Ops-Access-Requests workboard. TASK DETAIL https://phabricator.wikimedia.org/T105185 WORKBOARD https://phabricator.wikimedia.org/project/board/956/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Joe, RobH

[Wikidata-bugs] [Maniphest] [Commented On] T84902: deploy haedus and capella with os for orientdb testing

2014-12-22 Thread RobH
RobH added a comment. It seems I accidentally didnt notice and break the raid config setup on capella, as it uses an H310. A quick look confirms haedus does as well. So now capella is reinstalled with the h310 in bypass mode, presenting the disks normally. So this should be good to go, going

[Wikidata-bugs] [Maniphest] [Updated] T84902: deploy haedus and capella with os for orientdb testing

2014-12-22 Thread RobH
RobH removed a project: ops-codfw. TASK DETAIL https://phabricator.wikimedia.org/T84902 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences