[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[AndrewTavis_WMDE]

AndrewTavis_WMDE closed subtask T351072: Remove the WDCM clone (stats1007) as 
"Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AndrewTavis_WMDE
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[AndrewTavis_WMDE]

AndrewTavis_WMDE closed this task as "Resolved".
AndrewTavis_WMDE claimed this task.
AndrewTavis_WMDE added a comment.


  Sounds good to me! :) Thanks for the help here, @Lucas_Werkmeister_WMDE and 
@BTullis!

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AndrewTavis_WMDE
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a comment.


  I think it would be fine to mark this as resolved too.

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[AndrewTavis_WMDE]

AndrewTavis_WMDE added a comment.


  None of the files listed in your comment above 
 look like things we should 
worry about, @Lucas_Werkmeister_WMDE. Similarly that there's a different commit 
for this, as to my knowledge `stat1005` was the main server for the related 
work.
  
  So sounds like our work for this is finalized? Do we want to resolve this or 
keep this open until `stat1005` is fully deprecated?

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AndrewTavis_WMDE
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[Maintenance_bot]

Maintenance_bot removed a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Isabelladantes1983, Themindcoder, 
Adamm71, Hellket777, LisafBia6531, 786, Biggs657, Juan90264, Alter-paule, 
Beast1978, Un1tY, Hook696, Kent7301, CucyNoiD, Gaboe420, Giuliamocci, Cpaulf30, 
Af420, Bsandipan, Lewizho99, Maathavan, Neuronton
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a comment.


  Interestingly, stat1007 isn’t even on the same commit as stat1011:
  
  name=stat1007
lucaswerkmeister-wmde@stat1007:~$ sudo -u analytics-wmde git -C 
/srv/analytics-wmde/wdcm/src/ show -s
commit aa40182c322410584e91b93b9327adc017a218e9 (HEAD -> master, 
origin/master, origin/HEAD)
Author: GoranMilovanovic 
Date:   Thu Feb 8 20:08:09 2018 +0100

Minor

Change-Id: I5329a17b7b82b88958945f90b804195838e536b7
  
  
  
  name=stat1011
lucaswerkmeister-wmde@stat1011:~$ sudo -u analytics-wmde git -C 
/srv/analytics-wmde/wdcm/src/ show -s
commit c2b0a324e9ee35aa3d0e02dc29437342c0753e43 (HEAD -> master, 
origin/master, origin/HEAD)
Author: GoranMilovanovic 
Date:   Wed Nov 25 23:06:33 2020 +0100

T268684

Change-Id: I024691a1481dd7e20765328f224120c72c9d553b
  
  (I’m still assuming this is all irrelevant and just noting it for the record.)

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, Isabelladantes1983, Themindcoder, Adamm71, S8321414, 
Hellket777, LisafBia6531, Astuthiodit_1, 786, Biggs657, karapayneWMDE, 
Invadibot, maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, 
Akuckartz, Dringsim, Hook696, Kent7301, CucyNoiD, Nandana, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, 
QZanden, KimKelting, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, 
Neuronton, Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a comment.


  In T364965#9838567 , 
@Stashbot wrote:
  
  > Mentioned in SAL (#wikimedia-operations) [2024-05-28T16:14:49Z] 
 lucaswerkmeister-wmde@stat1011:~$ sudo -u analytics-wmde rm -rf 
/srv/analytics-wmde/wdcm/ # T364965 
; contained src/ as a clean git 
clone as of c2b0a324e9 

 / I024691a148, and nothing else
  
  Note: The stat1007 version, unlike stat1011 as logged above, has some 
untracked files:
  
lucaswerkmeister-wmde@stat1007:~$ sudo -u analytics-wmde git -C 
/srv/analytics-wmde/wdcm/src/ status
On branch master
Your branch is up to date with 'origin/master'.

Untracked files:
  (use "git add ..." to include in what will be committed)

WDCM_CollectedItems/Architectural Structure_ItemIDs.csv
WDCM_CollectedItems/Astronomical Object_ItemIDs.csv
WDCM_CollectedItems/Book_ItemIDs.csv
WDCM_CollectedItems/Chemical Entities_ItemIDs.csv
WDCM_CollectedItems/Event_ItemIDs.csv
WDCM_CollectedItems/Gene_ItemIDs.csv
WDCM_CollectedItems/Geographical Object_ItemIDs.csv
WDCM_CollectedItems/Human_ItemIDs.csv
WDCM_CollectedItems/Organization_ItemIDs.csv
WDCM_CollectedItems/Scientific Article_ItemIDs.csv
WDCM_CollectedItems/Taxon_ItemIDs.csv
WDCM_CollectedItems/Thoroughfare_ItemIDs.csv
WDCM_CollectedItems/Wikimedia_Internal_ItemIDs.csv
WDCM_CollectedItems/Work Of Art_ItemIDs.csv
WDCM_Engine.R
WDCM_Logs/QueryResult.java
WDCM_Logs/WDCM_CollectItems_SPARQL_Errors.csv
WDCM_Logs/clienttables.tsv
WDCM_Logs/databases.tsv
WDCM_Logs/projectsTracking.csv

nothing added to commit but untracked files present (use "git add" to track)
  
  I’m assuming these aren’t needed and can be lost when stat1007 as a whole 
goes away, but just in case, I’m not deleting the directory there just yet.

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, Isabelladantes1983, Themindcoder, Adamm71, S8321414, 
Hellket777, LisafBia6531, Astuthiodit_1, 786, Biggs657, karapayneWMDE, 
Invadibot, maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, 
Akuckartz, Dringsim, Hook696, Kent7301, CucyNoiD, Nandana, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, 
QZanden, KimKelting, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, 
Neuronton, Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[Stashbot]

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2024-05-28T16:14:49Z]  
lucaswerkmeister-wmde@stat1011:~$ sudo -u analytics-wmde rm -rf 
/srv/analytics-wmde/wdcm/ # T364965 
; contained src/ as a clean git 
clone as of c2b0a324e9 

 / I024691a148, and nothing else

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, Isabelladantes1983, Themindcoder, Adamm71, S8321414, 
Hellket777, LisafBia6531, Astuthiodit_1, 786, Biggs657, karapayneWMDE, 
Invadibot, maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, 
Akuckartz, Dringsim, Hook696, Kent7301, CucyNoiD, Nandana, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, 
QZanden, KimKelting, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, 
Neuronton, Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[gerritbot]

gerritbot added a comment.


  Change #1035468 **merged** by RLazarus:
  
  [operations/puppet@production] Remove statistics::wmde::wdcm
  
  https://gerrit.wikimedia.org/r/1035468

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, Isabelladantes1983, Themindcoder, Adamm71, S8321414, 
Hellket777, LisafBia6531, Astuthiodit_1, 786, Biggs657, karapayneWMDE, 
Invadibot, maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, 
Akuckartz, Dringsim, Hook696, Kent7301, CucyNoiD, Nandana, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, 
QZanden, KimKelting, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, 
Neuronton, Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[AndrewTavis_WMDE]

AndrewTavis_WMDE added a comment.


  Thanks for taking care of this, @Lucas_Werkmeister_WMDE! We'll be able to 
close both this and T351072  after 
Tuesday next week if/when the Puppet change is deployed :)

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AndrewTavis_WMDE
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, Isabelladantes1983, Themindcoder, Adamm71, S8321414, 
Hellket777, LisafBia6531, Astuthiodit_1, 786, Biggs657, karapayneWMDE, 
Invadibot, maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, 
Akuckartz, Dringsim, Hook696, Kent7301, CucyNoiD, Nandana, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, 
QZanden, KimKelting, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, 
Neuronton, Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[gerritbot]

gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, Isabelladantes1983, Themindcoder, Adamm71, S8321414, 
Hellket777, LisafBia6531, Astuthiodit_1, 786, Biggs657, karapayneWMDE, 
Invadibot, maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, 
Akuckartz, Dringsim, Hook696, Kent7301, CucyNoiD, Nandana, Gaboe420, 
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, 
QZanden, KimKelting, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, 
Neuronton, Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[gerritbot]

gerritbot added a comment.


  Change #1035468 had a related patch set uploaded (by Lucas Werkmeister 
(WMDE); author: Lucas Werkmeister (WMDE)):
  
  [operations/puppet@production] Remove statistics::wmde::wdcm
  
  https://gerrit.wikimedia.org/r/1035468

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[AndrewTavis_WMDE]

AndrewTavis_WMDE added a comment.


  @BTullis, checking in on this as your help in T358311 
 reminded me as it's all related to 
the same user. Would you be able to remove the 
`statistics/manifests/wmde/wdcm.pp` file and any related processes (including 
now stat1011) as well?

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AndrewTavis_WMDE
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[Manuel]

Manuel added a subtask: T351072: Remove the WDCM clone (stats1007).

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Manuel
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[AndrewTavis_WMDE]

AndrewTavis_WMDE added a comment.


  Confirming that data's still coming in as well. @BTullis, what should we do 
about statistics/manifests/wmde/wdcm.pp 
?
 Remove the file? And could you also remove it from puppet entirely on stat1011 
as well? Anything else?

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AndrewTavis_WMDE
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[BTullis]

BTullis added a comment.


  In T364965#9800046 , 
@Lucas_Werkmeister_WMDE wrote:
  
  > ...we can see if this Grafana panel 

 (which is populated by one of the `minutely` scripts) gets a gap, or whether 
it’s still populated from stat1011 without interruption.
  
  Looks OK to me.

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BTullis
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[BTullis]

BTullis added a comment.


  I have stopped the timers:
  
btullis@stat1007:~$ sudo systemctl stop performance-asoranking.timer 
product-analytics-movement-metrics.timer wmde-analytics-daily-early.timer 
wmde-analytics-daily-noon.timer wmde-analytics-minutely.timer 
wmde-analytics-weekly.timer
  
  Disabled the timers (which is what I had done previously):
  
btullis@stat1007:~$ sudo systemctl disable performance-asoranking.timer 
product-analytics-movement-metrics.timer wmde-analytics-daily-early.timer 
wmde-analytics-daily-noon.timer wmde-analytics-minutely.timer 
wmde-analytics-weekly.timer
  
  Removed the stray unit files and reloaded the systemd daemon.
  
btullis@stat1007:/lib/systemd/system$ sudo rm wmde-analytics-* 
performance-asoranking.* product-analytics-movement-metrics.*
btullis@stat1007:/lib/systemd/system$ sudo systemctl daemon-reload
  
  I have `run-puppet-agent` and verified that they don't come back. Now let's 
check for any gap in the dashobard that you mentioned.

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BTullis
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[BTullis]

BTullis added a comment.


  Ah yes, I thought I had actually removed the unit files in T353785#9789575 
 but I only disabled them. 
Puppet is not re-enabling them because they're unmanaged objects.
  I'll go ahead and stop them, delete any left over unit files, 
`daemon-reload`, run puppet for good measure, then see where we are.

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BTullis
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a comment.


  Though I guess just stopping the timers on stat1007 for half an hour could 
still be useful – then we can see if this Grafana panel 

 (which is populated by one of the `minutely` scripts) gets a gap, or whether 
it’s still populated from stat1011 without interruption.

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a comment.


  AFAIK you’d have to at least `stop` (and maybe `disable`) the timers, not the 
services (and I don’t think `systemctl daemon-reload` would have any effect if 
you’re not editing the unit files) – but won’t Puppet just restart the timers 
again in half an hour?

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[BTullis]

BTullis added a comment.


  You are right! Apologies, it seems that disabling the timer doesn't unload 
it, so they have been continuing to run on stat1007.
  Here's a tail from `journalctl -u wmde-analytics-minutely.service` on 
stat1007.
  
May 15 13:41:01 stat1007 systemd[1]: Starting Minutely jobs for wmde 
analytics infrastructure...
May 15 13:41:01 stat1007 minutely.sh[25992]: + '[' -z 
/srv/analytics-wmde/graphite/src/scripts ']'
May 15 13:41:01 stat1007 minutely.sh[25992]: + date '+%F %T minutely.sh 
Started!'
May 15 13:41:01 stat1007 minutely.sh[25992]: 2024-05-15 13:41:01 
minutely.sh Started!
May 15 13:41:01 stat1007 minutely.sh[25992]: + eval 
/srv/analytics-wmde/graphite/src/scripts/src/wikidata/wb_changes.php
May 15 13:41:01 stat1007 minutely.sh[25992]: ++ 
/srv/analytics-wmde/graphite/src/scripts/src/wikidata/wb_changes.php
May 15 13:41:01 stat1007 minutely.sh[25992]: + eval 
/srv/analytics-wmde/graphite/src/scripts/src/wikidata/maxlag.php
May 15 13:41:01 stat1007 minutely.sh[25992]: + date '+%F %T minutely.sh 
Waiting!'
May 15 13:41:01 stat1007 minutely.sh[25992]: ++ 
/srv/analytics-wmde/graphite/src/scripts/src/wikidata/maxlag.php
May 15 13:41:01 stat1007 minutely.sh[25992]: + eval 
/srv/analytics-wmde/graphite/src/scripts/src/wikidata/recentChanges.php
May 15 13:41:01 stat1007 minutely.sh[25992]: ++ 
/srv/analytics-wmde/graphite/src/scripts/src/wikidata/recentChanges.php
May 15 13:41:01 stat1007 minutely.sh[25992]: 2024-05-15 13:41:01 
minutely.sh Waiting!
May 15 13:41:01 stat1007 minutely.sh[25992]: + wait
May 15 13:41:01 stat1007 minutely.sh[25992]: 2024-05-15 13:41:01 
wikidata-wb_changes Script Started!
May 15 13:41:01 stat1007 minutely.sh[25992]: 2024-05-15 13:41:01 
wikidata-recentChanges Script Started!
May 15 13:41:01 stat1007 minutely.sh[25992]: 2024-05-15 13:41:01 
wikidata-maxlag Script Started!
May 15 13:41:02 stat1007 minutely.sh[25992]: 2024-05-15 13:41:02 
wikidata-maxlag Script Finished!
May 15 13:41:03 stat1007 minutely.sh[25992]: 2024-05-15 13:41:03 
wikidata-wb_changes Script Finished!
May 15 13:41:12 stat1007 minutely.sh[25992]: 2024-05-15 13:41:12 
wikidata-recentChanges Script Finished!
May 15 13:41:12 stat1007 minutely.sh[25992]: + date '+%F %T minutely.sh 
Ended!'
May 15 13:41:12 stat1007 minutely.sh[25992]: 2024-05-15 13:41:12 
minutely.sh Ended!
May 15 13:41:12 stat1007 systemd[1]: wmde-analytics-minutely.service: 
Succeeded.
May 15 13:41:12 stat1007 systemd[1]: Started Minutely jobs for wmde 
analytics infrastructure.
  
  Clearly I need to brush up on my `systemctl` commands.
  
  Shall I go ahead and remove them on stat1007 now? I Will go with a `systemctl 
stop` for each service and `systemctl daemon-reload` at the end.

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BTullis
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[AndrewTavis_WMDE]

AndrewTavis_WMDE added a comment.


  Quick note that the word used by @BTullis was `disabled` instead of `removed` 
for the stat1007 timers, so apologies if this caused some confusion. I figure 
not, but just wanted to be clear :)
  
  @BTullis, would you be able to check the journal for them and paste the 
output here so we can check it? On my end as well it seems like I can't access 
it.

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AndrewTavis_WMDE
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a comment.


  > The assumption is that they're working, and the timers for stat1007 have 
been removed.
  
  To me it looks like the timers are still running on both hosts:
  
  name=timers on stat1007
lucaswerkmeister-wmde@stat1007:~$ systemctl status 
wmde-analytics-minutely.timer wmde-analytics-daily-early.timer 
wmde-analytics-daily-noon.timer wmde-analytics-weekly.timer
● wmde-analytics-minutely.timer - Periodic execution of 
wmde-analytics-minutely.service
   Loaded: loaded (/lib/systemd/system/wmde-analytics-minutely.timer; 
disabled; vendor preset: enabled)
   Active: active (waiting) since Wed 2023-10-18 09:17:40 UTC; 6 months 27 
days ago
  Trigger: Wed 2024-05-15 12:42:00 UTC; 45s left

● wmde-analytics-daily-early.timer - Periodic execution of 
wmde-analytics-daily-early.service
   Loaded: loaded (/lib/systemd/system/wmde-analytics-daily-early.timer; 
disabled; vendor preset: enabled)
   Active: active (waiting) since Wed 2023-10-18 09:17:40 UTC; 6 months 27 
days ago
  Trigger: Thu 2024-05-16 03:00:00 UTC; 14h left

● wmde-analytics-daily-noon.timer - Periodic execution of 
wmde-analytics-daily-noon.service
   Loaded: loaded (/lib/systemd/system/wmde-analytics-daily-noon.timer; 
disabled; vendor preset: enabled)
   Active: active (waiting) since Wed 2023-10-18 09:17:41 UTC; 6 months 27 
days ago
  Trigger: Thu 2024-05-16 12:00:00 UTC; 23h left

● wmde-analytics-weekly.timer - Periodic execution of 
wmde-analytics-weekly.service
   Loaded: loaded (/lib/systemd/system/wmde-analytics-weekly.timer; 
disabled; vendor preset: enabled)
   Active: active (waiting) since Wed 2023-10-18 09:17:41 UTC; 6 months 27 
days ago
  Trigger: Sun 2024-05-19 00:00:00 UTC; 3 days left
  
  
  
  name=timers on stat1011
lucaswerkmeister-wmde@stat1011:~$ systemctl status 
wmde-analytics-minutely.timer wmde-analytics-daily-early.timer 
wmde-analytics-daily-noon.timer wmde-analytics-weekly.timer
● wmde-analytics-minutely.timer - Periodic execution of 
wmde-analytics-minutely.service
 Loaded: loaded (/lib/systemd/system/wmde-analytics-minutely.timer; 
enabled; vendor preset: enabled)
 Active: active (waiting) since Mon 2024-05-13 09:58:50 UTC; 2 days ago
Trigger: Wed 2024-05-15 12:41:00 UTC; 4s ago
   Triggers: ● wmde-analytics-minutely.service

Warning: some journal files were not opened due to insufficient permissions.
● wmde-analytics-daily-early.timer - Periodic execution of 
wmde-analytics-daily-early.service
 Loaded: loaded (/lib/systemd/system/wmde-analytics-daily-early.timer; 
enabled; vendor preset: enabled)
 Active: active (waiting) since Mon 2024-05-13 09:58:52 UTC; 2 days ago
Trigger: Thu 2024-05-16 03:00:00 UTC; 14h left
   Triggers: ● wmde-analytics-daily-early.service

Warning: some journal files were not opened due to insufficient permissions.
● wmde-analytics-daily-noon.timer - Periodic execution of 
wmde-analytics-daily-noon.service
 Loaded: loaded (/lib/systemd/system/wmde-analytics-daily-noon.timer; 
enabled; vendor preset: enabled)
 Active: active (waiting) since Mon 2024-05-13 09:58:54 UTC; 2 days ago
Trigger: Thu 2024-05-16 12:00:00 UTC; 23h left
   Triggers: ● wmde-analytics-daily-noon.service

Warning: some journal files were not opened due to insufficient permissions.
● wmde-analytics-weekly.timer - Periodic execution of 
wmde-analytics-weekly.service
 Loaded: loaded (/lib/systemd/system/wmde-analytics-weekly.timer; 
enabled; vendor preset: enabled)
 Active: active (waiting) since Mon 2024-05-13 09:58:56 UTC; 2 days ago
Trigger: Sun 2024-05-19 00:00:00 UTC; 3 days left
   Triggers: ● wmde-analytics-weekly.service

Warning: some journal files were not opened due to insufficient permissions.
  
  And the services are still being started on both hosts:
  
lucaswerkmeister-wmde@stat1007:~$ systemctl status 
wmde-analytics-minutely.service
● wmde-analytics-minutely.service - Minutely jobs for wmde analytics 
infrastructure
   Loaded: loaded (/lib/systemd/system/wmde-analytics-minutely.service; 
static; vendor preset: enabled)
   Active: inactive (dead) since Wed 2024-05-15 12:42:07 UTC; 6s ago
 Docs: https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  Process: 30146 
ExecStart=/srv/analytics-wmde/graphite/src/scripts/cron/minutely.sh 
/srv/analytics-wmde/graphite/src/scripts (code=exited, status=0/SUCCESS)
 Main PID: 30146 (code=exited, status=0/SUCCESS)
  
  
  
lucaswerkmeister-wmde@stat1011:~$ systemctl status 
wmde-analytics-minutely.service
● wmde-analytics-minutely.service - Minutely jobs for wmde analytics 
infrastructure
 Loaded: loaded (/lib/systemd/system/wmde-analytics-minutely.service; 
static)
 Active: inactive (dead) since Wed 2024-05-15 12:42:08

[Wikidata-bugs] [Maniphest] T364965: stat1007 to stat1011 migration pipeline output check

[AndrewTavis_WMDE]

AndrewTavis_WMDE renamed this task from "stat1007 migration output check" to 
"stat1007 to stat1011 migration pipeline output check".

TASK DETAIL
  https://phabricator.wikimedia.org/T364965

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AndrewTavis_WMDE
Cc: Lucas_Werkmeister_WMDE, BTullis, Manuel, Aklapper, AndrewTavis_WMDE, 
Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Dringsim, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org