[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[Maintenance_bot]

Maintenance_bot removed a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking, Maintenance_bot
Cc: Andrew, bking, akosiaris, Hokwelum, Volans, ayounsi, cmooney, EBernhardson, 
Bstorm, ArielGlenn, Gehel, Aklapper, Danny_Benjafield_WMDE, Bellucii32, 
Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, dcaro, Devnull, Slst2020, 
maantietaja, nskaggs, Raymond_Ndibe, ItamarWMDE, Nintendofan885, Akuckartz, 
Nandana, Namenlos314, skpuneethumar, sietec, Zylc, Giuliamocci, 1978Gage2001, 
Lahi, Operator873, Gq86, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Chicocvenancio, QZanden, EBjune, Tbscho, merbst, LawExplorer, JJMC89, elukey, 
_jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, mys_721tx, Cmjohnson, jkroll, 
Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, Gryllida, 
mark, faidon, scfc, Mbch331, bd808, Krenair, fgiunchedi, Isabelladantes1983, 
Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 786, Biggs657, 
Juan90264, Alter-paule, Beast1978, Un1tY, Hook696, Kent7301, joker88john, 
CucyNoiD, Gaboe420, Cpaulf30, Af420, Lewizho99, Maathavan, Neuronton
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[gerritbot]

gerritbot added a comment.


  Change 870714 **abandoned** by Bking:
  
  [operations/puppet@production] query_service: Allow query hosts to rsync data 
from clouddumps
  
  Reason:
  
  Our use case for dumps is small enough at this time; will revisit if needed
  
  https://gerrit.wikimedia.org/r/870714

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking, gerritbot
Cc: Andrew, bking, akosiaris, Hokwelum, Volans, ayounsi, cmooney, EBernhardson, 
Bstorm, ArielGlenn, Gehel, Aklapper, Danny_Benjafield_WMDE, Isabelladantes1983, 
Bellucii32, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, AWesterinen, 786, Biggs657, karapayneWMDE, Invadibot, dcaro, 
Devnull, Slst2020, maantietaja, nskaggs, Juan90264, Alter-paule, Raymond_Ndibe, 
Beast1978, ItamarWMDE, Un1tY, Nintendofan885, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, skpuneethumar, Gaboe420, sietec, 
Zylc, Giuliamocci, Cpaulf30, 1978Gage2001, Lahi, Operator873, Gq86, Af420, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, 
EBjune, Tbscho, merbst, LawExplorer, Lewizho99, JJMC89, Maathavan, elukey, 
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, mys_721tx, 
Cmjohnson, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, 
Manybubbles, Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[bking]

bking closed this task as "Resolved".
bking added a comment.


  Thanks @Hokwelum ! Since rsync is not rate-limited, we don't need to bother 
with the original topic of this ticket. The WDQS-specific rsync work will 
continue in T327689  .

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking
Cc: Andrew, bking, akosiaris, Hokwelum, Volans, ayounsi, cmooney, EBernhardson, 
Bstorm, ArielGlenn, Gehel, Aklapper, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Biggs657, karapayneWMDE, 
Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, maantietaja, nskaggs, Juan90264, 
Alter-paule, Raymond_Ndibe, Beast1978, CBogen, ItamarWMDE, Un1tY, 
Nintendofan885, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, Giuliamocci, Cpaulf30, 
1978Gage2001, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, 
Tbscho, merbst, LawExplorer, Lewizho99, JJMC89, Maathavan, elukey, _jensen, 
rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, mys_721tx, Cmjohnson, 
jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, 
Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[bking]

bking claimed this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking
Cc: Andrew, bking, akosiaris, Hokwelum, Volans, ayounsi, cmooney, EBernhardson, 
Bstorm, ArielGlenn, Gehel, Aklapper, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Biggs657, karapayneWMDE, 
Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, maantietaja, nskaggs, Juan90264, 
Alter-paule, Raymond_Ndibe, Beast1978, CBogen, ItamarWMDE, Un1tY, 
Nintendofan885, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, Giuliamocci, Cpaulf30, 
1978Gage2001, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, 
Tbscho, merbst, LawExplorer, Lewizho99, JJMC89, Maathavan, elukey, _jensen, 
rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, mys_721tx, Cmjohnson, 
jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, 
Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[fnegri]

fnegri moved this task from Kanban to Watching on the cloud-services-team board.
fnegri edited projects, added cloud-services-team; removed cloud-services-team 
(Kanban).

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

WORKBOARD
  https://phabricator.wikimedia.org/project/board/2773/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: fnegri
Cc: Andrew, bking, akosiaris, Hokwelum, Volans, ayounsi, cmooney, EBernhardson, 
Bstorm, ArielGlenn, Gehel, Aklapper, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Biggs657, karapayneWMDE, 
Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, maantietaja, nskaggs, Juan90264, 
Alter-paule, Raymond_Ndibe, Beast1978, CBogen, ItamarWMDE, Un1tY, 
Nintendofan885, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, Giuliamocci, Cpaulf30, 
1978Gage2001, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, 
Tbscho, merbst, LawExplorer, Lewizho99, JJMC89, Maathavan, elukey, _jensen, 
rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, mys_721tx, Cmjohnson, 
jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, 
Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, fgiunchedi, Ramtin2021, 
GeminiAgaloos, Phamhi, Allthingsgo
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[fnegri]

fnegri edited projects, added cloud-services-team; removed cloud-services-team 
(FY2022/2023-Q3).
Restricted Application edited projects, added cloud-services-team (Kanban); 
removed cloud-services-team.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: fnegri
Cc: Andrew, bking, akosiaris, Hokwelum, Volans, ayounsi, cmooney, EBernhardson, 
Bstorm, ArielGlenn, Gehel, Aklapper, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Biggs657, karapayneWMDE, 
Ramtin2021, Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, GeminiAgaloos, 
maantietaja, nskaggs, Juan90264, Alter-paule, Raymond_Ndibe, Beast1978, CBogen, 
ItamarWMDE, Un1tY, Nintendofan885, Akuckartz, Phamhi, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, skpuneethumar, Gaboe420, sietec, 
Zylc, Giuliamocci, Cpaulf30, 1978Gage2001, Lahi, Operator873, Gq86, Af420, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, 
Allthingsgo, QZanden, EBjune, Tbscho, merbst, LawExplorer, Lewizho99, JJMC89, 
Maathavan, elukey, _jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, 
mys_721tx, Cmjohnson, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, 
Tobias1984, Manybubbles, Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, 
fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[fnegri]

fnegri moved this task from Doing? (legacy column) to FY2022/2023-Q3 on the 
cloud-services-team board.
fnegri edited projects, added cloud-services-team (FY2022/2023-Q3); removed 
cloud-services-team.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

WORKBOARD
  https://phabricator.wikimedia.org/project/board/2773/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: fnegri
Cc: Andrew, bking, akosiaris, Hokwelum, Volans, ayounsi, cmooney, EBernhardson, 
Bstorm, ArielGlenn, Gehel, Aklapper, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Biggs657, karapayneWMDE, 
Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, maantietaja, nskaggs, Juan90264, 
Alter-paule, Raymond_Ndibe, Beast1978, CBogen, ItamarWMDE, Un1tY, 
Nintendofan885, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, Giuliamocci, Cpaulf30, 
1978Gage2001, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, 
Tbscho, merbst, LawExplorer, Lewizho99, JJMC89, Maathavan, elukey, _jensen, 
rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, mys_721tx, Cmjohnson, 
jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, 
Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[fnegri]

fnegri edited projects, added cloud-services-team; removed cloud-services-team 
(Kanban).
fnegri moved this task from Kanban to Doing? (legacy column) on the 
cloud-services-team board.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

WORKBOARD
  https://phabricator.wikimedia.org/project/board/2773/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: fnegri
Cc: Andrew, bking, akosiaris, Hokwelum, Volans, ayounsi, cmooney, EBernhardson, 
Bstorm, ArielGlenn, Gehel, Aklapper, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Biggs657, karapayneWMDE, 
Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, maantietaja, nskaggs, Juan90264, 
Alter-paule, Raymond_Ndibe, Beast1978, CBogen, ItamarWMDE, Un1tY, 
Nintendofan885, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, Giuliamocci, Cpaulf30, 
1978Gage2001, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, 
Tbscho, merbst, LawExplorer, Lewizho99, JJMC89, Maathavan, elukey, _jensen, 
rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, mys_721tx, Cmjohnson, 
jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, 
Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, fgiunchedi, Ramtin2021, 
GeminiAgaloos, Phamhi, Allthingsgo
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[Hokwelum]

Hokwelum added a subscriber: Andrew.
Hokwelum added a comment.


  In T222349#8485437 , 
@bking wrote:
  
  > Per above patches and discussion with @akosiaris , we are going to try 
using the rsync protocol instead of NFS. Do the clouddumps servers also 
rate-limit rsync?
  
  Currently, rsync doesn’t allow setting bandwidth limit in the config and we 
can only do that in the command line with a bwlimit option. We use that for any 
rsyncs to/from the clouddumps hosts to the best of our knowledge. As for the 
mirrors that pull from us, we do not limit the rate at which they pull and we 
always advise they pull every day to avoid spending time pulling really large 
amounts of data for long periods of time.
  
  What are your thoughts on this @Andrew or someone else from the WMCS team?

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Hokwelum
Cc: Andrew, bking, akosiaris, Hokwelum, Volans, ayounsi, cmooney, EBernhardson, 
Bstorm, ArielGlenn, Gehel, Aklapper, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, AWesterinen, 786, Biggs657, karapayneWMDE, 
Ramtin2021, Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, GeminiAgaloos, 
maantietaja, nskaggs, Juan90264, Alter-paule, Raymond_Ndibe, Beast1978, CBogen, 
ItamarWMDE, Un1tY, Nintendofan885, Akuckartz, Phamhi, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, Namenlos314, skpuneethumar, Gaboe420, sietec, 
Zylc, Giuliamocci, Cpaulf30, 1978Gage2001, Lahi, Operator873, Gq86, Af420, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, 
Allthingsgo, QZanden, EBjune, Tbscho, merbst, LawExplorer, Lewizho99, JJMC89, 
Maathavan, elukey, _jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, 
mys_721tx, Cmjohnson, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, 
Tobias1984, Manybubbles, Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, 
fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[gerritbot]

gerritbot added a comment.


  Change 870714 had a related patch set uploaded (by Bking; author: Bking):
  
  [operations/puppet@production] query_service: Allow query hosts to rsync data 
from clouddumps
  
  https://gerrit.wikimedia.org/r/870714

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: bking, akosiaris, Hokwelum, Volans, ayounsi, cmooney, EBernhardson, Bstorm, 
ArielGlenn, Gehel, Aklapper, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, AWesterinen, 786, Biggs657, karapayneWMDE, Ramtin2021, 
Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, GeminiAgaloos, maantietaja, 
nskaggs, Juan90264, Alter-paule, Raymond_Ndibe, Beast1978, CBogen, ItamarWMDE, 
Un1tY, Nintendofan885, Akuckartz, Phamhi, Hook696, Kent7301, joker88john, 
CucyNoiD, Nandana, Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, 
Giuliamocci, Cpaulf30, 1978Gage2001, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, 
QZanden, EBjune, Tbscho, merbst, LawExplorer, Lewizho99, JJMC89, Maathavan, 
elukey, _jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, mys_721tx, 
Cmjohnson, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, 
Manybubbles, Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[bking]

bking added subscribers: akosiaris, bking.
bking added a comment.


  Per above patches and discussion with @akosiaris , we are going to try using 
the rsync protocol instead of NFS. Do the clouddumps servers also rate-limit 
rsync?

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bking
Cc: bking, akosiaris, Hokwelum, Volans, ayounsi, cmooney, EBernhardson, Bstorm, 
ArielGlenn, Gehel, Aklapper, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, AWesterinen, 786, Biggs657, karapayneWMDE, Ramtin2021, 
Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, GeminiAgaloos, maantietaja, 
nskaggs, Juan90264, Alter-paule, Raymond_Ndibe, Beast1978, CBogen, ItamarWMDE, 
Un1tY, Nintendofan885, Akuckartz, Phamhi, Hook696, Kent7301, joker88john, 
CucyNoiD, Nandana, Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, 
Giuliamocci, Cpaulf30, 1978Gage2001, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, 
QZanden, EBjune, Tbscho, merbst, LawExplorer, Lewizho99, JJMC89, Maathavan, 
elukey, _jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, mys_721tx, 
Cmjohnson, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, 
Manybubbles, Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[Gehel]

Gehel edited projects, added Discovery-Search (Current work); removed 
Discovery-Search.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Hokwelum, Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, 
Gehel, Aklapper, Adamm71, Jersione, Hellket777, LisafBia6531, Astuthiodit_1, 
AWesterinen, 786, Biggs657, karapayneWMDE, Ramtin2021, Invadibot, MPhamWMF, 
dcaro, Devnull, Slst2020, GeminiAgaloos, maantietaja, nskaggs, Juan90264, 
Alter-paule, Raymond_Ndibe, Beast1978, CBogen, ItamarWMDE, Un1tY, 
Nintendofan885, Akuckartz, Phamhi, Hook696, Kent7301, joker88john, CucyNoiD, 
Nandana, Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, Giuliamocci, 
Cpaulf30, 1978Gage2001, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, 
QZanden, EBjune, Tbscho, merbst, LawExplorer, Lewizho99, JJMC89, Maathavan, 
elukey, _jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, mys_721tx, 
Cmjohnson, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, 
Manybubbles, Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, akosiaris, 
fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[gerritbot]

gerritbot added a comment.


  Change 867646 **merged** by Bking:
  
  [operations/puppet@production] Mount labstore to wcqs/wdqs instance for dumps 
reload
  
  https://gerrit.wikimedia.org/r/867646

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Hokwelum, Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, 
Gehel, Aklapper, Adamm71, Jersione, Hellket777, LisafBia6531, Astuthiodit_1, 
AWesterinen, 786, Biggs657, karapayneWMDE, Ramtin2021, Invadibot, MPhamWMF, 
dcaro, Devnull, Slst2020, GeminiAgaloos, maantietaja, nskaggs, Juan90264, 
Alter-paule, Raymond_Ndibe, Beast1978, CBogen, ItamarWMDE, Un1tY, 
Nintendofan885, Akuckartz, Phamhi, Hook696, Kent7301, joker88john, CucyNoiD, 
Nandana, Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, Giuliamocci, 
Cpaulf30, 1978Gage2001, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, 
QZanden, EBjune, Tbscho, merbst, LawExplorer, Lewizho99, JJMC89, Maathavan, 
elukey, _jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, mys_721tx, 
Cmjohnson, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, 
Manybubbles, Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, akosiaris, 
fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[gerritbot]

gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Hokwelum, Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, 
Gehel, Aklapper, Adamm71, Jersione, Hellket777, LisafBia6531, Astuthiodit_1, 
AWesterinen, 786, Biggs657, karapayneWMDE, Ramtin2021, Invadibot, MPhamWMF, 
dcaro, Devnull, Slst2020, GeminiAgaloos, maantietaja, nskaggs, Juan90264, 
Alter-paule, Raymond_Ndibe, Beast1978, CBogen, ItamarWMDE, Un1tY, 
Nintendofan885, Akuckartz, Phamhi, Hook696, Kent7301, joker88john, CucyNoiD, 
Nandana, Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, Giuliamocci, 
Cpaulf30, 1978Gage2001, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, 
QZanden, EBjune, Tbscho, merbst, LawExplorer, Lewizho99, JJMC89, Maathavan, 
elukey, _jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, mys_721tx, 
Cmjohnson, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, 
Manybubbles, Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, akosiaris, 
fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[gerritbot]

gerritbot added a comment.


  Change 867646 had a related patch set uploaded (by Bking; author: 
Ebernhardson):
  
  [operations/puppet@production] Mount labstore to wcqs/wdqs instance for dumps 
reload
  
  https://gerrit.wikimedia.org/r/867646

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Hokwelum, Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, 
Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Ramtin2021, 
Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, GeminiAgaloos, maantietaja, 
nskaggs, Raymond_Ndibe, CBogen, ItamarWMDE, Nintendofan885, Akuckartz, Phamhi, 
Nandana, Namenlos314, skpuneethumar, sietec, Zylc, Giuliamocci, 1978Gage2001, 
Lahi, Operator873, Gq86, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Chicocvenancio, Allthingsgo, QZanden, EBjune, Tbscho, merbst, LawExplorer, 
JJMC89, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, mys_721tx, 
Cmjohnson, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, 
Manybubbles, Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, akosiaris, 
fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[jbond]

jbond edited projects, added netops; removed SRE.
Restricted Application added a project: Infrastructure-Foundations.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jbond
Cc: Hokwelum, Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, 
Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Ramtin2021, 
Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, GeminiAgaloos, maantietaja, 
nskaggs, Raymond_Ndibe, CBogen, ItamarWMDE, Nintendofan885, Akuckartz, Phamhi, 
Nandana, Namenlos314, skpuneethumar, sietec, Zylc, Giuliamocci, 1978Gage2001, 
Lahi, Operator873, Gq86, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Chicocvenancio, Allthingsgo, QZanden, EBjune, Tbscho, merbst, LawExplorer, 
JJMC89, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, mys_721tx, 
Cmjohnson, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, 
Manybubbles, Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, akosiaris, 
fgiunchedi, joanna_borun, Muchiri124, RhinosF1, Legado_Shulgin, ReaperDawn, 
Davinaclare77, Techguru.pc, Hfbn0, Zppix, Wong128hk, Jay8g
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[Maintenance_bot]

Maintenance_bot removed a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: Hokwelum, Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, 
Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, joanna_borun, 
Ramtin2021, Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, GeminiAgaloos, 
maantietaja, nskaggs, Muchiri124, Raymond_Ndibe, CBogen, ItamarWMDE, 
Nintendofan885, Akuckartz, Phamhi, RhinosF1, Legado_Shulgin, ReaperDawn, 
Nandana, Namenlos314, skpuneethumar, sietec, Zylc, Giuliamocci, Davinaclare77, 
1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, Hfbn0, 
QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, mys_721tx, jkroll, 
Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, Gryllida, 
faidon, scfc, Mbch331, Jay8g, bd808, Krenair, fgiunchedi, Jersione, Hellket777, 
LisafBia6531, 786, Biggs657, Juan90264, Alter-paule, Beast1978, Un1tY, Hook696, 
Kent7301, joker88john, CucyNoiD, Gaboe420, Cpaulf30, Af420, Lewizho99, 
Maathavan, Neuronton
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[gerritbot]

gerritbot added a comment.


  Change 835596 **merged** by Ryan Kemper:
  
  [operations/puppet@production] Mount labstore to wcqs/wdqs instance for dumps 
reload
  
  https://gerrit.wikimedia.org/r/835596

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Hokwelum, Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, 
Gehel, Aklapper, Jersione, Hellket777, LisafBia6531, Astuthiodit_1, 
AWesterinen, 786, Biggs657, karapayneWMDE, joanna_borun, Ramtin2021, Invadibot, 
MPhamWMF, dcaro, Devnull, Slst2020, GeminiAgaloos, maantietaja, nskaggs, 
Juan90264, Muchiri124, Alter-paule, Raymond_Ndibe, Beast1978, CBogen, 
ItamarWMDE, Un1tY, Nintendofan885, Akuckartz, Phamhi, Hook696, Kent7301, 
RhinosF1, joker88john, Legado_Shulgin, ReaperDawn, CucyNoiD, Nandana, 
Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, Giuliamocci, Davinaclare77, 
Cpaulf30, 1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, Hfbn0, 
QZanden, EBjune, Tbscho, merbst, LawExplorer, Lewizho99, Zppix, JJMC89, 
Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, mys_721tx, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, 
Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, bd808, 
Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[gerritbot]

gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, Gehel, 
Aklapper, Jersione, fnegri, Hellket777, Raineydaz, LisafBia6531, Astuthiodit_1, 
AWesterinen, 786, Biggs657, karapayneWMDE, joanna_borun, Ramtin2021, Invadibot, 
MPhamWMF, dcaro, Devnull, Slst2020, GeminiAgaloos, maantietaja, nskaggs, 
Juan90264, Muchiri124, Alter-paule, Raymond_Ndibe, Beast1978, CBogen, 
ItamarWMDE, Un1tY, Nintendofan885, Akuckartz, Phamhi, Di3sel1975, Hook696, 
Kent7301, RhinosF1, joker88john, Legado_Shulgin, ReaperDawn, CucyNoiD, Nandana, 
Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, Giuliamocci, Davinaclare77, 
Cpaulf30, 1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, Hfbn0, 
QZanden, EBjune, Tbscho, merbst, LawExplorer, Lewizho99, Zppix, JJMC89, 
Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, mys_721tx, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, 
Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, bd808, 
Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[gerritbot]

gerritbot added a comment.


  Change 835596 had a related patch set uploaded (by Ryan Kemper; author: Ryan 
Kemper):
  
  [operations/puppet@production] Mount labstore to wcqs/wdqs instance for dumps 
reload
  
  https://gerrit.wikimedia.org/r/835596

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, Gehel, 
Aklapper, fnegri, Raineydaz, Astuthiodit_1, AWesterinen, karapayneWMDE, 
joanna_borun, Ramtin2021, Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, 
GeminiAgaloos, maantietaja, nskaggs, Muchiri124, Raymond_Ndibe, CBogen, 
ItamarWMDE, Nintendofan885, Akuckartz, Phamhi, Di3sel1975, RhinosF1, 
Legado_Shulgin, ReaperDawn, Nandana, Namenlos314, skpuneethumar, sietec, Zylc, 
Giuliamocci, Davinaclare77, 1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, 
Allthingsgo, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, 
JJMC89, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, mys_721tx, 
jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, 
Gryllida, faidon, scfc, Mbch331, Jay8g, bd808, Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[Maintenance_bot]

Maintenance_bot removed a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, Gehel, 
Aklapper, fnegri, Raineydaz, Astuthiodit_1, AWesterinen, karapayneWMDE, 
joanna_borun, Ramtin2021, Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, 
GeminiAgaloos, maantietaja, nskaggs, Muchiri124, Raymond_Ndibe, CBogen, 
ItamarWMDE, Nintendofan885, Akuckartz, Phamhi, Di3sel1975, RhinosF1, 
Legado_Shulgin, ReaperDawn, Nandana, Namenlos314, skpuneethumar, sietec, Zylc, 
Giuliamocci, Davinaclare77, 1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, 
Allthingsgo, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, 
JJMC89, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, mys_721tx, 
jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, 
Gryllida, faidon, scfc, Mbch331, Jay8g, bd808, Krenair, fgiunchedi, Jersione, 
Hellket777, LisafBia6531, 786, Biggs657, Juan90264, Alter-paule, Beast1978, 
Un1tY, Hook696, Kent7301, joker88john, CucyNoiD, Gaboe420, Cpaulf30, Af420, 
Lewizho99, Maathavan, Neuronton
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[gerritbot]

gerritbot added a comment.


  Change 832543 **merged** by Ryan Kemper:
  
  [operations/puppet@production] Mount labstore to wcqs/wdqs instance for dumps 
reload
  
  https://gerrit.wikimedia.org/r/832543

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, Gehel, 
Aklapper, Jersione, fnegri, Hellket777, Raineydaz, LisafBia6531, Astuthiodit_1, 
AWesterinen, 786, Biggs657, karapayneWMDE, joanna_borun, Ramtin2021, Invadibot, 
MPhamWMF, dcaro, Devnull, Slst2020, GeminiAgaloos, maantietaja, nskaggs, 
Juan90264, Muchiri124, Alter-paule, Raymond_Ndibe, Beast1978, CBogen, 
ItamarWMDE, Un1tY, Nintendofan885, Akuckartz, Phamhi, Di3sel1975, Hook696, 
Kent7301, RhinosF1, joker88john, Legado_Shulgin, ReaperDawn, CucyNoiD, Nandana, 
Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, Giuliamocci, Davinaclare77, 
Cpaulf30, 1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, Hfbn0, 
QZanden, EBjune, Tbscho, merbst, LawExplorer, Lewizho99, Zppix, JJMC89, 
Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, mys_721tx, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, 
Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, bd808, 
Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[gerritbot]

gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, Gehel, 
Aklapper, Jersione, fnegri, Hellket777, Raineydaz, LisafBia6531, Astuthiodit_1, 
AWesterinen, 786, Biggs657, karapayneWMDE, joanna_borun, Ramtin2021, Invadibot, 
MPhamWMF, dcaro, Devnull, Slst2020, GeminiAgaloos, maantietaja, nskaggs, 
Juan90264, Muchiri124, Alter-paule, Raymond_Ndibe, Beast1978, CBogen, 
ItamarWMDE, Un1tY, Nintendofan885, Akuckartz, Phamhi, Di3sel1975, Hook696, 
Kent7301, RhinosF1, joker88john, Legado_Shulgin, ReaperDawn, CucyNoiD, Nandana, 
Namenlos314, skpuneethumar, Gaboe420, sietec, Zylc, Giuliamocci, Davinaclare77, 
Cpaulf30, 1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, Af420, Bsandipan, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, Hfbn0, 
QZanden, EBjune, Tbscho, merbst, LawExplorer, Lewizho99, Zppix, JJMC89, 
Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, 
Wong128hk, mys_721tx, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, 
Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, bd808, 
Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[gerritbot]

gerritbot added a comment.


  Change 832543 had a related patch set uploaded (by Ebernhardson; author: 
Ebernhardson):
  
  [operations/puppet@production] Mount labstore to wcqs/wdqs instance for dumps 
reload
  
  https://gerrit.wikimedia.org/r/832543

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, Gehel, 
Aklapper, fnegri, Raineydaz, Astuthiodit_1, AWesterinen, karapayneWMDE, 
joanna_borun, Ramtin2021, Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, 
GeminiAgaloos, maantietaja, nskaggs, Muchiri124, Raymond_Ndibe, CBogen, 
ItamarWMDE, Nintendofan885, Akuckartz, Phamhi, Di3sel1975, RhinosF1, 
Legado_Shulgin, ReaperDawn, Nandana, Namenlos314, skpuneethumar, sietec, Zylc, 
Giuliamocci, Davinaclare77, 1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, 
Allthingsgo, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, 
JJMC89, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, mys_721tx, 
jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, 
Gryllida, faidon, scfc, Mbch331, Jay8g, bd808, Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[Gehel]

Gehel removed Gehel as the assignee of this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, Gehel, 
Aklapper, fnegri, Raineydaz, Astuthiodit_1, AWesterinen, karapayneWMDE, 
joanna_borun, Ramtin2021, Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, 
GeminiAgaloos, maantietaja, nskaggs, Muchiri124, Raymond_Ndibe, CBogen, 
ItamarWMDE, Nintendofan885, Akuckartz, Phamhi, Di3sel1975, RhinosF1, 
Legado_Shulgin, ReaperDawn, Nandana, Namenlos314, skpuneethumar, sietec, Zylc, 
Giuliamocci, Davinaclare77, 1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, 
Allthingsgo, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, 
JJMC89, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, mys_721tx, 
jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, 
Gryllida, faidon, scfc, Mbch331, Jay8g, bd808, Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[ArielGlenn]

ArielGlenn added a comment.


  Note that the checksum files for those dumps are available for download as 
well, since they are provided along with the main dump output files to all 
mirrors.
  
  Someone from WMCS will probably need to look at this (again) if the 
discussion is being re-opened. They should have insight into the impact on 
existing services from any change.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel, ArielGlenn
Cc: Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, Gehel, 
Aklapper, joanna_borun, Ramtin2021, Invadibot, MPhamWMF, dcaro, Devnull, 
Slst2020, GeminiAgaloos, maantietaja, nskaggs, lmata, Muchiri124, 
Raymond_Ndibe, CBogen, Nintendofan885, Akuckartz, Phamhi, RhinosF1, 
Legado_Shulgin, ReaperDawn, Nandana, Namenlos314, skpuneethumar, sietec, Zylc, 
Giuliamocci, Davinaclare77, 1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, 
Allthingsgo, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, 
JJMC89, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, mys_721tx, 
jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, 
Gryllida, faidon, scfc, Addshore, Mbch331, Jay8g, bd808, Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network

[Volans]

Volans added subscribers: cmooney, ayounsi, Volans.
Volans reopened this task as "Open".
Volans added a comment.
Restricted Application added a project: wdwb-tech.


  I'm re-opening this as a follow up from a chat in this CR 
.
  I think that we should find a solution for this as I find not ideal that we 
have to rely on an external source for our own data and raises some concerns:
  
  - the total size of the 3 files to download is over 100GB
  - with the external URL I guess you have to use the HTTP proxies, adding 
unnecessary strain there
  - the integrity of those files should be verified against a checksum coming 
from our internal and authoritative dumps, and this doesn't seem the case AFAICT
  
  Some alternatives that are worth to investigate:
  
  - Fix the internal rate-limiting issue for internal clients only, the current 
dumps host has a 10G NIC so it shouldn't be a networking problem, not sure for 
the disk side of it.
  - evaluate rsync for the transfer. For example we could have a slow rsync 
that copies only the required files to another host periodically and then have 
the cookbook pick them from this other location (either rsync or curl at that 
point) quickly.
  - evaluate transfer.py for this use case ( see 
https://wikitech.wikimedia.org/wiki/Transfer.py )
  
  Adding @ayounsi and @cmooney if they have any comment on the network side of 
it.

TASK DETAIL
  https://phabricator.wikimedia.org/T222349

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel, Volans
Cc: Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, Gehel, 
Aklapper, joanna_borun, Ramtin2021, Invadibot, MPhamWMF, dcaro, Devnull, 
Slst2020, GeminiAgaloos, maantietaja, nskaggs, lmata, Muchiri124, 
Raymond_Ndibe, CBogen, Nintendofan885, Akuckartz, Phamhi, RhinosF1, 
Legado_Shulgin, ReaperDawn, Nandana, Namenlos314, skpuneethumar, sietec, Zylc, 
Giuliamocci, Davinaclare77, 1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, 
Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, 
Allthingsgo, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, 
JJMC89, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, mys_721tx, 
jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, 
Gryllida, faidon, scfc, Addshore, Mbch331, Jay8g, bd808, Krenair, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org