[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-15 Thread toan 
toan added a comment.


  And a screenshot from k8s
  
  F34644227: image.png 

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: toan
Cc: toan, Lucas_Werkmeister_WMDE, Addshore, Aklapper, Samantha_Alipio_WMDE, 
Invadibot, maantietaja, Akuckartz, Iflorez, alaa_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-15 Thread toan 
toan added a comment.


  Pasting a screenshot from the heap too
  
  F34644214: image.png 

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: toan
Cc: toan, Lucas_Werkmeister_WMDE, Addshore, Aklapper, Samantha_Alipio_WMDE, 
Invadibot, maantietaja, Akuckartz, Iflorez, alaa_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-15 Thread Addshore 
Addshore closed this task as "Resolved".
Addshore reassigned this task from Addshore to toan.
Addshore added a comment.


  As part of this task we essentially rewrote the java wrapper around the query 
updater.
  https://github.com/wbstack/queryservice-updater/compare/0.3.6_2.2...0.3.84_3.6
  
  And poked the deployment lots
  
https://github.com/wbstack/deploy/compare/7cc8637c9f6f833af9b288f8769b12a027706eb7...cb798880766e72a3e6247b45556cf6a85e2389be
  
  During that time we managed to remove 1 thread leak that was causing most of 
the issues
  
  F34644013: image.png 
  
  So the meta namespace no longer grows at such a crazy uncontrollable rate
  
  F34644016: image.png 
  
  We think there are probably still some memory leaks somewhere as we still see 
steady growth of meta namespace usage, though heap remains withing the 30MB 
allocation normally.
  So we might end up looking at this again in the future.

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: toan, Addshore
Cc: toan, Lucas_Werkmeister_WMDE, Addshore, Aklapper, Samantha_Alipio_WMDE, 
Invadibot, maantietaja, Akuckartz, Iflorez, alaa_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-14 Thread Addshore 
Addshore claimed this task.
Addshore added a subscriber: toan.
Restricted Application added a project: User-Addshore.

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: toan, Lucas_Werkmeister_WMDE, Addshore, Aklapper, Samantha_Alipio_WMDE, 
Invadibot, maantietaja, Akuckartz, Iflorez, alaa_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-13 Thread Lucas_Werkmeister_WMDE 
Lucas_Werkmeister_WMDE moved this task from Peer Review to Test (Verification) 
on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞) board.
Lucas_Werkmeister_WMDE added a comment.


  In T284319#7344126 , @toan 
wrote:
  
  > A final cleanup https://github.com/wbstack/queryservice-updater/pull/44
  
  Already merged, so this is probably done?

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

WORKBOARD
  https://phabricator.wikimedia.org/project/board/3539/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: toan, Lucas_Werkmeister_WMDE
Cc: Lucas_Werkmeister_WMDE, Addshore, Aklapper, Samantha_Alipio_WMDE, 
Invadibot, maantietaja, Akuckartz, Iflorez, alaa_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-10 Thread toan 
toan added a comment.


  https://github.com/wbstack/queryservice-updater/pull/44

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: toan
Cc: Addshore, Aklapper, Samantha_Alipio_WMDE, Invadibot, maantietaja, 
Akuckartz, Iflorez, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-07 Thread Addshore 
Addshore added a comment.


  https://github.com/wbstack/queryservice-updater/pull/41

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: toan, Addshore
Cc: Addshore, Aklapper, Samantha_Alipio_WMDE, Invadibot, maantietaja, 
Akuckartz, Iflorez, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-07 Thread Addshore 
Addshore added a comment.


  Adding a paper trail here around why in the PR we decided it was probably 
fine to bump the wdqs version quite so much.
  

  
  1:17 PM  I have a question back at you! If I were to start using 
the 0.3.84 wdqs updater code, from 0.3.6 any ideas what ight change in rdf 
output?
  1:17 PM  or where to look to see what might change?
  1:17 PM <+gehel> that's a question for dcausse 
  1:18 PM <+dcausse> addshore: nothing
  1:18 PM <+dcausse> regarding the RDF itself I mean
  1:18 PM  okay, so the only changes in wdqs version numbers really 
are the wey the internal indexing happens?
  1:19 PM <+dcausse> yes and bugfixes
  1:19 PM <+dcausse> I mean at the query side of things
  1:19 PM  epic
  1:20 PM <+dcausse> since it's a multi-module project the updater might get a 
version bump even-though nothing actually changed there
  1:20 PM  yup,, nicee
  1:20 PM <+dcausse> 0.3.6 is quite old tho :)
  1:20 PM  so for this wbstack / wbaas thing we are gonig to base a 
"new" updater on 0.3.84 or something but keep 0.3.6 for the actually suery 
service for now
  1:21 PM <+dcausse> ok
  1:21 PM <+dcausse> lemme know if you run into troubles
  1:22 PM <+dcausse> but generally speaking we never change the RDF output, 
it's part of the stable interface policy
  1:24 PM  ack!

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: toan, Addshore
Cc: Addshore, Aklapper, Samantha_Alipio_WMDE, Invadibot, maantietaja, 
Akuckartz, Iflorez, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-03 Thread toan 
toan claimed this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: toan
Cc: Aklapper, Samantha_Alipio_WMDE, Invadibot, maantietaja, Akuckartz, Iflorez, 
alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, 
Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-01 Thread Addshore 
Addshore triaged this task as "Medium" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Aklapper, Samantha_Alipio_WMDE, Invadibot, maantietaja, Akuckartz, Iflorez, 
alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, 
Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-01 Thread Addshore 
Addshore moved this task from Prioritized Product (prioritised from top to 
bottom) to Wikidata-Campsite-Iteration-∞ on the Wikidata-Campsite board.
Addshore edited projects, added Wikidata-Campsite 
(Wikidata-Campsite-Iteration-∞); removed Wikidata-Campsite.

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

WORKBOARD
  https://phabricator.wikimedia.org/project/board/3402/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Aklapper, Samantha_Alipio_WMDE, Invadibot, maantietaja, Akuckartz, Iflorez, 
alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, 
Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-01 Thread Addshore 
Addshore updated the task description.
Addshore set the point value for this task to "13".

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Aklapper, Samantha_Alipio_WMDE, Invadibot, maantietaja, Akuckartz, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-01 Thread Addshore 
Addshore updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Aklapper, Samantha_Alipio_WMDE, Invadibot, maantietaja, Akuckartz, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-01 Thread Addshore 
Addshore updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Aklapper, Samantha_Alipio_WMDE, Invadibot, maantietaja, Akuckartz, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-01 Thread Addshore 
Addshore updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Aklapper, Samantha_Alipio_WMDE, Invadibot, maantietaja, Akuckartz, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-01 Thread Samantha_Alipio_WMDE 
Samantha_Alipio_WMDE updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Samantha_Alipio_WMDE
Cc: Aklapper, Samantha_Alipio_WMDE, Invadibot, maantietaja, Akuckartz, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-08-31 Thread Maintenance_bot 
Maintenance_bot added a project: Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T284319

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: Aklapper, Samantha_Alipio_WMDE, Invadibot, maantietaja, Akuckartz, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org