[Pywikipedia-bugs] [Maniphest] [Commented On] T238471: Performance problems with pywikibot's pagegenerator

2019-11-17 Thread Tilomi
Tilomi added a comment. Ok interesting, so i guess i have to wait until this issue is resolved or is there another functionality which i can use that won't load and initialize sitelinks? For a new feature we use the wikipedia sitelink but the performance problem occured already befo

[Pywikipedia-bugs] [Maniphest] [Commented On] T238471: Performance problems with pywikibot's pagegenerator

2019-11-17 Thread Tilomi
Tilomi added a comment. Thanks for the answers. I also tried the default value and higher values like 10, 20 or 60 for maxlag. But there were unfortunately no improvments with maxlag changed. I'll take a look at WikidataIntegrator and compare it with pywikibot. TASK DETAIL

[Pywikipedia-bugs] [Maniphest] [Commented On] T238471: Performance problems with pywikibot's pagegenerator

2019-11-16 Thread Tilomi
Tilomi added a comment. I thought about data dumps aswell. But i think it's a bit overkill to download 60 Gb to query about 100 Mb of data so i wanted to check first if there are any other possibilities regarding the SPARQL endpoint or pywikibot. TASK DETAIL

[Pywikipedia-bugs] [Maniphest] [Commented On] T238471: Performance problems with pywikibot's pagegenerator

2019-11-16 Thread Tilomi
Tilomi added a comment. I played around with them, but i saw no change in performance. I set following options to following values because i thought they would affect the performance: minthrottle = 0 // default value maxthrottle = 1 // default 60 put_throttle = 0 // 10 (i only read

[Pywikipedia-bugs] [Maniphest] [Created] T238471: Performance problems with pywikibot's pagegenerator

2019-11-16 Thread Tilomi
Tilomi created this task. Tilomi added projects: Pywikibot, Wikidata. Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. TASK DESCRIPTION Hi, i'm currently working on an open source university project (https://openartbrowser.org/ , https://github.com/hochschule-darm