[Pywikipedia-bugs] [Maniphest] [Commented On] T238291: noreferences.py error

2019-11-16 Thread Kaleem_Bhatti
Kaleem_Bhatti added a comment. I want edit scripts from "core" directory TASK DETAIL https://phabricator.wikimedia.org/T238291 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Kaleem_Bhatti Cc: Dvorapa, Xqt, Aklapper, pywikibot-bugs-list, Kaleem_Bh

[Pywikipedia-bugs] [Maniphest] [Commented On] T238291: noreferences.py error

2019-11-16 Thread Kaleem_Bhatti
Kaleem_Bhatti added a comment. @Dvorapa how I can find this core directore /mnt/nfs/labstore-secondary-tools-project/toolname/pywikibot-core I have installet it from git and here $ git clone --recursive --branch stable https://gerrit.wikimedia.org/r/pywikibot/core.git pywikibot-core

[Pywikipedia-bugs] [Maniphest] [Commented On] T238291: noreferences.py error

2019-11-16 Thread Dvorapa
Dvorapa added a comment. I'm happy to help, but please ask again, currently I don't understand TASK DETAIL https://phabricator.wikimedia.org/T238291 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Kaleem_Bhatti, Dvorapa Cc: Dvorapa, Xqt, Aklapper,

[Pywikipedia-bugs] [Maniphest] [Commented On] T238291: noreferences.py error

2019-11-16 Thread Kaleem_Bhatti
Kaleem_Bhatti added a comment. In T238291#5668955 , @Kaleem_Bhatti wrote: > In T238291#5668954 , @Dvorapa wrote: > >> Then it is where you installed it > > from here > $

[Pywikipedia-bugs] [Maniphest] [Commented On] T238471: Performance problems with pywikibot's pagegenerator

2019-11-16 Thread Xqt
Xqt added a comment. Decreasing maxlag parameter may lead to decreasing performance because some queries are probably waiting for a lower server lag TASK DETAIL https://phabricator.wikimedia.org/T238471 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/

[Pywikipedia-bugs] [Maniphest] [Updated] T238471: Performance problems with pywikibot's pagegenerator

2019-11-16 Thread Dvorapa
Dvorapa added a project: Pywikibot-Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T238471 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa Cc: Mpaa, Dvorapa, Aklapper, pywikibot-bugs-list, Tilomi, Zkhalido, darthmon_wmde, Viztor, Dann

[Pywikipedia-bugs] [Maniphest] [Updated] T210322: paraminfo_tests fails several times due to timeout at beta.wmflabs.org

2019-11-16 Thread Dvorapa
Dvorapa added a project: Pywikibot-Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T210322 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa Cc: Dvorapa, Krenair, gerritbot, Framawiki, Aklapper, pywikibot-bugs-list, Dalba, Xqt, Zkhalido

[Pywikipedia-bugs] [Maniphest] [Updated] T112243: Overwriting a redirect using wbeditentity causes an exception

2019-11-16 Thread Dvorapa
Dvorapa added a project: Pywikibot-Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T112243 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa Cc: Lydia_Pintscher, StudiesWorld, hoo, Ricordisamoa, pywikibot-bugs-list, jayvdb, Aklapper, Zk

[Pywikipedia-bugs] [Maniphest] [Updated] T221556: pywikibot's interwikidata.py won't handle projects where one externally-hosted language doesn't have access to the wikibase repo

2019-11-16 Thread Dvorapa
Dvorapa added a project: Pywikibot-Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T221556 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa Cc: Dvorapa, Ladsgroup, Xqt, Aklapper, pywikibot-bugs-list, Carlb, Zkhalido, darthmon_wmde, Viz

[Pywikipedia-bugs] [Maniphest] [Closed] T238291: noreferences.py error

2019-11-16 Thread Dvorapa
Dvorapa closed this task as "Resolved". Dvorapa assigned this task to Kaleem_Bhatti. Dvorapa added a comment. The issue seems to be fixed by https://gerrit.wikimedia.org/r/#/c/pywikibot/core/+/546388/ in the current master => so it should be fixed in the next stable release TASK DETAIL htt

[Pywikipedia-bugs] [Maniphest] [Commented On] T238471: Performance problems with pywikibot's pagegenerator

2019-11-16 Thread Dvorapa
Dvorapa added a comment. Perhaps try WikidataIntegrator instead of Pywikibot (if it offers the same functionality you need). I'm unsure what is its current state of development, so make sure you don't throw away your original code. A performance comparison of the two libraries from your case

[Pywikipedia-bugs] [Maniphest] [Commented On] T238471: Performance problems with pywikibot's pagegenerator

2019-11-16 Thread Tilomi
Tilomi added a comment. I thought about data dumps aswell. But i think it's a bit overkill to download 60 Gb to query about 100 Mb of data so i wanted to check first if there are any other possibilities regarding the SPARQL endpoint or pywikibot. TASK DETAIL https://phabricator.wikimedia.o

[Pywikipedia-bugs] [Maniphest] [Commented On] T238471: Performance problems with pywikibot's pagegenerator

2019-11-16 Thread Mpaa
Mpaa added a comment. Have you considered to get data from dumps, if possible? TASK DETAIL https://phabricator.wikimedia.org/T238471 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mpaa Cc: Mpaa, Dvorapa, Aklapper, pywikibot-bugs-list, Tilomi, Zkh

[Pywikipedia-bugs] [Maniphest] [Commented On] T238471: Performance problems with pywikibot's pagegenerator

2019-11-16 Thread Tilomi
Tilomi added a comment. I played around with them, but i saw no change in performance. I set following options to following values because i thought they would affect the performance: minthrottle = 0 // default value maxthrottle = 1 // default 60 put_throttle = 0 // 10 (i only read page

[Pywikipedia-bugs] [Maniphest] [Commented On] T238291: noreferences.py error

2019-11-16 Thread Kaleem_Bhatti
Kaleem_Bhatti added a comment. In T238291#5668954 , @Dvorapa wrote: > Then it is where you installed it from here $ git clone --recursive --branch stable https://gerrit.wikimedia.org/r/pywikibot/core.git pywikibot-core $ cd py

[Pywikipedia-bugs] [Maniphest] [Commented On] T238291: noreferences.py error

2019-11-16 Thread Dvorapa
Dvorapa added a comment. Then it is where you installed it TASK DETAIL https://phabricator.wikimedia.org/T238291 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa Cc: Dvorapa, Xqt, Aklapper, pywikibot-bugs-list, Kaleem_Bhatti, Zkhalido, Viz

[Pywikipedia-bugs] [Maniphest] [Commented On] T238291: noreferences.py error

2019-11-16 Thread Kaleem_Bhatti
Kaleem_Bhatti added a comment. In T238291#5668894 , @Dvorapa wrote: > It depends how you installed them. I have intalled from git TASK DETAIL https://phabricator.wikimedia.org/T238291 EMAIL PREFERENCES https://phabricator.wikim

[Pywikipedia-bugs] [Maniphest] [Commented On] T238471: Performance problems with pywikibot's pagegenerator

2019-11-16 Thread Dvorapa
Dvorapa added a comment. Have you tried to play around with "SETTINGS TO AVOID SERVER OVERLOAD" options in Pywikibot's user-config.py? TASK DETAIL https://phabricator.wikimedia.org/T238471 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa C

[Pywikipedia-bugs] [Maniphest] [Commented On] T238291: noreferences.py error

2019-11-16 Thread Dvorapa
Dvorapa added a comment. It depends how you installed them. TASK DETAIL https://phabricator.wikimedia.org/T238291 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dvorapa Cc: Dvorapa, Xqt, Aklapper, pywikibot-bugs-list, Kaleem_Bhatti, Zkhalido, Vi

[Pywikipedia-bugs] [Maniphest] [Commented On] T238291: noreferences.py error

2019-11-16 Thread Kaleem_Bhatti
Kaleem_Bhatti added a comment. @Dvorapa how I can open or edit core folder and scripts TASK DETAIL https://phabricator.wikimedia.org/T238291 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Kaleem_Bhatti Cc: Dvorapa, Xqt, Aklapper, pywikibot-bugs-l

[Pywikipedia-bugs] [Maniphest] [Commented On] T238291: noreferences.py error

2019-11-16 Thread Kaleem_Bhatti
Kaleem_Bhatti added a comment. In T238291#5668763 , @Dvorapa wrote: > It's a "core" folder in your home directory I believe. The error says your Wikipedia (wikiproject) is missing in the script's configuration. We want to add it there.

[Pywikipedia-bugs] [Maniphest] [Created] T238471: Performance problems with pywikibot's pagegenerator

2019-11-16 Thread Tilomi
Tilomi created this task. Tilomi added projects: Pywikibot, Wikidata. Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. TASK DESCRIPTION Hi, i'm currently working on an open source university project (https://openartbrowser.org/ , https://github.com/hochschule-darmstadt/

[Pywikipedia-bugs] [Maniphest] [Commented On] T238291: noreferences.py error

2019-11-16 Thread Dvorapa
Dvorapa added a comment. It's a "core" folder in your home directory I believe. The error says your Wikipedia (wikiproject) is missing in the script's configuration. We want to add it there. TASK DETAIL https://phabricator.wikimedia.org/T238291 EMAIL PREFERENCES https://phabricator.wiki

[Pywikipedia-bugs] [Maniphest] [Commented On] T238448: Get family info from wikidata

2019-11-16 Thread Mpaa
Mpaa added a comment. In T238448#5668653 , @Bugreporter wrote: > not all (special) projects are Wikidata clients. Then we can do it for those who are and leave the others hard-coded. TASK DETAIL https://phabricator.wikimedia.org/T

[Pywikipedia-bugs] [Maniphest] [Commented On] T235500: Pywikibot cannot create new property

2019-11-16 Thread Mpaa
Mpaa added a comment. In T235500#5663181 , @DD063520 wrote: > @Xqt : hi, would you consider again this patch, currently I make this modification locally to have some code running You can submit patches directly: https://www.mediaw

[Pywikipedia-bugs] [Maniphest] [Closed] T238404: Pywikibot fails when importing entity Q1410828

2019-11-16 Thread Mpaa
Mpaa closed this task as "Invalid". TASK DETAIL https://phabricator.wikimedia.org/T238404 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mpaa Cc: Dvorapa, Mpaa, Xqt, Aklapper, DD063520, pywikibot-bugs-list, Zkhalido, darthmon_wmde, Viztor, DannyS712