[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread zhuyifei1999
zhuyifei1999 added a comment.
@David_Hedlund Everything resolved for you? Can we close this?TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Xqt, zhuyifei1999Cc: gerritbot, zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Edited] T61649: transferbot does not support namespaces in right way

2018-07-05 Thread Dalba
Dalba updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...The appended summary text is:

```
This page was moved from [[wikipedia:de:Benutzer:Xqt/Test]]. It's edit history can be viewed at [[Benutzer:Xqt/Test/edithistory]]
story can be viewed at [[Benutzer:Xqt/Test/edithistory]]```

There are wrong namespaces aliases on target site. This could be solved easily, but I don't know how to proceed with prefix because that might be a namespace. What is the right way:...TASK DETAILhttps://phabricator.wikimedia.org/T61649EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Dvorapa, DalbaCc: Framawiki, gerritbot, Xqt, jayvdb, valhallasw, Ricordisamoa, pywikibot-bugs-list, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Asad_Ali_Palijo, Cpaulf30, Lahi, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Soteriaspace, RazeSoldier, Jayprakash12345, Th3d3v1ls, JakeTheDeveloper, Ramalepe, Liugev6, Magul, Tbscho, MayS, Zoranzoki21, Lewizho99, Mdupont, JJMC89, Maathavan, TerraCodes, Avicennasis, MuhammadShuaib, SimmeD, mys_721tx, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Updated] T198934: TestLogentryParams.test_BlockEntry fails on hidden titles

2018-07-05 Thread JJMC89
JJMC89 closed this task as a duplicate of T78152: log entry has no title.
TASK DETAILhttps://phabricator.wikimedia.org/T198934EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JJMC89Cc: Aklapper, pywikibot-bugs-list, Dalba, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Merged] T78152: log entry has no title

2018-07-05 Thread JJMC89
JJMC89 merged a task: T198934: TestLogentryParams.test_BlockEntry fails on hidden titles.
TASK DETAILhttps://phabricator.wikimedia.org/T78152EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Xqt, JJMC89Cc: Dalba, Masti, Magul, Shanmugamp7, gerritbot, Xqt, jayvdb, Aklapper, pywikibot-bugs-list, XZise, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Created] T198934: TestLogentryParams.test_BlockEntry fails on hidden titles

2018-07-05 Thread Dalba
Dalba created this task.Dalba triaged this task as "High" priority.Dalba added projects: Pywikibot-core, Pywikibot-tests.Herald added subscribers: pywikibot-bugs-list, Aklapper.
TASK DESCRIPTIONhttps://travis-ci.org/wikimedia/pywikibot/jobs/400546127#L

ERROR: test_BlockEntry_dewp (tests.logentry_tests.TestLogentryParams)
Test BlockEntry methods on wikipedia:de
--
Traceback (most recent call last):
  File "/home/travis/build/wikimedia/pywikibot/tests/aspects.py", line 783, in wrapped_method
func(self, key)
  File "/home/travis/build/wikimedia/pywikibot/tests/logentry_tests.py", line 171, in test_BlockEntry
for logentry in self.site.logevents(logtype='block', total=5):
  File "/home/travis/build/wikimedia/pywikibot/pywikibot/data/api.py", line 2879, in __iter__
for result in self._extract_results(resultdata):
  File "/home/travis/build/wikimedia/pywikibot/pywikibot/data/api.py", line 2828, in _extract_results
result = self.result(item)
  File "/home/travis/build/wikimedia/pywikibot/pywikibot/data/api.py", line 3125, in result
return self.entryFactory.create(pagedata)
  File "/home/travis/build/wikimedia/pywikibot/pywikibot/logentries.py", line 471, in create
return self._creator(logdata)
  File "/home/travis/build/wikimedia/pywikibot/pywikibot/logentries.py", line 454, in 
self._creator = lambda data: logclass(data, self._site)
  File "/home/travis/build/wikimedia/pywikibot/pywikibot/logentries.py", line 194, in __init__
pos = self.data['title'].find('#')
  File "/home/travis/build/wikimedia/pywikibot/pywikibot/logentries.py", line 43, in __missing__
'permission to view it.'.format(self._type, key))
HiddenKeyError: Log entry (block) has a hidden 'title' key and you don't have permission to view it.TASK DETAILhttps://phabricator.wikimedia.org/T198934EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DalbaCc: Aklapper, pywikibot-bugs-list, Dalba, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Updated] T198933: WikibaseKnownTypesTests.test_datatypes is failing on beta cluster tests

2018-07-05 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T198933EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, pywikibot-bugs-list, Dalba, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198933: WikibaseKnownTypesTests.test_datatypes is failing on beta cluster tests

2018-07-05 Thread gerritbot
gerritbot added a comment.
Change 444148 had a related patch set uploaded (by Dalba; owner: dalba):
[pywikibot/core@master] WikibaseKnownTypesTests: Add 'wikibase-sense' to unsupported types

https://gerrit.wikimedia.org/r/444148TASK DETAILhttps://phabricator.wikimedia.org/T198933EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, pywikibot-bugs-list, Dalba, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Updated] T198933: WikibaseKnownTypesTests.test_datatypes is failing on beta cluster tests

2018-07-05 Thread Dalba
Dalba added a project: Pywikibot-Wikidata.
TASK DETAILhttps://phabricator.wikimedia.org/T198933EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DalbaCc: gerritbot, Aklapper, pywikibot-bugs-list, Dalba, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Ricordisamoa, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Created] T198933: WikibaseKnownTypesTests.test_datatypes is failing on beta cluster tests

2018-07-05 Thread Dalba
Dalba created this task.Dalba added projects: Pywikibot-core, Pywikibot-tests.Herald added subscribers: pywikibot-bugs-list, Aklapper.
TASK DESCRIPTIONhttps://travis-ci.org/wikimedia/pywikibot/jobs/400546130#L1379

self = 
def test_datatypes(self):
"""Test that all encountered datatypes are known."""
unsupported = {'wikibase-form', 'wikibase-lexeme'}  # T194890
known = set(Property.types) | unsupported
self._check_param_superset(
>   self.repo, 'wbformatvalue', 'datatype', known)
tests/paraminfo_tests.py:235: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/paraminfo_tests.py:53: in _check_param_superset
self.assertGreaterEqual(set(expected), set(values))
E   AssertionError: {'wikibase-lexeme', 'wikibase-property', 'time', 'wikibase-form', 'quantity', 'globe-coordinate', 'math', 'tabular-data', 'monolingualtext', 'wikibase-item', 'string', 'url', 'external-id', 'geo-shape', 'commonsMedia'} not greater than or equal to {'wikibase-sense', 'wikibase-lexeme', 'wikibase-property', 'time', 'wikibase-form', 'globe-coordinate', 'quantity', 'math', 'monolingualtext', 'tabular-data', 'wikibase-item', 'string', 'url', 'external-id', 'geo-shape', 'commonsMedia'}

(There is a new data type: wikibase-sense)TASK DETAILhttps://phabricator.wikimedia.org/T198933EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DalbaCc: Aklapper, pywikibot-bugs-list, Dalba, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Triaged] T198933: WikibaseKnownTypesTests.test_datatypes is failing on beta cluster tests

2018-07-05 Thread Dalba
Dalba triaged this task as "High" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T198933EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DalbaCc: Aklapper, pywikibot-bugs-list, Dalba, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread Xqt
Xqt added a comment.

In T198817#4401454, @Dvorapa wrote:
Probably also https://www.mediawiki.org/wiki/Manual:Pywikibot/pagefromfile.py needs to be updated with the new parameters


Seems that such tags breaks transclusionsTASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: XqtCc: gerritbot, zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread Dvorapa
Dvorapa added a comment.
Probably also https://www.mediawiki.org/wiki/Manual:Pywikibot/pagefromfile.py needs to be updated with the new parametersTASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Xqt, DvorapaCc: gerritbot, zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread David_Hedlund
David_Hedlund added a comment.

In T198817#4401430, @Xqt wrote:

In T198817#4400838, @David_Hedlund wrote:
Exactly, pagefromfile.py can't overwrite pages. It says:

Page Test already exists, not adding!


You may use one of these options:

-appendtopAdd the text to the top of the existing page
-appendbottom Add the text to the bottom of the existing page
-forceOverwrite the existing page


Thank you very much, everything works as it should now!TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Xqt, David_HedlundCc: gerritbot, zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread Xqt
Xqt added a comment.

In T198817#4400838, @David_Hedlund wrote:
Exactly, pagefromfile.py can't overwrite pages. It says:

Page Test already exists, not adding!


You may use one of these options:

-appendtopAdd the text to the top of the existing page
-appendbottom Add the text to the bottom of the existing page
-forceOverwrite the existing pageTASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: XqtCc: gerritbot, zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T194950: Include Wikibase dispatch lag in API "maxlag" enforcing

2018-07-05 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2018-07-05T18:21:19Z]  Synchronized wmf-config/Wikibase-production.php: SWAT: [[gerrit:443939|Set dispatchLagToMaxLagFactor to 60 for wikidata]] T194950 (duration: 00m 51s)TASK DETAILhttps://phabricator.wikimedia.org/T194950EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, StashbotCc: Stashbot, Aklapper, gerritbot, pywikibot-bugs-list, ValterVB, Lea_Lacroix_WMDE, Legoktm, Addshore, MisterSynergy, Magnus, Anomie, Sjoerddebruin, Lydia_Pintscher, Multichill, hoo, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, aude, Ricordisamoa, Mbch331___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T194950: Include Wikibase dispatch lag in API "maxlag" enforcing

2018-07-05 Thread gerritbot
gerritbot added a comment.
Change 443939 merged by jenkins-bot:
[operations/mediawiki-config@master] Set dispatchLagToMaxLagFactor to 60 for wikidata

https://gerrit.wikimedia.org/r/443939TASK DETAILhttps://phabricator.wikimedia.org/T194950EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: Aklapper, gerritbot, pywikibot-bugs-list, ValterVB, Lea_Lacroix_WMDE, Legoktm, Addshore, MisterSynergy, Magnus, Anomie, Sjoerddebruin, Lydia_Pintscher, Multichill, hoo, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, aude, Ricordisamoa, Mbch331___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread David_Hedlund
David_Hedlund added a comment.

In T198817#4400810, @zhuyifei1999 wrote:
Creating pages is done, overwriting exiting pages... add_text can't replace.


Exactly, pagefromfile.py can't overwrite pages. It says:

Page Test already exists, not adding!TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Xqt, David_HedlundCc: gerritbot, zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread David_Hedlund
David_Hedlund added a comment.

In T198817#4400175, @gerritbot wrote:
Change 444011 had a related patch set uploaded (by Xqt; owner: Xqt):
 [pywikibot/core@master] [IMPR] New options for pagefromfile.py

https://gerrit.wikimedia.org/r/444011


@Xqt Thank you for the patch.TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Xqt, David_HedlundCc: gerritbot, zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread gerritbot
gerritbot added a comment.
Change 444011 merged by jenkins-bot:
[pywikibot/core@master] [IMPR] New options for pagefromfile.py

https://gerrit.wikimedia.org/r/444011TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Xqt, gerritbotCc: gerritbot, zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread zhuyifei1999
zhuyifei1999 added a comment.
Creating pages is done, overwriting exiting pages... add_text can't replace.TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Xqt, zhuyifei1999Cc: gerritbot, zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198889: Allow different projects of the same language to have different configs in clean_sandbox.py

2018-07-05 Thread zhuyifei1999
zhuyifei1999 added a comment.
I was suggesting to switch content by dbname, but this can potentially break third-party wikis.TASK DETAILhttps://phabricator.wikimedia.org/T198889EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999Cc: MarcoAurelio, Aklapper, pywikibot-bugs-list, zhuyifei1999___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Created] T198889: Allow different projects of the same language to have different configs in clean_sandbox.py

2018-07-05 Thread MarcoAurelio
MarcoAurelio created this task.MarcoAurelio added a project: Pywikibot-Other-scripts.Herald added subscribers: pywikibot-bugs-list, Aklapper.
TASK DESCRIPTIONAs discussed with @zhuyifei1999 on IRC, this https://github.com/wikimedia/pywikibot/blob/master/scripts/clean_sandbox.py script would benefit if sister projects that happen to use different sandbox settings could use it. Thanks.TASK DETAILhttps://phabricator.wikimedia.org/T198889EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarcoAurelioCc: MarcoAurelio, Aklapper, pywikibot-bugs-list, zhuyifei1999___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Merged] T188231: listpages logging fails with UnicodeEncodeError

2018-07-05 Thread Dalba
Dalba added a subscriber: Framawiki.Dalba merged a task: T196875: category.py logging fails with UnicodeEncodeError for Python 3.
TASK DETAILhttps://phabricator.wikimedia.org/T188231EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Xqt, DalbaCc: Framawiki, gerritbot, Mpaa, Zoranzoki21, Dalba, Aklapper, pywikibot-bugs-list, valhallasw, Xqt, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Updated] T196875: category.py logging fails with UnicodeEncodeError for Python 3

2018-07-05 Thread Dalba
Dalba closed this task as a duplicate of T188231: listpages logging fails with UnicodeEncodeError.
TASK DETAILhttps://phabricator.wikimedia.org/T196875EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DalbaCc: Aklapper, Framawiki, Dalba, valhallasw, Xqt, pywikibot-bugs-list, Chicocvenancio, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T196875: category.py logging fails with UnicodeEncodeError for Python 3

2018-07-05 Thread Dalba
Dalba added a comment.
I believe the solution to T188231 should also have resolved this one.TASK DETAILhttps://phabricator.wikimedia.org/T196875EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DalbaCc: Aklapper, Framawiki, Dalba, valhallasw, Xqt, pywikibot-bugs-list, Chicocvenancio, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T188231: listpages logging fails with UnicodeEncodeError

2018-07-05 Thread gerritbot
gerritbot added a comment.
Change 444014 merged by jenkins-bot:
[pywikibot/core@master] bot.py: Open RotatingFileHandler with utf-8 encoding

https://gerrit.wikimedia.org/r/444014TASK DETAILhttps://phabricator.wikimedia.org/T188231EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Xqt, gerritbotCc: gerritbot, Mpaa, Zoranzoki21, Dalba, Aklapper, pywikibot-bugs-list, valhallasw, Xqt, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Closed] T188231: listpages logging fails with UnicodeEncodeError

2018-07-05 Thread Xqt
Xqt closed this task as "Resolved".Xqt claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T188231EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: XqtCc: gerritbot, Mpaa, Zoranzoki21, Dalba, Aklapper, pywikibot-bugs-list, valhallasw, Xqt, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Updated] T188231: listpages logging fails with UnicodeEncodeError

2018-07-05 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T188231EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Mpaa, Zoranzoki21, Dalba, Aklapper, pywikibot-bugs-list, valhallasw, Xqt, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T188231: listpages logging fails with UnicodeEncodeError

2018-07-05 Thread gerritbot
gerritbot added a comment.
Change 444014 had a related patch set uploaded (by Dalba; owner: dalba):
[pywikibot/core@master] bot.py: Open RotatingFileHandler with utf-8 encoding

https://gerrit.wikimedia.org/r/444014TASK DETAILhttps://phabricator.wikimedia.org/T188231EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Mpaa, Zoranzoki21, Dalba, Aklapper, pywikibot-bugs-list, valhallasw, Xqt, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T188231: listpages logging fails with UnicodeEncodeError

2018-07-05 Thread Xqt
Xqt added a comment.
@valhallasw

@Xqt: could you add a breakpoint/print statement to ... to figure out which stream this is going to? Is this the console or is it trying to log to a file?

I added:

stream = self.stream
print('>>>', msg, '<<<')
stream.write(msg)

with result:

>>> 2018-07-05 18:14:49   listpages.py,  261 in   main: STDOUT
  192 Liste der Staatsoberhäupter 937 v. Chr. <<<
 193 Motoko Ishii
>>> 2018-07-05 18:14:49   listpages.py,  261 in   main: STDOUT
  193 Motoko Ishii <<<
 194 Dubičné
>>> 2018-07-05 18:14:49   listpages.py,  261 in   main: STDOUT
  194 Dubičné <<<
--- Logging error ---
Traceback (most recent call last):
  File "C:\Program Files (x86)\Python36-32\lib\logging\__init__.py", line 995, i
n emit
stream.write(msg)
  File "C:\Program Files (x86)\Python36-32\lib\encodings\cp1252.py", line 19, in
 encode
return codecs.charmap_encode(input,self.errors,encoding_table)[0]
UnicodeEncodeError: 'charmap' codec can't encode character '\u010d' in position
86: character maps to 
Call stack:
  File "C:\pwb\GIT\core\pwb.py", line 251, in 
if not main():
  File "C:\pwb\GIT\core\pwb.py", line 244, in main
run_python_file(filename, [filename] + args, argvu, file_package)
  File "C:\pwb\GIT\core\pwb.py", line 115, in run_python_file
main_mod.__dict__)
  File ".\scripts\listpages.py", line 283, in 
main()
  File ".\scripts\listpages.py", line 261, in main
pywikibot.stdout(output_list[-1])
  File "C:\pwb\GIT\core\pywikibot\logging.py", line 148, in stdout
logoutput(text, decoder, newline, STDOUT, **kwargs)
  File "C:\pwb\GIT\core\pywikibot\logging.py", line 109, in logoutput
logger.log(_level, text, extra=context, **kwargs)
Message: ' 194 Dubičné'
Arguments: ()
 195 Fräulein Lausbub
>>> 2018-07-05 18:14:49   listpages.py,  261 in   main: STDOUT
  195 Fräulein Lausbub <<<
 196 Louis Sosson
>>> 2018-07-05 18:14:49   listpages.py,  261 in   main: STDOUT
  196 Louis Sosson <<<
 197 1. Division (Belgien) 1949/50
>>> 2018-07-05 18:14:49   listpages.py,  261 in   main: STDOUT
  197 1. Division (Belgien) 1949/50 <<<
 198 Yalmakan FC
>>> 2018-07-05 18:14:49   listpages.py,  261 in   main: STDOUT
  198 Yalmakan FC <<<
 199 Goldgrund (Begriffsklärung)
>>> 2018-07-05 18:14:49   listpages.py,  261 in   main: STDOUT
  199 Goldgrund (Begriffsklärung) <<<

and for print(stream) I got
<_io.TextIOWrapper name='C:\\pwb\\GIT\\core\\logs\\listpages-bot.log' mode='a' encoding='cp1252'>TASK DETAILhttps://phabricator.wikimedia.org/T188231EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: XqtCc: Mpaa, Zoranzoki21, Dalba, Aklapper, pywikibot-bugs-list, valhallasw, Xqt, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread gerritbot
gerritbot added a comment.
Change 444011 had a related patch set uploaded (by Xqt; owner: Xqt):
[pywikibot/core@master] [IMPR] New options for pagefromfile.py

https://gerrit.wikimedia.org/r/444011TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Xqt, gerritbotCc: gerritbot, zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Updated] T198817: edit and create pages

2018-07-05 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Xqt, gerritbotCc: gerritbot, zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Triaged] T198817: edit and create pages

2018-07-05 Thread Xqt
Xqt triaged this task as "Low" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: XqtCc: zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Claimed] T198817: edit and create pages

2018-07-05 Thread Xqt
Xqt claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: XqtCc: zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread zhuyifei1999
zhuyifei1999 added a comment.

In T198817#4400033, @Xqt wrote:
I am wondering that it is able for Linux because the option parameter -text:"$(cat Test.wiki)" is just a text. No glue why/how the bot can Interpret this as a batch command


It doesn't. That's bash. Double quotes allows interpretation of some tokens, and $() makes command substitution. Therefore, in bash, -text:"$(cat Test.wiki)" means execute cat Test.wiki, get its stdout, then prepend its stdout with -text: and use the entire prepended string as a single argument to python.TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999Cc: zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread Dvorapa
Dvorapa added a comment.

In T198817#4400033, @Xqt wrote:
Probably Linux only, I do not know, hot to write Windows shell/Powershell command like this

I am wondering that it is able for Linux because the option parameter -text:"$(cat Test.wiki)" is just a text. No glue why/how the bot can Interpret this as a batch command


This just works the same as your example using pagefromfile.py or the desired behavior OP looks for. But as discussed above, these scripts definitely need adjustmentsTASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DvorapaCc: zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread Xqt
Xqt added a comment.
Probably Linux only, I do not know, hot to write Windows shell/Powershell command like this

I am wondering that it is able for Linux because the option parameter -text:"$(cat Test.wiki)" is just a text. No glue why/how the bot can Interpret this as a batch commandTASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: XqtCc: zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread Dvorapa
Dvorapa added a comment.

In T198817#4399968, @Xqt wrote:
It does not (might be it does for others than windows)


Probably Linux only, I do not know, hot to write Windows shell/Powershell command like this (I've found only https://stackoverflow.com/questions/43225925/windows-cmd-pass-output-of-one-command-as-parameter-to-another so far)TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DvorapaCc: zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread Xqt
Xqt added a comment.
This should work too if page does not exist:

$ echo "Hello world" > Test.wiki
$ python pwb.py add_text -text:"$(cat Test.wiki)" -page:"Test"


It does not (might be it does for others than windows)TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: XqtCc: zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Edited] T187009: Pywikibot documentation build throws too many warnings to console (goal)

2018-07-05 Thread Dvorapa
Dvorapa updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONCurrently there are **1850** warnings:

- more than one target found for cross-reference (157):127): we should be more specific in `@type param: Page` and similar, partially #Upstream as some of these should prefer local file method over another file's...TASK DETAILhttps://phabricator.wikimedia.org/T187009EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DvorapaCc: zhuyifei1999, Zoranzoki21, gerritbot, Aklapper, pywikibot-bugs-list, Dvorapa, Cpaulf30, Ivana_Isadora, Jayprakash12345, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, Dinoguy1000, jayvdb, Dalba, Masti, Alchimista, Rxy, Jay8g___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Updated] T187009: Pywikibot documentation build throws too many warnings to console (goal)

2018-07-05 Thread Dvorapa
Dvorapa removed a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T187009EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DvorapaCc: zhuyifei1999, Zoranzoki21, gerritbot, Aklapper, pywikibot-bugs-list, Dvorapa, Cpaulf30, Ivana_Isadora, Jayprakash12345, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, Dinoguy1000, jayvdb, Dalba, Masti, Alchimista, Rxy, Jay8g, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Lewizho99, Maathavan___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T187009: Pywikibot documentation build throws too many warnings to console (goal)

2018-07-05 Thread gerritbot
gerritbot added a comment.
Change 443918 merged by jenkins-bot:
[pywikibot/core@master] site.py: Improve type hints

https://gerrit.wikimedia.org/r/443918TASK DETAILhttps://phabricator.wikimedia.org/T187009EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: zhuyifei1999, Zoranzoki21, gerritbot, Aklapper, pywikibot-bugs-list, Dvorapa, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Ivana_Isadora, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, Dinoguy1000, jayvdb, Dalba, Masti, Alchimista, Rxy, Jay8g___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Closed] T198849: Argument processing chokes on python 2 when an argument contains non-ascii

2018-07-05 Thread zhuyifei1999
zhuyifei1999 closed this task as "Resolved".zhuyifei1999 added a comment.
@.avgas It should land on toolforge nightly at 1 UTC.TASK DETAILhttps://phabricator.wikimedia.org/T198849EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999Cc: gerritbot, Dalba, zhuyifei1999, Aklapper, Multichill, pywikibot-bugs-list, .avgas, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Jrbranaa, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, Wong128hk, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread zhuyifei1999
zhuyifei1999 added a comment.

In T198817#4399570, @Dvorapa wrote:
I suggest to improve both pagefromfile.py and add_text.py/basic.py:


pagefromfile.py to make the batch uploading as easy as possible. It should be able to read from the stream, from one file or multiple files.
add_text.py/basic.py to make the single page change as easy as possible. It should be able to edit redirects, replace the whole page, create missing page and read from piped input.
(probably rename those two scripts to something like single.py and multiple.py or something similar)



Agreed.TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999Cc: zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198849: Argument processing chokes on python 2 when an argument contains non-ascii

2018-07-05 Thread gerritbot
gerritbot added a comment.
Change 443957 merged by jenkins-bot:
[pywikibot/core@master] pagegenerators: try..except UnicodeEncodeError on getattr()

https://gerrit.wikimedia.org/r/443957TASK DETAILhttps://phabricator.wikimedia.org/T198849EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999, gerritbotCc: gerritbot, Dalba, zhuyifei1999, Aklapper, Multichill, pywikibot-bugs-list, .avgas, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Jrbranaa, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, Wong128hk, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread Dvorapa
Dvorapa added a comment.

In T198817#4399091, @Xqt wrote:

doesn't require files that starts with "{{-start-}}" and ends with "{{-stop-}}" -- we will batch upload 25 000 .wiki files so it will be a tedious task to generate 25 000 files just for this purpose.


You may easily add 25 000 delimited entries to that single file and upload them by a single command at once.


Yeah, the script can get one huge file like:

{{-start-}}
'''Test'''
Hello world
{{-stop-}}
{{-start-}}
'''Test 2'''
Hi world
{{-stop-}}TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DvorapaCc: zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread Dvorapa
Dvorapa added a comment.
I suggest to improve both pagefromfile.py and add_text.py/basic.py:


pagefromfile.py to make the batch uploading as easy as possible. It should be able to read from the stream, from one file or multiple files.
add_text.py/basic.py to make the single page change as easy as possible. It should be able to edit redirects, replace the whole page, create missing page and read from piped input.
(probably rename those two scripts to something like single.py and multiple.py or something similar)



In T198817#4398564, @Xqt wrote:
$ echo "{{-start-}}" > Test.wiki
 $ echo "‘‘‘Test‘‘‘" >> Test.wiki
 $ echo "Hello world" >> Test.wiki
 $ echo "{{-stop-}}" >> Test.wiki
 pwb.py pagefromfile -file:Test.wiki -notitle


This should work too if page does not exist:

$ echo "Hello world" > Test.wiki
$ python pwb.py add_text -text:"$(cat Test.wiki)" -page:"Test"TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DvorapaCc: zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T187009: Pywikibot documentation build throws too many warnings to console (goal)

2018-07-05 Thread gerritbot
gerritbot added a comment.
Change 443918 had a related patch set uploaded (by Dalba; owner: dalba):
[pywikibot/core@master] site.py: Improve type hints

https://gerrit.wikimedia.org/r/443918TASK DETAILhttps://phabricator.wikimedia.org/T187009EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: zhuyifei1999, Zoranzoki21, gerritbot, Aklapper, pywikibot-bugs-list, Dvorapa, Cpaulf30, Ivana_Isadora, Jayprakash12345, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, Dinoguy1000, jayvdb, Dalba, Masti, Alchimista, Rxy, Jay8g___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T187009: Pywikibot documentation build throws too many warnings to console (goal)

2018-07-05 Thread Dvorapa
Dvorapa added a comment.
https://gerrit.wikimedia.org/r/#/c/pywikibot/core/+/443761/ fixed some of the "more than one target found for cross-reference" warningsTASK DETAILhttps://phabricator.wikimedia.org/T187009EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DvorapaCc: zhuyifei1999, Zoranzoki21, gerritbot, Aklapper, pywikibot-bugs-list, Dvorapa, Cpaulf30, Ivana_Isadora, Jayprakash12345, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, Dinoguy1000, jayvdb, Dalba, Masti, Alchimista, Rxy, Jay8g___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Updated] T187009: Pywikibot documentation build throws too many warnings to console (goal)

2018-07-05 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T187009EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: zhuyifei1999, Zoranzoki21, gerritbot, Aklapper, pywikibot-bugs-list, Dvorapa, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Ivana_Isadora, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, mys_721tx, Dinoguy1000, jayvdb, Dalba, Masti, Alchimista, Rxy, Jay8g___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198849: Argument processing chokes on python 2 when an argument contains non-ascii

2018-07-05 Thread Multichill
Multichill added a comment.
Looks like @Dalba introduced it in https://gerrit.wikimedia.org/r/#/c/pywikibot/core/+/440096/TASK DETAILhttps://phabricator.wikimedia.org/T198849EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999, MultichillCc: gerritbot, Dalba, zhuyifei1999, Aklapper, Multichill, pywikibot-bugs-list, .avgas, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Jrbranaa, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, Wong128hk, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198849: Argument processing chokes on python 2 when an argument contains non-ascii

2018-07-05 Thread gerritbot
gerritbot added a comment.
Change 443957 had a related patch set uploaded (by Zhuyifei1999; owner: Zhuyifei1999):
[pywikibot/core@master] pagegenerators: try..except UnicodeError on getattr()

https://gerrit.wikimedia.org/r/443957TASK DETAILhttps://phabricator.wikimedia.org/T198849EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999, gerritbotCc: gerritbot, Dalba, zhuyifei1999, Aklapper, Multichill, pywikibot-bugs-list, .avgas, Jrbranaa, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, Wong128hk, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Updated] T198849: Argument processing chokes on python 2 when an argument contains non-ascii

2018-07-05 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T198849EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999, gerritbotCc: gerritbot, Dalba, zhuyifei1999, Aklapper, Multichill, pywikibot-bugs-list, .avgas, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Jrbranaa, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, Wong128hk, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Edited] T198849: Argument processing chokes on python 2 when an argument contains non-ascii

2018-07-05 Thread .avgas
.avgas updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...tools.irishbot@tools-bastion-03:~$ python /data/project/shared/pywikipedia/core/scripts/replace.py -regex 'scade alle 23.59 del giorno martedì 3 luglio 2018' 'scade alle 23.59 del giorno giovedì 5 luglio 2018' -page:"Wikipedia:Pagine_da_cancepython /data/project/shared/pywikipedia/core/scripts/replace.py -regex 'scade alle 23.59 del giorno martedì 3 luglio 2018' 'scade alle 23.59 del giorno giovedì 5 luglio 2018' -page:"Wikipedia:Pagine_da_cancellare/Step In Fluid" -page:"Wikipedia:Pagine_da_cancellare/Harun Demiraslan" llare/Step In Fluid" -page:"Wikipedia:Pagine_da_cancellare/Harun Demirasla" -page:"Wikipedia:Pagine_da_cancellare/Codici ICAO" -page:"Wikipedia:Pagine_da_cancellare/Ingegneria logistica e della produzione" -page:"Wikipedia:Pagine_da_cancellare/Summer Cummings" -page:"Wikipedia:Pagine_da_cancellare/Milos Rechtorik" -page:"Wikipedia:Pagine_da_cancellare/Aymen Krouma" -page:"Wikipedia:Pagine_da_cancellare/AMSN2" -page:"Wikipedia:Pagine_da_cancellare/Róbert Matejka" -page:"Wikipedia:Pagine_da_cancellare/Sylwester Lusiusz" -page:"Wikipedia:Pagine_da_cancellare/Radosław Kanach" -page:"Wikipedia:Pagine_da_cancellare/Aleš Mandous" -page:"Wikipedia:Pagine_da_cancellare/Paolo Martinelli (vescovo)" -page:"Wikipedia:Pagine_da_cancellare/Massimo Russo (batterista)" -page:"Wikipedia:Pagine_da_cancellare/Simone Venturi" -summary:"Prorogo PDC in seguito ad oscuramento"...TASK DETAILhttps://phabricator.wikimedia.org/T198849EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999, .avgasCc: Dalba, zhuyifei1999, Aklapper, Multichill, pywikibot-bugs-list, .avgas, Jrbranaa, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, Wong128hk, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Updated] T198849: Argument processing chokes on python 2 when an argument contains non-ascii

2018-07-05 Thread zhuyifei1999
zhuyifei1999 added a subscriber: Dalba.zhuyifei1999 added a comment.
I did this diff:

zhuyifei1999@zhuyifei1999-ThinkPad-X260:~/mw-dev/pywikibot-core$ git diff
diff --git a/pywikibot/pagegenerators.py b/pywikibot/pagegenerators.py
index ec06f313..95cf67dd 100644
--- a/pywikibot/pagegenerators.py
+++ b/pywikibot/pagegenerators.py
@@ -1176,6 +1176,7 @@ class GeneratorFactory(object):
 if value == '':
 value = None
 
+print(repr('_handle_', arg[1:], '_handle_' + arg[1:]))
 handler = getattr(self, '_handle_' + arg[1:], None)
 if handler:
 handler_result = handler(value)

Confirming everything is unicode:

zhuyifei1999@zhuyifei1999-ThinkPad-X260:~/mw-dev/pywikibot-core$ python pwb.py replace .ì
family and mylang are not set.
Defaulting to family='test' and mylang='test'.
(u'_handle_', u'\xec', u'_handle_\xec')
Traceback (most recent call last):
  File "pwb.py", line 251, in 
if not main():
  File "pwb.py", line 244, in main
run_python_file(filename, [filename] + args, argvu, file_package)
  File "pwb.py", line 115, in run_python_file
main_mod.__dict__)
  File "./scripts/replace.py", line 1198, in 
main()
  File "./scripts/replace.py", line 924, in main
if genFactory.handleArg(arg):
  File "/home/zhuyifei1999/mw-dev/pywikibot-core/pywikibot/pagegenerators.py", line 1180, in handleArg
handler = getattr(self, '_handle_' + arg[1:], None)
UnicodeEncodeError: 'ascii' codec can't encode character u'\xec' in position 8: ordinal not in range(128)

CRITICAL: Closing network session.

So the error is getattr cannot process a non-ascii unicode, and I can confirm this:

zhuyifei1999@zhuyifei1999-ThinkPad-X260:~/mw-dev/pywikibot-core$ python
Python 2.7.15rc1 (default, Apr 15 2018, 21:51:34) 
[GCC 7.3.0] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> type(b'footype', (object,), {})()
<__main__.footype object at 0x7efc8e62c110>
>>> getattr(type(b'footype', (object,), {})(), 'ì')
Traceback (most recent call last):
  File "", line 1, in 
AttributeError: 'footype' object has no attribute 'ì'
>>> getattr(type(b'footype', (object,), {})(), u'ì')
Traceback (most recent call last):
  File "", line 1, in 
UnicodeEncodeError: 'ascii' codec can't encode character u'\xec' in position 0: ordinal not in range(128)

So, #regression from d8ffde8. CC @DalbaTASK DETAILhttps://phabricator.wikimedia.org/T198849EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999Cc: Dalba, zhuyifei1999, Aklapper, Multichill, pywikibot-bugs-list, .avgas, Andrewjhill, Jrbranaa, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, Wong128hk, mys_721tx, jayvdb, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Updated] T198849: Argument processing chokes on python 2 when an argument contains non-ascii

2018-07-05 Thread zhuyifei1999
zhuyifei1999 added a project: Regression.zhuyifei1999 added a comment.
shell.py uses sys.argv instread of pywikibot.argvu, I'll just ignore that for now since there isn't really a reason to provide non-ascii args to shell.py.TASK DETAILhttps://phabricator.wikimedia.org/T198849EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999Cc: zhuyifei1999, Aklapper, Multichill, pywikibot-bugs-list, .avgas, Andrewjhill, Jrbranaa, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, Wong128hk, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Claimed] T198849: Argument processing chokes on python 2 when an argument contains non-ascii

2018-07-05 Thread zhuyifei1999
zhuyifei1999 claimed this task.zhuyifei1999 added a comment.
I'm debugging this.TASK DETAILhttps://phabricator.wikimedia.org/T198849EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999Cc: zhuyifei1999, Aklapper, Multichill, pywikibot-bugs-list, .avgas, Andrewjhill, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Created] T198849: Argument processing chokes on python 2 when an argument contains non-ascii

2018-07-05 Thread zhuyifei1999
zhuyifei1999 created this task.zhuyifei1999 added a project: Pywikibot-core.Herald added subscribers: pywikibot-bugs-list, Aklapper.
TASK DESCRIPTION@.avgas Encountered this error while using replace.py:

tools.irishbot@tools-bastion-03:~$ python /data/project/shared/pywikipedia/core/scripts/replace.py -regex 'scade alle 23.59 del giorno martedì 3 luglio 2018' 'scade alle 23.59 del giorno giovedì 5 luglio 2018' -page:"Wikipedia:Pagine_da_cancepython /data/project/shared/pywikipedia/core/scripts/replace.py -regex 'scade alle 23.59 del giorno martedì 3 luglio 2018' 'scade alle 23.59 del giorno giovedì 5 luglio 2018' -page:"Wikipedia:Pagine_da_cancellare/Step In Fluid" -page:"Wikipedia:Pagine_da_cancellare/Harun Demiraslan" llare/Step In Fluid" -page:"Wikipedia:Pagine_da_cancellare/Harun Demirasla" -page:"Wikipedia:Pagine_da_cancellare/Codici ICAO" -page:"Wikipedia:Pagine_da_cancellare/Ingegneria logistica e della produzione" -page:"Wikipedia:Pagine_da_cancellare/Summer Cummings" -page:"Wikipedia:Pagine_da_cancellare/Milos Rechtorik" -page:"Wikipedia:Pagine_da_cancellare/Aymen Krouma" -page:"Wikipedia:Pagine_da_cancellare/AMSN2" -page:"Wikipedia:Pagine_da_cancellare/Róbert Matejka" -page:"Wikipedia:Pagine_da_cancellare/Sylwester Lusiusz" -page:"Wikipedia:Pagine_da_cancellare/Radosław Kanach" -page:"Wikipedia:Pagine_da_cancellare/Aleš Mandous" -page:"Wikipedia:Pagine_da_cancellare/Paolo Martinelli (vescovo)" -page:"Wikipedia:Pagine_da_cancellare/Massimo Russo (batterista)" -page:"Wikipedia:Pagine_da_cancellare/Simone Venturi" -summary:"Prorogo PDC in seguito ad oscuramento"
Traceback (most recent call last):
  File "/data/project/shared/pywikipedia/core/scripts/replace.py", line 1198, in 
main()
  File "/data/project/shared/pywikipedia/core/scripts/replace.py", line 924, in main
if genFactory.handleArg(arg):
  File "/data/project/shared/pywikipedia/core/pywikibot/pagegenerators.py", line 1179, in handleArg
handler = getattr(self, '_handle_' + arg[1:], None)
UnicodeEncodeError: 'ascii' codec can't encode character u'\xec' in position 41: ordinal not in range(128)

CRITICAL: Closing network session.

I was able to reduce the number of arguments:

zhuyifei1999@zhuyifei1999-ThinkPad-X260:~/mw-dev/pywikibot-core$ python pwb.py replace .ì
family and mylang are not set.
Defaulting to family='test' and mylang='test'.
Traceback (most recent call last):
  File "pwb.py", line 251, in 
if not main():
  File "pwb.py", line 244, in main
run_python_file(filename, [filename] + args, argvu, file_package)
  File "pwb.py", line 115, in run_python_file
main_mod.__dict__)
  File "./scripts/replace.py", line 1198, in 
main()
  File "./scripts/replace.py", line 924, in main
if genFactory.handleArg(arg):
  File "/home/zhuyifei1999/mw-dev/pywikibot-core/pywikibot/pagegenerators.py", line 1179, in handleArg
handler = getattr(self, '_handle_' + arg[1:], None)
UnicodeEncodeError: 'ascii' codec can't encode character u'\xec' in position 8: ordinal not in range(128)

CRITICAL: Closing network session.
zhuyifei1999@zhuyifei1999-ThinkPad-X260:~/mw-dev/pywikibot-core$ python pwb.py shell ì
family and mylang are not set.
Defaulting to family='test' and mylang='test'.
WARNING: ./scripts/shell.py:30: UnicodeWarning: Unicode equal comparison failed to convert both arguments to Unicode - interpreting them as being unequal
  if '-noimport' in args:

Traceback (most recent call last):
  File "pwb.py", line 251, in 
if not main():
  File "pwb.py", line 244, in main
run_python_file(filename, [filename] + args, argvu, file_package)
  File "pwb.py", line 115, in run_python_file
main_mod.__dict__)
  File "./scripts/shell.py", line 61, in 
main(*args)
  File "./scripts/shell.py", line 36, in main
args = pywikibot.handle_args(args)
  File "/home/zhuyifei1999/mw-dev/pywikibot-core/pywikibot/bot.py", line 927, in handle_args
option, sep, value = arg.partition(':')
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 0: ordinal not in range(128)

CRITICAL: Closing network session.

I did this diff to inspect the args:

diff --git a/pywikibot/bot.py b/pywikibot/bot.py
index 51ad1bc8..549fbe6d 100644
--- a/pywikibot/bot.py
+++ b/pywikibot/bot.py
@@ -913,6 +913,7 @@ def handle_args(args=None, do_help=True):
 # it's the version in pywikibot.__init__ that is changed by scripts,
 # not the one in pywikibot.bot.
 args = pywikibot.argvu[1:]
+print(pywikibot.argvu)
 # get the name of the module calling this function. This is
 # required because the -help option loads the module's docstring and
 # because the module name will be used for the filename of the log.

But they are indeed unicode ([u'shell', u'\xec']), not str like what I guessed the cause is.

@Multichill Found that the error was not present in previous versions Pywikibot: [https] r-pywikibot-core.git (7e33658, g9185, 2018/03/18, 13:01:38, OUTDATED)  Pywikibot: [https] r-pywikibot-core.git 

[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread zhuyifei1999
zhuyifei1999 added a comment.

In T198817#4399091, @Xqt wrote:
You may easily add 25 000 delimited entries to that single file and upload them by a single command at once.


Delimiting is a non-solution, unless there are ways to 'escape' delimiters *and* the script can read from non-seekable streams.

Do One Things and Do It Well. pagefromfile.py is neither.TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999Cc: zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Andrewjhill, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T194950: Include Wikibase dispatch lag in API "maxlag" enforcing

2018-07-05 Thread gerritbot
gerritbot added a comment.
Change 443939 had a related patch set uploaded (by Ladsgroup; owner: Amir Sarabadani):
[operations/mediawiki-config@master] Set dispatchLagToMaxLagFactor to 60 for wikidata

https://gerrit.wikimedia.org/r/443939TASK DETAILhttps://phabricator.wikimedia.org/T194950EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: Aklapper, gerritbot, pywikibot-bugs-list, ValterVB, Lea_Lacroix_WMDE, Legoktm, Addshore, MisterSynergy, Magnus, Anomie, Sjoerddebruin, Lydia_Pintscher, Multichill, hoo, Andrewjhill, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, aude, Ricordisamoa, Mbch331___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread Xqt
Xqt added a comment.

doesn't require files that starts with "{{-start-}}" and ends with "{{-stop-}}" -- we will batch upload 25 000 .wiki files so it will be a tedious task to generate 25 000 files just for this purpose.


You may easily add 25 000 delimited entries to that single file and upload them by a single command at once.TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: XqtCc: zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Andrewjhill, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Created] T198839: Update Pywikibot class WikidataBot to include Wikimedia import URL (P4656)

2018-07-05 Thread Multichill
Multichill created this task.Multichill added projects: Pywikibot-core, Pywikibot-Wikidata, Wikidata.Herald added subscribers: pywikibot-bugs-list, Aklapper.
TASK DESCRIPTIONTo improve the traceability of data imported from Wikimedia projects  Wikimedia import URL (https://www.wikidata.org/wiki/Property:P4656)  was introduced.  We should update the WikidataBot at https://phabricator.wikimedia.org/diffusion/PWBC/browse/master/pywikibot/bot.py$2027 to also accept a page as source. Other scripts like https://phabricator.wikimedia.org/diffusion/PWBC/browse/master/scripts/harvest_template.py$306 are currently passing a site object.

Modify the WikidataBot bot that:


If site object gets passed, just add the imported from (same as now)
If a page object gets passed, extract the site (check if it's a valid site) and permalink to latest revision. Add both


Related conversation on Wikidata at https://www.wikidata.org/wiki/Property_talk:P143#Making_the_usage_of_this_property_clearerTASK DETAILhttps://phabricator.wikimedia.org/T198839EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MultichillCc: Aklapper, pywikibot-bugs-list, Multichill, Andrewjhill, Lahi, Gq86, GoranSMilovanovic, Magul, QZanden, Tbscho, MayS, LawExplorer, Mdupont, JJMC89, Avicennasis, mys_721tx, Wikidata-bugs, aude, jayvdb, Ricordisamoa, Dalba, Masti, Alchimista, Mbch331, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T198817: edit and create pages

2018-07-05 Thread David_Hedlund
David_Hedlund added a comment.

In T198817#4398574, @zhuyifei1999 wrote:

In T198817#4398554, @Dvorapa wrote:
First of all, the file should have correct Pywikibot license.


That's a non-issue. I sent this quick-and-dirty script to FSF so they can use it whatever they want. If license is a concern, the licenses allows re-publishing under a different license.


Yes that is how everything started. I'm a Free Software Foundation (FSF) intern during this summer and I work with the tech team. I requested zhuyifei1999 to write this script for me since I needed to batch upload .wiki files to directory.fsf.org.



Finally for this purpose we already have pagefromfile.py or a little bit easier add_text.py

We have discussed this. pagefromfile.py cannot read from a non-seekable stream (such as pipe) and add_text.py cannot do page replacements when the page exists.

You can also use basic.py

Only works on existing pages.

The script authored by zhuyifei1999 is very useful since it 1) updates pages if it already exist and create pages if they don't exist. 2) doesn't require files that starts with "{{-start-}}" and ends with "{{-stop-}}" -- we will batch upload 25 000 .wiki files so it will be a tedious task to generate 25 000 files just for this purpose.TASK DETAILhttps://phabricator.wikimedia.org/T198817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: David_HedlundCc: zhuyifei1999, saper, Zoranzoki21, Xqt, Dvorapa, pywikibot-bugs-list, Framawiki, Aklapper, David_Hedlund, Andrewjhill, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs