[Pywikipedia-bugs] [Maniphest] [Commented On] T276715: reflinks.py: unknown encoding

2021-03-07 Thread Rubin16
Rubin16 added a comment.


  not only win-1251.
  
Page [[Список кораблей Военно-морского флота Российской Федерации]] saved

2473 pages read
13 pages written
0 pages skipped
Execution time: 366 seconds
Read operation time: 0.1 seconds
Write operation time: 28.2 seconds
Script terminated by exception:

ERROR: LookupError: unknown encoding: binary
Traceback (most recent call last):
  File "pwb.py", line 363, in 
if not main():
  File "pwb.py", line 358, in main
file_package)
  File "pwb.py", line 75, in run_python_file
main_mod.__dict__)
  File "./scripts/reflinks.py", line 767, in 
main()
  File "./scripts/reflinks.py", line 763, in main
bot.run()
  File 
"/mnt/nfs/labstore-secondary-tools-project/rubin16/pywikibot-core/pywikibot/bot.py",
 line 1484, in run
self.treat(page)
  File "./scripts/reflinks.py", line 535, in treat
ref.url, use_fake_user_agent=self._use_fake_user_agent)
  File 
"/mnt/nfs/labstore-secondary-tools-project/rubin16/pywikibot-core/pywikibot/tools/__init__.py",
 line 1478, in wrapper
return obj(*__args, **__kw)
  File 
"/mnt/nfs/labstore-secondary-tools-project/rubin16/pywikibot-core/pywikibot/comms/http.py",
 line 417, in fetch
response.encoding = _decide_encoding(response, charset)
  File 
"/mnt/nfs/labstore-secondary-tools-project/rubin16/pywikibot-core/pywikibot/comms/http.py",
 line 472, in _decide_encoding
return _try_decode(response.content, header_encoding)
  File 
"/mnt/nfs/labstore-secondary-tools-project/rubin16/pywikibot-core/pywikibot/comms/http.py",
 line 456, in _try_decode
content.decode(encoding)
LookupError: unknown encoding: binary
CRITICAL: Exiting due to uncaught except

TASK DETAIL
  https://phabricator.wikimedia.org/T276715

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Rubin16
Cc: Aklapper, pywikibot-bugs-list, Rubin16, Jyoo1011, JohnsonLee01, SHEKH, 
Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, 
Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T276715: reflinks.py: unknown encoding

2021-03-07 Thread Xqt
Xqt added a comment.


  `Win-1251` is not a valid alias of Python Standard Encodings 
. Must be 
`windows-1521`.

TASK DETAIL
  https://phabricator.wikimedia.org/T276715

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt
Cc: Xqt, valhallasw, Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, Jyoo1011, 
JohnsonLee01, SHEKH, Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Tbscho, MayS, 
Mdupont, JJMC89, Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, 
Alchimista
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T276715: reflinks.py: unknown encoding

2021-03-08 Thread gerritbot
gerritbot added a comment.


  Change 669725 had a related patch set uploaded (by Xqt; owner: Xqt):
  [pywikibot/core@master] [bugfix] check for LookupError exception in 
_try_decode
  
  https://gerrit.wikimedia.org/r/669725

TASK DETAIL
  https://phabricator.wikimedia.org/T276715

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt, gerritbot
Cc: Xqt, valhallasw, Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, Jyoo1011, 
JohnsonLee01, SHEKH, Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Tbscho, MayS, 
Mdupont, JJMC89, Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, 
Alchimista
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T276715: reflinks.py: unknown encoding

2021-03-08 Thread Xqt
Xqt added a comment.


  @Rubin16: Are you able to test this patch above?

TASK DETAIL
  https://phabricator.wikimedia.org/T276715

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt
Cc: Xqt, valhallasw, Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, Jyoo1011, 
JohnsonLee01, SHEKH, Dijkstra, Alter-paule, Beast1978, Un1tY, Khutuck, 
Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, Wenyi, Gaboe420, 
Giuliamocci, Cpaulf30, Af420, Bsandipan, Tbscho, MayS, Lewizho99, Mdupont, 
JJMC89, Maathavan, Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, 
Alchimista
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T276715: reflinks.py: unknown encoding

2021-03-08 Thread Rubin16
Rubin16 added a comment.


  @Xqt checked, works, thanks a lot

TASK DETAIL
  https://phabricator.wikimedia.org/T276715

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt, Rubin16
Cc: Xqt, valhallasw, Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, Jyoo1011, 
JohnsonLee01, SHEKH, Dijkstra, Alter-paule, Beast1978, Un1tY, Khutuck, 
Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, Wenyi, Gaboe420, 
Giuliamocci, Cpaulf30, Af420, Bsandipan, Tbscho, MayS, Lewizho99, Mdupont, 
JJMC89, Maathavan, Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, 
Alchimista
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T276715: reflinks.py: unknown encoding

2021-03-08 Thread Rubin16
Rubin16 added a comment.


  it stopped crashing but it stopped editing too... it is hard to explain the 
problem,  as I can't see the pages where problem happens.
  I just see this
  
Retrieving 50 pages from wikipedia:ru.
Adding references section before Ссылки section...
  
  So, I suppose some page should have been edited now, but there are no changes 
in the log of contributions: I ran bot for 10-15 minutes and it certainly 
should have edited some pages.
  
  I've also noticed some new errors in trace:
  
Can't retrieve page http://www.vpc.org/studies/amroul2006.pdf : 
HTTPSConnectionPool(host='www.vpc.org', port=443): Max retries exceeded with 
url: /studies/amroul2006.pdf (Caused by SSLError(SSLError("bad handshake: 
Error([('SSL routines', 'tls_process_server_certificate', 'certificate verify 
failed')],)",),))
WARNING: 
/mnt/nfs/labstore-secondary-tools-project/rubin16/pywikibot-core/pywikibot/data/api.py:2014:
 ResourceWarning: unclosed 
  uniquedescr, self._data, self._cachetime = pickle.load(f)
  
  
  
WARNING: /usr/lib/python3.5/socket.py:647: ResourceWarning: unclosed 

  self._sock = None

TASK DETAIL
  https://phabricator.wikimedia.org/T276715

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt, Rubin16
Cc: Xqt, valhallasw, Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, Jyoo1011, 
JohnsonLee01, SHEKH, Dijkstra, Alter-paule, Beast1978, Un1tY, Khutuck, 
Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, Wenyi, Gaboe420, 
Giuliamocci, Cpaulf30, Af420, Bsandipan, Tbscho, MayS, Lewizho99, Mdupont, 
JJMC89, Maathavan, Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, 
Alchimista
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T276715: reflinks.py: unknown encoding

2021-03-08 Thread gerritbot
gerritbot added a comment.


  Change 669725 **merged** by jenkins-bot:
  [pywikibot/core@master] [bugfix] check for LookupError exception in 
_try_decode
  
  https://gerrit.wikimedia.org/r/669725

TASK DETAIL
  https://phabricator.wikimedia.org/T276715

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt, gerritbot
Cc: Xqt, valhallasw, Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, Jyoo1011, 
JohnsonLee01, SHEKH, Dijkstra, Alter-paule, Beast1978, Un1tY, Khutuck, 
Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, Wenyi, Gaboe420, 
Giuliamocci, Cpaulf30, Af420, Bsandipan, Tbscho, MayS, Lewizho99, Mdupont, 
JJMC89, Maathavan, Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, 
Alchimista
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T276715: reflinks.py: unknown encoding

2021-03-08 Thread gerritbot
gerritbot added a comment.


  Change 669918 had a related patch set uploaded (by Xqt; owner: Xqt):
  [pywikibot/core@master] [bugfix] Fix the issue that there are no changes in 
the log of contributions
  
  https://gerrit.wikimedia.org/r/669918

TASK DETAIL
  https://phabricator.wikimedia.org/T276715

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt, gerritbot
Cc: Xqt, valhallasw, Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, Jyoo1011, 
JohnsonLee01, SHEKH, Dijkstra, Alter-paule, Beast1978, Un1tY, Khutuck, 
Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, Wenyi, Gaboe420, 
Giuliamocci, Cpaulf30, Af420, Bsandipan, Tbscho, MayS, Lewizho99, Mdupont, 
JJMC89, Maathavan, Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, 
Alchimista
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T276715: reflinks.py: unknown encoding

2021-03-08 Thread Xqt
Xqt added a comment.


  > I suppose some page should have been edited now, but there are no changes 
in the log of contributions
  
  Should be solved with https://gerrit.wikimedia.org/r/669918

TASK DETAIL
  https://phabricator.wikimedia.org/T276715

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt
Cc: Xqt, valhallasw, Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, Jyoo1011, 
JohnsonLee01, SHEKH, Dijkstra, Alter-paule, Beast1978, Un1tY, Khutuck, 
Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, Wenyi, Gaboe420, 
Giuliamocci, Cpaulf30, Af420, Bsandipan, Tbscho, MayS, Lewizho99, Mdupont, 
JJMC89, Maathavan, Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, 
Alchimista
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T276715: reflinks.py: unknown encoding

2021-03-08 Thread gerritbot
gerritbot added a comment.


  Change 669918 **merged** by jenkins-bot:
  [pywikibot/core@master] [bugfix] Fix the issue that there are no changes in 
the log of contributions
  
  https://gerrit.wikimedia.org/r/669918

TASK DETAIL
  https://phabricator.wikimedia.org/T276715

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt, gerritbot
Cc: Xqt, valhallasw, Mpaa, Aklapper, pywikibot-bugs-list, Rubin16, Jyoo1011, 
JohnsonLee01, SHEKH, Dijkstra, Alter-paule, Beast1978, Un1tY, Khutuck, 
Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, Wenyi, Gaboe420, 
Giuliamocci, Cpaulf30, Af420, Bsandipan, Tbscho, MayS, Lewizho99, Mdupont, 
JJMC89, Maathavan, Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, 
Alchimista
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs