subject:"\[Pywikipedia\-bugs\] \[Maniphest\] \[Commented On\] T226157\: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization"

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

2021-02-03 Thread gerritbot

gerritbot added a comment.


  Change 660809 **merged** by jenkins-bot:
  [pywikibot/core@master] [IMPR] Create a SiteLink with __getitem__ method
  
  https://gerrit.wikimedia.org/r/660809

TASK DETAIL
  https://phabricator.wikimedia.org/T226157

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt, gerritbot
Cc: Bugreporter, Chicocvenancio, Xqt, Lokal_Profil, Aklapper, matej_suchanek, 
pywikibot-bugs-list, JohnsonLee01, SHEKH, Dijkstra, Alter-paule, Beast1978, 
Un1tY, Khutuck, Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, 
Wenyi, Gaboe420, Giuliamocci, Cpaulf30, Af420, Darkminds3113, Bsandipan, 
Jayprakash12345, Tbscho, MayS, Vali.matei, Lewizho99, Mdupont, JJMC89, 
Maathavan, Dvorapa, Altostratus, Avicennasis, Volker_E, Wong128hk, mys_721tx, 
GWicke, Dinoguy1000, jayvdb, Ricordisamoa, Masti, Alchimista, Rxy, Jay8g
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

2021-02-02 Thread gerritbot

gerritbot added a comment.


  Change 660758 **merged** by jenkins-bot:
  [pywikibot/core@master] [IMPR] speed up preload_sites.py maintenance script
  
  https://gerrit.wikimedia.org/r/660758

TASK DETAIL
  https://phabricator.wikimedia.org/T226157

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Bugreporter, Chicocvenancio, Xqt, Lokal_Profil, Aklapper, matej_suchanek, 
pywikibot-bugs-list, JohnsonLee01, SHEKH, Dijkstra, Alter-paule, Beast1978, 
Un1tY, Khutuck, Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, 
Wenyi, Gaboe420, Giuliamocci, Cpaulf30, Af420, Darkminds3113, Bsandipan, 
Jayprakash12345, Tbscho, MayS, Vali.matei, Lewizho99, Mdupont, JJMC89, 
Maathavan, Dvorapa, Altostratus, Avicennasis, Volker_E, Wong128hk, mys_721tx, 
GWicke, Dinoguy1000, jayvdb, Ricordisamoa, Masti, Alchimista, Rxy, Jay8g
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

2021-02-01 Thread gerritbot

gerritbot added a comment.


  Change 660809 had a related patch set uploaded (by Xqt; owner: Xqt):
  [pywikibot/core@master] [IMPR] Create a SiteLink with __getitem__ method
  
  https://gerrit.wikimedia.org/r/660809

TASK DETAIL
  https://phabricator.wikimedia.org/T226157

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Bugreporter, Chicocvenancio, Xqt, Lokal_Profil, Aklapper, matej_suchanek, 
pywikibot-bugs-list, JohnsonLee01, SHEKH, Dijkstra, Alter-paule, Beast1978, 
Un1tY, Khutuck, Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, 
Wenyi, Gaboe420, Giuliamocci, Cpaulf30, Af420, Darkminds3113, Bsandipan, 
Jayprakash12345, Tbscho, MayS, Vali.matei, Lewizho99, Mdupont, JJMC89, 
Maathavan, Dvorapa, Altostratus, Avicennasis, Volker_E, Wong128hk, mys_721tx, 
GWicke, Dinoguy1000, jayvdb, Ricordisamoa, Masti, Alchimista, Rxy, Jay8g
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

2021-02-01 Thread gerritbot

gerritbot added a comment.


  Change 660758 had a related patch set uploaded (by Xqt; owner: Xqt):
  [pywikibot/core@master] [IMPR] speed up preload_sites.py maintenance script
  
  https://gerrit.wikimedia.org/r/660758

TASK DETAIL
  https://phabricator.wikimedia.org/T226157

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Bugreporter, Chicocvenancio, Xqt, Lokal_Profil, Aklapper, matej_suchanek, 
pywikibot-bugs-list, JohnsonLee01, SHEKH, Dijkstra, Khutuck, Zkhalido, Viztor, 
Wenyi, Darkminds3113, Jayprakash12345, Tbscho, MayS, Vali.matei, Mdupont, 
JJMC89, Dvorapa, Altostratus, Avicennasis, Volker_E, Wong128hk, mys_721tx, 
GWicke, Dinoguy1000, jayvdb, Ricordisamoa, Masti, Alchimista, Rxy, Jay8g
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

2021-01-26 Thread gerritbot

gerritbot added a comment.


  Change 656997 **merged** by jenkins-bot:
  [pywikibot/core@master] [maintenance] Add a preload_sites.py script to 
preload site informations
  
  https://gerrit.wikimedia.org/r/656997

TASK DETAIL
  https://phabricator.wikimedia.org/T226157

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Bugreporter, Chicocvenancio, Xqt, Lokal_Profil, Aklapper, matej_suchanek, 
pywikibot-bugs-list, JohnsonLee01, SHEKH, Dijkstra, Alter-paule, Beast1978, 
Un1tY, Khutuck, Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, 
Wenyi, Gaboe420, Giuliamocci, Cpaulf30, Af420, Darkminds3113, Bsandipan, 
Jayprakash12345, Tbscho, MayS, Vali.matei, Lewizho99, Mdupont, JJMC89, 
Maathavan, Dvorapa, Altostratus, Avicennasis, Volker_E, Wong128hk, mys_721tx, 
GWicke, Dinoguy1000, jayvdb, Ricordisamoa, Masti, Alchimista, Rxy, Jay8g
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

2021-01-20 Thread Xqt

Xqt added a comment.


  In T226157#6762542 , 
@Bugreporter wrote:
  
  > This still does not handle a problem: A user is usually not registered in 
all wikis, and querying data without a user account will result in error. 
Therefore, if you try to run this script, it will almost always return a 
pywikibot.exceptions.NoUsername error. In addition, the first load of site 
informations is still slow. There are two things to be done:
  >
  > 1. Allow page object be lazy loaded (not to be confuse with preload), so 
that no site object is created at all. Usually when user querying an item only 
few or no sitelink is actually used.
  > 2. Introduce an "anonymouse mode" in Pywikibot, i.e. allow script to fetch 
site or page information (as read-only) without a registered account.
  
  This is just an intermediate "solution" which is able to decrease processing 
time of other scripts low because it preloads and Caches siteinfo settings. In 
compat we had lage family files for these Settings.  Creating the site object 
is not the problem; it does not cause any api loads. The underlying problem is 
link parsing which needs an api call to retrieve namespace aliases for each 
affected site.

TASK DETAIL
  https://phabricator.wikimedia.org/T226157

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt
Cc: Bugreporter, Chicocvenancio, Xqt, Lokal_Profil, Aklapper, matej_suchanek, 
pywikibot-bugs-list, JohnsonLee01, SHEKH, Dijkstra, Alter-paule, Beast1978, 
Un1tY, Khutuck, Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, 
Wenyi, Gaboe420, Giuliamocci, Cpaulf30, Af420, Darkminds3113, Bsandipan, 
Jayprakash12345, Tbscho, MayS, Vali.matei, Lewizho99, Mdupont, JJMC89, 
Maathavan, Dvorapa, Altostratus, Avicennasis, Volker_E, Wong128hk, mys_721tx, 
GWicke, Dinoguy1000, jayvdb, Ricordisamoa, Masti, Alchimista, Rxy, Jay8g
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

2021-01-20 Thread Bugreporter

Bugreporter added a comment.

  In T226157#6756845 , 
@gerritbot wrote:

  > Change 656997 had a related patch set uploaded (by Xqt; owner: Xqt):
  > [pywikibot/core@master] [maintenance] Add a preload_sites.py script to 
preload site informations
  >
  > https://gerrit.wikimedia.org/r/656997

  This still does not handle a problem: A user is usually not registered in all 
wikis, and querying data without a user account will result in error. In 
addition, the first load of site informations is still slow. There are two 
things to be done:

  1. Allow page object be lazy loaded (not to be confuse with preload), so that 
no site object is created at all. Usually when user querying an item only few 
or no sitelink is actually used.
  2. Introduce an "anonymouse mode" in Pywikibot, i.e. allow script to fetch 
site or page information (as read-only) without a registered account.

TASK DETAIL
  https://phabricator.wikimedia.org/T226157

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Bugreporter
Cc: Bugreporter, Chicocvenancio, Xqt, Lokal_Profil, Aklapper, matej_suchanek, 
pywikibot-bugs-list, JohnsonLee01, SHEKH, Dijkstra, Alter-paule, Beast1978, 
Un1tY, Khutuck, Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, 
Wenyi, Gaboe420, Giuliamocci, Cpaulf30, Af420, Darkminds3113, Bsandipan, 
Jayprakash12345, Tbscho, MayS, Vali.matei, Lewizho99, Mdupont, JJMC89, 
Maathavan, Dvorapa, Altostratus, Avicennasis, Volker_E, Wong128hk, mys_721tx, 
GWicke, Dinoguy1000, jayvdb, Ricordisamoa, Masti, Alchimista, Rxy, Jay8g
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

2021-01-18 Thread gerritbot

gerritbot added a comment.


  Change 656997 had a related patch set uploaded (by Xqt; owner: Xqt):
  [pywikibot/core@master] [maintenance] Add a preload_sites.py script to 
preload site informations
  
  https://gerrit.wikimedia.org/r/656997

TASK DETAIL
  https://phabricator.wikimedia.org/T226157

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Bugreporter, Chicocvenancio, Xqt, Lokal_Profil, Aklapper, matej_suchanek, 
pywikibot-bugs-list, JohnsonLee01, SHEKH, Dijkstra, Khutuck, Zkhalido, Viztor, 
Wenyi, Darkminds3113, Jayprakash12345, Tbscho, MayS, Vali.matei, Mdupont, 
JJMC89, Dvorapa, Altostratus, Avicennasis, Volker_E, Wong128hk, mys_721tx, 
GWicke, Dinoguy1000, jayvdb, Ricordisamoa, Masti, Alchimista, Rxy, Jay8g
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

[Pywikipedia-bugs] [Maniphest] [Commented On] T226157: Data retrieval may be very long and heavy because of parsing Link during SiteLink initialization

8 matches

Site Navigation

Mail list logo

Footer information