Re: [pywikibot] Not sure if I'm running weblinkchecker correctly
Ok, I've got it to run correctly now. I am running into errors like these though while it is running. Is this normal or do I need to do something differently? socket.gaierror: [Errno 11004] getaddrinfo failed raise err File "C:\Users\Me\Myfolder\Python\Python36\lib\socket.py", line 702, in create_connectio n sock.connect(sa) TimeoutError: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connectio n failed because connected host has failed to respond During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Users\Me\Myfolder\Python\Python36\lib\threading.py", line 916, in _bootstrap_in ner self.run() File "weblinkchecker.py", line 529, in run ok, message = linkChecker.check() File "weblinkchecker.py", line 438, in check msg = error[1] TypeError: 'TimeoutError' object is not subscriptable - File "C:\Users\Me\Myfolder\Python\Python36\lib\threading.py", line 916, in _bootstrap_in ner self.run() File "weblinkchecker.py", line 529, in run ok, message = linkChecker.check() File "weblinkchecker.py", line 438, in check msg = error[1] TypeError: 'gaierror' object does not support indexing -- File "C:\Users\Me\Myfolder\Python\Python36\lib\socket.py", line 575, in readinto return self._sock.recv_into(b) ConnectionResetError: [WinError 10054] An existing connection was forcibly close d by the remote host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Users\Me\Myfolder\Python\Python36\lib\threading.py", line 916, in _bootstrap_in ner self.run() File "weblinkchecker.py", line 529, in run ok, message = linkChecker.check() File "weblinkchecker.py", line 438, in check msg = error[1] TypeError: 'ConnectionResetError' object is not subscriptable --- During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Users\Me\Myfolder\Python\Python36\lib\threading.py", line 916, in _bootstrap_in ner self.run() File "weblinkchecker.py", line 529, in run ok, message = linkChecker.check() File "weblinkchecker.py", line 438, in check msg = error[1] TypeError: 'TimeoutError' object is not subscriptable On Mon, May 30, 2016 at 11:45 AM, .wrote: > Ok, I ran it again with different arguments and now I have a deadlinks > folder. However, when I try to run it for a category with many pages, it > hangs. If I do this: > > >python weblinkchecker.py -cat:People > > It says > > Retrieving 240 pages from mywiki:en. > > And then it doesn't do anything else. Even 30 minutes later it had not > changed. > > Later I tried again with this: > > >python weblinkchecker.py -cat:People -step:5 > > And it says > > Retrieving 240 pages from mywiki:en. > > and hangs, just like before. > > > > > On Sun, May 29, 2016 at 5:03 PM, . wrote: > >> I did a search for "deadlinks" and "results-mywiki.txt" and did not find >> those files. There is a "logs" subdirectory in the core_stable directory, >> but there is only one file in there, a text file called "commands." Should >> this deadlinks subdirectory exist now, or will it not be created until I >> run the bot a week later? >> >> On Sun, May 29, 2016 at 10:15 AM, masti wrote: >> >>> look for the subdirectory called deadlinks >>> it contains all data generated by the bot >>> results-yourwiki.txt - a bot log (text) >>> deadlinks-yourwiki.dat - a bot database (dump of python dictionary) >>> so You can see what is going on >>> >>> masti >>> >>> >>> >>> On 05/28/2016 11:36 PM, . wrote: >>> >>> Ok. I had added some dead links to the user page and was testing to see >>> what it would do. Thank you! >>> >>> On Sat, May 28, 2016 at 4:02 PM, masti wrote: >>> Hi, all the examples are in the script help. You have to run it on a list of pages not just Your user page the bot will create a database of the links it thinks are dead. the bot will only report links as dead if they are found dead at least twice several days apart. Default is 7 days. So once You run it through the whole namespace You will have to wait some days to rerun it. You can set the rquired period with -day parameter but less than a week does not make sense as it will report dead link for a temporary problems with site masti On 05/28/2016 07:18 PM, . wrote: Hi all, I'my trying to run weblinkchecker from my own computer. I've logged in to the bot account, but
Re: [pywikibot] Not sure if I'm running weblinkchecker correctly
Ok, I ran it again with different arguments and now I have a deadlinks folder. However, when I try to run it for a category with many pages, it hangs. If I do this: >python weblinkchecker.py -cat:People It says Retrieving 240 pages from mywiki:en. And then it doesn't do anything else. Even 30 minutes later it had not changed. Later I tried again with this: >python weblinkchecker.py -cat:People -step:5 And it says Retrieving 240 pages from mywiki:en. and hangs, just like before. On Sun, May 29, 2016 at 5:03 PM, .wrote: > I did a search for "deadlinks" and "results-mywiki.txt" and did not find > those files. There is a "logs" subdirectory in the core_stable directory, > but there is only one file in there, a text file called "commands." Should > this deadlinks subdirectory exist now, or will it not be created until I > run the bot a week later? > > On Sun, May 29, 2016 at 10:15 AM, masti wrote: > >> look for the subdirectory called deadlinks >> it contains all data generated by the bot >> results-yourwiki.txt - a bot log (text) >> deadlinks-yourwiki.dat - a bot database (dump of python dictionary) >> so You can see what is going on >> >> masti >> >> >> >> On 05/28/2016 11:36 PM, . wrote: >> >> Ok. I had added some dead links to the user page and was testing to see >> what it would do. Thank you! >> >> On Sat, May 28, 2016 at 4:02 PM, masti wrote: >> >>> Hi, >>> all the examples are in the script help. >>> You have to run it on a list of pages not just Your user page >>> the bot will create a database of the links it thinks are dead. >>> the bot will only report links as dead if they are found dead at least >>> twice several days apart. Default is 7 days. >>> So once You run it through the whole namespace You will have to wait >>> some days to rerun it. >>> You can set the rquired period with -day parameter >>> but less than a week does not make sense as it will report dead link for >>> a temporary problems with site >>> >>> masti >>> >>> >>> >>> On 05/28/2016 07:18 PM, . wrote: >>> >>> Hi all, >>> >>> I'my trying to run weblinkchecker from my own computer. I've logged in >>> to the bot account, but when I try to run weblink checker, like this: >>> >>> >python weblinkchecker.py UserPage:usernamegoeshere >>> >>> I just get a very long bunch of help text on the screen "This bot is >>> used for checking external links found at the wiki" etc. I don't know if >>> I'm successfully running the script or not, and whether it's actually >>> checking any links. >>> >>> What am I doing wrong? >>> >>> Thanks! >>> >>> >>> >>> ___ >>> pywikibot mailing >>> listpywikibot@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/pywikibot >>> >>> >>> >>> ___ >>> pywikibot mailing list >>> pywikibot@lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/pywikibot >>> >>> >> >> >> ___ >> pywikibot mailing >> listpywikibot@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/pywikibot >> >> >> >> ___ >> pywikibot mailing list >> pywikibot@lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/pywikibot >> >> > ___ pywikibot mailing list pywikibot@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot
Re: [pywikibot] Not sure if I'm running weblinkchecker correctly
look for the subdirectory called deadlinks it contains all data generated by the bot results-yourwiki.txt - a bot log (text) deadlinks-yourwiki.dat - a bot database (dump of python dictionary) so You can see what is going on masti On 05/28/2016 11:36 PM, . wrote: Ok. I had added some dead links to the user page and was testing to see what it would do. Thank you! On Sat, May 28, 2016 at 4:02 PM, mastiwrote: Hi, all the examples are in the script help. You have to run it on a list of pages not just Your user page the bot will create a database of the links it thinks are dead. the bot will only report links as dead if they are found dead at least twice several days apart. Default is 7 days. So once You run it through the whole namespace You will have to wait some days to rerun it. You can set the rquired period with -day parameter but less than a week does not make sense as it will report dead link for a temporary problems with site masti On 05/28/2016 07:18 PM, . wrote: Hi all, I'my trying to run weblinkchecker from my own computer. I've logged in to the bot account, but when I try to run weblink checker, like this: >python weblinkchecker.py UserPage:usernamegoeshere I just get a very long bunch of help text on the screen "This bot is used for checking external links found at the wiki" etc. I don't know if I'm successfully running the script or not, and whether it's actually checking any links. What am I doing wrong? Thanks! ___ pywikibot mailing list pywikibot@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot ___ pywikibot mailing list pywikibot@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot ___ pywikibot mailing list pywikibot@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot ___ pywikibot mailing list pywikibot@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot
Re: [pywikibot] Not sure if I'm running weblinkchecker correctly
Ok. I had added some dead links to the user page and was testing to see what it would do. Thank you! On Sat, May 28, 2016 at 4:02 PM, mastiwrote: > Hi, > all the examples are in the script help. > You have to run it on a list of pages not just Your user page > the bot will create a database of the links it thinks are dead. > the bot will only report links as dead if they are found dead at least > twice several days apart. Default is 7 days. > So once You run it through the whole namespace You will have to wait some > days to rerun it. > You can set the rquired period with -day parameter > but less than a week does not make sense as it will report dead link for a > temporary problems with site > > masti > > > > On 05/28/2016 07:18 PM, . wrote: > > Hi all, > > I'my trying to run weblinkchecker from my own computer. I've logged in to > the bot account, but when I try to run weblink checker, like this: > > >python weblinkchecker.py UserPage:usernamegoeshere > > I just get a very long bunch of help text on the screen "This bot is used > for checking external links found at the wiki" etc. I don't know if I'm > successfully running the script or not, and whether it's actually checking > any links. > > What am I doing wrong? > > Thanks! > > > > ___ > pywikibot mailing > listpywikibot@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/pywikibot > > > > ___ > pywikibot mailing list > pywikibot@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/pywikibot > > ___ pywikibot mailing list pywikibot@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot
Re: [pywikibot] Not sure if I'm running weblinkchecker correctly
Hi, all the examples are in the script help. You have to run it on a list of pages not just Your user page the bot will create a database of the links it thinks are dead. the bot will only report links as dead if they are found dead at least twice several days apart. Default is 7 days. So once You run it through the whole namespace You will have to wait some days to rerun it. You can set the rquired period with -day parameter but less than a week does not make sense as it will report dead link for a temporary problems with site masti On 05/28/2016 07:18 PM, . wrote: Hi all, I'my trying to run weblinkchecker from my own computer. I've logged in to the bot account, but when I try to run weblink checker, like this: >python weblinkchecker.py UserPage:usernamegoeshere I just get a very long bunch of help text on the screen "This bot is used for checking external links found at the wiki" etc. I don't know if I'm successfully running the script or not, and whether it's actually checking any links. What am I doing wrong? Thanks! ___ pywikibot mailing list pywikibot@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot ___ pywikibot mailing list pywikibot@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot
Re: [pywikibot] Not sure if I'm running weblinkchecker correctly
(Forgot to mention this is for a third party wiki.) On Sat, May 28, 2016 at 1:18 PM, .wrote: > Hi all, > > I'my trying to run weblinkchecker from my own computer. I've logged in to > the bot account, but when I try to run weblink checker, like this: > > >python weblinkchecker.py UserPage:usernamegoeshere > > I just get a very long bunch of help text on the screen "This bot is used > for checking external links found at the wiki" etc. I don't know if I'm > successfully running the script or not, and whether it's actually checking > any links. > > What am I doing wrong? > > Thanks! > > ___ pywikibot mailing list pywikibot@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot
[pywikibot] Not sure if I'm running weblinkchecker correctly
Hi all, I'my trying to run weblinkchecker from my own computer. I've logged in to the bot account, but when I try to run weblink checker, like this: >python weblinkchecker.py UserPage:usernamegoeshere I just get a very long bunch of help text on the screen "This bot is used for checking external links found at the wiki" etc. I don't know if I'm successfully running the script or not, and whether it's actually checking any links. What am I doing wrong? Thanks! ___ pywikibot mailing list pywikibot@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot