Re: MirrorManager crawler patch

2009-07-20 Thread Bruno Wolff III
On Mon, Jul 20, 2009 at 01:27:11 -0400, Ricky Zhou ri...@fedoraproject.org wrote: 2) MirrorManager currently doesn't check timestamps, and the solution to this isn't trivial, especially since with FTP, which returns directory listing data as just the text of the output. This is

Re: MirrorManager crawler patch

2009-07-20 Thread Ricky Zhou
On 2009-07-20 09:34:47 AM, Bruno Wolff III wrote: 2) MirrorManager currently doesn't check timestamps, and the solution to this isn't trivial, especially since with FTP, which returns directory listing data as just the text of the output. This is almost impossible to parse

MirrorManager crawler patch

2009-07-19 Thread Ricky Zhou
Hey, I think we might have found a bug in the mirror crawler where it did not do the repomd sha256sum check if a mirror is checked via FTP. I think the crawler might still need a good bit of cleanup apart from this, but here is an initial attempt at a patch to fix this:

Re: MirrorManager crawler patch

2009-07-19 Thread Ricky Zhou
On 2009-07-20 12:13:41 AM, Ricky Zhou wrote: Hey, I think we might have found a bug in the mirror crawler where it did not do the repomd sha256sum check if a mirror is checked via FTP. I think the crawler might still need a good bit of cleanup apart from this, but here is an initial attempt

Re: MirrorManager crawler patch

2009-07-19 Thread Ricky Zhou
On 2009-07-20 12:28:34 AM, Ricky Zhou wrote: I just took a closer look at this with Matt, and it turns out that my extra code in this patch shouldn't be necessary (and in fact, doesn't seem to run at all). I'm going to look at testing this more on another outdated site. Hi, Matt and I just