Re: [Catalog-sig] Time for a static cheeseshop mirror for easy_install?

2007-04-09 Thread Phillip J. Eby
At 11:35 AM 4/9/2007 -0400, Jim Fulton wrote: >On Apr 9, 2007, at 11:32 AM, Martin v. Löwis wrote: > > > Jim Fulton schrieb: > >> On Apr 9, 2007, at 10:46 AM, A.M. Kuchling wrote: > >> ... > >>> Right now people could mirror > >>> http://cheeseshop.python.org/packages/, but there's nothing there

Re: [Catalog-sig] [Distutils] Time for a static cheeseshop mirror for easy_install?

2007-04-09 Thread Phillip J. Eby
At 10:46 AM 4/9/2007 -0400, A.M. Kuchling wrote: >On Sat, Apr 07, 2007 at 12:44:56PM -0400, Phillip J. Eby wrote: > > I don't know whether this will actually solve any problems the cheeseshop > > itself is having; it may be that ill-behaved web spiders are at fault, or > > something else altogether

Re: [Catalog-sig] Full package list

2007-04-09 Thread Phillip J. Eby
At 07:21 PM 4/9/2007 +0200, Martin v. Löwis wrote: >Jeremy Kloth schrieb: > > On Monday 09 April 2007 6:36:53 am Martin v. Löwis wrote: > >> With the browse pages hidden from spiders, the search engines > >> cannot find out the complete list of packages anymore (AFAICT). > >> > >> Would it be usefu

Re: [Catalog-sig] Performing exact matches in Cheeseshop URLs

2007-04-09 Thread Phillip J. Eby
At 09:42 PM 4/9/2007 +1000, Richard Jones wrote: >On Mon, 9 Apr 2007, Martin v. Löwis wrote: > > Currently, an URL like > > > > http://cheeseshop.python.org/pypi/PyXML > > > > will match all packages that have PyXML in their name. > > > > Should that be changed to only listing packages which > > ha

Re: [Catalog-sig] Flamenco queries

2007-04-09 Thread Phillip J. Eby
At 12:00 PM 4/9/2007 +0200, Martin v. Löwis wrote: > > Perhaps this? > > > > select rc.trove_id, count(*) > > from releases r, release_classifiers rc > > where r.name=rc.name and r.version=rc.version > >and r._pypi_hidden=FALSE > > group by rc.trove_id > >This did work indeed (although it wa

Re: [Catalog-sig] Full package list

2007-04-09 Thread Martin v. Löwis
Jeremy Kloth schrieb: > On Monday 09 April 2007 6:36:53 am Martin v. Löwis wrote: >> With the browse pages hidden from spiders, the search engines >> cannot find out the complete list of packages anymore (AFAICT). >> >> Would it be useful to have a page with just the names of all >> packages, linki

Re: [Catalog-sig] Full package list

2007-04-09 Thread Jeremy Kloth
On Monday 09 April 2007 6:36:53 am Martin v. Löwis wrote: > With the browse pages hidden from spiders, the search engines > cannot find out the complete list of packages anymore (AFAICT). > > Would it be useful to have a page with just the names of all > packages, linking to pypi/? It could go into

Re: [Catalog-sig] [Distutils] Time for a static cheeseshop mirror for easy_install?

2007-04-09 Thread Matt Good
On Sat, 2007-04-07 at 12:44 -0400, Phillip J. Eby wrote: > For what easy_install does, there really isn't any dynamic API usage, so a > static mirror for easy_install could take a good bit of load off the > cheeseshop. Jon Rosebaugh (aka Chairos) actually started working on this a couple days ag

Re: [Catalog-sig] Time for a static cheeseshop mirror for easy_install?

2007-04-09 Thread Jim Fulton
On Apr 9, 2007, at 11:32 AM, Martin v. Löwis wrote: > Jim Fulton schrieb: >> On Apr 9, 2007, at 10:46 AM, A.M. Kuchling wrote: >> ... >>> Right now people could mirror >>> http://cheeseshop.python.org/packages/, but there's nothing there >>> for >>> easy_install >> >> Is there any reason why

Re: [Catalog-sig] Time for a static cheeseshop mirror for easy_install?

2007-04-09 Thread Martin v. Löwis
Jim Fulton schrieb: > On Apr 9, 2007, at 10:46 AM, A.M. Kuchling wrote: > ... >> Right now people could mirror >> http://cheeseshop.python.org/packages/, but there's nothing there for >> easy_install > > Is there any reason why easy_install shouldn't look there? It's only files, no descriptions

Re: [Catalog-sig] Time for a static cheeseshop mirror for easy_install?

2007-04-09 Thread Jim Fulton
On Apr 9, 2007, at 10:46 AM, A.M. Kuchling wrote: ... > Right now people could mirror > http://cheeseshop.python.org/packages/, but there's nothing there for > easy_install Is there any reason why easy_install shouldn't look there? Jim -- Jim Fulton mailto:[EMAIL PROTECTE

Re: [Catalog-sig] Time for a static cheeseshop mirror for easy_install?

2007-04-09 Thread A.M. Kuchling
On Sat, Apr 07, 2007 at 12:44:56PM -0400, Phillip J. Eby wrote: > I don't know whether this will actually solve any problems the cheeseshop > itself is having; it may be that ill-behaved web spiders are at fault, or > something else altogether. In this recent case, two different spiders were c

[Catalog-sig] Full package list

2007-04-09 Thread Martin v. Löwis
With the browse pages hidden from spiders, the search engines cannot find out the complete list of packages anymore (AFAICT). Would it be useful to have a page with just the names of all packages, linking to pypi/? It could go into the navigation bar, below "List trove classifiers". Regards, Mart

Re: [Catalog-sig] Performing exact matches in Cheeseshop URLs

2007-04-09 Thread Martin v. Löwis
> Currently the EasyInstall doc says "Individual project version pages' URLs > must be of the form base/projectname/version, where base is the package > index's base URL." Ok, I have changed it in r444. The original search semantics of that is still available in /pypi?:action=index&name=PyXML

Re: [Catalog-sig] Performing exact matches in Cheeseshop URLs

2007-04-09 Thread Richard Jones
On Mon, 9 Apr 2007, Martin v. Löwis wrote: > Currently, an URL like > > http://cheeseshop.python.org/pypi/PyXML > > will match all packages that have PyXML in their name. > > Should that be changed to only listing packages which > have PyXML as their exact name? (it would still give > two entries,

[Catalog-sig] Performing exact matches in Cheeseshop URLs

2007-04-09 Thread Martin v. Löwis
Currently, an URL like http://cheeseshop.python.org/pypi/PyXML will match all packages that have PyXML in their name. Should that be changed to only listing packages which have PyXML as their exact name? (it would still give two entries, as there are two visible releases of that package). Regar

Re: [Catalog-sig] Flamenco queries

2007-04-09 Thread Martin v. Löwis
> Perhaps this? > > select rc.trove_id, count(*) > from releases r, release_classifiers rc > where r.name=rc.name and r.version=rc.version >and r._pypi_hidden=FALSE > group by rc.trove_id This did work indeed (although it was slower than when doing the counting in Python...) I found that