I'm trying to mirror the simple index (just the index, not the referenced files) in order to do some queries on package availability. I was planning on doing a simple "wget --timestamping --recursive --level=1" but when I do, everything seems to be downloaded each time.
Does PyPI not set the last modified date on the index files? If I try wget -S it looks like the last modified date is always now. Is this caused by the CDN, or is it how PyPI works? Assuming last-modified *is* inaccurate, is there any other way of doing an incremental mirror of the simple index? Paul _______________________________________________ Distutils-SIG maillist - Distutils-SIG@python.org https://mail.python.org/mailman/listinfo/distutils-sig
