On 01/ 8/10 12:00 PM, Fr?d?ric VANNIERE wrote:
>> On 01/ 8/10 10:26 AM, Fr?d?ric VANNIERE wrote:
>
>> A mirror only contains package files, not package
>> metadata.  As a
>> result, all package metadata would have to be
>> retrieved from
>> pkg.opensolaris.org while the package files should
>> primarily be
>> retrieved from your mirror.
>
> In a normal situation, IPS should download 1 manifest file per package on 
> opensolaris.org and many compressed files from the mirror.

That's basically correct.

>> How did you create this mirror?
>
> It's a very simple apache proxy with disk cache.

Ah, I see.  While a few individuals have reported success with using an 
web proxy cache, that's not something that has been tested yet, so 
perhaps you've run into a subtle issue with that particular configuration.

Support for using web proxy caches was only recently added, and it only 
works for specific operations (manifest, file, catalog).

>>> The worst bug is that all files are downloaded
>> twice from the repository, also, the files
>> /dev/catalog/1/catalog.attrs and /dev/versions/0/ are
>> fetched 166 times.
>>
>> What leads you to believe that all of the files are
>> downloaded twice  from the repository?
>
> Sorry, I'm wrong for this, I've made the installation on Virtualbox and 
> captured the traffic from host. The guest traffic is seen twice but there is 
> only one request per file. The remaining issue is that IPS doesn't alway use 
> the mirror for package files.

Yes, it may not always use the mirror, and that wouldn't be a bug. 
However, it may not be using the mirror as often as it could or should.

However, when you say package files, are you talking about /file/0/ 
requests?

When you're analysing the traffic, are you ensuring that you are only 
tracking requests made to your local Apache proxy and ignoring requests 
that the proxy might make itself to pkg.opensolaris.org?

>> I'm also confused as to how many servers these
>> numbers are based off of.
>> Are these just numbers from an install of a single
>>   server?
>
> So, they are 150 packages and 20k files downloaded for a single server 
> install.

150 package is the number of packages listed by 'pkg list' after an install?

Another thing that might be contributing to this is how AI is performing 
the installs.

Can you provide the full install log?

-- 
Shawn Walker

Reply via email to