suboptimal fetch behavior [was: No valid mirrors for mysql56?

2013-07-17 Thread John Marino
On 7/18/2013 01:29, John Marshall wrote:
>> Seems odd that the ports system wouldn't catch this and delete
>> the bad original before trying to re-download or forcing an overwrite
>> on download.
> 
> So, the tarball had changed since the last time you downloaded it (using
> an earlier version of the port).  The ports system did catch it and
> complain that your downloaded tarball didn't match the (new) expected
> tarball for the same release, but the ports system didn't assume
> responsibility for deleting the existing file.

This behavior has personally burned me numerous times.  As I am often
building the entire tree, this behavior not only causes false positives
on bad builds, but it prevents all the ports that depend on it from
building as well which hurts builds meant to produce official packages.

I think the behavior is sub-optimal and needs to be improved.  Something
along the lines of downloading it to a temporary file, and if that file
matches the hash then replacing the current distfile with new one.

Yeah, I definitely think this should be looked at.

The other thing: This doesn't affect pkgsrc often because when a package
gets rerolled they immediately switch to a unique SUBDIR scheme so that
the new distfile never clashes with the old one.  That's a policy change
on how to handle re-rolls but it does work.

John
___
freebsd-ports@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"


Re: No valid mirrors for mysql56?

2013-07-17 Thread John Marshall
On Thu, 18 Jul 2013, 00:09 +0100, Steven Hartland wrote:
> Seems for some reason mysql-5.6.12.tar.gz has changed sizes
> and checksums since I last downloaded and after updating ports
> from svn it was expecting a new version of the file without a change
> in filename, hence the issue.

 - The 5.6.12 tarball was re-rolled, so the size and checksum changed
 - The FreeBSD port's distinfo file was updated to reflect that change

   
   r322075 | ale | 2013-06-30 19:05:03 +1000 (Sun, 30 Jun 2013) | 4 lines
   
   Distfile rerolled to make it clearer the license of this
   community edition (GPLv2).
   Restore readline patch.
   
   
   Index: distinfo
   ===
   --- distinfo (revision 322074)
   +++ distinfo (revision 322075)
   @@ -1,2 +1,2 @@
   -SHA256 (mysql-5.6.12.tar.gz) = 
1153c1e0ae94116c150be5f173c336a80471b5ed4642a682b8462d36d54d5817
   -SIZE (mysql-5.6.12.tar.gz) = 35876046
   +SHA256 (mysql-5.6.12.tar.gz) = 
7911af0180c8014b9193bde42b6b705460fa70bf75681b62c64d1cf2580686bc
   +SIZE (mysql-5.6.12.tar.gz) = 35853760
   
   

> Seems odd that the ports system wouldn't catch this and delete
> the bad original before trying to re-download or forcing an overwrite
> on download.

So, the tarball had changed since the last time you downloaded it (using
an earlier version of the port).  The ports system did catch it and
complain that your downloaded tarball didn't match the (new) expected
tarball for the same release, but the ports system didn't assume
responsibility for deleting the existing file.

-- 
John Marshall


pgpo6VCGAoRA6.pgp
Description: PGP signature


Re: No valid mirrors for mysql56?

2013-07-17 Thread Steven Hartland
- Original Message - 
From: "John Marshall" 

..

=> Couldn't fetch it - please try to retrieve this
=> port manually into /usr/ports/distfiles/ and try again.
*** Error code 1


So the problem is not that it isn't available, the problem is that the
software you're using won't fetch it.

Delete (or rename) the existing copy from /usr/ports/distfiles and try
again.


Good catch, I spotted the file size difference error but assumed this
was moaning about the new copy it was downloading and not an
existing copy.

Seems for some reason mysql-5.6.12.tar.gz has changed sizes
and checksums since I last downloaded and after updating ports
from svn it was expecting a new version of the file without a change
in filename, hence the issue.

Seems odd that the ports system wouldn't catch this and delete
the bad original before trying to re-download or forcing an overwrite
on download.

   Regards
   Steve


This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. 


In the event of misdirection, illegible or incomplete transmission please 
telephone +44 845 868 1337
or return the E.mail to postmas...@multiplay.co.uk.

___
freebsd-ports@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"


Re: No valid mirrors for mysql56?

2013-07-17 Thread John Marshall
On 17/07/2013 23:58, Steven Hartland wrote:
> Seems there are currently no valid mirrors for the mysql56 port:-
> 
> 
> ===> Fetching all distfiles required by mysql-server-5.6.12 for building
> ===>  Extracting for mysql-server-5.6.12
> => SHA256 Checksum mismatch for mysql-5.6.12.tar.gz.
> ===>  Refetch for 1 more times files: mysql-5.6.12.tar.gz

You already have a copy of mysql-5.6.12.tar.gz but its size/checksum
doesn't match the distinfo specification in the port, so the port is
trying to "Refetch".

> => mysql-5.6.12.tar.gz doesn't seem to exist in /usr/ports/distfiles/.

> => Attempting to fetch
> ftp://ftp.gwdg.de/pub/misc/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
> fetch: mysql-5.6.12.tar.gz: local file (35876046 bytes) is longer than
> remote file (35853760 bytes)

The fetch from this site baulked at the size difference.

> => Attempting to fetch
> ftp://ftp.ntua.gr/pub/databases/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
> 
> fetch: mysql-5.6.12.tar.gz: local file (35876046 bytes) is longer than
> remote file (35853760 bytes)

So did this.

> => Attempting to fetch
> ftp://mirror.switch.ch/mirror/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
> fetch: mysql-5.6.12.tar.gz: local file (35876046 bytes) is longer than
> remote file (35853760 bytes)

and this.

> => Attempting to fetch
> http://download.softagency.net/MySQL/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
> 
> fetch: mysql-5.6.12.tar.gz: local file (35876046 bytes) is longer than
> remote file (35853760 bytes)
> => Attempting to fetch
> ftp://ftp.FreeBSD.org/pub/FreeBSD/ports/distfiles/mysql-5.6.12.tar.gz
> fetch:
> ftp://ftp.FreeBSD.org/pub/FreeBSD/ports/distfiles/mysql-5.6.12.tar.gz:
> size mismatch: expected 35853760, actual 35876046

and these,

> => Couldn't fetch it - please try to retrieve this
> => port manually into /usr/ports/distfiles/ and try again.
> *** Error code 1

So the problem is not that it isn't available, the problem is that the
software you're using won't fetch it.

Delete (or rename) the existing copy from /usr/ports/distfiles and try
again.

-- 
John Marshall



signature.asc
Description: OpenPGP digital signature


Re: No valid mirrors for mysql56?

2013-07-17 Thread Rodrigo OSORIO
On 17/07/13 14:58 +0100, Steven Hartland wrote:
> Seems there are currently no valid mirrors for the mysql56 port:-
> 
> 
> ===> Fetching all distfiles required by mysql-server-5.6.12 for building
> ===>  Extracting for mysql-server-5.6.12
> => SHA256 Checksum mismatch for mysql-5.6.12.tar.gz.
> ===>  Refetch for 1 more times files: mysql-5.6.12.tar.gz
> => mysql-5.6.12.tar.gz doesn't seem to exist in /usr/ports/distfiles/.
> => Attempting to fetch 

> ftp://ftp.fi.muni.cz/pub/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
Works

> ftp://ftp.fi.muni.cz/pub/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: 
works

> http://mysql.mirrors.cybercity.dk/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
TO

> http://mysql.mirrors.cybercity.dk/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: 
TO

> ftp://ftp.fh-wolfenbuettel.de/pub/database/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
Works

> ftp://ftp.fh-wolfenbuettel.de/pub/database/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz:
>  Unknown FTP error
works

> ftp://ftp.gwdg.de/pub/misc/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
works

I think this a local/temporary failure. maybe you should try it again.

- regards
___
freebsd-ports@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"


No valid mirrors for mysql56?

2013-07-17 Thread Steven Hartland

Seems there are currently no valid mirrors for the mysql56 port:-


===> Fetching all distfiles required by mysql-server-5.6.12 for building
===>  Extracting for mysql-server-5.6.12
=> SHA256 Checksum mismatch for mysql-5.6.12.tar.gz.
===>  Refetch for 1 more times files: mysql-5.6.12.tar.gz
=> mysql-5.6.12.tar.gz doesn't seem to exist in /usr/ports/distfiles/.
=> Attempting to fetch 
ftp://ftp.fi.muni.cz/pub/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: ftp://ftp.fi.muni.cz/pub/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: 
Unknown FTP error
=> Attempting to fetch 
http://mysql.mirrors.cybercity.dk/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: 
http://mysql.mirrors.cybercity.dk/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: No 
route to host
=> Attempting to fetch 
ftp://ftp.fh-wolfenbuettel.de/pub/database/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: 
ftp://ftp.fh-wolfenbuettel.de/pub/database/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz:
 Unknown FTP error
=> Attempting to fetch 
ftp://ftp.gwdg.de/pub/misc/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: mysql-5.6.12.tar.gz: local file (35876046 bytes) is longer than remote 
file (35853760 bytes)
=> Attempting to fetch 
http://netmirror.org/mirror/mysql.com/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: 
http://netmirror.org/mirror/mysql.com/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: 
Not Found
=> Attempting to fetch 
ftp://netmirror.org/mysql.com/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: ftp://netmirror.org/mysql.com/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: 
Protocol error
=> Attempting to fetch 
http://mirrors.ntua.gr/MySQL/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: http://mirrors.ntua.gr/MySQL/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: 
Requested Range Not Satisfiable
=> Attempting to fetch 
ftp://ftp.ntua.gr/pub/databases/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: mysql-5.6.12.tar.gz: local file (35876046 bytes) is longer than remote 
file (35853760 bytes)
=> Attempting to fetch 
http://mysql.sote.hu/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: http://mysql.sote.hu/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: No address 
record
=> Attempting to fetch 
ftp://ftp.rhnet.is/pub/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: ftp://ftp.rhnet.is/pub/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: 
File unavailable (e.g., file not found, no access)
=> Attempting to fetch 
ftp://mirror.widexs.nl/pub/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: ftp://mirror.widexs.nl/pub/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: File unavailable (e.g., file not found, no 
access)

=> Attempting to fetch 
ftp://mirror.switch.ch/mirror/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: mysql-5.6.12.tar.gz: local file (35876046 bytes) is longer than remote 
file (35853760 bytes)
=> Attempting to fetch 
http://mysql.dp.ua/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: http://mysql.dp.ua/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: Not Found
=> Attempting to fetch 
http://mysql.mirrored.ca/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: http://mysql.mirrored.ca/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: size 
mismatch: expected 35853760, actual 51
=> Attempting to fetch 
ftp://mirror.services.wisc.edu/mirrors/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: 
ftp://mirror.services.wisc.edu/mirrors/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz:
 No address record
=> Attempting to fetch 
http://mysql.mirrors.pair.com/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: http://mysql.mirrors.pair.com/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: 
Requested Range Not Satisfiable
=> Attempting to fetch 
ftp://ftp.linorg.usp.br/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: ftp://ftp.linorg.usp.br/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: 
No address record
=> Attempting to fetch 
ftp://ftp.cbn.net.id/mirror/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: ftp://ftp.cbn.net.id/mirror/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: File unavailable (e.g., file not found, no 
access)

=> Attempting to fetch 
ftp://ftp.easynet.be/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: ftp://ftp.easynet.be/mysql/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz: 
Unknown FTP error
=> Attempting to fetch 
http://download.softagency.net/MySQL/Downloads/MySQL-5.6/mysql-5.6.12.tar.gz
fetch: mysql-5.6.12.tar.gz: local file (35876046 bytes) is longer than remote 
file (35853760 bytes)
=> Attempting to fetch 
ftp://ftp.FreeBSD.org/pub/FreeBSD/ports/distfiles/mysql-5.6.12.tar.gz
fetch: ftp://ftp.FreeBSD.org/pub/FreeBSD/ports/distfiles/mysql-5.6.12.tar.gz: 
size mismatch: expected 35853760, actual 35876046
=> Couldn't fetch it - please try to retrieve this
=> port manually into /usr/ports/distfiles/ and try again.
*** Error code 1

Stop in /usr/ports/databases/mysql56-server.
*** Error code 1

Stop in /usr/ports/databases/mysql56-server.

   Regards
   Steve 


___
freebsd-ports@freebsd.org mailing list
http://lists.freeb