Re: distfiles cleaner

2015-10-19 Thread Jeffrey Bouquet via freebsd-ports


On 10/19/2015 16:41, Julian H. Stacey wrote:
> Bryan Drewery wrote
> 
>> I could go on, but really I think both are pretty bad compared to using
>> Poudriere, which also has a 'distclean' sub-command.
> OK, Thanks for all detail.  I would have run a poudriere to compare
> with the previous 3, but I've just removed my last copy of my 58
> Gig. But I note: one more reason to learn poudriere :-)
>
> Cheers,
> Julian

Just to add to the portmaster V portupgrade ... I recall fondly the
MOVED portmanager.  (binary code).  It had an initial check-dependency
run one could cntl-c out of and have onscreen to update just a few
ports...  and fixed ports often where the others failed for some
reason.

[I tried coding some local variances to portmaster here, but got
lost in the code...]

I read about poudriere daily almost on the ports list, and wish [1] that
before
I use it someone (if ever, not likely  to use it as of now,  not enough
machines) puts together a flowchart of its use cases, edge cases, etc
large enough to preclude reading forum threads or mailing lists...

[1] not for my benefit, but something I could write about in emails...
___
freebsd-ports@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"


Re: distfiles cleaner

2015-10-19 Thread Julian H. Stacey
Bryan Drewery wrote

> I could go on, but really I think both are pretty bad compared to using
> Poudriere, which also has a 'distclean' sub-command.

OK, Thanks for all detail.  I would have run a poudriere to compare
with the previous 3, but I've just removed my last copy of my 58
Gig. But I note: one more reason to learn poudriere :-)

Cheers,
Julian
--
Julian Stacey,  BSD Linux Unix Sys. Eng. Consultant Munich http://berklix.com
 Reply After previous text to preserve context, as in a play script.
 Indent previous text with >Insert new lines before 80 chars.
 Use plain text, Not quoted-printable, Not HTML, Not base64, Not MS.doc.
___
freebsd-ports@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"


Re: distfiles cleaner

2015-10-19 Thread Bryan Drewery
On 10/19/15 3:57 PM, Julian H. Stacey wrote:
> Hi, Reference:
>> From:RW via freebsd-ports 
>> Date:Mon, 19 Oct 2015 14:56:11 +0100
> 
> RW via freebsd-ports wrote:
>> On Mon, 19 Oct 2015 14:16:37 +0200
>> Julian H. Stacey wrote:
>>
>>> Hi ports@
>>> What is the modern equivalent of this obsolete stuff please ?
>>>
>>> http://www.freebsd.org/cgi/man.cgi?query=portsclean&sektion=1&apropos=0&manpath=FreeBSD+9.0-RELEASE+and+Ports
>>> portsclean --distclean
>>> Clean out all the distfiles that are not referenced by any
>>> port in the ports tree.
>>>
>>> https://wiki.freebsd.org/portupgrade
>>> Portupgrade (aka pkgtools)
>>> last edited 2012-08-01
>>
>> Why are you looking at the wiki?
> 
> I didnt know what tool to look for so a search engine took me to the wiki.
> 
>> The code was updated only a few months
>> ago?

The wiki seems generally fine to me but I didn't read details.

> 
> Err ? moved from wiki to which ports/ ?
> Wiki has "It is currently maintained by BryanDrewery "
> So I added to CC. If the wiki is obsolete I suggest it be deleted
> or reduced to point to URL with new code.
> 
>>  https://svnweb.freebsd.org/ports/head/ports-mgmt/portupgrade/
> 
> Thanks.
> 
> [with current]
> cd /usr/ports/ports-mgmt/portupgrade ; make install ; man portupgrade
>   "To clean unreferenced distfiles, working directories and old shared
>  libraries, use portsclean(1)"
> which portsclean  # /usr/local/sbin/portsclean
> pkg which /usr/local/sbin/portsclean  # portupgrade-2.4.14,2
> pkg info portupgrade-2.4.14,2 | grep Origin   # ports-mgmt/portupgrade
> 
> 
>> I think the case for portupgrade and portsclean is now much stronger
>> than it was before they were fully converted to pkg. That removed all
>> the problems associated with maintaining a secondary database. The
>> conversion to pkg replaced portmaster's best code and portupgrade's
>> worst.
> 
> I'm lost. I presume portupgrade had some bad code,
> replaced by good code from portmaster.

Portupgrade is objectively better.  Having maintained both for quite a
while, I have given up trying to fix the problems in portmaster.

Portupgrade has proper dependency handling, which portmaster does not
(https://github.com/freebsd/portmaster/issues/44 not easily fixable in
portmaster compared to easy to fix in portupgrade).

Portupgrade handles libraries during upgrade so your system is not
totally trashed during upgrade AND it does it in a sane order which
portmaster does not as it removes things on the way down the chain which
can result in basically removing everything while it works back up
(https://github.com/freebsd/portmaster/issues/40)

Portupgrade supports installing from packages, which portmaster does not
(https://github.com/freebsd/portmaster/pull/34 incomplete). [Likely
referenced by OP]

Portupgrade keeps logs.

Portupgrade keeps a db of the INDEX so it can be fast, compared to
portmaster reparsing it.

Portupgrade used to be frowned on for having a 2nd db for tracking
installing ports, but it no longer does. It just queries the pkg db with
'pkg query' now [as referenced by OP].

Portupgrade's biggest problem is still with ruby upgrades.

I could go on, but really I think both are pretty bad compared to using
Poudriere, which also has a 'distclean' sub-command.



-- 
Regards,
Bryan Drewery
___
freebsd-ports@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"


Re: distfiles cleaner

2015-10-19 Thread Julian H. Stacey
Hi, Reference:
> From: RW via freebsd-ports 
> Date: Mon, 19 Oct 2015 14:56:11 +0100

RW via freebsd-ports wrote:
> On Mon, 19 Oct 2015 14:16:37 +0200
> Julian H. Stacey wrote:
> 
> > Hi ports@
> > What is the modern equivalent of this obsolete stuff please ?
> > 
> > http://www.freebsd.org/cgi/man.cgi?query=portsclean&sektion=1&apropos=0&manpath=FreeBSD+9.0-RELEASE+and+Ports
> > portsclean --distclean
> > Clean out all the distfiles that are not referenced by any
> > port in the ports tree.
> > 
> > https://wiki.freebsd.org/portupgrade
> > Portupgrade (aka pkgtools)
> > last edited 2012-08-01
> 
> Why are you looking at the wiki?

I didnt know what tool to look for so a search engine took me to the wiki.

> The code was updated only a few months
> ago?

Err ? moved from wiki to which ports/ ?
Wiki has "It is currently maintained by BryanDrewery "
So I added to CC. If the wiki is obsolete I suggest it be deleted
or reduced to point to URL with new code.

>  https://svnweb.freebsd.org/ports/head/ports-mgmt/portupgrade/

Thanks.

[with current]
cd /usr/ports/ports-mgmt/portupgrade ; make install ; man portupgrade
"To clean unreferenced distfiles, working directories and old shared
 libraries, use portsclean(1)"
which portsclean# /usr/local/sbin/portsclean
pkg which /usr/local/sbin/portsclean# portupgrade-2.4.14,2
pkg info portupgrade-2.4.14,2 | grep Origin # ports-mgmt/portupgrade


> I think the case for portupgrade and portsclean is now much stronger
> than it was before they were fully converted to pkg. That removed all
> the problems associated with maintaining a secondary database. The
> conversion to pkg replaced portmaster's best code and portupgrade's
> worst.

I'm lost. I presume portupgrade had some bad code,
replaced by good code from portmaster.

> BTW I recently switched from distviper to portsclean. I used to prefer
> distviper because of its speed, but that speed comes from assuming that
> all distinfo files are called distinfo, which isn't true. I found
> it was unconditionally removing the files for linux ports. 

Yes, confirmed below, distviper removed a great swathe of
rpm/i386/fedora/10/
rpm/i686/centos/6.6/

> It's also
> never been converted to pkg which breaks its fast mode.  

Cloning my 58G current distfiles to test each method I found:

PORTS/  EXECUTABLE  DISTFILES GIG
sysutils/bsdadminscripts 
distviper   # 4.185918

ports-mgmt/portmaster
portmaster -t -y --clean-distfiles  # 4.231094

ports-mgmt/portupgrade
portsclean --distclean  # 4.078680

portsclean removed 50 files that portmaster did not, so I guess portmaster
may be best/ most conservative. A sample of 1 deletion by portsclean:
./subversion18/subversion-1.8.14.tar.bz2
from devel/subversion18 (not something Ive just built or fetched BTW)

I ran find on all 3 stripped distfiles/ +
diff current.portsclean current.portmaster > cleanmaster.diff
wc -l *
100 cleanmaster.diff
751 current.distviper
837 current.portmaster
783 current.portsclean
All here for next few days in case of interest:
http://berklix.com/~jhs/tmp/distfile_lists/

Thanks Lars, Kubilay, RW.

Cheers,
Julian
--
Julian Stacey,  BSD Linux Unix Sys. Eng. Consultant Munich http://berklix.com
 Reply After previous text to preserve context, as in a play script.
 Indent previous text with >Insert new lines before 80 chars.
 Use plain text, Not quoted-printable, Not HTML, Not base64, Not MS.doc.
___
freebsd-ports@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"


Re: distfiles cleaner

2015-10-19 Thread RW via freebsd-ports
On Mon, 19 Oct 2015 14:16:37 +0200
Julian H. Stacey wrote:

> Hi ports@
> What is the modern equivalent of this obsolete stuff please ?
> 
> http://www.freebsd.org/cgi/man.cgi?query=portsclean&sektion=1&apropos=0&manpath=FreeBSD+9.0-RELEASE+and+Ports
>   portsclean --distclean
>   Clean out all the distfiles that are not referenced by any
>   port in the ports tree.
> 
> https://wiki.freebsd.org/portupgrade
>   Portupgrade (aka pkgtools)
>   last edited 2012-08-01

Why are you looking at the wiki? The code was updated only a few months
ago?

 https://svnweb.freebsd.org/ports/head/ports-mgmt/portupgrade/

I think the case for portupgrade and portsclean is now much stronger
than it was before they were fully converted to pkg. That removed all
the problems associated with maintaining a secondary database. The
conversion to pkg replaced portmaster's best code and portupgrade's
worst.


BTW I recently switched from distviper to portsclean. I used to prefer
distviper because of its speed, but that speed comes from assuming that
all distinfo files are called distinfo, which isn't true. I found
it was unconditionally removing the files for linux ports. It's also
never been converted to pkg which breaks its fast mode.  
___
freebsd-ports@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"


Re: distfiles cleaner

2015-10-19 Thread Julian H. Stacey
Hi, Reference:
> From: Kubilay Kocak 

Kubilay Kocak wrote:
> On 19/10/2015 11:16 PM, Julian H. Stacey wrote:
> > Hi ports@
> > What is the modern equivalent of this obsolete stuff please ?
> > 
> > http://www.freebsd.org/cgi/man.cgi?query=portsclean&sektion=1&apropos=0&manpath=FreeBSD+9.0-RELEASE+and+Ports
> > portsclean --distclean
> > Clean out all the distfiles that are not referenced by any
> > port in the ports tree.
> > 
> > https://wiki.freebsd.org/portupgrade
> > Portupgrade (aka pkgtools)
> > last edited 2012-08-01
> > 
> > Cheers,
> > Julian
> > 
> 
> Also, portmaster(8) has --clean-distfiles, and --clean-packages for
> stale packages

Thanks, just installed ports-mgmt/portmaster , so now I have a choice :-)

Cheers,
Julian
--
Julian Stacey,  BSD Linux Unix Sys. Eng. Consultant Munich http://berklix.com
 Reply After previous text to preserve context, as in a play script.
 Indent previous text with >Insert new lines before 80 chars.
 Use plain text, Not quoted-printable, Not HTML, Not base64, Not MS.doc.
___
freebsd-ports@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"


Re: distfiles cleaner

2015-10-19 Thread Julian H. Stacey
Lars Engels wrote:
> On Mon, Oct 19, 2015 at 02:16:37PM +0200, Julian H. Stacey wrote:
> > Hi ports@
> > What is the modern equivalent of this obsolete stuff please ?
> >=20
> > http://www.freebsd.org/cgi/man.cgi?query=3Dportsclean&sektion=3D1&apropos=
> =3D0&manpath=3DFreeBSD+9.0-RELEASE+and+Ports
> > portsclean --distclean
> > Clean out all the distfiles that are not referenced by any
> > port in the ports tree.
> >=20
> > https://wiki.freebsd.org/portupgrade
> > Portupgrade (aka pkgtools)
> > last edited 2012-08-01
> 
> Try distviper from sysutils/bsdadminscripts.

Thanks Lars, 
Just installed,
Now copying my 58 G of current distfiles before trying.

Cheers,
Julian
--
Julian Stacey,  BSD Linux Unix Sys. Eng. Consultant Munich http://berklix.com
 Reply After previous text to preserve context, as in a play script.
 Indent previous text with >Insert new lines before 80 chars.
 Use plain text, Not quoted-printable, Not HTML, Not base64, Not MS.doc.
___
freebsd-ports@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"


Re: distfiles cleaner

2015-10-19 Thread Kubilay Kocak
On 19/10/2015 11:16 PM, Julian H. Stacey wrote:
> Hi ports@
> What is the modern equivalent of this obsolete stuff please ?
> 
> http://www.freebsd.org/cgi/man.cgi?query=portsclean&sektion=1&apropos=0&manpath=FreeBSD+9.0-RELEASE+and+Ports
>   portsclean --distclean
>   Clean out all the distfiles that are not referenced by any
>   port in the ports tree.
> 
> https://wiki.freebsd.org/portupgrade
>   Portupgrade (aka pkgtools)
>   last edited 2012-08-01
> 
> Cheers,
> Julian
> 

Also, portmaster(8) has --clean-distfiles, and --clean-packages for
stale packages
___
freebsd-ports@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"


Re: distfiles cleaner

2015-10-19 Thread Lars Engels
On Mon, Oct 19, 2015 at 02:16:37PM +0200, Julian H. Stacey wrote:
> Hi ports@
> What is the modern equivalent of this obsolete stuff please ?
> 
> http://www.freebsd.org/cgi/man.cgi?query=portsclean&sektion=1&apropos=0&manpath=FreeBSD+9.0-RELEASE+and+Ports
>   portsclean --distclean
>   Clean out all the distfiles that are not referenced by any
>   port in the ports tree.
> 
> https://wiki.freebsd.org/portupgrade
>   Portupgrade (aka pkgtools)
>   last edited 2012-08-01

Try distviper from sysutils/bsdadminscripts.


pgpK3VsjPGPwL.pgp
Description: PGP signature


distfiles cleaner

2015-10-19 Thread Julian H. Stacey
Hi ports@
What is the modern equivalent of this obsolete stuff please ?

http://www.freebsd.org/cgi/man.cgi?query=portsclean&sektion=1&apropos=0&manpath=FreeBSD+9.0-RELEASE+and+Ports
portsclean --distclean
Clean out all the distfiles that are not referenced by any
port in the ports tree.

https://wiki.freebsd.org/portupgrade
Portupgrade (aka pkgtools)
last edited 2012-08-01

Cheers,
Julian
-- 
Julian Stacey,  BSD Linux Unix Sys. Eng. Consultant Munich http://berklix.com
 Reply After previous text to preserve context, as in a play script.
 Indent previous text with >Insert new lines before 80 chars.
 Use plain text, Not quoted-printable, Not HTML, Not base64, Not MS.doc.
___
freebsd-ports@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscr...@freebsd.org"