Fwd: Re: [gentoo-user] emerge sync taking forever
---BeginMessage--- Actually, read through this article. It seems to indicate that the portage system will not be running any quicker any time soon. http://www.uwyn.com/resources/gentoo_departure.html On Wednesday 30 July 2003 01:08, Marius Mauch wrote: On 07/29/03 Fred Van Andel wrote: Marius Mauch [EMAIL PROTECTED] wrote: (07/29/2003 15:08) On 07/29/03 daniel wrote: On July 29, 2003 04:48 pm, Marius Mauch wrote: The better way would be to rewrite portage with a modular approach, so it can use different backends (the current code is not very friendly for that). But that needs a lot of time. alright then, i have some (not much, but some time). what languages do i need to know? like i said earlier, i'm just a webgeek (perl/php/mysql) but i'm willing to dive into python if it means getting a more robust portage. No one is currently working on that and AFAIK there are no plans for a portage rewrite in the near future, so it's hard to say what languages will be needed for that. Most likely are C/C++ or Python, but that's just my opinion. Someone did write a db back end and posted it to bugzilla. Carpaski was looking at it but I dont know if anything actually came from it. I suggest you actually discuss this with carpaski before you attempt a rewrite, you might just save yourself some grief. Sure, I'm not attempting to do any coding right now without any planning and discussing. This is only a long term idea for now. Marius -- [EMAIL PROTECTED] mailing list -- Henry Kleynhans [EMAIL PROTECTED] ---End Message--- -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
Bering wrote:
Collins Richey wrote:
On Tue, 29 Jul 2003 14:32:59 -0400
daniel [EMAIL PROTECTED] wrote:
On July 29, 2003 01:50 pm, Dhruba Bandopadhyay wrote:
Emerge sync was never really 'quick' as such. A lot of files
(~5) files get updated each time including cache during the
'hang' that you mention.
so what're the chances that portage might be switching to a more
robust database-driven setup?
My $.02. I don't need to sync hourly, so it's no big deal. I'd rather
see time spent on making portage more robust.
Agreed! Just put emerge sync in a cron job or during the night, and
you'll never know how much time it took ;) Like you did with emerge
xfree... and kde.. gnome, etc..
Yes. That is what I do. Here's what I use in /etc/cron.daily/sync.cron.
#!/bin/bash
DIR=/tmp/portage
LOG=$DIR/updates.log
HOST=$(hostname | awk -F. '{print $1}')
SUBJECT=$HOST package updates
EMAIL=[EMAIL PROTECTED]
emerge sync /dev/null
emerge -Duvlp world $LOG
mail -s $SUBJECT $EMAIL $LOG
For this you need SMTP started and mailx emerged. Then even if you have
fixpackages in features it doesn't matter how long it takes.
To be honest, I think mysql to run portage is excessive. Portage at the
moment is quite lightweight and works well with simple text files.
Adding database administration is just going to make debugging and
maintenance more complex and tiresome. Also, other portage todo's may
take priority like reverse dependencies and sticky settings from what I
hear.
--
[EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
Hi Bering, Nachricht vom Mittwoch, 30. Juli 2003, 01:51:04: Agreed! Just put emerge sync in a cron job or during the night, and you'll never know how much time it took ;) I will know, because it will still be running at the morning. With my old laptop (Pentium-75), I sleep less than an emerge sync takes, which is about 10 hours (!). Timo -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
William Hubbs wrote: Hi all, has anyone else noticed that emerge sync is taking a lot longer lately? I have noticed that lately it is taking a lot longer to finish -- After the message Updating portage cache . Done. It just hangs there for a long time then finally exits. I saw a segmentation violation at this point yesterday then reran it and it went ok. Below is my emerge info output. Can anyone shed any light on why portage is suddenly taking what seems like an hour plus to do an emerge sync? Emerge sync was never really 'quick' as such. A lot of files (~5) files get updated each time including cache during the 'hang' that you mention. Unless you have a very fast computer it will take some time. Possible reasons it may be taking longer are if you have FEATURES=fixpackages or if package categories have been modified at the dev end and they are being changed around by portage. -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
On July 29, 2003 01:50 pm, Dhruba Bandopadhyay wrote: Emerge sync was never really 'quick' as such. A lot of files (~5) files get updated each time including cache during the 'hang' that you mention. Unless you have a very fast computer it will take some time. so what're the chances that portage might be switching to a more robust database-driven setup? i'm just a webgeek, but i would think that doing an emergesync and updating the portage cache would be considerably faster if everything were running on mysql or something -- i pray that my son does not die today. but if he should die, i pray that he dies well. but most of all, i pray that if he lives, it will not be dishonour that preserves him. - dornean war-prayer, michael p. kube-mcdowell's shield of lies -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
On 07/29/03 daniel wrote: On July 29, 2003 01:50 pm, Dhruba Bandopadhyay wrote: Emerge sync was never really 'quick' as such. A lot of files (~5) files get updated each time including cache during the 'hang' that you mention. Unless you have a very fast computer it will take some time. so what're the chances that portage might be switching to a more robust database-driven setup? i'm just a webgeek, but i would think that doing an emergesync and updating the portage cache would be considerably faster if everything were running on mysql or something If you are finished with coding it submit it on bugzilla ;-) Marius -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
On Tue, Jul 29, 2003 at 02:32:59PM -0400, daniel wrote: On July 29, 2003 01:50 pm, Dhruba Bandopadhyay wrote: Emerge sync was never really 'quick' as such. A lot of files (~5) files get updated each time including cache during the 'hang' that you mention. Unless you have a very fast computer it will take some time. so what're the chances that portage might be switching to a more robust database-driven setup? i'm just a webgeek, but i would think that doing an emergesync and updating the portage cache would be considerably faster if everything were running on mysql or something True, but then you force everyone who is running gentoo to have a full database as part of the base system, and I don't think that is a good idea. I don't understand the internals of portage very well at all, but there must be a better way of handling it than what we have now without using a full-blown database. William -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
On 07/29/03 William Hubbs wrote: On Tue, Jul 29, 2003 at 02:32:59PM -0400, daniel wrote: On July 29, 2003 01:50 pm, Dhruba Bandopadhyay wrote: Emerge sync was never really 'quick' as such. A lot of files (~5) files get updated each time including cache during the 'hang' that you mention. Unless you have a very fast computer it will take some time. so what're the chances that portage might be switching to a more robust database-driven setup? i'm just a webgeek, but i would think that doing an emergesync and updating the portage cache would be considerably faster if everything were running on mysql or something True, but then you force everyone who is running gentoo to have a full database as part of the base system, and I don't think that is a good idea. I don't understand the internals of portage very well at all, but there must be a better way of handling it than what we have now without using a full-blown database. The better way would be to rewrite portage with a modular approach, so it can use different backends (the current code is not very friendly for that). But that needs a lot of time. Marius -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
It'd be most excellent if portage used a faster database engine... say mysql.. to catalog it's data. On Tuesday 29 July 2003 05:15 pm, daniel wrote: On July 29, 2003 04:48 pm, Marius Mauch wrote: The better way would be to rewrite portage with a modular approach, so it can use different backends (the current code is not very friendly for that). But that needs a lot of time. alright then, i have some (not much, but some time). what languages do i need to know? like i said earlier, i'm just a webgeek (perl/php/mysql) but i'm willing to dive into python if it means getting a more robust portage. -- ** Registered Linux User Number 185956 http://groups.google.com/groups?hl=ensafe=offgroup=linux Join me in chat at #linux-users on irc.freenode.net This email account no longers accepts attachments or messages containing html. 4:42pm up 19 days, 2:40, 4 users, load average: 1.19, 1.46, 1.37 -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
On Tue, 29 Jul 2003 14:32:59 -0400 daniel [EMAIL PROTECTED] wrote: On July 29, 2003 01:50 pm, Dhruba Bandopadhyay wrote: Emerge sync was never really 'quick' as such. A lot of files (~5) files get updated each time including cache during the 'hang' that you mention. so what're the chances that portage might be switching to a more robust database-driven setup? My $.02. I don't need to sync hourly, so it's no big deal. I'd rather see time spent on making portage more robust. -- Collins Richey - Denver Area if you fill your heart with regrets of yesterday and the worries of tomorrow, you have no today to be thankful for. -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
On 07/29/03 daniel wrote: On July 29, 2003 04:48 pm, Marius Mauch wrote: The better way would be to rewrite portage with a modular approach, so it can use different backends (the current code is not very friendly for that). But that needs a lot of time. alright then, i have some (not much, but some time). what languages do i need to know? like i said earlier, i'm just a webgeek (perl/php/mysql) but i'm willing to dive into python if it means getting a more robust portage. No one is currently working on that and AFAIK there are no plans for a portage rewrite in the near future, so it's hard to say what languages will be needed for that. Most likely are C/C++ or Python, but that's just my opinion. Marius -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
Marius Mauch [EMAIL PROTECTED] wrote: (07/29/2003 15:08) On 07/29/03 daniel wrote: On July 29, 2003 04:48 pm, Marius Mauch wrote: The better way would be to rewrite portage with a modular approach, so it can use different backends (the current code is not very friendly for that). But that needs a lot of time. alright then, i have some (not much, but some time). what languages do i need to know? like i said earlier, i'm just a webgeek (perl/php/mysql) but i'm willing to dive into python if it means getting a more robust portage. No one is currently working on that and AFAIK there are no plans for a portage rewrite in the near future, so it's hard to say what languages will be needed for that. Most likely are C/C++ or Python, but that's just my opinion. Someone did write a db back end and posted it to bugzilla. Carpaski was looking at it but I dont know if anything actually came from it. I suggest you actually discuss this with carpaski before you attempt a rewrite, you might just save yourself some grief. Fred Van Andel [EMAIL PROTECTED] GPG KeyID: 76526AD599455482 GPG fingerprint: 64E4 4BAB 9C99 D565 3E3C F5D0 7652 6AD5 9945 5482 -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
On 07/29/03 Fred Van Andel wrote: Marius Mauch [EMAIL PROTECTED] wrote: (07/29/2003 15:08) On 07/29/03 daniel wrote: On July 29, 2003 04:48 pm, Marius Mauch wrote: The better way would be to rewrite portage with a modular approach, so it can use different backends (the current code is not very friendly for that). But that needs a lot of time. alright then, i have some (not much, but some time). what languages do i need to know? like i said earlier, i'm just a webgeek (perl/php/mysql) but i'm willing to dive into python if it means getting a more robust portage. No one is currently working on that and AFAIK there are no plans for a portage rewrite in the near future, so it's hard to say what languages will be needed for that. Most likely are C/C++ or Python, but that's just my opinion. Someone did write a db back end and posted it to bugzilla. Carpaski was looking at it but I dont know if anything actually came from it. I suggest you actually discuss this with carpaski before you attempt a rewrite, you might just save yourself some grief. Sure, I'm not attempting to do any coding right now without any planning and discussing. This is only a long term idea for now. Marius -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
Collins Richey wrote: On Tue, 29 Jul 2003 14:32:59 -0400 daniel [EMAIL PROTECTED] wrote: On July 29, 2003 01:50 pm, Dhruba Bandopadhyay wrote: Emerge sync was never really 'quick' as such. A lot of files (~5) files get updated each time including cache during the 'hang' that you mention. so what're the chances that portage might be switching to a more robust database-driven setup? My $.02. I don't need to sync hourly, so it's no big deal. I'd rather see time spent on making portage more robust. Agreed! Just put emerge sync in a cron job or during the night, and you'll never know how much time it took ;) Like you did with emerge xfree... and kde.. gnome, etc.. -- [EMAIL PROTECTED] mailing list
Re: [gentoo-user] emerge sync taking forever
On Tue, 29 Jul 2003 17:27:28 -0400 Jerry McBride [EMAIL PROTECTED] wrote: It'd be most excellent if portage used a faster database engine... say mysql.. to catalog it's data. I would be all for this, so long as it is optional. I don't want to have mysql running on a firewall say, just to run portage. -- Ian Truelsen Email: [EMAIL PROTECTED] AIM: ihtruelsen Homepage: http://www.ihtruelsen.dyndns.org -- [EMAIL PROTECTED] mailing list
