Re: terrible performance in 6.1beta4

2006-04-08 Thread Joao Barros
On 3/30/06, Kris Kennaway <[EMAIL PROTECTED]> wrote: > Actually I seem to recall that on Linux with default settings fsync() > lies and does not actually sync data before returning, so maybe it's > worth turning off on FreeBSD too if you're comfortable with the > implications of this. > A few mont

Re: terrible performance in 6.1beta4

2006-04-08 Thread Francisco Reyes
Kris Kennaway writes: Well there you go then..you're trying to access a file that is larger than RAM, so naturally you won't be able to fit it all in RAM, and with 1GB less RAM in your system you'll spend much more time reading bits of it from disk and later throwing them away. Not to mention

Re: terrible performance in 6.1beta4

2006-04-03 Thread Norberto Meijome
On Mon, 3 Apr 2006 15:18:02 +0200 [EMAIL PROTECTED] wrote: > Beto, > > i believe he has given up. > :( without knowing WHAT is the problem? > i would say that on a dedicated database machine 50-75% > dedicated(shared) memory is not overkill. of course not. I am not sure I read his vmstat scr

Re: terrible performance in 6.1beta4

2006-04-03 Thread usleepless
i just thought of another possible cause: what is the location of the to-be-imported file? local disk? because if it is on the network, check your NIC if you are running at the maximum rate, nfs buffers, etc ( i was fooled by such a situation once ). regards, usleep On 4/3/06, [EMAIL PROTECTE

Re: terrible performance in 6.1beta4

2006-04-03 Thread usleepless
Beto, i believe he has given up. i would say that on a dedicated database machine 50-75% dedicated(shared) memory is not overkill. wasn't there some other switch which determined wether to page shared-memory out? regards, usleep On 4/3/06, Norberto Meijome <[EMAIL PROTECTED]> wrote: > On Wed,

Re: terrible performance in 6.1beta4

2006-04-03 Thread Norberto Meijome
On Wed, 29 Mar 2006 19:09:26 -0600 Miguel <[EMAIL PROTECTED]> wrote: > Hi, im loading a lot of information to a postgresql 8.1.3 database, > im using the copy command, using the same file and version of > postgres in gentoo it spend a few minutes (~4-5), in freebsd > 6.1-beta4 it has already spent

Re: terrible performance in 6.1beta4

2006-03-31 Thread Miguel
[EMAIL PROTECTED] wrote: Miguel, you are not inserting into an indexed table, are you? yes, i am... is that a problem? it used to be a problem, but since your gentoo box is doing the same task in 4-5 minutes, i doubt it is currently the problem. i seem to recall some speedup

Re: terrible performance in 6.1beta4

2006-03-30 Thread usleepless
Miguel, > >you are not inserting into an indexed table, are you? > > yes, i am... > is that a problem? it used to be a problem, but since your gentoo box is doing the same task in 4-5 minutes, i doubt it is currently the problem. i seem to recall some speedup of the copyin-command in one of the

Re: terrible performance in 6.1beta4

2006-03-30 Thread usleepless
Bill, > > Actually I seem to recall that on Linux with default settings fsync() > > lies and does not actually sync data before returning, so maybe it's > > worth turning off on FreeBSD too if you're comfortable with the > > implications of this. > > If you have fsync off and the system crashes, y

Re: terrible performance in 6.1beta4

2006-03-30 Thread Bill Moran
Miguel <[EMAIL PROTECTED]> wrote: > [EMAIL PROTECTED] wrote: > > >Miguel > > > >>attached is my config file, shared_buffers are 25% of total RAM > >>im guessing that this is a disk controlled bug or something, when i > >>execute any query involving many rows, the server response is very low, > >>

Re: terrible performance in 6.1beta4

2006-03-30 Thread Kris Kennaway
On Thu, Mar 30, 2006 at 07:24:37PM -0500, Bill Moran wrote: > Kris Kennaway <[EMAIL PROTECTED]> wrote: > > > On Thu, Mar 30, 2006 at 10:49:01PM +0200, [EMAIL PROTECTED] wrote: > > > Kris, > > > > > > > Yes, this is my impression of the problem too. Any time your process > > > > is waiting on dis

Re: terrible performance in 6.1beta4

2006-03-30 Thread Bill Moran
Kris Kennaway <[EMAIL PROTECTED]> wrote: > On Thu, Mar 30, 2006 at 10:49:01PM +0200, [EMAIL PROTECTED] wrote: > > Kris, > > > > > Yes, this is my impression of the problem too. Any time your process > > > is waiting on disk I/O it is going to perform terribly (on any OS - > > > disks are slow),

Re: terrible performance in 6.1beta4

2006-03-30 Thread Miguel
[EMAIL PROTECTED] wrote: Miguel attached is my config file, shared_buffers are 25% of total RAM im guessing that this is a disk controlled bug or something, when i execute any query involving many rows, the server response is very low, ssh, su, even copy or rename a file, cpu usage remains

Re: terrible performance in 6.1beta4

2006-03-30 Thread Michal Mertl
Miguel wrote: .. "postgresql is slow for me" and others wrote: ... "you may have to dedicate more memory to it" Sorry for the above, but I haven't seen the beginning of the thread. I don't know PostgreSQL much but I also has been recently running quite simple program on one quite large table (

Re: terrible performance in 6.1beta4

2006-03-30 Thread Kris Kennaway
On Thu, Mar 30, 2006 at 10:49:01PM +0200, [EMAIL PROTECTED] wrote: > Kris, > > > Yes, this is my impression of the problem too. Any time your process > > is waiting on disk I/O it is going to perform terribly (on any OS - > > disks are slow), and the way to fix this is to make sure it does as > >

Re: terrible performance in 6.1beta4

2006-03-30 Thread usleepless
Miguel > attached is my config file, shared_buffers are 25% of total RAM > im guessing that this is a disk controlled bug or something, when i > execute any query involving many rows, the server response is very low, > ssh, su, even copy or rename a file, cpu usage remains ~87% idle though you ar

Re: terrible performance in 6.1beta4

2006-03-30 Thread usleepless
Kris, > Yes, this is my impression of the problem too. Any time your process > is waiting on disk I/O it is going to perform terribly (on any OS - > disks are slow), and the way to fix this is to make sure it does as > little I/O as possible (by allowing everything to be cached in RAM). just for

Re: terrible performance in 6.1beta4

2006-03-30 Thread usleepless
Miguel, > > > Yes, it is a dump of a single table. i want to tranfer the data from one > server to another, and this is one of the biggest table. ok, but gentoo performs the same task ok, so it is not a postgresql problem. you have not confirmed wether the gentoo-box is running with the same p

Re: terrible performance in 6.1beta4

2006-03-30 Thread Kris Kennaway
On Thu, Mar 30, 2006 at 09:41:51PM +0200, [EMAIL PROTECTED] wrote: > Miguel, > > > 3.0G > > i looked at your top-screenshot, i have the impression you could > dedicate far more memory to postgresql. maybe it would be usefull to > post your postgresql.conf ( this is in fact a postgresql question,

Re: terrible performance in 6.1beta4

2006-03-30 Thread Miguel
[EMAIL PROTECTED] wrote: Kris, 3.0G Well there you go then..you're trying to access a file that is larger than RAM, so naturally you won't be able to fit it all in RAM, and with 1GB less RAM in your system you'll spend much more time reading bits of it from disk and later throwing t

Re: terrible performance in 6.1beta4

2006-03-30 Thread usleepless
Kris, > > 3.0G > > Well there you go then..you're trying to access a file that is larger > than RAM, so naturally you won't be able to fit it all in RAM, and > with 1GB less RAM in your system you'll spend much more time reading > bits of it from disk and later throwing them away. i know a bit of

Re: terrible performance in 6.1beta4

2006-03-30 Thread usleepless
Miguel, > 3.0G i looked at your top-screenshot, i have the impression you could dedicate far more memory to postgresql. maybe it would be usefull to post your postgresql.conf ( this is in fact a postgresql question, but i don't care ). you might want to turn fsync off, my limited knowledge about

Re: terrible performance in 6.1beta4

2006-03-30 Thread Kris Kennaway
On Thu, Mar 30, 2006 at 08:52:43AM -0600, Miguel wrote: > [EMAIL PROTECTED] wrote: > > >Miguel, > > > > > > > >>On Wed, Mar 29, 2006 at 07:09:26PM -0600, Miguel wrote: > >> > >> > >>>Hi, im loading a lot of information to a postgresql 8.1.3 database, im > >>>using the copy command, using the s

Re: terrible performance in 6.1beta4

2006-03-30 Thread Miguel
[EMAIL PROTECTED] wrote: Miguel, On Wed, Mar 29, 2006 at 07:09:26PM -0600, Miguel wrote: Hi, im loading a lot of information to a postgresql 8.1.3 database, im using the copy command, using the same file and version of postgres in gentoo it spend a few minutes (~4-5), in freebsd 6.1-b

Re: terrible performance in 6.1beta4

2006-03-30 Thread Miguel
Kris Kennaway wrote: On Wed, Mar 29, 2006 at 07:09:26PM -0600, Miguel wrote: Hi, im loading a lot of information to a postgresql 8.1.3 database, im using the copy command, using the same file and version of postgres in gentoo it spend a few minutes (~4-5), in freebsd 6.1-beta4 it has alrea

Re: terrible performance in 6.1beta4

2006-03-30 Thread usleepless
Miguel, > On Wed, Mar 29, 2006 at 07:09:26PM -0600, Miguel wrote: > > Hi, im loading a lot of information to a postgresql 8.1.3 database, im > > using the copy command, using the same file and version of postgres in > > gentoo it spend a few minutes (~4-5), in freebsd 6.1-beta4 it has > > already

Re: terrible performance in 6.1beta4

2006-03-29 Thread Kris Kennaway
On Wed, Mar 29, 2006 at 07:09:26PM -0600, Miguel wrote: > Hi, im loading a lot of information to a postgresql 8.1.3 database, im > using the copy command, using the same file and version of postgres in > gentoo it spend a few minutes (~4-5), in freebsd 6.1-beta4 it has > already spent 25 minutes

terrible performance in 6.1beta4

2006-03-29 Thread Miguel
Hi, im loading a lot of information to a postgresql 8.1.3 database, im using the copy command, using the same file and version of postgres in gentoo it spend a few minutes (~4-5), in freebsd 6.1-beta4 it has already spent 25 minutes and the server apparently is doing nothing, and the reponse ti