Re: [GENERAL] pgbench initialize

2016-12-16 Thread Vladimir Rusinov
Depends on goals of your benchmarking. What are you trying to achieve? Initialization and vacuuming each time will help achieve more consistent best-case numbers (to reduce variance, I'd also destroy cluster completely and clean up hardware, e.g. run fstrim in case of SSD, etc). If you are howeve

Re: [GENERAL] pgbench and scaling

2016-11-19 Thread rakeshkumar464
"Are the TPS numbers per pgbench? If so, then you're getting 10x490=4900 TPS system wide, or 20*280=5600 TPS system wide. " Per pgbench. Your explanation makes sense. thanks. -- View this message in context: http://postgresql.nabble.com/pgbench-and-scaling-tp5930891p5931131.html Sent from

Re: [GENERAL] pgbench and scaling

2016-11-18 Thread Vick Khera
On Thu, Nov 17, 2016 at 8:08 PM, Rakesh Kumar wrote: > I noticed that as I scale from 5 to 10 to 20 to 40, the TPS starts falling > almost linearly : > > with 5, TPS was doing 639 > with 10 TPS was down to 490 > with 20 TPS was down to 280 > and so on. Are the TPS numbers per pgbench? If so, the

Re: [GENERAL] pgbench and scaling

2016-11-17 Thread Rakesh Kumar
I forgot to mention that the db is replicated synchronously. I think that is the culprit. -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] pgbench tps drop from 5000 to 37 going from localhost to a server 13ms away

2015-07-27 Thread Jeff Janes
On Mon, Jul 27, 2015 at 3:19 AM, Chris Withers wrote: > On 24/07/2015 22:51, Jeff Janes wrote: > > starting vacuum...end. > >> transaction type: TPC-B (sort of) >> scaling factor: 1 >> > > This is your problem. There is only one row in the pgbench_branch > table, and every transaction has to

Re: [GENERAL] pgbench tps drop from 5000 to 37 going from localhost to a server 13ms away

2015-07-27 Thread Chris Withers
On 24/07/2015 22:51, Jeff Janes wrote: starting vacuum...end. transaction type: TPC-B (sort of) scaling factor: 1 This is your problem. There is only one row in the pgbench_branch table, and every transaction has to update that one row. This is inherently a seriaized event. Indeed

Re: [GENERAL] pgbench tps drop from 5000 to 37 going from localhost to a server 13ms away

2015-07-24 Thread Jeff Janes
On Fri, Jul 24, 2015 at 12:13 PM, Chris Withers wrote: > On 24/07/2015 19:21, Jan Lentfer wrote: > >> >> I've been doing some lightweight load testing with “pgbench -c8 -j8 -T10” When run locally on the postgres server I've testing, this gives around 5000tps When I

Re: [GENERAL] pgbench tps drop from 5000 to 37 going from localhost to a server 13ms away

2015-07-24 Thread Chris Withers
On 24/07/2015 19:21, Jan Lentfer wrote: I've been doing some lightweight load testing with “pgbench -c8 -j8 -T10” When run locally on the postgres server I've testing, this gives around 5000tps When I do it from a server that has a 13ms ping latency, it drops to 37tps. This is using the defa

Re: [GENERAL] pgbench tps drop from 5000 to 37 going from localhost to a server 13ms away

2015-07-24 Thread Jan Lentfer
>> Am 24.07.2015 um 18:59 schrieb Chris Withers : >> >> Hi all, >> >> I've been doing some lightweight load testing with >> “pgbench -c8 -j8 -T10” >> >> When run locally on the postgres server I've testing, this gives around >> 5000tps >> >> When I do it from a server that has a 13ms ping la

Re: [GENERAL] pgbench tps drop from 5000 to 37 going from localhost to a server 13ms away

2015-07-24 Thread Jan Lentfer
That seems to be a large drop. On the other hand 13 ms is also like a very large network latency. On LAN your usually in the sub ms area. So going from e.g. 0.2 ms to 13ms is 65 fold decrease. What is the network toplogy like? Jan Von meinem iPad gesendet > Am 24.07.2015 um 18:59 schrieb Chris

Re: [GENERAL] pgbench - prevent client from aborting on ERROR

2015-04-30 Thread Adrian Klaver
On 04/30/2015 11:36 AM, Nicholson, Brad (Toronto, ON, CA) wrote: Hi, Is there any way to do this? For context, I'm wanting to write a custom script in repeatable read isolation level. If I hit a serializable error, I don't want the client to abort, I want it to continue running transactions.

Re: [GENERAL] pgbench

2014-12-13 Thread alikon
Hi, can you share the plsql procedure to call the query from pgbench i'm running in the same issue cause i have a long query that i want to submit to pgbench There are any news for fix this pgbench issue ? -- View this message in context: http://postgresql.nabble.com/pgbench-tp5773225p5830455

Re: [GENERAL] pgbench

2013-10-04 Thread Simeó Reig
A 2013-10-03 17:50, Alvaro Herrera escrigué: Giuseppe Broccolo wrote: The format of the script file has to be one SQL command per line; multiline SQL commands are not supported, and empty lines are ignored. This could bring to errors. Could this be your case? Multiline SQL commands are not su

Re: [GENERAL] pgbench

2013-10-03 Thread Tom Lane
Alvaro Herrera writes: > Multiline SQL commands are not supported? Well that sucks, because only > BUFSIZ chars are read from each line. In my platform that's 8192, but > maybe in Simeó's case it's shorter .. or maybe his query really is > longer than 8192 bytes. > This smells like a pgbench b

Re: [GENERAL] pgbench

2013-10-03 Thread Alvaro Herrera
Giuseppe Broccolo wrote: > The format of the script file has to be one SQL command per line; > multiline SQL commands are not supported, and empty lines are > ignored. This could bring to errors. Could this be your case? Multiline SQL commands are not supported? Well that sucks, because only BUF

Re: [GENERAL] pgbench

2013-10-03 Thread Adrian Klaver
On 10/03/2013 07:48 AM, Simeó Reig wrote: A 2013-10-03 16:40, Adrian Klaver escrigué: On 10/03/2013 07:23 AM, Simeó Reig wrote: Unfortunately I can't put the sql here, but I repeat: I could do: psql -d databasename > scrip_file.sql and it works perfectly, and It is a one line query. I wo

Re: [GENERAL] pgbench

2013-10-03 Thread Giuseppe Broccolo
Il 03/10/2013 16:11, Simeó Reig ha scritto: A 2013-10-03 15:51, Adrian Klaver escrigué: On 10/03/2013 06:21 AM, Simeó Reig wrote: Hello I was doing a performance test with pgbench with a pretty long queries and I have the next error: $ pgbench -n -c1 -T 3 -f veins_pgbench.sql pdn Cl

Re: [GENERAL] pgbench

2013-10-03 Thread Simeó Reig
A 2013-10-03 16:40, Adrian Klaver escrigué: On 10/03/2013 07:23 AM, Simeó Reig wrote: You have not shown the query, but could you be running into the belwo: http://www.postgresql.org/docs/9.3/interactive/pgbench.html "The format of a script file is one SQL command per line; multiline SQL c

Re: [GENERAL] pgbench

2013-10-03 Thread Adrian Klaver
On 10/03/2013 07:23 AM, Simeó Reig wrote: You have not shown the query, but could you be running into the belwo: http://www.postgresql.org/docs/9.3/interactive/pgbench.html "The format of a script file is one SQL command per line; multiline SQL commands are not supported. Empty lines and line

Re: [GENERAL] pgbench

2013-10-03 Thread Simeó Reig
A 2013-10-03 16:16, Adrian Klaver escrigué: On 10/03/2013 07:11 AM, Simeó Reig wrote: A 2013-10-03 15:51, Adrian Klaver escrigué: On 10/03/2013 06:21 AM, Simeó Reig wrote: Hello I was doing a performance test with pgbench with a pretty long queries and I have the next error: $ pgbenc

Re: [GENERAL] pgbench

2013-10-03 Thread Simeó Reig
A 2013-10-03 15:51, Adrian Klaver escrigué: On 10/03/2013 06:21 AM, Simeó Reig wrote: Hello I was doing a performance test with pgbench with a pretty long queries and I have the next error: $ pgbench -n -c1 -T 3 -f veins_pgbench.sql pdn Client 0 aborted in state 0: ERROR: syntax err

Re: [GENERAL] pgbench

2013-10-03 Thread Adrian Klaver
On 10/03/2013 07:11 AM, Simeó Reig wrote: A 2013-10-03 15:51, Adrian Klaver escrigué: On 10/03/2013 06:21 AM, Simeó Reig wrote: Hello I was doing a performance test with pgbench with a pretty long queries and I have the next error: $ pgbench -n -c1 -T 3 -f veins_pgbench.sql pdn Client

Re: [GENERAL] pgbench

2013-10-03 Thread Adrian Klaver
On 10/03/2013 06:21 AM, Simeó Reig wrote: Hello I was doing a performance test with pgbench with a pretty long queries and I have the next error: $ pgbench -n -c1 -T 3 -f veins_pgbench.sql pdn Client 0 aborted in state 0: ERROR: syntax error at end of input LINE 1: ...(abc.persones.p

Re: [GENERAL] pgbench help

2012-12-24 Thread Atri Sharma
Sent from my iPad On 24-Dec-2012, at 17:15, Georges Racinet wrote: > On 12/24/2012 12:32 PM, John R Pierce wrote: >> On 12/24/2012 2:43 AM, Georges Racinet wrote: >>> Make sure both servers aren't running at the same time >> >> why? its perfectly OK to ahve severla postgres servers running at

Re: [GENERAL] pgbench help

2012-12-24 Thread Georges Racinet
On 12/24/2012 12:32 PM, John R Pierce wrote: > On 12/24/2012 2:43 AM, Georges Racinet wrote: >> Make sure both servers aren't running at the same time > > why? its perfectly OK to ahve severla postgres servers running at > once, as long as they are on different port numbers. I generally use > 543

Re: [GENERAL] pgbench help

2012-12-24 Thread John R Pierce
On 12/24/2012 2:43 AM, Georges Racinet wrote: Make sure both servers aren't running at the same time why? its perfectly OK to ahve severla postgres servers running at once, as long as they are on different port numbers. I generally use 5432, 5433, 5434, etc for this. mostly for developmen

Re: [GENERAL] pgbench help

2012-12-24 Thread Atri Sharma
On Mon, Dec 24, 2012 at 4:13 PM, Georges Racinet wrote: > On 12/24/2012 08:50 AM, Atri Sharma wrote: >> I have two 9.2 servers running in different data directories and >> installation directories. One of them(the main one) has its bin in the >> path of my system.The other one does not, hence, I n

Re: [GENERAL] pgbench help

2012-12-24 Thread Georges Racinet
On 12/24/2012 08:50 AM, Atri Sharma wrote: > I have two 9.2 servers running in different data directories and > installation directories. One of them(the main one) has its bin in the > path of my system.The other one does not, hence, I need to use the > complete path(/usr/local/pgsql/...). > > I wa

Re: [GENERAL] pgbench out of memory error

2010-01-05 Thread Greg Smith
Jeff Ross wrote: I'm trying to put a new server on line and I'm having a problem getting any kind of decent performance from it. pgbench yields around 4000 tps until scale and clients both are above 21, then I see the following: NOTICE: ALTER TABLE / ADD PRIMARY KEY will create implicit index

Re: [GENERAL] Pgbench tool download

2009-08-17 Thread Josh Kupershmidt
On Mon, Aug 17, 2009 at 11:56 AM, Chris Barnes wrote: > I am looking for pgbench. Is there a good source from which I can download > the most current version? If you installed from source, look under contrib for the pgbench subdirectory. If you installed from your OS's package repository, try look

Re: [GENERAL] pgbench

2008-08-08 Thread Heeman Lee
Never mind. I found it. On Fri, 2008-08-08 at 12:16 -0400, Heeman Lee wrote: > Hi, > > I can't find pgbench on the package we installed. I built, contrib pkg > and installed, but that still didn't generate pgbench anywhere. > Any idea where to get pgbench? > > -- > Heeman Lee -- Heeman Lee

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Justin
Greg Smith wrote: On Fri, 14 Mar 2008, Justin wrote: I was wondering why the -s would not rescale the data? First, you don't know how to rescale the data if someone is passing in a custom script. More importantly, people don't expect the benchmark tool to change things in tables unless s

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Justin
Tom Lane wrote: Justin <[EMAIL PROTECTED]> writes: I was wondering why the -s would not rescale the data? That would involve re-initializing the table contents. If that's what you want, use -i. regards, tom lane thanks

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Greg Smith
On Fri, 14 Mar 2008, Justin wrote: I was wondering why the -s would not rescale the data? First, you don't know how to rescale the data if someone is passing in a custom script. More importantly, people don't expect the benchmark tool to change things in tables unless specifically requeste

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Tom Lane
Justin <[EMAIL PROTECTED]> writes: > I was wondering why the -s would not rescale the data? That would involve re-initializing the table contents. If that's what you want, use -i. regards, tom lane -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) T

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Justin
Tom Lane wrote: Greg Smith <[EMAIL PROTECTED]> writes: On Fri, 14 Mar 2008, Tom Lane wrote: Yeah, -s is only meaningful when given with -i. Maybe someday we ought to fix pgbench to complain if you try to set it at other times. You have to pass -s in to the actual run if y

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Tom Lane
Greg Smith <[EMAIL PROTECTED]> writes: > On Fri, 14 Mar 2008, Tom Lane wrote: >> Yeah, -s is only meaningful when given with -i. Maybe someday we ought >> to fix pgbench to complain if you try to set it at other times. > You have to pass -s in to the actual run if you're specifying your own > cu

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Greg Smith
On Fri, 14 Mar 2008, Tom Lane wrote: "Pavan Deolasee" <[EMAIL PROTECTED]> writes: You must have initialized pgbench with scale 1. Yeah, -s is only meaningful when given with -i. Maybe someday we ought to fix pgbench to complain if you try to set it at other times. You have to pass -s in to

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Tom Lane
"Pavan Deolasee" <[EMAIL PROTECTED]> writes: > On Fri, Mar 14, 2008 at 2:34 PM, Enrico Sirola <[EMAIL PROTECTED]> wrote: >> as you see, the reported scaling factor is 1, but I specified -s 1000, > You must have initialized pgbench with scale 1. Yeah, -s is only meaningful when given with -i. May

Re: [GENERAL] pgbench not setting scale size correctly?

2008-03-14 Thread Pavan Deolasee
On Fri, Mar 14, 2008 at 2:34 PM, Enrico Sirola <[EMAIL PROTECTED]> wrote: > > as you see, the reported scaling factor is 1, but I specified -s 1000, > which seems strange... I'm going to recompile it from the sources now. > Didn't I get anything or there is a bug somewhere? You must have initi

Re: [GENERAL] pgbench

2006-03-04 Thread Tatsuo Ishii
pgbench comes with PostgreSQL source code distribution and must be compiled under PostgreSQL source tree. I'm not familiar with MacOS but I guess there may be pre-compiled package. Anyone can help him? -- Tatsuo Ishii SRA OSS, Inc. Japan > I have just received my new MacBook (1.83Gz. Duo) and wan