Re: [GENERAL] Slow Query / Check Point Segments

time if possible in order to reduce average I/O. You're just not seeing that the rest of the time because checkpoints are happening so often. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com

Re: [GENERAL] more docs on extending postgres in C

://doxygen.postgresql.org/ , along with reading through the modules in contrib/ as already suggested (which won't be found by the query above because they're optional). -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com

Re: [GENERAL] postgres external table

always have to be careful about when using these is that an external table might return a weird query error under odd circumstances such as you describe, which you might not normally expect from a simple SELECT. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services

Re: [GENERAL] postgres external table

PostgreSQL-based product I'm aware of that has working external table support already is Greenplum DB. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general

Re: [GENERAL] postgres external table

system too. Just make the mainframe/whatever dump a new text file periodically into where the external table looks for its data, and you skip having to schedule reloads when the content changes. Can make your life easier while running the two systems in parallel initially. -- Greg Smith

Re: [GENERAL] postgresql 8.1 windows 2008 64 bit

-- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Huge iowait during checkpoint finish

. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com

Re: [GENERAL] location for pg_default tablespace

you've told it to use. At that point, you can then point all new creation toward that location by setting default_tablespace, or put individual bits of data onto there with the appropriate options to CREATE: http://www.postgresql.org/docs/current/static/manage-ag-tablespaces.html -- Greg Smith

Re: [GENERAL] location for pg_default tablespace

in pg_tblspace yourself; that directory is for the database to manage. Your tablespace should be somewhere completely outside of /var/lib/pgsql/data altogether. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com

Re: [GENERAL] Gentoo, 8,2 --- 8.4, and /var/run/postgresql in mode 770

it. Didn't 8.2 put these in /tmp? Maybe this was a gentoo thing. http://bugs.gentoo.org/236546 talks about what changed and shows the associated warning, which I'm guessing you didn't see. You can move it back to /tmp if you want. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL

Re: [GENERAL] Huge iowait during checkpoint finish

interesting. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] pg.dropped

instead. And of course this makes my INSERT not working... There's obviously something wrong here, but the fact that the pg_attribute entry is still there (but marked dropped) is a not a direct cause of your problem. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services

Re: [GENERAL] Minimizing disk space

, although the burst size can be bigger than that under load. You should settle into where there's only 48MB being used there with those parameter changes. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent

Re: [GENERAL] PostgreSQL Write Performance

expensive hardware to improve the situation. If you haven't been seeing that in your app already, I assure you it's just because you haven't looked for the issue before--this limitation on disk write speed has been there all along, the database is just forcing you to address it. -- Greg Smith

Re: [GENERAL] timestams in the the pg_standby output

it fell apart. There's a gotcha in running tail -f into some programs too--for example, to pipe that into grep you need to change grep's buffering mode. I suspect the Perl program I suggested will look less like overkill by the time you're done here. -- Greg Smith2ndQuadrant Baltimore, MD

Re: [GENERAL] PostgreSQL Write Performance

on this and related techniques at http://www.postgresql.org/docs/current/interactive/populate.html Another thing you can do is defer your constraints: http://www.postgresql.org/docs/current/static/sql-set-constraints.html so that they execute in a more efficient block. -- Greg Smith

Re: [GENERAL] pgbench out of memory error

to start instead and see what happens. On the select-only, you can easily need 1M total transactions to get an accurate reading here. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general

Re: [GENERAL] Upgraded from Leopard to Snow Leopard - PostgreSQL won't start anymore

-safety --with-bonjour --prefix=install location | Then run make/make install, point PGDATA toward your existing database, and start the server. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com

Re: [GENERAL] PostgreSQL Write Performance

be introducing a possibility of some data loss from the latest insert(s) if the server crashes in this situation. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql

Re: [GENERAL] timestams in the the pg_standby output

); | |With something like this:| |||printf %s %s\n, strftime(%Y-%m-%d %H:%M:%S, localtime(time)), $item| || |(untested, and I am not a regular Perl programmer, its but File::Tail is the best library I know of to do this sort of thing)| || -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL

Re: [GENERAL] timestams in the the pg_standby output

the right idea, just need to make sure it behaves as you expect and doesn't clump the line reads into larger chunks. The main improvement in the Perl implementation over this is the ability to do things like adjust timeout behavior easily. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL

Re: [GENERAL] Deleting 100 rows which meets certain criteria

from mytable WHERE timestamp_field (now() - INTERVAL '400 hour' ) LIMIT 100); The main advantage of using the primary key is that the result will be more portable to other databases--the ctid field is very much a PostgreSQL specific hack. -- Greg Smith2ndQuadrant Baltimore, MD

Re: [GENERAL] PANIC: right sibling 2019 of block 2018 is not next child of 1937 in index sl_log_2_idx1

be in order too. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Finding the bin path

. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com

Re: [GENERAL] Not finding RPMs for 8.4.2!

stuff--faster and more accurate. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org

Re: [GENERAL] Justifying a PG over MySQL approach to a project

sponsoring the Streaming Replication feature targeted for 8.5). When the telcos and providers of telco equipment like Skype, Cisco, and NTT are all using PostgreSQL, it certainly makes it easy to support the idea that the database is reliable in the real world. -- Greg Smith2ndQuadrant

Re: [GENERAL] Justifying a PG over MySQL approach to a project

by about 8X on both read and writes sides between 8.1 and 8.3. Since 8.1 came out in late 2005, it's no wonder the PostgreSQL is slow meme got so deep into people's memories--until only four years ago, it was still actually true. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training

Re: [GENERAL] Extracting SQL from logs in a usable format

and maintaining concurrency are all critical and far from trivial. I hope you're using the CVS format logs, which should make the job a lot easier than the standard text one. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com

Re: [GENERAL] Possible causes for database corruption and solutions

reliable external drive solution nowadays, because at least you're guaranteed to get SMART data, cache flushes, and a drive technology that's always been optimized for ruggedness. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www

Re: [GENERAL] Possible causes for database corruption and solutions

Michael Clark wrote: On Wed, Dec 16, 2009 at 11:25 AM, Greg Smith g...@2ndquadrant.com mailto:g...@2ndquadrant.com wrote: Florian Weimer wrote: I hope that Mac OS X turns off write caches on low battery. I've never heard of such a thing. The best you can do

Re: [GENERAL] Justifying a PG over MySQL approach to a project

engine and everybody works on it. What the MySQL community calls options in storage engines I call split QA, and the source of new types of failures not possible if you only have one underlying storage codebase to worry about. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training

Re: [GENERAL] Justifying a PG over MySQL approach to a project

Thomas Kellerer wrote: Greg Smith wrote on 16.12.2009 22:44: You've probably already found http://wiki.postgresql.org/wiki/Why_PostgreSQL_Instead_of_MySQL:_Comparing_Reliability_and_Speed_in_2007 which was my long treatment of this topic (and overdue for an update). There is an update

Re: [GENERAL] Interesting Benchmark Article

know from personal experience has very poor default settings for shared_buffers due to Ubuntu's operating system defaults. Perhaps if theses parameters were altered postgres would get a clean sweep. The parameters are no better on a default Windows install. -- Greg Smith2ndQuadrant Baltimore

Re: [GENERAL] replication dbs

://wiki.postgresql.org/wiki/Replication%2C_Clustering%2C_and_Connection_Pooling , with more details about some of the projects/products that add features in this area at http://wiki.postgresql.org/wiki/Clustering -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g

Re: [GENERAL] Possible causes for database corruption and solutions

. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] getaddrinfo.c error

in Eclipse that might help you out: http://wiki.postgresql.org/wiki/Working_with_Eclipse -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com

Re: [GENERAL] Postgres.exe Process taking too much memory and CPU usage - making the system extremely slow.

rather than 128MB, tweaked the wording there accordingly. 8MB working out best is really unexpected though; I'd like to know what you were doing where *that* was the optimal setting. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www

Re: [GENERAL] PIVOT tables and crosstab

or break them into a separate, optional package, but they're nonetheless part of the official source code release. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general

Re: [GENERAL] Excessive (and slow) fsync() within single transaction

recommendation #1 if I ran into this situation would be Don't try that on OS X with HFS+. Maybe there's some way to get more performance out of there by tweaking the OS, I haven't had to do so myself enough to know the details off the top of my head. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL

Re: [GENERAL] Excessive (and slow) fsync() within single transaction

. Basically, it reduces the number of fsync's from transaction commits to be a fixed number per unit of time, rather than being proportional to the number of commits. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com

Re: [GENERAL] Excessive (and slow) fsync() within single transaction

right first. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql

Re: [GENERAL] Excessive (and slow) fsync() within single transaction

to the WAL followed by an fsync. That's basically the fsync rate of the system, as long as you don't get a checkpoint in the middle slowing it down. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via

Re: [GENERAL] Excessive (and slow) fsync() within single transaction

that anything the drive has said is written is actually on disk, which used to be how things worked, from that perspective all (well, almost all) drives lie. Having that behavior documented and a workaround available doesn't change that. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training

Re: [GENERAL] Excessive (and slow) fsync() within single transaction

not sure how to do this on OS X though. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http

Re: [GENERAL] SELECTing every Nth record for better performance

one approach for something like that. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http

Re: [GENERAL] Testing query times

how to clear the OS cache on Linux: |sync; echo 3 /proc/sys/vm/drop_caches| And on Windows you should be able to clear it with CacheSet: http://technet.microsoft.com/en-us/sysinternals/bb897561.aspx -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g

Re: [GENERAL] Postgres performance on Veritas VxVM

, you should be able to get the smaller open_datasync writes and some improvements from using direct writes too stack on top of one another. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general

Re: [GENERAL] Postgres performance on Veritas VxVM

using Linux's LVM for similar reasons--while it shouldn't be so slow, it is. Nothing you can do about it but use direct disk partitions instead if you need the performance to be good. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com

Re: [GENERAL] use log_statement to log only SELECTs?

need a much better justification for why you can't just filter things out of the log yourself before it would be worth further complicating the code involved. It's just not a common request--if anything, you might find people want everything *but* SELECTs. -- Greg Smith2ndQuadrant

Re: [GENERAL] limiting resources to users

Craig Ringer wrote: On 1/12/2009 11:33 AM, Greg Smith wrote: 1) If you spawn the psql process with bash using , you can then find its pid with $!, then chain through the process tree with ps and pg_stat_activity as needed to figure out the backend pid. I feel like I'm missing something

Re: [GENERAL] Postgres database performance on 6 core Opteron vs 4 core Xeon

in reality AMD's cost effectiveness can make for a better overall database system at the same price point. If you really need a lot of disks to make your app performance well, better to focus on that rather than trivia like how fast stuff moves around the memory bus. -- Greg Smith

Re: [GENERAL] limiting resources to users

that to lookup the backend pid assigned; not hard to do if you've seen an example or know how this all fits together, but not really an obvious technique either. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via

Re: [GENERAL] READ ONLY I/O ERROR

a drive failure though. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org

Re: [GENERAL] limiting resources to users

of the query running at once, but in the nice a batch job context it might be usable. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes

Re: [BUGS] Re: [GENERAL] How duplicate data produce when a UNIQUE index exite ?

time. If you're not sure exactly how the old one was built, this can help you out. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make

Re: [GENERAL] which software to replicate a database on windows xp/vista is the best???

recommendations for where you can find it. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http

Re: [GENERAL] How duplicate data produce when a UNIQUE index exite ?

there. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com

Re: [GENERAL] PG_STANDBY ISSUE

for the backup to be useful. The standby doesn't actually use it for anything, it's more of a helper for a human trying to figure out what's going on. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql

Re: [GENERAL] Easier to use warm standby in 8.4?

having the background writer active during recovery, that should help on I/O bound slaves. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org

Re: [GENERAL] Books

. As you can see at http://www.linbrary.com/postgresql/840/index.html Fultus Corporation is not affiliated with The PostgreSQL Global Development Group. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via

Re: [GENERAL] specifying a password on the cmd line for db connect

/interactive/libpq-pgpass.html -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com

Re: [GENERAL] Voting: pg_ctl init versus initdb

on. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Voting: pg_ctl init versus initdb

' initscripts. And I thought the entire point of this proposal was that we could expunge knowledge of initdb from users' minds. Exactly. I think the best transition design would be to make initdb and init both work. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services

Re: [GENERAL] safelly erasing dirs/files

need to setup a .pgpass file: http://www.postgresql.org/docs/current/static/libpq-pgpass.html -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org

Re: [GENERAL] safelly erasing dirs/files

might be able to work your way up to bigger ones. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http

Re: [GENERAL] Customize the install directory of the postgres DB

(but not completely). -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql

Re: [GENERAL] Customize the install directory of the postgres DB

have to add those to the system loader configuration or set LD_LIBRARY_PATH before calling database binaries. Ideally you'd find them via rpath or something so this isn't an issue, but it's easy to miss that the first time you make a change like this. -- Greg Smith2ndQuadrant Baltimore

Re: [GENERAL] Postgres Clustering Options

this I did, that featured a shared SAN and commercial cluster software. -- Greg Smithg...@2ndquadrant.comBaltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Postgres Clustering Options

. If you don't expect a standby is going to be able to keep up with your volume due to that issue, the remote one is going to be even worse though. -- Greg Smithg...@2ndquadrant.comBaltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your

Re: [GENERAL] Postgres Clustering Options

is allowing the original master to continue writing to the shared SAN volume once that transition has happened. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services and Support g...@2ndquadrant.com www.2ndQuadrant.com -- Sent via pgsql-general mailing list (pgsql-general

Re: [GENERAL] Incremental Backups in postgres

to recovery from a failure, and that list will go back to when you started the backup. Saving those is actually part of the base backup process, as documented in the manual if you read that section more carefully. -- Greg Smith2ndQuadrant Baltimore, MD PostgreSQL Training, Services

Re: [GENERAL] Editor for sgml files

On Mon, 9 Nov 2009, Richard Broersma wrote: Out of curiosity, what are the favorite editor for authoring the PostgreSQL document sgml files? http://developer.postgresql.org/pgdocs/postgres/docguide-authoring.html -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD

Re: [GENERAL] warm standby resume and take online problems

recovery a bit leading up to here. This might be a full disk or a bad block on the xlog drive instead of something more complicated. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes

Re: [GENERAL] How-To Consitent EC2 Snapshots with Postgres

block instead. That will flush the important things that can't be in the write cache first, and as long as you grab the incremental WAL files when you're done as a second step you shouldn't need to quiesce the file system in the middle. -- * Greg Smith gsm...@gregsmith.com http

Re: [GENERAL] checkpoints/bgwriter tuning verification

page on Linux's pdflush on my web page. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Help with postgresql memory issue

controlled by the zone configuration. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Help with postgresql memory issue

a software limit is being run into instead. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Postgres alpha testing docs and general test packs

easily find the relevant discussion leading up that patch being applied, and many of those include better/more obvious examples and documentation. The current alpha2 is based on the results of https://commitfest.postgresql.org/action/commitfest_view?id=3 -- * Greg Smith gsm...@gregsmith.com http

Re: [GENERAL] auto truncate/vacuum full

locking instead of micromanaging the details. (Yes, I should have been using date-range partitioning instead and just dropped the old partitions, but sometimes these things grow only after you've made design decisions the wrong way) -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com

Re: [GENERAL] auto truncate/vacuum full

I was alluding to, moving in that direction would seem much more valuable than trying to optimize the existing approach better. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes

Re: [GENERAL] Research and EAV models

to do both. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] OT - 2 of 4 drives in a Raid10 array failed - Any chance of recovery?

of the mdadm detail (and smartctl -i for each underlying drive) on any production server, to make it easier to answer questions like what's the serial number of the drive that failed in /dev/md0?. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql

Re: [GENERAL] OT - 2 of 4 drives in a Raid10 array failed - Any chance of recovery?

to implement either. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] OT - 2 of 4 drives in a Raid10 array failed - Any chance of recovery?

that still works, to help figure out where they fit into the larger array. That and --detail are what I find myself using instead of /proc/mdstat , which provides an awful interface IMHO. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general

Re: [GENERAL] Linux TOP

the shared bits each of the PostgreSQL processes includes. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Linux TOP

whether that's still going on or not now, as Tom already suggested. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Sharedbuffers and WorkMem

much beyond the 10GB range anyway. Your starting configuration seems fine to me, I would suggest getting your application running and measure actual memory use before tweaking anything further. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql

Re: [GENERAL] Best practices for effective_io_concurrency

suggestions here and to even demonstrate the feature at work. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] table full scan or index full scan?

to an index scan if you're running a query that only selects a small number of records where an index on the condition you're checking for exists. There's some information about alternative ways to solve this problem at http://wiki.postgresql.org/wiki/Slow_Counting -- * Greg Smith gsm

Re: [GENERAL] PostgreSQL reads each 8k block - no larger blocks are used - even on sequential scans

of are hacking on projects with a much clearer payback instead. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] How to troubleshoot authentication failure?

for. In general, debug2 is usually a good place to start at when trying to nail down mysterious database issues. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your

Re: [GENERAL] Limit of bgwriter_lru_maxpages of max. 1000?

instead. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Limit of bgwriter_lru_maxpages of max. 1000?

is there. Do you have an where one should set tracepoints inside and outside PostgreSQL? I think you'd want to instrument BufferAlloc inside bufmgr.c to measure what you're after. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing

Re: [GENERAL] Limit of bgwriter_lru_maxpages of max. 1000?

there's a design limitation here. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] PostgreSQL reads each 8k block - no larger blocks are used - even on sequential scans

being done by the Linux kernel and in some hardware is already doing this sort of optimization for you on that OS, whether or not your app knows enough to recognize it's sequentially scanning the disk it's working against. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore

Re: [GENERAL] PostgreSQL reads each 8k block - no larger blocks are used - even on sequential scans

keep meaning to add something just like this as a second level example on top of dd/bonnie++ on my disk testing page. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your

Re: [GENERAL] Limit of bgwriter_lru_maxpages of max. 1000?

. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] PostgreSQL reads each 8k block - no larger blocks are used - even on sequential scans

applications and see performance plunge with a larger block size. There certainly are others where a larger block would work better. Testing either way is complicated by the way RAID devices usually have their own stripe sizes to consider on top of the database block size. -- * Greg Smith gsm

Re: [GENERAL] Limit of bgwriter_lru_maxpages of max. 1000?

. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore, MD -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Performance evaluation of PostgreSQL's historic releases

. The improvements in that version just don't help trivial examples like the sysbench ones you ran. P.S. On your write-heavy tests, increasing checkpoint_segments a lot should improve overall performance, if you re-test at some point. -- * Greg Smith gsm...@gregsmith.com http://www.gregsmith.com Baltimore

<    1   2   3   4   5   6   7   8   >