Re: [PERFORM] 10K vs 15k rpm for analytics

2010-03-08 Thread Greg Smith
Scott Carey wrote: For high sequential throughput, nothing is as optimized as XFS on Linux yet. It has weaknesses elsewhere however. I'm curious what you feel those weaknesses are. The recent addition of XFS back into a more mainstream position in the RHEL kernel as of their 5.4 update

Re: [PERFORM] 10K vs 15k rpm for analytics

2010-03-08 Thread Scott Carey
On Mar 2, 2010, at 2:10 PM, wrote: > On Tue, 2 Mar 2010, Scott Marlowe wrote: > >> On Tue, Mar 2, 2010 at 2:30 PM, Francisco Reyes >> wrote: >>> Scott Marlowe writes: >>> Then the real thing to compare is the speed of the drives for throughput not rpm. >>> >>> In a machine, simmil

Re: [PERFORM] 10K vs 15k rpm for analytics

2010-03-08 Thread Scott Carey
On Mar 2, 2010, at 1:36 PM, Francisco Reyes wrote: > da...@lang.hm writes: > >> With sequential scans you may be better off with the large SATA drives as >> they fit more data per track and so give great sequential read rates. > > I lean more towards SAS because of writes. > One common thing w

Re: [PERFORM] partition pruning

2010-03-08 Thread Simon Riggs
On Thu, 2010-03-04 at 17:40 -0500, Robert Haas wrote: > On Mon, Mar 1, 2010 at 2:29 PM, Anj Adu wrote: > > When I use intervals in my query e.g col1 between current_timestamp - > > interval '10 days' and current_timestamp...the optimizer checks ALL > > partitions whereas if I use col1 between

Re: [PERFORM] Estimation issue with partitioned tables

2010-03-08 Thread Robert Haas
On Sun, Mar 7, 2010 at 12:57 PM, Josh Berkus wrote: >>> Yeah, I can generate one pretty easily; the behavior is readily >>> observable and repeatable.  Will get on it RSN, but at you said, we're >>> not doing anything about it for 9.0. > > Well, I can generate a test case, but on examination it tu

Re: [PERFORM] Testing FusionIO

2010-03-08 Thread Ben Chobot
On Mar 8, 2010, at 12:50 PM, Greg Smith wrote: > Ben Chobot wrote: >> We've enjoyed our FusionIO drives very much. They can do 100k iops without >> breaking a sweat. Just make sure you shut them down cleanly - it can up to >> 30 minutes per card to recover from a crash/plug pull test. > > Ye

Re: [PERFORM] Testing FusionIO

2010-03-08 Thread Greg Smith
Ben Chobot wrote: We've enjoyed our FusionIO drives very much. They can do 100k iops without breaking a sweat. Just make sure you shut them down cleanly - it can up to 30 minutes per card to recover from a crash/plug pull test. Yeah...I got into an argument with Kenny Gorman over my concerns

Re: [PERFORM] Paritioning vs. caching

2010-03-08 Thread Josh Berkus
> 1. When I query the table by ID, it performs index scan on each > partition. The result is only found in one partition, but I understand > why it needs to look in all of them. How much disk reading does it > involve? Is only the "head" of indexes for partitions that do not > include the row scan

Re: [PERFORM] Paritioning vs. caching

2010-03-08 Thread Anj Adu
If the partitioned column in your where clause does not use hardcoded values ...e.g datecolumn between 'year1' and 'year2' ..the query planner will check all partitions ..this is a known issue with the optimizer On Mon, Mar 8, 2010 at 10:28 AM, Konrad Garus wrote: > Hello, > > I am evaluating a m

[PERFORM] Paritioning vs. caching

2010-03-08 Thread Konrad Garus
Hello, I am evaluating a materialized view implemented as partitioned table. At the moment the table is partitioned yearly and contains 5 numeric/timestamp columns. One of the columns is ID (but it's not what the table is partitioned on). Partition for one year occupies about 1200 MB. Each of the

Re: [PERFORM] Testing FusionIO

2010-03-08 Thread Ben Chobot
We've enjoyed our FusionIO drives very much. They can do 100k iops without breaking a sweat. Just make sure you shut them down cleanly - it can up to 30 minutes per card to recover from a crash/plug pull test. I also have serious questions about their longevity and failure mode when the flash

Re: [PERFORM] prepared statements and partitioning (partition elimination not working)

2010-03-08 Thread Kenneth Marshall
On Mon, Mar 08, 2010 at 10:24:56AM -0700, Kevin Kempter wrote: > Hi all; > > we've found that partition elimination is not happening for a prepared > statement, however running the same statement in psql manually does give us > partition elimination. > > Is this a known issue? > Yes, see the

[PERFORM] prepared statements and partitioning (partition elimination not working)

2010-03-08 Thread Kevin Kempter
Hi all; we've found that partition elimination is not happening for a prepared statement, however running the same statement in psql manually does give us partition elimination. Is this a known issue? -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make chang

Re: [PERFORM] Testing FusionIO

2010-03-08 Thread Łukasz Jagiełło
2010/3/8 Devrim GÜNDÜZ : > Hi, > > I have a FusionIO drive to test for a few days. I already ran iozone and > bonnie++ against it. Does anyone have more suggestions for it? > > It is a single drive (unfortunately). vdbench -- Łukasz Jagiełło System Administrator G-Forces Web Management Polska sp

Re: [PERFORM] Testing FusionIO

2010-03-08 Thread Yeb Havinga
Devrim GÜNDÜZ wrote: Hi, I have a FusionIO drive Cool!! to test for a few days. I already ran iozone and bonnie++ against it. Does anyone have more suggestions for it? Oracle has a tool to test drives specifically for database loads kinds called orion - its free software and comes with a

[PERFORM] Testing FusionIO

2010-03-08 Thread Devrim GÜNDÜZ
Hi, I have a FusionIO drive to test for a few days. I already ran iozone and bonnie++ against it. Does anyone have more suggestions for it? It is a single drive (unfortunately). Regards, -- Devrim GÜNDÜZ PostgreSQL Danışmanı/Consultant, Red Hat Certified Engineer PostgreSQL RPM Repository: http