Re: [PERFORM] Extremely slow intarray index creation and inserts.

2009-03-19 Thread Oleg Bartunov
On Thu, 19 Mar 2009, Oleg Bartunov wrote: On Thu, 19 Mar 2009, Tom Lane wrote: Oleg Bartunov writes: We usually say about 200 unique values as a limit for gist_int_ops. That seems awfully small ... should we make gist_intbig_ops the default, or more likely, raise the signature size of both

Re: [PERFORM] Extremely slow intarray index creation and inserts.

2009-03-19 Thread Oleg Bartunov
On Thu, 19 Mar 2009, Tom Lane wrote: Oleg Bartunov writes: We usually say about 200 unique values as a limit for gist_int_ops. That seems awfully small ... should we make gist_intbig_ops the default, or more likely, raise the signature size of both opclasses? Even at a crossover point of 10

Re: [PERFORM] Extremely slow intarray index creation and inserts.

2009-03-19 Thread Tom Lane
Oleg Bartunov writes: > We usually say about 200 unique values as a limit for > gist_int_ops. That seems awfully small ... should we make gist_intbig_ops the default, or more likely, raise the signature size of both opclasses? Even at a crossover point of 1 I'm not sure that many real-world

Re: [PERFORM] Extremely slow intarray index creation and inserts.

2009-03-19 Thread Oleg Bartunov
We usually say about 200 unique values as a limit for gist_int_ops. On Wed, 18 Mar 2009, Tom Lane wrote: Ron Mayer writes: Oleg Bartunov wrote: OB:> it's not about short or long arrays, it's about small or big OB:> cardinality of the whole set (the number of unique elements) I'm re-reading

Re: [PERFORM] Extremely slow intarray index creation and inserts.

2009-03-18 Thread Tom Lane
Ron Mayer writes: > Oleg Bartunov wrote: > OB:> it's not about short or long arrays, it's about small or big > OB:> cardinality of the whole set (the number of unique elements) > I'm re-reading the docs and still wasn't obvious to me. A > potential docs patch is attached below. Done, though no

Re: [PERFORM] Extremely slow intarray index creation and inserts.

2009-03-18 Thread Ron Mayer
Tom Lane wrote: > Ron Mayer writes: >> vm=# create index "gist7" on tmp_intarray_test using GIST (my_int_array >> gist__int_ops); >> CREATE INDEX >> Time: 2069836.856 ms > >> Is that expected, or does it sound like a bug to take over >> half an hour to index 7 rows of mostly 5 and 6-elem

Re: [PERFORM] Extremely slow intarray index creation and inserts.

2009-03-17 Thread Tom Lane
Ron Mayer writes: > vm=# create index "gist7" on tmp_intarray_test using GIST (my_int_array > gist__int_ops); > CREATE INDEX > Time: 2069836.856 ms > Is that expected, or does it sound like a bug to take over > half an hour to index 7 rows of mostly 5 and 6-element > integer arrays? I p

Re: [PERFORM] Extremely slow intarray index creation and inserts.

2009-03-17 Thread Ron Mayer
Ron Mayer wrote: > This table summarizes some of the times, shown more completely > in a script below. > = > create gist index on 1 = 5 seconds > create gist index on 2 = 32 seconds > create gist index on 3 = 39

[PERFORM] Extremely slow intarray index creation and inserts.

2009-03-17 Thread Ron Mayer
Short summary: * extremely slow intarray indexes with gist__int_ops * gist__intbig_ops seems much faster even with short arrays * gin seems much much faster for inserts and creation(and queries) I was debugging a system with a table that slowed to where individual inserts were taking