Re: [GENERAL] Comparison of Oracle and PostgreSQL full text search

2010-07-29 Thread Howard Rogers
On Thu, Jul 29, 2010 at 10:33 PM, Dean Rasheed dean.a.rash...@gmail.com wrote: On 28 July 2010 02:58, Howard Rogers h...@diznix.com wrote: For what it's worth, I wrote up the performance comparison here: http://diznix.com/dizwell/archives/153 Thanks, very interesting results. I wonder

Re: [GENERAL] Comparison of Oracle and PostgreSQL full text search

2010-07-28 Thread Howard Rogers
On Wed, Jul 28, 2010 at 8:38 PM, Daniel Verite dan...@manitou-mail.org wrote:        zhong ming wu wrote: I always thought there is a clause in their user agreement preventing the users from publishing benchmarks like that. I must be mistaken. No you're correct. Currently, to download the

[GENERAL] Comparison of Oracle and PostgreSQL full text search

2010-07-27 Thread Howard Rogers
Thanks to some very helpful input here in earlier threads, I was finally able to pull together a working prototype Full Text Search 'engine' on PostgreSQL and compare it directly to the way the production Oracle Text works. The good news is that PostgreSQL is bloody fast! The slightly iffy news is

Re: [GENERAL] Bitmask trickiness

2010-07-23 Thread Howard Rogers
On Fri, Jul 23, 2010 at 3:02 PM, Scott Marlowe scott.marl...@gmail.com wrote: If you mean, did I read the bit in the doco where it said nothing at all in the 'these are great advantages' style I've just described, but instead makes the fairly obvious point that a bit string takes 8 bits to

Re: [GENERAL] Bitmask trickiness

2010-07-23 Thread Howard Rogers
On Fri, Jul 23, 2010 at 7:57 PM, Stephen Cook scli...@gmail.com wrote: On 7/23/2010 5:33 AM, Howard Rogers wrote: ...so select * from table where 21205 | 4097 = 21205 would correctly grab that record. So I'm assuming you mean the 'stored value' should be on both sides of the equals test

Re: [GENERAL] Bitmask trickiness

2010-07-23 Thread Howard Rogers
Hate to interrupt your flame war, and I apologize for not being precise in my meaning first try... You don't need any bitwise anything to compare two bitmasks-hiding-in-integers, just check for equality. Instead of select * from coloursample where colour 10 = 10; just try select * from

Re: [GENERAL] Bitmask trickiness

2010-07-23 Thread Howard Rogers
On Fri, Jul 23, 2010 at 6:17 PM, Alban Hertroys dal...@solfertje.student.utwente.nl wrote: I thought to do select * from coloursample where colour 10 = 10; ...but that's not right, because it finds the third record is a match. What's not entirely clear to me is whether you only want to

Re: [GENERAL] Bitmask trickiness

2010-07-22 Thread Howard Rogers
On Thu, Jul 22, 2010 at 1:02 PM, Scott Marlowe scott.marl...@gmail.com wrote: Why on Earth would I want to store this sort of stuff in a bit string?! Because you are manipulating bits and not integers?  I guess there are 10 kinds of people, those who like think in binary and those who

Re: [GENERAL] Bitmask trickiness

2010-07-22 Thread Howard Rogers
On Fri, Jul 23, 2010 at 12:35 AM, Peter Hunsberger peter.hunsber...@gmail.com wrote: On Wed, Jul 21, 2010 at 11:13 PM, Howard Rogers h...@diznix.com wrote: On Thu, Jul 22, 2010 at 1:02 PM, Scott Marlowe scott.marl...@gmail.com wrote: Why on Earth would I want to store this sort of stuff

Re: [GENERAL] Bitmask trickiness

2010-07-22 Thread Howard Rogers
On Fri, Jul 23, 2010 at 8:37 AM, Scott Marlowe scott.marl...@gmail.com wrote: On Thu, Jul 22, 2010 at 3:09 PM, Howard Rogers h...@diznix.com wrote: On Fri, Jul 23, 2010 at 12:35 AM, Peter Hunsberger peter.hunsber...@gmail.com wrote: On Wed, Jul 21, 2010 at 11:13 PM, Howard Rogers h

[GENERAL] Bitmask trickiness

2010-07-21 Thread Howard Rogers
Suppose 1=Red, 2=Yellow, 4=Green and 8=Orange. Now suppose the following data structures and rows exist: create table coloursample (recid integer, colour integer, descript varchar); insert into coloursample values (1,2,'Yellow only'); insert into coloursample values (2,10,'Yellow and Orange');

Re: [GENERAL] Bitmask trickiness

2010-07-21 Thread Howard Rogers
On Wed, Jul 21, 2010 at 9:17 PM, Mathieu De Zutter math...@dezutter.org wrote: On Wed, Jul 21, 2010 at 5:59 AM, Howard Rogers h...@diznix.com wrote: It's also easy to find records which have either some yellow or some orange (or both) in them: select * from coloursample where colour 100

[GENERAL] Full Text Search ideas

2010-07-18 Thread Howard Rogers
I asked recently about a performance problem I'd been having with some full text queries, and got really useful help that pointed me to the root issues. Currently, I'm trying to see if our document search (running on Oracle Text) can be migrated to PostgreSQL, and the reason I asked that earlier

Re: [GENERAL] Full Text Search ideas

2010-07-18 Thread Howard Rogers
On Mon, Jul 19, 2010 at 6:16 AM, Tom Lane t...@sss.pgh.pa.us wrote: Howard Rogers h...@diznix.com writes: ims=# select count(*) from search_rm where to_tsvector('english', textsearch) @@ to_tsquery('english','bat sb12n'); count ---  3849 (1 row) Time: 408.962 ms ims=# select

Re: [GENERAL] Full Text Search dictionary issues

2010-07-16 Thread Howard Rogers
On Fri, Jul 16, 2010 at 10:23 AM, Tom Lane t...@sss.pgh.pa.us wrote: Howard Rogers h...@diznix.com writes: I have 10 million rows in a table, with full text index created on one of the columns. I submit this query: ims=# select count(*) from search_rm ims-# where to_tsvector('english

Re: [GENERAL] Full Text Search dictionary issues

2010-07-16 Thread Howard Rogers
On Sat, Jul 17, 2010 at 3:14 AM, Tom Lane t...@sss.pgh.pa.us wrote: Howard Rogers h...@diznix.com writes: OK, Tom: I did actually account for the number of rows difference before I posted, though I accept I didn't show you that. So here goes: ... Both queries return zero rows. One takes

[GENERAL] Full Text Search dictionary issues

2010-07-15 Thread Howard Rogers
I have 10 million rows in a table, with full text index created on one of the columns. I submit this query: ims=# select count(*) from search_rm ims-# where to_tsvector('english', textsearch) ims-# @@ to_tsquery('english', 'woman beach ball');  count ---    646 (1 row) Time: 107.570 ms

Re: [GENERAL] Commit every N rows in PL/pgsql

2010-07-06 Thread Howard Rogers
On 06/03/2010 08:26 AM, Chris Browne wrote: len.wal...@gmail.com (Len Walter) writes: I need to populate a new column in a Postgres 8.3 table. The SQL would be something like update t set col_c = col_a + col_b. Unfortunately, this table has 110 million rows, so running that query runs out of

Re: [GENERAL] DBI::Oracle problems

2010-07-02 Thread Howard Rogers
...@fetter.org wrote: On Wed, Jun 30, 2010 at 10:10:02AM +1000, Howard Rogers wrote: I am stumped, despite working on this for a week! I am trying to create a 64-bit postgresql 8.4 database server which can retrieve data from various 64-bit Oracle 10gR2 and 11gR2 databases. Try downloading

Re: [GENERAL] DBI::Oracle problems

2010-06-30 Thread Howard Rogers
at 10:10:02AM +1000, Howard Rogers wrote: I am stumped, despite working on this for a week! I am trying to create a 64-bit postgresql 8.4 database server which can retrieve data from various 64-bit Oracle 10gR2 and 11gR2 databases. Try downloading the latest version of DBI-Link using

[GENERAL] DBI::Oracle problems

2010-06-29 Thread Howard Rogers
I am stumped, despite working on this for a week! I am trying to create a 64-bit postgresql 8.4 database server which can retrieve data from various 64-bit Oracle 10gR2 and 11gR2 databases. - I have a freshly-installed 64-bit Centos 5.5, no firewall, no SELinux. - I create an oracle user