[GENERAL] PostgreSQL and Windows 10 upgrade

2015-09-23 Thread Daniel Begin
Does anyone running PostgreSQL 9.3 on Windows 7 has upgraded to Windows 10? Successfully or not. Daniel

Re: [GENERAL] Advise on memory usage limitation by PostgreSQL on Windows

2015-09-23 Thread Daniel Begin
Venkata , Not really an advice but the wiki has specific comments about shared_buffers values in Windows environment. See… http://www.postgresql.org/docs/current/static/runtime-config-resource.html#GUC-SHARED-BUFFERS I use a Windows 7 64b, 16 GB RAM, 4 cores. According to the above link I

Re: [GENERAL] Planner cost adjustments

2015-06-19 Thread Daniel Begin
o all, Daniel -Original Message- From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Francisco Olarte Sent: June-11-15 10:05 To: Daniel Begin Cc: Bill Moran; pgsql-general@postgresql.org; Tomas Vondra; Melvin Davidson Subject: Re: [GENERAL] Pl

Re: [GENERAL] Planner cost adjustments

2015-06-11 Thread Daniel Begin
best solution but the problem is definitely narrower :-) Daniel -Original Message- From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Bill Moran Sent: June-11-15 06:51 To: Daniel Begin Cc: pgsql-general@postgresql.org; 'Tomas Vondra'; &

Re: [GENERAL] Planner cost adjustments

2015-06-10 Thread Daniel Begin
rget to 500, or even to 1000? Is there something else I can trigger to get the appropriate plan? Comments/explanations would be appreciated Daniel -Original Message- From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Daniel Begin Sent: June

Re: [GENERAL] Problem when temp_tablespace get full?

2015-06-03 Thread Daniel Begin
react/manage the situation? Daniel From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of David G. Johnston Sent: June-03-15 11:54 To: Daniel Begin Cc: pgsql-general@postgresql.org Subject: Re: [GENERAL] Problem when temp_tablespace get full? On

[GENERAL] Problem when temp_tablespace get full?

2015-06-03 Thread Daniel Begin
Context. A query almost filled a SSD drive (temp_tablespace) and my PC got unresponsive; I did SELECT pg_cancel_backend(6600); 6600 was the pid of the process and got a successful answer (t) However, just after that, the disk simply turned off and the system crashed. I was able to restart the P

Re: [GENERAL] Planner cost adjustments

2015-06-03 Thread Daniel Begin
PostgreSQL developers so they can improve the planner). And I am still open to other proposal Daniel -Original Message- From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Bill Moran Sent: June-02-15 23:31 To: Daniel Begin Cc: pgsql-general

Re: [GENERAL] Planner cost adjustments

2015-06-02 Thread Daniel Begin
Here is a follow-up on the step-by-step procedure proposed by PT #1 - setup postgresql planner's cost estimate settings for my hardware. -- Current parameters values described in section 18.7.2 haven't been chang

Re: [GENERAL] Planner cost adjustments

2015-05-29 Thread Daniel Begin
s that "on Windows the useful range is 64MB to 512MB". Best regards, Daniel -Original Message- From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Tomas Vondra Sent: May-29-15 20:19 To: Daniel Begin; 'PT' Cc: pgsql-gene

Re: [GENERAL] Planner cost adjustments

2015-05-29 Thread Daniel Begin
age = 5000 vacuum_freeze_table_age = 15000 vacuum_multixact_freeze_min_age = 500 vacuum_multixact_freeze_table_age= 15000 -Original Message- From: PT [mailto:wmo...@potentialtech.com] Sent: May-29-15 16:35 To: Daniel Begin Cc: pgsql-general@postgresql.org Subject: Re

[GENERAL] Planner cost adjustments

2015-05-29 Thread Daniel Begin
Hi all, Running some queries, I found that the planner often selects sequential scan instead of an index scan, even if the latter is way faster (one order of magnitude faster if I consider some tests I made by setting enable_seqscan = ON/OFF). How can I figure out what parameter I should adjust to

Re: [GENERAL] FW: Constraint exclusion in partitions

2015-05-25 Thread Daniel Begin
Thank for your patience :-) - About using PgAdmin, anecdotal problems or not, I did the whole tests again in plain postgresql. - About running queries once or not, Bill and Francisco both pointed out somehow that I should run each query multiple times to get appropriate statistics. I did it fo

Re: [GENERAL] FW: Constraint exclusion in partitions

2015-05-23 Thread Daniel Begin
Oops, I was responding to the email below from melvin6925 From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of David G. Johnston Sent: May-23-15 19:32 To: Daniel Begin Cc: melvin6925; pgsql-general@postgresql.org Subject: Re: [GENERAL] [NOVICE

Re: [GENERAL] FW: Constraint exclusion in partitions

2015-05-23 Thread Daniel Begin
g time) but I swear, I did not change the times when editing table names!-) Do you see any glitch/flaw in the procedure I am using? Someone has an idea about the problem behind this unexpected behavior? I really need to get much faster results with my queries on this large table and partitioni

Re: [GENERAL] FW: Constraint exclusion in partitions

2015-05-23 Thread Daniel Begin
was used at least for constant id and range of ids Daniel From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of melvin6925 Sent: May-23-15 15:15 To: Daniel Begin; pgsql-general@postgresql.org Subject: Re: [GENERAL] FW: Constraint exclusion

Re: [GENERAL] FW: Constraint exclusion in partitions

2015-05-23 Thread Daniel Begin
Following Francisco suggestion, I was able to do some tests earlier this morning when the partitioning process completed and all the resulting tables analyzed. Here is what I got on both the original table and its partitioned counterpart while running the same queries. I tested them only for a

[GENERAL] FW: Constraint exclusion in partitions

2015-05-22 Thread Daniel Begin
Sent that on pgsql-novice list but did not get any answers yet. Maybe someone could help me understand here J Hi all, I have split a large table (billions of records) into multiple partitions, hoping the access would be faster. I used an ID to make partitions check (check (id >= 100 A

Re: [GENERAL] Restarting DB after moving to another drive

2015-05-16 Thread Daniel Begin
...@postgresql.org] On Behalf Of Daniel Begin Sent: May-15-15 15:17 To: 'Francisco Olarte' Cc: r...@iol.ie; pgsql-general@postgresql.org Subject: Re: [GENERAL] Restarting DB after moving to another drive Thank for that comprehensive response! And you are right about practicing restore, I ne

Re: [GENERAL] Restarting DB after moving to another drive

2015-05-15 Thread Daniel Begin
al-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Francisco Olarte Sent: May-15-15 12:20 To: Daniel Begin Cc: r...@iol.ie; pgsql-general@postgresql.org Subject: Re: [GENERAL] Restarting DB after moving to another drive HI Daniel: On Fri, May 15, 2015 at 5:35 PM, Daniel Begin

Re: [GENERAL] Restarting DB after moving to another drive

2015-05-15 Thread Daniel Begin
ql.org] On Behalf Of Francisco Olarte Sent: May-15-15 05:12 To: Daniel Begin Cc: r...@iol.ie; pgsql-general@postgresql.org Subject: Re: [GENERAL] Restarting DB after moving to another drive Hi Daniel: On Wed, May 13, 2015 at 8:06 PM, Daniel Begin wrote: ... > - I still have a lot to learn on data

Re: [GENERAL] Restarting DB after moving to another drive

2015-05-13 Thread Daniel Begin
ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of John R Pierce Sent: May-13-15 14:16 To: pgsql-general@postgresql.org Subject: Re: [GENERAL] Restarting DB after moving to another drive On 5/13/2015 11:06 AM, Daniel Begin wrote: > I am then currently running pg_dumpall

Re: [GENERAL] Restarting DB after moving to another drive

2015-05-13 Thread Daniel Begin
gresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Francisco Olarte Sent: May-13-15 06:57 To: Daniel Begin Cc: r...@iol.ie; pgsql-general@postgresql.org Subject: Re: [GENERAL] Restarting DB after moving to another drive Hi Daniel: On Mon, May 11, 2015 at 5:30 PM, Daniel Begin wrote

Re: [GENERAL] Restarting DB after moving to another drive

2015-05-11 Thread Daniel Begin
g] On Behalf Of Marc Mamin Sent: May-11-15 13:10 To: Daniel Begin; 'Francisco Olarte' Cc: r...@iol.ie; pgsql-general@postgresql.org Subject: Re: [GENERAL] Restarting DB after moving to another drive Hi, have you checked that the links in $PGDATA\pg_tblspc on the new drive are valid ? They possi

Re: [GENERAL] Restarting DB after moving to another drive

2015-05-11 Thread Daniel Begin
l.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Francisco Olarte Sent: May-11-15 11:01 To: Daniel Begin Cc: r...@iol.ie; pgsql-general@postgresql.org Subject: Re: [GENERAL] Restarting DB after moving to another drive Hi Daniel. On Mon, May 11, 2015 at 4:42 PM, Daniel Begin wrote: &

Re: [GENERAL] Restarting DB after moving to another drive

2015-05-11 Thread Daniel Begin
Behalf Of Raymond O'Donnell Sent: May-11-15 09:19 To: Daniel Begin; pgsql-general@postgresql.org Subject: Re: [GENERAL] Restarting DB after moving to another drive On 11/05/2015 13:38, Daniel Begin wrote: > I just get it back running with the old drive - was some Windows > hidd

Re: [GENERAL] Restarting DB after moving to another drive

2015-05-11 Thread Daniel Begin
O'Donnell [mailto:r...@iol.ie] Sent: May-11-15 07:50 To: Daniel Begin; pgsql-general@postgresql.org Subject: Re: [GENERAL] Restarting DB after moving to another drive On 11/05/2015 12:03, Daniel Begin wrote: > I am working on windows and I had to move my database on another hard > driv

[GENERAL] Restarting DB after moving to another drive

2015-05-11 Thread Daniel Begin
I am working on windows and I had to move my database on another hard drive after the original one started overheating. In order to move the DB I did the following. -Stop postgresql-x64-9.3 service - and wait until there were no more system access to on the original drive -Copy the entire cont

Re: [GENERAL] Indexing large table of coordinates with GiST

2015-01-16 Thread Daniel Begin
pgsql-general-ow...@postgresql.org] On Behalf Of Nathan Clayton Sent: January-15-15 19:19 To: pgsql-general@postgresql.org Subject: Re: [GENERAL] Indexing large table of coordinates with GiST On 1/15/2015 12:36 PM, Daniel Begin wrote: > > Thank, there is a lot of potential ways to resolve t

Re: [GENERAL] Indexing large table of coordinates with GiST

2015-01-16 Thread Daniel Begin
pgsql-general-ow...@postgresql.org] On Behalf Of Nathan Clayton Sent: January-15-15 19:19 To: pgsql-general@postgresql.org Subject: Re: [GENERAL] Indexing large table of coordinates with GiST On 1/15/2015 12:36 PM, Daniel Begin wrote: > > Thank, there is a lot of potential ways to resolve t

Re: [GENERAL] Indexing large table of coordinates with GiST

2015-01-15 Thread Daniel Begin
aniel __ On Thu, Jan 15, 2015 at 7:44 AM, Daniel Begin wrote: Hi, I'm trying to create an index on coordinates (geography type) over a large table (4.5 billion records) using GiST... CREATE INDEX nodes_geom_idx ON nodes USING

[GENERAL] Indexing large table of coordinates with GiST

2015-01-15 Thread Daniel Begin
Hi, I'm trying to create an index on coordinates (geography type) over a large table (4.5 billion records) using GiST... CREATE INDEX nodes_geom_idx ON nodes USING gist (geom); The command ran for 5 days until my computer stops because a power outage! Before restarting the index creation, I am as

Re: [GENERAL] Removing duplicate records from a bulk upload (rationale behind selecting a method)

2014-12-12 Thread Daniel Begin
soon with useful results Daniel From: Marc Mamin [mailto:m.ma...@intershop.de] Sent: December-12-14 14:25 To: John McKown; Daniel Begin Cc: Tom Lane; Scott Marlowe; Andy Colson; PostgreSQL General Subject: AW: [GENERAL] Removing duplicate records from a bulk upload (rationale behind se

Re: [GENERAL] Removing duplicate records from a bulk upload (rationale behind selecting a method)

2014-12-12 Thread Daniel Begin
4 06:41 To: Daniel Begin; 'Tom Lane'; 'Scott Marlowe' Cc: 'Andy Colson'; pgsql-general@postgresql.org Subject: Re: [GENERAL] Removing duplicate records from a bulk upload (rationale behind selecting a method) >Thank Tom, >I understand that the rationale behind

Re: [GENERAL] Removing duplicate records from a bulk upload (rationale behind selecting a method)

2014-12-09 Thread Daniel Begin
-Original Message- From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Tom Lane Sent: December-08-14 21:52 To: Scott Marlowe Cc: Andy Colson; Daniel Begin; pgsql-general@postgresql.org Subject: Re: [GENERAL] Removing duplicate records from a bulk upload

Re: [GENERAL] Removing duplicate records from a bulk upload (rationale behind selecting a method)

2014-12-08 Thread Daniel Begin
> On 12/7/2014 9:31 PM, Daniel Begin wrote: >> I have just completed the bulk upload of a large database. Some >> tables have billions of records and no constraints or indexes have >> been applied yet. About 0.1% of these records may have been >> duplicated during the

[GENERAL] Removing duplicate records from a bulk upload

2014-12-07 Thread Daniel Begin
I have just completed the bulk upload of a large database. Some tables have billions of records and no constraints or indexes have been applied yet. About 0.1% of these records may have been duplicated during the upload and I need to remove them before applying constraints. I understand ther

Re: [GENERAL] Inconsistency between PgAdmin III GUI and SQL window ?

2014-10-23 Thread Daniel Begin
the search path to xxx AND public schema (set search_path to xxx, public;) everything goes right! Daniel -Original Message- From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Adrian Klaver Sent: October-22-14 09:46 To: Daniel Begin; 'Da

Re: [GENERAL] Inconsistency between PgAdmin III GUI and SQL window ?

2014-10-22 Thread Daniel Begin
To: Daniel Begin; pgsql-general@postgresql.org Subject: Re: [GENERAL] Inconsistency between PgAdmin III GUI and SQL window ? On 10/21/2014 03:33 PM, Daniel Begin wrote: > I have first to admit the inconsistency is probably on my side!-) > > The task - I want to clone a table I created

[GENERAL] Inconsistency between PgAdmin III GUI and SQL window ?

2014-10-21 Thread Daniel Begin
I have first to admit the inconsistency is probably on my side!-) The task - I want to clone a table I created in public schema in another schema (xxx) of the same database. The problem - I get an error message when creating the table using the original SQL script: ERROR: type "geography" does not

Re: [GENERAL] Best practices for Large import in empty database?

2014-10-01 Thread Daniel Begin
Oups, right to the point! Thanks... -Original Message- From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Tom Lane Sent: October-01-14 10:38 To: Daniel Begin Cc: pgsql-general@postgresql.org Subject: Re: [GENERAL] Best practices for Large

[GENERAL] Best practices for Large import in empty database?

2014-10-01 Thread Daniel Begin
I am about to feed an empty database with a large import of data (the size of csv files is about 500 GB). Tables are created but I haven't added any constraints or indexes yet. I wonder whether the best practice is to add them before or after the import. Are there other good practices that would ea

Re: [GENERAL] PostgreSQL Portable

2014-09-11 Thread Daniel Begin
Wow, I was not expecting so many skillful feedbacks - Thanks to all I am not closing the point yet since, as Steve Crawford suggested, the solution I am looking for (as newbie) might not be optimal !-) So here is more context. All PCs run W7/64b (different hardware) and I will be the only u

[GENERAL] PostgreSQL Portable

2014-09-10 Thread Daniel Begin
First, I am a Newbie regarding PostgreSQL . I just started to look at PostgreSQL to implement a large GIS DB (1Tb). The data must reside in an external disk with eSATA connection and may be moved to different locations (and Windows desktops/laptops). I was looking to install PostgreSQL and Pos