On 3/13/2008 12:25 PM, Emanuel Petr wrote:
Cédric Villemain wrote:
Le Thursday 13 March 2008, Emanuel Petr a écrit :
Hi all,
we have problem to replicate 12 GB table.

Note: Other smaller tables were replicated without problem.

Here is what I see on "slave" node.
$ grep 'action"' /var/log/slony1/slon-db.log
DEBUG2 remoteWorkerThread_1: prepare to copy table "public"."action"
DEBUG2 remoteWorkerThread_1: copy table "public"."action"
DEBUG2 remoteWorkerThread_1: Begin COPY of table "public"."action"
NOTICE:  truncate of "public"."action" failed - doing delete

DEBUG2 remoteWorkerThread_1: prepare to copy table "public"."action"
DEBUG2 remoteWorkerThread_1: copy table "public"."action"
DEBUG2 remoteWorkerThread_1: Begin COPY of table "public"."action"
NOTICE:  truncate of "public"."action" failed - doing delete
DEBUG2 remoteWorkerThread_1: 6584477358 bytes copied for table
"public"."action"

DEBUG2 remoteWorkerThread_1: prepare to copy table "public"."action"
DEBUG2 remoteWorkerThread_1: copy table "public"."action"
DEBUG2 remoteWorkerThread_1: Begin COPY of table "public"."action"
NOTICE:  truncate of "public"."action" failed - doing delete
DEBUG2 remoteWorkerThread_1: 6587572735 bytes copied for table
"public"."action"

DEBUG2 remoteWorkerThread_1: prepare to copy table "public"."action"
DEBUG2 remoteWorkerThread_1: copy table "public"."action"
DEBUG2 remoteWorkerThread_1: Begin COPY of table "public"."action"
NOTICE:  truncate of "public"."action" failed - doing delete

I can't find any error message in the log.

I think you probably have made other try before.

No, there was only one try. It was aim to show you, that COPY action for this table is in a loop.

The question is what aborts the subscription process. Since the copy operation in the second and third attempt above did succeed, it might not be related to that table itself, but something that happens later. Can you provide the entire log from one "prepare to copy ..." to the next?


Jan



If for any reason, slony can not truncate the table before replicating it, it delete every lines.

The table on "slave" node was blank before replication start.
And the message "truncate of ... failed - doing delete" appears for another tables, which were replicated without problem. So I don't think it's the problem.

There is problem only with bigger (over 10GB) tables.


68GB/12GB give about 5 tests to replicate the table ?

I ommit the last versions of everything you are using.... (os, kernel, postgres and slony)

You must truncate manualy the tables on the 'slave', then restarting your replica from scratch.

And now I'm not able to work with this "badly" replicated table. Each command on this table hang up. Note: Slony is stopped.



COPY event for this "big" table is in a loop and table size on "slave"
node is still growing.

On "Master" node, the table size is 12GB.
On "Slave" node the tables size was 68GB before I have stopped the
replication.


-------------

OS: Ubuntu 6.06.2 LTS , 2.6.15-29-amd64-server, x86_64

DB: postgresql-8.1

SLONY: Version: 1.2.9-2ubuntu0~dapper0


Detail of our problematic "12GB" table
=# \d+ action;
                                             Table "public.action"
    Column   |            Type             |
Modifiers                      | Description
------------+-----------------------------+--------------------------------
---------------------+------------- id | integer | not null default
nextval('action_id_seq'::regclass) |
  clientid   | integer                     |

  action     | integer                     | not null

  response   | integer                     |

  startdate  | timestamp without time zone | not null default now()

  clienttrid | character varying(128)      | not null

  enddate    | timestamp without time zone |

  servertrid | character varying(128)      |

Indexes:
     "action_pkey" PRIMARY KEY, btree (id)
     "action_servertrid_key" UNIQUE, btree (servertrid)
     "action_action_idx" btree ("action")
     "action_clientid_idx" btree (clientid)
     "action_response_idx" btree (response)
     "action_startdate_idx" btree (startdate)
Foreign-key constraints:
     "action_action_fkey" FOREIGN KEY ("action") REFERENCES enum_action(id)
     "action_clientid_fkey" FOREIGN KEY (clientid) REFERENCES "login"(id)
     "action_response_fkey" FOREIGN KEY (response) REFERENCES
enum_error(id)


---------------

Does anyone have an idea what could be wrong?

Thanks,
Petr
_______________________________________________
Slony1-general mailing list
[email protected]
http://lists.slony.info/mailman/listinfo/slony1-general



_______________________________________________
Slony1-general mailing list
[email protected]
http://lists.slony.info/mailman/listinfo/slony1-general


--
#======================================================================#
# It's easier to get forgiveness for being wrong than for being right. #
# Let's break this rule - forgive me.                                  #
#================================================== [EMAIL PROTECTED] #

_______________________________________________
Slony1-general mailing list
[email protected]
http://lists.slony.info/mailman/listinfo/slony1-general

Reply via email to