Re: Bulk Insert into PostgreSQL

2018-07-05 Thread Srinivas Karthik V
, Srinivas Karthik On Wed, Jul 4, 2018 at 10:27 PM, Peter Geoghegan wrote: > On Tue, Jul 3, 2018 at 4:34 PM, Srinivas Karthik V > wrote: > > @Peter: I was indexing the primary key of all the tables in tpc-ds. Some > of > > the fact tables has multiple columns as part of the prim

Re: Bulk Insert into PostgreSQL

2018-07-03 Thread Srinivas Karthik V
@Peter: I was indexing the primary key of all the tables in tpc-ds. Some of the fact tables has multiple columns as part of the primary key. Also, most of them are numeric type. On Mon, Jul 2, 2018 at 7:09 AM, Peter Geoghegan wrote: > On Sun, Jul 1, 2018 at 5:19 PM, Tsunakawa, Takayuki > wrote:

Re: Bulk Insert into PostgreSQL

2018-06-29 Thread Srinivas Karthik V
I was using copy command to load. Removing the primary key constraint on the table and then loading it helps a lot. In fact, a 400GB table was loaded and the primary constraint was added in around 15 hours. Thanks for the wonderful suggestions. Regards, Srinivas Karthik On 28 Jun 2018 2:07 a.m.,

Bulk Insert into PostgreSQL

2018-06-27 Thread Srinivas Karthik V
Hi, I am performing a bulk insert of 1TB TPC-DS benchmark data into PostgreSQL 9.4. It's taking around two days to insert 100 GB of data. Please let me know your suggestions to improve the performance. Below are the configuration parameters I am using: shared_buffers =12GB maintainence_work_mem = 8