Re: Tools to migrate data from Json files to PostgreSQL DB.

2019-03-07 Thread Tony Shelver
You may want to assess how you want to store and access the data in Postgres before deciding on an import strategy. I have a system with a mix of relational and JSON data. The data was originally sourced in flat file format. I wrote a few Python programs to take the data, then format to JSON, whi

Re: partial data migration

2019-03-07 Thread Adrian Klaver
On 3/7/19 5:53 PM, Julie Nishimura wrote: Thank you Ron! What if dev environment is on 9.6, but prod is on version 8.3? Will posgtres_fdw still be the right option? Thanks to the documentation writers: https://www.postgresql.org/docs/11/postgres-fdw.html#id-1.11.7.42.15 Sent from my iPhone

Re: Tools to migrate data from Json files to PostgreSQL DB.

2019-03-07 Thread Pavel Stehule
Hi čt 7. 3. 2019 v 22:21 odesílatel github kran napsal: > Hello PostgreSQL Team, > > Are there are any tools to migrate data present in the json files ? to the > postgreSQL database. > We have data in flat files about 2 billion records across multiple files. > > 1) What is the easiest way I can

Re: partial data migration

2019-03-07 Thread Julie Nishimura
Great, thanks! Sent from my iPhone On Mar 7, 2019, at 7:48 PM, Ron mailto:ronljohnso...@gmail.com>> wrote: Yes, for whole tables (even sets of tables) "pg_dump --table=" is good at that. Even better, you can run the 9.6 pg_dump against the 8.3 database and get parallelism with "--jobs". On

Re: partial data migration

2019-03-07 Thread Ron
Yes, for whole tables (even sets of tables) "pg_dump --table=" is good at that.  Even better, you can run the 9.6 pg_dump against the 8.3 database and get parallelism with "--jobs". On 3/7/19 8:11 PM, Julie Nishimura wrote: Ron, thanksagain. In case if I need to migrate the entire tables, I sho

Re: partial data migration

2019-03-07 Thread Julie Nishimura
Ron, thanksagain. In case if I need to migrate the entire tables, I should be able to use pg_dump and pg_restore for certain tables, even between different versions, right? In case if I need to migrate from 8 to 9? Thanks From: Ron Sent: Thursday, March 7, 2019

Re: partial data migration

2019-03-07 Thread Ron
(8.3?  That's even older than what we just migrated from!!!) No.  Make some views (I'd probably make them "month-sized"), COPY each view from the source db to a file, and then COPY each file to it's relevant target table. You should also think about a program named pg_bulkload. https://www.p

Re: partial data migration

2019-03-07 Thread Julie Nishimura
Thank you Ron! What if dev environment is on 9.6, but prod is on version 8.3? Will posgtres_fdw still be the right option? Sent from my iPhone On Mar 6, 2019, at 11:57 PM, Ron mailto:ronljohnso...@gmail.com>> wrote: On 3/7/19 1:54 AM, Julie Nishimura wrote: Hello psql friends, We need to migra

Re: Future Non-server Windows support???

2019-03-07 Thread Ron
On 3/7/19 2:58 PM, Bill Haught wrote: [snip] Like why would anyone choose Winbloz *if* you don't *have* too, I have no idea. 1999 wants it's insult back. -- Angular momentum makes the world go 'round.

Re: Tools to migrate data from Json files to PostgreSQL DB.

2019-03-07 Thread Adrian Klaver
On 3/7/19 1:21 PM, github kran wrote: Hello PostgreSQL Team, Are there are any tools to migrate data present in the json files ? to the postgreSQL database. We have data in flat files about 2 billion records across multiple files. 1) What is the easiest way I can transfer this data to relatio

Tools to migrate data from Json files to PostgreSQL DB.

2019-03-07 Thread github kran
Hello PostgreSQL Team, Are there are any tools to migrate data present in the json files ? to the postgreSQL database. We have data in flat files about 2 billion records across multiple files. 1) What is the easiest way I can transfer this data to relational database ?. 2) Any tools I can use ?.

Re: Property Graph Query Language proposed for SQL:2020

2019-03-07 Thread Peter Eisentraut
On 2019-02-25 01:09, Stefan Keller wrote: > Anyone aware and following this standardization activities? > Forthcoming SQL:2020 seems to contain "Property Graph Query Extensions". > See: > * GQL: a standard for property graph querying > https://www.gqlstandards.org/ > * Property Graph Query Language

Re: Future Non-server Windows support???

2019-03-07 Thread Adrian Klaver
On 3/7/19 12:58 PM, Bill Haught wrote: On 3/7/2019 8:29 PM, Thomas Kellerer wrote: Bill Haught schrieb am 07.03.2019 um 20:41: "...most Windows 95 applications still run fine in Windows 10 - that's 20 years of binary compatibility"  See Major Linux Problems on the Desktop, 2018 edition by Artem

Re: python install location

2019-03-07 Thread Peter Eisentraut
On 2019-03-07 01:12, Alan Nilsson wrote: > How does postgres determine which install of python to use in conjunction > with plpythonu? It looks for a "python" program and then uses that to find the location of the required library. > Is there a way, in postgres, short of rebuilding that we can t

Re: Future Non-server Windows support???

2019-03-07 Thread Bill Haught
On 3/7/2019 8:29 PM, Thomas Kellerer wrote: Bill Haught schrieb am 07.03.2019 um 20:41: "...most Windows 95 applications still run fine in Windows 10 - that's 20 years of binary compatibility"  See Major Linux Problems on the Desktop, 2018 edition by Artem S. Tashkinov https://itvision.altervis

Re: Future Non-server Windows support???

2019-03-07 Thread Thomas Kellerer
Bill Haught schrieb am 07.03.2019 um 20:41: "...most Windows 95 applications still run fine in Windows 10 - that's 20 years of binary compatibility" See Major Linux Problems on the Desktop, 2018 edition by Artem S. Tashkinov https://itvision.altervista.org/why.linux.is.not.ready.for.the.desktop

Re: Connection pooling for differing databases?

2019-03-07 Thread Jerry Sievers
Arjun Ranade writes: > Hi all, > > I'm wondering if there's a tool like pgpool that can provide a single > origin point (host/port) that will proxy/direct connections to the > specific servers that contain the db needing to be accessed. > > For example... lets say we had two databases: db1.compan

Re: Connection pooling for differing databases?

2019-03-07 Thread Arjun Ranade
I'm looking at pgbouncer and it does most of what I need. I'm wondering about clients connecting via pgadmin, is there a way for users using pgadmin or another tool to see all the databases that are part of the configs? Thanks, Arjun On Thu, Mar 7, 2019 at 2:39 PM Moreno Andreo wrote: > Il 07/

Re: Future Non-server Windows support???

2019-03-07 Thread Bill Haught
On 3/3/2019 7:30 AM, Laurenz Albe wrote: Bill Haught wrote: My main concern is that Microsoft has Enterprise versions of Windows and versions for everything else which makes me wonder if at some point Windows versions for desktop use may not have features needed by some database applications or

Re: Connection pooling for differing databases?

2019-03-07 Thread Moreno Andreo
Il 07/03/2019 20:27, Arjun Ranade ha scritto: Hi all, I'm wondering if there's a tool like pgpool that can provide a single origin point (host/port) that will proxy/direct connections to the specific servers that contain the db needing to be accessed. Yes, I think there are many, but I'm encou

Re: Connection pooling for differing databases?

2019-03-07 Thread Fabrízio de Royes Mello
Em qui, 7 de mar de 2019 às 16:10, Arjun Ranade escreveu: > > Hi all, > > I'm wondering if there's a tool like pgpool that can provide a single origin point (host/port) that will proxy/direct connections to the specific servers that contain the db needing to be accessed. > > For example... lets sa

Connection pooling for differing databases?

2019-03-07 Thread Arjun Ranade
Hi all, I'm wondering if there's a tool like pgpool that can provide a single origin point (host/port) that will proxy/direct connections to the specific servers that contain the db needing to be accessed. For example... lets say we had two databases: db1.company.com:5432 and db2.company.com:5433

Resolved: Question about pg_upgrade from 9.2 to X.X

2019-03-07 Thread Perumal Raj
Thanks again. Perumal Raju On Thu, Mar 7, 2019, 2:32 AM Justin Pryzby wrote: > On Wed, Mar 06, 2019 at 09:44:16PM -0800, Perumal Raj wrote: > > Any pointers for pg_repack schema creation ? > > With recent postgres, you should use just: "CREATE EXTENSION pg_repack", > which > does all that for y

Re: Question about pg_upgrade from 9.2 to X.X

2019-03-07 Thread Justin Pryzby
On Wed, Mar 06, 2019 at 09:44:16PM -0800, Perumal Raj wrote: > Any pointers for pg_repack schema creation ? With recent postgres, you should use just: "CREATE EXTENSION pg_repack", which does all that for you. > Will there be any impact in the future , Since i used --link option ? You probably h

Re: Performance comparison between Pgsql 10.5 and Pgsql 11.2

2019-03-07 Thread Nicola Contu
So the first file is on Postgres11.2 on a test server (and where I compare 10 vs 11) The second file, is our preprod machine running Postgres 11.2 (different hardware etc, it is a VM). I know that could be confusing, but I just wanted to compare that too because if you see the two files there's a l