Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-05-17 Thread Edson Richter
Em 17/05/2016 11:07, Merlin Moncure escreveu: On Mon, Apr 25, 2016 at 8:48 PM, Adam Brusselback wrote: It is not difficult to simulate column store in a row store system if you're willing to decompose your tables into (what is essentially) BCNF fragments. It simply is laborious for designers a

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-05-17 Thread Merlin Moncure
On Mon, Apr 25, 2016 at 8:48 PM, Adam Brusselback wrote: >>It is not difficult to simulate column store in a row store system if >>you're willing to decompose your tables into (what is essentially) >>BCNF fragments. It simply is laborious for designers and programmers. > > I could see a true colu

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-05-17 Thread Bráulio Bhavamitra
Alvaro, is this related or dependent on https://www.pgcon.org/2016/schedule/events/920.en.html ? On Mon, Apr 25, 2016 at 11:20 AM Alvaro Herrera wrote: > Bráulio Bhavamitra wrote: > > Hi all, > > > > I'm finally having performance issues with PostgreSQL when doing big > > analytics queries over

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-05-10 Thread Bruce Momjian
On Mon, Apr 25, 2016 at 11:20:11AM -0300, Alvaro Herrera wrote: > In our design, columnar or not is going to be an option: you're going to > be able to say "Dear server, for this table kindly set up columnar > storage for me, would you? Thank you very much." And then you’re going > to get a table w

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-26 Thread George Neuner
On Mon, 25 Apr 2016 21:48:44 -0400, Adam Brusselback wrote: >>It is not difficult to simulate column store in a row store system if >>you're willing to decompose your tables into (what is essentially) >>BCNF fragments. It simply is laborious for designers and programmers. > >I could see a true c

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-25 Thread Adam Brusselback
>It is not difficult to simulate column store in a row store system if >you're willing to decompose your tables into (what is essentially) >BCNF fragments. It simply is laborious for designers and programmers. I could see a true column store having much better performance than tricking a row base

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-25 Thread George Neuner
On Thu, 21 Apr 2016 09:08:22 -0700, "David G. Johnston" wrote: >?I have little experience (and nothing practical) with columnar store but >at a high level I don't see the point. At the high level, it's about avoiding fetching data you don't need. In a row store system, in general you must fetc

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-25 Thread Merlin Moncure
On Mon, Apr 25, 2016 at 9:20 AM, Alvaro Herrera wrote: > Bráulio Bhavamitra wrote: >> Hi all, >> >> I'm finally having performance issues with PostgreSQL when doing big >> analytics queries over almost the entire database of more than 100gb of >> data. >> >> And what I keep reading all over the we

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-25 Thread Bráulio Bhavamitra
On Mon, Apr 25, 2016 at 11:20 AM Alvaro Herrera wrote: > Bráulio Bhavamitra wrote: > > Hi all, > > > > I'm finally having performance issues with PostgreSQL when doing big > > analytics queries over almost the entire database of more than 100gb of > > data. > > > > And what I keep reading all ove

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-25 Thread Alvaro Herrera
Bráulio Bhavamitra wrote: > Hi all, > > I'm finally having performance issues with PostgreSQL when doing big > analytics queries over almost the entire database of more than 100gb of > data. > > And what I keep reading all over the web is many databases switching to > columnar store (RedShift, Ca

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-22 Thread Guyren Howe
On Apr 22, 2016, at 15:03 , Merlin Moncure wrote: > > On Thu, Apr 21, 2016 at 5:08 AM, Bráulio Bhavamitra > wrote: >> I'm finally having performance issues with PostgreSQL when doing big >> analytics queries over almost the entire database of more than 100gb of >> data. >> >> And what I keep r

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-22 Thread Merlin Moncure
On Thu, Apr 21, 2016 at 5:08 AM, Bráulio Bhavamitra wrote: > Hi all, > > I'm finally having performance issues with PostgreSQL when doing big > analytics queries over almost the entire database of more than 100gb of > data. > > And what I keep reading all over the web is many databases switching t

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-22 Thread jje
An interesting topic we have also discussed in our team. Realistically - this is more about picking the right software for the job. PostgreSQL has come so far up in it's performance for more general workloads that it is fast becoming a bit of a darling in the world of cloud - being able to handle

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-21 Thread Bráulio Bhavamitra
On Thu, Apr 21, 2016 at 1:39 PM Geoff Winkless wrote: > On 21 April 2016 at 17:08, David G. Johnston > wrote: > > I have little experience (and nothing practical) with columnar store but > at > > a high level I don't see the point. I would hope that anyone interested > in > > working on a colum

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-21 Thread Geoff Winkless
On 21 April 2016 at 17:08, David G. Johnston wrote: > I have little experience (and nothing practical) with columnar store but at > a high level I don't see the point. I would hope that anyone interested in > working on a columnar store database would pick an existing one to improve > rather than

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-21 Thread David G. Johnston
On Thu, Apr 21, 2016 at 3:08 AM, Bráulio Bhavamitra wrote: > Hi all, > > I'm finally having performance issues with PostgreSQL when doing big > analytics queries over almost the entire database of more than 100gb of > data. > > And what I keep reading all over the web is many databases switching

Re: [GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-21 Thread Francisco Olarte
Hi Bráulio: On Thu, Apr 21, 2016 at 12:08 PM, Bráulio Bhavamitra wrote: > And what I keep reading all over the web is many databases switching to > columnar store (RedShift, Cassandra, cstore_fdw, etc) and having great > performance on queries in general and giant boosts with big analytics > quer

[GENERAL] Columnar store as default for PostgreSQL 10?

2016-04-21 Thread Bráulio Bhavamitra
Hi all, I'm finally having performance issues with PostgreSQL when doing big analytics queries over almost the entire database of more than 100gb of data. And what I keep reading all over the web is many databases switching to columnar store (RedShift, Cassandra, cstore_fdw, etc) and having great