Re: [GENERAL] PostgreSQL and Kubernetes
Il 03/04/2017 22:32, Alex Kliukin ha scritto: as it makes little sense to build an aircraft carrier to carry a single Cessna. :-) A bit extreme, but it makes the idea ... Thanks Moreno.- Kind regards, -- Oleksii “Alex" Kliukin
Re: [GENERAL] PostgreSQL and Kubernetes
Il 03/04/2017 18:10, Joe Conway ha scritto: On 03/31/2017 01:58 AM, Moreno Andreo wrote: Il 30/03/2017 14:38, Vick Khera ha scritto: On Thu, Mar 30, 2017 at 6:10 AM, Moreno Andreo mailto:moreno.and...@evolu-s.it>> wrote: Since I'm on Google Cloud Platform, I thought it would be a good idea to see what it offers. They currently have in beta a Postgres flavor of their cloudsql. I haven't used it yet, but I plan to test it sometime in the next couple of months. I'm aware of this (and I'm about to test it too), but while this is in beta I need a solution to keep up with my architecture... I can't stay with a single server and no backup (except a snapshot of the disk made on a daily basis... but that's no real backup) waiting for Cloud SQL to get out of beta... Take a look at: https://github.com/CrunchyData/crunchy-containers This is another good post... but I decided to keep the current architecture, adding a standby server managed by repmgr and load balanced by PgPool II, with barman taking care of the backup. I don't think spending more than a week studying the docs and preparing the whole thing in test lab. If I'm about to migrate to Cloud SQL I think it's not worth the effort to create a new structure and migrate in there, just for some time... and then migrate again to CloudSQL. Thanks again Moreno.- HTH, Joe -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general
Re: [GENERAL] PostgreSQL and Kubernetes
> On 30. Mar 2017, at 12:10, Moreno Andreo wrote: > as databases aren't built for type of dynamic scheduling that something like > kubernetes (or any other container management solution), due to how they > interact with the filesystem, network stack, and more. > Further more, he suggests that because of this lack of integration, that if > you do run your database in kubernetes/docker, you are very likely to > encounter data corruption and data loss" > > What's your advice? I think dynamic scheduling just increases the chances of your database instance being killed. Your K8S cluster, if not configured properly, may decide to kill your master database pod when scaling down nodes in order to utilise resources efficiently. If you run your PostgreSQL on K8S make sure you have a good and battle-tested HA setup, know your way around configuring both PostgreSQL streaming replication and Kubernetes cluster, and have a number of databases to manage, as it makes little sense to build an aircraft carrier to carry a single Cessna. Kind regards, -- Oleksii “Alex" Kliukin
Re: [GENERAL] PostgreSQL and Kubernetes
On 03/31/2017 01:58 AM, Moreno Andreo wrote: > Il 30/03/2017 14:38, Vick Khera ha scritto: >> >> On Thu, Mar 30, 2017 at 6:10 AM, Moreno Andreo >> mailto:moreno.and...@evolu-s.it>> wrote: >> >> Since I'm on Google Cloud Platform, I thought it would be a good >> idea to see what it offers. >> >> >> They currently have in beta a Postgres flavor of their cloudsql. I >> haven't used it yet, but I plan to test it sometime in the next couple >> of months. > > I'm aware of this (and I'm about to test it too), but while this is in > beta I need a solution to keep up with my architecture... I can't stay > with a single server and no backup (except a snapshot of the disk made > on a daily basis... but that's no real backup) waiting for Cloud SQL to > get out of beta... Take a look at: https://github.com/CrunchyData/crunchy-containers HTH, Joe -- Crunchy Data - http://crunchydata.com PostgreSQL Support for Secure Enterprises Consulting, Training, & Open Source Development signature.asc Description: OpenPGP digital signature
Re: [GENERAL] PostgreSQL and Kubernetes
Il 30/03/2017 14:38, Vick Khera ha scritto: On Thu, Mar 30, 2017 at 6:10 AM, Moreno Andreowrote: Since I'm on Google Cloud Platform, I thought it would be a good idea to see what it offers. They currently have in beta a Postgres flavor of their cloudsql. I haven't used it yet, but I plan to test it sometime in the next couple of months. I'm aware of this (and I'm about to test it too), but while this is in beta I need a solution to keep up with my architecture... I can't stay with a single server and no backup (except a snapshot of the disk made on a daily basis... but that's no real backup) waiting for Cloud SQL to get out of beta...
Re: [GENERAL] PostgreSQL and Kubernetes
Il 30/03/2017 15:27, Adrian Klaver ha scritto: On 03/30/2017 03:10 AM, Moreno Andreo wrote: Hi everyone, I was googling around while searching stuff to finish my cluster solution (already running in production in single-server mode) with barman and pgbouncer, when I ran into this https://hackernoon.com/postgresql-cluster-into-kubernetes-cluster-f353cde212de Since I'm on Google Cloud Platform, I thought it would be a good idea to see what it offers. [snip] What's your advice? I don't us eKubernetes, neither do I, at the moment. but if there's to dig into something new, I'm always ready! but I do know one of the former members of the Postgres Core does: https://opensource.com/article/17/2/stateful-applications That's a *niiice* article! and delivered a talk at Scale15x on it: http://www.socallinuxexpo.org/scale/15x/presentations/ccp-containerized-clustered-postgres https://www.youtube.com/watch?v=mxmZv9xkc8s I'll take a look later Thanks a lot!!! Best regards Moreno. Go to about 3 minutes in on the video as there are sound/video issues before that. Thanks in advance, Moreno -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general
Re: [GENERAL] PostgreSQL and Kubernetes
On 03/30/2017 03:10 AM, Moreno Andreo wrote: Hi everyone, I was googling around while searching stuff to finish my cluster solution (already running in production in single-server mode) with barman and pgbouncer, when I ran into this https://hackernoon.com/postgresql-cluster-into-kubernetes-cluster-f353cde212de Since I'm on Google Cloud Platform, I thought it would be a good idea to see what it offers. After a quick read, I found a comment saying *"There was a series of comments by Kelsey Hightower about running databases in Kubernetes, both at conferences and on Twitter; he essentially says that you should absolutely NOT run your database in a container/kubernetes pod/service/deployment, as databases aren't built for type of dynamic scheduling that something like kubernetes (or any other container management solution), due to how they interact with the filesystem, network stack, and more.* *Further more, he suggests that because of this lack of integration, that if you do run your database in kubernetes/docker, you are very likely to encounter data corruption and data loss"* What's your advice? I don't us eKubernetes, but I do know one of the former members of the Postgres Core does: https://opensource.com/article/17/2/stateful-applications and delivered a talk at Scale15x on it: http://www.socallinuxexpo.org/scale/15x/presentations/ccp-containerized-clustered-postgres https://www.youtube.com/watch?v=mxmZv9xkc8s Go to about 3 minutes in on the video as there are sound/video issues before that. Thanks in advance, Moreno -- Adrian Klaver adrian.kla...@aklaver.com -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general
Re: [GENERAL] PostgreSQL and Kubernetes
On Thu, Mar 30, 2017 at 6:10 AM, Moreno Andreo wrote: > Since I'm on Google Cloud Platform, I thought it would be a good idea to > see what it offers. They currently have in beta a Postgres flavor of their cloudsql. I haven't used it yet, but I plan to test it sometime in the next couple of months.
[GENERAL] PostgreSQL and Kubernetes
Hi everyone, I was googling around while searching stuff to finish my cluster solution (already running in production in single-server mode) with barman and pgbouncer, when I ran into this https://hackernoon.com/postgresql-cluster-into-kubernetes-cluster-f353cde212de Since I'm on Google Cloud Platform, I thought it would be a good idea to see what it offers. After a quick read, I found a comment saying "There was a series of comments by Kelsey Hightower about running databases in Kubernetes, both at conferences and on Twitter; he essentially says that you should absolutely NOT run your database in a container/kubernetes pod/service/deployment, as databases aren't built for type of dynamic scheduling that something like kubernetes (or any other container management solution), due to how they interact with the filesystem, network stack, and more. Further more, he suggests that because of this lack of integration, that if you do run your database in kubernetes/docker, you are very likely to encounter data corruption and data loss" What's your advice? Thanks in advance, Moreno