Re: [Opensim-dev] PostgreSQL data module for OpenSim
What are the advantages of of using PostgreSQL for Opensim in comparison to mysql? Perfomance? Memory usage? Anything else? As far as I know, both have improved over the years and for me, as an average user and not a database guru, they are about the same. In other words, why should I switch if I have everything in place with MySQL? On Sat, Oct 12, 2013 at 4:00 AM, Fernando Francisco de Oliveira ferna...@oliveira.eti.br wrote: I hope so. I want to see it in production soon. cant wait to compile it from oficial repository :) I'm working on the database migration tool, and it is almost done. (mysql to postgresql) or any direction (even sqlite to postgres), mssql to postgres. as prototype its fixed to mysql to postgres, but adding the database plugin, like opensim itself, it can be done only configuring the INI file. like this: [Setup] Databases = myopensim,osmyothersim [DatabaseOrigin] StorageProvider = OpenSim.Data.MySQL.dll ConnectionString = Data Source=localhost;User ID=root;Password=***;Old Guids=true;Database= [DatabaseTarget] StorageProvider = OpenSim.Data.PGSQL.dll ConnectionString = User ID=postgres;Password=***;Host=localhost;Port=5432;Database= Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands 2013/10/11 James Hughes jam...@bluewallgroup.com On 10/10/2013 10:09 PM, Fernando Francisco de Oliveira wrote: Hello I just requested a push from my fork of opensim to the nebadon git opensim repository, that I created the PostgreSQL project to use this database in opensim. https://github.com/ffoliveira/**opensimulator/tree/PostgreSQLhttps://github.com/ffoliveira/opensimulator/tree/PostgreSQL I already have a Mantis Account. I hope the code and it's use may improve opensim performance and gain more users. Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_**lands http://twitter.com/oliveira_lands Thanks Fernando. I have always been suspect of projects that had no PgSQL support :) I think it will be a nice addition to our little project. BlueWall __**_ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/**mailman/listinfo/opensim-devhttps://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] PostgreSQL data module for OpenSim
my intention with the project was to add new features and not replace them. With a database like postgresql, we can cover more users, and many of them in the corporate environment. Database migration is an option, and I'm working on a tool to cover who want to do it. I saw some advantages using postgresql, but it's necessary to do more benchmarks to see how its behavior under pressure. This was a little test : https://docs.google.com/document/d/1iPjAItQPNQCUagROLogf6GZH3NdPE_Wtn2KtAIhYwyE/edit?usp=sharingless Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands 2013/10/12 Shy Robbiani shy.robbi...@gmail.com What are the advantages of of using PostgreSQL for Opensim in comparison to mysql? Perfomance? Memory usage? Anything else? As far as I know, both have improved over the years and for me, as an average user and not a database guru, they are about the same. In other words, why should I switch if I have everything in place with MySQL? On Sat, Oct 12, 2013 at 4:00 AM, Fernando Francisco de Oliveira ferna...@oliveira.eti.br wrote: I hope so. I want to see it in production soon. cant wait to compile it from oficial repository :) I'm working on the database migration tool, and it is almost done. (mysql to postgresql) or any direction (even sqlite to postgres), mssql to postgres. as prototype its fixed to mysql to postgres, but adding the database plugin, like opensim itself, it can be done only configuring the INI file. like this: [Setup] Databases = myopensim,osmyothersim [DatabaseOrigin] StorageProvider = OpenSim.Data.MySQL.dll ConnectionString = Data Source=localhost;User ID=root;Password=***;Old Guids=true;Database= [DatabaseTarget] StorageProvider = OpenSim.Data.PGSQL.dll ConnectionString = User ID=postgres;Password=***;Host=localhost;Port=5432;Database= Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands 2013/10/11 James Hughes jam...@bluewallgroup.com On 10/10/2013 10:09 PM, Fernando Francisco de Oliveira wrote: Hello I just requested a push from my fork of opensim to the nebadon git opensim repository, that I created the PostgreSQL project to use this database in opensim. https://github.com/ffoliveira/**opensimulator/tree/PostgreSQLhttps://github.com/ffoliveira/opensimulator/tree/PostgreSQL I already have a Mantis Account. I hope the code and it's use may improve opensim performance and gain more users. Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_**lands http://twitter.com/oliveira_lands Thanks Fernando. I have always been suspect of projects that had no PgSQL support :) I think it will be a nice addition to our little project. BlueWall __**_ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/**mailman/listinfo/opensim-devhttps://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] PostgreSQL data module for OpenSim
Interesting. I'll give it a try on my test sims and watch memory consumption as memory limitations are often an issue for some virtual server installs. And yes, it's always good to have options. I'm glad to see it in the git master :) On Sat, Oct 12, 2013 at 3:39 PM, Fernando Francisco de Oliveira ferna...@oliveira.eti.br wrote: my intention with the project was to add new features and not replace them. With a database like postgresql, we can cover more users, and many of them in the corporate environment. Database migration is an option, and I'm working on a tool to cover who want to do it. I saw some advantages using postgresql, but it's necessary to do more benchmarks to see how its behavior under pressure. This was a little test : https://docs.google.com/document/d/1iPjAItQPNQCUagROLogf6GZH3NdPE_Wtn2KtAIhYwyE/edit?usp=sharingless Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands 2013/10/12 Shy Robbiani shy.robbi...@gmail.com What are the advantages of of using PostgreSQL for Opensim in comparison to mysql? Perfomance? Memory usage? Anything else? As far as I know, both have improved over the years and for me, as an average user and not a database guru, they are about the same. In other words, why should I switch if I have everything in place with MySQL? On Sat, Oct 12, 2013 at 4:00 AM, Fernando Francisco de Oliveira ferna...@oliveira.eti.br wrote: I hope so. I want to see it in production soon. cant wait to compile it from oficial repository :) I'm working on the database migration tool, and it is almost done. (mysql to postgresql) or any direction (even sqlite to postgres), mssql to postgres. as prototype its fixed to mysql to postgres, but adding the database plugin, like opensim itself, it can be done only configuring the INI file. like this: [Setup] Databases = myopensim,osmyothersim [DatabaseOrigin] StorageProvider = OpenSim.Data.MySQL.dll ConnectionString = Data Source=localhost;User ID=root;Password=***;Old Guids=true;Database= [DatabaseTarget] StorageProvider = OpenSim.Data.PGSQL.dll ConnectionString = User ID=postgres;Password=***;Host=localhost;Port=5432;Database= Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands 2013/10/11 James Hughes jam...@bluewallgroup.com On 10/10/2013 10:09 PM, Fernando Francisco de Oliveira wrote: Hello I just requested a push from my fork of opensim to the nebadon git opensim repository, that I created the PostgreSQL project to use this database in opensim. https://github.com/ffoliveira/**opensimulator/tree/PostgreSQLhttps://github.com/ffoliveira/opensimulator/tree/PostgreSQL I already have a Mantis Account. I hope the code and it's use may improve opensim performance and gain more users. Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_**landshttp://twitter.com/oliveira_lands Thanks Fernando. I have always been suspect of projects that had no PgSQL support :) I think it will be a nice addition to our little project. BlueWall __**_ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/**mailman/listinfo/opensim-devhttps://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] PostgreSQL data module for OpenSim
Good. It would be nice to see the results when you get it. I'm going to conduct some more tests on my server too. The preliminary tests I've done at my home computer, with win8 and lots of stuff installed. Timothy Rogers did some tests on his servers and got better results that I did. Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands 2013/10/12 Shy Robbiani shy.robbi...@gmail.com Interesting. I'll give it a try on my test sims and watch memory consumption as memory limitations are often an issue for some virtual server installs. And yes, it's always good to have options. I'm glad to see it in the git master :) On Sat, Oct 12, 2013 at 3:39 PM, Fernando Francisco de Oliveira ferna...@oliveira.eti.br wrote: my intention with the project was to add new features and not replace them. With a database like postgresql, we can cover more users, and many of them in the corporate environment. Database migration is an option, and I'm working on a tool to cover who want to do it. I saw some advantages using postgresql, but it's necessary to do more benchmarks to see how its behavior under pressure. This was a little test : https://docs.google.com/document/d/1iPjAItQPNQCUagROLogf6GZH3NdPE_Wtn2KtAIhYwyE/edit?usp=sharingless Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands 2013/10/12 Shy Robbiani shy.robbi...@gmail.com What are the advantages of of using PostgreSQL for Opensim in comparison to mysql? Perfomance? Memory usage? Anything else? As far as I know, both have improved over the years and for me, as an average user and not a database guru, they are about the same. In other words, why should I switch if I have everything in place with MySQL? On Sat, Oct 12, 2013 at 4:00 AM, Fernando Francisco de Oliveira ferna...@oliveira.eti.br wrote: I hope so. I want to see it in production soon. cant wait to compile it from oficial repository :) I'm working on the database migration tool, and it is almost done. (mysql to postgresql) or any direction (even sqlite to postgres), mssql to postgres. as prototype its fixed to mysql to postgres, but adding the database plugin, like opensim itself, it can be done only configuring the INI file. like this: [Setup] Databases = myopensim,osmyothersim [DatabaseOrigin] StorageProvider = OpenSim.Data.MySQL.dll ConnectionString = Data Source=localhost;User ID=root;Password=***;Old Guids=true;Database= [DatabaseTarget] StorageProvider = OpenSim.Data.PGSQL.dll ConnectionString = User ID=postgres;Password=***;Host=localhost;Port=5432;Database= Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands 2013/10/11 James Hughes jam...@bluewallgroup.com On 10/10/2013 10:09 PM, Fernando Francisco de Oliveira wrote: Hello I just requested a push from my fork of opensim to the nebadon git opensim repository, that I created the PostgreSQL project to use this database in opensim. https://github.com/ffoliveira/**opensimulator/tree/PostgreSQLhttps://github.com/ffoliveira/opensimulator/tree/PostgreSQL I already have a Mantis Account. I hope the code and it's use may improve opensim performance and gain more users. Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_**landshttp://twitter.com/oliveira_lands Thanks Fernando. I have always been suspect of projects that had no PgSQL support :) I think it will be a nice addition to our little project. BlueWall __**_ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/**mailman/listinfo/opensim-devhttps://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] PostgreSQL data module for OpenSim
Hi Sean, Migration would most readily be accomplished with the very excellent OAR capability provided by Justin Clarke-Casey a few years back ;) Cheers On Thu, Oct 10, 2013 at 11:18 PM, Fernando Francisco de Oliveira ferna...@oliveira.eti.br wrote: Hello, thank you for your support. Me and Timothy did some preliminary tests and it seens to work in a some way better than mysql. But as you said it depends from each environment where it is been tested. I'm working on a software tool do do the migrations from any opensim supported database to postgresql, but still imature. My idea is to do migrations in any direction. my-pg | pg-my | ms-my | my-ms etc. I already put the config comented examples on StandaloneCommon.ini and other config files. Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev -- === http://osgrid.org/ http://simhost.com http://twitter.com/jstallings2 ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] PostgreSQL data module for OpenSim
Yes, but for griders, I think it need a migration too, what oar can't do ... Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands 2013/10/11 James Stallings II james.stalli...@gmail.com Hi Sean, Migration would most readily be accomplished with the very excellent OAR capability provided by Justin Clarke-Casey a few years back ;) Cheers On Thu, Oct 10, 2013 at 11:18 PM, Fernando Francisco de Oliveira ferna...@oliveira.eti.br wrote: Hello, thank you for your support. Me and Timothy did some preliminary tests and it seens to work in a some way better than mysql. But as you said it depends from each environment where it is been tested. I'm working on a software tool do do the migrations from any opensim supported database to postgresql, but still imature. My idea is to do migrations in any direction. my-pg | pg-my | ms-my | my-ms etc. I already put the config comented examples on StandaloneCommon.ini and other config files. Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev -- === http://osgrid.org/ http://simhost.com http://twitter.com/jstallings2 ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] PostgreSQL data module for OpenSim
On 10/10/2013 10:09 PM, Fernando Francisco de Oliveira wrote: Hello I just requested a push from my fork of opensim to the nebadon git opensim repository, that I created the PostgreSQL project to use this database in opensim. https://github.com/ffoliveira/opensimulator/tree/PostgreSQL I already have a Mantis Account. I hope the code and it's use may improve opensim performance and gain more users. Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands Thanks Fernando. I have always been suspect of projects that had no PgSQL support :) I think it will be a nice addition to our little project. BlueWall ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] PostgreSQL data module for OpenSim
I hope so. I want to see it in production soon. cant wait to compile it from oficial repository :) I'm working on the database migration tool, and it is almost done. (mysql to postgresql) or any direction (even sqlite to postgres), mssql to postgres. as prototype its fixed to mysql to postgres, but adding the database plugin, like opensim itself, it can be done only configuring the INI file. like this: [Setup] Databases = myopensim,osmyothersim [DatabaseOrigin] StorageProvider = OpenSim.Data.MySQL.dll ConnectionString = Data Source=localhost;User ID=root;Password=***;Old Guids=true;Database= [DatabaseTarget] StorageProvider = OpenSim.Data.PGSQL.dll ConnectionString = User ID=postgres;Password=***;Host=localhost;Port=5432;Database= Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands 2013/10/11 James Hughes jam...@bluewallgroup.com On 10/10/2013 10:09 PM, Fernando Francisco de Oliveira wrote: Hello I just requested a push from my fork of opensim to the nebadon git opensim repository, that I created the PostgreSQL project to use this database in opensim. https://github.com/ffoliveira/**opensimulator/tree/PostgreSQLhttps://github.com/ffoliveira/opensimulator/tree/PostgreSQL I already have a Mantis Account. I hope the code and it's use may improve opensim performance and gain more users. Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_**lands http://twitter.com/oliveira_lands Thanks Fernando. I have always been suspect of projects that had no PgSQL support :) I think it will be a nice addition to our little project. BlueWall __**_ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/**mailman/listinfo/opensim-devhttps://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] PostgreSQL data module for OpenSim
Brilliant Fernando, Cheers! James On Thu, Oct 10, 2013 at 9:09 PM, Fernando Francisco de Oliveira ferna...@oliveira.eti.br wrote: Hello I just requested a push from my fork of opensim to the nebadon git opensim repository, that I created the PostgreSQL project to use this database in opensim. https://github.com/ffoliveira/opensimulator/tree/PostgreSQL I already have a Mantis Account. I hope the code and it's use may improve opensim performance and gain more users. Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev -- === http://osgrid.org/ http://simhost.com http://twitter.com/jstallings2 ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] PostgreSQL data module for OpenSim
I don't have any objections on taking this into core, as long as Fernando is willing to maintain it in the long run. Thanks, Fernando. On 10/10/2013 7:09 PM, Fernando Francisco de Oliveira wrote: Hello I just requested a push from my fork of opensim to the nebadon git opensim repository, that I created the PostgreSQL project to use this database in opensim. https://github.com/ffoliveira/opensimulator/tree/PostgreSQL I already have a Mantis Account. I hope the code and it's use may improve opensim performance and gain more users. Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] PostgreSQL data module for OpenSim
This is very cool! Fernando -- are there any quantitative results of how well PostgreSQL handles OpenSim's workload compared to MySQL/MariaDB? Has anyone tested the performance to see if it is actually better? I know it's very hard to compare two database systems, because you can easily produce a benchmark that does well on one and not the other. But, in this case, we are talking about a fairly specific workload, with OpenSim -- the workload will vary in scale depending on the region's popularity, but the use patterns will be more or less similar (within reason; if you have a heavily hacked special-purpose region, its usage pattern may fall beyond the typical use case). Anyway, I will see about giving this a try soon just to see if it's stable and working. Do you have any documentation written up (on the Wiki would be nice), or is it all just in the example config files and the source code? Region operators might also be interested in a guide detailing a migration process for those wanting to retain existing data while moving from MySQL to Postgres. Thanks! Sean On Thu, Oct 10, 2013 at 10:09 PM, Fernando Francisco de Oliveira ferna...@oliveira.eti.br wrote: Hello I just requested a push from my fork of opensim to the nebadon git opensim repository, that I created the PostgreSQL project to use this database in opensim. https://github.com/ffoliveira/opensimulator/tree/PostgreSQL I already have a Mantis Account. I hope the code and it's use may improve opensim performance and gain more users. Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] PostgreSQL data module for OpenSim
Hello, thank you for your support. Me and Timothy did some preliminary tests and it seens to work in a some way better than mysql. But as you said it depends from each environment where it is been tested. I'm working on a software tool do do the migrations from any opensim supported database to postgresql, but still imature. My idea is to do migrations in any direction. my-pg | pg-my | ms-my | my-ms etc. I already put the config comented examples on StandaloneCommon.ini and other config files. Fernando Oliveira http://oliveira.eti.br http://twitter.com/oliveira_lands ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev