Re: [Wikitech-l] Better non-MySQL db support

2013-02-28 Thread Freako F. Freakolowsky
On 28. 02. 2013 04:29, Greg Sabino Mullane wrote: I can't think of a clean way to abstract that anyway, as just needing an index hint for MySQL does mean the same is needed on Oracle, and vice-versa. Please don't use index hints on Oracle ... since 9i you get far better performances using CBO

Re: [Wikitech-l] Better non-MySQL db support

2013-02-28 Thread Greg Sabino Mullane
Daniel Friesen let us know: For reference this is the RFC that was discussed in my thread on the subject. https://www.mediawiki.org/wiki/Requests_for_comment/Abstract_table_definitions Should probably dig up some gmane/archive links for both this and that discussion and add them to

Re: [Wikitech-l] Better non-MySQL db support

2013-02-28 Thread Greg Sabino Mullane
Matthew Flaschen wrote: No, I was just talking about defining the indices (obviously, the query planner is out of luck if you don't define them properly). E.g. in the PostgeSQL tables.sql file: CREATE INDEX archive_name_title_timestamp ON archive (ar_namespace,ar_title,ar_timestamp);

Re: [Wikitech-l] Better non-MySQL db support

2013-02-27 Thread Daniel Friesen
For reference this is the RFC that was discussed in my thread on the subject. https://www.mediawiki.org/wiki/Requests_for_comment/Abstract_table_definitions Should probably dig up some gmane/archive links for both this and that discussion and add them to the RFC page. -- ~Daniel Friesen

Re: [Wikitech-l] Better non-MySQL db support

2013-02-27 Thread Greg Sabino Mullane
Luke Welling asked: Specifically, do we use MySQL specific syntax that is more efficient (but breaks elsewhere) or do we attempt to write lowest common denominator SQL that will run more places, but not run as efficiently on our primary target? Neither: we use the already-existing methods, and

Re: [Wikitech-l] Better non-MySQL db support

2013-02-27 Thread Matthew Flaschen
On 02/27/2013 10:29 PM, Greg Sabino Mullane wrote: Not sure what you mean - index hints? Yeah, that could be a little tricky, but luckily the Postgres part, at any rate, doesn't have to worry about those (as our planner is smart enough to pick the best index itself ;). I can't think of a

Re: [Wikitech-l] Better non-MySQL db support

2013-02-26 Thread Nikola Smolenski
On 26/02/13 04:18, Matthew Flaschen wrote: Sure, for starters. :) Bear in mind, if we want to keep support for all these dbs, every change to the database schema has to (at some point) result in a change to separate SQL files for each DB (MySQL and SQLite use the same ones). For instance, there

Re: [Wikitech-l] Better non-MySQL db support

2013-02-26 Thread Dmitriy Sintsov
26 Февраль 2013 г. 14:27:06 пользователь Nikola Smolenski (smole...@eunet.rs) написал: On 26/02/13 04:18, Matthew Flaschen wrote: Sure, for starters. :) Bear in mind, if we want to keep support for all these dbs, every change to the database schema has to (at some point) result in a

Re: [Wikitech-l] Better non-MySQL db support

2013-02-26 Thread Luke Welling WMF
Do we have an official position on cross database compatibility? Some of the MediaWiki SQL is in separate files and can be easily directed at a specific database engine. A lot of it though is scattered as fragments though other code and is going to be run on any engine we connect to.

Re: [Wikitech-l] Better non-MySQL db support

2013-02-26 Thread Marc A. Pelletier
On 02/26/2013 02:14 PM, Luke Welling WMF wrote: Do we have an official position on cross database compatibility? It would be nice if we did. In my own production environments, I always use postgres. To date, mw has been good enough with its support that I've never had significant

Re: [Wikitech-l] Better non-MySQL db support

2013-02-26 Thread Matthew Flaschen
On 02/26/2013 02:14 PM, Luke Welling WMF wrote: Specifically, do we use MySQL specific syntax that is more efficient (but breaks elsewhere) or do we attempt to write lowest common denominator SQL that will run more places, but not run as efficiently on our primary target? There's a DB layer

[Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Mark A. Hershberger
How can we improve the support for databases like PostgreSQL, Oracle, DB2 and MS SQL? Getting Jenkins involved in testing isn't the (only) answer, though it would certainly help. If developers who were interested in those databases could watch includes/db, that would help, as well. If nothing

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Petr Bena
I would be happy to install some mediawiki on oracle db, but I have no oracle db on any of my personal servers :/ The main problem of oracle is that it's not very much free - thus it's not packaged by most of linux vendors and it might be hard to install for many sysadmins. (In order to install

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread OQ
On Mon, Feb 25, 2013 at 9:27 AM, Mark A. Hershberger m...@everybody.org wrote: How can we improve the support for databases like PostgreSQL, Oracle, DB2 and MS SQL? The main issues arise from not keeping these other DBs in mind when writing the queries (and also not using the db layer).

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Chad
On Mon, Feb 25, 2013 at 7:27 AM, Mark A. Hershberger m...@everybody.org wrote: Getting Jenkins involved in testing isn't the (only) answer, though it would certainly help. If developers who were interested in those databases could watch includes/db, that would help, as well. The latter is

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Mark A. Hershberger
On 02/25/2013 10:40 AM, Chad wrote: Covering all the non-mysql/sqlite we support: - DB2 has been unmaintained for ages, and personally I'm in favor of dropping that one altogether. - MSSQL would be nice to improve. - Oracle support's not bad (maybe not perfect), freakolowsy would know more.

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Danny Joe Bauch
I'm still alive and willing to continue to work on MSSQL. On Mon, Feb 25, 2013 at 9:40 AM, Chad innocentkil...@gmail.com wrote: On Mon, Feb 25, 2013 at 7:27 AM, Mark A. Hershberger m...@everybody.org wrote: Getting Jenkins involved in testing isn't the (only) answer, though it would

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Mark A. Hershberger
On 02/25/2013 10:52 AM, Danny Joe Bauch wrote: I'm still alive and willing to continue to work on MSSQL. Have you tried to run MediaWiki's latest from git against MSSQL? -- http://hexmode.com/ There is no path to peace. Peace is the path. -- Mahatma Gandhi, Non-Violence in Peace and War

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Danny Joe Bauch
No. The last version I got running was 1.19, and have not worked on any since. I could do as you suggest, though. On Mon, Feb 25, 2013 at 9:54 AM, Mark A. Hershberger m...@everybody.orgwrote: On 02/25/2013 10:52 AM, Danny Joe Bauch wrote: I'm still alive and willing to continue to work on

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Petr Bena
It would be best to have automated environment for this, either on labs or somewhere else. Problem is that it's not possible to install MSSQL and such on wikimedia labs given the restrictions On Mon, Feb 25, 2013 at 5:36 PM, Danny Joe Bauch dj.ba...@gmail.com wrote: No. The last version I got

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Mark A. Hershberger
On 02/25/2013 11:43 AM, Petr Bena wrote: It would be best to have automated environment for this, either on labs or somewhere else. Problem is that it's not possible to install MSSQL and such on wikimedia labs given the restrictions Which is why I suggested that we work with someone at MS to

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Danny Joe Bauch
Microsoft was very kind to provide me with an Azure account which I used to do the testing of 1.18 and 1.19. I've not been in touch with them lately, nor have I checked whether that account is still open. I would gladly jump back on that. I'm afraid I got a bit distracted when my job disappeared

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Yuri Astrakhan
There are some bugs that also prevents accurate unit testing on multiple backends (these are the ones I hit personally): * *Bug 37702* https://bugzilla.wikimedia.org/show_bug.cgi?id=37702 - Cloned tables for unittests do not have references and constraints * *Bug 44790*

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Sumana Harihareswara
On 02/25/2013 07:40 AM, Chad wrote: On Mon, Feb 25, 2013 at 7:27 AM, Mark A. Hershberger m...@everybody.org wrote: Getting Jenkins involved in testing isn't the (only) answer, though it would certainly help. If developers who were interested in those databases could watch includes/db, that

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Chad
On Mon, Feb 25, 2013 at 7:48 AM, Mark A. Hershberger m...@everybody.org wrote: Other than that, I can only add my +1 to dropping DB2 support. I don't know of it being used anywhere. https://gerrit.wikimedia.org/r/#/c/50764/ -Chad ___ Wikitech-l

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Chad
On Mon, Feb 25, 2013 at 9:53 AM, Sumana Harihareswara suma...@wikimedia.org wrote: * Make a meta-schema so that we no longer use tables.sql as a canonical source. Chad and Max started in http://svn.wikimedia.org/viewvc/mediawiki/branches/abstract-schema/ . See

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Freako F. Freakolowsky
I'm still active on Oracle front, but as you might have noticed i have been [WARNING ... understatement ahead] a bit busy in the last 1,5 year so i just can't manage to pay as much attention to what's going on as i would like to ... I used to get paid by my company to do this, but due to some

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Greg Sabino Mullane
Mark A. Hershberger wrote: How can we improve the support for databases like PostgreSQL, Oracle, DB2 and MS SQL? Getting Jenkins involved in testing isn't the (only) answer, though it would certainly help. If developers who were interested in those databases could watch includes/db, that

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Chad
On Mon, Feb 25, 2013 at 1:29 PM, Greg Sabino Mullane g...@endpoint.com wrote: Mark A. Hershberger wrote: How can we improve the support for databases like PostgreSQL, Oracle, DB2 and MS SQL? Getting Jenkins involved in testing isn't the (only) answer, though it would certainly help. If

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Tyler Romeo
Where is the abstract-schema branch now? The only thing I remember about that was a brief mailing list discussion (I think started by Daniel Friesnen) about making such a format. What exactly were the hold-ups with updates? *--* *Tyler Romeo* Stevens Institute of Technology, Class of 2015 Major

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Chad
On Mon, Feb 25, 2013 at 2:00 PM, Tyler Romeo tylerro...@gmail.com wrote: Where is the abstract-schema branch now? The only thing I remember about that was a brief mailing list discussion (I think started by Daniel Friesnen) about making such a format. What exactly were the hold-ups with

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Brian Wolff
However - it's not a freeware and that automatically makes it very unpopular for open source OS vendors and very unlikely a choice of standard webadmin and that makes it hard to test. Even if I was able to obtain some license to install oracle on any of my servers, I wouldn't do it as it

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Tyler Romeo
Oh. Sorry must have missed that. I'll take a look and see if there's anything interesting. On Feb 25, 2013 5:05 PM, Chad innocentkil...@gmail.com wrote: On Mon, Feb 25, 2013 at 2:00 PM, Tyler Romeo tylerro...@gmail.com wrote: Where is the abstract-schema branch now? The only thing I remember

Re: [Wikitech-l] Better non-MySQL db support

2013-02-25 Thread Matthew Flaschen
On 02/25/2013 12:53 PM, Sumana Harihareswara wrote: The question: what do we need to test more often to keep RDBMSes happy? https://www.mediawiki.org/wiki/Database_testing https://www.mediawiki.org/wiki/New_installer/Test_plan Permissions, searching, schema setup, schema changes, quoting