Re: What ever happened to NitroEDb engine for MySQL
I don't know what your data or your needs are, but I just thought I'd make you aware of this; MySQL is *not* the answer to a great many problems, regardless of the storage engine. Use the right tool for the job. Right. I've used other databases that were faster than MySQL for some queries, but they can't load more than a couple million rows because of their high index maintenance. MyISAM is the only engine I've found that can load a lot of data (50 million rows) in just a few minutes and rebuild indexes in no time. It looks like I'll stick with MyISAM. Of course, if indexing is the major challenge, it could also be that you'd benefit from something like Tokutek (or Infobright, which doesn't really have indexes in the traditional sense). But I don't know what Tokutek's price is, or if they'd be suitable for your application. And then you'd be able to stay within the umbrella of MySQL, which is a huge advantage. I guess it all depends how you value the price-benefit ratio of getting more from your hardware, vs. proprietary licensing fees, vs. building things your own way. This has all gone far afield from NitroEDB :-) -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org
Re: What ever happened to NitroEDb engine for MySQL
I'd not hold your breath. Take a look at the open-source version of Infobright. On Sat, Feb 7, 2009 at 8:21 PM, mos mo...@fastmail.fm wrote: NitroEDB was suppose to be shipped Q2 2007. Whatever happened to that? When can I expect it? TIA -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org
Re: What ever happened to NitroEDb engine for MySQL
We recently began using infobright in my shop.. reporting queries against 10's of millions of rows which previously had taken ~2 hours to execute where reduced to less than 10 minutes. It certainly comes with it's own set of limitations but it has been a god-send for us. - michael On Sun, Feb 8, 2009 at 10:58 AM, Baron Schwartz ba...@xaprb.com wrote: I'd not hold your breath. Take a look at the open-source version of Infobright. On Sat, Feb 7, 2009 at 8:21 PM, mos mo...@fastmail.fm wrote: NitroEDB was suppose to be shipped Q2 2007. Whatever happened to that? When can I expect it? TIA -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=mdyk...@gmail.com -- - michael dykman - mdyk...@gmail.com - All models are wrong. Some models are useful. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org
Re: What ever happened to NitroEDb engine for MySQL
At 11:14 AM 2/8/2009, Michael Dykman wrote: We recently began using infobright in my shop.. reporting queries against 10's of millions of rows which previously had taken ~2 hours to execute where reduced to less than 10 minutes. It certainly comes with it's own set of limitations but it has been a god-send for us. - michael Michael Baron, I took a quick look at InfoBright and it seems interesting but... 1) Infobright appears to be a read-only database engine with the only means to update data is through Load Data Infile and Insert, Updated, Delete are not supported? Is that correct? How do you get rid of old rows or update existing rows? 2) Does it have Full-Text search? I need to search on paragraphs of text. Mike On Sun, Feb 8, 2009 at 10:58 AM, Baron Schwartz ba...@xaprb.com wrote: I'd not hold your breath. Take a look at the open-source version of Infobright. On Sat, Feb 7, 2009 at 8:21 PM, mos mo...@fastmail.fm wrote: NitroEDB was suppose to be shipped Q2 2007. Whatever happened to that? When can I expect it? TIA -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=mdyk...@gmail.com -- - michael dykman - mdyk...@gmail.com - All models are wrong. Some models are useful. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org
Re: What ever happened to NitroEDb engine for MySQL
Generally, data cubes are designed to never delete data. Our reports are accumulative so it's not an everyday issue. We tend to reuld the data if there is a problem and, as LOAD DATA is so quick and the queries themselves so potentially time consuming, this is not perceived as much of an inconvenience. You are not going to find full-text search or an other indexing structures in this storage engine.. Those operations are always expensive and therefore don't belong in the data warehousing space. The idea is to boil down your raw data into pure integer structures before it gets into the warehouse.. that's when reporting on massive amounts of data becomes feasibile. Any verbal content gets reduced to indexes into a global dictionary. It's important to note that data warehousing, business intelligence, data cubing, whatever you want to call it, is fundamentally different than the operational business data which is the backbone of our day-to-day business. - michael dykman On Sun, Feb 8, 2009 at 5:51 PM, mos mo...@fastmail.fm wrote: At 11:14 AM 2/8/2009, Michael Dykman wrote: We recently began using infobright in my shop.. reporting queries against 10's of millions of rows which previously had taken ~2 hours to execute where reduced to less than 10 minutes. It certainly comes with it's own set of limitations but it has been a god-send for us. - michael Michael Baron, I took a quick look at InfoBright and it seems interesting but... 1) Infobright appears to be a read-only database engine with the only means to update data is through Load Data Infile and Insert, Updated, Delete are not supported? Is that correct? How do you get rid of old rows or update existing rows? 2) Does it have Full-Text search? I need to search on paragraphs of text. Mike On Sun, Feb 8, 2009 at 10:58 AM, Baron Schwartz ba...@xaprb.com wrote: I'd not hold your breath. Take a look at the open-source version of Infobright. On Sat, Feb 7, 2009 at 8:21 PM, mos mo...@fastmail.fm wrote: NitroEDB was suppose to be shipped Q2 2007. Whatever happened to that? When can I expect it? TIA -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=mdyk...@gmail.com -- - michael dykman - mdyk...@gmail.com - All models are wrong. Some models are useful. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=mdyk...@gmail.com -- - michael dykman - mdyk...@gmail.com - All models are wrong. Some models are useful. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org
Re: What ever happened to NitroEDb engine for MySQL
2) Does it have Full-Text search? I need to search on paragraphs of text. Have you taken a look at Sphinx? BTW Andrew Aksyonoff just showed me in a Skype chat that he's implemented full aggregate functionality in Sphinx, and it now understands a very SQL-ish dialect and speaks the MySQL protocol -- so you can literally use the mysql command-line client (or your favorite programming language's mysql connector) to connect to it and type queries just as you would type SQL. Sphinx has a lot of powerful functionality that makes it scale on really big data sets and take advantage of modern hardware very well. Unlike MySQL it can do intra-query parallelization and scaling out to multiple machines is transparent. (There is no difference between querying one Sphinx index and querying distributed indexes on many machines; you just have to set the config file up correctly). I don't know what your data or your needs are, but I just thought I'd make you aware of this; MySQL is *not* the answer to a great many problems, regardless of the storage engine. Use the right tool for the job. -- Baron Schwartz, Director of Consulting, Percona Inc. Our Blog: http://www.mysqlperformanceblog.com/ Our Services: http://www.percona.com/services.html -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org
Re: What ever happened to NitroEDb engine for MySQL
Baron, At 07:32 PM 2/8/2009, you wrote: 2) Does it have Full-Text search? I need to search on paragraphs of text. Have you taken a look at Sphinx? I looked at Sphinx a couple of years ago and it looked great. I'm glad the author is still improving it. I'm a Windows programmer so I'm still running MySQL 5.1 on XP (I know, I knowg). Sphinx only supports Windows on a single thread so I stayed away from it. I've got to move my databases over to Ubuntu because Sphinx is definitely a must have. BTW Andrew Aksyonoff just showed me in a Skype chat that he's implemented full aggregate functionality in Sphinx, and it now understands a very SQL-ish dialect and speaks the MySQL protocol -- so you can literally use the mysql command-line client (or your favorite programming language's mysql connector) to connect to it and type queries just as you would type SQL. Sphinx has a lot of powerful functionality that makes it scale on really big data sets and take advantage of modern hardware very well. Unlike MySQL it can do intra-query parallelization and scaling out to multiple machines is transparent. (There is no difference between querying one Sphinx index and querying distributed indexes on many machines; you just have to set the config file up correctly). Cool! I'll revisit the Sphinx site. I don't know what your data or your needs are, but I just thought I'd make you aware of this; MySQL is *not* the answer to a great many problems, regardless of the storage engine. Use the right tool for the job. Right. I've used other databases that were faster than MySQL for some queries, but they can't load more than a couple million rows because of their high index maintenance. MyISAM is the only engine I've found that can load a lot of data (50 million rows) in just a few minutes and rebuild indexes in no time. It looks like I'll stick with MyISAM. Mike -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org
What ever happened to NitroEDb engine for MySQL
NitroEDB was suppose to be shipped Q2 2007. Whatever happened to that? When can I expect it? TIA Mike http://solutions.mysql.com/engines.html * http://www.mysql.com/news-and-events/news/article_1181.htmlNitroEDB NitroEDB for MySQL is a high speed relational storage engine from NitroSecurity, originally developed to address the growing demand for real-time analysis within the network security event management market. NitroEDBs focus is on high volume databases. Utilizing unique indexing techniques, data management methods and query processing algorithms, the technology enables multiple order of magnitude increases in relational data management and query performance with multi-billion record volumes running on commodity hardware. The technology is currently deployed in NitroView Enterprise Security Manager, the industrys highest performance network security monitoring and analysis solution. The General Availability for NitroEDB for MySQL is scheduled for Q2 2007. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org
