Re: Hypothetical design question regarding keyword searching

2007-07-19 Thread Mark Papadakis

Greetings,

Buy 'Building Scalable Web Sites'
[http://www.oreillynet.com/pub/pr/1582], authored by the chief
architect of Flickr. Among other interesting topics, he describes the
system they use for full-text search. Its pretty simple, though this
is just one of the ways you can solve this problem.

Good luck,
Mark

On 7/19/07, Peter Bradley <[EMAIL PROTECTED]> wrote:

Ysgrifennodd Scott Haneda:
> I have been looking at stock photo sites lately, started wondering how they
> are doing their keyword searched.  Given a potential for millions of images,
> each with x keywords, I have come up with two approaches...
>
>


Is this the sort of thing you're looking for:

http://en.wikipedia.org/wiki/Inverted_index

It's the sort of structure used in library software.



Peter

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]





--
Mark Papadakis
http://www.markpapadakis.com/
[EMAIL PROTECTED]

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Abnormal mySQL service behavior / 5.0.26

2007-02-16 Thread Mark Papadakis

On 2/16/07, Juan Eduardo Moreno <[EMAIL PROTECTED]> wrote:



On 2/16/07, Mark Papadakis <[EMAIL PROTECTED]> wrote:
> Good day,


R: are you using MyISAM or InnoDB tables?


InnoDB, only.


> For the past 2 weeks, we have been dealing with some rather strange
problems.
> While nothing changed in terms of the mySQL server or clients
> configuration ( including the options provided to the server during
> startup, by either my.cnf or as arguments to the executable ), we are
> getting the following kind of errors.

> o Server shutdown in progress


R: Could be any fatal error in mysql that produce this "server shutdown in
progress"


True, however the server doesn't actually shut down, nor it crashes or
anything like that, except once.
It is as if all threads are killed, or at least the questions that are
actively being processed.




> o Out of memory (Needed 5256540 bytes)


R: What is your sort_buffer_size setting?



sort_buffer_size = 24MB




> o Sort Aborted

R: filesort.cc ..The error 'Sort aborted' comes if the sort function fails
for some reason. You can try identified what query is a cause of error.



The amount of data that needs to be processed (i.e sorted) for those
queries to return the results set is small, judging from the database
structure as well as the actual queries. Plus, those queries are
different every time. Executing those SELECT statements later on,
turns out they are going through just a handful of rows anyway.



> o o Can't create a new thread (errno 11); if you are not out of
> available memory, you can consult the manual for a possible
> OS-dependent bug
> o Unknown Error ( this occurs more often than the rest )


R: What say the  error file in specific?


Not much can be deducting from going through the error file.

070216  8:34:49 [ERROR] Out of memory; check if mysqld or some other
process uses all available memory; if not, you may have to use
'ulimit' to allow
mysqld to use more memory or you can add more swap space


070213 20:34:49 [ERROR] /usr/local/mysql/bin/mysqld: Sort aborted

The only meaningful message block is:
BEGIN


070216  8:34:49 [ERROR] Out of memory; check if mysqld or some other
process uses all available memory; if not, you may have to use
'ulimit' to allow
mysqld to use more memory or you can add more swap space
070216  8:34:49 [ERROR] Out of memory; check if mysqld or some other
process uses all available memory; if not, you may have to use
'ulimit' to allow
mysqld to use more memory or you can add more swap space
mysqld got signal 6;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
We will try our best to scrape up some info that will hopefully help diagnose
the problem, but since we have already crashed, something is definitely wrong
and this may fail.

key_buffer_size=41943040
read_buffer_size=8384512
max_used_connections=2049
max_connections=2048
threads_connected=964
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size +
sort_buffer_size)*max_connections = 32752 K
bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

You seem to be running 32-bit Linux and have 964 concurrent connections.
If you have not changed STACK_SIZE in LinuxThreads and built the binary
yourself, LinuxThreads is quite likely to steal a part of the global heap for
the thread stack. Please read http://www.mysql.com/doc/en/Linux.html

thd=0x46dc5840
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
Cannot determine thread, fp=0xbbf3c438, backtrace may not be correct.
Stack range sanity check OK, backtrace follows:
0x80a0a12
0x82fb4e8
0x83257a1
0x82fb879
0x8325a80
0x838a3b8
0x838a3dd
0x838ae96
0x838b065
0x838a30c
0x812c923
0x83b0fa3
0x8126642
0x8104a29
0x80b410e
0x80b410e
0x80b944a
0x80b0e54
0x80b06f3
0x80afc84
0x82f8c9c
0x83412ea
New value of fp=(nil) failed sanity check, terminating stack trace!
Please read http://dev.mysql.com/doc/mysql/en/Using_stack_trace.html
and follow instructions on how to resolve the stack trace. Resolved
stack trace is much more helpful in diagnosing the problem, so please do
resolve it
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort...
thd->query at 0x1f284388 = UPDATE content SET hits1 = hits1 + 1 WHERE
src = 'woman'
thd->thread_id=19077185
The manual page at http://www.mysql.com/doc/en/Crashing.html contains
information that should help you find out what is causing the crash.
pure virtual method called

Number of processes running now: 0


END



> There is plenty of memory on the system, as much as there was before
> the problems surface

Abnormal mySQL service behavior / 5.0.26

2007-02-16 Thread Mark Papadakis

Good day,

For the past 2 weeks, we have been dealing with some rather strange problems.
While nothing changed in terms of the mySQL server or clients
configuration ( including the options provided to the server during
startup, by either my.cnf or as arguments to the executable ), we are
getting the following kind of errors.

o Server shutdown in progress
o Out of memory (Needed 5256540 bytes)
o Sort Aborted
o o Can't create a new thread (errno 11); if you are not out of
available memory, you can consult the manual for a possible
OS-dependent bug
o Unknown Error ( this occurs more often than the rest )

There is plenty of memory on the system, as much as there was before
the problems surfaced.

We moved a database from that system, to another system ( that
database was the one hit more often ) in hope to perhaps solve the
problem. Indeed, the errors are coming up less frequently now, but
they still do.

Is there any chance this is due to tables corruption or corruption of
any other kind on the server side? I didn't see any bug fixes in 0.27+
revisions that seem to be related to this problem, so I assume its not
a bug that existed in <= 0.26.

Any ideas ?

Thank you very much in advance.

PS: Please reply to this email address as well, if possible.

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: How thread-safe is mysql_real_connect()?

2005-10-07 Thread Mark Papadakis
Greetings,

mySQL is thread safe, more or less.
Make sure you compile against libmysqlclient_r (or simply
ignore/handle SIGPIPE ).


Further info can be found at:
http://dev.mysql.com/doc/mysql/en/myodbc-unix-thread-safe.html
http://dev.mysql.com/doc/mysql/en/myodbc-unix-thread-safe.html

MarkP

On 10/7/05, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
> (please excuse the double post but I wanted to reach the two audiences I
> thought could help the best)
>
> This is a question about the interpreting the documentation in the manual
> for the C API.
> I searched the list archives (all lists) going back 365 days for the terms
> (unquoted): "mysql_real_connect thread" (I also looked for
> alternatives:"mysql_real_connect threaded", "mysql_real_connect multi
> threaded", etc.). I searched on Google Groups for: mysql_real_connect
> thread and found a few interesting hits. However, I am still not 100%
> clear on how to interpret some of the information on this page:
> http://dev.mysql.com/doc/mysql/en/threaded-clients.html
>
> I do a lot of MySQL administration and development using mostly the CLI
> and a few other tools but I am writing a multithreaded client to automate
> certain background processing and I need a bit of advice. According to the
> page in question the function mysql_real_connect() is not "thread-safe".
> Does that simply mean that I cannot call that function from more than one
> thread at a time or does that mean that the connection created by one call
> to the function will be visible to the other threads or what? Just how not
> "thread-safe" is it?
>
> Each thread will have it's own  MYSQL structure and I will need to use two
> different connections per thread at the same time (am I going to need a
> separate call to mysql_init() for each connection?). I know how to wrap
> all of my calls to mysql_real_connect()  in a critical section or protect
> them with a mutex if that's all I need to do . If it's not that simple and
> I do need to compile and link against another library (as the page
> suggests - sort of) can someone help me to configure my Microsoft Visual
> C++ .NET (v7) to do it? I said "sort-of" because the page also says that
> the binary distributions (which I am working with ) already contain the
> threadsafe library so I wonder if I need to rebuild anything or not.  How
> can I tell?
>
> I am an experienced but not well-seasoned C++ developer (not using c# for
> this). I know the language and can write and debug code just fine (I can
> make stand-alone apps and DLLs all day); it's just that some of the
> complier/linker options and settings that confound me and I am having
> trouble translating the advice on the page into specifics I can work with
> for my environment.
>
> I know I probably left out some simple pieces of information, just let me
> know and I will respond ASAP. Please remember to CC: both lists on all
> responses.
>
> Shawn Green
> Database Administrator
> Unimin Corporation - Spruce Pine
>
>
>
>
>


--
Mark Papadakis
http://www.markpapadakis.com/
[EMAIL PROTECTED]

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Some Assistance Please

2005-08-30 Thread Mark Papadakis
Greetings Rob,


> 
> What is the optimum way to structure the database to allow for the
> simplest user search?

> Is it more efficient to store images and large documents in their
> respective format on disc and the URL in the database or as blob objects?

Most of the times, especially for read-only data(=images), going for
the file-system is the right thing to do. Just make sure you don't put
them all in a single directory ; employ a simple hash mechanism for
deciding where to store them ( many files in a directory = performance
problem with most FS flavor )


> A requirement is that searches will be entered in many languages
> including all European, Asian and middle-eastern languages and scripts.
> This may also be mixed languages where manufacturer name may be in the
> middle of say Japanese script.
> 
> Further, my clients expect the site to grow over a period of three years
> from 4 initial languages to around 50 and service many more countries.
> 
> I have defined so far a range of categories and sub categories, types,
> manufacturers etc. I also intend to carry advertiser data, country,
> language and images. Included may also be uploaded documents being
> detailed specifications of vehicles in PDF and other formats although
> they may be outside the search criteria (???)
> My knowledge of applying single field search (ala Google) to multiple
> tables is decidedly limited and I don't want to find myself in deep
> water due to lack of specific knowledge.

There are many things to consider here. Do you need additions and
updates to be instantly indexed / searchable? Is it going to be
keywords only ? What about advanced options ? Those are just some of
the parameters that would come into play.

Personally, I wouldn't use mySQL's LIKE or regular expression
matching, nor it fulltext indices. I wouldn't even use mySQL for
search at all. Still, you should try both ways ( and others, such as
breaking down your text into words and mapping those words into
objects -- I am sorry if that sounds confusing ) and see what works
for you.

Good luck,
Mark



-- 
Mark Papadakis
http://www.markpapadakis.com/
[EMAIL PROTECTED]

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Got error 127 when reading table cat

2005-06-30 Thread Mark Papadakis

That's usually an I/O error, if memory serves me right.
Try dumping the data, drop table, recreate it, and re-insert the data  
back-in.


MarkP


On Jun 30, 2005, at 14:34 , nikos wrote:


Hello list
Can somebody infor me what is the "Got error 127 when reading table
cat"?

Thank you
Nikos


--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/mysql? 
[EMAIL PROTECTED]






--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Central UDF project at mysql.com?

2005-03-30 Thread Mark Papadakis
That is a really good idea - though I am not sure there is much of
those out there to justify the cause, nor many developers actually
using UDFs.

Still, having them all in one place could be nothing but a good thing.

MarkP

On Wed, 30 Mar 2005 14:39:11 +0100 (BST), Dan Bolser
<[EMAIL PROTECTED]> wrote:
> 
> Hi,
> 
> I searched for previous discussion on this topic, but didn't find any.
> 
> I would like to see a centralized MySQL hosted UDF archive and development
> project. The only existing 'archives' seem to be somewhat poorly
> maintained (sorry), and suffer for their duplicated efforts and being
> loosely distributed throughout the web.
> 
> The best I can find are here (ranked according to Google)...
> 
> http://empyrean.lib.ndsu.nodak.edu/~nem/mysql/udf/
> http://www.oreillynet.com/pub/wlg/2292
> http://www.thecodeproject.com/Purgatory/mygroupconcat.asp
> http://mysql-udf.sourceforge.net/
> http://www.linuxjournal.com/article/6841
> 
> I think a centralized project would do wonders for the UDF community,
> allowing UDF's to be discussed, suggested and developed under one roof. A
> first step should be to create a [EMAIL PROTECTED] mailing list. Without
> such a central list the UDF community can't communicate effectively. Who
> better than MySQL to organize the MySQL UDF community?
> 
> A simple "not officially supported" statement is all that is needed. Good
> UDF's could become part of MySQL proper, and a UDF 'bundle' would be a
> great development. MySQL programmers could help build UDF's, and the
> community could vote on 'wanted' functions.
> 
> You could probably guess where all this is going, and that is towards my
> own UDF request (where to ask?), but I will leave that for later.
> 
> Any comments? Any postings that I have missed? Any reason that their is no
> udf mailing list? I think that their are tons of UDF's waiting to happen,
> given the right conditions.
> 
> All the best,
> Dan.
> 
> --
> MySQL General Mailing List
> For list archives: http://lists.mysql.com/mysql
> To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
> 
> 


-- 
Mark Papadakis
Head of R&D
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: QUERY ordering clarification

2005-03-28 Thread Mark Papadakis
Hello,

Assume nothing. 
Use ORDER BY or re-think your approach to the problem.

MarkP


On Mon, 28 Mar 2005 09:43:09 -0800 (PST), Grant Giddens
<[EMAIL PROTECTED]> wrote:
> Hi,
> 
> If I do a query like:
> 
> SELECT prodname, price FROM prod_table WHERE sku in
> ($sku1, $sku2, $sku3, $sku4)
> 
> Will my results always be ordered in $sku1, $sku2,
> $sku3, $sku4 order? I can't really do a ORDER BY
> prodname or price here.
> 
> I just want to make sure that that this type of query
> will always return the results in $sku1, $sku2, $sku3,
> $sku4 order.
> 
> Thanks,
> Grant
> 
> __
> Do you Yahoo!?
> Yahoo! Small Business - Try our new resources site!
> http://smallbusiness.yahoo.com/resources/
> 
> --
> MySQL General Mailing List
> For list archives: http://lists.mysql.com/mysql
> To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
> 
> 


-- 
Mark Papadakis
Head of R&D
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Social Networking querys

2005-02-02 Thread Mark Papadakis
We have implemented a system which uses 'swappable' in-memory data,
binary trees and hashtables to do things like:

o Return 'best' possible route from one person to another based on
weight of relationships between links
o Return 'shortest' possible route from one person to another
o Return total persons within N degrees of seperation
and so forth.

The in-memory data are flushed when memory is tight or when they get
too old, and get replaced with more data from InnoDB tables.
Essentially, it is quite rate to need to swap or load db data.given
that the data structures are not heavy in memory requirements.

Its writen in C++. Our tests with 10 million users (random set)
indicated less than 1 second  response time for any of the above
operations (when no mem-disk swaps take place ).

MarkP



On Wed, 2 Feb 2005 13:44:52 -0500, Balazs Rauznitz <[EMAIL PROTECTED]> wrote:
> On Wed, Feb 02, 2005 at 10:19:45AM -0800, Bruce Douglas wrote:
> > dathan...
> >
> > given that you work at friendster, aren't you kind of restricted from 
> > commenting on how one would go about creating/implementing this kind of 
> > system??
> 
> I thought about this too when describing my company's solution
> (http://multiply.com/ just for full disclosure). Considering that
> technology is just one of many keys to the success of a company, I
> think techies benefit much more from sharing some experiences with
> peers rather than keep everything secret and hope that the other guy
> screws up. Of course as long as help is reciprocal...
> 
> Balazs
> 
> --
> MySQL General Mailing List
> For list archives: http://lists.mysql.com/mysql
> To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
> 
> 


-- 
Mark Papadakis
Head of R&D
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: load balacing in a replicated environment

2005-01-21 Thread Mark Papadakis
We have a mySQL clustering system in the works, which will be able to
give you clustering support ( up to 32 nodes per cluster ), with full
transactions support, in a write to ALL (at the same), read from LEAST
BUSY architecture.

In other words, all nodes will be able to serve as slaves. The least
busy node will answer the next read query. There are more feautres
planned,  but I can't discuss it further until we launch the product
(sometime in late Spring).

Mark Papadakis


On Fri, 21 Jan 2005 10:41:30 -0800 (PST), Atle Veka
<[EMAIL PROTECTED]> wrote:
> 
> The easiest way, which does not need any code changes, is to set up DNS
> round robin. Every time the application resolves the database domain name
> it gets a "random" (I believe the nameserver just circulates the list) IP
> back.
> 
> Atle
> -
> Flying Crocodile Inc, Unix Systems Administrator
> 
> On Fri, 21 Jan 2005, Eben Goodman wrote:
> 
> > I am considering setting up replication for a loaded database that has
> > to perform thousands of heavy selects every day.  I want to have a
> > master with one way replication to multiple slaves.  But I also want to
> > be able to load balance connections across the multiple slaves.  What
> > options exist to enable a web server (apache) and or a web application
> > (php/perl) to do load balancing so not all queries are sent to the same
> > slave server, but distributed across all available slaves?  One quick
> > and dirty idea would be to have a script that manages the database
> > connection layer, and based on time of day or something passes a
> > different server address through... but there must be sexier ways to
> > handle this sort of thing?
> >
> > any advice is appreciated.
> >
> 
> --
> MySQL General Mailing List
> For list archives: http://lists.mysql.com/mysql
> To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
> 
> 


-- 
Mark Papadakis
Head of R&D
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: cannot Connect to local MYSQL server through socket

2004-11-24 Thread Mark Papadakis
Hello,

The mysql sock file is used for Unix Domain Sockets communication.

In essence, it is used for interconnection between processes running
on the same system. They function just like ordinary-over-the-net
sockets. They are just faster for interprocess communication.

I am not sure I understand what your problem is with the file, or what
chmod/chown have to do with it. Please explain.

MarkP


On Wed, 24 Nov 2004 12:00:45 -0600, Victor Pendleton
<[EMAIL PROTECTED]> wrote:
> Is the MySQL server running and you can not connect? Or are you not able
> to start the MySQL server?
> 
> 
> 
> Morris, Andrew wrote:
> 
> >../var/lib/mysql/mysql.sock.
> >
> >I've been round the houses with this following the thread but I can't
> >get past this error despite all the chmod and chown modifications,
> >installed MySQL admin and it still won't start.
> >
> >Am I best to chuck it in the bin or uninstall the lot and start again?
> >
> >This is Fedora Core 3 with MySQL 3.23.58-13.
> >
> >Any help gladly appreciated but its not obvious from the web site how to
> >go beyond the chmod and chown fixes. What does the socks file do anyway?
> >
> >Thanks
> >
> >Andrew G Morris
> >ILT Advisor (Technical)
> >JISC RSC West Midlands
> >01902 824434
> >07980 982738
> >
> >
> >
> >
> 
> 
> --
> MySQL General Mailing List
> For list archives: http://lists.mysql.com/mysql
> To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
> 
> 


-- 
Mark Papadakis
Head of R&D
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: The better and more efficient way to store datetime data.

2004-11-24 Thread Mark Papadakis
Hello,

If you aim for for absolute control over the storage (the fileystem
nature is the limit), and speed, do not use an SQL system.  Of course,
you would have to face all the trouble of writing your own
mini-engine/subsystem for the job. It all comes down to what your
needs are and how much time you can spend on it.

If you want to use SQL, but do not wish to get down to milisecond
level, use a simple INT UNSIGNED, in conjuction with either
UNIX_TIMESTAMP or your favorite time() call equivalent in your
language. Thats 4 bytes.


Mark

On Wed, 24 Nov 2004 14:53:08 +0100, Jose Antonio <[EMAIL PROTECTED]> wrote:
> I need to store huge data series using MySQL with InnoDB as storage
> engine. The data type of the parameters can be double, float, int,
> smallint, mediumint, tinyint  So, I've thought to store them in
> the following way:
> 
> Table Parameter:
> Parameter ID - small int
> Parameter Name - varchar(8)
> Parameter Description - varchar(16)
> Parameter dbType - varchar(10)
> 
> Table floatParameter:
> Parameter ID - small int
> Datetime - datetime or long
> Parameter value - float
> 
> etc 
> 
> for the Datetime field  is it better to use the MySQL built-in
> DATETIME type, or is it better to save a long (as milliseconds)?
> 
> The required hard-disk storage by a 'datetime' is the same as for a 'long'?
> Is there any different in the performance?
> 
> The queries I will be doing more often are similar to this one:
> "SELECT datetime, value FROM floatParameter WHERE datetime BETWEEN
> '2004-10-01 00:00:00' and '2004-10-15 00:00:00'"
> 
> Discussion is open and suggestions are more than welcome.
> 
> Jose.
> 
> --
> MySQL General Mailing List
> For list archives: http://lists.mysql.com/mysql
> To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
> 
> 


-- 
Mark Papadakis
Head of R&D
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Mysql 4.1 and the LIMIT sql statement

2004-11-17 Thread Mark Papadakis
I suppose they fixed it.
Relying on 'undocumented features' is a bad habbit. 

Update your code to exclude the LIMIT clause if you do not wish to use
it. Its the best thing ou can do.

Mark Papadakis



On Wed, 17 Nov 2004 12:21:31 -0800, Matt Babineau <[EMAIL PROTECTED]> wrote:
> Hi all-
> 
> Has anyone run into problems with this sql syntax?
> 
> LIMIT -1
> 
> I've used this extensively in my code to get back all records rather then
> specifing a limit. I've done this programmatically with PHP, so all my
> queries have a limit even if I don't need one, I just have it specify LIMIT
> -1, but apparently this functionality doesn't seem to work in 4.1???
> 
> Thanks,
> 
> Matt Babineau
> Web Developer
> Criticalcode - http://www.criticalcode.com
> 
> 


-- 
Mark Papadakis
Head of R&D
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: scalability of MySQL - future plans?

2004-11-13 Thread Mark Papadakis
InnoDB is able to handle that workload of 600 TB/year in
> 
> year 2012. But you will need a huge server which has 10 x the memory of a
> high-end server, and 600 - 4000 physical disk drives.
> 
> The following link describes a system with 512 GB of memory, and 2000 disk
> 
> drives:
> http://www.tpc.org/results/individual_results/IBM/IBM_690_040217_es.pdf
> The system costs 5.6 million US dollars.
> 
> > Best regards,
> > Jacek Becla
> > Stanford University
> 
> Best regards,
> 
> Heikki Tuuri
> Innobase Oy
> Foreign keys, transactions, and row level locking for MySQL
> InnoDB Hot Backup - a hot backup tool for InnoDB which also backs up
> MyISAM
> tables
> http://www.innodb.com/order.php
> 
> Order MySQL technical support from https://order.mysql.com/
> 
> --
> MySQL General Mailing List
> For list archives: http://lists.mysql.com/mysql
> To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
> 
> 


-- 
Mark Papadakis
Head of R&D
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



mySQL Clustering and HA (NDB - Emic Networks Solution - Replication) : Enterpise Use

2004-11-04 Thread Mark Papadakis
Hello all,

After playing with the idea of  'abandoning ship' in favor of IBM DB2
or Oracle, we deiced to stick with mySQL, due its simplicity and
investment in time and experience we have put into it.

Our company needs a HA solution for ensuring 24x7 operation for the
mySQL server instances. As it is, there are are two solutions
available for the problem: Emic Networks's EAC for mySQL and MySQL's
Cluster.

The Emic solution seems to work but is way too expensive for our
budget (around 4k$ for each 2CPUs node). So we need to either go with
NDB or try to get replication to work properly.

Here is a list of questions:
o How 'stable' is MySQL cluster (NDB) ? Is it ready for enterprise
use? Or even tested?

o Does the memory size limit the data we can manage? If it is a memory
based solution it should mean that it can handle of a very limited
number of databases/tables/rows, based on the available memory of the
nodes.

o Is there some sort of tight integration planned for mySQL cluster
and mySQL server ? Perhaps in 5.0 ?

o When is adding/removing nodes on the fly scheduled for
implementation? Without such a feature the system would have to be
shutdown - therefore not a complete HA solution.

o Has anyone gotten replication to work right? Perhaps Multi-Master replication?

Thank you very much in advance,
MarkP


-- 
Mark Papadakis
Head of R&D
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Corrupted tables -- for 'no apparent' reason

2001-09-07 Thread Mark Papadakis

Hello,

We are using mySQL on over 6 servers here, we have been doing so for over 2 years, and 
we are constaly facing problems with corrupted tables, especially on two of our 
busiest servers. 
Tables seem to corrupt out of the blue and we have to shut them down ( the servers ) 
occassionaly to fix all tables and then bring them up again.

This is really not something we want to do, bringing down a server that is, so we were 
wondering if we are doing something wrong. There must be other users of mySQL using it 
for far most difficult tasks who maybe faced the same problems once but managed to 
solve them. 

We are using mySQL 3.23.41. Tables corruptions occur regardless the server's 
configuration ( even on a system with PIII@1MhzX2 with 1.5G RAM we get those problems 
) so maybe there is something wrong with the startup options we are using for mySQLd.

This is how we start mySQLd.

--skip-locking -O back_log=1024 -O table_cache=280 -O max_connections=2048 -O 
wait_timeout=30 -O interactive_timeout=30 -O long_query_time=2 
--log-slow-queries=slow.log --big-tables

Please reply to [EMAIL PROTECTED] Thank you in advance,

Mark Papadakis


-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail <[EMAIL PROTECTED]>
To unsubscribe, e-mail <[EMAIL PROTECTED]>
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php




order by ( bug or undocumented feature )

2001-01-21 Thread Mark Papadakis

Hi all,

I was wondering what's wrong with a query like this:

select itemlist , sum(field1), count(*) as cnt from table where where conditions 
group by id having cnt=2 order by field_x, field_y desc limit 10

I am expecting to get the requested rows order by field_x. Those with same value ( as 
in field_x=5 ) should be additionaly ordered by field_y. So for example I 'd get:

field_x, field_y
52
52
51
50
45
38

and so on.

Am I missing the point of order by here? If so, what is the best way/fastest way to 
achieve the required results set?

Please, reply directly to me ( [EMAIL PROTECTED] ) if possible.

Thank you,




Mark Papadakis
R&D Director - Web Division
Phaistos Networks, S.A. - http://www.phaistosnetworks.gr 
[EMAIL PROTECTED] T:+30-892-23855  F:+30-892-22670
- A DOL Digital Company



-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail <[EMAIL PROTECTED]>
To unsubscribe, e-mail <[EMAIL PROTECTED]>
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php