Re: Hypothetical design question regarding keyword searching

2007-07-19 Thread Mark Papadakis

Greetings,

Buy 'Building Scalable Web Sites'
[http://www.oreillynet.com/pub/pr/1582], authored by the chief
architect of Flickr. Among other interesting topics, he describes the
system they use for full-text search. Its pretty simple, though this
is just one of the ways you can solve this problem.

Good luck,
Mark

On 7/19/07, Peter Bradley [EMAIL PROTECTED] wrote:

Ysgrifennodd Scott Haneda:
 I have been looking at stock photo sites lately, started wondering how they
 are doing their keyword searched.  Given a potential for millions of images,
 each with x keywords, I have come up with two approaches...


snip /

Is this the sort of thing you're looking for:

http://en.wikipedia.org/wiki/Inverted_index

It's the sort of structure used in library software.



Peter

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]





--
Mark Papadakis
http://www.markpapadakis.com/
[EMAIL PROTECTED]

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Abnormal mySQL service behavior / 5.0.26

2007-02-16 Thread Mark Papadakis

Good day,

For the past 2 weeks, we have been dealing with some rather strange problems.
While nothing changed in terms of the mySQL server or clients
configuration ( including the options provided to the server during
startup, by either my.cnf or as arguments to the executable ), we are
getting the following kind of errors.

o Server shutdown in progress
o Out of memory (Needed 5256540 bytes)
o Sort Aborted
o o Can't create a new thread (errno 11); if you are not out of
available memory, you can consult the manual for a possible
OS-dependent bug
o Unknown Error ( this occurs more often than the rest )

There is plenty of memory on the system, as much as there was before
the problems surfaced.

We moved a database from that system, to another system ( that
database was the one hit more often ) in hope to perhaps solve the
problem. Indeed, the errors are coming up less frequently now, but
they still do.

Is there any chance this is due to tables corruption or corruption of
any other kind on the server side? I didn't see any bug fixes in 0.27+
revisions that seem to be related to this problem, so I assume its not
a bug that existed in = 0.26.

Any ideas ?

Thank you very much in advance.

PS: Please reply to this email address as well, if possible.

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Abnormal mySQL service behavior / 5.0.26

2007-02-16 Thread Mark Papadakis

On 2/16/07, Juan Eduardo Moreno [EMAIL PROTECTED] wrote:



On 2/16/07, Mark Papadakis [EMAIL PROTECTED] wrote:
 Good day,


R: are you using MyISAM or InnoDB tables?


InnoDB, only.


 For the past 2 weeks, we have been dealing with some rather strange
problems.
 While nothing changed in terms of the mySQL server or clients
 configuration ( including the options provided to the server during
 startup, by either my.cnf or as arguments to the executable ), we are
 getting the following kind of errors.

 o Server shutdown in progress


R: Could be any fatal error in mysql that produce this server shutdown in
progress


True, however the server doesn't actually shut down, nor it crashes or
anything like that, except once.
It is as if all threads are killed, or at least the questions that are
actively being processed.




 o Out of memory (Needed 5256540 bytes)


R: What is your sort_buffer_size setting?



sort_buffer_size = 24MB




 o Sort Aborted

R: filesort.cc ..The error 'Sort aborted' comes if the sort function fails
for some reason. You can try identified what query is a cause of error.



The amount of data that needs to be processed (i.e sorted) for those
queries to return the results set is small, judging from the database
structure as well as the actual queries. Plus, those queries are
different every time. Executing those SELECT statements later on,
turns out they are going through just a handful of rows anyway.



 o o Can't create a new thread (errno 11); if you are not out of
 available memory, you can consult the manual for a possible
 OS-dependent bug
 o Unknown Error ( this occurs more often than the rest )


R: What say the  error file in specific?


Not much can be deducting from going through the error file.

070216  8:34:49 [ERROR] Out of memory; check if mysqld or some other
process uses all available memory; if not, you may have to use
'ulimit' to allow
mysqld to use more memory or you can add more swap space


070213 20:34:49 [ERROR] /usr/local/mysql/bin/mysqld: Sort aborted

The only meaningful message block is:
BEGIN


070216  8:34:49 [ERROR] Out of memory; check if mysqld or some other
process uses all available memory; if not, you may have to use
'ulimit' to allow
mysqld to use more memory or you can add more swap space
070216  8:34:49 [ERROR] Out of memory; check if mysqld or some other
process uses all available memory; if not, you may have to use
'ulimit' to allow
mysqld to use more memory or you can add more swap space
mysqld got signal 6;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
We will try our best to scrape up some info that will hopefully help diagnose
the problem, but since we have already crashed, something is definitely wrong
and this may fail.

key_buffer_size=41943040
read_buffer_size=8384512
max_used_connections=2049
max_connections=2048
threads_connected=964
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size +
sort_buffer_size)*max_connections = 32752 K
bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

You seem to be running 32-bit Linux and have 964 concurrent connections.
If you have not changed STACK_SIZE in LinuxThreads and built the binary
yourself, LinuxThreads is quite likely to steal a part of the global heap for
the thread stack. Please read http://www.mysql.com/doc/en/Linux.html

thd=0x46dc5840
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
Cannot determine thread, fp=0xbbf3c438, backtrace may not be correct.
Stack range sanity check OK, backtrace follows:
0x80a0a12
0x82fb4e8
0x83257a1
0x82fb879
0x8325a80
0x838a3b8
0x838a3dd
0x838ae96
0x838b065
0x838a30c
0x812c923
0x83b0fa3
0x8126642
0x8104a29
0x80b410e
0x80b410e
0x80b944a
0x80b0e54
0x80b06f3
0x80afc84
0x82f8c9c
0x83412ea
New value of fp=(nil) failed sanity check, terminating stack trace!
Please read http://dev.mysql.com/doc/mysql/en/Using_stack_trace.html
and follow instructions on how to resolve the stack trace. Resolved
stack trace is much more helpful in diagnosing the problem, so please do
resolve it
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort...
thd-query at 0x1f284388 = UPDATE content SET hits1 = hits1 + 1 WHERE
src = 'woman'
thd-thread_id=19077185
The manual page at http://www.mysql.com/doc/en/Crashing.html contains
information that should help you find out what is causing the crash.
pure virtual method called

Number of processes running now: 0


END



 There is plenty of memory on the system, as much as there was before
 the problems surfaced.

 We moved a database from that system, to another system ( that
 database was the one hit more often ) in hope to perhaps solve the
 problem. Indeed

Re: How thread-safe is mysql_real_connect()?

2005-10-07 Thread Mark Papadakis
Greetings,

mySQL is thread safe, more or less.
Make sure you compile against libmysqlclient_r (or simply
ignore/handle SIGPIPE ).


Further info can be found at:
http://dev.mysql.com/doc/mysql/en/myodbc-unix-thread-safe.html
http://dev.mysql.com/doc/mysql/en/myodbc-unix-thread-safe.html

MarkP

On 10/7/05, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote:
 (please excuse the double post but I wanted to reach the two audiences I
 thought could help the best)

 This is a question about the interpreting the documentation in the manual
 for the C API.
 I searched the list archives (all lists) going back 365 days for the terms
 (unquoted): mysql_real_connect thread (I also looked for
 alternatives:mysql_real_connect threaded, mysql_real_connect multi
 threaded, etc.). I searched on Google Groups for: mysql_real_connect
 thread and found a few interesting hits. However, I am still not 100%
 clear on how to interpret some of the information on this page:
 http://dev.mysql.com/doc/mysql/en/threaded-clients.html

 I do a lot of MySQL administration and development using mostly the CLI
 and a few other tools but I am writing a multithreaded client to automate
 certain background processing and I need a bit of advice. According to the
 page in question the function mysql_real_connect() is not thread-safe.
 Does that simply mean that I cannot call that function from more than one
 thread at a time or does that mean that the connection created by one call
 to the function will be visible to the other threads or what? Just how not
 thread-safe is it?

 Each thread will have it's own  MYSQL structure and I will need to use two
 different connections per thread at the same time (am I going to need a
 separate call to mysql_init() for each connection?). I know how to wrap
 all of my calls to mysql_real_connect()  in a critical section or protect
 them with a mutex if that's all I need to do . If it's not that simple and
 I do need to compile and link against another library (as the page
 suggests - sort of) can someone help me to configure my Microsoft Visual
 C++ .NET (v7) to do it? I said sort-of because the page also says that
 the binary distributions (which I am working with ) already contain the
 threadsafe library so I wonder if I need to rebuild anything or not.  How
 can I tell?

 I am an experienced but not well-seasoned C++ developer (not using c# for
 this). I know the language and can write and debug code just fine (I can
 make stand-alone apps and DLLs all day); it's just that some of the
 complier/linker options and settings that confound me and I am having
 trouble translating the advice on the page into specifics I can work with
 for my environment.

 I know I probably left out some simple pieces of information, just let me
 know and I will respond ASAP. Please remember to CC: both lists on all
 responses.

 Shawn Green
 Database Administrator
 Unimin Corporation - Spruce Pine







--
Mark Papadakis
http://www.markpapadakis.com/
[EMAIL PROTECTED]

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Some Assistance Please

2005-08-30 Thread Mark Papadakis
Greetings Rob,


 
 What is the optimum way to structure the database to allow for the
 simplest user search?

 Is it more efficient to store images and large documents in their
 respective format on disc and the URL in the database or as blob objects?

Most of the times, especially for read-only data(=images), going for
the file-system is the right thing to do. Just make sure you don't put
them all in a single directory ; employ a simple hash mechanism for
deciding where to store them ( many files in a directory = performance
problem with most FS flavor )


 A requirement is that searches will be entered in many languages
 including all European, Asian and middle-eastern languages and scripts.
 This may also be mixed languages where manufacturer name may be in the
 middle of say Japanese script.
 
 Further, my clients expect the site to grow over a period of three years
 from 4 initial languages to around 50 and service many more countries.
 
 I have defined so far a range of categories and sub categories, types,
 manufacturers etc. I also intend to carry advertiser data, country,
 language and images. Included may also be uploaded documents being
 detailed specifications of vehicles in PDF and other formats although
 they may be outside the search criteria (???)
 My knowledge of applying single field search (ala Google) to multiple
 tables is decidedly limited and I don't want to find myself in deep
 water due to lack of specific knowledge.

There are many things to consider here. Do you need additions and
updates to be instantly indexed / searchable? Is it going to be
keywords only ? What about advanced options ? Those are just some of
the parameters that would come into play.

Personally, I wouldn't use mySQL's LIKE or regular expression
matching, nor it fulltext indices. I wouldn't even use mySQL for
search at all. Still, you should try both ways ( and others, such as
breaking down your text into words and mapping those words into
objects -- I am sorry if that sounds confusing ) and see what works
for you.

Good luck,
Mark



-- 
Mark Papadakis
http://www.markpapadakis.com/
[EMAIL PROTECTED]

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Got error 127 when reading table cat

2005-06-30 Thread Mark Papadakis

That's usually an I/O error, if memory serves me right.
Try dumping the data, drop table, recreate it, and re-insert the data  
back-in.


MarkP


On Jun 30, 2005, at 14:34 , nikos wrote:


Hello list
Can somebody infor me what is the Got error 127 when reading table
cat?

Thank you
Nikos


--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/mysql? 
[EMAIL PROTECTED]






--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Central UDF project at mysql.com?

2005-03-30 Thread Mark Papadakis
That is a really good idea - though I am not sure there is much of
those out there to justify the cause, nor many developers actually
using UDFs.

Still, having them all in one place could be nothing but a good thing.

MarkP

On Wed, 30 Mar 2005 14:39:11 +0100 (BST), Dan Bolser
[EMAIL PROTECTED] wrote:
 
 Hi,
 
 I searched for previous discussion on this topic, but didn't find any.
 
 I would like to see a centralized MySQL hosted UDF archive and development
 project. The only existing 'archives' seem to be somewhat poorly
 maintained (sorry), and suffer for their duplicated efforts and being
 loosely distributed throughout the web.
 
 The best I can find are here (ranked according to Google)...
 
 http://empyrean.lib.ndsu.nodak.edu/~nem/mysql/udf/
 http://www.oreillynet.com/pub/wlg/2292
 http://www.thecodeproject.com/Purgatory/mygroupconcat.asp
 http://mysql-udf.sourceforge.net/
 http://www.linuxjournal.com/article/6841
 
 I think a centralized project would do wonders for the UDF community,
 allowing UDF's to be discussed, suggested and developed under one roof. A
 first step should be to create a [EMAIL PROTECTED] mailing list. Without
 such a central list the UDF community can't communicate effectively. Who
 better than MySQL to organize the MySQL UDF community?
 
 A simple not officially supported statement is all that is needed. Good
 UDF's could become part of MySQL proper, and a UDF 'bundle' would be a
 great development. MySQL programmers could help build UDF's, and the
 community could vote on 'wanted' functions.
 
 You could probably guess where all this is going, and that is towards my
 own UDF request (where to ask?), but I will leave that for later.
 
 Any comments? Any postings that I have missed? Any reason that their is no
 udf mailing list? I think that their are tons of UDF's waiting to happen,
 given the right conditions.
 
 All the best,
 Dan.
 
 --
 MySQL General Mailing List
 For list archives: http://lists.mysql.com/mysql
 To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
 
 


-- 
Mark Papadakis
Head of RD
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: QUERY ordering clarification

2005-03-28 Thread Mark Papadakis
Hello,

Assume nothing. 
Use ORDER BY or re-think your approach to the problem.

MarkP


On Mon, 28 Mar 2005 09:43:09 -0800 (PST), Grant Giddens
[EMAIL PROTECTED] wrote:
 Hi,
 
 If I do a query like:
 
 SELECT prodname, price FROM prod_table WHERE sku in
 ($sku1, $sku2, $sku3, $sku4)
 
 Will my results always be ordered in $sku1, $sku2,
 $sku3, $sku4 order? I can't really do a ORDER BY
 prodname or price here.
 
 I just want to make sure that that this type of query
 will always return the results in $sku1, $sku2, $sku3,
 $sku4 order.
 
 Thanks,
 Grant
 
 __
 Do you Yahoo!?
 Yahoo! Small Business - Try our new resources site!
 http://smallbusiness.yahoo.com/resources/
 
 --
 MySQL General Mailing List
 For list archives: http://lists.mysql.com/mysql
 To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
 
 


-- 
Mark Papadakis
Head of RD
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Social Networking querys

2005-02-02 Thread Mark Papadakis
We have implemented a system which uses 'swappable' in-memory data,
binary trees and hashtables to do things like:

o Return 'best' possible route from one person to another based on
weight of relationships between links
o Return 'shortest' possible route from one person to another
o Return total persons within N degrees of seperation
and so forth.

The in-memory data are flushed when memory is tight or when they get
too old, and get replaced with more data from InnoDB tables.
Essentially, it is quite rate to need to swap or load db data.given
that the data structures are not heavy in memory requirements.

Its writen in C++. Our tests with 10 million users (random set)
indicated less than 1 second  response time for any of the above
operations (when no mem-disk swaps take place ).

MarkP



On Wed, 2 Feb 2005 13:44:52 -0500, Balazs Rauznitz [EMAIL PROTECTED] wrote:
 On Wed, Feb 02, 2005 at 10:19:45AM -0800, Bruce Douglas wrote:
  dathan...
 
  given that you work at friendster, aren't you kind of restricted from 
  commenting on how one would go about creating/implementing this kind of 
  system??
 
 I thought about this too when describing my company's solution
 (http://multiply.com/ just for full disclosure). Considering that
 technology is just one of many keys to the success of a company, I
 think techies benefit much more from sharing some experiences with
 peers rather than keep everything secret and hope that the other guy
 screws up. Of course as long as help is reciprocal...
 
 Balazs
 
 --
 MySQL General Mailing List
 For list archives: http://lists.mysql.com/mysql
 To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
 
 


-- 
Mark Papadakis
Head of RD
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: load balacing in a replicated environment

2005-01-21 Thread Mark Papadakis
We have a mySQL clustering system in the works, which will be able to
give you clustering support ( up to 32 nodes per cluster ), with full
transactions support, in a write to ALL (at the same), read from LEAST
BUSY architecture.

In other words, all nodes will be able to serve as slaves. The least
busy node will answer the next read query. There are more feautres
planned,  but I can't discuss it further until we launch the product
(sometime in late Spring).

Mark Papadakis


On Fri, 21 Jan 2005 10:41:30 -0800 (PST), Atle Veka
[EMAIL PROTECTED] wrote:
 
 The easiest way, which does not need any code changes, is to set up DNS
 round robin. Every time the application resolves the database domain name
 it gets a random (I believe the nameserver just circulates the list) IP
 back.
 
 Atle
 -
 Flying Crocodile Inc, Unix Systems Administrator
 
 On Fri, 21 Jan 2005, Eben Goodman wrote:
 
  I am considering setting up replication for a loaded database that has
  to perform thousands of heavy selects every day.  I want to have a
  master with one way replication to multiple slaves.  But I also want to
  be able to load balance connections across the multiple slaves.  What
  options exist to enable a web server (apache) and or a web application
  (php/perl) to do load balancing so not all queries are sent to the same
  slave server, but distributed across all available slaves?  One quick
  and dirty idea would be to have a script that manages the database
  connection layer, and based on time of day or something passes a
  different server address through... but there must be sexier ways to
  handle this sort of thing?
 
  any advice is appreciated.
 
 
 --
 MySQL General Mailing List
 For list archives: http://lists.mysql.com/mysql
 To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
 
 


-- 
Mark Papadakis
Head of RD
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: The better and more efficient way to store datetime data.

2004-11-24 Thread Mark Papadakis
Hello,

If you aim for for absolute control over the storage (the fileystem
nature is the limit), and speed, do not use an SQL system.  Of course,
you would have to face all the trouble of writing your own
mini-engine/subsystem for the job. It all comes down to what your
needs are and how much time you can spend on it.

If you want to use SQL, but do not wish to get down to milisecond
level, use a simple INT UNSIGNED, in conjuction with either
UNIX_TIMESTAMP or your favorite time() call equivalent in your
language. Thats 4 bytes.


Mark

On Wed, 24 Nov 2004 14:53:08 +0100, Jose Antonio [EMAIL PROTECTED] wrote:
 I need to store huge data series using MySQL with InnoDB as storage
 engine. The data type of the parameters can be double, float, int,
 smallint, mediumint, tinyint  So, I've thought to store them in
 the following way:
 
 Table Parameter:
 Parameter ID - small int
 Parameter Name - varchar(8)
 Parameter Description - varchar(16)
 Parameter dbType - varchar(10)
 
 Table floatParameter:
 Parameter ID - small int
 Datetime - datetime or long
 Parameter value - float
 
 etc 
 
 for the Datetime field  is it better to use the MySQL built-in
 DATETIME type, or is it better to save a long (as milliseconds)?
 
 The required hard-disk storage by a 'datetime' is the same as for a 'long'?
 Is there any different in the performance?
 
 The queries I will be doing more often are similar to this one:
 SELECT datetime, value FROM floatParameter WHERE datetime BETWEEN
 '2004-10-01 00:00:00' and '2004-10-15 00:00:00'
 
 Discussion is open and suggestions are more than welcome.
 
 Jose.
 
 --
 MySQL General Mailing List
 For list archives: http://lists.mysql.com/mysql
 To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
 
 


-- 
Mark Papadakis
Head of RD
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: cannot Connect to local MYSQL server through socket

2004-11-24 Thread Mark Papadakis
Hello,

The mysql sock file is used for Unix Domain Sockets communication.

In essence, it is used for interconnection between processes running
on the same system. They function just like ordinary-over-the-net
sockets. They are just faster for interprocess communication.

I am not sure I understand what your problem is with the file, or what
chmod/chown have to do with it. Please explain.

MarkP


On Wed, 24 Nov 2004 12:00:45 -0600, Victor Pendleton
[EMAIL PROTECTED] wrote:
 Is the MySQL server running and you can not connect? Or are you not able
 to start the MySQL server?
 
 
 
 Morris, Andrew wrote:
 
 ../var/lib/mysql/mysql.sock.
 
 I've been round the houses with this following the thread but I can't
 get past this error despite all the chmod and chown modifications,
 installed MySQL admin and it still won't start.
 
 Am I best to chuck it in the bin or uninstall the lot and start again?
 
 This is Fedora Core 3 with MySQL 3.23.58-13.
 
 Any help gladly appreciated but its not obvious from the web site how to
 go beyond the chmod and chown fixes. What does the socks file do anyway?
 
 Thanks
 
 Andrew G Morris
 ILT Advisor (Technical)
 JISC RSC West Midlands
 01902 824434
 07980 982738
 
 
 
 
 
 
 --
 MySQL General Mailing List
 For list archives: http://lists.mysql.com/mysql
 To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
 
 


-- 
Mark Papadakis
Head of RD
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Mysql 4.1 and the LIMIT sql statement

2004-11-17 Thread Mark Papadakis
I suppose they fixed it.
Relying on 'undocumented features' is a bad habbit. 

Update your code to exclude the LIMIT clause if you do not wish to use
it. Its the best thing ou can do.

Mark Papadakis



On Wed, 17 Nov 2004 12:21:31 -0800, Matt Babineau [EMAIL PROTECTED] wrote:
 Hi all-
 
 Has anyone run into problems with this sql syntax?
 
 LIMIT -1
 
 I've used this extensively in my code to get back all records rather then
 specifing a limit. I've done this programmatically with PHP, so all my
 queries have a limit even if I don't need one, I just have it specify LIMIT
 -1, but apparently this functionality doesn't seem to work in 4.1???
 
 Thanks,
 
 Matt Babineau
 Web Developer
 Criticalcode - http://www.criticalcode.com
 
 


-- 
Mark Papadakis
Head of RD
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: scalability of MySQL - future plans?

2004-11-13 Thread Mark Papadakis
, and row level locking for MySQL
 InnoDB Hot Backup - a hot backup tool for InnoDB which also backs up
 MyISAM
 tables
 http://www.innodb.com/order.php
 
 Order MySQL technical support from https://order.mysql.com/
 
 --
 MySQL General Mailing List
 For list archives: http://lists.mysql.com/mysql
 To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
 
 


-- 
Mark Papadakis
Head of RD
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



mySQL Clustering and HA (NDB - Emic Networks Solution - Replication) : Enterpise Use

2004-11-04 Thread Mark Papadakis
Hello all,

After playing with the idea of  'abandoning ship' in favor of IBM DB2
or Oracle, we deiced to stick with mySQL, due its simplicity and
investment in time and experience we have put into it.

Our company needs a HA solution for ensuring 24x7 operation for the
mySQL server instances. As it is, there are are two solutions
available for the problem: Emic Networks's EAC for mySQL and MySQL's
Cluster.

The Emic solution seems to work but is way too expensive for our
budget (around 4k$ for each 2CPUs node). So we need to either go with
NDB or try to get replication to work properly.

Here is a list of questions:
o How 'stable' is MySQL cluster (NDB) ? Is it ready for enterprise
use? Or even tested?

o Does the memory size limit the data we can manage? If it is a memory
based solution it should mean that it can handle of a very limited
number of databases/tables/rows, based on the available memory of the
nodes.

o Is there some sort of tight integration planned for mySQL cluster
and mySQL server ? Perhaps in 5.0 ?

o When is adding/removing nodes on the fly scheduled for
implementation? Without such a feature the system would have to be
shutdown - therefore not a complete HA solution.

o Has anyone gotten replication to work right? Perhaps Multi-Master replication?

Thank you very much in advance,
MarkP


-- 
Mark Papadakis
Head of RD
Phaistos Networks, S.A

-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Corrupted tables -- for 'no apparent' reason

2001-09-07 Thread Mark Papadakis

Hello,

We are using mySQL on over 6 servers here, we have been doing so for over 2 years, and 
we are constaly facing problems with corrupted tables, especially on two of our 
busiest servers. 
Tables seem to corrupt out of the blue and we have to shut them down ( the servers ) 
occassionaly to fix all tables and then bring them up again.

This is really not something we want to do, bringing down a server that is, so we were 
wondering if we are doing something wrong. There must be other users of mySQL using it 
for far most difficult tasks who maybe faced the same problems once but managed to 
solve them. 

We are using mySQL 3.23.41. Tables corruptions occur regardless the server's 
configuration ( even on a system with PIII@1MhzX2 with 1.5G RAM we get those problems 
) so maybe there is something wrong with the startup options we are using for mySQLd.

This is how we start mySQLd.

--skip-locking -O back_log=1024 -O table_cache=280 -O max_connections=2048 -O 
wait_timeout=30 -O interactive_timeout=30 -O long_query_time=2 
--log-slow-queries=slow.log --big-tables

Please reply to [EMAIL PROTECTED] Thank you in advance,

Mark Papadakis


-
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/   (the list archive)

To request this thread, e-mail [EMAIL PROTECTED]
To unsubscribe, e-mail [EMAIL PROTECTED]
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php