Re: WANTED: Utility to reverse engineer existing database II
emacs MJM - Original Message - From: Kevin [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Tuesday, August 07, 2001 11:30 AM Subject: WANTED: Utility to reverse engineer existing database II Thanks for pointing out mysqldump. I now need to be able to copy a limited number of data records. I see that mysqldump allows data copy by providing the cooresponding INSERT statements. However, I don't always want all of the records. Some of my tables have thousands of records and I may only want the first 200 or so. I did not see an option on mysqldump that would limit the number of records. Any ideas without writing a program? Kevin -Original Message- From: Kevin [mailto:[EMAIL PROTECTED]] Sent: Monday, August 06, 2001 4:58 PM To: [EMAIL PROTECTED] Subject: WANTED: Utility to reverse engineer existing database I need a utility that will probe my existing mysql database, analyze the 90+ tables and spit out the data definition language (create table, create index, etc.) needed to recreate the database. Does such a utility exist? Kevin - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Help Please OpenBSD Mysql
/usr/libexec/ld.so loads the dynamic libraries, It goes down a path set by LD_LIBRARY_PATH, get the location where the libary is in and put it in the path, should be that simply. find / -name libpthread.so.14* -print , might help. BTW that was a solaris answer but should be the same on openbsd MJM - Original Message - From: Savage, Elijah [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Thursday, July 26, 2001 2:34 PM Subject: Help Please OpenBSD Mysql Has anyone ever seen this error. I have loaded mysql on a sparc running openbsd. I have asked on the opebsd list and searched for days on google and deja. But it seems as if mysql has a problem running on the sparc platform because others have ran in to this eact same problem but have not been provided an answer. Is there anyone here that can help me please. The error pasted below is from when I run safe_mysqld. /usr/libexec/ld.so: my_print_defaults: libpthread.so.14.20: No such file or directory Starting mysqld daemon with databases from /var/mysql 010726 13:24:45 mysqld ended - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: mysql.org
The web site is a off shot of the magazine, Ziff-Davis publishes most of the tech magazines on the new racks. They Been doing it for a long time. The class that this one is in I will call the Movers and Shakers. Interactive week they claim is a 200$ a year subscription, but I doubt anyone ever paid it. It is sent to you after filling out a questionnaire that you buy/approval/recommend Internet/computer stuff. They want the CTO to the lead programmer(people in the purchase order loop) They are using it so the advertiser reach the group they want. Overall they are not bad and give you something to read in the restroom. MJM - Original Message - From: Van [EMAIL PROTECTED] To: Michael Meltzer [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Sent: Friday, July 20, 2001 1:32 AM Subject: Re: mysql.org Michael Meltzer wrote: thought the list might want to know, this has been picked up by a trade magazine, I got a copy of interactive week in sail mail today. (In my best sarcastic voice)As they say in Hollywood Any Publicity is good as long as your spell the names right. Found a web version if any one wants a look. http://www.zdnet.com/intweek/stories/news/0,4164,2787146,00.html MJM database to make the filter happy Michael: I'd have never caught that but for the list. Thanks. Wonder what the audience for that site is. Also, was particularly intrigued by the Portal out of the Box note. I thought Progress' only integration with MySQL was Gemini. Clearly MySQL + Gemini != Portal. Hmmm! I'm (probably?) not going anywhere with this, but, perhaps someone should order the mysql.org product and check for PHP integration under interesting licensing (not GPL). Not the same licensing as Apache, which could be integrated in almost anything non-GPL, but makes the ears perk up. My vote's for Monty and MySQL AB. That's the server I use and will continue to do so. Best Regards, Van -- = Linux rocks!!! http://www.dedserius.com/ = - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Questions about extremely large database support
Do not put tick by tick data in a database, The stuff is not relational, it is time series, FAME was one on the few that could deal it but I think it died. A database does not help research or organizing the data, it gets in the way. you would be better off timestamping the data to the millisecond and making a simple structure for trade and quote records that can run them together in time order and making a flat ACSII file for each symbol per day, depending on the access pattern use zlib to compress the file(s) after a few days(should get 8:1 compression and fast read access). You need a few custom filters if you do not want to pull back the whole symbol data for the day or to handle splits. Now using A database to mange the files and provide summary(open,close,high,low,etc...) information for screening is fine but not the raw data. MJM - Original Message - From: Tom Wheeler [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Thursday, July 19, 2001 4:15 PM Subject: Questions about extremely large database support We are beginning a project and need to choose a database. We have been using MS Visual FoxPro, which is like mySQL in that it is very fast and ISAM-based, but is used more often as a file database rather than client/server. Unfortunately, we are quickly approaching FoxPro's 2GB table size limit, so we cannot continue using it. Our two most important requirements for the database engine are speed and scalability. We will be inserting probably 5,000,000 records per day into our database, and will maintain around 2TB of data. Of course, these figures will grow in time (probably about 40% per year). We will be accessing the data using custom C++ components, and at this stage, our data model/design is fairly flexible. We would like to be able to scale easily, potentially by splitting databases up across multiple machines. My questions are: Is mySQL up to such a task? I have been using mySQL for four years now, but have never used it in a project of this magnitude. We'll be handling financial data in the database, so integrity is important. Where can I find information about very large databases with mySQL? Is there a really efficient way to implement a function like indexseek() in FoxPro? This function will simply check an index to tell you if a record with that key exists. Sort of like select count(id) from Foo where id=1 except that it doesn't actually fetch the field value and it just checks the index file, not the data file. Thanks for your help. If you would prefer to take this thread offline from the list, you may e-mail me directly at [EMAIL PROTECTED] tw - Tom Wheeler Software Engineer Teralogix, Inc. [EMAIL PROTECTED] - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: mysql.org
thought the list might want to know, this has been picked up by a trade magazine, I got a copy of interactive week in sail mail today. (In my best sarcastic voice)As they say in Hollywood Any Publicity is good as long as your spell the names right. Found a web version if any one wants a look. http://www.zdnet.com/intweek/stories/news/0,4164,2787146,00.html MJM database to make the filter happy - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: beowulfen and mysql
I think you are overestimating the compute needs, 100,000 customers generating 1k on average a day of data(I suspect that is a high number) for 1 year,36 gig of data. Not that Much. using a IO subsystem that can do 100 meg/sec read access(3ware comes to mind as a cheap way, you can get it above 200+ meg a second for allot more, pci bus limited) 360 seconds for one pass thought the data. 6 minutes is not that bad, no real-time need for this problem. Build a system based on the serverworks HE chip set, 4 gig's memory is only 2000$ these days(and should make the programmer life easier) and has dual PIII and dual pci chips, put in a gigbit interface for the LAN connect if you want to offload the problem. 2.2Ghz of CPU should solve most of your computation issues(stat and simple matching). About the only thing that could be a problem is your programmers. They hopeful need to use a one pass solution. N squared at worst. What you are doing should be a IO bound problem. The beowulfen are use for compute bound tasks like weather, key breaking, simulations etc... were the data set can be broken down and acted on independently. Also do not underestimate the issues the programmers will have writing code for that system, it is a different mindset. Giving them a speedy box with fast IO and lots of memory and that more likely will permit them to get the job done. But on the other hand I am guessing/assuming about the problem. MJM - Original Message - From: Joey Kelly [EMAIL PROTECTED] To: [EMAIL PROTECTED] Cc: Gary Huntress [EMAIL PROTECTED] Sent: Tuesday, July 17, 2001 9:13 PM Subject: Re: beowulfen and mysql Gary, Thanks for your response. Basically, what we are doing is buidling a huge database that will hold a lot of different info on each of our customers. I can't tell you what we do for a living, but basically we want to find out (for instance) how many of our customers used our product (the green one, not the blue or red one) last month, and travelled to Tennesee while using it. We might be able to sell this info to our vendors so they can make a better product next year. We have well over 100,000 customers. We will probably need to run other types of queries against the data next month, and I have 2 programmers to write the queries. What kind of algorithms my coders will construct is up to them (I'm just the admin). I do know that beowulfen are great number crunchers, and that a huge number of selects might not run faster on a cluster than one one huge machine because of the I/O bottlenecks between machines. We are planning on doing what we can to compensate for this. That said, what kid of experiences have you and others had with mysql and clusters? --Joey From: Gary Huntress [EMAIL PROTECTED] To: Joey Kelly [EMAIL PROTECTED], [EMAIL PROTECTED] Subject:Re: beowulfen and mysql Date sent: Sun, 15 Jul 2001 21:19:02 -0400 First, lets make sure we're all talking about the same thing. A general definition of data mining would be the automated extraction of predictive information from large databases. Automated implies some sort of agent, and by its very nature the predictions are statistical (hence the large data sets). Most agents that I have seen could be classified as decision tree, neural network, or genetic algorithm. Note that data mining is not considered to be data warehousing, ad hoc querying, OLTP or visualization. Are you trying to build some sort of predictive model? Perhaps you can describe it a bit further. In general, once you pick an algorithm or approach you would have to build an application layer above your query layer. I imagine you would do that in C, for speed. You probably want to read about MySQL replication here http://www.mysql.com/documentation/mysql/bychapter/manual_Replication.ht ml#R eplication Now, regarding Beowulf clusters. They are defined as (by the people that created it, Donald Becker and company) solely a computational cluster and not something geared toward data mining. You certainly can learn some great lessons from their architecture (channel bonded ethernet or myrinet) but don't expect them to answer any questions in the database arena! Regards, Gary SuperID Huntress === FreeSQL.org offering free database hosting to developers Visit http://www.freesql.org - Original Message - From: Joey Kelly [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Sunday, July 15, 2001 8:26 PM Subject: beowulfen and mysql Howdy. My company needs to implement a data mining setup. I am building a cluster using dual athlons and perhaps firewire instead of 100baseTX. I need to find out as much as I can from those who have done mysql on beowulfen. Please contact me at [EMAIL PROTECTED] Thanks :) +++ Joey Kelly /Minister of
Re: unix_timestamp doesn't understand year 2038
it not a bug, it is a feature, complain to Tomas Riche, 68 years (2038-1970) is all the seconds that fit in 2^31 or a signed long number, which is how the timestamp was defined a long time ago, it was always figured that some would change the base year sooner or later. Or the programmer view ;-) that I will be retired by then so it will be the next person problem, or better yet The software will last that long ha ha ha :-). I subspect someone with refine it to a 64 bit number one of these days. But this is not a bug. MJM - Original Message - From: Theo Van Dinter [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Tuesday, July 10, 2001 3:59 PM Subject: unix_timestamp doesn't understand year 2038 Description: unix_timestamp doesn't understand year 2038. How-To-Repeat: this works: select unix_timestamp(2037-12-31 23:59:59); this doesn't: select unix_timestamp(2038-01-01 00:00:00); Fix: unknown. everything through Jan 19 03:14:07 2038 GMT should be valid. Submitter-Id: submitter ID Originator: Theo Van Dinter Organization: Kluge.Net - WWW Access and Internet Education Network MySQL support: [none | licence | email support | extended email support ] Synopsis: unix_timestamp not handling year 2038 Severity: non-critical Priority: medium Category: mysql Class: sw-bug Release: mysql-3.23.39 (Official MySQL RPM) Environment: System: Linux eclectic 2.2.19 #1 Mon Apr 9 15:10:02 EDT 2001 i586 unknown Architecture: i586 Some paths: /usr/bin/perl /usr/bin/make /usr/bin/gmake /usr/bin/gcc /usr/bin/cc GCC: Reading specs from /usr/lib/gcc-lib/i386-redhat-linux/egcs-2.91.66/specs gcc version egcs-2.91.66 19990314/Linux (egcs-1.1.2 release) Compilation info: CC='egcs' CFLAGS='-O6 -fno-omit-frame-pointer -mpentium' CXX='egcs' CXXFLAGS='-O6 -fno-omit-frame-pointer -felide-constructors -fno-ex ceptions -fno-rtti -mpentium' LDFLAGS='' LIBC: lrwxrwxrwx 1 root root 13 Oct 6 2000 /lib/libc.so.6 - libc-2.1.3.so -rwxr-xr-x 1 root root 4101836 Jan 15 10:49 /lib/libc-2.1.3.so -rw-r--r-- 1 root root 20273324 Jan 15 10:49 /usr/lib/libc.a -rw-r--r-- 1 root root 178 Jan 15 10:49 /usr/lib/libc.so lrwxrwxrwx 1 root root 10 Nov 17 2000 /usr/lib/libc-client.a - c-client.a Configure command: ./configure --disable-shared --with-mysqld-ldflags=-all-static --with-clien t-ldflags=-all-static --without-berkeley-db --without-innodb --enable-assemb ler --with-mysqld-user=mysql --with-unix-socket-path=/var/lib/mysql/mysql.so ck --prefix=/ --with-extra-charsets=complex --exec-prefix=/usr --libexecdir= /usr/sbin --sysconfdir=/etc --datadir=/usr/share --localstatedir=/var/lib/my sql --infodir=/usr/info --includedir=/usr/include --mandir=/usr/man '--with-comment=Official MySQL RPM' Perl: This is perl, version 5.005_03 built for i386-linux - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail [EMAIL PROTECTED] To unsubscribe, e-mail [EMAIL PROTECTED] Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
