WANTED: lots of data
I'm working on some software that will generate all sorts of statistics on large volumes of data. I'm looking for data to experiment on. I'd like 100 million - 1 billion records. These records can be anything from log files to database records, or whatever. I just need tons of data. If you have lots of data and have been interested in getting it summarized, rolled-up, aggregated so that you can have nice summary reports on it then let me know. BTW, I'm not trying to sell anything. This software is just an idea and I'm looking for lots of real world data to test with. Mark -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
concurrent_insert with 4.0.x
Hello, Does anyone know how to enable concurrent_insert with mysql version 4.0.x. I can't seem to turn it on no matter what I do. Mark - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail <[EMAIL PROTECTED]> To unsubscribe, e-mail <[EMAIL PROTECTED]> Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Load Data Command
If the table has a unique key then add the REPLACE keyword. This will update the columns with new values if the key already exists and add the row if it doesnt. --Mark Michael Kaiser wrote: > Using the following inserts data from a text file into a particular MySQL > table: > > LOAD DATA LOCAL INFILE "file.txt" INTO TABLE whatever; > > Is there any way to do this, but instead of inserting, it's updating? > > Michael Kaiser > LivingLegend.net > [EMAIL PROTECTED] > > "Many folk like to know beforehand what is to be set on the table; > but those who have laboured to prepare the feast like to keep their secrets; > for wonder makes the words of praise louder." > > > - > Before posting, please check: >http://www.mysql.com/manual.php (the manual) >http://lists.mysql.com/ (the list archive) > > To request this thread, e-mail <[EMAIL PROTECTED]> > To unsubscribe, e-mail <[EMAIL PROTECTED]> > Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php > > - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail <[EMAIL PROTECTED]> To unsubscribe, e-mail <[EMAIL PROTECTED]> Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
Re: Inserting files from command prompt
I do this from the command line sometimes: mysql -h HOST -pPASSWORD DATABASE < statements.sql The statements.sql file should contain full sql statements. This will read in the file and execute the sql 1 line at a time. The opposite would be to use mysqldump like so: mysqldump -h HOST -pPASSWORD DATABASE TABLE > statements.sql This would dump the contents of the given table in the given database into the statements.sql file. This create full insert statements with schema. You can pass it many options; see the web page docs for more. --Mark Paul DuBois wrote: > At 10:48 -0500 3/20/02, Stembridge, Michael wrote: > >> Can a file be inserted to a mysql table from a unix(linux) command >> prompt? > > > mysqlimport? > >> Also, can I query the same table and output the data to a filename.ext >> in a >> specified directory? > > > SELECT ... INTO OUTFILE > >> Not sure if this is an appropriate question for the list, but all >> clues/examples would be greatly appreciated. > > > > - > Before posting, please check: > http://www.mysql.com/manual.php (the manual) > http://lists.mysql.com/ (the list archive) > > To request this thread, e-mail <[EMAIL PROTECTED]> > To unsubscribe, e-mail > <[EMAIL PROTECTED]> > Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php > > - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail <[EMAIL PROTECTED]> To unsubscribe, e-mail <[EMAIL PROTECTED]> Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
kudos to the mysql team
I just wanted to say that MySQL absolutely rocks! We are using Mysql with a very large database and it's working beautfully. Needless to say we will be buying licenses to further support mysql. Here are some rough stats on what we were doing: Inserts: 13,000,000 per day Updates: 12,000,000 per day Queries: 12,000,000 per day This process has been running for almost a year with no problems. This puts the total number of inserts, updates and queries at about 5 billion EACH for the year. Thats 5 billion inserts and the system is idle about 50% of the time, so there's plenty of room for growth. We use Myisam tables to store the raw and summary data, Innodb tables to keep track of the batch transactions, Merge tables to query large numbers of rows accross many tables, and Heap tables to quickly reduce raw data into summary data. Again, cheers to the mysql development team for a job well done. --Mark - Before posting, please check: http://www.mysql.com/manual.php (the manual) http://lists.mysql.com/ (the list archive) To request this thread, e-mail <[EMAIL PROTECTED]> To unsubscribe, e-mail <[EMAIL PROTECTED]> Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
