Hi,
I need some help please! I have 60GB of proxy logs to parse and load into a mysql database. I've written a parsing script but I'm stuck now on how to load the data in.
I have a database called PROXY_LOG with 2 tables:
USER_TABLE user_id date_time url_id size
and
URL_TABLE url_id url category
The data values I have for each record are:
user_id date_time size url category
for example:
u752359 2004-04-02 12:33:04 3403 http://www.mysql.com/index.html business
The problem is I'm not sure how to load the data into the 2 tables and set the url_id. Could anyone point me in the right direction please?
Many thanks,
js.
js,
Is this a one time operation? If so, you could create a temporary table with all the fields:
BIG_TABLE user_id date_time url_id size url category
and use Load Data InFile to load the data into this one table. Then create the two smaller tables using:
create table USER_TABLE select user_id, date_time, url_id, size from BIG_TABLE;
create table URL_TABLE select url_id, url, category from BIG_TABLE;
drop table BIG_TABLE;
So there you have it in 3 lines of code. :-)
Mike
P.S. If you could break the text file into two files to begin with, then two Load Data InFile statements would handle things nicely.
Thanks Mos, that sounds ideal but the url_id value has to come from the database.
js.
_________________________________________________________________
Want to block unwanted pop-ups? Download the free MSN Toolbar now! http://toolbar.msn.co.uk/
-- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED]
