I'm skeptical that use-treads can every be very effective.
What order are the rows in? They are probably in PRIMARY KEY order, which
means that the INSERTing threads will be fighting over similar spots in the
table.
Is it I/O bound when it is single-threaded? If so, then there can't be any
Yes, the rows are in primary key order, however each row contains
specific integer primary keys; I'm not inserting nulls into a table
where the primary key is auto increment, so I don't see why concurrent
inserts would fight for similar spots (although, I'm admittedly not a
MySQL hotshot, so the
It's been a long time sine I used mysqlimport, but you might want to try:
- using --fields-terminated-by rather than --fields-terminated
- losing (or escaping) the backticks in --columns=
- checking my.cnf to see if the client settings are the same for mysql
and mysqlimport
- checking user
-Original Message-
From: Carsten Pedersen [mailto:cars...@bitbybit.dk]
Sent: Monday, January 03, 2011 1:48 PM
To: Jerry Schwartz
Cc: 'mos'; mysql@lists.mysql.com
Subject: Re: mysqlimport doesn't work for me
It's been a long time sine I used mysqlimport, but you might want to try:
- using
zcat /Backup/Latest/alba2_2009-03-10_00h45m.Tuesday.sql.gz | mysql -h
192.168.0.224 -u root -p alba2
Cheers
Claudio
2009/3/11 Rob Wultsch wult...@gmail.com
On Tue, Mar 10, 2009 at 7:16 PM, René Fournier m...@renefournier.com
wrote:
OK, I've managed to do the same thing with just the
Thanks. That works great.
On 10-Mar-09, at 9:36 PM, Rob Wultsch wrote:
On Tue, Mar 10, 2009 at 7:16 PM, René Fournier m...@renefournier.com
wrote:
OK, I've managed to do the same thing with just the mysql command
line
program:
mysql -h 192.168.0.224 -u root -p alba2
OK, I've managed to do the same thing with just the mysql command line
program:
mysql -h 192.168.0.224 -u root -p alba2 /Backup/Latest/
alba2_2009-03-10_00h45m.Tuesday.sql
Works great. However, the sql file is normally gzipped, so Can I
ungzip the file on the fly (and without
Hi Rene,
Just a head's up. You might want to keep your username/password
credentials private.
On Tue, Mar 10, 2009 at 10:16 PM, René Fournier m...@renefournier.com wrote:
OK, I've managed to do the same thing with just the mysql command line
program:
mysql -h 192.168.0.224 -u root
info if we had
ill intents.
Sent from my Verizon Wireless BlackBerry
-Original Message-
From: Darryle Steplight dstepli...@gmail.com
Date: Tue, 10 Mar 2009 22:20:26
To: René Fournierm...@renefournier.com
Cc: mysqlmysql@lists.mysql.com
Subject: Re: mysqlimport remote host problem
Hi
On Tue, Mar 10, 2009 at 7:16 PM, René Fournier m...@renefournier.com wrote:
OK, I've managed to do the same thing with just the mysql command line
program:
mysql -h 192.168.0.224 -u root -p alba2
/Backup/Latest/alba2_2009-03-10_00h45m.Tuesday.sql
Works great. However, the sql file
Hello Shuly,
Try this.
http://www.mysqlperformanceblog.com/2008/07/03/how-to-load-large-files-safely-into-innodb-with-load-data-infile/
On Tue, Feb 24, 2009 at 1:08 PM, Shuly Avraham sh...@cshl.edu wrote:
Hi,
I have a huge table with about 50 millions of rows.
I dumped the table using
Thanks for the resource!
However, I am loading into a MyISAM table, while logging is disabled.
In a matter of fact, I was able to load the data at the end, after
disabling the keys. But now, as I try to create the keys, it takes a
huge amount of time. there are 250 Million rows in one of
Mysql use tmpdir,
when ever there is any index creation.
regards
anandkl
On 8/21/08, jthorpe [EMAIL PROTECTED] wrote:
Hi,
I've been trying to import a 10G dump file using mysqlimport
and it is eventually failing because it runs out of tmpdir
space -- I get Errcode: 28.
I was surprised
You should increase parameter named max_bulk_insert_buffer_size and
max_allowed_packet.
On 8/21/08, Ananda Kumar [EMAIL PROTECTED] wrote:
Mysql use tmpdir,
when ever there is any index creation.
regards
anandkl
On 8/21/08, jthorpe [EMAIL PROTECTED] wrote:
Hi,
I've been trying to
Hey Scott -
I dont think you can use , with mysqlimport as a field separator if it is
part of the data. use something else - I used the pipe | character...
This is what worked for me:
C:\mysqlimport --fields-enclosed-by= --fields-terminated-by=|
--lines-terminated-by=\r\n --ignore-lines=1
On 2006-10-04 Scott Hamm wrote:
OBJECTIVE:
INPUT:
E524541015.txt:20061004|,535,999|Scot|Hamm|,410|||101 Walter
Rd|Dover|MD|76709|,041|
...
Been trying to get mysqlimport to use these characters to no avail, how do
I get around to it?
I can't answer your question but think that you're
On Sun, 27 Aug 2006, Jim Seymour wrote:
Hi,
I download a csv file from Yahoo in this format:
ABIAX
20.63
2006-08-3
ACEIX
8.78
2006-08-3
CIGAX
10.08
2006-08-3
FSCTX
On Mon, 2006-08-28 at 13:47 +0200, Thomas Spahni wrote:
On Sun, 27 Aug 2006, Jim Seymour wrote:
Hi,
I download a csv file from Yahoo in this format:
ABIAX
20.63
2006-08-3
ACEIX
8.78
2006-08-3
CIGAX
A batch script or shell script can easily be written to do this.
-Sheeri
On 2/20/06, Daniel Kasak [EMAIL PROTECTED] wrote:
I've got some import scripts that are giving me trouble.
Some MOFOs keep changing the format of the data they give us, and
sometimes I loose half the records. When this
On 2/22/06, sheeri kritzer [EMAIL PROTECTED] wrote:
A batch script or shell script can easily be written to do this.
-Sheeri
On 2/20/06, Daniel Kasak [EMAIL PROTECTED] wrote:
I've got some import scripts that are giving me trouble.
Some MOFOs keep changing the format of the data they
Daniel,
What about just running your import file through dos2unix before piping
it to mysql?
That way, it would leave \n alone (since that is unix format) and
replace any occurrances of
\r\n with plan old \n.
--
George
-Original Message-
From: Daniel Kasak [mailto:[EMAIL
George Law wrote:
Daniel,
What about just running your import file through dos2unix before piping
it to mysql?
That way, it would leave \n alone (since that is unix format) and
replace any occurrances of
\r\n with plan old \n.
I could think of a lot of things I could do if this were all
A little less dodgy is to write a VBA routine within Access to do the
filtering. Alternatively, if you don't want to trust access to do it, you
can write a VBScript or JScript routine and run it through the shell (yes,
Windoze has shell scripts, too)
There are all kinds of things you can do.
Hello.
See:
http://dev.mysql.com/doc/refman/5.0/en/the-dbug-package.html
P. Evans wrote:
Hello Listers,
Can anyone explain what are valid values for the 'debug options' on a
mysqlimport ? The manuals just say :
--debug[=debug_options], -# [debug_options]
Write a
is pretty much inaccessible until mysqlimport completes.
-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED]
Sent: Monday, March 28, 2005 12:30 AM
To: [EMAIL PROTECTED]
Subject: Re: mysqlimport blocks all access to database
Hi Joseph,
I have been trying to use mysqlimport
Hi Joseph,
I have been trying to use mysqlimport to load a primarily read only
database with data at regular intervals. My problem occurs when my
tables are myisam. In this case all access to the database and the
tables blocks until mysqlimport completes. The -lock-tables=false
parameter does
Please do not consider the previous email. I found my error.
mysqlimport is behaving exactly as expected.
Regards, Clodoaldo Pinto
On Sat, 29 Jan 2005 15:53:48 -0200, Clodoaldo Pinto
[EMAIL PROTECTED] wrote:
I need to update a table with mysqlimport.
I would like to update the table lines
Can you run a find and replace to double up the backslashes?
\ -- \\
-Original Message-
From: Hans van Dalen
To: [EMAIL PROTECTED]
Sent: 4/28/04 3:46 AM
Subject: mysqlimport and \ as data
Hi Group,
Does anybody have any expierence with mysqlimport and a comma separated
file with data
Ron McKeever [EMAIL PROTECTED] wrote:
I'm trying to use mysqimport instead of LOAD DATA INFILE from a shell
script. I notice an option for mysqlimport is not working or im doing it
wrong.
This works with LOAD DATA INFILE :
mysql -e LOAD DATA INFILE 'x' INTO TABLE x IGNORE 2 LINES
but
May Yang [EMAIL PROTECTED] wrote:
Dear everyone,
I'd like to ask you a question, thanks in advance.
Q: How long will it take to import 100GB data into MySQL DB by command mysqlimport
?
Depends on how many records are to be inserted. Hard to tell not knowing your hardware
and record
Cersosimo, Steve [EMAIL PROTECTED] wrote:
Am I wrong to assume mysqlimport is supposed to emulate the LOAD DATA INFILE
syntax? I cannot find the command line option to turn on the CONCURRENT
flag.
CONCURRENT currently is not supported by mysqlimport.
--
For technical support contracts,
Check file permissions.
The file must be readable by the user 'mysql'.
Will Tyburczy wrote:
I've unable to load data from files into existing tables. When I give the command: mysqlimport [database] [filename] I keep getting the following error.
mysqlimport: Error: Can't get stat of '[filename]'
Will Tyburczy [EMAIL PROTECTED] wrote:
I've unable to load data from files into existing tables. When I give the command:
mysqlimport [database] [filename] I keep getting the following error.
mysqlimport: Error: Can't get stat of '[filename]' (Errcode: 13), when using table:
[table]
I
Thanks Paul, the options file worked fine!
Neil Belch
- Original Message -
From: Paul DuBois [EMAIL PROTECTED]
To: Neil Belch [EMAIL PROTECTED]; mySQL List
[EMAIL PROTECTED]
Sent: Thursday, September 04, 2003 2:48 AM
Subject: Re: mysqlimport problems
At 0:34 +0100 9/4/03, Neil Belch
, 2003 5:10 PM
To: 'Fortuno, Adam'; [EMAIL PROTECTED]
Subject: RE: mysqlimport command question
To: '[EMAIL PROTECTED]'; [EMAIL PROTECTED]
Subject: RE: mysqlimport command question
Darryl,
Provide a copy of the table's details either with a describe
table output or
the table's definition
At 0:34 +0100 9/4/03, Neil Belch wrote:
Hi all, new to the list and new to mySQL...
I've only been at it for a few days and am looking at importing text
files to databases.
I'm having trouble with mysqlimport and would appreciate any help or
solutions as to what I'm doing wrong - I'm sure its a
Darryl,
Provide a copy of the table's details either with a describe table output or
the table's definition and a sample of the input file's top 5-rows.
Regards,
Adam
-Original Message-
From: Darryl Hoar [mailto:[EMAIL PROTECTED]
Sent: Tuesday, September 02, 2003 4:31 PM
To: [EMAIL
To: '[EMAIL PROTECTED]'; [EMAIL PROTECTED]
Subject: RE: mysqlimport command question
Darryl,
Provide a copy of the table's details either with a describe
table output or
the table's definition and a sample of the input file's top 5-rows.
Regards,
Adam
OK, here is the table structure:
mysql
Please ignore this this problem as I found the answer. For those inquring minds,
I added a -L to the mysqlimport command and we are all happy now.
James
-Original Message-
From: James E Hicks III [mailto:[EMAIL PROTECTED]
Sent: Monday, March 24, 2003 2:48 PM
To: Mysql
Subject:
On 24-Mar-2003 James E Hicks III wrote:
snipage
mysqlimport: Error: Can't get stat of '/fullpathto/thefile.SQL' (Errcode:
13), when using table: thefile
localhost.dread$ perror 13
Error code 13: Permission denied
localhost.dread$
--
Don Read
You're having a permissions problem.
From the Load data infile section of the manual:
For security reasons, when reading text files located on the server, the
files must either reside in the database directory or be readable by all.
Also, to use LOAD DATA INFILE on server files, you must have the
Probably a permission problem. If it cannot read the file it cannot import
it.
monster perror 13
Error code 13: Permission denied
-Original Message-
From: James E Hicks III [mailto:[EMAIL PROTECTED]
Sent: Monday, March 24, 2003 11:48 AM
To: Mysql
Subject: mysqlimport: Error: Can't get
it is NO permission Problem, the file ist world readable and
the user CAN access the DB.
stupid me, it WAS a permission problem. The permission for a directory in the path
wasn't right.
sql, mysql or what else the spam filter needs.
On Tuesday 18 February 2003 12:08, Stefan Immel wrote:
we get a strange error when trying to import data into our database:
mysqlimport: Error: Can't get stat of 'KUNDEN' (Errcode: 13), when using
table: KUNDEN
it is NO permission Problem, the file ist world readable and the user CAN
access
Hi,
You should not use mysqlimport but mysql:
mysql my_db file.sql
See http://www.mysql.com/doc/en/mysqldump.html
for details.
Regards,
Joseph Bueno
Elby Vaz wrote:
I created a file.sql with mysqldump.
mysqldump my_db my_table file.sql
What I do to get this file with the mysqlimport?
Elby,
I created a file.sql with mysqldump.
mysqldump my_db my_table file.sql
What I do to get this file with the mysqlimport?
mysqlimport ??
You do this with mysql in batch mode, not with mysqldump:
shell mysql your_database file.sql
Regards,
--
You don't.
you use the file as input to the mysql client.
mysql file.sql
Elby Vaz wrote:
I created a file.sql with mysqldump.
mysqldump my_db my_table file.sql
What I do to get this file with the mysqlimport?
mysqlimport ??
Thanks,
e.
At 13:04 + 12/20/02, Imran Khan wrote:
Hi,
I'm working on SOlaris 8 with MySQL v3.23.54.
I'm trying to give a user 'user1' access to one of my databases
'db1', and specifically one table 'table1'.
As root I've run:
msql grant all on db1 to user1@localhost
-and it appears to work fine.
vinita,
Monday, September 23, 2002, 9:12:24 AM, you wrote:
vvM I can create a database called test,
vvM mysql create database test;
vvM Query OK, 1 row affected (0.03 sec)
vvM BUT I can't create any other databases???
vvM mysql create database tem;
vvM ERROR 1044: Access denied for user:
HI Egor
OK, I want to create new databases, to do that I need database
create privilege.
Grant CREATE ON ##
to ddb@localhost IDENTIFIED BY 'passwd'
What should go into #, is it a *? but I should NOT given permission
to access other databases.
Thanks
Egor Egorov wrote:
vinita,
At 9:05 +1000 9/24/02, vinita vigine Murugiah wrote:
HI Egor
OK, I want to create new databases, to do that I need database
create privilege.
Grant CREATE ON ##
to ddb@localhost IDENTIFIED BY 'passwd'
What should go into #, is it a *? but I should NOT given
permission to access
Hi paul
Paul DuBois wrote:
At 9:05 +1000 9/24/02, vinita vigine Murugiah wrote:
HI Egor
OK, I want to create new databases, to do that I need database
create privilege.
Grant CREATE ON ##
to ddb@localhost IDENTIFIED BY 'passwd'
What should go into #, is it a *? but I
At 9:41 +1000 9/24/02, vinita vigine Murugiah wrote:
Hi paul
Paul DuBois wrote:
At 9:05 +1000 9/24/02, vinita vigine Murugiah wrote:
HI Egor
OK, I want to create new databases, to do that I need database
create privilege.
Grant CREATE ON ##
to ddb@localhost IDENTIFIED BY 'passwd'
Paul DuBois wrote:
At 9:41 +1000 9/24/02, vinita vigine Murugiah wrote:
Hi paul
Paul DuBois wrote:
At 9:05 +1000 9/24/02, vinita vigine Murugiah wrote:
HI Egor
OK, I want to create new databases, to do that I need database
create privilege.
Grant CREATE ON ##
to
sql,query
At 11:49 +1000 9/24/02, vinita vigine Murugiah wrote:
Paul DuBois wrote:
At 9:41 +1000 9/24/02, vinita vigine Murugiah wrote:
Hi paul
Paul DuBois wrote:
At 9:05 +1000 9/24/02, vinita vigine Murugiah wrote:
HI Egor
OK, I want to create new databases, to do that I need
sql,query
HI sorry for the confusion.
well.. I want to create a database where I can give *any* name
(ofcourse, the database doesn't exist).
Are you trying to say, I need to ask the root, to give me create
privilege on database xxx, even before it exist, then only I can
create the database
James,
Tuesday, July 23, 2002, 8:32:10 PM, you wrote:
JC There didn't seem to be any responses to this question last time I posted.
JC So I'll try again. Does anyone know where to locate mysqlimport logs, if
JC there are any?
No, mysqlimport doesn't write logs and you can't see warnings.
There didn't seem to be any responses to this question last time I posted.
So I'll try again. Does anyone know where to locate mysqlimport logs, if
there are any?
TIA
James
-Original Message-
From: James Ching [mailto:[EMAIL PROTECTED]]
Sent: Thursday, July 18, 2002 4:54 PM
To:
Jonas,
Friday, May 17, 2002, 4:54:18 PM, you wrote:
JO Receive the message:
JO mysqlimport: Error: The used command is not
JO allowed with this MySQL version, when using table: t_parameter.
Did you tried to use mysqlimport with --local option?
If so, you should specify local-infile for
Scott,
Tuesday, April 9, 2002, 6:20:38 PM, you wrote:
SA I been using mysqlimport for a long time with no problems.
SA But today when I try (as root)
SA mysqlimport admin /usr/local/systems/admin/data/person.txt -p
SA I get
SA mysqlimport: Error: Can't get stat of
SA
At 22:04 -0700 3/25/02, Keith Spiller wrote:
Hello,
mysqlimport --replace --fields-terminated-by=\| --verbose
--user=user --password=mysql database tables.sql
I'm trying to use the mysqlimport command. I have multiple tables
listed in my table.sql file. But the command requires that the
That means the server does not have permission to read the file.
James E. Hicks III wrote:
What exactly does this error mean?
mysqlimport: Error: Can't get stat of '/home/jameshicks/NONSTOCK' (Errcode: 13),
when using table: NONSTOCK
James
mysql
If you can ssh to the host you should be able to
use scp to copy the file over.
Lucy wrote:
Hi
I'd successfully loaded a text file to a previously created table on my
localhost/server. It all works fine.
I'm having trouble doing the same to a remote host. I've checked the manual
for
Hi Gerald
Thanks a lot for the suggestion, but I'm not sure it will solve my prob,
'cos I dont want to copy a whole DB, and it's not on the same server anyway.
I think it's my --local syntax in the mysqlimport (given in earlier message
posted) that's dodgy. I've also tried an equals sign,
sounds strange, but if you do it this way, you should have no problems:
mysqldump test_database test_database.dump
mysql test_database test_database.dump
will import everything in test_database.dump into your database..
somehow, you had selected your database, but that got dropped ?
Atle
I suppose that only way to reorganize unique field is to use another table.
- Original Message -
From: Irmund Thum [EMAIL PROTECTED]
To: Rus [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED]
Sent: Tuesday, February 13, 2001 8:53 AM
Subject: Re: mysqlimport - LOAD DATA LOCAL INFILE
Rus schrieb
Rus schrieb:
Maybe it's problem with end_of_line symbol.
You could use PHP to insert records directly into db.
- Original Message -
From: Irmund Thum [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED]
Sent: Monday, February 12, 2001 2:30 PM
Subject: mysqlimport - LOAD DATA LOCAL INFILE
67 matches
Mail list logo
