Both load data infile and mysqlimport both support the ignore option.
If you are loading a file into a table with a unique index and
duplicate rows in the file any duplicates will be silently ignored.

On 4/19/05, newbie c <[EMAIL PROTECTED]> wrote:
> thanks for the reply!  I am not too concerned about cutting out the columns 
> as I may need to other information for later. 
> I was just wondering does it make a difference if both of the columns that 
> I am interested have entries that are NOT unique? 
> Also,  at what point does one need a parser or use of a hash? 
> thanks!
> 
> Eric Bergen <[EMAIL PROTECTED]> wrote: 
> awk is probably the best tool I can think of for cutting columns out
> of a text file. Something like
> awk -F \\t '{ print $2 "," $3 }' my_file
> could be used to pick the second and third column out of a file prior
> to importing it.
> 
> -Eric
> 
> On 4/18/05, newbie c wrote:
> > Hi,
> > 
> > I am about to create a database and there are a number of files that I
> need
> > to load into the database. They are tab delimited files. One of the files
> contains about 4 or 5 columns. I am only interested in the second and the
> third column right now but I will load the whole table. The values in the
> second column can occur more than once in the file.
> > As well the values in the third column can occur more than once in the
> file.
> > 
> > Another file that I want to load as a table into the databse only contains
> two
> > column and one column will be unique while the second column will have
> > duplicate values in the file.
> > 
> > My question is when should I use mysqlimport, or load data and when should
> I write my own Perl parser to help load the table?
> > What criteria would be needed to decide to read a file into a hash?
> > 
> > Also, if I decide to use mysqlimport is there anything I should watch out
> for?
> > 
> > thanks!
> > 
> > 
> > ---------------------------------
> > Post your free ad now! Yahoo! Canada Personals
> > 
> > 
> 
> 
> -- 
> Eric Bergen
> [EMAIL PROTECTED]
> http://www.ebergen.net
> 
> 
> 
> ________________________________
> Post your free ad now! Yahoo! Canada Personals
>  
> 
> 


-- 
Eric Bergen
[EMAIL PROTECTED]
http://www.ebergen.net

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:    http://lists.mysql.com/[EMAIL PROTECTED]

Reply via email to