Both load data infile and mysqlimport both support the ignore option.
If you are loading a file into a table with a unique index and
duplicate rows in the file any duplicates will be silently ignored.
On 4/19/05, newbie c <[EMAIL PROTECTED]> wrote:
> thanks for the reply! I am not too concerned about cutting out the columns
> as I may need to other information for later.
> I was just wondering does it make a difference if both of the columns that
> I am interested have entries that are NOT unique?
> Also, at what point does one need a parser or use of a hash?
> thanks!
>
> Eric Bergen <[EMAIL PROTECTED]> wrote:
> awk is probably the best tool I can think of for cutting columns out
> of a text file. Something like
> awk -F \\t '{ print $2 "," $3 }' my_file
> could be used to pick the second and third column out of a file prior
> to importing it.
>
> -Eric
>
> On 4/18/05, newbie c wrote:
> > Hi,
> >
> > I am about to create a database and there are a number of files that I
> need
> > to load into the database. They are tab delimited files. One of the files
> contains about 4 or 5 columns. I am only interested in the second and the
> third column right now but I will load the whole table. The values in the
> second column can occur more than once in the file.
> > As well the values in the third column can occur more than once in the
> file.
> >
> > Another file that I want to load as a table into the databse only contains
> two
> > column and one column will be unique while the second column will have
> > duplicate values in the file.
> >
> > My question is when should I use mysqlimport, or load data and when should
> I write my own Perl parser to help load the table?
> > What criteria would be needed to decide to read a file into a hash?
> >
> > Also, if I decide to use mysqlimport is there anything I should watch out
> for?
> >
> > thanks!
> >
> >
> > ---------------------------------
> > Post your free ad now! Yahoo! Canada Personals
> >
> >
>
>
> --
> Eric Bergen
> [EMAIL PROTECTED]
> http://www.ebergen.net
>
>
>
> ________________________________
> Post your free ad now! Yahoo! Canada Personals
>
>
>
--
Eric Bergen
[EMAIL PROTECTED]
http://www.ebergen.net
--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED]