Re: How to skip the malformatted records while loading data

2011-08-24 Thread XieXianshan
Thanks for your reply,Ashutosh. I found that the Syntax of Load Data in MySql supports serveral options to ignore rows, such as TERMINATED BY, LINES STARTING BY and so on. But unfortunately,it seems to be unsupported by hive so far. 于 2011年08月25日 06:09, Ashutosh Chauhan 写道: > One possibility is

Re: How to skip the malformatted records while loading data

2011-08-24 Thread Ashutosh Chauhan
One possibility is to filter out NULLs, something like following: hive> select * from tb where id != NULL or pref != NULL or zip != NULL; This is not most efficient, but will work. 2011/8/18 XieXianshan > Hi,everyone, > > Is there an option to ignore malformatted records while loading data > i

How to skip the malformatted records while loading data

2011-08-18 Thread XieXianshan
Hi,everyone, Is there an option to ignore malformatted records while loading data into hive table? Or an option to ignore bad rows while querying data? For instance: 1. Specify a row format explicitly for a new table. hive>create table tb (id int, pref string, zip string) row format delimited fie

How to skip the malformatted records while loading data

2011-08-18 Thread XieXianshan
Hi,everyone, Is there an option to ignore malformatted records while loading data into hive table? Or an option to ignore bad rows while querying data? For instance: 1. Specify a row format explicitly for a new table. hive>create table tb (id int, pref string, zip string) row format delimited fie