thanks for reply Im assuming I can't use avro without reprocess all my stored data(delimited,lzo-compressed text), Am I right ? So I'm wonder if I can use statement *ALTER TABLE xxx PARTITION (xxxx**) CHANGE COLUMN (...)* to create diffrent HCatalog schema for parttions based on datafiles with changed schema https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-ChangeColumnName/Type/Position/Comment
2015-08-31 23:19 GMT+02:00 Edward Capriolo <[email protected]>: > Yes. Specifically the avro ser-de like avro support "evolving schema". > > On Mon, Aug 31, 2015 at 5:15 PM, Dominik Choma <[email protected]> > wrote: > >> I have external hcat structures over lzo-compressed datafiles , data is >> partitioned by date string >> Is it possible to handle schema changes by setting diffrent schema(column >> names & datatypes) per-partition? >> >> Thanks, >> Dominik. >> >> >
