Hadoop / Hive Error when trying to load data to table that had Lzo compression in it.

Hi All, SET hive.exec.compress.output=true; SET io.seqfile.compression.type=BLOCK; SET mapred.output.compression.codec=com.hadoop.compression.lzo.LzopCodec; set mapred.job.priority=VERY_HIGH; set mapred.job.name=loading data from YYY to XX; insert overwrite table X partition

Re: name node and secondary name node

Hi Aditya, Secondary name node will take a copy of metadata from Primary Namenode at regular intervals. This is the short of the long story. To know more see the picture and description in the link. https://www.inkling.com/read/hadoop-definitive-guide-tom-white-3rd/chapter-10/hdfs Regards,