Re: hive transaction strange behaviour

2015-11-14 Thread Eugene Koifman
When Compaction process runs, it will create base directory. https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Configuration at a minimum you need hive.compactor.initiator.on

writing in parquet hive table using custom MR

2015-11-14 Thread Shushant Arora
Hi I have a requirement to dump parquet files in hive table using custom MR. Parquet has so many data models- avro-parquet,proto-parquet,hive-parquet ? Which one is recommended over other for inmemory plain java objects. Hive internally uses MapredParquetOutputformat . Is it better than AvroParq

RE: Best practices for monitoring hive

2015-11-14 Thread Mich Talebzadeh
Hi. Hive is a multi-fact application require a number of monitoring tools to ensure that it is performing as it should. You need to ensure among other things: 1. Hive server is up and running through os level check via cron say every minute 24x7. --. netstat -plten|grep port 2