Re: Hive + Flume

2014-02-28 Thread Stephen Sprague
if you can configure flume to create temporary files that start with an underscore (_) i believe hive will safely ignore them. otherwise you have write a script to move them out. On Fri, Feb 28, 2014 at 11:09 AM, P lva wrote: > Hi, > > I'm have a flume stream that stores data in a directory whi

Hive + Flume

2014-02-28 Thread P lva
Hi, I'm have a flume stream that stores data in a directory which is source for an external table in hive. However flume creates tmp file that cannot be read by hive and query breaks. Is there any way to avoid hive reading this tmp file ? Thanks