Would Drill know to partition prune based on directories if it didn't have the hive metastore to define the partitions at the directory level?
On Wed, Aug 5, 2015 at 11:01 AM, Neeraja Rentachintala < nrentachint...@maprtech.com> wrote: > John > Both would work i.e query partitioned directories directly using file > system storage plug in or via Hive table. > > On Wed, Aug 5, 2015 at 8:58 AM, John Omernik <j...@omernik.com> wrote: > > > After reading about Parquet Partition Pruning in Drill 1.1, I was > wondering > > if there is still partitioning based on "hive like" partitions. I.e. I > have > > a process that is making a hive table with Parquet files. It's using > > Partitions (Directories). Do I need Drill to read that data using the > Hive > > Plugin so it's aware of the partitions and can prune, or can I just use > the > > DFS plugin, point it at the root of the table in Hive, and let it go, > > inferring Schema and partitions based on the directories that exist? > > > > John > > >
