This has come up before (see DRILL-2799), and there were conversations on whether to provide a list of such files to ignore. I'm not sure if there was any conclusion.
On Wed, Jun 29, 2016 at 1:06 PM, John Omernik <[email protected]> wrote: > When the Hadoop FS client copies files (say parquet files) It adds a > ._COPYING_ at the end of the file until it's complete. If that's there > Drill fails (partial files etc). > > I know I can ignore files that start with . (or directories) but is there a > good way to tell Drill to ignore files that are not *.parquet, or that have > ._COPYING_ at the end of them? > > Thanks! > > John >
