Does it work to provide a wild card in your source spec? a la dfs.tdunning.`/user/tdunning/foo/data/*.parquet`
? On Wed, Jun 29, 2016 at 1:06 PM, John Omernik <[email protected]> wrote: > When the Hadoop FS client copies files (say parquet files) It adds a > ._COPYING_ at the end of the file until it's complete. If that's there > Drill fails (partial files etc). > > I know I can ignore files that start with . (or directories) but is there a > good way to tell Drill to ignore files that are not *.parquet, or that have > ._COPYING_ at the end of them? > > Thanks! > > John >
