Help with WebHDFS authentication: simple vs simple-dt

2016-09-27 Thread Benjamin Ross
All, I'm in the process of setting up encryption at rest on a cluster, but I want to make sure that everything else remains permissive - otherwise it will break existing processes that we have in place. I'm very close to getting this working - the last piece is that webhdfs is not permissive:

read multiple files

2016-09-27 Thread Divya Gehlot
Hi, The input data files for my spark job generated at every five minutes file name follows epoch time convention as below : InputFolder/batch-147495960 InputFolder/batch-147495990 InputFolder/batch-147496020 InputFolder/batch-147496050 InputFolder/batch-147496080 InputFolder/