Re: Completing a bulk load from HFiles stored in S3

2019-10-31 Thread Josh Elser
Short answer: no, it will not work and you need to copy it to HDFS first. IIRC, the bulk load code is ultimately calling a filesystem rename from the path you provided to the proper location in the hbase.rootdir's filesystem. I don't believe that an `fs.rename` is going to work across filesyst

Re: Completing a bulk load from HFiles stored in S3

2019-10-31 Thread Wellington Chevreuil
I believe you can specify your s3 path for the hfiles directly, as hdfs FileSystem does support s3a scheme, but you would need to add your s3 access and secret key to your completebulkload configuration. Em qua, 30 de out de 2019 às 19:43, Gautham Acharya < gauth...@alleninstitute.org> escreveu: