[GitHub] [hudi] zuyanton edited a comment on issue #1847: [SUPPORT] querying MoR tables on S3 becomes slow with number of files growing

2020-07-26 Thread GitBox


zuyanton edited a comment on issue #1847:
URL: https://github.com/apache/hudi/issues/1847#issuecomment-664064544


   @umehrot2 @bschell Looks like CSE is disabled on the cluster, however I can 
see that we still specify CSE key id in cluster config. is 
```fs.s3.cse.enabled``` is the only flag that triggers EMR to override 
```getLen```?
   
![cluster_capture](https://user-images.githubusercontent.com/67354813/88493752-b72d4580-cf67-11ea-8371-f8e36897ebbd.PNG)
   
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] zuyanton edited a comment on issue #1847: [SUPPORT] querying MoR tables on S3 becomes slow with number of files growing

2020-07-20 Thread GitBox


zuyanton edited a comment on issue #1847:
URL: https://github.com/apache/hudi/issues/1847#issuecomment-661287128


   @bvaradar , logging  ```fileStatus.getClass().getName()``` from within 
```HoodieBaseFile``` constructor, gives me 
```com.amazon.ws.emr.hadoop.fs.s3n.S3NativeFileSystem$3```



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org