advancedxy commented on issue #391: URL: https://github.com/apache/incubator-uniffle/issues/391#issuecomment-1341094666
> In fact, Can an abstract storage layer be provided in uniffle, and each manufacturer implements the necessary storage interface? It may require a detailed design doc to illustrate your idea and proposal. In fact, I believe uniffle(and other RSS systems also) makes a big assumption of filesystem capability, such as append support, if we want to support new storages and dropping append requirement, we should reconsider the data layout patterns and all the features it required such as read operation, data distribution, etc. cc @zuston and @LuciferYang. P.S: I think it's nice to have object store as a new storage type supported, we just need to think it throughly, make sure it doesn't introduce too much complexity, and maintain the flexibility to extend more storages. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
