vinothchandar edited a comment on pull request #2410: URL: https://github.com/apache/hudi/pull/2410#issuecomment-755529282
This points to a deeper discussion. Right now, hudi-common is depended upon by `hudi-hadoop-mr` which has all the Hive/InputFormat code. Should that also be redone as a client-module, if saw we want to support Hive writing ultimately? That is a large change though. So, we can do either of the two options here for now. A) move `HoodieEngineContext` to hudi-common; add a `HoodieMREngineContext` (very similar to `HoodieJavaEngineContext`) B) Move FSUtils#getAllPartitionPaths to hudi-client-common and have another parallelized impl. I still prefer A. But want to hear what you both think as well. Let's make a quick call, since we want this in soon :) ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
