Re: [DISCUSS] Refactor hudi-client module for better support of multiple engines

2021-09-17 Thread Vinoth Chandar
Hi Gary, Thanks for the detailed response. Let me add my take on it. >>HoodieFlinkMergeOnReadTable.upsert(List) to use the AppendHandle.write(HoodieRecord) directly, I have the same issue on JavaClient, for the Kafka Connect implementation. I have an idea of how we can implement this. Will raise

Difference/compatibility between original Parquet files and Hudi modified Parquet files

2021-09-17 Thread Xiong Qiang
Hi, all, I am new to Hudi, so please forgive me for naive questions. I was following the guides at https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hudi-work-with-dataset.html and at https://hudi.incubator.apache.org/docs/quick-start-guide/. My goal is to load original Parquet files (writ