nsivabalan commented on issue #5952:
URL: https://github.com/apache/hudi/issues/5952#issuecomment-1229347594
looks like there is some confusion here. S3EventsSource actually reads
events from SQS and populates the data into Hudi metadata table. this is the
first stage which does not look into your S3 data directory at all.
Its the 2nd stage where we read the actual source files from S3 path in
S3EventsHoodieIncrSource. Can you help clarify where you are seeing the perf
hit.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
