prashanthpdesai edited a comment on issue #661: URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-632263515
we are trying to use HUDI Deltastreamer to read from compacted Kafka topic in production environment and pull the messages incrementally and persist the data in MapR Platform in regular interval , tried initially with MOR with continuous mode of streamer faced small file issue , now planning to run it in minibatch(every 2 hours) with COPY_ON_WRITE to avoid compaction etc. we are facing offsetoutofrange exception ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org