hudi-bot opened a new issue, #14504:
URL: https://github.com/apache/hudi/issues/14504
* Repartition WriteStatus before index writes, in a way that each
WriteStatus with new records are not clubbed together.
* This repartition will improve parallelism for this hbase index operation.
* In HBaseIndex puts call, there is a sleep of 100 millis for each batch of
puts. This implementation assumes negligible time for puts, but for large
batches of puts it is inefficient.
* Using rate limiter will be efficient compared to sleep as it accounts for
the time taken for puts as well.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-316
- Type: Task
---
## Comments
03/Apr/20 20:53;Venkatesh
Rudraraju;[https://github.com/apache/incubator-hudi/pull/1484];;;
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
