Dkbei opened a new issue, #1191: URL: https://github.com/apache/incubator-paimon/issues/1191
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Paimon version The paimon hive-connector version is[paimon-hive-connector-2.1-cdh-6.3-0.5-20230520.001837-16.jar](https://repository.apache.org/content/groups/snapshots/org/apache/paimon/paimon-hive-connector-2.1-cdh-6.3/0.5-SNAPSHOT/paimon-hive-connector-2.1-cdh-6.3-0.5-20230520.001837-16.jar) ### Compute Engine hive-2.1.1-cdh-6.3.2 ### Minimal reproduce step 1.Data from the hive table is read to the paimon table 2.The hive table data totals 3.8 million 3.The paimon table is partitioned according to create_time and contains data within three years. If data needs to be written to the paimon table successfully, set the memory size to 8 GB. In the same scenario, only 1.5 GB memory needs to be allocated for hive table writing 4.If the paimon table increases the number of buckets, more memory resources will be required. 5.The EXCLUSIVE lock is added when hive writes the paimon table. As a result, any query is blocked. ### What doesn't meet your expectations? 1. Reduce resource usage 2. Check whether hive writes data to the paimon table without blocking the paimon table query. ### Anything else? _No response_ ### Are you willing to submit a PR? - [ ] I'm willing to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
