stym06 opened a new issue #3747: URL: https://github.com/apache/hudi/issues/3747
**Describe the problem you faced** I'm running the hive sync process to sync the Hudi data stored in the Azure blob storage, written by the Deltastreamer tool. The problem is that this process is unable to exit after the sync completes and partitions etc are added. **To Reproduce** Steps to reproduce the behavior: 1. Run Hive sync independently with Hudi data written to Blob **Expected behavior** Hive sync process should complete as expected and exit. **Environment Description** * Hudi version : 0.9.0-SNAPSHOT * Spark version : 2.4.4 * Hive version : 3.1.2 * Hadoop version : 3.2.0 * Storage (HDFS/S3/GCS..) : Azure Blob * Running on Docker? (yes/no) : K8s **Additional context** I'm running the hive metastore and hive server as separate services on a K8s cluster, using the below repo images: https://github.com/joshuarobinson/trino-on-k8s/blob/master/hive_metastore/Dockerfile **Stacktrace** ``` 2021-09-22 14:56:18,313 INFO [main] utils.MetaStoreUtils (MetaStoreUtils.java:updateTableStatsSlow(705)) - Updated size of table hmi_quectel_battery_packet_v1_test to 5784679 2021-09-22 14:56:18,341 INFO [main] hive.HiveSyncTool (HiveSyncTool.java:syncHoodieTable(197)) - Sync complete for hmi_quectel_battery_packet_v1_test 2021-09-22 14:56:18,342 INFO [main] metastore.HiveMetaStore (HiveMetaStore.java:logInfo(895)) - 0: Cleaning up thread local RawStore... 2021-09-22 14:56:18,342 INFO [main] HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(347)) - ugi=root ip=unknown-ip-addr cmd=Cleaning up thread local RawStore... 2021-09-22 14:56:18,343 INFO [main] metastore.HiveMetaStore (HiveMetaStore.java:logInfo(895)) - 0: Done cleaning up thread local RawStore 2021-09-22 14:56:18,343 INFO [main] HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(347)) - ugi=root ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore 2021-09-22 14:56:18,343 INFO [main] metastore.HiveMetaStore (HiveMetaStore.java:logInfo(895)) - 0: Done cleaning up thread local RawStore 2021-09-22 14:56:18,343 INFO [main] HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(347)) - ugi=root ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
