when I run delta streamer(version 0.9) to ingest data from kafka to a Hbase
indexed mor table ,  after few commits, met this error when compaction
running
[image: image.png]

 In hdfs there is a file has same fileId and commit instant but different
in the middle:
hdfs://tl5/projects/data_vite/mysql_ingestion/rti_vite/shopee_item_v4_db__item_v4_tab_newHbase/BR/2021-10/813800cd-1aaf-43ea-829f-4feef4a51cb3-0_19-2672-4427765_
*20211006051032*.parquet

below is 20211006051032.commit's content,


[image: image.png]


What does 2672-4427765 and 2657-4368242 mean? and how can I fix this error?

I tried recreate table , it happens again


-- 
*Jian Feng,冯健*
Shopee | Engineer | Data Infrastructure

Reply via email to