[ https://issues.apache.org/jira/browse/IMPALA-9045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zoltán Borók-Nagy reassigned IMPALA-9045: ----------------------------------------- Assignee: Zoltán Borók-Nagy > Filter base directories of open/aborted compactions > --------------------------------------------------- > > Key: IMPALA-9045 > URL: https://issues.apache.org/jira/browse/IMPALA-9045 > Project: IMPALA > Issue Type: Bug > Components: Frontend > Affects Versions: Impala 3.3.0 > Reporter: Csaba Ringhofer > Assignee: Zoltán Borók-Nagy > Priority: Critical > Labels: impala-acid > > Major compactions creates directories in base_writeid_visibilityTxnId, which > expresses that it contains all deltas +bases <= writeId, and that the > compaction's transaction is visibilityTxnId. visibilityTxnId is needed to > check whether the compaction is open/aborted/committed, and base directories > belonging to open/aborted compactions should be ignored. > Currently Impala only checks the writeId, so if there is an open/aborted > compaction, it will be used as base, and base/delta directories with smaller > writeIds will be ignored, leading to potential data loss. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org