Hi Carbondata community, I am evaluating various file format right now and found Carbondata to be interesting specially with the multiple index used to avoid full scan but I am asking if there is any way to achieve idem potence when writing to Carbondata from Spark (or alternative) ? A strong requirement is to avoid a Spark worker crash to write duplicated entries in Carbon... Tx
Vincent