Hi dev: Currently CarbonData supports using compaction command to compact delta data into carbondata file, but it needs two or more segments to be compacted, if the size of these segments is big and user don't want to compact them(it needs to spend a lot of time), just want to compact delta data files into carbondata files for every segment. Discuss with Jacky and David offline, there is a way to do this: add new compaction type for compacting delta data files for each segment, for example: alter table table_name compact 'iud_delta' where segment.id in (0.2), this command will compact all delta data files of segment 0.2 into carbondata files as new segment 0.3.
Any suggestion for this, thanks. -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
