Babulal created CARBONDATA-691: ---------------------------------- Summary: After Compaction records count are mismatched. Key: CARBONDATA-691 URL: https://issues.apache.org/jira/browse/CARBONDATA-691 Project: CarbonData Issue Type: Bug Components: data-load, data-query, docs Affects Versions: 1.0.0-incubating Reporter: Babulal Attachments: createLoadcmd.txt, driverlog.txt
Spark version - Spark 1.6.2 and spark2.1 After Compaction data showing is wrong. create table and load 4 times s( compaction threshold is 4,3) Load 4 times same data .each load 105 records as attached in file . --+--+ | SegmentSequenceId | Status | Load Start Time | Load End Time | +--------------------+------------+--------------------------+--------------------------+--+ | 3 | Compacted | 2017-02-01 14:07:51.922 | 2017-02-01 14:07:52.591 | | 2 | Compacted | 2017-02-01 14:07:33.481 | 2017-02-01 14:07:34.443 | | 1 | Compacted | 2017-02-01 14:07:23.495 | 2017-02-01 14:07:24.167 | | 0.1 | Success | 2017-02-01 14:07:52.815 | 2017-02-01 14:07:57.201 | | 0 | Compacted | 2017-02-01 14:07:07.541 | 2017-02-01 14:07:11.983 | +--------------------+------------+--------------------------+--------------------------+--+ 5 rows selected (0.021 seconds) 0: jdbc:hive2://8.99.61.4:23040> select count(*) from Comp_VMALL_DICTIONARY_INCLUDE_7; +-----------+--+ | count(1) | +-----------+--+ | 1680 | +-----------+--+ 1 row selected (4.468 seconds) 0: jdbc:hive2://8.99.61.4:23040> select count(imei) from Comp_VMALL_DICTIONARY_INCLUDE_7; +--------------+--+ | count(imei) | +--------------+--+ | 1680 | +--------------+--+ Expected :- total records should be 420 . -- This message was sent by Atlassian JIRA (v6.3.15#6346)