DEEPAK MEHRA created CARBONDATA-619:
---------------------------------------
Summary: Compaction API for Spark 2.1 : Issue in compaction type
Key: CARBONDATA-619
URL: https://issues.apache.org/jira/browse/CARBONDATA-619
Project: CarbonData
Issue Type: Bug
Components: data-query
Affects Versions: 1.0.0-incubating
Reporter: DEEPAK MEHRA
Priority: Minor
Attachments: compaction_result.png, employee.csv
Compaction API for Spark 2.1 : Compaction is successful on the segment ids
irrespective of the compaction types which are( Minor and Major) i.e The
compaction was successful for type other than Minor/Major
I created a table with name carbon_table and made 5 loads into the table with
the threshold of (4,3)
cc.sql("create table carbon_table(id int,name string) stored by 'carbondata'")
cc.sql("LOAD DATA LOCAL INPATH 'hdfs://hadoop-master:54311/data/employee.csv'
INTO TABLE carbon_table options('FILEHEADER'='id,name')")
For instance
Compaction.compaction(spark,"default","carbon_table","xyz")
here
default is the database name
carbon_table is the table name
xyz is the compaction type
I invoked the above method to compact the segments and it was executed
successfully and compacted the segment ids. On show segment It produced the
result with success for compaction . I have attached the screen shot for the
same.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
