Re: [Discussion] Support Spark/Hive based partition in carbon

2017-12-04 Thread Ravindra Pesala
Hi Jacky, Here we have the main problem with the underlying segment based design of carbon. For every increment load carbon creates a segment and manages the segments through the tablestatus file. The changes will be very big and impact is more if we try to change this design. And also we will hav

回复: [Discussion] Support Spark/Hive based partition in carbon

2017-12-04 Thread 岑玉海
Hi, Ravindra: I read your design documents, why not use the standard hive/spark folder structure, is there any problem if use the hive/spark folder structure? Best regards! Yuhai Cen 在2017年12月4日 14:09,Ravindra Pesala 写道: Hi, Please find the design document for standard partition su