currently, datamap in carbon applys to all segments. The roadmap refers to commands like add/drop segment, and also maybe something about incremental loading for MV. For these scenes, it is better to make datamap can be use on segment level instead of disable the datamap when any datamap data is not ready for any segment. Also this can make datamap fail-safe and enhance carbon's stablility. Maybe we can consider about this also.
----- Regards Manhua ---Original--- From: "Ravindra Pesala"<ravi.pes...@gmail.com> Date: Tue, Jul 16, 2019 22:31 PM To: "dev"<dev@carbondata.apache.org>; Subject: [Discussion] Roadmap for Apache CarbonData 2 Hi Community, Three years have passed since the launching of the Apache CarbonData project, CarbonData has become a popular data management solution for various scenarios. As new workload like AI and new runtime environment like the cloud is emerging quickly, I think we are reaching a point that needs to discuss the future of CarbonData. To bring CarbonData to a new level to satisfy those new requirements, Jacky and I drafted a roadmap for CarbonData 2 in the cwiki website. - English Version: https://cwiki.apache.org/confluence/display/CARBONDATA/Apache+CarbonData+2+Roadmap+Proposal - Chinese Version: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=120737492 Please feel free to discuss the roadmap in this thread, and we welcome every feedback to make CarbonData better. Thanks and Regards, Ravindra.
