Re: [Discussion]Float and Double compatibility issue with external segments to Carbon

2020-05-07 Thread David CaiQiang
It is a historical legacy issue and easy to reuse the solution of the double
data type.

Suggest implementing the float data type independently.




-
Best Regards
David Cai
--
Sent from: 
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/


Re: Disable Adaptive encoding for Double and Float by default

2020-05-07 Thread David CaiQiang
I agree with Ravindra and I can try to fix it (I have mentioned in a PR
review comment). 



-
Best Regards
David Cai
--
Sent from: 
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/


Re: [ANNOUNCE] Kunal Kapoor as new PMC for Apache CarbonData

2020-05-07 Thread David CaiQiang
Congratulations Kunal



-
Best Regards
David Cai
--
Sent from: 
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/


Re: Carbon over-use cluster resources

2020-05-07 Thread David CaiQiang
Hi, manhua
  Now no_sort reuse the loading flow of local_sort. It is not a good
solution and led to the situation which you have mentioned. In my opinion,
we need to adjust the loading flow of no_sort, maybe like global_sort
finally.

  In addition, the producer-consumer pattern in data encoding and
compression also can be optimized for no_sort and global_sort, maybe just
prefetch one page and process it instead of using a thread pool.



-
Best Regards
David Cai
--
Sent from: 
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/