[DISCUSSION] Improve insert process

2017-10-26 Thread cenyuhai11
When I insert data into carbondata from one table, I should do as the following: 1、select count(1) from table1 and then 2、insert into table table1 select * from table1 Why I should execute "select count(1) from table1" first? because the number of tasks are compute by carbondata, it is releated to

Fw:Fw:carbondata在创建表时报错,请问下老师是什么原因

2017-10-26 Thread 胡健军
转发邮件信息 发件人:"胡健军" 发送日期:2017-10-23 19:42:42 收件人:u...@carbondata.apache.org 主题:Fw:carbondata在创建表时报错,请问下老师是什么原因 Forwarding messages From: "胡健军" Date: 2017-10-23 19:28:59 To: u...@carbondata.apache.org Subject: carbondata在创建表时报错,请问下老师是什么原因 scala> c

Re: [Discussion] Merging carbonindex files for each segments and across segments

2017-10-26 Thread Liang Chen
Yes, Jin Zhou. Merge all index files to one in a segment would be useful feature. it would significantly improve query performance. Regards Liang Jin Zhou wrote > Hi, ravipesala > > Thank you for your proposal, merging index file is a very useful feature > as > we have already met serious perfo

Re: [Discussion]support user specified segments in major compation

2017-10-26 Thread Liang Chen
Hi Jin Zhou Thanks for starting this discussion. 1. For your first proposal : Currently , segment is the system internal concept, not expose to outside. Can you provide what exact problems do you encounter? we can find the alternative solution for your problems. --

Re: [DISCUSSION] Optimize the default value for some parameters

2017-10-26 Thread Liang Chen
Hi Ravi Yes, so we need provide a table level property for blocklet size to configure while creating a table. can you please create one JIRA for this ? How about liking this: CREATE TABLE IF NOT EXISTS (column_name,column_type) STORED BY 'carbondata' TBLPROPERTIES('TABLE_BLOCKLETSIZE'='128')

Re: [DISCUSSION] Optimize the default value for some parameters

2017-10-26 Thread xm_zzc
Hi ravipesala: Ok, I will raise jira for this and try to implement this. -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/