[jira] [Created] (CARBONDATA-1166) creating partition on decimal column is failing

2017-06-12 Thread QiangCai (JIRA)
QiangCai created CARBONDATA-1166: Summary: creating partition on decimal column is failing Key: CARBONDATA-1166 URL: https://issues.apache.org/jira/browse/CARBONDATA-1166 Project: CarbonData

[jira] [Created] (CARBONDATA-1165) Class Cast excpeyion in intermediate file merger when loading data

2017-06-12 Thread anubhav tarar (JIRA)
anubhav tarar created CARBONDATA-1165: - Summary: Class Cast excpeyion in intermediate file merger when loading data Key: CARBONDATA-1165 URL: https://issues.apache.org/jira/browse/CARBONDATA-1165

[jira] [Created] (CARBONDATA-1164) Make Column Group feature deprecated

2017-06-12 Thread Jacky Li (JIRA)
Jacky Li created CARBONDATA-1164: Summary: Make Column Group feature deprecated Key: CARBONDATA-1164 URL: https://issues.apache.org/jira/browse/CARBONDATA-1164 Project: CarbonData Issue Type:

[jira] [Created] (CARBONDATA-1163) Use sortBy operator to load data

2017-06-12 Thread Yadong Qi (JIRA)
Yadong Qi created CARBONDATA-1163: - Summary: Use sortBy operator to load data Key: CARBONDATA-1163 URL: https://issues.apache.org/jira/browse/CARBONDATA-1163 Project: CarbonData Issue Type: S

[jira] [Created] (CARBONDATA-1162) After compact segments, data sorted in global level.

2017-06-12 Thread Yadong Qi (JIRA)
Yadong Qi created CARBONDATA-1162: - Summary: After compact segments, data sorted in global level. Key: CARBONDATA-1162 URL: https://issues.apache.org/jira/browse/CARBONDATA-1162 Project: CarbonData

[jira] [Created] (CARBONDATA-1161) Generate one index file per segment to improve the performance of first query

2017-06-12 Thread Yadong Qi (JIRA)
Yadong Qi created CARBONDATA-1161: - Summary: Generate one index file per segment to improve the performance of first query Key: CARBONDATA-1161 URL: https://issues.apache.org/jira/browse/CARBONDATA-1161

[jira] [Created] (CARBONDATA-1160) Use spark multi-threads model to load data

2017-06-12 Thread Yadong Qi (JIRA)
Yadong Qi created CARBONDATA-1160: - Summary: Use spark multi-threads model to load data Key: CARBONDATA-1160 URL: https://issues.apache.org/jira/browse/CARBONDATA-1160 Project: CarbonData Iss

Re: About ColumnGroup feature

2017-06-12 Thread David CaiQiang
+1 for A As I known, so far ColumnGroup feature can't improve performance very well, it became a useless feature nearly. If necessary, we need redesign this feature to keep code clean and tune it well to improve performance. - Best Regards David Cai -- View this message in context: http://

RE: About ColumnGroup feature

2017-06-12 Thread Jihong Ma
not a feature beneficial to real-world application, vote for A! Jihong -Original Message- From: Jacky Li [mailto:jacky.li...@qq.com] Sent: Friday, June 09, 2017 6:05 PM To: dev@carbondata.apache.org Subject: About ColumnGroup feature Hi Community, In JIRA 1014, we are adding Unsafe Col

[jira] [Created] (CARBONDATA-1159) Batch sort loading is not proper without synchronization

2017-06-12 Thread dhatchayani (JIRA)
dhatchayani created CARBONDATA-1159: --- Summary: Batch sort loading is not proper without synchronization Key: CARBONDATA-1159 URL: https://issues.apache.org/jira/browse/CARBONDATA-1159 Project: Carbon

[jira] [Created] (CARBONDATA-1158) Hive integration code optimization

2017-06-12 Thread Liang Chen (JIRA)
Liang Chen created CARBONDATA-1158: -- Summary: Hive integration code optimization Key: CARBONDATA-1158 URL: https://issues.apache.org/jira/browse/CARBONDATA-1158 Project: CarbonData Issue Typ

[jira] [Created] (CARBONDATA-1157) Dependency conflict when executing load query on multinode cluster with Spark 1.6

2017-06-12 Thread SWATI RAO (JIRA)
SWATI RAO created CARBONDATA-1157: - Summary: Dependency conflict when executing load query on multinode cluster with Spark 1.6 Key: CARBONDATA-1157 URL: https://issues.apache.org/jira/browse/CARBONDATA-1157

[jira] [Created] (CARBONDATA-1156) IUD Performance Improvement And Synchonizaion issue

2017-06-12 Thread kumar vishal (JIRA)
kumar vishal created CARBONDATA-1156: Summary: IUD Performance Improvement And Synchonizaion issue Key: CARBONDATA-1156 URL: https://issues.apache.org/jira/browse/CARBONDATA-1156 Project: CarbonDa

[jira] [Created] (CARBONDATA-1155) DataLoad failure for noDictionarySortColumns with 3Lakh data

2017-06-12 Thread Rahul Kumar (JIRA)
Rahul Kumar created CARBONDATA-1155: --- Summary: DataLoad failure for noDictionarySortColumns with 3Lakh data Key: CARBONDATA-1155 URL: https://issues.apache.org/jira/browse/CARBONDATA-1155 Project: C

[jira] [Created] (CARBONDATA-1154) Driver Side IUD Performance Optimization

2017-06-12 Thread sounak chakraborty (JIRA)
sounak chakraborty created CARBONDATA-1154: -- Summary: Driver Side IUD Performance Optimization Key: CARBONDATA-1154 URL: https://issues.apache.org/jira/browse/CARBONDATA-1154 Project: CarbonDa

Re: can't apply mappartitions to dataframe generated from carboncontext

2017-06-12 Thread Mic Sun
org.apache.spark.SparkException: Task not serializable at org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:304) at org.apache.spark.util.ClosureCleaner$.org$apache$spark$util$ClosureCleaner$$clean(ClosureCleaner.scala:294) at org.apache.spark.uti