Re: insert into carbon table failed

I guess then word node in "Carbodata launches one job per each node to sort the data at node level and avoid shuffling" may make some confuse. I guess carbondata should launches one task per each executor . here job should be task ,node should be executor. Maybe he can try increase the number of

Carbondata resolve kettle dependencies fail

As the attachment shows: Carbondata resolve kettle dependencies fail. Can anyone know how to fix this? Also,if you use exclusion in maven to exclude the kettle, your project will fail even in compile time.

Re: [jira] [Created] (CARBONDATA-824) Null pointer Exception display to user while performance Testing

First, can you try change the create table statement ends with STORED BY 'carbondata' instead of STORED BY 'org.apache.carbondata.format'; Second , can you give some sample data instead of trying to upload 32GB CSV file.

Re: Questions about dictionary-encoded column and MDK

1. Dictionary encoding make column storage more efficient with small size and improved search performance。 2. when search,MDK/Min-Max can be used to do block/blocklet prunning in oder to reduce IO. For now ,MDK is composed by dimensions with the oder of declared in create table statement On Th

Re: java.lang.AbstractMethodError: org.apache.spark.sql.CarbonContext

Do you build the package from source? If so, please check spark version. Make sure your spark assembly version is 1.6 and build carbondata with profile specified eg. mvn package -Pspark-1.6

Re: carbondata quick start error，can‘t select from table

I have integrated CarbonData to project StreamingPro ( http://www.jianshu.com/p/7733da82a9ce). StreamingPro ships with carbondata-0.3.0 without kettle dependency and support spark streaming. Maybe you can have a try,hope this can save your time.

Re: read parquet file --No such file or directory

Can you try to create CarbonContext as follows: val cc = new CarbonContext(sc, storeLocation, metaLocation") cc.setConf("carbon.kettle.home", kettleHome)

Re: compile error from spark project: scala.reflect.internal.MissingRequirmentError: object scala.runtime in compiler mirror not found

Specify the Profile eg. -Pspark-1.6 On Wed, Nov 30, 2016 at 9:53 AM, bill.zhou wrote: > hi all > > today fetch the latest code from the master branch, then compile the > project. > when compile the project spark it gives following issue. who knows this > issue ? > >

Re: carbon data

Try Code like this: ``` if (cc.tableNames().filter(f => f == _cfg.get("tableName").get).size == 0) { df.sqlContext.sql(s"DROP TABLE IF EXISTS ${_cfg.get("tableName").get}") writer.options(_cfg).mode(SaveMode.Overwrite).format(_format).save() } else { writer.options(_cfg).mode(Sa

Re: Hive create table error

It works. Thanks On Fri, Nov 25, 2016 at 6:03 PM, Sea <261810...@qq.com> wrote: > Hi, william > > > please set your mysql charset latin-1 > > > > > -- 原始邮件 -- > 发件人: "william";; > 发送时间: 2016年11月25日(星期五) 晚上6

Using DataFrame to write carbondata file cause no table found error

[image: Inline image 1] here the code: ``` val df = func(rdd) val writer = df.write if (_resource != "") { writer.option("path", _resource) } writer.options(_cfg).mode(SaveMode.valueOf(_mode)).format(_format).save() ``` and the configurations: ··· { "name": "stream.output", "params": [

Hive create table error

[image: Inline image 1] When I start StreamingPro with carbondata support, hive create table `TABLE_PARAMS` will fail .

[jira] [Created] (CARBONDATA-98) Met an exception when convert a large scale csv : Failed to generate global dictionary files

William Zen created CARBONDATA-98: - Summary: Met an exception when convert a large scale csv : Failed to generate global dictionary files Key: CARBONDATA-98 URL: https://issues.apache.org/jira/browse/CARBONDATA