Re: 答复: spark streaming insert data error

2019-03-20 Thread David CaiQiang
There are all documents(include streaming table) under the following link.
https://github.com/apache/carbondata/tree/master/docs

You can find all examples in examples/spark2 module:
example 1 (support Update/Delete)
https://github.com/apache/carbondata/blob/master/examples/spark2/src/main/scala/org/apache/carbondata/examples/StreamingUsingBatchLoadExample.scala

example 2 (not support Update/Delete)
https://github.com/apache/carbondata/blob/master/examples/spark2/src/main/scala/org/apache/carbondata/examples/StructuredStreamingExample.scala
or:
https://github.com/apache/carbondata/blob/master/examples/spark2/src/main/scala/org/apache/carbondata/examples/StreamingWithRowParserExample.scala



-
Best Regards
David Cai
--
Sent from: 
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/


Re: spark streaming insert data error

2019-03-20 Thread Jocean shi
HI:

I dont't use CarbonTable.getCreateOrderColumn method.
All the method controller is Carbondata.
If my DataFrame schema order don't match table schema order then error

Best
Jocean.shi


David CaiQiang  于2019年3月20日周三 下午3:48写道:

> You can get table schema by CarbonTable.getCreateOrderColumn method.
> It will return the correct table schema.
>
> "name,city,id,salary" is the order of column storage, it is not the table
> schema.
>
>
>
> -
> Best Regards
> David Cai
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>


Re: spark streaming insert data error

2019-03-20 Thread David CaiQiang
You can get table schema by CarbonTable.getCreateOrderColumn method.
It will return the correct table schema.

"name,city,id,salary" is the order of column storage, it is not the table
schema.



-
Best Regards
David Cai
--
Sent from: 
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/