[carbondata-presto enhancements] support reading carbon SDK writer output in presto

2018-12-09 Thread Ajantha Bhat
Currently, carbon SDK files output (files without metadata folder and its
contents) are read by spark using an external table with carbon session.
But presto carbon integration doesn't support that. It can currently read
only the transactional table output files.

Hence we can enhance presto to read SDK output files. This will increase
the use cases for presto-carbon integration.

The above scenario can be achieved by inferring schema if metadata folder
not exists and
setting read committed scope to LatestFilesReadCommittedScope, if
non-transctional table output files are present.


Thanks,
Ajantha


Re: [DISCUSS] Support transactional table in SDK

2018-12-09 Thread Nicholas
Hi Jacky,
Carbon should support transactional table in SDK before
ApacheFlink-Carbondata Integration.After having online segment, I can use
this feature to implement ApacheFlink-CarbonData integration.Therefore, can
I participate in the development of this feature,facilitating the
integration of ApacheFlink-CarbonData integration feature?



--
Sent from: 
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/