Re: Optimize and refactor insert into command

2020-01-01 Thread sujith chacko
, > Ajantha > > On Thu, 2 Jan, 2020, 12:18 am sujith chacko, > wrote: > > > Hi Ajantha, > > > >Thanks for your initiative, I have couple of questions even though. > > > > a) As per your explanation the dataset validation is already done as part >

Re: Optimize and refactor insert into command

2020-01-01 Thread sujith chacko
Hi Ajantha, Thanks for your initiative, I have couple of questions even though. a) As per your explanation the dataset validation is already done as part of the source table, this is what you mean? What I understand is the insert select queries are going to get some benefits since we don’t do

Re: [DISCUSSION] Support OBSFS

2019-02-19 Thread sujith chacko
Hi Manish, May i know which version of hadoop will provide OBSFS support. Is this file system already supported in recent hadoop releases? Thanks Sujith. On Tue, 19 Feb 2019 at 4:18 PM, manish nalla wrote: > Hi all, > > OBS is an Object-based Storage Service developed and maintained by >

Re: [Discussion] DDLs to operate on CarbonLRUCache

2019-02-19 Thread sujith chacko
Hi Naman, Thanks for proposing this feature, seems to be pretty interesting feature, few points i want to bring up here 1) I think we shall require a detailed design for this feature where all the DDL's you are going to expose shall be clearly mentioned as frequent updation of DDL's are not

Re: [ANNOUNCE] Bo Xu as new Apache CarbonData committer

2018-12-07 Thread sujith chacko
Congratulations Xubo!!! On Sat, 8 Dec 2018 at 8:37 AM, Liang Chen wrote: > Hi all > > We are pleased to announce that the PMC has invited Bo Xu as new > Apache CarbonData > committer, and the invite has been accepted! > > Congrats to Bo Xu and welcome aboard. > > Regards > Apache CarbonData PMC

Re: Is carbondata replace global dictionary in driver site?

2018-10-30 Thread sujith chacko
Conversion from dictionary to actual values happens in executor side. Please refer CarbonDictionaryDecoder.scala class know more details about conversion logic. You can also refer the plan by executing explain query. Thanks, Sujith On Fri, 26 Oct 2018 at 3:27 PM, carbondata-newuser <

Re: carbondata1.5 compatible with spark2.3.1

2018-10-12 Thread sujith chacko
Hi , Carbon is compatible with both versions spark 2.3.1 and spark 2.3.2 . but it will be always better to use more stable versions for online deployment. Spark 2.3.2 has many blockers and data inconsistency issues fixed including few security bugs. Thanks, Sujith On Sun, 30 Sep 2018 at 1:46

Re: [ANNOUNCE] Raghunandan as new committer of Apache CarbonData

2018-09-26 Thread sujith chacko
Congratulations Raghu On Wed, 26 Sep 2018 at 12:44 PM, Rahul Kumar wrote: > congrats Raghunandan !! > > > Rahul Kumar > *Sr. Software Consultant* > *Knoldus Inc.* > m: 9555480074 > w: www.knoldus.com e: rahul.ku...@knoldus.in > > > > On Wed, Sep 26, 2018 at 12:41 PM

Re: [DISCUSSION] Updates to CarbonData documentation and structure

2018-09-05 Thread sujith chacko
+1, As this will improve our documentation quality, just have 1 suggestions, do we need to have a migration guide also in carbon or a section which basically says any behaviour changes while migrating the carbon versions. This will be very handy when we release our major versions. Fo Example if

Re: [DISCUSSION] Support Map type for complex type columns

2018-08-20 Thread sujith chacko
Hi Indumathi, Design document covers all aspects of the implementation which is good except few minor points are missing i think like, It will be better if we can list down the constraints in our implementations if any, like a)Can we use map data type columns as partition key columns? b) It will

Re: [Discussion] Propose to upgrade the version of integration/presto from 0.187 to 0.206

2018-08-13 Thread sujith chacko
+1 for presto 0.207/0.208 upgradation. As liang mentioned there are some memory issues related patches as well there are some security fixes in 0.207 version Hope the patches are present in presto 0.208 version also. Thanks, Sujith On Mon, 13 Aug 2018 at 2:38 PM, Liang Chen wrote: > Hi > >