Re: [VOTE] Apache CarbonData 2.3.1-rc1 release

+1 for the release Thanks Kunal Kapoor On Tue, 21 Nov, 2023, 1:07 am Liang Chen, wrote: > Hi > > > > I submit the Apache CarbonData 2.3.1 (RC1) to your vote. > > 1. Key features of this release are highlighted as below.. > > - Fixed performance

Re: Dear community

upgrade the spark version frequently to leverage these features. Another idea that popped into my head is if Carbondata can help in an offline Feature Store for the model training. Not sure whether this is feasible or even the right approach, need to brainstorm on this. Thanks Kunal Kapoor

Re: [ANNOUNCE] Bo Xu as new PMC for Apache CarbonData

Congratulations Xubo Regards Kunal Kapoor On Tue, Apr 25, 2023 at 10:53 PM Akash r wrote: > Congratulations Xubo > > Regards > Akash R Nilugal > > On Tue, 25 Apr 2023 at 12:28 AM, Liang Chen > wrote: > > > *Hi * > > > > > > *We are plea

Re: [DISCUSSION] Incremental‌ ‌Dataload‌‌of Average aggregate in ‌MV‌‌

Hi Shreelekhya, +1 for this feature, I could not understand how you would be able to handle compatibility, for the old tables the SQL doesn't have to be rewritten, while for new tables it has to be. So how will you decide this? Same scenario for old table load Also, Need to benchmark the impact

Re: [ANNOUNCE] Vikram Ahuja as new Apache CarbonData committer

Congratulations vikram On Mon, 14 Feb 2022, 10:36 am Vikram Ahuja, wrote: > Thank you all for your wishes > > Regards > Vikram Ahuja >

Re: [VOTE] Apache CarbonData 2.3.0(RC2) release

Hi all PMC vote has passed for Apache Carbondata 2.3.0 release, the result as below: +1(binding): 5（Akash, Kumar Vishal, Ravindra, Jean-Baptiste) +1(non-binding) : 1 Thanks all for your vote. Kunal Kapoor On Thu, Jan 20, 2022 at 11:09 PM Indhumathi M wrote: > +1 > > Regards, >

[VOTE] Apache CarbonData 2.3.0(RC2) release

se [ ] -1 Do not release this package because... Regards, Kunal Kapoor

[VOTE] Apache CarbonData 2.3.0(RC1) release

e [ ] -1 Do not release this package because... Regards, Kunal Kapoor

Re: [VOTE] Apache CarbonData 2.2.0(RC2) release

+1 Regards Kunal Kapoor On Mon, 2 Aug 2021, 4:53 pm Kumar Vishal, wrote: > +1 > Regards > Kumar Vishal > > On Mon, 2 Aug 2021 at 2:28 PM, Indhumathi M > wrote: > > > +1 > > > > Regards, > > Indhumathi M > > > > On Mon, Aug 2, 20

Re: [VOTE] Apache CarbonData 2.2.0(RC1) release

-1, Many important issues are still open. Lets wait for these fixes Thanks Kunal Kapoor On Tue, 6 Jul 2021, 3:44 pm Kumar Vishal, wrote: > -1 > Pls consider pr 4148 > Regards > Kumar Vishal > > On Tue, 6 Jul 2021 at 12:45 PM, Akash Nilugal > wrote: > > > Hi All

Re: [ANNOUNCE] Akash R Nilugal as new PMC for Apache CarbonData

Congratulations akash On Tue, 13 Apr 2021, 8:43 pm Akash r, wrote: > Thank you all > > > Regards, > Akash R Nilugal > > On Sun, Apr 11, 2021, 6:29 PM Liang Chen wrote: > > > Hi > > > > > > We are pleased to announce that Akash R Nilugal as new PMC for Apache > > CarbonData. > > > > > >

Re: [DISCUSSION] Support alter schema for complex types

+1 On Fri, Mar 26, 2021 at 6:19 PM akshay_nuthala wrote: > No, these and other nested level operations will be taken care in the next > phase. > > > > -- > Sent from: > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/ >

Re: [DISCUSSION] Support JOIN query with spatial index

+1 On Mon, Mar 22, 2021 at 4:07 PM Indhumathi wrote: > Hi community, > > Currently, carbon supports IN_POLYGON and IN_POLYGON_LIST udf's, > where user has to manually provide the polygon points(series of latitude > and longitude pair), to query carbon table based on spatial index. > > This

Re: Improve carbondata CDC performance

+1, agree with ravi's suggestion On Thu, Mar 11, 2021 at 7:53 PM Ravindra Pesala wrote: > +1 > Instead of doing the cartesian join, we can broadcast the sorted min/max > with file paths and do the binary search inside the map function. > > Thank you > > On Wed, 24 Feb 2021 at 13:02, akashrn5

Re: [Discussion]Presto Queries leveraging Secondary Index

+1 for the design On Tue, Mar 23, 2021 at 10:37 AM VenuReddy wrote: > Hi all.! > > As discussed in the community meeting held on last week of Feb 2021, we > already have plan to make Secondary Index as a Coarse Grain Datamap in the > future. And It would be more appropriate for this requirement

Re: [VOTE] Apache CarbonData 2.1.1(RC2) release

+1 On Fri, Mar 26, 2021 at 2:57 PM Ajantha Bhat wrote: > Hi All, > > I submit the Apache CarbonData 2.1.1(RC2) for your vote. > > *1.Release Notes:* > >

Re: [DISCUSSION] Describe complex columns

+1 good idea for visualizing complex columns On Thu, Mar 18, 2021 at 10:35 PM Shreelekhya wrote: > Hi, > > Currently describe formatted displays the column information of a table and > some additional information. When complex types such as ARRAY, STRUCT, and > MAP types are present in table,

Re: DISCUSSION: propose to activate "Issues" of https://github.com/apache/carbondata

Then i don't think moving to github issues would be good. JIRA is much better suited for our needs On Thu, Mar 18, 2021 at 8:48 PM Jean-Baptiste Onofre wrote: > Hi, > > I don’t think so. GH Issues is not as "advanced" as Jira. > > Regards > JB > > >

Re: DISCUSSION: propose to activate "Issues" of https://github.com/apache/carbondata

Hi, Is there a way to create story and subtask in github issues similar to jira? On Thu, 18 Mar 2021, 6:12 pm Jean-Baptiste Onofre, wrote: > Hi, > > First of all, I full agree with Liang. > > I think it makes sense to keep the workflow: > > - issue > - PullRequest > - checks (CI) > - merge > >

Re: [VOTE] Apache CarbonData 2.1.1(RC1) release

-1, lets wait for the pending jira's to get resolved On Thu, 18 Mar 2021, 7:30 pm Kumar Vishal, wrote: > -1 > -Regards > Kumar Vishal > > On Thu, 18 Mar 2021 at 6:35 PM, David CaiQiang > wrote: > > > -1, please fix the pending defect and merge the completed PR at first. > > > > > > > > - >

Re: [Discussion]Presto Queries leveraging Secondary Index

+1 on using index server to leverage SI index. As discussed earlier we would need a segment UDF to enable selective segment reading instead of the current implementation. The existing setSegmentsToRead API should be removed later as well Please share the design after your POC On Mon, Jan 18,

Re: About: Carbon Thrift Server is always hung dead!

Yes, because we are using the existing JDBC process provided by spark, therefore HA should be supported by following the link in my previous reply. You can try that solution and if you face any problem then we can discuss. On Thu, 4 Feb 2021, 1:59 pm jingych, wrote: > Hi Kunal Kap

Re: About: Carbon Thrift Server is always hung dead!

roblem is solved or not. We can check further on this if some issue persists. You can join slack for better communication with us using this link <https://join.slack.com/t/carbondataworkspace/shared_invite/zt-g8sv1g92-pr3GTvjrW5H9DVvNl6H2dg> . Thank you Kunal Kapoor On Thu, Feb 4, 2021 at

Re: [DISCUSSION]Merge index property and operations improvement.

+1 On Mon, Nov 23, 2020 at 3:12 PM akashrn5 wrote: > Hi david, > > Thanks for reply > > a) remove mergeIndex property and event listener, add mergeIndex as a part > of loading/compaction transaction. > ==> yes, this can be done, as already discussed. > > b) if the merging index failed,

Re: Size control of minot compaction

The user has to anyways change the application to add new property. If we don't change the property name then at least we can use the existing major compaction size threshold property instead of adding a new one. On Tue, 24 Nov 2020, 1:43 pm Zhangshunyu, wrote: > Hi Akash, if we change the

Re: Size control of minot compaction

or would consider all segments with size below " carbon.compaction.size.threshold". Custom compaction should not consider any property and do a force compaction(existing behaviour). Thanks Kunal Kapoor On Tue, Nov 24, 2020 at 10:32 AM Kunal Kapoor wrote: > Hi Zhangshunyu, > We sh

Re: Size control of minot compaction

compaction.size.threshold " and "carbon.compaction.level.threshold". Major would consider all segments with size below " carbon.compaction.size.threshold". Custom compaction should not consider any property and do a force compaction(existing behaviour). Thanks Kunal Kapoor On Tue, Nov 24, 2020 at 7:

Re: [VOTE] Apache CarbonData 2.1.0(RC2) release

Hi all PMC vote has passed for Apache Carbondata 2.1.0 release, the result as below: +1(binding): 5（Ravindra Pesala, David CaiQiang, Liang Chen, Zhichao Zhang, Kumar Vishal) +1(non-binding) : 3(Indhumathi, Akash, Ajantha Bhat) Thanks all for your vote. On Fri, Nov 6, 2020 at 8:29 AM Liang

[VOTE] Apache CarbonData 2.1.0(RC2) release

f a majority of at least three +1 PMC votes are cast. [ ] +1 Release this package as Apache CarbonData 2.1.0 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Regards, Kunal Kapoor

Re: [ANN] Indhumathi as new Apache CarbonData committer

Congratulations Indhumathi Regards Kunal Kapoor On Wed, 7 Oct 2020, 8:32 pm Indhumathi M, wrote: > Thank you all > > Regards > Indhumathi > > On Wed, Oct 7, 2020 at 8:21 PM Ravindra Pesala > wrote: > > > Congrats Indumathi ! > > > > > > On Wed,

[VOTE] Apache CarbonData 2.1.0(RC1) release

not release this package because... Regards, Kunal Kapoor

Re: Clean files enhancement

+1 for ravi's comment Better to show what would be deleted/moved to trash. Regards, Kunal Kapoor On Thu, Sep 24, 2020 at 8:34 PM Ravindra Pesala wrote: > Hi Vikram, > > +1 > > It is good to remove the automatic cleanup. > But I am still worried about the clean file comman

Re: [Discussion] Segment management enhance

Hi David, I don't think changing the segment ID to UUID is a good idea, it will cause usability issues. 1. Seeing a UUID named directory in the table structure would be weird, and not informative. 2. The show segments command would also have the same problem. Thanks Kunal Kapoor On Fri, Sep 4

Re: [Discussion]Do we still need to support carbon.merge.index.in.segment property ?

Agree with david on always using merge index. +1 for deprecating the property. On Thu, Jul 9, 2020 at 3:32 PM Ajantha Bhat wrote: > Hi, What if too many index files in a segment and user want to finish load > fast and don't want to wait for merge index? > > That time setting merge index =

Re: [VOTE] Apache CarbonData 2.0.1(RC1) release

Hi all PMC vote has passed for Apache Carbondata 2.0.1 release, the result as below: +1(binding): 4（Jacky, David CaiQiang, Liang Chen, Zhichao Zhang) +1(non-binding) : 1 Thanks all for your vote. On Mon, Jun 1, 2020 at 7:20 PM David CaiQiang wrote: > +1 > > > > - > Best Regards >

[VOTE] Apache CarbonData 2.0.1(RC1) release

elease this package as Apache CarbonData 2.0.1 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Regards, Kunal Kapoor

Re: [DISCUSSION] About global sort in 2.0.0

+1 We can have 2.0.1 as the patch release. Regards Kunal Kapoor On Mon, Jun 1, 2020 at 9:09 AM Jacky Li wrote: > Hi All, > > In CarbonData version 2.0.0, there is a bug that making global-sort using > incorrect sort value when sorting column is String. > This is impacting all

Re: [VOTE] Apache CarbonData 2.0.0(RC3) release

Hi all PMC vote has passed for Apache Carbondata 2.0.0 release, the result as below: +1(binding): 6（Jacky, Kumar Vishal, Ravindra, David CaiQiang, Liang Chen, Zhichao Zhang) +1(non-binding) : 3 Thanks all for your vote. On Wed, May 20, 2020 at 4:07 PM Kunal Kapoor wrote: > Hi all >

Re: [VOTE] Apache CarbonData 2.0.0(RC3) release

> +1 > > > > > --原始邮件------ > 发件人:"Kunal Kapoor" 发送时间:2020年5月17日(星期天) 下午5:20 > 收件人:"dev" > 主题:[VOTE] Apache CarbonData 2.0.0(RC3) release > > > > Hi All, > > I submit the Apache CarbonData 2.0.0(RC3) for your v

Re: [VOTE] Apache CarbonData 2.0.0(RC3) release

Hi David, Java-docs are created only for java classes, and mv-plan does not have any java classes therefore there is no doc jar. On Mon, May 18, 2020 at 12:13 PM David CaiQiang wrote: > hi, Kunal > > another question about point 4: > *4. A staged Maven repository is available for review at:*

Re: [VOTE] Apache CarbonData 2.0.0(RC3) release

Hi David, Yeah you are right. I will remove the 2.4 source zip and other files for the same. Thanks Kunal Kapoor On Mon, May 18, 2020 at 8:25 AM David CaiQiang wrote: > I have a doubt about point 3: > *3. The artifacts to be voted on are located here:* > https://dist.apache.org/repos

[VOTE] Apache CarbonData 2.0.0(RC3) release

of at least three +1 PMC votes are cast. [ ] +1 Release this package as Apache CarbonData 2.0.0 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Regards, Kunal Kapoor

[VOTE] Apache CarbonData 2.0.0(RC2) release

tes are cast. [ ] +1 Release this package as Apache CarbonData 2.0.0 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Regards, Kunal Kapoor

[VOTE] Apache CarbonData 2.0.0(RC1) release

tes are cast. [ ] +1 Release this package as Apache CarbonData 2.0.0 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Regards, Kunal Kapoor

Re: Propose to upgrade hive version to 3.1.0

? > > Thanks, > Ajantha > > On Fri, 21 Feb, 2020, 4:39 pm Kunal Kapoor, > wrote: > > > Hi All, > > > > The hive community has already released version 3.1.0 which has a lot of > > bug fixes and new features. > > Many of the users have already migrated to

Propose to upgrade hive version to 3.1.0

the release notes <https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343014=Text=12310843> for the list of improvements and bug fixes. Regards Kunal Kapoor

Re: [Discussion] Support Secondary Index on Carbon Table

+1 Thanks Kunal Kapoor On Wed, Feb 5, 2020, 5:33 PM Indhumathi M wrote: > Hi Community, > > Currently we have datamaps like,* default datamaps* which are block and > blocklet and *coarse grained datamaps* like bloom, and *fine grained > datamaps* like lucene > which helps

[DISCUSSION] Hive and Presto Write support + Performance improvement

/DML would not be supported. *2. Read Performance should be better or equivalent to ORC.* *Phase2 (Presto): To be done later* The Tasks are same as Hive and any update to the task list would be updated after analysis. Any suggestions from the community is appreciated. Thanks Kunal Kapoor

Re: [DISCUSSION]: Changes to SHOW METACACHE command

t; keyword is optional. This command will not show per table, only per node Example: Driver - X bytes Executor1 - Y bytes Executor2 - Z bytes Thanks Kunal Kapoor On Fri, Jan 3, 2020 at 11:11 AM Akash Nilugal wrote: > hi, > > +1, > Looks good. > Can you please update the

Re: Apply to open 'Issues' tab in Apache CarbonData github

Hi, +1 for Ajantha's suggestion. The use of issues tab is not clear from this post. Please give details on how you are planning to use it. Thanks Kunal Kapoor On Mon, Dec 30, 2019 at 2:03 PM Akash Nilugal wrote: > Hi, > > +1 for ajantha's suggestion. > > Many Open source

Re: [DISCUSSION]: Changes to SHOW METACACHE command

Hi Vikram, What is the background for these changes and what are the benefits this will add to carbondata? Better to add a detailed design document in this thread. Thanks Kunal Kapoor On Tue, Nov 26, 2019 at 7:01 PM vikramahuja1001 wrote: > Current result of Show Metacache command: > &l

Re: [DISCUSSION] Support Time Series for MV datamap and autodatamap loading of timeseries datamaps

+1 Regards Kunal Kapoor On Mon, Nov 18, 2019, 3:47 PM Kumar Vishal wrote: > +1 > -Regards > Kumar Vishal > > On Mon, Oct 21, 2019 at 5:46 PM Akash Nilugal > wrote: > > > Hi All, > > > > Based on further analysis with druid and influxdb, current de

Re: [VOTE] Apache CarbonData 1.6.1(RC1) release

+1 On Mon, Oct 7, 2019, 8:42 PM Raghunandan S < carbondatacontributi...@gmail.com> wrote: > Hi > > > I submit the Apache CarbonData 1.6.1 (RC1) for your vote. > > > 1.Release Notes: > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220=12345993 > > > Some key

Re: [DISCUSSION] Support heterogeneous format segments in carbondata

+1 On Mon, Sep 30, 2019, 2:44 PM Akash Nilugal wrote: > Hi > > +1 > One question is , is add segment and load data to main table supported? If > yes, how the segment locking thing is handled? as we are going to add an > entry inside table status with a segment id for added segment. > > Regards,

Re: [ANNOUNCE] Ajantha as new Apache CarbonData committer

Congratulations ajantha On Thu, Oct 3, 2019, 5:30 PM Liang Chen wrote: > Hi > > > We are pleased to announce that the PMC has invited Ajantha as new Apache > CarbonData committer and the invite has been accepted! > > Congrats to Ajantha and welcome aboard. > > Regards > > Apache CarbonData PMC

Re: Time travel/versioning on carbondata.

then would multiple versions of schema files be maintained? 6. *Can the user travel both ways in the revert command?* First reset to an old transaction id and then come back to the latest ID? +1 for not removing the compacted segments immediately to maintain transaction history. Thanks Kunal

Re: [VOTE] Apache CarbonData 1.6.0(RC3) release

+1 Regard Kunal Kapoor On Wed, Aug 14, 2019, 3:02 PM Kumar Vishal wrote: > +1 > Regards > Kumar Vishal > > On Wed, 14 Aug 2019 at 14:59, David Cai wrote: > > > +1 > > >

Re: [VOTE] Apache CarbonData 1.5.4(RC1) release

+1 On Sun, May 26, 2019, 11:19 AM Kumar Vishal wrote: > +1 > Regards > Kumar Vishal > > On Sun, 26 May 2019 at 06:38, Jacky Li wrote: > > > +1 > > > > This version adds some very good features! > > > > Regards, > > Jacky > > > > > > > > -- > > Sent from: > >

Re: [ANNOUNCE] Akash as new Apache CarbonData committer

Congratulations akash壟 On Thu, Apr 25, 2019, 7:56 PM Mohammad Shahid Khan < mohdshahidkhan1...@gmail.com> wrote: > Congrats Akash > Regards, > Mohammad Shahid Khan > > On Thu 25 Apr, 2019, 7:51 PM Liang Chen, wrote: > > > Hi all > > > > We are pleased to announce that the PMC has invited Akash

Re: [DISCUSSION] Distributed Index Cache Server

Hi xuchuayin, ok, we will be moving the pruning logic to this module. Please give +1 to the design if you are happy with it. Thanks Kunal Kapoor On Wed, Feb 20, 2019 at 6:25 PM xuchuanyin wrote: > Hi kunal, > > At last I'd suggest again that the code for pruning procedure should b

Re: [DISCUSSION] Distributed Index Cache Server

Hi xuchuanyin, I have uploaded the version2 of the design document with the desired changes. Please review and let me know if anything is missing or needs to be changed. Thanks Kunal Kapoor On Mon, Feb 18, 2019 at 12:15 PM Kunal Kapoor wrote: > Hi xuchuanyin, > I will expose an int

Re: [DISCUSSION] Distributed Index Cache Server

Hi xuchuanyin, I will expose an interface and the put the same in the design document soon. Thanks for the feedback Kunal Kapoor On Wed, Feb 13, 2019 at 8:04 PM ChuanYin Xu wrote: > Hi kunal, I think we can go further for 2.3 & 4. > > For 4, I think all functions of Index

Re: [DISCUSSION] Distributed Index Cache Server

Hi yaojinguo, 1. The carbon.input.segments property will restrict the segments that have to be accessed. Therefore the carbon driver will send on the specified segments for pruning. Why do you think that the Cache Server will slow down the query? On Fri, Feb 15, 2019 at 2:52 PM yaojinguo wrote:

Re: [DISCUSSION] Distributed Index Cache Server

. Thanks Kunal Kapoor On Thu, Feb 14, 2019 at 11:56 PM dhatchayani wrote: > Hi Kunal, > > This feature looks great from the design. > > Still, I need some more clarifications on the below points. > > (1) How segment deletion will be handled? Whether the next query tak

Re: [DISCUSSION] Distributed Index Cache Server

are currently trying to figure out the best way to authorise and authenticate the access for multiple users. 4. Yes a seperate module would be create but just to start the server and client. The other logic would not be moved to this module. Thanks Kunal Kapoor On Wed, Feb 13, 2019 at 6:59 AM

Re: [DISCUSSION] Distributed Index Cache Server

Hi Manish, Thank you for the suggestions. 1. I will add the impacted areas to the design document. 2. Yes the mapping has to be updated when a executor is down and when it get back up the scheduling of the splits has to be done accordingly. Same will be updated in the design. 3. I think the

Re: [DISCUSSION] Distributed Index Cache Server

Hi Xuchuanyin, Uploaded the design in PDF format to the JIRA. Thanks Kunal Kapoor On Tue, Feb 12, 2019 at 1:58 PM xuchuanyin wrote: > Hi kunal, can you attach the document directly to the jira? I cannot access > the doc on google drive. Thanks. > > > > -- > Sent

[DISCUSSION] Distributed Index Cache Server

for the design document. https://docs.google.com/document/d/161NXxrKLPucIExkWip5mX00x2iOPH6bvsuQnCzzp47E/edit?ts=5c542ab4#heading=h.x0qaehgkncz5 Thanks Kunal Kapoor

Re: [DISCUSSION] Distributed Index Cache Server

+ JIRA link for tracking purpose https://issues.apache.org/jira/browse/CARBONDATA-3288 On Tue, Feb 5, 2019 at 4:36 PM Kunal Kapoor wrote: > + JIRA link for tracking purpose > > > On Tue, Feb 5, 2019 at 4:27 PM Kunal Kapoor > wrote: > >> Hi All, >> >> Carbon

Re: [DISCUSSION] Distributed Index Cache Server

+ JIRA link for tracking purpose On Tue, Feb 5, 2019 at 4:27 PM Kunal Kapoor wrote: > Hi All, > > Carbon currently caches all block/blocklet datamap index information into > the driver. And for bloom type of datamap, it can prune the splits in a > distributed way using dist

Re: [VOTE] Apache CarbonData 1.5.2(RC2) release

+1 Thanks Kunal Kapoor On Wed, Jan 30, 2019, 10:54 PM Raghunandan S < carbondatacontributi...@gmail.com wrote: > Hi > > > I submit the Apache CarbonData 1.5.2 (RC2) for your vote. > > > 1.Release Notes: > > > https://issues.apache.org/jira/secure/ReleaseNote

Re: [ANNOUNCE] Chuanyin Xu as new PMC for Apache CarbonData

Congratulations On Wed, Jan 2, 2019, 9:36 AM xm_zzc <441586...@qq.com wrote: > Congratulation, Chuanyin Xu. > > > > -- > Sent from: > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/ >

Re: [ANNOUNCE] Bo Xu as new Apache CarbonData committer

Congratulations xubo On Sat, Dec 8, 2018, 9:53 AM kanaka kumar avvaru < kanakakumaravv...@gmail.com wrote: > Congrats Xubo. > > -Regards > Kanaka > > On Sat 8 Dec, 2018, 09:41 Raghunandan S wrote: > > > Congrats xubo. Welcome on board > > > > On Sat, 8 Dec 2018, 8:37 am Liang Chen, wrote: > >

Re: [VOTE] Apache CarbonData 1.5.1(RC2) release

+1 Regards Kunal Kapoor On Mon, Dec 3, 2018, 1:18 PM kanaka +1 > > I think CARBONDATA-3116 is not introduced in 1.5.1 & As Ravindra mentioned, > If currently it is not intended for end users, we can discuss and optimize > configuration in next version > > About the

[Discussion] CarbonReader performance improvement

is greatly appreciated. Thanks Kunal Kapoor

Re: java.lang.NegativeArraySizeException occurred when compact

Okay sure. Please let us know the result On Thu, Oct 18, 2018, 11:01 AM xm_zzc <441586...@qq.com> wrote: > Hi Kunal Kapoor: > I have patched PR#2796 into 1.3.1 and run stream app again, this issue > does not happen often, I will run for a few days to check whether it works. &g

Re: java.lang.NegativeArraySizeException occurred when compact

Right. Can you try to write the segments after cherry picking #2796? On Wed, Oct 17, 2018 at 3:21 PM xm_zzc <441586...@qq.com> wrote: > Hi Kunal Kapoor: > 1. No; > 2. query unsuccessfully, I use Carbon SDK Reader to read that wrong > segment and it failed too.

Re: java.lang.NegativeArraySizeException occurred when compact

into the possibilities of any other thread clearing the MemoryBlock. Regards Kunal Kapoor On Tue, Oct 16, 2018 at 1:31 PM xm_zzc <441586...@qq.com> wrote: > Hi Babu: > Thanks for your reply. > I set enable.unsafe.in.query.processing=false and > enable.unsafe.columnpage=false , and test f

Re: [ANNOUNCE] Raghunandan as new committer of Apache CarbonData

Congratulations raghunandan On Wed, Sep 26, 2018, 1:04 PM Ravindra Pesala wrote: > Congrats Raghu > > On Wed, 26 Sep 2018 at 12:53, sujith chacko > wrote: > > > Congratulations Raghu > > > > On Wed, 26 Sep 2018 at 12:44 PM, Rahul Kumar > > wrote: > > > > > congrats Raghunandan !! > > > > > >

Re: Issues about dictionary and S3

Hi aaron, For Issue2 can you cherry-pick https://github.com/apache/carbondata/pull/2761 and try. I think it should solve your problem. Thanks On Tue, Sep 25, 2018 at 8:34 PM aaron <949835...@qq.com> wrote: > Thanks a lot! Looking forward to your good news. > > > > -- > Sent from: >

Re: Issues about dictionary and S3

-2967 Thanks Kunal Kapoor On Mon, Sep 24, 2018 at 12:56 PM aaron <949835...@qq.com> wrote: > Hi kunalkapoor, > > More info for you. > > *1. One comment about how to reproduce this *- query was distributed to > spark workers on different nodes for execution. > > *2.

Re: Issues about dictionary and S3

Hi aaron, Thank you for reporting the issues. Let me have a look into these. I will reply ASAP. Thanks Kunal Kapoor On Mon, Sep 24, 2018 at 9:07 AM aaron <949835...@qq.com> wrote: > One typo fix, spark version of No 2 should be 2.2.1 Pre built with hadoop > 2.7.2 > >

Re: [DISCUSSION] Updates to CarbonData documentation and structure

+1, I agree with sujith. We can have a seperate link in the website(example: *Breaking change*) which can list all the behaviour changes that the new version is introducing. Regards, Kunal Kapoor On Wed, Sep 5, 2018 at 3:56 PM sujith chacko wrote: > +1, > As this will impro

Re: error occur when I load data to s3

Ok. Let me have a look On Tue, Sep 4, 2018, 8:22 AM aaron <949835...@qq.com> wrote: > Hi kunalkapoor, >It seems that error not fixed yet. Do you have any idea? > > thanks > aaron > > aaron:2.2.1 aaron$ spark-shell --executor-memory 4g --driver-memory 2g > Ivy Default Cache set to:

Re: error occur when I load data to s3

Hi aaron, Many issues like this have been identified in 1.4 version. Most of the issues have been fixed in the master code and will be released in 1.5 version. Remaing fixes are in progress. Can you try the same scenario in 1.5(master branch). Thanks Kunal Kapoor On Mon, Sep 3, 2018, 5:57 AM

Re: [DISCUSSION] Remove BTree related code

+1 for removing unused code Regards Kunal Kapoor On Fri, Aug 24, 2018, 2:09 PM Ravindra Pesala wrote: > +1 > We can remove unused code > > Regards, > Ravindra > > On Fri, 24 Aug 2018 at 14:06, Kumar Vishal > wrote: > > > > > > >

Re: [VOTE] Apache CarbonData 1.4.1(RC2) release

+1 Regards Kunal Kapoor On Fri, Aug 10, 2018, 8:14 AM Ravindra Pesala wrote: > Hi > > > I submit the Apache CarbonData 1.4.1 (RC2) for your vote. > > > 1.Release Notes: > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220=1234

Re: Operation not allowed: ALTER TABLE COMPACT(line 1, pos 0)

Hi chenxingyu, I am unable to reproduce the issue. Can you please verify your jars. This looks to be a parsing issue. Thanks Kunal Kapoor On Wed, Jun 27, 2018 at 3:09 PM 陈星宇 wrote: > hi， > i refer to the official document to compact carbondata table by command > 'AL

Re: S3 support

. I think we can introduce refresh using path for this scenario. Thanks Kunal Kapoor On Fri, Jun 22, 2018 at 12:08 PM David CaiQiang wrote: > Hi Kunal, > I have some questions. > > *Problem(Locking):* > Does the memory lock support that the multiple drivers concurrently load >

S3 support

. Any suggestion from community is most welcomed. Please let me know for any clarification. Regards Kunal Kapoor

Re: [VOTE] Apache CarbonData 1.4.0(RC2) release

+1 On Mon, May 28, 2018, 8:20 AM xm_zzc <441586...@qq.com> wrote: > +1 > > > > -- > Sent from: > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/ >

Re: 回复：[DISCUSSION] Support only spark 2 in carbon 1.3.0

+1 On 09-Oct-2017 9:32 AM, "岑玉海" wrote: > +1 > > > Best regards! > Yuhai Cen > > > 在2017年10月9日 09:56，Lu Cao 写道： > Hi community, > Currently we have three spark related module in carbondata(spark 1.5, 1.6, > 2.1), the project has become more and more

Re: [ANNOUNCE] Manish Gupta as new Apache CarbonData

Congratulations manish  On 25-Aug-2017 11:10 PM, "Aniket Adnaik" wrote: > Congratulations Manish !!! > > Best Regards, > Aniket > > On 25 Aug 2017 8:56 am, "Liang Chen" wrote: > > > Hi all > > > > We are pleased to announce that the PMC has

[jira] [Created] (CARBONDATA-1229) null being populated in table if user deletes table during single pass load

Kunal Kapoor created CARBONDATA-1229: Summary: null being populated in table if user deletes table during single pass load Key: CARBONDATA-1229 URL: https://issues.apache.org/jira/browse/CARBONDATA-1229

[jira] [Created] (CARBONDATA-1171) Add support for show partition DDL

Kunal Kapoor created CARBONDATA-1171: Summary: Add support for show partition DDL Key: CARBONDATA-1171 URL: https://issues.apache.org/jira/browse/CARBONDATA-1171 Project: CarbonData

[jira] [Created] (CARBONDATA-1170) Skip single_pass loading during first load

Kunal Kapoor created CARBONDATA-1170: Summary: Skip single_pass loading during first load Key: CARBONDATA-1170 URL: https://issues.apache.org/jira/browse/CARBONDATA-1170 Project: CarbonData

[jira] [Created] (CARBONDATA-1135) Show partition column information in describe formatted command

Kunal Kapoor created CARBONDATA-1135: Summary: Show partition column information in describe formatted command Key: CARBONDATA-1135 URL: https://issues.apache.org/jira/browse/CARBONDATA-1135

[jira] [Created] (CARBONDATA-1113) Add validation for partition column feature

Kunal Kapoor created CARBONDATA-1113: Summary: Add validation for partition column feature Key: CARBONDATA-1113 URL: https://issues.apache.org/jira/browse/CARBONDATA-1113 Project: CarbonData

[jira] [Created] (CARBONDATA-1075) Close Dictionary Server when application ends

Kunal Kapoor created CARBONDATA-1075: Summary: Close Dictionary Server when application ends Key: CARBONDATA-1075 URL: https://issues.apache.org/jira/browse/CARBONDATA-1075 Project: CarbonData

Re: [ANNOUNCE] Ravindra as new Apache CarbonData PMC

Congratulations ravi -- Regards *Kunal Kapoor* On Fri, May 19, 2017 at 7:55 PM, sounak <soun...@gmail.com> wrote: > Congrats Ravi :) > > On Fri, May 19, 2017 at 7:51 PM, Kumar Vishal <kumarvishal1...@gmail.com> > wrote: > > > Congratulations Ravi :) > >

  1   2   >