[jira] [Created] (CARBONDATA-4182) Performance issue when multiple load happeneing to same table for same interval with 2 MVs.

2021-05-11 Thread suyash yadav (Jira)
suyash yadav created CARBONDATA-4182:


 Summary: Performance issue when multiple load happeneing to same 
table for same interval with 2 MVs.
 Key: CARBONDATA-4182
 URL: https://issues.apache.org/jira/browse/CARBONDATA-4182
 Project: CarbonData
  Issue Type: Improvement
  Components: core
Affects Versions: 2.1.0
 Environment: Apache carbon 2.1.0
Reporter: suyash yadav


Hi Team,

We need your help to resolve one of the performance issue that we are facing. 
Please see below details about the table structure and schema implemented at 
our end:

1.We have 25 tables and 2 MVS created for these tables for hour and day 
granularity.
 2.One table can have more than 1 can for same interval and whenver multiple 
csv are there as an input to these tables then sequential loading will take 
place.
 3.for different tables data loading is parallal but whenver 2 csvs are there 
for same table then for that table sequential load will happen by one and then 
other csv respectivly.
 4.We have observed for 1minute of csv to be loaded into the table it is taking 
approximalty 345 to 60 minutes which is creating a huge backlog.

We need your help to resolve this performanec issue as there will be no use of 
15 minutes of data will take more than 15 minutes to load. Users are not going 
to wait and will get fed up by this slowness.

Kindly advice.

Regards
Suyash Yadav



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (CARBONDATA-4181) Empty result coming randomly when we query in presto with filter on SI column

2021-05-11 Thread Mahesh Raju Somalaraju (Jira)
Mahesh Raju Somalaraju created CARBONDATA-4181:
--

 Summary: Empty result coming randomly when we query in presto with 
filter on SI column
 Key: CARBONDATA-4181
 URL: https://issues.apache.org/jira/browse/CARBONDATA-4181
 Project: CarbonData
  Issue Type: Bug
Reporter: Mahesh Raju Somalaraju


Empty result coming randomly when we query in presto with filter on SI column.

Spark side one task is skipped and empty results are displaying.

 

steps to reproduce:

1) Everytime create tabe freshly and load the data

2) create the SI

3) query on Si column in presto

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (CARBONDATA-4180) create maintable and do insert before creation of si on maintable, then query on si column from presto does not hit SI

2021-05-11 Thread Mahesh Raju Somalaraju (Jira)
Mahesh Raju Somalaraju created CARBONDATA-4180:
--

 Summary: create maintable and do insert before creation of si on 
maintable, then query on si column from presto does not hit SI
 Key: CARBONDATA-4180
 URL: https://issues.apache.org/jira/browse/CARBONDATA-4180
 Project: CarbonData
  Issue Type: Bug
Reporter: Mahesh Raju Somalaraju


create maintable and do insert before creation of si on maintable, then query 
on si column from presto does not hit SI

 

steps:

1) create maintable

2) insert the data

3) create SI

4) query from presto on si column

Expectation:

It should hit SI table and fetch the results.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)