[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …

2020-06-20 Thread GitBox


CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647081651


   Build Failed  with Spark 2.3.4, Please check CI 
http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3179/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …

2020-06-20 Thread GitBox


CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647081587


   Build Failed  with Spark 2.4.5, Please check CI 
http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1454/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA1 commented on pull request #1259: [Review][CARBONDATA-1381] Add test cases for missing scenarios in Partition feature

2020-06-20 Thread GitBox


CarbonDataQA1 commented on pull request #1259:
URL: https://github.com/apache/carbondata/pull/1259#issuecomment-647070524


   Build Failed  with Spark 2.3.4, Please check CI 
http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3180/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] marchpure closed pull request #3621: [HOTFIX] Support both listfile() and listfile(maxCount) in InsertStag…

2020-06-20 Thread GitBox


marchpure closed pull request #3621:
URL: https://github.com/apache/carbondata/pull/3621


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] marchpure closed pull request #3667: [HOTFIX] Enhanced compatibility with Spark's FilePartition interface

2020-06-20 Thread GitBox


marchpure closed pull request #3667:
URL: https://github.com/apache/carbondata/pull/3667


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] marchpure commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …

2020-06-20 Thread GitBox


marchpure commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647069585


   retest this please



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …

2020-06-20 Thread GitBox


CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647032567


   Build Failed  with Spark 2.3.4, Please check CI 
http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3177/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …

2020-06-20 Thread GitBox


CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647032458


   Build Failed  with Spark 2.4.5, Please check CI 
http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1452/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3795: [CARBONDATA-3860] Fix IndexServer keeps loading some segments index repeatly

2020-06-20 Thread GitBox


CarbonDataQA1 commented on pull request #3795:
URL: https://github.com/apache/carbondata/pull/3795#issuecomment-647030351


   Build Success with Spark 2.3.4, Please check CI 
http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3178/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3795: [CARBONDATA-3860] Fix IndexServer keeps loading some segments index repeatly

2020-06-20 Thread GitBox


CarbonDataQA1 commented on pull request #3795:
URL: https://github.com/apache/carbondata/pull/3795#issuecomment-647029993


   Build Success with Spark 2.4.5, Please check CI 
http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1453/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Created] (CARBONDATA-3860) Fix IndexServer keeps loading some segments index repeatly

2020-06-20 Thread Xingjun Hao (Jira)
Xingjun Hao created CARBONDATA-3860:
---

 Summary: Fix IndexServer keeps loading some segments index repeatly
 Key: CARBONDATA-3860
 URL: https://issues.apache.org/jira/browse/CARBONDATA-3860
 Project: CarbonData
  Issue Type: Bug
Reporter: Xingjun Hao


In current 

getTableBlockIndexUniqueIdentifiers function. if the 
segmentBlockIndexInfo.getSegmentMetaDataInfo() is null, the IndexServer will 
keeps loading the index of this segment repeatly. We shall avoid to let it 
affect query performance, considering MetaDataInfo doesn't matter with the 
query processing.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [carbondata] marchpure opened a new pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …

2020-06-20 Thread GitBox


marchpure opened a new pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796


   ### Why is this PR needed?
when storing table status file in object store, reading of table status 
file mayfail (receive EOFException or JsonSyntaxException)
   when table status file is being modifying
   we shall retry multiple times and add the lock before throwing EOFException 
or JsonSyntaxException

### What changes were proposed in this PR?
   Add lock and retry mechanism to read tablestatus
   
### Does this PR introduce any user interface change?
- No
   
### Is any new testcase added?
- No
   
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Updated] (CARBONDATA-3859) Lock and retry to read tablestatus before throwing EOFException or JsonSyntaxException

2020-06-20 Thread Xingjun Hao (Jira)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xingjun Hao updated CARBONDATA-3859:

Summary: Lock and retry to read tablestatus before throwing EOFException or 
JsonSyntaxException  (was: Enhance lock and retry of Reading tablestatus files 
while loading)

> Lock and retry to read tablestatus before throwing EOFException or 
> JsonSyntaxException
> --
>
> Key: CARBONDATA-3859
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3859
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: Xingjun Hao
>Priority: Major
>
> when storing table status file in object store, reading of table status file 
> mayfail (receive EOFException or JsonSyntaxException)
> when table status file is being modifying
> we shall retry multiple times and add the lock before throwing EOFException 
> or JsonSyntaxException



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (CARBONDATA-3859) Enhance lock and retry of Reading tablestatus files while loading

2020-06-20 Thread Xingjun Hao (Jira)
Xingjun Hao created CARBONDATA-3859:
---

 Summary: Enhance lock and retry of Reading tablestatus files while 
loading
 Key: CARBONDATA-3859
 URL: https://issues.apache.org/jira/browse/CARBONDATA-3859
 Project: CarbonData
  Issue Type: Improvement
Reporter: Xingjun Hao


when storing table status file in object store, reading of table status file 
mayfail (receive EOFException or JsonSyntaxException)
when table status file is being modifying
we shall retry multiple times and add the lock before throwing EOFException or 
JsonSyntaxException



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3795: [WIP] index server performance issue

2020-06-20 Thread GitBox


CarbonDataQA1 commented on pull request #3795:
URL: https://github.com/apache/carbondata/pull/3795#issuecomment-646956966


   Build Failed  with Spark 2.3.4, Please check CI 
http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3176/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3795: [WIP] index server performance issue

2020-06-20 Thread GitBox


CarbonDataQA1 commented on pull request #3795:
URL: https://github.com/apache/carbondata/pull/3795#issuecomment-646956742


   Build Failed  with Spark 2.4.5, Please check CI 
http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1451/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3794: [WIP] refresh segment index cache performance issue

2020-06-20 Thread GitBox


CarbonDataQA1 commented on pull request #3794:
URL: https://github.com/apache/carbondata/pull/3794#issuecomment-646956581


   Build Failed  with Spark 2.4.5, Please check CI 
http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1450/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3794: [WIP] refresh segment index cache performance issue

2020-06-20 Thread GitBox


CarbonDataQA1 commented on pull request #3794:
URL: https://github.com/apache/carbondata/pull/3794#issuecomment-646955935


   Build Success with Spark 2.3.4, Please check CI 
http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3175/
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org