[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …
CarbonDataQA1 commented on pull request #3796: URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647081651 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3179/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …
CarbonDataQA1 commented on pull request #3796: URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647081587 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1454/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #1259: [Review][CARBONDATA-1381] Add test cases for missing scenarios in Partition feature
CarbonDataQA1 commented on pull request #1259: URL: https://github.com/apache/carbondata/pull/1259#issuecomment-647070524 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3180/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] marchpure closed pull request #3621: [HOTFIX] Support both listfile() and listfile(maxCount) in InsertStag…
marchpure closed pull request #3621: URL: https://github.com/apache/carbondata/pull/3621 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] marchpure closed pull request #3667: [HOTFIX] Enhanced compatibility with Spark's FilePartition interface
marchpure closed pull request #3667: URL: https://github.com/apache/carbondata/pull/3667 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] marchpure commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …
marchpure commented on pull request #3796: URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647069585 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …
CarbonDataQA1 commented on pull request #3796: URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647032567 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3177/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …
CarbonDataQA1 commented on pull request #3796: URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647032458 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1452/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3795: [CARBONDATA-3860] Fix IndexServer keeps loading some segments index repeatly
CarbonDataQA1 commented on pull request #3795: URL: https://github.com/apache/carbondata/pull/3795#issuecomment-647030351 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3178/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3795: [CARBONDATA-3860] Fix IndexServer keeps loading some segments index repeatly
CarbonDataQA1 commented on pull request #3795: URL: https://github.com/apache/carbondata/pull/3795#issuecomment-647029993 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1453/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (CARBONDATA-3860) Fix IndexServer keeps loading some segments index repeatly
Xingjun Hao created CARBONDATA-3860: --- Summary: Fix IndexServer keeps loading some segments index repeatly Key: CARBONDATA-3860 URL: https://issues.apache.org/jira/browse/CARBONDATA-3860 Project: CarbonData Issue Type: Bug Reporter: Xingjun Hao In current getTableBlockIndexUniqueIdentifiers function. if the segmentBlockIndexInfo.getSegmentMetaDataInfo() is null, the IndexServer will keeps loading the index of this segment repeatly. We shall avoid to let it affect query performance, considering MetaDataInfo doesn't matter with the query processing. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [carbondata] marchpure opened a new pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …
marchpure opened a new pull request #3796: URL: https://github.com/apache/carbondata/pull/3796 ### Why is this PR needed? when storing table status file in object store, reading of table status file mayfail (receive EOFException or JsonSyntaxException) when table status file is being modifying we shall retry multiple times and add the lock before throwing EOFException or JsonSyntaxException ### What changes were proposed in this PR? Add lock and retry mechanism to read tablestatus ### Does this PR introduce any user interface change? - No ### Is any new testcase added? - No This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (CARBONDATA-3859) Lock and retry to read tablestatus before throwing EOFException or JsonSyntaxException
[ https://issues.apache.org/jira/browse/CARBONDATA-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingjun Hao updated CARBONDATA-3859: Summary: Lock and retry to read tablestatus before throwing EOFException or JsonSyntaxException (was: Enhance lock and retry of Reading tablestatus files while loading) > Lock and retry to read tablestatus before throwing EOFException or > JsonSyntaxException > -- > > Key: CARBONDATA-3859 > URL: https://issues.apache.org/jira/browse/CARBONDATA-3859 > Project: CarbonData > Issue Type: Improvement >Reporter: Xingjun Hao >Priority: Major > > when storing table status file in object store, reading of table status file > mayfail (receive EOFException or JsonSyntaxException) > when table status file is being modifying > we shall retry multiple times and add the lock before throwing EOFException > or JsonSyntaxException -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (CARBONDATA-3859) Enhance lock and retry of Reading tablestatus files while loading
Xingjun Hao created CARBONDATA-3859: --- Summary: Enhance lock and retry of Reading tablestatus files while loading Key: CARBONDATA-3859 URL: https://issues.apache.org/jira/browse/CARBONDATA-3859 Project: CarbonData Issue Type: Improvement Reporter: Xingjun Hao when storing table status file in object store, reading of table status file mayfail (receive EOFException or JsonSyntaxException) when table status file is being modifying we shall retry multiple times and add the lock before throwing EOFException or JsonSyntaxException -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3795: [WIP] index server performance issue
CarbonDataQA1 commented on pull request #3795: URL: https://github.com/apache/carbondata/pull/3795#issuecomment-646956966 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3176/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3795: [WIP] index server performance issue
CarbonDataQA1 commented on pull request #3795: URL: https://github.com/apache/carbondata/pull/3795#issuecomment-646956742 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1451/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3794: [WIP] refresh segment index cache performance issue
CarbonDataQA1 commented on pull request #3794: URL: https://github.com/apache/carbondata/pull/3794#issuecomment-646956581 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1450/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3794: [WIP] refresh segment index cache performance issue
CarbonDataQA1 commented on pull request #3794: URL: https://github.com/apache/carbondata/pull/3794#issuecomment-646955935 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3175/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org