[ https://issues.apache.org/jira/browse/HAWQ-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075614#comment-15075614 ]
ASF GitHub Bot commented on HAWQ-297: ------------------------------------- GitHub user zhangh43 opened a pull request: https://github.com/apache/incubator-hawq/pull/234 HAWQ-297. Double check hdfs and split length equals to metadata logic… … length. for each table, we store file logic length in pg_aoseg metadata table. when scanning tables, we obtain blocks information from HDFS(or cache) we need to ensure the file length in HDFS equals to the logic length of file in pg_aoseg. Again, we also need to ensure after we assign each blocks to virtual segments, the total length of splits equals to the logic length of file in pg_aoseg. You can merge this pull request into a Git repository by running: $ git pull https://github.com/zhangh43/incubator-hawq hawq297 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-hawq/pull/234.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #234 ---- commit 06ffaf14b90456fd7970868b04b68a36c169412a Author: hubertzhang <hzh...@pivotal.io> Date: 2015-12-30T09:59:39Z HAWQ-297. Double check hdfs and split length equals to metadata logic length. ---- > Double check hdfs and split length equals to metadata logic length. > ------------------------------------------------------------------- > > Key: HAWQ-297 > URL: https://issues.apache.org/jira/browse/HAWQ-297 > Project: Apache HAWQ > Issue Type: Improvement > Components: Core > Reporter: Hubert Zhang > Assignee: Hubert Zhang > > for each table, we store file logic length in pg_aoseg metadata table. > when scanning tables, we obtain blocks information from HDFS(or cache) > we need to ensure the file length in HDFS equals to the logic length of file > in pg_aoseg. > Again, we also need to ensure after we assign each blocks to virtual > segments, the total length of splits equals to the logic length of file in > pg_aoseg. -- This message was sent by Atlassian JIRA (v6.3.4#6332)