[
https://issues.apache.org/jira/browse/HAWQ-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075614#comment-15075614
]
ASF GitHub Bot commented on HAWQ-297:
-------------------------------------
GitHub user zhangh43 opened a pull request:
https://github.com/apache/incubator-hawq/pull/234
HAWQ-297. Double check hdfs and split length equals to metadata logic…
… length.
for each table, we store file logic length in pg_aoseg metadata table.
when scanning tables, we obtain blocks information from HDFS(or cache)
we need to ensure the file length in HDFS equals to the logic length of
file in pg_aoseg.
Again, we also need to ensure after we assign each blocks to virtual
segments, the total length of splits equals to the logic length of file in
pg_aoseg.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zhangh43/incubator-hawq hawq297
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-hawq/pull/234.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #234
----
commit 06ffaf14b90456fd7970868b04b68a36c169412a
Author: hubertzhang <hzh...@pivotal.io>
Date: 2015-12-30T09:59:39Z
HAWQ-297. Double check hdfs and split length equals to metadata logic
length.
----
> Double check hdfs and split length equals to metadata logic length.
> -------------------------------------------------------------------
>
> Key: HAWQ-297
> URL: https://issues.apache.org/jira/browse/HAWQ-297
> Project: Apache HAWQ
> Issue Type: Improvement
> Components: Core
> Reporter: Hubert Zhang
> Assignee: Hubert Zhang
>
> for each table, we store file logic length in pg_aoseg metadata table.
> when scanning tables, we obtain blocks information from HDFS(or cache)
> we need to ensure the file length in HDFS equals to the logic length of file
> in pg_aoseg.
> Again, we also need to ensure after we assign each blocks to virtual
> segments, the total length of splits equals to the logic length of file in
> pg_aoseg.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
