Hubert Zhang created HAWQ-297: --------------------------------- Summary: Double check hdfs and split length equals to metadata logic length. Key: HAWQ-297 URL: https://issues.apache.org/jira/browse/HAWQ-297 Project: Apache HAWQ Issue Type: Improvement Components: Core Reporter: Hubert Zhang Assignee: Lei Chang
for each table, we store file logic length in pg_aoseg metadata table. when scanning tables, we obtain blocks information from HDFS(or cache) we need to ensure the file length in HDFS equals to the logic length of file in pg_aoseg. Again, we also need to ensure after we assign each blocks to virtual segments, the total length of splits equals to the logic length of file in pg_aoseg. -- This message was sent by Atlassian JIRA (v6.3.4#6332)