[ https://issues.apache.org/jira/browse/IMPALA-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tianyi Wang resolved IMPALA-7004. --------------------------------- Resolution: Fixed Fix Version/s: Impala 3.1.0 Commit 13a1acd7e42b533c39b9f4eea1c17823bde4c1c5 in impala's branch refs/heads/master from [~tianyiwang] [ [https://git-wip-us.apache.org/repos/asf?p=impala.git;h=13a1acd] ] IMPALA-7003: Deflake erasure coding data loading Erasure coding data loading is flaky in two ways: 1. HBase sometimes doesn't work because of HBase-19369 2. Nested data loading sometimes fails because the HDFS namenode cannot find enough good datanodes. For problem 1, this patch enables erasure coding only on /test-warehouse directory. For problem 2, this patch sets dfs.namenode.redundancy.considerLoad to false, preventing namenode from excluding heavily-loaded datanodes. Change-Id: I219106cd3ec7ffab7a834700f2a722b165e5f66c Reviewed-on: [http://gerrit.cloudera.org:8080/10362] Reviewed-by: Alex Behm <alex.b...@cloudera.com> Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com> > Deflake erasure coding data loading > ----------------------------------- > > Key: IMPALA-7004 > URL: https://issues.apache.org/jira/browse/IMPALA-7004 > Project: IMPALA > Issue Type: Sub-task > Affects Versions: Impala 3.1.0 > Reporter: Tianyi Wang > Assignee: Tianyi Wang > Priority: Major > Fix For: Impala 3.1.0 > > > Currently the data loading of erasure coding is flaky. There are 2 separate > problems: > # HBase data loading sometimes fails: HBASE-19369 > # Nested data loading sometimes fails because there are not enough "Good" > data nodes. The root cause might be same as IMPALA-6394 -- This message was sent by Atlassian JIRA (v7.6.3#76005)