[jira] [Created] (IMPALA-8232) Custom cluster tests should allow setting dfs.client settings for impalads
Sahil Takiar created IMPALA-8232:
Summary: Custom cluster tests should allow setting dfs.client
settings for impalads
Key: IMPALA-8232
URL: https://issues.apache.org/jira/browse/IMPALA-8232
Project: IMPALA
Issue Type: Improvement
Components: Backend
Reporter: Sahil Takiar
Assignee: Sahil Takiar
Right now, custom cluster tests only allow specifying impalad startup options,
however, it would be nice if the tests could specify arbitrary HDFS client
configs as well (e.g. {{dfs.client}} options). This would allow us to increase
our test integration coverage with different HDFS client setups such as (1)
disabling short-circuit reads (thus triggering the code path for a remote read)
(requires setting {{dfs.client.read.shortcircuit}} to false), (2) enabling
hedged reads (requires setting {{dfs.client.hedged.read.threadpool.size}} to a
value greater than 0).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (IMPALA-8232) Custom cluster tests should allow setting dfs.client settings for impalads
Sahil Takiar created IMPALA-8232:
Summary: Custom cluster tests should allow setting dfs.client
settings for impalads
Key: IMPALA-8232
URL: https://issues.apache.org/jira/browse/IMPALA-8232
Project: IMPALA
Issue Type: Improvement
Components: Backend
Reporter: Sahil Takiar
Assignee: Sahil Takiar
Right now, custom cluster tests only allow specifying impalad startup options,
however, it would be nice if the tests could specify arbitrary HDFS client
configs as well (e.g. {{dfs.client}} options). This would allow us to increase
our test integration coverage with different HDFS client setups such as (1)
disabling short-circuit reads (thus triggering the code path for a remote read)
(requires setting {{dfs.client.read.shortcircuit}} to false), (2) enabling
hedged reads (requires setting {{dfs.client.hedged.read.threadpool.size}} to a
value greater than 0).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
