[jira] [Updated] (HADOOP-18501) [ABFS]: Partial Read should add to throttling metric
[ https://issues.apache.org/jira/browse/HADOOP-18501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18501: Labels: pull-request-available (was: ) > [ABFS]: Partial Read should add to throttling metric > > > Key: HADOOP-18501 > URL: https://issues.apache.org/jira/browse/HADOOP-18501 > Project: Hadoop Common > Issue Type: Bug > Components: fs/azure >Affects Versions: 3.3.4 >Reporter: Pranav Saxena >Assignee: Pranav Saxena >Priority: Minor > Labels: pull-request-available > > Error Description: > For partial read (due to account backend throttling), the ABFS driver retry > but doesn't add up in the throttling metrics. > In case of partial read with connection-reset exception, ABFS driver retry > for the full request and doesn't add up in throttling metrics. > Mitigation: > In case of partial read, Abfs Driver should retry for the remaining bytes and > it should be added in throttling metrics. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-18501) [ABFS]: Partial Read should add to throttling metric
[ https://issues.apache.org/jira/browse/HADOOP-18501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranav Saxena updated HADOOP-18501: --- Description: Error Description: For partial read (due to account backend throttling), the ABFS driver retry but doesn't add up in the throttling metrics. In case of partial read with connection-reset exception, ABFS driver retry for the full request and doesn't add up in throttling metrics. Mitigation: In case of partial read, Abfs Driver should retry for the remaining bytes and it should be added in throttling metrics. was: Error Description: For partial read (due to account backend throttling), the ABFS driver doesn't retry and doesn't add up in the throttling metrics. Mitigation: Abfs Driver should retry for the remaining bytes. Also, it should be added in throttling metrics. > [ABFS]: Partial Read should add to throttling metric > > > Key: HADOOP-18501 > URL: https://issues.apache.org/jira/browse/HADOOP-18501 > Project: Hadoop Common > Issue Type: Bug > Components: fs/azure >Affects Versions: 3.3.4 >Reporter: Pranav Saxena >Assignee: Pranav Saxena >Priority: Minor > > Error Description: > For partial read (due to account backend throttling), the ABFS driver retry > but doesn't add up in the throttling metrics. > In case of partial read with connection-reset exception, ABFS driver retry > for the full request and doesn't add up in throttling metrics. > Mitigation: > In case of partial read, Abfs Driver should retry for the remaining bytes and > it should be added in throttling metrics. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-18501) [ABFS]: Partial Read should add to throttling metric
[ https://issues.apache.org/jira/browse/HADOOP-18501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranav Saxena updated HADOOP-18501: --- Component/s: fs/azure > [ABFS]: Partial Read should add to throttling metric > > > Key: HADOOP-18501 > URL: https://issues.apache.org/jira/browse/HADOOP-18501 > Project: Hadoop Common > Issue Type: Bug > Components: fs/azure >Reporter: Pranav Saxena >Assignee: Pranav Saxena >Priority: Minor > > Error Description: > For partial read (due to account backend throttling), the ABFS driver doesn't > retry and doesn't add up in the throttling metrics. > Mitigation: > Abfs Driver should retry for the remaining bytes. Also, it should be added in > throttling metrics. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-18501) [ABFS]: Partial Read should add to throttling metric
[ https://issues.apache.org/jira/browse/HADOOP-18501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranav Saxena updated HADOOP-18501: --- Affects Version/s: 3.3.4 > [ABFS]: Partial Read should add to throttling metric > > > Key: HADOOP-18501 > URL: https://issues.apache.org/jira/browse/HADOOP-18501 > Project: Hadoop Common > Issue Type: Bug > Components: fs/azure >Affects Versions: 3.3.4 >Reporter: Pranav Saxena >Assignee: Pranav Saxena >Priority: Minor > > Error Description: > For partial read (due to account backend throttling), the ABFS driver doesn't > retry and doesn't add up in the throttling metrics. > Mitigation: > Abfs Driver should retry for the remaining bytes. Also, it should be added in > throttling metrics. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-18501) [ABFS]: Partial Read should add to throttling metric
[ https://issues.apache.org/jira/browse/HADOOP-18501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranav Saxena updated HADOOP-18501: --- Description: Error Description: For partial read (due to account backend throttling), the ABFS driver doesn't retry and doesn't add up in the throttling metrics. Mitigation: Abfs Driver should retry for the remaining bytes. Also, it should be added in throttling metrics. was: Error Description: At present, SAS Tokens generated from the Azure Portal may or may not contain a ? as a prefix. SAS Tokens that contain the ? prefix will lead to an error in the driver due to a clash of query parameters. This leads to customers having to manually remove the ? prefix before passing the SAS Tokens. Mitigation: After receiving the SAS Token from the provider, check if any prefix ? is present or not. If present, remove it and pass the SAS Token. > [ABFS]: Partial Read should add to throttling metric > > > Key: HADOOP-18501 > URL: https://issues.apache.org/jira/browse/HADOOP-18501 > Project: Hadoop Common > Issue Type: Bug >Reporter: Pranav Saxena >Assignee: Pranav Saxena >Priority: Minor > > Error Description: > For partial read (due to account backend throttling), the ABFS driver doesn't > retry and doesn't add up in the throttling metrics. > Mitigation: > Abfs Driver should retry for the remaining bytes. Also, it should be added in > throttling metrics. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
