[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations
[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867829#comment-16867829
]
Hudson commented on HADOOP-16340:
-
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16790 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/16790/])
HADOOP-16340. ABFS driver continues to retry on IOException responses (stevel:
rev 450c070a8fb61910f4cd3cf263ce85091509a336)
* (edit)
hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/oauth2/AzureADAuthenticator.java
> ABFS driver continues to retry on IOException responses from REST operations
>
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
>Affects Versions: 3.3.0
>Reporter: Robert Levas
>Assignee: Robert Levas
>Priority: Major
> Fix For: 3.3.0
>
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations
[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867688#comment-16867688
]
Larry McCay commented on HADOOP-16340:
--
[~ste...@apache.org] , [~DanielZhou] - Where are we on the review for this
patch?
> ABFS driver continues to retry on IOException responses from REST operations
>
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
>Affects Versions: 3.3.0
>Reporter: Robert Levas
>Assignee: Robert Levas
>Priority: Major
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations
[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866895#comment-16866895
]
Steve Loughran commented on HADOOP-16340:
-
[~rlevas] -you can now have hadoop-common JIRAs assigned to you
> ABFS driver continues to retry on IOException responses from REST operations
>
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
>Affects Versions: 3.3.0
>Reporter: Robert Levas
>Assignee: Robert Levas
>Priority: Major
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations
[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16864907#comment-16864907
]
Da Zhou commented on HADOOP-16340:
--
[~rlevas], I canot find you in the Assignee list, maybe [~ste...@apache.org]
can help to add you to the list?
> ABFS driver continues to retry on IOException responses from REST operations
>
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
>Affects Versions: 3.3.0
>Reporter: Robert Levas
>Priority: Major
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations
[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860182#comment-16860182
]
Steve Loughran commented on HADOOP-16340:
-
makes sense...I was just scanning branches to see which didn't have the
HADOOP-15809 patch in and couldn't see it
> ABFS driver continues to retry on IOException responses from REST operations
>
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
>Affects Versions: 3.3.0
>Reporter: Robert Levas
>Priority: Major
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations
[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860045#comment-16860045
]
Robert Levas commented on HADOOP-16340:
---
It looks like
{{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}} was
made public in {{HADOOP-15809}} -
[https://github.com/apache/hadoop/commit/273cc2d4e972dc7cc371761a4ab2d1bc20dd5ca0#diff-c20196161db7a6b5e0f9d390ab924209]
Closing this as invalid.
> ABFS driver continues to retry on IOException responses from REST operations
>
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
>Affects Versions: 3.3.0
>Reporter: Robert Levas
>Priority: Major
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations
[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857938#comment-16857938
]
Robert Levas commented on HADOOP-16340:
---
[~ste...@apache.org], [~DanielZhou]... Can you assign this Jira to me? I do
not have privs for that in this project.
> ABFS driver continues to retry on IOException responses from REST operations
>
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
>Affects Versions: 3.3.0
>Reporter: Robert Levas
>Priority: Major
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations
[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857869#comment-16857869
]
Steve Loughran commented on HADOOP-16340:
-
[~rlevas] sounds good for me. Just make it public and then tag as we do for
{{AbfsAuthorizer}}
{code}
@InterfaceAudience.LimitedPrivate("authorization-subsystems")
@InterfaceStability.Unstable
{code}
> ABFS driver continues to retry on IOException responses from REST operations
>
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
>Affects Versions: 3.3.0
>Reporter: Robert Levas
>Priority: Major
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations
[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855719#comment-16855719
]
Robert Levas commented on HADOOP-16340:
---
[~DanielZhou]. I can do this, but I am unfamiliar with this projects
development workflow.
if you would like me to work on it, I will take a look at the project's site
and figure out how to do it.
> ABFS driver continues to retry on IOException responses from REST operations
>
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
>Affects Versions: 3.3.0
>Reporter: Robert Levas
>Priority: Major
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations
[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855319#comment-16855319
]
Da Zhou commented on HADOOP-16340:
--
Thanks [~rlevas] for reporting this issue. The HttpException was created to
solve a bug in _AzureADAuthenticator_. You are correct the customer extension
should have access to the HttpException, which is the simplest fix for this
issue. Do you want to work on this?
> ABFS driver continues to retry on IOException responses from REST operations
>
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
>Affects Versions: 3.3.0
>Reporter: Robert Levas
>Priority: Major
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations
[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854395#comment-16854395
]
Steve Loughran commented on HADOOP-16340:
-
Patches a pull requests welcome, probably making the HttpException public is
the simplest. Abfs test policy is the same as the other stores:
https://github.com/steveloughran/hadoop/blob/trunk/hadoop-tools/hadoop-azure/src/site/markdown/testing_azure.md
> ABFS driver continues to retry on IOException responses from REST operations
>
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
>Affects Versions: 3.3.0
>Reporter: Robert Levas
>Priority: Major
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations
[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854393#comment-16854393
]
Steve Loughran commented on HADOOP-16340:
-
FYI [~DanielZhou]
> ABFS driver continues to retry on IOException responses from REST operations
>
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
>Affects Versions: 3.3.0
>Reporter: Robert Levas
>Priority: Major
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations
[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16853261#comment-16853261
]
Robert Levas commented on HADOOP-16340:
---
FYI [~ste...@apache.org]
> ABFS driver continues to retry on IOException responses from REST operations
>
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/azure
>Affects Versions: 3.3.0
>Reporter: Robert Levas
>Priority: Major
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
