[jira] [Updated] (HDFS-15765) Add support for Kerberos and Basic Auth in webhdfs

2023-03-02 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HDFS-15765:
--
Labels: pull-request-available  (was: )

> Add support for Kerberos and Basic Auth in webhdfs
> --
>
> Key: HDFS-15765
> URL: https://issues.apache.org/jira/browse/HDFS-15765
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hadoop-client
>Reporter: Pushpendra Singh
>Priority: Minor
>  Labels: pull-request-available
>
> webhdfs's HTTP operation like get ( GetOpParam.java) operation and other HTTP 
> operation has 'requireAuth' set to false and expected to work with Delegation 
> token only. However, when working with webhdfs over Apache Knox, delegation 
> token authentication is not supported, we should support Kerberos 
> authentication (SPNEGO) or Basic authentication for WebHdfsFileSystem if user 
> turns on a configuration.
> Further webhdfs (WebHDFSFileSystem.java)  is calling 'public URLConnection 
> openConnection(URL url)' and providing no way to use the kerberos 
> authentication, if configured.
> Even after setting the UserGroupInformation with user name and keytab, 
> openConnection is not using the keytab for authentication.
> Also WebHdfsFileSystem doesn't provide any support for HTTP BASIC 
> authentication (username/password). Provide support to read the password via 
> environment variable.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-15765) Add support for Kerberos and Basic Auth in webhdfs

2021-01-11 Thread shanyu zhao (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

shanyu zhao updated HDFS-15765:
---
Description: 
webhdfs's HTTP operation like get ( GetOpParam.java) operation and other HTTP 
operation has 'requireAuth' set to false and expected to work with Delegation 
token only. However, when working with webhdfs over Apache Knox, delegation 
token authentication is not supported, we should support Kerberos 
authentication (SPNEGO) or Basic authentication for WebHdfsFileSystem if user 
turns on a configuration.

Further webhdfs (WebHDFSFileSystem.java)  is calling 'public URLConnection 
openConnection(URL url)' and providing no way to use the kerberos 
authentication, if configured.

Even after setting the UserGroupInformation with user name and keytab, 
openConnection is not using the keytab for authentication.

Also WebHdfsFileSystem doesn't provide any support for HTTP BASIC 
authentication (username/password). Provide support to read the password via 
environment variable.

  was:
swebhdfs's HTTP operation like get ( GetOpParam.java) operation and other HTTP 
operation has 'requireAuth' set to false and expected to work with Delegation 
token only.  These attributes should be configurable to either use the kerberos 
credentials or the delegation token.

Further swebhdfs (WebHDFSFileSystem.java)  is calling 'public URLConnection 
openConnection(URL url)' and providing no way to use the kerberos 
authentication, if configured.

Even after setting the UserGroupInformation with user name and keytab, 
openConnection is not using the keytab for authentication.

 Webhdfs doesnt provide any support to read the BASIC auth password. Provide 
support to read the password via environment variable.

Expected Fix : Depending upon the requireAuth for any given HTTP operation, 
swebhdfs should use kerberos and instead call the function 

public URLConnection openConnection(URL url, boolean isSpnego) [File : 
URLConnectionFactory.java]


> Add support for Kerberos and Basic Auth in webhdfs
> --
>
> Key: HDFS-15765
> URL: https://issues.apache.org/jira/browse/HDFS-15765
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hadoop-client
>Reporter: Pushpendra Singh
>Priority: Minor
>
> webhdfs's HTTP operation like get ( GetOpParam.java) operation and other HTTP 
> operation has 'requireAuth' set to false and expected to work with Delegation 
> token only. However, when working with webhdfs over Apache Knox, delegation 
> token authentication is not supported, we should support Kerberos 
> authentication (SPNEGO) or Basic authentication for WebHdfsFileSystem if user 
> turns on a configuration.
> Further webhdfs (WebHDFSFileSystem.java)  is calling 'public URLConnection 
> openConnection(URL url)' and providing no way to use the kerberos 
> authentication, if configured.
> Even after setting the UserGroupInformation with user name and keytab, 
> openConnection is not using the keytab for authentication.
> Also WebHdfsFileSystem doesn't provide any support for HTTP BASIC 
> authentication (username/password). Provide support to read the password via 
> environment variable.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-15765) Add support for Kerberos and Basic Auth in webhdfs

2021-01-08 Thread Pushpendra Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pushpendra Singh updated HDFS-15765:

Description: 
swebhdfs's HTTP operation like get ( GetOpParam.java) operation and other HTTP 
operation has 'requireAuth' set to false and expected to work with Delegation 
token only.  These attributes should be configurable to either use the kerberos 
credentials or the delegation token.

Further swebhdfs (WebHDFSFileSystem.java)  is calling 'public URLConnection 
openConnection(URL url)' and providing no way to use the kerberos 
authentication, if configured.

Even after setting the UserGroupInformation with user name and keytab, 
openConnection is not using the keytab for authentication.

 Webhdfs doesnt provide any support to read the BASIC auth password. Provide 
support to read the password via environment variable.

Expected Fix : Depending upon the requireAuth for any given HTTP operation, 
swebhdfs should use kerberos and instead call the function 

public URLConnection openConnection(URL url, boolean isSpnego) [File : 
URLConnectionFactory.java]

  was:
swebhdfs's HTTP operation like get ( GetOpParam.java) operation and other HTTP 
operation has 'requireAuth' set to false and expected to work with Delegation 
token only.  These attributes should be configurable to either use the kerberos 
credentials or the delegation token.

Further swebhdfs (WebHDFSFileSystem.java)  is calling 'public URLConnection 
openConnection(URL url)' and providing no way to use the kerberos 
authentication, if configured.

Even after setting the UserGroupInformation with user name and keytab, 
openConnection is not using the keytab for authentication.

 

Expected Fix : Depending upon the requireAuth for any given HTTP operation, 
swebhdfs should use kerberos and instead call the function 

public URLConnection openConnection(URL url, boolean isSpnego) [File : 
URLConnectionFactory.java]


> Add support for Kerberos and Basic Auth in webhdfs
> --
>
> Key: HDFS-15765
> URL: https://issues.apache.org/jira/browse/HDFS-15765
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hadoop-client
>Reporter: Pushpendra Singh
>Priority: Minor
>
> swebhdfs's HTTP operation like get ( GetOpParam.java) operation and other 
> HTTP operation has 'requireAuth' set to false and expected to work with 
> Delegation token only.  These attributes should be configurable to either use 
> the kerberos credentials or the delegation token.
> Further swebhdfs (WebHDFSFileSystem.java)  is calling 'public URLConnection 
> openConnection(URL url)' and providing no way to use the kerberos 
> authentication, if configured.
> Even after setting the UserGroupInformation with user name and keytab, 
> openConnection is not using the keytab for authentication.
>  Webhdfs doesnt provide any support to read the BASIC auth password. Provide 
> support to read the password via environment variable.
> Expected Fix : Depending upon the requireAuth for any given HTTP operation, 
> swebhdfs should use kerberos and instead call the function 
> public URLConnection openConnection(URL url, boolean isSpnego) [File : 
> URLConnectionFactory.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-15765) Add support for Kerberos and Basic Auth in webhdfs

2021-01-08 Thread Pushpendra Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/HDFS-15765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pushpendra Singh updated HDFS-15765:

Summary: Add support for Kerberos and Basic Auth in webhdfs  (was: webhdfs 
and url authentication using Kerberos)

> Add support for Kerberos and Basic Auth in webhdfs
> --
>
> Key: HDFS-15765
> URL: https://issues.apache.org/jira/browse/HDFS-15765
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: hadoop-client
>Reporter: Pushpendra Singh
>Priority: Minor
>
> swebhdfs's HTTP operation like get ( GetOpParam.java) operation and other 
> HTTP operation has 'requireAuth' set to false and expected to work with 
> Delegation token only.  These attributes should be configurable to either use 
> the kerberos credentials or the delegation token.
> Further swebhdfs (WebHDFSFileSystem.java)  is calling 'public URLConnection 
> openConnection(URL url)' and providing no way to use the kerberos 
> authentication, if configured.
> Even after setting the UserGroupInformation with user name and keytab, 
> openConnection is not using the keytab for authentication.
>  
> Expected Fix : Depending upon the requireAuth for any given HTTP operation, 
> swebhdfs should use kerberos and instead call the function 
> public URLConnection openConnection(URL url, boolean isSpnego) [File : 
> URLConnectionFactory.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org