[jira] [Updated] (HDFS-7032) Add WebHDFS support for reading and writing to encryption zones

2014-09-15 Thread Andrew Wang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Wang updated HDFS-7032:
--
   Resolution: Fixed
Fix Version/s: 2.6.0
   Status: Resolved  (was: Patch Available)

Committed to trunk and branch-2, thanks Charles.

> Add WebHDFS support for reading and writing to encryption zones
> ---
>
> Key: HDFS-7032
> URL: https://issues.apache.org/jira/browse/HDFS-7032
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: encryption, webhdfs
>Affects Versions: 3.0.0, 2.6.0
>Reporter: Stephen Chu
>Assignee: Charles Lamb
> Fix For: 2.6.0
>
> Attachments: HDFS-7032.001.patch, HDFS-7032.002.patch
>
>
> Currently, decrypting files within encryption zones does not work through 
> WebHDFS. Users will get returned the raw data.
> For example:
> {code}
> bash-4.1$ hdfs crypto -listZones
> /enc2 key128 
> /jenkins  key128 
> bash-4.1$ hdfs dfs -cat /enc2/hello
> hello and goodbye
> bash-4.1$ hadoop fs -cat 
> webhdfs://hdfs-cdh5-vanilla-1.host.com:20101/enc2/hello14/09/08 15:55:26 WARN 
> ssl.FileBasedKeyStoresFactory: The property 'ssl.client.truststore.location' 
> has not been set, no TrustStore will be loaded
> 忡?~?A
> ?`?y???Wbash-4.1$ 
> bash-4.1$ curl -i -L 
> "http://hdfs-cdh5-vanilla-1.host.com:20101/webhdfs/v1/enc2/hello?user.name=hdfs&op=OPEN";
> HTTP/1.1 307 TEMPORARY_REDIRECT
> Cache-Control: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Content-Type: application/octet-stream
> Set-Cookie: 
> hadoop.auth=u=hdfs&p=hdfs&t=simple&e=1410252968270&s=QzpylAy1ltts1F6hHpsVFGC0TfA=;
>  Version=1; Path=/; Expires=Tue, 09-Sep-2014 08:56:08 GMT; HttpOnly
> Location: 
> http://hdfs-cdh5-vanilla-1.host.com:20003/webhdfs/v1/enc2/hello?op=OPEN&user.name=hdfs&namenoderpcaddress=hdfs-cdh5-vanilla-1.host.com:8020&offset=0
> Content-Length: 0
> Server: Jetty(6.1.26)
> HTTP/1.1 200 OK
> Cache-Control: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Content-Type: application/octet-stream
> Content-Length: 18
> Access-Control-Allow-Methods: GET
> Access-Control-Allow-Origin: *
> Server: Jetty(6.1.26)
> 忡?~?A
> ?`?y???Wbash-4.1$ 
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HDFS-7032) Add WebHDFS support for reading and writing to encryption zones

2014-09-15 Thread Charles Lamb (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Charles Lamb updated HDFS-7032:
---
Attachment: HDFS-7032.002.patch

Rebased.

> Add WebHDFS support for reading and writing to encryption zones
> ---
>
> Key: HDFS-7032
> URL: https://issues.apache.org/jira/browse/HDFS-7032
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: encryption, webhdfs
>Affects Versions: 3.0.0, 2.6.0
>Reporter: Stephen Chu
>Assignee: Charles Lamb
> Attachments: HDFS-7032.001.patch, HDFS-7032.002.patch
>
>
> Currently, decrypting files within encryption zones does not work through 
> WebHDFS. Users will get returned the raw data.
> For example:
> {code}
> bash-4.1$ hdfs crypto -listZones
> /enc2 key128 
> /jenkins  key128 
> bash-4.1$ hdfs dfs -cat /enc2/hello
> hello and goodbye
> bash-4.1$ hadoop fs -cat 
> webhdfs://hdfs-cdh5-vanilla-1.host.com:20101/enc2/hello14/09/08 15:55:26 WARN 
> ssl.FileBasedKeyStoresFactory: The property 'ssl.client.truststore.location' 
> has not been set, no TrustStore will be loaded
> 忡?~?A
> ?`?y???Wbash-4.1$ 
> bash-4.1$ curl -i -L 
> "http://hdfs-cdh5-vanilla-1.host.com:20101/webhdfs/v1/enc2/hello?user.name=hdfs&op=OPEN";
> HTTP/1.1 307 TEMPORARY_REDIRECT
> Cache-Control: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Content-Type: application/octet-stream
> Set-Cookie: 
> hadoop.auth=u=hdfs&p=hdfs&t=simple&e=1410252968270&s=QzpylAy1ltts1F6hHpsVFGC0TfA=;
>  Version=1; Path=/; Expires=Tue, 09-Sep-2014 08:56:08 GMT; HttpOnly
> Location: 
> http://hdfs-cdh5-vanilla-1.host.com:20003/webhdfs/v1/enc2/hello?op=OPEN&user.name=hdfs&namenoderpcaddress=hdfs-cdh5-vanilla-1.host.com:8020&offset=0
> Content-Length: 0
> Server: Jetty(6.1.26)
> HTTP/1.1 200 OK
> Cache-Control: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Content-Type: application/octet-stream
> Content-Length: 18
> Access-Control-Allow-Methods: GET
> Access-Control-Allow-Origin: *
> Server: Jetty(6.1.26)
> 忡?~?A
> ?`?y???Wbash-4.1$ 
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HDFS-7032) Add WebHDFS support for reading and writing to encryption zones

2014-09-12 Thread Andrew Wang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Wang updated HDFS-7032:
--
Assignee: Charles Lamb
  Status: Patch Available  (was: Open)

> Add WebHDFS support for reading and writing to encryption zones
> ---
>
> Key: HDFS-7032
> URL: https://issues.apache.org/jira/browse/HDFS-7032
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: encryption, webhdfs
>Affects Versions: 3.0.0, 2.6.0
>Reporter: Stephen Chu
>Assignee: Charles Lamb
> Attachments: HDFS-7032.001.patch
>
>
> Currently, decrypting files within encryption zones does not work through 
> WebHDFS. Users will get returned the raw data.
> For example:
> {code}
> bash-4.1$ hdfs crypto -listZones
> /enc2 key128 
> /jenkins  key128 
> bash-4.1$ hdfs dfs -cat /enc2/hello
> hello and goodbye
> bash-4.1$ hadoop fs -cat 
> webhdfs://hdfs-cdh5-vanilla-1.host.com:20101/enc2/hello14/09/08 15:55:26 WARN 
> ssl.FileBasedKeyStoresFactory: The property 'ssl.client.truststore.location' 
> has not been set, no TrustStore will be loaded
> 忡?~?A
> ?`?y???Wbash-4.1$ 
> bash-4.1$ curl -i -L 
> "http://hdfs-cdh5-vanilla-1.host.com:20101/webhdfs/v1/enc2/hello?user.name=hdfs&op=OPEN";
> HTTP/1.1 307 TEMPORARY_REDIRECT
> Cache-Control: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Content-Type: application/octet-stream
> Set-Cookie: 
> hadoop.auth=u=hdfs&p=hdfs&t=simple&e=1410252968270&s=QzpylAy1ltts1F6hHpsVFGC0TfA=;
>  Version=1; Path=/; Expires=Tue, 09-Sep-2014 08:56:08 GMT; HttpOnly
> Location: 
> http://hdfs-cdh5-vanilla-1.host.com:20003/webhdfs/v1/enc2/hello?op=OPEN&user.name=hdfs&namenoderpcaddress=hdfs-cdh5-vanilla-1.host.com:8020&offset=0
> Content-Length: 0
> Server: Jetty(6.1.26)
> HTTP/1.1 200 OK
> Cache-Control: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Content-Type: application/octet-stream
> Content-Length: 18
> Access-Control-Allow-Methods: GET
> Access-Control-Allow-Origin: *
> Server: Jetty(6.1.26)
> 忡?~?A
> ?`?y???Wbash-4.1$ 
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HDFS-7032) Add WebHDFS support for reading and writing to encryption zones

2014-09-11 Thread Charles Lamb (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Charles Lamb updated HDFS-7032:
---
Attachment: HDFS-7032.001.patch

Submitting patch for test-patch run.

> Add WebHDFS support for reading and writing to encryption zones
> ---
>
> Key: HDFS-7032
> URL: https://issues.apache.org/jira/browse/HDFS-7032
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: encryption, webhdfs
>Affects Versions: 3.0.0, 2.6.0
>Reporter: Stephen Chu
> Attachments: HDFS-7032.001.patch
>
>
> Currently, decrypting files within encryption zones does not work through 
> WebHDFS. Users will get returned the raw data.
> For example:
> {code}
> bash-4.1$ hdfs crypto -listZones
> /enc2 key128 
> /jenkins  key128 
> bash-4.1$ hdfs dfs -cat /enc2/hello
> hello and goodbye
> bash-4.1$ hadoop fs -cat 
> webhdfs://hdfs-cdh5-vanilla-1.host.com:20101/enc2/hello14/09/08 15:55:26 WARN 
> ssl.FileBasedKeyStoresFactory: The property 'ssl.client.truststore.location' 
> has not been set, no TrustStore will be loaded
> 忡?~?A
> ?`?y???Wbash-4.1$ 
> bash-4.1$ curl -i -L 
> "http://hdfs-cdh5-vanilla-1.host.com:20101/webhdfs/v1/enc2/hello?user.name=hdfs&op=OPEN";
> HTTP/1.1 307 TEMPORARY_REDIRECT
> Cache-Control: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Content-Type: application/octet-stream
> Set-Cookie: 
> hadoop.auth=u=hdfs&p=hdfs&t=simple&e=1410252968270&s=QzpylAy1ltts1F6hHpsVFGC0TfA=;
>  Version=1; Path=/; Expires=Tue, 09-Sep-2014 08:56:08 GMT; HttpOnly
> Location: 
> http://hdfs-cdh5-vanilla-1.host.com:20003/webhdfs/v1/enc2/hello?op=OPEN&user.name=hdfs&namenoderpcaddress=hdfs-cdh5-vanilla-1.host.com:8020&offset=0
> Content-Length: 0
> Server: Jetty(6.1.26)
> HTTP/1.1 200 OK
> Cache-Control: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Expires: Mon, 08 Sep 2014 22:56:08 GMT
> Date: Mon, 08 Sep 2014 22:56:08 GMT
> Pragma: no-cache
> Content-Type: application/octet-stream
> Content-Length: 18
> Access-Control-Allow-Methods: GET
> Access-Control-Allow-Origin: *
> Server: Jetty(6.1.26)
> 忡?~?A
> ?`?y???Wbash-4.1$ 
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)