[
https://issues.apache.org/jira/browse/BIGTOP-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329930#comment-14329930
]
Peter Slawski commented on BIGTOP-1694:
---------------------------------------
Yes, here is the testing done on latest master branch for this patch. I'll
attach a second patch with the new files added to the end. Thanks! :)
Without patch, HttpFS uses file:// for fs.defaultFS:
{noformat}
-bash-4.1$ cat /var/log/hadoop-httpfs/httpfs.log | grep Name
2015-02-21 01:48:11,255 INFO HttpFSServerWebApp [][:] Connects to Namenode
[file:///]
{noformat}
With patch, HttpFS uses hdfs://:
{noformat}
-bash-4.1$ cat /var/log/hadoop-httpfs/httpfs.log | grep Name
2015-02-21 01:35:55,728 INFO HttpFSServerWebApp [][:] Connects to Namenode
[hdfs://ip-10-225-181-95.ec2.internal:8020]
{noformat}
Thus with the patch, listing root through HttpFS shows HDFS files:
{noformat}
-bash-4.1$ curl
"http://localhost:14000/webhdfs/v1?op=liststatus&user.name=hadoop"; | python -m
json.tool | grep pathSuffix
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1124 0 1124 0 0 19136 0 --:--:-- --:--:-- --:--:-- 19379
"pathSuffix": "benchmarks",
"pathSuffix": "hbase",
"pathSuffix": "solr",
"pathSuffix": "tmp",
"pathSuffix": "user",
"pathSuffix": "var",
-bash-4.1$ hadoop fs -ls /
Found 6 items
drwxrwxrwx - hdfs hadoop 0 2015-02-21 01:37 /benchmarks
drwxr-xr-x - hbase hbase 0 2015-02-21 01:37 /hbase
drwxr-xr-x - solr solr 0 2015-02-21 01:37 /solr
drwxrwxrwt - hdfs hadoop 0 2015-02-21 01:41 /tmp
drwxr-xr-x - hdfs hadoop 0 2015-02-21 01:41 /user
drwxr-xr-x - hdfs hadoop 0 2015-02-21 01:37 /var
{noformat}
> puppet: Make httpfs subscribe to core-site and hdfs-site
> --------------------------------------------------------
>
> Key: BIGTOP-1694
> URL: https://issues.apache.org/jira/browse/BIGTOP-1694
> Project: Bigtop
> Issue Type: Bug
> Components: deployment
> Affects Versions: 0.8.0
> Reporter: Peter Slawski
> Assignee: Peter Slawski
> Fix For: 0.9.0
>
> Attachments: BIGTOP-1694.1.patch, BIGTOP-1694.2.patch
>
>
> When applying puppet on a cluster, the HttpFS service can be started before
> core-site.xml template is filled. This results in HttpFS using the default
> value of fs.defaultFS which is 'file://'. HttpFS will then be using the local
> file system instead of HDFS. If Hue is installed on the cluster as well, its
> file browser will show the local file system instead of HDFS.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
