[ https://issues.apache.org/jira/browse/HDFS-15418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139983#comment-17139983 ]
Uma Maheswara Rao G edited comment on HDFS-15418 at 6/18/20, 8:46 PM: ---------------------------------------------------------------------- Updated PR for review! By default ViewFileSystem represents mount links as symlinks. Many deployment does not really developed symlink aware applications as ListStatus behaves little differently when we have symlinks. With OverloadScheme, if application build on other fs where no symlinks handling, then application see some different behaviors. Ex: HADOOP-17024 However, HADOOP-17029 was attempted to fix some of that incompatibilities. But changing existing behaviors would create incompatibility issues. So, the idea is to introduce advanced config to disable as symlink assumption in ViewFileSystem#listStatus. Bydefault, it's enabled as symlinks in ViewFileSystem. If one wants to disable, please set fs.viewfs.mount.links.as.symlinks to false. In ViewFileSystemOverloadScheme, by default it's false as we tend to work as any other HCFS filesystem and many of them might not have symlinks. If one wants to to see them same as ViewFileSystem, please set fs.viewfs.mount.links.as.symlinks to true. This is an advanced and non advertised property. CC: [~abhishekd] please check if this works fine in your scenarios as this is slightly modified behavior from HADOOP-17029. was (Author: umamaheswararao): Updated PR for review! By default ViewFileSystem represents mount links as symlinks. Many deployment does not really developed symlink aware applications as ListStatus behaves little differently when we have symlinks. With OverloadScheme, if application build on other fs where no symlinks handling, then application see some different behaviors. Ex: HADOOP-17024 However, HADOOP-17029 was attempted to fix some of that incompatibilities. But changing existing behaviors would create incompatibility issues. So, the idea is to introduce advanced config to disable as symlink assumption in ViewFileSystem#listStatus. Bydefault, it's enabled as symlinks in ViewFileSystem. If one wants to disable, please set fs.viewfs.mount.links.as.symlinks to false. In ViewFileSystemOverloadScheme, by default it's false as we tend to work as any other HCFS filesystem and many of them might not have symlinks. If one wants to to see them same as ViewFileSystem, please set fs.viewfs.mount.links.as.symlinks to true. This is an advanced and non advertised property. > ViewFileSystemOverloadScheme should represent mount links as non symlinks > ------------------------------------------------------------------------- > > Key: HDFS-15418 > URL: https://issues.apache.org/jira/browse/HDFS-15418 > Project: Hadoop HDFS > Issue Type: Sub-task > Reporter: Uma Maheswara Rao G > Assignee: Uma Maheswara Rao G > Priority: Major > > Currently ViewFileSystemOverloadScheme uses ViewFileSystem default behavior. > ViewFS represents the mount links as symlinks always. Since > ViewFSOverloadScheme, we can have any scheme, and that scheme fs does not > have symlinks, ViewFs behavior symlinks can confuse. > So, here I propose to represent mount links as non symlinks in > ViewFSOverloadScheme -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org