[ https://issues.apache.org/jira/browse/HADOOP-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-13037: ----------------------------------- Attachment: HADOOP-13037.005.patch Thanks, [~vishwajeet.dusane]. I need to test it using some valid credentials, but this looks good, overall. I made a few minor changes as I was going through the patch, posted as v005. Please review. * Smartquote in {{index.md}} replaced with quote * Changed some uses of {{Configuration#get/setClass}} to improve type safety * Removed {{\@VisibleForTesting}} annotations from {{AdlFileSystem}} fields * Removed deleted config params from {{TestConcurrentDataReadOperations}} * Collapsed static imports from {{AdlConfKeys}} * Removed a call to {{incrementReadOps}} from {{AdlFileSystem#getFileBlockLocations}}, as it's incremented in {{getFileStatus}} * Changed some unit tests that succeed for thrown exceptions to use the {{\@Test(expected=ExceptionType.class)}} syntax * Flipped {{assertEquals(expected, actual)}} where these were inverted BTW- {{adls.xml}} adds the following: {noformat} + <property> + <name>fs.contract.is-blobstore</name> + <value>true</value> + </property> {noformat} I'm not familiar with this parameter. What is it controlling? > Azure Data Lake Client: Support Azure data lake as a file system in Hadoop > -------------------------------------------------------------------------- > > Key: HADOOP-13037 > URL: https://issues.apache.org/jira/browse/HADOOP-13037 > Project: Hadoop Common > Issue Type: Improvement > Components: fs, fs/azure, tools > Reporter: Shrikant Naidu > Assignee: Vishwajeet Dusane > Fix For: 2.9.0 > > Attachments: HADOOP-13037 Proposal.pdf, HADOOP-13037-001.patch, > HADOOP-13037-002.patch, HADOOP-13037-003.patch, HADOOP-13037-004.patch, > HADOOP-13037.005.patch > > > The jira proposes an improvement over HADOOP-12666 to remove webhdfs > dependencies from the ADL file system client and build out a standalone > client. At a high level, this approach would extend the Hadoop file system > class to provide an implementation for accessing Azure Data Lake. The scheme > used for accessing the file system will continue to be > adl://<accountname>.azuredatalake.net/path/to/file. > The Azure Data Lake Cloud Store will continue to provide a webHDFS rest > interface. The client will access the ADLS store using WebHDFS Rest APIs > provided by the ADLS store. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org