I'm having problems getting the s3 classpath setup on the CLI & am trying to 
work out what I'm doing wrong.


without setting things up, you can't expect to talk to blobstores

hadoop fs -ls wasb://something/
hadoop fs -ls s3a://landsat-pds/

That's expected. but what I can't do is get the aws bits on the CP via 
HADOOP_OPTIONAL_TOOLS

export 
HADOOP_OPTIONAL_TOOLS="hadoop-azure,hadoop-aws,hadoop-adl,hadoop-openstack"

Once I do that the wasb:// ls works (or at least doesnt throw a CNFE), but the 
s3a URL still fails

if Add the line to ~/.hadooprc all becomes well

hadoop_add_to_classpath_tools hadoop-aws

any ideas?

Reply via email to