I'm having problems getting the s3 classpath setup on the CLI & am trying to work out what I'm doing wrong.
without setting things up, you can't expect to talk to blobstores hadoop fs -ls wasb://something/ hadoop fs -ls s3a://landsat-pds/ That's expected. but what I can't do is get the aws bits on the CP via HADOOP_OPTIONAL_TOOLS export HADOOP_OPTIONAL_TOOLS="hadoop-azure,hadoop-aws,hadoop-adl,hadoop-openstack" Once I do that the wasb:// ls works (or at least doesnt throw a CNFE), but the s3a URL still fails if Add the line to ~/.hadooprc all becomes well hadoop_add_to_classpath_tools hadoop-aws any ideas?