Hi,
I have written a sample spark job that reads the data residing in hbase. I
keep getting below error , any suggestions to resolve this please?
Caused by: java.lang.IllegalArgumentException: AWS Access Key ID and Secret
Access Key must be specified by setting the fs.s3.awsAccessKeyId and
fs.s3
set("fs.s3a.impl",
"org.apache.hadoop.fs.s3a.S3AFileSystem")
spark.sparkContext.hadoopConfiguration.set("fs.s3a.secret.key",
aws.secret_access_key)
Thanks,
Badri
From: KhajaAsmath Mohammed
Sent: 19 May 2021 04:41
To: user @spark
Subject: S3 Access Issues - Spark
Hi,
I
