Cheolsoo Park created PIG-4247: ---------------------------------- Summary: S3 properties are not picked up from core-site.xml in local mode Key: PIG-4247 URL: https://issues.apache.org/jira/browse/PIG-4247 Project: Pig Issue Type: Bug Reporter: Cheolsoo Park Assignee: Cheolsoo Park Fix For: 0.15.0
Even in local mode, {{fs.s3}} properties need to be set if the job accesses s3 files (for eg, registering jars on s3, loading input files on s3, etc). In particular, {{fs.s3.awsSecretAccessKey}} and {{fs.s3.awsAccessKey}} are usually set in {{core-site.xml}}, but since local mode doesn't load {{core-site.xml}}, these properties have to be set again in pig.properties. This adds operational overhead because whenever rotating aws keys, {{pig.properties}} also needs to be updated. So it would be nice if {{fs.s3}} properties can be set even in local mode. -- This message was sent by Atlassian JIRA (v6.3.4#6332)