[ https://issues.apache.org/jira/browse/HIVE-14848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jaume M updated HIVE-14848: --------------------------- Status: Open (was: Patch Available) > S3 creds added to a hidden list by HIVE-14588 are not working on MR jobs > ------------------------------------------------------------------------ > > Key: HIVE-14848 > URL: https://issues.apache.org/jira/browse/HIVE-14848 > Project: Hive > Issue Type: Bug > Components: Hive > Affects Versions: 2.2.0 > Reporter: Sergio Peña > Assignee: Jaume M > Priority: Major > Attachments: HIVE-14848.1.patch, HIVE-14848.1.patch, > HIVE-14848.2.patch > > > When S3 credentials are included in hive-site.xml, then MR jobs that need to > read > data from S3 cannot use them because S3 values are stripped from the Job > configuration > object before submitting the MR job. > {noformat} > @Override > public void initialize(HiveConf conf, QueryPlan queryPlan, DriverContext > driverContext) { > ... > conf.stripHiddenConfigurations(job); > this.jobExecHelper = new HadoopJobExecHelper(job, console, this, this); > } > {noformat} > A nice to have (available on hadoop 2.9.0) is an MR > {{mapreduce.job.redacted-properties}} that can be used to hide this list on > the MR side (such as history server UI) to allow MR run the job without > issues. > UPDATE: > Change the call to stripHiddenConfigurations() in > ql/exec/tez/DagUtils.createConfiguration(), because this is currently broken > for running hive-blobstore suite against Tez -- This message was sent by Atlassian JIRA (v7.6.3#76005)