subject:"Setting s3 credentials in cloudera"

Re: Setting s3 credentials in cloudera

2014-04-21 Thread Kishore kumar

With the same credentials I am able to download the s3 file to my local
filesystem.


On Tue, Apr 22, 2014 at 11:17 AM, Kishore kumar wrote:

> No, I am running in cli.
>
>
> On Mon, Apr 21, 2014 at 8:43 PM, j.barrett Strausser <
> j.barrett.straus...@gmail.com> wrote:
>
>> You mention cloudera, are you trying to execute the query from HUE?  That
>> requires altering the setting for HUE and not HIVE.
>>
>>
>> On Mon, Apr 21, 2014 at 11:12 AM, j.barrett Strausser <
>> j.barrett.straus...@gmail.com> wrote:
>>
>>> Hope those aren't you actual credentials.
>>>
>>>
>>> On Mon, Apr 21, 2014 at 11:05 AM, Kishore kumar 
>>> wrote:
>>>
 I Edited "Cluster-wide Configuration Safety Valve for core-site.xml"
 in cm, and specified as below, but still the problem is same.

 
 fs.s3.awsAccessKeyId
 AKIAJNIM5P2SASWJPHSA
 

 
 fs.s3.awsSecretAccessKey
 BN1hkKD7JY4LGGNbjxmnFE0ehs12vXmP44GCKV2N
 


 FAILED: Error in metadata:
 MetaException(message:java.lang.IllegalArgumentException: AWS Access Key ID
 and Secret Access Key must be specified as the username or password
 (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or
 fs.s3.awsSecretAccessKey properties (respectively).)
 FAILED: Execution Error, return code 1 from
 org.apache.hadoop.hive.ql.exec.DDLTask

 Thanks,
 Kishore.


 On Mon, Apr 21, 2014 at 8:17 PM, Kishore kumar 
 wrote:

> I set the credentials from hive command line, still I am getting the
> error. please help me.
>
> hive> set fs.s3.awsAccessKeyId = x;
>  hive> set fs.s3.awsSecretAccessKey = xxx;
>
> FAILED: Error in metadata:
> MetaException(message:java.lang.IllegalArgumentException: AWS Access Key 
> ID
> and Secret Access Key must be specified as the username or password
> (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or
> fs.s3.awsSecretAccessKey properties (respectively).)
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask
>
> Thanks,
> Kishore.
>
>
>
> On Mon, Apr 21, 2014 at 7:33 PM, Kishore kumar 
> wrote:
>
>> Hi Experts,
>>
>> I am trying to create table against my s3 file, I faced the below
>> issue, where to set these credentials in clouderamanager4.8. I got this
>> link (
>> http://community.cloudera.com/t5/Cloudera-Manager-Installation/AWS-Access-Key-ID-and-Secret-Access-Key-must-be-specified-as-the/td-p/495)
>> after some research but please explain me clearly after edited
>> "Cluster-wide Configuration Safety Valve for core-site.xml" how to
>> specify the values.
>>
>> -- Thanks,
>>
>>
>> *Kishore *
>>
>
>
>
> --
>
>


 --


>>>
>>>
>>> --
>>>
>>>
>>> 
>>>
>>
>
> --
>
>


-- 

*Kishore Kumar*
ITIM

Re: Setting s3 credentials in cloudera

2014-04-21 Thread Kishore kumar

No, I am running in cli.


On Mon, Apr 21, 2014 at 8:43 PM, j.barrett Strausser <
j.barrett.straus...@gmail.com> wrote:

> You mention cloudera, are you trying to execute the query from HUE?  That
> requires altering the setting for HUE and not HIVE.
>
>
> On Mon, Apr 21, 2014 at 11:12 AM, j.barrett Strausser <
> j.barrett.straus...@gmail.com> wrote:
>
>> Hope those aren't you actual credentials.
>>
>>
>> On Mon, Apr 21, 2014 at 11:05 AM, Kishore kumar wrote:
>>
>>> I Edited "Cluster-wide Configuration Safety Valve for core-site.xml" in
>>> cm, and specified as below, but still the problem is same.
>>>
>>> 
>>> fs.s3.awsAccessKeyId
>>> AKIAJNIM5P2SASWJPHSA
>>> 
>>>
>>> 
>>> fs.s3.awsSecretAccessKey
>>> BN1hkKD7JY4LGGNbjxmnFE0ehs12vXmP44GCKV2N
>>> 
>>>
>>>
>>> FAILED: Error in metadata:
>>> MetaException(message:java.lang.IllegalArgumentException: AWS Access Key ID
>>> and Secret Access Key must be specified as the username or password
>>> (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or
>>> fs.s3.awsSecretAccessKey properties (respectively).)
>>> FAILED: Execution Error, return code 1 from
>>> org.apache.hadoop.hive.ql.exec.DDLTask
>>>
>>> Thanks,
>>> Kishore.
>>>
>>>
>>> On Mon, Apr 21, 2014 at 8:17 PM, Kishore kumar wrote:
>>>
 I set the credentials from hive command line, still I am getting the
 error. please help me.

 hive> set fs.s3.awsAccessKeyId = x;
  hive> set fs.s3.awsSecretAccessKey = xxx;

 FAILED: Error in metadata:
 MetaException(message:java.lang.IllegalArgumentException: AWS Access Key ID
 and Secret Access Key must be specified as the username or password
 (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or
 fs.s3.awsSecretAccessKey properties (respectively).)
 FAILED: Execution Error, return code 1 from
 org.apache.hadoop.hive.ql.exec.DDLTask

 Thanks,
 Kishore.



 On Mon, Apr 21, 2014 at 7:33 PM, Kishore kumar 
 wrote:

> Hi Experts,
>
> I am trying to create table against my s3 file, I faced the below
> issue, where to set these credentials in clouderamanager4.8. I got this
> link (
> http://community.cloudera.com/t5/Cloudera-Manager-Installation/AWS-Access-Key-ID-and-Secret-Access-Key-must-be-specified-as-the/td-p/495)
> after some research but please explain me clearly after edited
> "Cluster-wide Configuration Safety Valve for core-site.xml" how to
> specify the values.
>
> -- Thanks,
>
>
> *Kishore *
>



 --

 *Kishore Kumar*
 ITIM

 Bidstalk - Ingenius Programmatic Platform

 Email: kish...@techdigita.in| Tel: +1 415 423 8230  | Cell: +91 741
 135 8658 | skype: kishore.alajangi | YM: kk_asn2004 | Twitter:
 __kishorealajangi
 [image: Inline image 1]

>>>
>>>
>>>
>>> --
>>>
>>> *Kishore Kumar*
>>> ITIM
>>>
>>> Bidstalk - Ingenius Programmatic Platform
>>>
>>> Email: kish...@techdigita.in| Tel: +1 415 423 8230  | Cell: +91 741 135
>>> 8658 | skype: kishore.alajangi | YM: kk_asn2004 | Twitter:
>>> __kishorealajangi
>>> [image: Inline image 1]
>>>
>>
>>
>>
>> --
>>
>>
>> https://github.com/bearrito
>> @deepbearrito
>>
>
>
>
> --
>
>
> https://github.com/bearrito
> @deepbearrito
>



-- 

*Kishore Kumar*
ITIM

Bidstalk - Ingenius Programmatic Platform

Email: kish...@techdigita.in| Tel: +1 415 423 8230  | Cell: +91 741 135
8658 | skype: kishore.alajangi | YM: kk_asn2004 | Twitter: __kishorealajangi
[image: Inline image 1]

Re: Setting s3 credentials in cloudera

2014-04-21 Thread j.barrett Strausser

You mention cloudera, are you trying to execute the query from HUE?  That
requires altering the setting for HUE and not HIVE.


On Mon, Apr 21, 2014 at 11:12 AM, j.barrett Strausser <
j.barrett.straus...@gmail.com> wrote:

> Hope those aren't you actual credentials.
>
>
> On Mon, Apr 21, 2014 at 11:05 AM, Kishore kumar wrote:
>
>> I Edited "Cluster-wide Configuration Safety Valve for core-site.xml" in
>> cm, and specified as below, but still the problem is same.
>>
>> 
>> fs.s3.awsAccessKeyId
>> AKIAJNIM5P2SASWJPHSA
>> 
>>
>> 
>> fs.s3.awsSecretAccessKey
>> BN1hkKD7JY4LGGNbjxmnFE0ehs12vXmP44GCKV2N
>> 
>>
>>
>> FAILED: Error in metadata:
>> MetaException(message:java.lang.IllegalArgumentException: AWS Access Key ID
>> and Secret Access Key must be specified as the username or password
>> (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or
>> fs.s3.awsSecretAccessKey properties (respectively).)
>> FAILED: Execution Error, return code 1 from
>> org.apache.hadoop.hive.ql.exec.DDLTask
>>
>> Thanks,
>> Kishore.
>>
>>
>> On Mon, Apr 21, 2014 at 8:17 PM, Kishore kumar wrote:
>>
>>> I set the credentials from hive command line, still I am getting the
>>> error. please help me.
>>>
>>> hive> set fs.s3.awsAccessKeyId = x;
>>>  hive> set fs.s3.awsSecretAccessKey = xxx;
>>>
>>> FAILED: Error in metadata:
>>> MetaException(message:java.lang.IllegalArgumentException: AWS Access Key ID
>>> and Secret Access Key must be specified as the username or password
>>> (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or
>>> fs.s3.awsSecretAccessKey properties (respectively).)
>>> FAILED: Execution Error, return code 1 from
>>> org.apache.hadoop.hive.ql.exec.DDLTask
>>>
>>> Thanks,
>>> Kishore.
>>>
>>>
>>>
>>> On Mon, Apr 21, 2014 at 7:33 PM, Kishore kumar wrote:
>>>
 Hi Experts,

 I am trying to create table against my s3 file, I faced the below
 issue, where to set these credentials in clouderamanager4.8. I got this
 link (
 http://community.cloudera.com/t5/Cloudera-Manager-Installation/AWS-Access-Key-ID-and-Secret-Access-Key-must-be-specified-as-the/td-p/495)
 after some research but please explain me clearly after edited
 "Cluster-wide Configuration Safety Valve for core-site.xml" how to
 specify the values.

 -- Thanks,


 *Kishore *

>>>
>>>
>>>
>>> --
>>>
>>> *Kishore Kumar*
>>> ITIM
>>>
>>> Bidstalk - Ingenius Programmatic Platform
>>>
>>> Email: kish...@techdigita.in| Tel: +1 415 423 8230  | Cell: +91 741 135
>>> 8658 | skype: kishore.alajangi | YM: kk_asn2004 | Twitter:
>>> __kishorealajangi
>>> [image: Inline image 1]
>>>
>>
>>
>>
>> --
>>
>> *Kishore Kumar*
>> ITIM
>>
>> Bidstalk - Ingenius Programmatic Platform
>>
>> Email: kish...@techdigita.in| Tel: +1 415 423 8230  | Cell: +91 741 135
>> 8658 | skype: kishore.alajangi | YM: kk_asn2004 | Twitter:
>> __kishorealajangi
>> [image: Inline image 1]
>>
>
>
>
> --
>
>
> https://github.com/bearrito
> @deepbearrito
>



-- 


https://github.com/bearrito
@deepbearrito

Re: Setting s3 credentials in cloudera

2014-04-21 Thread j.barrett Strausser

Hope those aren't you actual credentials.


On Mon, Apr 21, 2014 at 11:05 AM, Kishore kumar wrote:

> I Edited "Cluster-wide Configuration Safety Valve for core-site.xml" in
> cm, and specified as below, but still the problem is same.
>
> 
> fs.s3.awsAccessKeyId
> AKIAJNIM5P2SASWJPHSA
> 
>
> 
> fs.s3.awsSecretAccessKey
> BN1hkKD7JY4LGGNbjxmnFE0ehs12vXmP44GCKV2N
> 
>
>
> FAILED: Error in metadata:
> MetaException(message:java.lang.IllegalArgumentException: AWS Access Key ID
> and Secret Access Key must be specified as the username or password
> (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or
> fs.s3.awsSecretAccessKey properties (respectively).)
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask
>
> Thanks,
> Kishore.
>
>
> On Mon, Apr 21, 2014 at 8:17 PM, Kishore kumar wrote:
>
>> I set the credentials from hive command line, still I am getting the
>> error. please help me.
>>
>> hive> set fs.s3.awsAccessKeyId = x;
>>  hive> set fs.s3.awsSecretAccessKey = xxx;
>>
>> FAILED: Error in metadata:
>> MetaException(message:java.lang.IllegalArgumentException: AWS Access Key ID
>> and Secret Access Key must be specified as the username or password
>> (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or
>> fs.s3.awsSecretAccessKey properties (respectively).)
>> FAILED: Execution Error, return code 1 from
>> org.apache.hadoop.hive.ql.exec.DDLTask
>>
>> Thanks,
>> Kishore.
>>
>>
>>
>> On Mon, Apr 21, 2014 at 7:33 PM, Kishore kumar wrote:
>>
>>> Hi Experts,
>>>
>>> I am trying to create table against my s3 file, I faced the below issue,
>>> where to set these credentials in clouderamanager4.8. I got this link (
>>> http://community.cloudera.com/t5/Cloudera-Manager-Installation/AWS-Access-Key-ID-and-Secret-Access-Key-must-be-specified-as-the/td-p/495)
>>> after some research but please explain me clearly after edited
>>> "Cluster-wide Configuration Safety Valve for core-site.xml" how to
>>> specify the values.
>>>
>>> -- Thanks,
>>>
>>>
>>> *Kishore *
>>>
>>
>>
>>
>> --
>>
>> *Kishore Kumar*
>> ITIM
>>
>> Bidstalk - Ingenius Programmatic Platform
>>
>> Email: kish...@techdigita.in| Tel: +1 415 423 8230  | Cell: +91 741 135
>> 8658 | skype: kishore.alajangi | YM: kk_asn2004 | Twitter:
>> __kishorealajangi
>> [image: Inline image 1]
>>
>
>
>
> --
>
> *Kishore Kumar*
> ITIM
>
> Bidstalk - Ingenius Programmatic Platform
>
> Email: kish...@techdigita.in| Tel: +1 415 423 8230  | Cell: +91 741 135
> 8658 | skype: kishore.alajangi | YM: kk_asn2004 | Twitter:
> __kishorealajangi
> [image: Inline image 1]
>



-- 


https://github.com/bearrito
@deepbearrito

Re: Setting s3 credentials in cloudera

2014-04-21 Thread Kishore kumar

I Edited "Cluster-wide Configuration Safety Valve for core-site.xml" in cm,
and specified as below, but still the problem is same.


fs.s3.awsAccessKeyId
AKIAJNIM5P2SASWJPHSA



fs.s3.awsSecretAccessKey
BN1hkKD7JY4LGGNbjxmnFE0ehs12vXmP44GCKV2N


FAILED: Error in metadata:
MetaException(message:java.lang.IllegalArgumentException: AWS Access Key ID
and Secret Access Key must be specified as the username or password
(respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or
fs.s3.awsSecretAccessKey properties (respectively).)
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask

Thanks,
Kishore.


On Mon, Apr 21, 2014 at 8:17 PM, Kishore kumar wrote:

> I set the credentials from hive command line, still I am getting the
> error. please help me.
>
> hive> set fs.s3.awsAccessKeyId = x;
>  hive> set fs.s3.awsSecretAccessKey = xxx;
>
> FAILED: Error in metadata:
> MetaException(message:java.lang.IllegalArgumentException: AWS Access Key ID
> and Secret Access Key must be specified as the username or password
> (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or
> fs.s3.awsSecretAccessKey properties (respectively).)
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask
>
> Thanks,
> Kishore.
>
>
>
> On Mon, Apr 21, 2014 at 7:33 PM, Kishore kumar wrote:
>
>> Hi Experts,
>>
>> I am trying to create table against my s3 file, I faced the below issue,
>> where to set these credentials in clouderamanager4.8. I got this link (
>> http://community.cloudera.com/t5/Cloudera-Manager-Installation/AWS-Access-Key-ID-and-Secret-Access-Key-must-be-specified-as-the/td-p/495)
>> after some research but please explain me clearly after edited
>> "Cluster-wide Configuration Safety Valve for core-site.xml" how to
>> specify the values.
>>
>> -- Thanks,
>>
>>
>> *Kishore *
>>
>
>
>
> --
>
> *Kishore Kumar*
> ITIM
>
> Bidstalk - Ingenius Programmatic Platform
>
> Email: kish...@techdigita.in| Tel: +1 415 423 8230  | Cell: +91 741 135
> 8658 | skype: kishore.alajangi | YM: kk_asn2004 | Twitter: __kishorealajangi
> [image: Inline image 1]
>



-- 

*Kishore Kumar*
ITIM

Bidstalk - Ingenius Programmatic Platform

Email: kish...@techdigita.in| Tel: +1 415 423 8230  | Cell: +91 741 135
8658 | skype: kishore.alajangi | YM: kk_asn2004 | Twitter: __kishorealajangi
[image: Inline image 1]

Re: Setting s3 credentials in cloudera

2014-04-21 Thread Kishore kumar

I set the credentials from hive command line, still I am getting the error.
please help me.

hive> set fs.s3.awsAccessKeyId = x;
 hive> set fs.s3.awsSecretAccessKey = xxx;

FAILED: Error in metadata:
MetaException(message:java.lang.IllegalArgumentException: AWS Access Key ID
and Secret Access Key must be specified as the username or password
(respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or
fs.s3.awsSecretAccessKey properties (respectively).)
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask

Thanks,
Kishore.



On Mon, Apr 21, 2014 at 7:33 PM, Kishore kumar wrote:

> Hi Experts,
>
> I am trying to create table against my s3 file, I faced the below issue,
> where to set these credentials in clouderamanager4.8. I got this link (
> http://community.cloudera.com/t5/Cloudera-Manager-Installation/AWS-Access-Key-ID-and-Secret-Access-Key-must-be-specified-as-the/td-p/495)
> after some research but please explain me clearly after edited
> "Cluster-wide Configuration Safety Valve for core-site.xml" how to
> specify the values.
>
> -- Thanks,
>
>
> *Kishore *
>



-- 

*Kishore Kumar*
ITIM

Bidstalk - Ingenius Programmatic Platform

Email: kish...@techdigita.in| Tel: +1 415 423 8230  | Cell: +91 741 135
8658 | skype: kishore.alajangi | YM: kk_asn2004 | Twitter: __kishorealajangi
[image: Inline image 1]

Setting s3 credentials in cloudera

2014-04-21 Thread Kishore kumar

Hi Experts,

I am trying to create table against my s3 file, I faced the below issue,
where to set these credentials in clouderamanager4.8. I got this link (
http://community.cloudera.com/t5/Cloudera-Manager-Installation/AWS-Access-Key-ID-and-Secret-Access-Key-must-be-specified-as-the/td-p/495)
after some research but please explain me clearly after edited
"Cluster-wide Configuration Safety Valve for core-site.xml" how to specify
the values.

-- Thanks,


*Kishore *

Re: Setting s3 credentials in cloudera

Re: Setting s3 credentials in cloudera

Re: Setting s3 credentials in cloudera

Re: Setting s3 credentials in cloudera

Re: Setting s3 credentials in cloudera

Re: Setting s3 credentials in cloudera

Setting s3 credentials in cloudera

7 matches

Site Navigation

Mail list logo

Footer information