2015-08-25 11:03 GMT+05:00 changmao wang <wang.chang...@gmail.com>:
> Any ideas on this issue?

Can you check credentials with another client?
s3curl, for example?

I got some bugs in s3cmd after debian upgrade, so if another client
works, than s3cmd has bug.

> On Mon, Aug 24, 2015 at 5:09 PM, changmao wang <wang.chang...@gmail.com>
> wrote:
>>
>> Please check attached file for details.
>>
>> On Mon, Aug 24, 2015 at 4:48 PM, Shunichi Shinohara <sh...@basho.com>
>> wrote:
>>>
>>> Then, back to my first questions:
>>> Could you provide results following commands with s3cfg1?
>>> - s3cmd ls
>>> - s3cmd info s3://stock
>>>
>>> From log file, gc index queries timed out again and again.
>>> Not sure but it may be subtle situation...
>>>
>>> --
>>> Shunichi Shinohara
>>> Basho Japan KK
>>>
>>>
>>> On Mon, Aug 24, 2015 at 11:03 AM, changmao wang <wang.chang...@gmail.com>
>>> wrote:
>>> > 1. root@cluster1-hd10:~# grep cs_root_host /etc/riak-cs/app.config
>>> >               {cs_root_host, "api2.cloud-datayes.com"},
>>> > root@cluster1-hd10:~# grep host_base .s3cfg
>>> > host_base = api2.cloud-datayes.com
>>> > root@cluster1-hd10:~# grep host_base s3cfg1
>>> > host_base = api2.cloud-datayes.com
>>> >
>>> > 2. please check attached file for "s3cmd -d" output and
>>> > '/etc/riak-cs/console.log'.
>>> >
>>> >
>>> > On Mon, Aug 24, 2015 at 9:54 AM, Shunichi Shinohara <sh...@basho.com>
>>> > wrote:
>>> >>
>>> >> What is "api2.cloud-datayes.com"? Your s3cfg attached at the first one
>>> >> in this email thread
>>> >> does not include it. Please make sure you provide correct / consistent
>>> >> information to
>>> >> debug the issue.
>>> >>
>>> >> - What is your riak cs config "cs_root_host"?
>>> >> - What is your host_base in s3cfg that you USE?
>>> >> - What is your host_bucket in s3cfg?
>>> >>
>>> >> Also, please attach s3cmd debug output AND riak cs console log at the
>>> >> same
>>> >> time
>>> >> interval.
>>> >> --
>>> >> Shunichi Shinohara
>>> >> Basho Japan KK
>>> >>
>>> >>
>>> >> On Mon, Aug 24, 2015 at 10:42 AM, changmao wang
>>> >> <wang.chang...@gmail.com>
>>> >> wrote:
>>> >> > I'm not sure who created it. This's a legacy production system.
>>> >> >
>>> >> > Just now, I used another "s3cfg" file to access it. Below is my
>>> >> > output:
>>> >> > root@cluster1-hd10:~# s3cmd -c s3cfg1 info
>>> >> > s3://stock/XSHE/0/000050/2008/XSHE-000050-20080102
>>> >> > s3://stock/XSHE/0/000050/2008/XSHE-000050-20080102 (object):
>>> >> >    File size: 397535
>>> >> >    Last mod:  Thu, 05 Dec 2013 03:19:00 GMT
>>> >> >    MIME type: binary/octet-stream
>>> >> >    MD5 sum:   feb2609ecfc9bb21549f2401a5c9477d
>>> >> >    ACL:       stockwrite: FULL_CONTROL
>>> >> >    ACL:       *anon*: READ
>>> >> >    URL:
>>> >> >
>>> >> > http://stock.s3.amazonaws.com/XSHE/0/000050/2008/XSHE-000050-20080102
>>> >> > root@cluster1-hd10:~# s3cmd -c s3cfg1 ls
>>> >> > s3://stock/XSHE/0/000050/2008/XSHE-000050-20080102 -d
>>> >> > DEBUG: ConfigParser: Reading file 's3cfg1'
>>> >> > DEBUG: ConfigParser: access_key->TE...17_chars...0
>>> >> > DEBUG: ConfigParser: bucket_location->US
>>> >> > DEBUG: ConfigParser: cloudfront_host->cloudfront.amazonaws.com
>>> >> > DEBUG: ConfigParser: cloudfront_resource->/2010-07-15/distribution
>>> >> > DEBUG: ConfigParser: default_mime_type->binary/octet-stream
>>> >> > DEBUG: ConfigParser: delete_removed->False
>>> >> > DEBUG: ConfigParser: dry_run->False
>>> >> > DEBUG: ConfigParser: encoding->UTF-8
>>> >> > DEBUG: ConfigParser: encrypt->False
>>> >> > DEBUG: ConfigParser: follow_symlinks->False
>>> >> > DEBUG: ConfigParser: force->False
>>> >> > DEBUG: ConfigParser: get_continue->False
>>> >> > DEBUG: ConfigParser: gpg_command->/usr/bin/gpg
>>> >> > DEBUG: ConfigParser: gpg_decrypt->%(gpg_command)s -d --verbose
>>> >> > --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o
>>> >> > %(output_file)s %(input_file)s
>>> >> > DEBUG: ConfigParser: gpg_encrypt->%(gpg_command)s -c --verbose
>>> >> > --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o
>>> >> > %(output_file)s %(input_file)s
>>> >> > DEBUG: ConfigParser: gpg_passphrase->...-3_chars...
>>> >> > DEBUG: ConfigParser: guess_mime_type->True
>>> >> > DEBUG: ConfigParser: host_base->api2.cloud-datayes.com
>>> >> > DEBUG: ConfigParser: host_bucket->%(bucket)s.api2.cloud-datayes.com
>>> >> > DEBUG: ConfigParser: human_readable_sizes->False
>>> >> > DEBUG: ConfigParser: list_md5->False
>>> >> > DEBUG: ConfigParser: log_target_prefix->
>>> >> > DEBUG: ConfigParser: preserve_attrs->True
>>> >> > DEBUG: ConfigParser: progress_meter->True
>>> >> > DEBUG: ConfigParser: proxy_host->10.21.136.81
>>> >> > DEBUG: ConfigParser: proxy_port->8080
>>> >> > DEBUG: ConfigParser: recursive->False
>>> >> > DEBUG: ConfigParser: recv_chunk->4096
>>> >> > DEBUG: ConfigParser: reduced_redundancy->False
>>> >> > DEBUG: ConfigParser: secret_key->Hk...37_chars...=
>>> >> > DEBUG: ConfigParser: send_chunk->4096
>>> >> > DEBUG: ConfigParser: simpledb_host->sdb.amazonaws.com
>>> >> > DEBUG: ConfigParser: skip_existing->False
>>> >> > DEBUG: ConfigParser: socket_timeout->100
>>> >> > DEBUG: ConfigParser: urlencoding_mode->normal
>>> >> > DEBUG: ConfigParser: use_https->False
>>> >> > DEBUG: ConfigParser: verbosity->WARNING
>>> >> > DEBUG: Updating Config.Config encoding -> UTF-8
>>> >> > DEBUG: Updating Config.Config follow_symlinks -> False
>>> >> > DEBUG: Updating Config.Config verbosity -> 10
>>> >> > DEBUG: Unicodising 'ls' using UTF-8
>>> >> > DEBUG: Unicodising
>>> >> > 's3://stock/XSHE/0/000050/2008/XSHE-000050-20080102'
>>> >> > using UTF-8
>>> >> > DEBUG: Command: ls
>>> >> > DEBUG: Bucket 's3://stock':
>>> >> > DEBUG: String 'XSHE/0/000050/2008/XSHE-000050-20080102' encoded to
>>> >> > 'XSHE/0/000050/2008/XSHE-000050-20080102'
>>> >> > DEBUG: SignHeaders: 'GET\n\n\n\nx-amz-date:Mon, 24 Aug 2015 01:36:01
>>> >> > +0000\n/stock/'
>>> >> > DEBUG: CreateRequest: resource[uri]=/
>>> >> > DEBUG: SignHeaders: 'GET\n\n\n\nx-amz-date:Mon, 24 Aug 2015 01:36:01
>>> >> > +0000\n/stock/'
>>> >> > DEBUG: Processing request, please wait...
>>> >> > DEBUG: get_hostname(stock): stock.api2.cloud-datayes.com
>>> >> > DEBUG: format_uri():
>>> >> >
>>> >> >
>>> >> > http://stock.api2.cloud-datayes.com/?prefix=XSHE/0/000050/2008/XSHE-000050-20080102&delimiter=/
>>> >> > WARNING: Retrying failed request:
>>> >> > /?prefix=XSHE/0/000050/2008/XSHE-000050-20080102&delimiter=/ ('')
>>> >> > WARNING: Waiting 3 sec...
>>> >> > DEBUG: SignHeaders: 'GET\n\n\n\nx-amz-date:Mon, 24 Aug 2015 01:37:05
>>> >> > +0000\n/stock/'
>>> >> > DEBUG: Processing request, please wait...
>>> >> > DEBUG: get_hostname(stock): stock.api2.cloud-datayes.com
>>> >> > DEBUG: format_uri():
>>> >> >
>>> >> >
>>> >> > http://stock.api2.cloud-datayes.com/?prefix=XSHE/0/000050/2008/XSHE-000050-20080102&delimiter=/
>>> >> > WARNING: Retrying failed request:
>>> >> > /?prefix=XSHE/0/000050/2008/XSHE-000050-20080102&delimiter=/ ('')
>>> >> > WARNING: Waiting 6 sec...
>>> >> > ....
>>> >> >
>>> >> >
>>> >> >
>>> >> > On Mon, Aug 24, 2015 at 9:17 AM, Shunichi Shinohara
>>> >> > <sh...@basho.com>
>>> >> > wrote:
>>> >> >>
>>> >> >> The result of "s3cmd ls" (aka, GET Service API) indicates there
>>> >> >> is no bucket with name "stock":
>>> >> >>
>>> >> >> > root@cluster-s3-hd1:~# s3cmd ls
>>> >> >> > 2013-12-01 06:45  s3://test
>>> >> >>
>>> >> >> Have you created it?
>>> >> >>
>>> >> >> --
>>> >> >> Shunichi Shinohara
>>> >> >> Basho Japan KK
>>> >> >>
>>> >> >>
>>> >> >> On Mon, Aug 24, 2015 at 10:14 AM, changmao wang
>>> >> >> <wang.chang...@gmail.com>
>>> >> >> wrote:
>>> >> >> > Shunichi,
>>> >> >> >
>>> >> >> > Thanks for your reply. Below is my command result:
>>> >> >> > root@cluster-s3-hd1:~# s3cmd ls
>>> >> >> > 2013-12-01 06:45  s3://test
>>> >> >> > root@cluster-s3-hd1:~# s3cmd info s3://stock
>>> >> >> > ERROR: Access to bucket 'stock' was denied
>>> >> >> > root@cluster-s3-hd1:~# s3cmd info s3://stock -d
>>> >> >> > DEBUG: ConfigParser: Reading file '/root/.s3cfg'
>>> >> >> > DEBUG: ConfigParser: access_key->M2...17_chars...K
>>> >> >> > DEBUG: ConfigParser: bucket_location->US
>>> >> >> > DEBUG: ConfigParser: cloudfront_host->cloudfront.amazonaws.com
>>> >> >> > DEBUG: ConfigParser:
>>> >> >> > cloudfront_resource->/2010-07-15/distribution
>>> >> >> > DEBUG: ConfigParser: default_mime_type->binary/octet-stream
>>> >> >> > DEBUG: ConfigParser: delete_removed->False
>>> >> >> > DEBUG: ConfigParser: dry_run->False
>>> >> >> > DEBUG: ConfigParser: encoding->UTF-8
>>> >> >> > DEBUG: ConfigParser: encrypt->False
>>> >> >> > DEBUG: ConfigParser: follow_symlinks->False
>>> >> >> > DEBUG: ConfigParser: force->False
>>> >> >> > DEBUG: ConfigParser: get_continue->False
>>> >> >> > DEBUG: ConfigParser: gpg_command->/usr/bin/gpg
>>> >> >> > DEBUG: ConfigParser: gpg_decrypt->%(gpg_command)s -d --verbose
>>> >> >> > --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o
>>> >> >> > %(output_file)s %(input_file)s
>>> >> >> > DEBUG: ConfigParser: gpg_encrypt->%(gpg_command)s -c --verbose
>>> >> >> > --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o
>>> >> >> > %(output_file)s %(input_file)s
>>> >> >> > DEBUG: ConfigParser: gpg_passphrase->...-3_chars...
>>> >> >> > DEBUG: ConfigParser: guess_mime_type->True
>>> >> >> > DEBUG: ConfigParser: host_base->api2.cloud-datayes.com
>>> >> >> > DEBUG: ConfigParser:
>>> >> >> > host_bucket->%(bucket)s.api2.cloud-datayes.com
>>> >> >> > DEBUG: ConfigParser: human_readable_sizes->False
>>> >> >> > DEBUG: ConfigParser: list_md5->False
>>> >> >> > DEBUG: ConfigParser: log_target_prefix->
>>> >> >> > DEBUG: ConfigParser: preserve_attrs->True
>>> >> >> > DEBUG: ConfigParser: progress_meter->True
>>> >> >> > DEBUG: ConfigParser: proxy_host->10.21.136.81
>>> >> >> > DEBUG: ConfigParser: proxy_port->8080
>>> >> >> > DEBUG: ConfigParser: recursive->False
>>> >> >> > DEBUG: ConfigParser: recv_chunk->4096
>>> >> >> > DEBUG: ConfigParser: reduced_redundancy->False
>>> >> >> > DEBUG: ConfigParser: secret_key->1u...37_chars...=
>>> >> >> > DEBUG: ConfigParser: send_chunk->4096
>>> >> >> > DEBUG: ConfigParser: simpledb_host->sdb.amazonaws.com
>>> >> >> > DEBUG: ConfigParser: skip_existing->False
>>> >> >> > DEBUG: ConfigParser: socket_timeout->10
>>> >> >> > DEBUG: ConfigParser: urlencoding_mode->normal
>>> >> >> > DEBUG: ConfigParser: use_https->False
>>> >> >> > DEBUG: ConfigParser: verbosity->WARNING
>>> >> >> > DEBUG: Updating Config.Config encoding -> UTF-8
>>> >> >> > DEBUG: Updating Config.Config follow_symlinks -> False
>>> >> >> > DEBUG: Updating Config.Config verbosity -> 10
>>> >> >> > DEBUG: Unicodising 'info' using UTF-8
>>> >> >> > DEBUG: Unicodising 's3://stock' using UTF-8
>>> >> >> > DEBUG: Command: info
>>> >> >> > DEBUG: SignHeaders: 'GET\n\n\n\nx-amz-date:Mon, 24 Aug 2015
>>> >> >> > 01:11:09
>>> >> >> > +0000\n/stock/?location'
>>> >> >> > DEBUG: CreateRequest: resource[uri]=/?location
>>> >> >> > DEBUG: SignHeaders: 'GET\n\n\n\nx-amz-date:Mon, 24 Aug 2015
>>> >> >> > 01:11:09
>>> >> >> > +0000\n/stock/?location'
>>> >> >> > DEBUG: Processing request, please wait...
>>> >> >> > DEBUG: get_hostname(stock): stock.api2.cloud-datayes.com
>>> >> >> > DEBUG: format_uri():
>>> >> >> > http://stock.api2.cloud-datayes.com/?location
>>> >> >> > DEBUG: Response: {'status': 403, 'headers': {'date': 'Mon, 24 Aug
>>> >> >> > 2015
>>> >> >> > 01:11:09 GMT', 'content-length': '160', 'content-type':
>>> >> >> > 'application/xml',
>>> >> >> > 'server': 'Riak CS'}, 'reason': 'Forbidden', 'data': '<?xml
>>> >> >> > version="1.0"
>>> >> >> > encoding="UTF-8"?><Error><Code>AccessDenied</Code><Message>Access
>>> >> >> >
>>> >> >> >
>>> >> >> >
>>> >> >> > Denied</Message><Resource>/stock</Resource><RequestId></RequestId></Error>'}
>>> >> >> > DEBUG: S3Error: 403 (Forbidden)
>>> >> >> > DEBUG: HttpHeader: date: Mon, 24 Aug 2015 01:11:09 GMT
>>> >> >> > DEBUG: HttpHeader: content-length: 160
>>> >> >> > DEBUG: HttpHeader: content-type: application/xml
>>> >> >> > DEBUG: HttpHeader: server: Riak CS
>>> >> >> > DEBUG: ErrorXML: Code: 'AccessDenied'
>>> >> >> > DEBUG: ErrorXML: Message: 'Access Denied'
>>> >> >> > DEBUG: ErrorXML: Resource: '/stock'
>>> >> >> > DEBUG: ErrorXML: RequestId: None
>>> >> >> > ERROR: Access to bucket 'stock' was denied
>>> >> >> >
>>> >> >> > On Mon, Aug 24, 2015 at 9:04 AM, Shunichi Shinohara
>>> >> >> > <sh...@basho.com>
>>> >> >> > wrote:
>>> >> >> >>
>>> >> >> >> The error message in console.log shows no user with access_key
>>> >> >> >> in
>>> >> >> >> your
>>> >> >> >> s3cfg.
>>> >> >> >> Could you provide resutls following commands?
>>> >> >> >>
>>> >> >> >> - s3cmd ls
>>> >> >> >> - s3cmd info s3://stock
>>> >> >> >>
>>> >> >> >> If error happens, debug print switch "-d" of s3cmd might help.
>>> >> >> >>
>>> >> >> >> [1]
>>> >> >> >>
>>> >> >> >>
>>> >> >> >>
>>> >> >> >> http://docs.basho.com/riakcs/latest/cookbooks/Account-Management/#Creating-a-User-Account
>>> >> >> >>
>>> >> >> >> --
>>> >> >> >> Shunichi Shinohara
>>> >> >> >> Basho Japan KK
>>> >> >> >>
>>> >> >> >>
>>> >> >> >> On Fri, Aug 21, 2015 at 10:00 AM, changmao wang
>>> >> >> >> <wang.chang...@gmail.com>
>>> >> >> >> wrote:
>>> >> >> >> > Kazuhiro,
>>> >> >> >> >
>>> >> >> >> > Maybe that's not the key point. I'm using riak 1.4.2 and
>>> >> >> >> > follow
>>> >> >> >> > below
>>> >> >> >> > docs
>>> >> >> >> > to configure "s3cfg" file.
>>> >> >> >> >
>>> >> >> >> >
>>> >> >> >> >
>>> >> >> >> >
>>> >> >> >> > http://docs.basho.com/riakcs/1.4.2/cookbooks/configuration/Configuring-an-S3-Client/#Sample-s3cmd-Configuration-File-for-Production-Use
>>> >> >> >> >
>>> >> >> >> > There's no "signature_v2" parameter in "s3cfg". However, I
>>> >> >> >> > added
>>> >> >> >> > this
>>> >> >> >> > parameter to "s3cfg" and tried again with same errors.
>>> >> >> >> >
>>> >> >> >> >
>>> >> >> >> >
>>> >> >> >> >
>>> >> >> >> > On Thu, Aug 20, 2015 at 10:31 PM, Kazuhiro Suzuki
>>> >> >> >> > <k...@basho.com>
>>> >> >> >> > wrote:
>>> >> >> >> >>
>>> >> >> >> >> Hi Changmao,
>>> >> >> >> >>
>>> >> >> >> >> It seems your s3cmd config should include 2 items:
>>> >> >> >> >>
>>> >> >> >> >> signature_v2 = True
>>> >> >> >> >> host_base  = api2.cloud-datayes.com
>>> >> >> >> >>
>>> >> >> >> >> Riak CS requires "signature_v2 = True" since Riak CS has not
>>> >> >> >> >> supported
>>> >> >> >> >> s3 authentication version 4 yet.
>>> >> >> >> >> You can find a sample configuration of s3cmd here to interact
>>> >> >> >> >> with
>>> >> >> >> >> Riak
>>> >> >> >> >> CS
>>> >> >> >> >> [1].
>>> >> >> >> >>
>>> >> >> >> >> [1]:
>>> >> >> >> >>
>>> >> >> >> >>
>>> >> >> >> >>
>>> >> >> >> >>
>>> >> >> >> >> http://docs.basho.com/riakcs/2.0.1/cookbooks/configuration/Configuring-an-S3-Client/#Sample-s3cmd-Configuration-File-for-Production-Use
>>> >> >> >> >>
>>> >> >> >> >> Thanks,
>>> >> >> >> >>
>>> >> >> >> >> On Thu, Aug 20, 2015 at 7:44 PM, changmao wang
>>> >> >> >> >> <wang.chang...@gmail.com>
>>> >> >> >> >> wrote:
>>> >> >> >> >> > Just now, I used "admin_key" and "admin_secret" from
>>> >> >> >> >> > /etc/riak-cs/app.config
>>> >> >> >> >> > to run "s3cmd -c s3-stock ls  s3://stock/XSHE/0/000600"
>>> >> >> >> >> > and I got the below error:
>>> >> >> >> >> > ERROR: Access to bucket 'stock' was denied
>>> >> >> >> >> >
>>> >> >> >> >> > Below is abstract from "/var/log/riak-cs/console.log"
>>> >> >> >> >> > 2015-08-20 18:40:22.790 [debug]
>>> >> >> >> >> > <0.28085.18>@riak_cs_s3_auth:calculate_signature:129 STS:
>>> >> >> >> >> > ["GET","\n",[],"\n",[],"\n","\n",[["x-amz-date",":",<<"Thu,
>>> >> >> >> >> > 20
>>> >> >> >> >> > Aug
>>> >> >> >> >> > 2015
>>> >> >> >> >> > 10:40:22 +0000">>,"\n"]],["/stock/",[]]]
>>> >> >> >> >> > 2015-08-20 18:40:32.861 [error]
>>> >> >> >> >> > <0.28153.18>@riak_cs_wm_common:maybe_create_user:223
>>> >> >> >> >> > Retrieval
>>> >> >> >> >> > of
>>> >> >> >> >> > user
>>> >> >> >> >> > record for s3 failed. Reason: no_user_key
>>> >> >> >> >> > 2015-08-20 18:40:32.861 [debug]
>>> >> >> >> >> > <0.28153.18>@riak_cs_wm_common:post_authentication:452 No
>>> >> >> >> >> > user
>>> >> >> >> >> > key
>>> >> >> >> >> > 2015-08-20 18:40:32.969 [debug]
>>> >> >> >> >> > <0.28189.18>@riak_cs_get_fsm:prepare:406
>>> >> >> >> >> > Manifest:
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> > {lfs_manifest_v3,3,1048576,{<<"pipeline">>,<<100,97,116,97,121,101,115,47,112,105,112,101,108,105,110,101,47,100,97,116,97,47,114,101,112,111,114,116,47,115,122,47,83,90,48,48,50,49,55,53,67,78,47,50,48,49,48,95,50,48,49,48,45,48,52,45,50,52,95,229,133,172,229,143,184,231,171,160,231,168,139,239,188,136,50,48,49,48,229,185,180,52,230,156,136,239,188,137,46,80,68,70>>},[],"2013-12-16T23:01:12.000Z",<<192,71,150,153,181,181,77,61,186,41,100,32,5,91,197,166>>,255387,<<"application/pdf">>,<<55,41,141,170,187,226,47,223,183,95,105,129,155,154,210,202>>,active,{1387,234872,598819},{1387,234872,918555},[],undefined,undefined,undefined,undefined,{acl_v2,{"pipelinewrite","ef38ca69e145a40c1f8378633994192dace4539339315e6b42d7d1e6e2d2de51","AVG2DHZ4UNUYFAZ8F4WR"},[{{"pipelinewrite","ef38ca69e145a40c1f8378633994192dace4539339315e6b42d7d1e6e2d2de51"},['FULL_CONTROL']},{'AllUsers',['READ']}],{1387,234872,598546}},[],undefined}
>>> >> >> >> >> > 2015-08-20 18:40:33.043 [debug]
>>> >> >> >> >> > <0.28189.18>@riak_cs_lfs_utils:range_blocks:118
>>> >> >> >> >> > InitialBlock:
>>> >> >> >> >> > 0,
>>> >> >> >> >> > FinalBlock:
>>> >> >> >> >> > 0
>>> >> >> >> >> > 2015-08-20 18:40:33.043 [debug]
>>> >> >> >> >> > <0.28189.18>@riak_cs_lfs_utils:range_blocks:120
>>> >> >> >> >> > SkipInitial: 0,
>>> >> >> >> >> > KeepFinal:
>>> >> >> >> >> > 255387
>>> >> >> >> >> > 2015-08-20 18:40:33.050 [debug]
>>> >> >> >> >> > <0.28189.18>@riak_cs_get_fsm:waiting_continue_or_stop:229
>>> >> >> >> >> > Block
>>> >> >> >> >> > Servers:
>>> >> >> >> >> > [<0.28191.18>]
>>> >> >> >> >> > 2015-08-20 18:40:33.079 [debug]
>>> >> >> >> >> > <0.28189.18>@riak_cs_get_fsm:waiting_chunks:307 Retrieved
>>> >> >> >> >> > block
>>> >> >> >> >> >
>>> >> >> >> >> > {<<192,71,150,153,181,181,77,61,186,41,100,32,5,91,197,166>>,0}
>>> >> >> >> >> > 2015-08-20 18:40:33.079 [debug]
>>> >> >> >> >> > <0.28189.18>@riak_cs_get_fsm:perhaps_send_to_user:280
>>> >> >> >> >> > Returning
>>> >> >> >> >> > block
>>> >> >> >> >> >
>>> >> >> >> >> > {<<192,71,150,153,181,181,77,61,186,41,100,32,5,91,197,166>>,0}
>>> >> >> >> >> > to
>>> >> >> >> >> > client
>>> >> >> >> >> > 2015-08-20 18:40:38.218 [error]
>>> >> >> >> >> > <0.28086.18>@riak_cs_wm_common:maybe_create_user:223
>>> >> >> >> >> > Retrieval
>>> >> >> >> >> > of
>>> >> >> >> >> > user
>>> >> >> >> >> > record for s3 failed. Reason: no_user_key
>>> >> >> >> >> > 2015-08-20 18:40:38.218 [debug]
>>> >> >> >> >> > <0.28086.18>@riak_cs_wm_common:post_authentication:452 No
>>> >> >> >> >> > user
>>> >> >> >> >> > key
>>> >> >> >> >> > 2015-08-20 18:40:38.226 [debug]
>>> >> >> >> >> > <0.28210.18>@riak_cs_get_fsm:prepare:406
>>> >> >> >> >> > Manifest:
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> > {lfs_manifest_v3,3,1048576,{<<"pipeline">>,<<100,97,116,97,121,101,115,47,112,105,112,101,108,105,110,101,47,100,97,116,97,47,114,101,112,111,114,116,47,115,104,47,83,72,54,48,48,55,53,48,67,78,47,50,48,48,55,95,50,48,48,55,45,49,49,45,50,49,95,230,177,159,228,184,173,232,141,175,228,184,154,229,133,179,228,186,142,73,66,69,95,53,232,141,175,229,147,129,232,142,183,229,190,151,228,186,140,230,156,159,228,184,180,229,186,138,230,137,185,230,150,135,231,154,132,229,133,172,229,145,138,229,143,138,233,163,142,233,153,169,230,143,144,231,164,186,46,112,100,102>>},[],"2013-12-15T09:04:48.000Z",<<201,247,249,158,95,22,64,242,161,118,253,64,120,187,205,105>>,89863,<<"application/pdf">>,<<139,151,203,173,6,111,222,48,17,81,102,170,216,66,193,77>>,active,{1387,98288,545827},{1387,98288,618409},[],undefined,undefined,undefined,undefined,{acl_v2,{"pipelinewrite","ef38ca69e145a40c1f8378633994192dace4539339315e6b42d7d1e6e2d2de51","AVG2DHZ4UNUYFAZ8F4WR"},[{{"pipelinewrite","ef38c
 
a69e145a40c1f8378633994192dace4539339315e6b42d7d1e6e2d2de51"},['FULL_CONTROL']},{'AllUsers',['READ']}],{1387,98288,545618}},[],undefined}
>>> >> >> >> >> > 2015-08-20 18:40:38.280 [debug]
>>> >> >> >> >> > <0.28210.18>@riak_cs_lfs_utils:range_blocks:118
>>> >> >> >> >> > InitialBlock:
>>> >> >> >> >> > 0,
>>> >> >> >> >> > FinalBlock:
>>> >> >> >> >> > 0
>>> >> >> >> >> > 2015-08-20 18:40:38.280 [debug]
>>> >> >> >> >> > <0.28210.18>@riak_cs_lfs_utils:range_blocks:120
>>> >> >> >> >> > SkipInitial: 0,
>>> >> >> >> >> > KeepFinal:
>>> >> >> >> >> > 89863
>>> >> >> >> >> > 2015-08-20 18:40:38.280 [debug]
>>> >> >> >> >> > <0.28210.18>@riak_cs_get_fsm:waiting_continue_or_stop:229
>>> >> >> >> >> > Block
>>> >> >> >> >> > Servers:
>>> >> >> >> >> > [<0.28212.18>]
>>> >> >> >> >> > 2015-08-20 18:40:38.343 [debug]
>>> >> >> >> >> > <0.28210.18>@riak_cs_get_fsm:waiting_chunks:307 Retrieved
>>> >> >> >> >> > block
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> > {<<201,247,249,158,95,22,64,242,161,118,253,64,120,187,205,105>>,0}
>>> >> >> >> >> > 2015-08-20 18:40:38.344 [debug]
>>> >> >> >> >> > <0.28210.18>@riak_cs_get_fsm:perhaps_send_to_user:280
>>> >> >> >> >> > Returning
>>> >> >> >> >> > block
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> > {<<201,247,249,158,95,22,64,242,161,118,253,64,120,187,205,105>>,0}
>>> >> >> >> >> > to
>>> >> >> >> >> > client
>>> >> >> >> >> >
>>> >> >> >> >> > On Thu, Aug 20, 2015 at 6:04 PM, Stanislav Vlasov
>>> >> >> >> >> > <stanislav....@gmail.com>
>>> >> >> >> >> > wrote:
>>> >> >> >> >> >>
>>> >> >> >> >> >> 2015-08-20 14:47 GMT+05:00 changmao wang
>>> >> >> >> >> >> <wang.chang...@gmail.com>:
>>> >> >> >> >> >>
>>> >> >> >> >> >> > what's your meaning of domain name of
>>> >> >> >> >> >> > /etc/riak-cs/app.config
>>> >> >> >> >> >> > and
>>> >> >> >> >> >> > ~/.s3cfg?
>>> >> >> >> >> >> > I guess it's cs_root_host parameter from
>>> >> >> >> >> >> > /etc/riak-cs/app.config
>>> >> >> >> >> >> > and
>>> >> >> >> >> >> > host_base from '~/.s3cfg'.
>>> >> >> >> >> >> > If so, there're same as "api2.cloud-datayes.com".
>>> >> >> >> >> >>
>>> >> >> >> >> >> Yes, is that i mean, but i see, it is not your case
>>> >> >> >> >> >> Try to set {level, debug} in lager_file_backend section
>>> >> >> >> >> >> for
>>> >> >> >> >> >> console.log.
>>> >> >> >> >> >>
>>> >> >> >> >> >> > However, I can not ping this host from localhost.
>>> >> >> >> >> >>
>>> >> >> >> >> >> It's ok, if you write proper proxy_host and proxy_port in
>>> >> >> >> >> >> .s3cfg
>>> >> >> >> >> >>
>>> >> >> >> >> >> > On Thu, Aug 20, 2015 at 5:23 PM, Stanislav Vlasov
>>> >> >> >> >> >> > <stanislav....@gmail.com>
>>> >> >> >> >> >> > wrote:
>>> >> >> >> >> >> >>
>>> >> >> >> >> >> >> 2015-08-20 13:57 GMT+05:00 changmao wang
>>> >> >> >> >> >> >> <wang.chang...@gmail.com>:
>>> >> >> >> >> >> >> > somebody watching on this?
>>> >> >> >> >> >> >>
>>> >> >> >> >> >> >> Do you set up same domain in riak-cs.conf and in
>>> >> >> >> >> >> >> .s3cfg?
>>> >> >> >> >> >> >> I got such error in this case.
>>> >> >> >> >> >> >>
>>> >> >> >> >> >> >> > On Wed, Aug 19, 2015 at 9:01 AM, changmao wang
>>> >> >> >> >> >> >> > <wang.chang...@gmail.com>
>>> >> >> >> >> >> >> > wrote:
>>> >> >> >> >> >> >> >>
>>> >> >> >> >> >> >> >> Matthew,
>>> >> >> >> >> >> >> >>
>>> >> >> >> >> >> >> >> I used s3cmd --configure to generate ".s3cfg" config
>>> >> >> >> >> >> >> >> file
>>> >> >> >> >> >> >> >> and
>>> >> >> >> >> >> >> >> then
>>> >> >> >> >> >> >> >> access
>>> >> >> >> >> >> >> >> RIAK service by s3cmd.
>>> >> >> >> >> >> >> >> The access_key and secret_key from ".s3cfg" is same
>>> >> >> >> >> >> >> >> as
>>> >> >> >> >> >> >> >> admin_key
>>> >> >> >> >> >> >> >> and
>>> >> >> >> >> >> >> >> admin_secret from "/etc/riak-cs/app.config".
>>> >> >> >> >> >> >> >>
>>> >> >> >> >> >> >> >> However, I got error as below using s3cmd to access
>>> >> >> >> >> >> >> >> one
>>> >> >> >> >> >> >> >> bucket.
>>> >> >> >> >> >> >> >>
>>> >> >> >> >> >> >> >> root@cluster-s3-hd1:~# s3cmd -c /root/.s3cfg ls
>>> >> >> >> >> >> >> >> s3://pipeline/article/111.pdf
>>> >> >> >> >> >> >> >> ERROR: Access to bucket 'pipeline' was denied
>>> >> >> >> >> >> >> >>
>>> >> >> >> >> >> >> >> By the way, I used Riak and Riak-CS 1.4.2 on Ubuntu.
>>> >> >> >> >> >> >> >> Current
>>> >> >> >> >> >> >> >> production
>>> >> >> >> >> >> >> >> cluster is a legacy system without documents for
>>> >> >> >> >> >> >> >> co-workers.
>>> >> >> >> >> >> >> >>
>>> >> >> >> >> >> >> >> Attached file is "s3cfg" generated by "s3cmd
>>> >> >> >> >> >> >> >> --configure".
>>> >> >> >> >> >> >> >> --
>>> >> >> >> >> >> >> >> Amao Wang
>>> >> >> >> >> >> >> >> Best & Regards
>>> >> >> >> >> >> >> >
>>> >> >> >> >> >> >> >
>>> >> >> >> >> >> >> >
>>> >> >> >> >> >> >> >
>>> >> >> >> >> >> >> > --
>>> >> >> >> >> >> >> > Amao Wang
>>> >> >> >> >> >> >> > Best & Regards
>>> >> >> >> >> >> >> >
>>> >> >> >> >> >> >> > _______________________________________________
>>> >> >> >> >> >> >> > riak-users mailing list
>>> >> >> >> >> >> >> > riak-users@lists.basho.com
>>> >> >> >> >> >> >> >
>>> >> >> >> >> >> >> >
>>> >> >> >> >> >> >> >
>>> >> >> >> >> >> >> >
>>> >> >> >> >> >> >> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>> >> >> >> >> >> >> >
>>> >> >> >> >> >> >>
>>> >> >> >> >> >> >>
>>> >> >> >> >> >> >>
>>> >> >> >> >> >> >> --
>>> >> >> >> >> >> >> Stanislav
>>> >> >> >> >> >> >
>>> >> >> >> >> >> >
>>> >> >> >> >> >> >
>>> >> >> >> >> >> >
>>> >> >> >> >> >> > --
>>> >> >> >> >> >> > Amao Wang
>>> >> >> >> >> >> > Best & Regards
>>> >> >> >> >> >>
>>> >> >> >> >> >>
>>> >> >> >> >> >>
>>> >> >> >> >> >> --
>>> >> >> >> >> >> Stanislav
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> > --
>>> >> >> >> >> > Amao Wang
>>> >> >> >> >> > Best & Regards
>>> >> >> >> >> >
>>> >> >> >> >> > _______________________________________________
>>> >> >> >> >> > riak-users mailing list
>>> >> >> >> >> > riak-users@lists.basho.com
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>> >> >> >> >> >
>>> >> >> >> >>
>>> >> >> >> >>
>>> >> >> >> >>
>>> >> >> >> >> --
>>> >> >> >> >> Kazuhiro Suzuki | Basho Japan KK
>>> >> >> >> >
>>> >> >> >> >
>>> >> >> >> >
>>> >> >> >> >
>>> >> >> >> > --
>>> >> >> >> > Amao Wang
>>> >> >> >> > Best & Regards
>>> >> >> >> >
>>> >> >> >> > _______________________________________________
>>> >> >> >> > riak-users mailing list
>>> >> >> >> > riak-users@lists.basho.com
>>> >> >> >> >
>>> >> >> >> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>> >> >> >> >
>>> >> >> >
>>> >> >> >
>>> >> >> >
>>> >> >> >
>>> >> >> > --
>>> >> >> > Amao Wang
>>> >> >> > Best & Regards
>>> >> >
>>> >> >
>>> >> >
>>> >> >
>>> >> > --
>>> >> > Amao Wang
>>> >> > Best & Regards
>>> >
>>> >
>>> >
>>> >
>>> > --
>>> > Amao Wang
>>> > Best & Regards
>>
>>
>>
>>
>> --
>> Amao Wang
>> Best & Regards
>
>
>
>
> --
> Amao Wang
> Best & Regards
>
> _______________________________________________
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>



-- 
Stanislav

_______________________________________________
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Reply via email to