[
https://issues.apache.org/jira/browse/HADOOP-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15802781#comment-15802781
]
Mingliang Liu commented on HADOOP-13650:
----------------------------------------
I also commented in the parent thread, but a quick update here:
DDB table region is always the s3 bucket region for simplicity. The general
usage pattern is to specify the fs.defaultFS as s3://mybucket alike:
{code}
# we have bucket then we can infer the region; -fs is overriding the
fs.defaultFS configuration file
hadoop s3a init [-fs s3://bucket] -m dynamodb://table
{code}
And we have options if {{fs.defaultFS}} is not specified or is not S3.
{code}
# Option 1: we assume the S3 bucket name is the same as table name; and it does
exist so we can get it's location (region) as DDB region.
hadoop s3a init -m dynamodb://table
# Option 2: we rely on the endpoint for determining the DDB region. The
respective S3 bucket is not known (and can be non-existent).
hadoop s3a destroy [-D fs.s3a.s3guard.ddb.endpoint=us-west-1.amazonaws.com] -m
dynamodb://table
{code}
Does this make sense?
> S3Guard: Provide command line tools to manipulate metadata store.
> -----------------------------------------------------------------
>
> Key: HADOOP-13650
> URL: https://issues.apache.org/jira/browse/HADOOP-13650
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: HADOOP-13345
> Reporter: Lei (Eddy) Xu
> Assignee: Lei (Eddy) Xu
> Attachments: HADOOP-13650-HADOOP-13345.000.patch,
> HADOOP-13650-HADOOP-13345.001.patch, HADOOP-13650-HADOOP-13345.002.patch,
> HADOOP-13650-HADOOP-13345.003.patch
>
>
> Similar systems like EMRFS has the CLI tools to manipulate the metadata
> store, i.e., create or delete metadata store, or {{import}}, {{sync}} the
> file metadata between metadata store and S3.
> http://docs.aws.amazon.com//ElasticMapReduce/latest/ReleaseGuide/emrfs-cli-reference.html
> S3Guard should offer similar functionality.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
