[ 
https://issues.apache.org/jira/browse/HADOOP-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792010#comment-16792010
 ] 

Steve Loughran commented on HADOOP-16118:
-----------------------------------------

set capacity with no changes 
{code}
 bin/hadoop s3guard set-capacity s3a://hwdev-steve-ireland-new/
2019-03-13 18:51:24,597 [main] INFO  s3guard.S3GuardTool 
(S3GuardTool.java:initMetadataStore(318)) - Metadata store 
DynamoDBMetadataStore{region=eu-west-1, tableName=hwdev-steve-ireland-new, 
tableArn=arn:aws:dynamodb:eu-west-1:980678866538:table/hwdev-steve-ireland-new} 
is initialized.
2019-03-13 18:51:24,625 [main] INFO  s3guard.DynamoDBMetadataStore 
(DynamoDBMetadataStore.java:updateParameters(1548)) - Table capacity unchanged 
at read: 0, write: 0
Metadata Store Diagnostics:
        
ARN=arn:aws:dynamodb:eu-west-1:980678866538:table/hwdev-steve-ireland-new
        description=S3Guard metadata store in DynamoDB
        name=hwdev-steve-ireland-new
        persist.authoritative.bit=true
        read-capacity=0
        region=eu-west-1
        retryPolicy=ExponentialBackoffRetry(maxRetries=9, sleepTime=250 
MILLISECONDS)
        size=38314
        status=ACTIVE
        table={AttributeDefinitions: [{AttributeName: child,AttributeType: S}, 
{AttributeName: parent,AttributeType: S}],TableName: 
hwdev-steve-ireland-new,KeySchema: [{AttributeName: parent,KeyType: HASH}, 
{AttributeName: child,KeyType: RANGE}],TableStatus: ACTIVE,CreationDateTime: 
Thu Oct 11 18:51:14 BST 2018,ProvisionedThroughput: {LastIncreaseDateTime: Tue 
Oct 30 16:48:45 GMT 2018,LastDecreaseDateTime: Tue Oct 30 18:00:03 GMT 
2018,NumberOfDecreasesToday: 0,ReadCapacityUnits: 0,WriteCapacityUnits: 
0},TableSizeBytes: 38314,ItemCount: 248,TableArn: 
arn:aws:dynamodb:eu-west-1:980678866538:table/hwdev-steve-ireland-new,TableId: 
a7b0728a-f008-4260-b2a0-ff3dd03367d1,}
        write-capacity=0
{code}


> S3Guard to support on-demand DDB tables
> ---------------------------------------
>
>                 Key: HADOOP-16118
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16118
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.3.0
>            Reporter: Steve Loughran
>            Priority: Major
>
> AWS now supports [on demand DDB 
> capacity|https://aws.amazon.com/blogs/aws/amazon-dynamodb-on-demand-no-capacity-planning-and-pay-per-request-pricing/]
>  
> This has lowest cost and best scalability, so could be the default capacity. 
> + add a new option to set-capacity.
> Will depend on an SDK update: created HADOOP-16117.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to