Request limit exceeded." response from ec2, get tracebacks in deltacloud log
----------------------------------------------------------------------------
Key: DTACLOUD-47
URL: https://issues.apache.org/jira/browse/DTACLOUD-47
Project: DeltaCloud
Issue Type: Bug
Components: Client (Ruby)
Environment: ec2 + aeolus
Reporter: wes hayutin
Assignee: David Lutterkort
Under heavy use, starting 15-20 instances serially its possible to get a
response back from ec2 that the "request limit has been reached". Once a load
is created, and ec2 can not handle more requests I see a lot of tracebacks in
the ec2 log.
127.0.0.1 - - [31/May/2011 20:54:32] "GET /api/instances HTTP/1.1" 500 5628
9.4191
127.0.0.1 - - [31/May/2011 20:54:32] "GET /api/instances HTTP/1.1" 200 52194
9.8775
Deltacloud::BackendError - RequestLimitExceeded: Request limit exceeded.
REQUEST=ec2.us-east-1.amazonaws.com:443/?AWSAccessKeyId=AKIAJ557V2EQ&Action=DeleteTags&ResourceId.1=i-fba01795&SignatureMethod=HmacSHA256&SignatureVersion=2&Tag.1.Key=name&Timestamp=2011-06-01T00%3A54%3A32.000Z&Version=2010-08-31&Signature=ZLFgXz2V9aIIyuV9FTHApP4vNnfo8NxFaf6OEhSCJss%3D
REQUEST ID=55502bf8-4814-41a6-933b-fb02b6a21e20 :
././lib/deltacloud/base_driver/base_driver.rb:247:in `safely'
././lib/deltacloud/base_driver/base_driver.rb:245:in `each'
././lib/deltacloud/base_driver/base_driver.rb:245:in `safely'
././lib/deltacloud/drivers/ec2/ec2_driver.rb:174:in `instances'
././lib/deltacloud/helpers/application_helper.rb:80:in `send'
././lib/deltacloud/helpers/application_helper.rb:80:in `filter_all'
/usr/lib/ruby/1.8/benchmark.rb:293:in `measure'
././lib/deltacloud/helpers/application_helper.rb:79:in `filter_all'
././server.rb:383
././lib/sinatra/rabbit.rb:104:in `instance_eval'
././lib/sinatra/rabbit.rb:104:in `GET /api/instances'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:863:in `call'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:863:in `route'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:521:in
`instance_eval'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:521:in `route_eval'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:500:in `route!'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:497:in `catch'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:497:in `route!'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:476:in `each'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:476:in `route!'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:601:in `dispatch!'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:411:in `call!'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:566:in
`instance_eval'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:566:in `invoke'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:566:in `catch'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:566:in `invoke'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:411:in `call!'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:399:in `call'
././lib/sinatra/rack_driver_select.rb:45:in `call'
././lib/sinatra/rack_matrix_params.rb:80:in `call'
././lib/sinatra/rack_runtime.rb:36:in `call'
././lib/sinatra/rack_etag.rb:42:in `call'
/usr/lib/ruby/gems/1.8/gems/rack-accept-0.4.3/lib/rack/accept/context.rb:22:in
`call'
/usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/methodoverride.rb:24:in `call'
/usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/commonlogger.rb:18:in `call'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:979:in `call'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:1005:in
`synchronize'
/usr/lib/ruby/gems/1.8/gems/sinatra-1.0/lib/sinatra/base.rb:979:in `call'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/stats.rb:24:in `call'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/stats.rb:33:in `log'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/stats.rb:24:in `call'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/connection.rb:76:in
`pre_process'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/connection.rb:74:in `catch'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/connection.rb:74:in
`pre_process'
/usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:1060:in
`call'
/usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:1060:in
`spawn_threadpool'
/usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:1057:in
`initialize'
/usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:1057:in
`new'
/usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:1057:in
`spawn_threadpool'
/usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:1049:in
`defer'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/connection.rb:54:in `process'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/connection.rb:42:in
`receive_data'
/usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in
`run_machine'
/usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in
`run'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/backends/base.rb:57:in `start'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/server.rb:156:in `start'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/controllers/controller.rb:80:in
`start'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/runner.rb:177:in `send'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/runner.rb:177:in `run_command'
/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/runner.rb:143:in `run!'
/usr/share/deltacloud-core/bin/deltacloudd:124
/usr/bin/deltacloudd:5:in `load'
/usr/bin/deltacloudd:5
127.0.0.1 - - [31/May/2011 20:54:32] "GET /api/instances HTTP/1.1" 500 5628
9.4123
127.0.0.1 - - [31/May/2011 20:54:33] "GET /api/instances HTTP/1.1" 200 52194
9.9548
Deltacloud::BackendError - RequestLimitExceeded: Request limit exceeded.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
