On 8 February 2012 08:57, Ulrich Schwickerath <ulrich.schwicker...@cern.ch> wrote: > Hi, Ruben, > > I confirm I get the same timing when I do NOT use the SSL proxy: > > (...) > > r> <td>rack.url_scheme</td> <td class="code"><div>http</div></td> </tr> <tr> > <td>rack.version</td> <td class="code"><div>[1, 0]</div></td> </tr> <tr> > <td>sinatra.error</td> <td class="code"><div>#<NoMethodError: undefined > method `[]' for nil:NilClass></div></td> </tr> </table> <div > class="clear"></div> </div> <!-- /RACK ENV --> <p id="explanation">You're > seeing this error because you haveenabled the <code>show_exceptions</code> > setting.</p> </div> <!-- /WRAP --> </body></html> > > real 1m8.893s > user 0m0.263s > sys 0m0.051s > [lsfadmin@lxadm10 private]$ euca-describe-images > > IMAGE ami-00000023 glExecWN_slc5_x86_64_kvm lsfadmin > available private i386 machine > IMAGE ami-00000024 glExecWN_slc6_x86_64_kvm lsfadmin > available private i386 machine > [lsfadmin@lxadm10 private]$ echo $EC2_URL > http://oneadmin02.cern.ch:4567 > > I have something else which is strange: there are 2 VMs in my list which do > not have a "state" defined. I cannot delete them either: > > $ onevm list | grep -v runn > ID USER GROUP NAME STAT CPU MEM HOSTNAME > TIME > 22976 lsfadmin batch LXBATCH 0 0K lxbst0541.cern. 02 > 14:12:07 > 23467 lsfadmin batch LXBATCH 0 0K lxbst0511.cern. 00 > 04:33:07 > $ onevm delete 22976 > $ onevm delete 23467 > $ onevm list | grep -v runn > ID USER GROUP NAME STAT CPU MEM HOSTNAME > TIME > 22976 lsfadmin batch LXBATCH 0 0K lxbst0541.cern. 02 > 14:12:23 > 23467 lsfadmin batch LXBATCH 0 0K lxbst0511.cern. 00 > 04:33:23 > > Now I wonder if that might be related... I suppose I will need to > micky-mouse in my mysql ddb to get rid of those? >
Would you mind to send the output of * onevm show 22976 -x * SELECT * FROM vm_pool WHERE oid=22976; Maybe that is the root of the problem. I have just written this patch which improves the describe_instances performance, it is not thoroughly tested but if it works I will prepare a commit and will upload it to the master branch: https://gist.github.com/aee5654cbe0b44bbbd51 Cheers. > Thanks a lot for your support! > > Cheers, > Ulrich > > > > On 02/07/2012 10:50 PM, Ruben S. Montero wrote: >> >> Hi Ulrich >> >> Those in the log are not error messages but log messages. If you take >> a look they log a HTTP 200 return code (SUCCESS). process in 0.8 secs. >> >> Could you confirm the times accessing directly the econe-server... We >> believe this is a configuration issue, as we can not reproduce this. >> Please also *do not* revert the patches from Daniel >> >> Thanks >> >> Ruben >> >> On Mon, Feb 6, 2012 at 5:43 PM, Ulrich Schwickerath >> <ulrich.schwicker...@cern.ch> wrote: >>> >>> Hi, >>> >>> sure. I've changed >>> #:server: localhost >>> :server: oneadmin02.cern.ch >>> :port: 4567 >>> >>> #SSL Proxy >>> #:ssl_server: https://oneadmin02.cern.ch:8443/ >>> >>> in /etc/one/econe.conf and restarted the server. Then I changed >>> export EC2_URL=http://oneadmin02.cern.ch:4567 >>> >>> Access works: >>> $ euca-describe-images >>> IMAGE ami-00000023 glExecWN_slc5_x86_64_kvm lsfadmin >>> available private i386 machine >>> IMAGE ami-00000024 glExecWN_slc6_x86_64_kvm lsfadmin >>> available private i386 machine >>> >>> which gives >>> [root@oneadmin02 ~]# cat /var/log/one/econe-server.log >>> -------------------------------------- >>> Server configuration >>> -------------------------------------- >>> {:template_location=>"/etc/one/ec2query_templates", >>> :views=>"/usr/lib/one/ruby/cloud/econe/views", >>> :instance_types=> >>> {:"batchslc5.small"=>{:template=>"batchslc5.small.erb"}, >>> :"m1.small"=>{:template=>"m1.small.erb"}, >>> :"batchslc5.medium"=>{:template=>"batchslc5.medium.erb"}, >>> :"m1.medium"=>{:template=>"m1.medium.erb"}, >>> :"batchslc5.large"=>{:template=>"batchslc5.large.erb"}, >>> :"m1.large"=>{:template=>"m1.large.erb"}, >>> :"batchslc6.small"=>{:template=>"batchslc6.small.erb"}, >>> :"m1.xlarge"=>{:template=>"m1.xlarge.erb"}, >>> :"batchslc6.medium"=>{:template=>"batchslc6.medium.erb"}, >>> :"m1.huge"=>{:template=>"m1.huge.erb"}, >>> :"batchslc6.large"=>{:template=>"batchslc6.large.erb"}}, >>> :auth=>"ec2", >>> :one_xmlrpc=>"http://localhost:2633/RPC2", >>> :core_auth=>"cipher", >>> :server=>"oneadmin02.cern.ch", >>> :port=>4567} >>> 137.138.5.252 - - [06/Feb/2012 17:35:30] "POST / HTTP/1.1" 200 742 0.8725 >>> 137.138.5.252 - - [06/Feb/2012 17:35:30] "POST / HTTP/1.1" 200 742 0.7949 >>> >>> NoMethodError - undefined method `[]' for nil:NilClass: >>> /usr/lib/one/ruby/cloud/econe/EC2QueryServer.rb:216:in `render_state' >>> (erb):20:in `describe_instances' >>> /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:326:in `call' >>> /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:326:in `each_element' >>> >>> /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:239:in >>> `each' >>> >>> /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:238:in >>> `upto' >>> >>> /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:238:in >>> `each' >>> /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:324:in `each_element' >>> /usr/lib/one/ruby/OpenNebula/Pool.rb:100:in `each' >>> (erb):14:in `describe_instances' >>> /usr/lib/one/ruby/cloud/econe/EC2QueryServer.rb:181:in >>> `describe_instances' >>> /usr/lib/one/ruby/cloud/econe/econe-server.rb:176:in `do_http_request' >>> /usr/lib/one/ruby/cloud/econe/econe-server.rb:158:in `POST /' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1151:in >>> `call' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1151:in >>> `compile!' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:724:in >>> `instance_eval' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:724:in >>> `route_eval' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:708:in >>> `route!' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:758:in >>> `process_route' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:755:in >>> `catch' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:755:in >>> `process_route' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:707:in >>> `route!' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:706:in >>> `each' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:706:in >>> `route!' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:843:in >>> `dispatch!' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:644:in >>> `call!' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in >>> `instance_eval' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in >>> `invoke' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in >>> `catch' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in >>> `invoke' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:644:in >>> `call!' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:629:in >>> `call' >>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/head.rb:9:in `call' >>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/commonlogger.rb:18:in >>> `call' >>> >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/showexceptions.rb:21:in >>> `call' >>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/methodoverride.rb:24:in >>> `call' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1272:in >>> `call' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1303:in >>> `synchronize' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1272:in >>> `call' >>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/content_length.rb:13:in >>> `call' >>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/chunked.rb:15:in `call' >>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:84:in >>> `pre_process' >>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:82:in >>> `catch' >>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:82:in >>> `pre_process' >>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:57:in >>> `process' >>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:42:in >>> `receive_data' >>> >>> /usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in >>> `run_machine' >>> >>> /usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in >>> `run' >>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/backends/base.rb:61:in >>> `start' >>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/server.rb:159:in `start' >>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/handler/thin.rb:14:in >>> `run' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1234:in >>> `run!' >>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/main.rb:25 >>> /usr/lib/one/ruby/cloud/econe/econe-server.rb:165 >>> >>> Weird. These errors are actually new. I didn't have them right after the >>> upgrade last week when I was mentioning the long response times. >>> >>> One thing that might give a clue: I have a cron job which queries the >>> system >>> and counts the number of running VMs. If not all leases are full, >>> some new batch VMs are started. This "sometimes" seems to work, however, >>> if >>> it does not or if it takes too long to respond, there are concurrent >>> queries >>> to the system (from up to 3 different client machines). >>> >>> From the output above I don't think the SSL proxy is causing the >>> problem. >>> Could it be that one of my gems is too old or buggy ? >>> >>> Thanks for your help! >>> Ulrich >>> >>> >>> >>> >>> On 02/06/2012 04:33 PM, Ruben S. Montero wrote: >>>> >>>> Hi >>>> >>>> Could you try interacting directly with the server (i.e. without the >>>> proxy part?). We are not able to reproduce this.. The server makes a >>>> call equivalent to a onevm list and returns the output, in our >>>> installation with ~500 VMs we are seeing a 1s overhead because of the >>>> HTTP process. But the overall response time is< 2s for the EC2 >>>> interface and<1s from the CLI. >>>> >>>> Cheers >>>> >>>> Ruben >>>> >>>> On Mon, Feb 6, 2012 at 11:42 AM, Ulrich Schwickerath >>>> <ulrich.schwicker...@cern.ch> wrote: >>>>> >>>>> Hi, all, >>>>> >>>>> we are still experiencing problems after the upgrade to ONE3.2.1. The >>>>> EC2 >>>>> access is very very slow and unstable. This morning, I noticed a lot of >>>>> blocked requests to econe, and error message in the econe-server log >>>>> files: >>>>> >>>>> >>>>> NoMethodError - undefined method `[]' for nil:NilClass: >>>>> /usr/lib/one/ruby/cloud/econe/EC2QueryServer.rb:216:in `render_state' >>>>> (erb):20:in `describe_instances' >>>>> /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:326:in `call' >>>>> /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:326:in `each_element' >>>>> >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:239:in >>>>> `each' >>>>> >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:238:in >>>>> `upto' >>>>> >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:238:in >>>>> `each' >>>>> /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:324:in `each_element' >>>>> /usr/lib/one/ruby/OpenNebula/Pool.rb:100:in `each' >>>>> (erb):14:in `describe_instances' >>>>> /usr/lib/one/ruby/cloud/econe/EC2QueryServer.rb:181:in >>>>> `describe_instances' >>>>> /usr/lib/one/ruby/cloud/econe/econe-server.rb:176:in `do_http_request' >>>>> /usr/lib/one/ruby/cloud/econe/econe-server.rb:158:in `POST /' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1151:in >>>>> `call' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1151:in >>>>> `compile!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:724:in >>>>> `instance_eval' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:724:in >>>>> `route_eval' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:708:in >>>>> `route!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:758:in >>>>> `process_route' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:755:in >>>>> `catch' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:755:in >>>>> `process_route' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:707:in >>>>> `route!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:706:in >>>>> `each' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:706:in >>>>> `route!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:843:in >>>>> `dispatch!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:644:in >>>>> `call!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in >>>>> `instance_eval' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in >>>>> `invoke' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in >>>>> `catch' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in >>>>> `invoke' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:644:in >>>>> `call!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:629:in >>>>> `call' >>>>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/head.rb:9:in `call' >>>>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/commonlogger.rb:18:in >>>>> `call' >>>>> >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/showexceptions.rb:21:in >>>>> `call' >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/methodoverride.rb:24:in >>>>> `call' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1272:in >>>>> `call' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1303:in >>>>> `synchronize' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1272:in >>>>> `call' >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/content_length.rb:13:in >>>>> `call' >>>>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/chunked.rb:15:in >>>>> `call' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:84:in >>>>> `pre_process' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:82:in >>>>> `catch' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:82:in >>>>> `pre_process' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:57:in >>>>> `process' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:42:in >>>>> `receive_data' >>>>> >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in >>>>> `run_machine' >>>>> >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in >>>>> `run' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/backends/base.rb:61:in >>>>> `start' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/server.rb:159:in >>>>> `start' >>>>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/handler/thin.rb:14:in >>>>> `run' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1234:in >>>>> `run!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/main.rb:25 >>>>> /usr/lib/one/ruby/cloud/econe/econe-server.rb:165 >>>>> NoMethodError - undefined method `[]' for nil:NilClass: >>>>> /usr/lib/one/ruby/cloud/econe/EC2QueryServer.rb:216:in `render_state' >>>>> (erb):20:in `describe_instances' >>>>> /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:326:in `call' >>>>> /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:326:in `each_element' >>>>> >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:239:in >>>>> `each' >>>>> >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:238:in >>>>> `upto' >>>>> >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:238:in >>>>> `each' >>>>> /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:324:in `each_element' >>>>> /usr/lib/one/ruby/OpenNebula/Pool.rb:100:in `each' >>>>> (erb):14:in `describe_instances' >>>>> /usr/lib/one/ruby/cloud/econe/EC2QueryServer.rb:181:in >>>>> `describe_instances' >>>>> /usr/lib/one/ruby/cloud/econe/econe-server.rb:176:in `do_http_request' >>>>> /usr/lib/one/ruby/cloud/econe/econe-server.rb:158:in `POST /' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1151:in >>>>> `call' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1151:in >>>>> `compile!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:724:in >>>>> `instance_eval' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:724:in >>>>> `route_eval' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:708:in >>>>> `route!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:758:in >>>>> `process_route' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:755:in >>>>> `catch' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:755:in >>>>> `process_route' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:707:in >>>>> `route!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:706:in >>>>> `each' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:706:in >>>>> `route!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:843:in >>>>> `dispatch!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:644:in >>>>> `call!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in >>>>> `instance_eval' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in >>>>> `invoke' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in >>>>> `catch' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in >>>>> `invoke' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:644:in >>>>> `call!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:629:in >>>>> `call' >>>>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/head.rb:9:in `call' >>>>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/commonlogger.rb:18:in >>>>> `call' >>>>> >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/showexceptions.rb:21:in >>>>> `call' >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/methodoverride.rb:24:in >>>>> `call' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1272:in >>>>> `call' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1303:in >>>>> `synchronize' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1272:in >>>>> `call' >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/content_length.rb:13:in >>>>> `call' >>>>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/chunked.rb:15:in >>>>> `call' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:84:in >>>>> `pre_process' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:82:in >>>>> `catch' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:82:in >>>>> `pre_process' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:57:in >>>>> `process' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:42:in >>>>> `receive_data' >>>>> >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in >>>>> `run_machine' >>>>> >>>>> >>>>> /usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in >>>>> `run' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/backends/base.rb:61:in >>>>> `start' >>>>> /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/server.rb:159:in >>>>> `start' >>>>> /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/handler/thin.rb:14:in >>>>> `run' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1234:in >>>>> `run!' >>>>> /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/main.rb:25 >>>>> /usr/lib/one/ruby/cloud/econe/econe-server.rb:165 >>>>> >>>>> What I mean with slow is that to get a list of O(400) virtual machines >>>>> the >>>>> system needs O(5-10) minutes while local queries with onevm list take >>>>> ~2 >>>>> seconds. >>>>> >>>>> We are currently bitten badly by this problem because we use this to >>>>> refill >>>>> our virtual batch farm. Is there a downgrade path ? >>>>> >>>>> Any idea ? >>>>> >>>>> Thanks, >>>>> Ulrich >>>>> >>>>> -- >>>>> -------------------------------------- >>>>> Dr. Ulrich Schwickerath >>>>> CERN IT/PES-PS >>>>> 1211 Geneva 23 >>>>> e-mail: ulrich.schwicker...@cern.ch >>>>> phone: +41 22 767 9576 >>>>> mobile: +41 76 487 5602 >>>>> >>>>> _______________________________________________ >>>>> Users mailing list >>>>> Users@lists.opennebula.org >>>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org >>>> >>>> >>>> >>> >>> -- >>> -------------------------------------- >>> Dr. Ulrich Schwickerath >>> CERN IT/PES-PS >>> 1211 Geneva 23 >>> e-mail: ulrich.schwicker...@cern.ch >>> phone: +41 22 767 9576 >>> mobile: +41 76 487 5602 >>> >> >> > > > -- > -------------------------------------- > Dr. Ulrich Schwickerath > CERN IT/PES-PS > 1211 Geneva 23 > e-mail: ulrich.schwicker...@cern.ch > phone: +41 22 767 9576 > mobile: +41 76 487 5602 > > _______________________________________________ > Users mailing list > Users@lists.opennebula.org > http://lists.opennebula.org/listinfo.cgi/users-opennebula.org -- Daniel Molina Project Engineer OpenNebula - The Open Source Toolkit for Data Center Virtualization www.OpenNebula.org | dmol...@opennebula.org | @OpenNebula _______________________________________________ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org