[DISCUSS] Let's fix CloudStack Upgrades and DB migrations with CloudStack Chimp

2015-08-27 Thread Rohit Yadav
Hi all,

Some of us have discussed in the past on fixing CloudStack’s upgrade and DB 
migration, I’m trying to explore if we can really fix this. Please review, 
advise changes, add suggestions along with your upgrade experience so we can 
improve this in near future starting with ACS 4.7 or above:

http://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Chimp
(note: this wiki will keep changing depending on the discussions and feedback)

Regards,
Rohit Yadav
Software Architect, ShapeBlue


[cid:9DD97B41-04C5-45F0-92A7-951F3E962F7A]


M. +91 88 262 30892 | 
rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab




Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build
CSForge – rapid IaaS deployment framework
CloudStack Consulting
CloudStack Software 
Engineering
CloudStack Infrastructure 
Support
CloudStack Bootcamp Training Courses

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.


Re: How does the parameter startdate/enddate of api listEvents() use new time format like 'yyyy-MM-dd HH:mm:ss' ?

2015-08-27 Thread Abhinandan Prateek
apikey/signature should work and they have same privileges as the respective 
user logged in.
Are all the api calls failing or just some ?
Can you share relevant portion of the scripts that you are trying to run ?

> On 28-Aug-2015, at 11:31 am, tony_caot...@163.com wrote:
>
>
> Thanks for all your people's replys.
>
> 1.  Abhinandan,  My ACS manager was not listening on port '8096',
>
> 2.  As Yipeng said, When I call this api from cloudmonkey, it works fine, 
> like this
>" cloudmonkey api listEvents listall=true startdate='2015-08-28 00:00:00' "
>
>When I call it through my python scripts, I used the apikey/signature pair 
> to work,  but it failed.
>I found that how cloudmonkey works,
>first it login with username/password, then call the function with this 
> session id.
>
> it seems that the apikey/signature pair's privilege is not same with 
> username/password pair's ?
>
>
> @Daan, yes I am a Chinese. I am afraid it's not a preblem about character 
> encodings perhaps.
>
>
> ---
> Cao Tong
>
> On 08/27/2015 08:54 PM, Abhinandan Prateek wrote:
>> Try using the “8096” port for testing/checking APIs.
>>
>> shapeblue.com> wrote:
>>> Yes, as per  
>>> https://cloudstack.apache.org/api/apidocs-4.2/root_admin/listEvents.html
>>>
>>>
 On 24-Aug-2015, at 2:08 pm, tony_caot...@163.com wrote:

 Hello Every.

 I know this is a very simple question to most of you. but it is really 
 hard for me to continue my work.

 So could Anyone spend your three minutes to give me some advice, it will 
 be very usefull to me.

 my question is:

   How does the parameter startdate/enddate of api listEvents() use new 
 time format  like '-MM-dd HH:mm:ss' ?


>>> Event({'listall':'True', 'startdate':'2015-08-24 00:00:00'})
 http://10.0.1.100:8080/client/api?apiKey=hjZ12EQ4JfFasIHO3RCXBLji-3RbBmdC973utGwCL5388WypVKwtaNsDso-JzVQIZXUVwfaT1vANdDUJs3Vkkg&command=listEvents&listall=True&response=json&startdate=2015-08-24+00%3A00%3A00&signature=z4LQCw7yzGmTK5B7TzAbzl1biXI%3D
 Traceback (most recent call last):
 File "", line 1, in 
 File "SignedAPICall.py", line 67, in Event
   a = api.listEvents(request)
 File "SignedAPICall.py", line 49, in handlerFunction
   return self._make_request(name, args[0])
 File "SignedAPICall.py", line 61, in _make_request
   data = self._http_get(self.value)
 File "SignedAPICall.py", line 54, in _http_get
   response = urllib.urlopen(url)
 File "/usr/lib64/python2.7/urllib.py", line 87, in urlopen
   return opener.open(url)
 File "/usr/lib64/python2.7/urllib.py", line 208, in open
   return getattr(self, name)(url)
 File "/usr/lib64/python2.7/urllib.py", line 359, in open_http
   return self.http_error(url, fp, errcode, errmsg, headers)
 File "/usr/lib64/python2.7/urllib.py", line 372, in http_error
   result = method(url, fp, errcode, errmsg, headers)
 File "/usr/lib64/python2.7/urllib.py", line 683, in http_error_401
   errcode, errmsg, headers)
 File "/usr/lib64/python2.7/urllib.py", line 381, in http_error_default
   raise IOError, ('http error', errcode, errmsg, headers)
 IOError: ('http error', 401, 'Unauthorized', >>> at 0x7f083da78998>)

 ---
 Cao Tong

 On 08/19/2015 10:32 AM, tony_caot...@163.com wrote:
> Hi All:
>
>   Does any one have any idea ? Thanks.
>
> ---
> Cao Tong
>
> On 08/18/2015 06:04 PM, tony_caot...@163.com wrote:
>> In ParamProcessWorker::setFieldValue() I found this lins:
>>
>>  case DATE:
>>   // This piece of code is for maintaining backward 
>> compatibility
>>   // and support both the date formats(Bug 9724)
>>
>> Is it related to my problem?  Where can I found the descriptions about 
>> BUG9724 ?
>>
>> ---
>> Cao Tong
>>
>> On 08/18/2015 05:54 PM, tony_caot...@163.com wrote:
>>> Hello,
>>>
>>> When I use timestamp format startdate="2015-07-31", it works find.
>>> When I use it like this startdate="2015-07-31 13:00:00".
>>> It return a error
>>> IOError: ('http error', 401, 'Unauthorized', >> instance at 0x16dca70>)
>>>
>>> Could anyone tell me why ?
>>>
>>> I have read the code "DefaultLoginAPIAuthenticatorCmd::authenticate()" 
>>> , but I am still not understand what was happening,
>>> it seems authenticate failed, but why??
>>>
>>> ---
>>> Cao Tong
>>>
>>> On 07/31/2015 07:07 PM, tony_caot...@163.com wrote:
 Hi,

   was this format is enabled in ACS 4.5.1 like /"-MM-dd HH:mm:ss"


 /I found it in 4.5.0 API doc, but it seems not enabled.

 http://cloudstack.apache.org/api/apidocs-4.5/user/listEvents.html

>>> api.listEvents(startdate="2015-07-31 13:00:00")
>

Re: How does the parameter startdate/enddate of api listEvents() use new time format like 'yyyy-MM-dd HH:mm:ss' ?

2015-08-27 Thread tony_caotong


Thanks for all your people's replys.

1.  Abhinandan,  My ACS manager was not listening on port '8096',

2.  As Yipeng said, When I call this api from cloudmonkey, it works 
fine, like this
" cloudmonkey api listEvents listall=true startdate='2015-08-28 
00:00:00' "


When I call it through my python scripts, I used the 
apikey/signature pair to work,  but it failed.

I found that how cloudmonkey works,
first it login with username/password, then call the function with 
this session id.


it seems that the apikey/signature pair's privilege is not same with 
username/password pair's ?



@Daan, yes I am a Chinese. I am afraid it's not a preblem about 
character encodings perhaps.



---
Cao Tong

On 08/27/2015 08:54 PM, Abhinandan Prateek wrote:

Try using the “8096” port for testing/checking APIs.

shapeblue.com> wrote:

Yes, as per  
https://cloudstack.apache.org/api/apidocs-4.2/root_admin/listEvents.html



On 24-Aug-2015, at 2:08 pm, tony_caot...@163.com wrote:

Hello Every.

I know this is a very simple question to most of you. but it is really hard for 
me to continue my work.

So could Anyone spend your three minutes to give me some advice, it will be 
very usefull to me.

my question is:

   How does the parameter startdate/enddate of api listEvents() use new time 
format  like '-MM-dd HH:mm:ss' ?



Event({'listall':'True', 'startdate':'2015-08-24 00:00:00'})

http://10.0.1.100:8080/client/api?apiKey=hjZ12EQ4JfFasIHO3RCXBLji-3RbBmdC973utGwCL5388WypVKwtaNsDso-JzVQIZXUVwfaT1vANdDUJs3Vkkg&command=listEvents&listall=True&response=json&startdate=2015-08-24+00%3A00%3A00&signature=z4LQCw7yzGmTK5B7TzAbzl1biXI%3D
Traceback (most recent call last):
File "", line 1, in 
File "SignedAPICall.py", line 67, in Event
   a = api.listEvents(request)
File "SignedAPICall.py", line 49, in handlerFunction
   return self._make_request(name, args[0])
File "SignedAPICall.py", line 61, in _make_request
   data = self._http_get(self.value)
File "SignedAPICall.py", line 54, in _http_get
   response = urllib.urlopen(url)
File "/usr/lib64/python2.7/urllib.py", line 87, in urlopen
   return opener.open(url)
File "/usr/lib64/python2.7/urllib.py", line 208, in open
   return getattr(self, name)(url)
File "/usr/lib64/python2.7/urllib.py", line 359, in open_http
   return self.http_error(url, fp, errcode, errmsg, headers)
File "/usr/lib64/python2.7/urllib.py", line 372, in http_error
   result = method(url, fp, errcode, errmsg, headers)
File "/usr/lib64/python2.7/urllib.py", line 683, in http_error_401
   errcode, errmsg, headers)
File "/usr/lib64/python2.7/urllib.py", line 381, in http_error_default
   raise IOError, ('http error', errcode, errmsg, headers)
IOError: ('http error', 401, 'Unauthorized', )

---
Cao Tong

On 08/19/2015 10:32 AM, tony_caot...@163.com wrote:

Hi All:

   Does any one have any idea ? Thanks.

---
Cao Tong

On 08/18/2015 06:04 PM, tony_caot...@163.com wrote:

In ParamProcessWorker::setFieldValue() I found this lins:

  case DATE:
   // This piece of code is for maintaining backward compatibility
   // and support both the date formats(Bug 9724)

Is it related to my problem?  Where can I found the descriptions about BUG9724 ?

---
Cao Tong

On 08/18/2015 05:54 PM, tony_caot...@163.com wrote:

Hello,

When I use timestamp format startdate="2015-07-31", it works find.
When I use it like this startdate="2015-07-31 13:00:00".
It return a error
IOError: ('http error', 401, 'Unauthorized', )

Could anyone tell me why ?

I have read the code "DefaultLoginAPIAuthenticatorCmd::authenticate()" , but I 
am still not understand what was happening,
it seems authenticate failed, but why??

---
Cao Tong

On 07/31/2015 07:07 PM, tony_caot...@163.com wrote:

Hi,

   was this format is enabled in ACS 4.5.1 like /"-MM-dd HH:mm:ss"


/I found it in 4.5.0 API doc, but it seems not enabled.

http://cloudstack.apache.org/api/apidocs-4.5/user/listEvents.html


api.listEvents(startdate="2015-07-31 13:00:00")

Traceback (most recent call last):
File "", line 1, in 
File "call.py", line 48, in handlerFunction
   return self._make_request(name, kwargs)
File "call.py", line 60, in _make_request
   data = self._http_get(self.value)
File "call.py", line 53, in _http_get
   response = urllib.urlopen(url)
File "/usr/lib64/python2.7/urllib.py", line 87, in urlopen
   return opener.open(url)
File "/usr/lib64/python2.7/urllib.py", line 208, in open
   return getattr(self, name)(url)
File "/usr/lib64/python2.7/urllib.py", line 359, in open_http
   return self.http_error(url, fp, errcode, errmsg, headers)
File "/usr/lib64/python2.7/urllib.py", line 372, in http_error
   result = method(url, fp, errcode, errmsg, headers)
File "/usr/lib64/python2.7/urllib.py", line 683, in http_error_401
   errcode, errmsg, headers)
File "/usr/lib64/python2.7/urllib.py", line 381, in http_error_default
   raise IOError, ('http error', errcode, errmsg, headers)
IO

[GitHub] cloudstack pull request: Changed variable s_logger to non-static a...

2015-08-27 Thread rafaelweingartner
Github user rafaelweingartner commented on the pull request:

https://github.com/apache/cloudstack/pull/714#issuecomment-135612199
  
@RajaniKaruturi
Are you sure that the class “CglibThrowableRenderer” is in cloud-utils?
I have just got the master version from the git repository and that class 
is not there.

I also did a search in the git repository and could not find that class. I 
did found the log4j.xml configuration files that refer that class, but the 
class itself I did not find.
Search URL: 
https://github.com/apache/cloudstack/search?utf8=%E2%9C%93&q=CglibThrowableRenderer

Maybe someone forgot to commit? Or the PR has not been merged?



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: messages: fix string in pt_BR translation...

2015-08-27 Thread milamberspace
Github user milamberspace commented on the pull request:

https://github.com/apache/cloudstack/pull/749#issuecomment-135552489
  

The root cause of this issue is the missing comma after the backslash in 
the pt_BR translation.

See this key/value on source messages.properties:

message.admin.guide.read=For VMware-based VMs, please read the dynamic 
scaling section in the admin guide before scaling. Would you like to continue?\,


Generally, the translators on Transifex don't changes the 'special' 
characters on source language, thus the BR translation (and others languages) 
must included the backslash in the localization sentence.

But in the case of Portuguese (Brazil) localization, the translator has 
missed the comma at the end of the sentence (unlike the source language). (the 
language like French (my native) is good, on master or 4.5, because the comma 
at the end exists)

The correct fix is:

1/ Fix on Transifex (else, next time when I will update the L10N properties 
files, your changes will be erased)
2/ Download the new l10n properties from Transifex (all languages or only 
the language with issue)
3/ Make the PR
4/ Wait the 2 LGTM (if possibly with me, because I follow the L10N process 
on CloudStack (important for me))
5/ Commit/Merge the PR

You can have some information on the L10N here:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Update+L10N+files+from+Transifex+to+git+repo

@bhaisaab  I can fix this issue on Transifex (and check for all languages 
if the comma is missing) and purpose a new PR to (re)fix this issue, Or if you 
want fix them, free you as felling.





---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


How do I stop Status popup message box?

2015-08-27 Thread Yichi Lu
Hi:
If I make a list type API call, and specify a pagesize > default.page.size,
I'll get a popup status message box saying: "Page size can't exceed max
allowed page size value: x", every time I login to my account, no matter
how many time I clicked 'Close'. Is there a way to stop this popup message
box?
This happened when I set default.page.size to 40. Even if later on I used
pagesize = 40, or set default.page.size > pagesize, but still default.page.size
< 500, I still got the popup message box each time I logged in to
cloudstack.
The message box no longer popped up only after I set default.page.size =
500.
Is this a bug? Or designed behavior?
Yichi


[GitHub] cloudstack pull request: messages: fix string in pt_BR translation...

2015-08-27 Thread milamberspace
Github user milamberspace commented on the pull request:

https://github.com/apache/cloudstack/pull/749#issuecomment-135543206
  
No LTGM. This isn't the good way to fix this.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Fix schema-421to430.sql issue after Maria...

2015-08-27 Thread remibergsma
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/757#issuecomment-135519152
  
Tested CentOS 6 which has MySQL 5.1 and it works fine. The other versions I 
don't have at hand now.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Fix schema-421to430.sql issue after Maria...

2015-08-27 Thread bhaisaab
Github user bhaisaab commented on the pull request:

https://github.com/apache/cloudstack/pull/757#issuecomment-135503642
  
I guess we simply need to test this for mysql 5.1.x, 5.5.x, 5.6.x; once it 
runs we can merge this.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Discuss reserving memory on KVM hypervisors ref: CLOUDSTACK-8678

2015-08-27 Thread Josh Harshman
In a KVM cluster, CloudStack sees 100% of the compute node's RAM and treats it 
as allocatable space which eventually leads to OOM killing guests.


There is an agent property named host.reserved.mem.mb which is able to be set 
in the agent.properties file and passed to the management server.  This value 
is stored as dom0MinMem, however, it appears to be ignored.


If we could tweak the host capacity calculation and have it take this into 
account, I believe that would be ideal.


Side note: the variable dom0MinMem is declared as an int and can be overflowed. 
Suggested change would be make it a long and add a check especially if we are 
going to make this a configurable parameter.




Josh Harshman

Cloud Engineer


Intrinium
Tel: (509) 465-1234 x5259
Fax: (866) 565-4578
Lync / Skype: josh.harsh...@intrinium.com
Web: http://intrinium.com


[Intrinium Long Sig Logo]


[Facebook] [Twitter] 
  [Linkedin] 
  
[Youtube]   [Blog] 


Information Security and Compliance Consulting | Managed IT and Security 
Services | Cloud Services







This email and any files transmitted with it are confidential and intended 
solely for the use of the individual or entity to whom they are addressed. If 
you have received this email in error please notify the system manager. This 
message contains confidential information and is intended only for the 
individual named. If you are not the named addressee you should not 
disseminate, distribute or copy this e-mail. Please notify the sender 
immediately by e-mail if you have received this e-mail by mistake and delete 
this e-mail from your system. If you are not the intended recipient you are 
notified that disclosing, copying, distributing or taking any action in 
reliance on the contents of this information is strictly prohibited.


[GitHub] cloudstack pull request: CLOUDSTACK-8762: Check to confirm disk ac...

2015-08-27 Thread miguelaferreira
Github user miguelaferreira commented on the pull request:

https://github.com/apache/cloudstack/pull/754#issuecomment-135485255
  
@bhaisaab that's great. So if you think that in the future this 
implementation might change it would even be better to create an interface to 
use in the `LibvirtComputingResource`(and others). And as first implementation 
it would get the code you write here to check the file attributes.

When a better implementation comes along, it is easier to switch.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8762: Check to confirm disk ac...

2015-08-27 Thread bhaisaab
Github user bhaisaab commented on the pull request:

https://github.com/apache/cloudstack/pull/754#issuecomment-135483908
  
@miguelaferreira okay, I'll see what I can do. I'm also exploring other 
ways to detech if the vm disk file has changed, using an exhaustive checksum 
comparison for example as file attributes cannot be trusted for nfs partitions 
that were mounted with noatime. I would also like to discuss perhaps here, if 
anyone has better ideas or suggestions.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Fix schema-421to430.sql issue after Maria...

2015-08-27 Thread remibergsma
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/757#issuecomment-135454714
  
Assuming the tests will pass: LGTM
What I tested:
- the new query has the same result as the old ones
- the build now works again on CentOS 7 using MariaDB 5.5.44 (that failed 
since I upgraded from 5.5.41)
In general, the query is much better anyway I'd say. Thanks @ustcweizhou !


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Fix schema-421to430.sql issue after Maria...

2015-08-27 Thread ustcweizhou
Github user ustcweizhou commented on the pull request:

https://github.com/apache/cloudstack/pull/757#issuecomment-135453825
  
description of the issue:
http://markmail.org/message/7isvqsur2preppvl
http://markmail.org/message/t47bdpkhg6j4hhlb


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Fix schema-421to430.sql issue after Maria...

2015-08-27 Thread ustcweizhou
GitHub user ustcweizhou opened a pull request:

https://github.com/apache/cloudstack/pull/757

Fix schema-421to430.sql issue after MariaDB upgrade

@remibergsma @wido Can you test it?

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ustcweizhou/cloudstack MariaDB-crash

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/757.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #757


commit 99786516d7eb25fcf2e971bc3d2e7532a3a39b1f
Author: Wei Zhou 
Date:   2015-08-27T14:21:22Z

Fix schema-421to430.sql issue after MariaDB upgrade




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Removed unused agent command AttachVolume...

2015-08-27 Thread remibergsma
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/743#issuecomment-135448301
  
@koushik-das I tried it and it works for me. Can you tell me about your 
environment (OS, shell, ?) Maybe I might be able to figure it out (line 220 
maybe). You can also try to run it using 'bash -x tools/git/git-pr 743` and 
send me the output. I'll then debug it. Thx!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: FYI: MariaDB upgrade on CentOS 7 breaks install

2015-08-27 Thread Remi Bergsma
Missed that one, thx! ;-)



On 27/08/15 12:03, "Wido den Hollander"  wrote:

>On 08/26/2015 10:33 PM, Remi Bergsma wrote:
>> Hi all,
>> 
>> Not sure if MariaDB is even supported, but for those who use it:
>> 
>> Today I run into an issue with the latest MariaDB on CentOS7 (it was 
>> upgraded from 5.5.41 -> 5.5.44). After the upgrade I could no longer install 
>> CloudStack due to the following error (traced it to this file by executing 
>> all steps manually):
>> 
>> ---
>
>I've seen this as well on a clean install on Ubuntu 14.04, even with
>MariaDB 10.
>
>I posted it on the list before:
>http://mail-archives.apache.org/mod_mbox/cloudstack-dev/201508.mbox/%3c55c1c38f.9090...@widodh.nl%3E
>
>Wido
>
>> [root@cs3 db]# mysql cloud < 
>> /data/git/cs3/cloudstack/developer/target/db/db/schema-421to430.sql
>> ERROR 2013 (HY000) at line 114: Lost connection to MySQL server during query
>> 
>> Trying to get some variables.
>> Some pointers may be invalid and cause the dump to abort.
>> Query (0x7fc8909cd318): UPDATE `cloud`.`configuration` SET value = 
>> CONCAT("*.",(SELECT `temptable`.`value` FROM (SELECT * FROM 
>> `cloud`.`configuration` WHERE `name`="consoleproxy.url.domain") AS 
>> `temptable` WHERE `temptable`.`name`="consoleproxy.url.domain")) WHERE 
>> `name`="consoleproxy.url.domain"
>> Connection ID (thread ID): 10
>> Status: NOT_KILLED
>> 
>> Optimizer switch: 
>> index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=off
>> 
>> The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
>> information that should help you find out what is causing the crash.
>> ---
>> 
>> The MySQL server crashed, then restarted. I haven't debugged it further but 
>> a downgrade works:
>> 
>> systemctl stop mariadb
>> yum remove mariadb-libs
>> yum install mariadb-1:5.5.41-2.el7_0.x86_64
>> yum install mariadb-server-1:5.5.41-2.el7_0.x86_64
>> systemctl start mariadb
>> 
>> Just in case someone else runs into it.
>> 
>> Regards,
>> Remi
>> 


Re: FYI: MariaDB upgrade on CentOS 7 breaks install

2015-08-27 Thread Remi Bergsma
Hi Wei,

Thanks a lot, this solved it! :-)

Can you open a PR please?

Be sure to ping @wido as he might want to test it on Ubuntu as well. I expect 
this will also work fine.

Thanks, Remi




On 27/08/15 14:37, "Wei ZHOU"  wrote:

>Hi Remi,
>
>Can you test the following change?
>
># git diff setup/db/db/schema-421to430.sql
>diff --git a/setup/db/db/schema-421to430.sql
>b/setup/db/db/schema-421to430.sql
>index 3f2ad02..0a96ea0 100644
>--- a/setup/db/db/schema-421to430.sql
>+++ b/setup/db/db/schema-421to430.sql
>@@ -111,8 +111,7 @@ CREATE TABLE `cloud`.`async_job_join_map` (
> ) ENGINE=InnoDB DEFAULT CHARSET=utf8;
>
> #realhostip changes, before changing table and adding default value
>-UPDATE `cloud`.`configuration` SET value = CONCAT("*.",(SELECT
>`temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
>`name`="consoleproxy.url.domain") AS `temptable` WHERE
>`temptable`.`name`="consoleproxy.url.domain")) W
>-UPDATE `cloud`.`configuration` SET `value` = CONCAT("*.",(SELECT
>`temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
>`name`="secstorage.ssl.cert.domain") AS `temptable` WHERE
>`temptable`.`name`="secstorage.ssl.cert.dom
>+UPDATE `cloud`.`configuration` SET value=CONCAT("*.",value) WHERE
>`name`="consoleproxy.url.domain" OR `name`="secstorage.ssl.cert.domain";
>
> ALTER TABLE `cloud`.`configuration` ADD COLUMN `default_value`
>VARCHAR(4095) COMMENT 'Default value for a configuration parameter';
> ALTER TABLE `cloud`.`configuration` ADD COLUMN `updated` datetime COMMENT
>'Time this was updated by the server. null means this row is obsolete.';
>
>
>
>
>2015-08-27 12:03 GMT+02:00 Wido den Hollander :
>
>> On 08/26/2015 10:33 PM, Remi Bergsma wrote:
>> > Hi all,
>> >
>> > Not sure if MariaDB is even supported, but for those who use it:
>> >
>> > Today I run into an issue with the latest MariaDB on CentOS7 (it was
>> upgraded from 5.5.41 -> 5.5.44). After the upgrade I could no longer
>> install CloudStack due to the following error (traced it to this file by
>> executing all steps manually):
>> >
>> > ---
>>
>> I've seen this as well on a clean install on Ubuntu 14.04, even with
>> MariaDB 10.
>>
>> I posted it on the list before:
>>
>> http://mail-archives.apache.org/mod_mbox/cloudstack-dev/201508.mbox/%3c55c1c38f.9090...@widodh.nl%3E
>>
>> Wido
>>
>> > [root@cs3 db]# mysql cloud <
>> /data/git/cs3/cloudstack/developer/target/db/db/schema-421to430.sql
>> > ERROR 2013 (HY000) at line 114: Lost connection to MySQL server during
>> query
>> >
>> > Trying to get some variables.
>> > Some pointers may be invalid and cause the dump to abort.
>> > Query (0x7fc8909cd318): UPDATE `cloud`.`configuration` SET value =
>> CONCAT("*.",(SELECT `temptable`.`value` FROM (SELECT * FROM
>> `cloud`.`configuration` WHERE `name`="consoleproxy.url.domain") AS
>> `temptable` WHERE `temptable`.`name`="consoleproxy.url.domain")) WHERE
>> `name`="consoleproxy.url.domain"
>> > Connection ID (thread ID): 10
>> > Status: NOT_KILLED
>> >
>> > Optimizer switch:
>> index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=off
>> >
>> > The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html
>> contains
>> > information that should help you find out what is causing the crash.
>> > ---
>> >
>> > The MySQL server crashed, then restarted. I haven't debugged it further
>> but a downgrade works:
>> >
>> > systemctl stop mariadb
>> > yum remove mariadb-libs
>> > yum install mariadb-1:5.5.41-2.el7_0.x86_64
>> > yum install mariadb-server-1:5.5.41-2.el7_0.x86_64
>> > systemctl start mariadb
>> >
>> > Just in case someone else runs into it.
>> >
>> > Regards,
>> > Remi
>> >
>>


[GitHub] cloudstack pull request: Made following fixes in simulator

2015-08-27 Thread miguelaferreira
Github user miguelaferreira commented on the pull request:

https://github.com/apache/cloudstack/pull/741#issuecomment-135415998
  
Setup (running all unit tests)
```
git fetch upstream pull/741/head:pr/741
git checkout pr/741
mvn clean install -Pdeveloper,systemvm
mvn -Dsimulator -pl :cloud-client-ui jetty:run
```

Integration testing
```
python -m marvin.deployDataCenter -i setup/dev/advanced.cfg
nosetests --with-marvin --marvin-config=setup/dev/advanced.cfg 
test/integration/smoke/test_scale_vm.py -s -a 
tags=advanced,required_hardware=false --zone=Sandbox-simulator 
--hypervisor=simulator


 Marvin Init Started 

=== Marvin Parse Config Successful ===

=== Marvin Setting TestData Successful===

 Log Folder Path: /tmp//MarvinLogs//Aug_27_2015_12_55_07_HK730O. All 
logs will be available here 

=== Marvin Init Logging Successful===

 Marvin Init Successful 
=== TestName: test_02_scale_vm_without_hypervisor_specifics | Status : 
SUCCESS ===

===final results are now copied to: /tmp//MarvinLogs/test_scale_vm_KD77WX===
```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8781 : Superfluous field durin...

2015-08-27 Thread nlivens
GitHub user nlivens opened a pull request:

https://github.com/apache/cloudstack/pull/756

CLOUDSTACK-8781 : Superfluous field during VPC creation



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/nlivens/cloudstack CLOUDSTACK-8781

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/756.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #756


commit b1f1b63e28a09503f690fa504ed4861d7a518a67
Author: Nick Livens 
Date:   2015-08-27T12:57:17Z

CLOUDSTACK-8781 : Superfluous field during VPC creation




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: How does the parameter startdate/enddate of api listEvents() use new time format like 'yyyy-MM-dd HH:mm:ss' ?

2015-08-27 Thread Abhinandan Prateek
Try using the “8096” port for testing/checking APIs.

shapeblue.com> wrote:
>
> Yes, as per  
> https://cloudstack.apache.org/api/apidocs-4.2/root_admin/listEvents.html
>
>
>> On 24-Aug-2015, at 2:08 pm, tony_caot...@163.com wrote:
>>
>> Hello Every.
>>
>> I know this is a very simple question to most of you. but it is really hard 
>> for me to continue my work.
>>
>> So could Anyone spend your three minutes to give me some advice, it will be 
>> very usefull to me.
>>
>> my question is:
>>
>>   How does the parameter startdate/enddate of api listEvents() use new time 
>> format  like '-MM-dd HH:mm:ss' ?
>>
>>
> Event({'listall':'True', 'startdate':'2015-08-24 00:00:00'})
>> http://10.0.1.100:8080/client/api?apiKey=hjZ12EQ4JfFasIHO3RCXBLji-3RbBmdC973utGwCL5388WypVKwtaNsDso-JzVQIZXUVwfaT1vANdDUJs3Vkkg&command=listEvents&listall=True&response=json&startdate=2015-08-24+00%3A00%3A00&signature=z4LQCw7yzGmTK5B7TzAbzl1biXI%3D
>> Traceback (most recent call last):
>> File "", line 1, in 
>> File "SignedAPICall.py", line 67, in Event
>>   a = api.listEvents(request)
>> File "SignedAPICall.py", line 49, in handlerFunction
>>   return self._make_request(name, args[0])
>> File "SignedAPICall.py", line 61, in _make_request
>>   data = self._http_get(self.value)
>> File "SignedAPICall.py", line 54, in _http_get
>>   response = urllib.urlopen(url)
>> File "/usr/lib64/python2.7/urllib.py", line 87, in urlopen
>>   return opener.open(url)
>> File "/usr/lib64/python2.7/urllib.py", line 208, in open
>>   return getattr(self, name)(url)
>> File "/usr/lib64/python2.7/urllib.py", line 359, in open_http
>>   return self.http_error(url, fp, errcode, errmsg, headers)
>> File "/usr/lib64/python2.7/urllib.py", line 372, in http_error
>>   result = method(url, fp, errcode, errmsg, headers)
>> File "/usr/lib64/python2.7/urllib.py", line 683, in http_error_401
>>   errcode, errmsg, headers)
>> File "/usr/lib64/python2.7/urllib.py", line 381, in http_error_default
>>   raise IOError, ('http error', errcode, errmsg, headers)
>> IOError: ('http error', 401, 'Unauthorized', > at 0x7f083da78998>)
>>
>> ---
>> Cao Tong
>>
>> On 08/19/2015 10:32 AM, tony_caot...@163.com wrote:
>>>
>>> Hi All:
>>>
>>>   Does any one have any idea ? Thanks.
>>>
>>> ---
>>> Cao Tong
>>>
>>> On 08/18/2015 06:04 PM, tony_caot...@163.com wrote:

 In ParamProcessWorker::setFieldValue() I found this lins:

  case DATE:
   // This piece of code is for maintaining backward 
 compatibility
   // and support both the date formats(Bug 9724)

 Is it related to my problem?  Where can I found the descriptions about 
 BUG9724 ?

 ---
 Cao Tong

 On 08/18/2015 05:54 PM, tony_caot...@163.com wrote:
>
> Hello,
>
> When I use timestamp format startdate="2015-07-31", it works find.
> When I use it like this startdate="2015-07-31 13:00:00".
> It return a error
> IOError: ('http error', 401, 'Unauthorized',  instance at 0x16dca70>)
>
> Could anyone tell me why ?
>
> I have read the code "DefaultLoginAPIAuthenticatorCmd::authenticate()" , 
> but I am still not understand what was happening,
> it seems authenticate failed, but why??
>
> ---
> Cao Tong
>
> On 07/31/2015 07:07 PM, tony_caot...@163.com wrote:
>>
>> Hi,
>>
>>   was this format is enabled in ACS 4.5.1 like /"-MM-dd HH:mm:ss"
>>
>>
>> /I found it in 4.5.0 API doc, but it seems not enabled.
>>
>> http://cloudstack.apache.org/api/apidocs-4.5/user/listEvents.html
>>
> api.listEvents(startdate="2015-07-31 13:00:00")
>> Traceback (most recent call last):
>> File "", line 1, in 
>> File "call.py", line 48, in handlerFunction
>>   return self._make_request(name, kwargs)
>> File "call.py", line 60, in _make_request
>>   data = self._http_get(self.value)
>> File "call.py", line 53, in _http_get
>>   response = urllib.urlopen(url)
>> File "/usr/lib64/python2.7/urllib.py", line 87, in urlopen
>>   return opener.open(url)
>> File "/usr/lib64/python2.7/urllib.py", line 208, in open
>>   return getattr(self, name)(url)
>> File "/usr/lib64/python2.7/urllib.py", line 359, in open_http
>>   return self.http_error(url, fp, errcode, errmsg, headers)
>> File "/usr/lib64/python2.7/urllib.py", line 372, in http_error
>>   result = method(url, fp, errcode, errmsg, headers)
>> File "/usr/lib64/python2.7/urllib.py", line 683, in http_error_401
>>   errcode, errmsg, headers)
>> File "/usr/lib64/python2.7/urllib.py", line 381, in http_error_default
>>   raise IOError, ('http error', errcode, errmsg, headers)
>> IOError: ('http error', 401, 'Unauthorized', > instance at 0x16dca70>)
>
>>
>>
>> my ACS version:
>>
>> [root@cs ~]# rpm -qa |grep cloud
>> cloudstack-management-4.5

Re: FYI: MariaDB upgrade on CentOS 7 breaks install

2015-08-27 Thread Wei ZHOU
Hi Remi,

Can you test the following change?

# git diff setup/db/db/schema-421to430.sql
diff --git a/setup/db/db/schema-421to430.sql
b/setup/db/db/schema-421to430.sql
index 3f2ad02..0a96ea0 100644
--- a/setup/db/db/schema-421to430.sql
+++ b/setup/db/db/schema-421to430.sql
@@ -111,8 +111,7 @@ CREATE TABLE `cloud`.`async_job_join_map` (
 ) ENGINE=InnoDB DEFAULT CHARSET=utf8;

 #realhostip changes, before changing table and adding default value
-UPDATE `cloud`.`configuration` SET value = CONCAT("*.",(SELECT
`temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
`name`="consoleproxy.url.domain") AS `temptable` WHERE
`temptable`.`name`="consoleproxy.url.domain")) W
-UPDATE `cloud`.`configuration` SET `value` = CONCAT("*.",(SELECT
`temptable`.`value` FROM (SELECT * FROM `cloud`.`configuration` WHERE
`name`="secstorage.ssl.cert.domain") AS `temptable` WHERE
`temptable`.`name`="secstorage.ssl.cert.dom
+UPDATE `cloud`.`configuration` SET value=CONCAT("*.",value) WHERE
`name`="consoleproxy.url.domain" OR `name`="secstorage.ssl.cert.domain";

 ALTER TABLE `cloud`.`configuration` ADD COLUMN `default_value`
VARCHAR(4095) COMMENT 'Default value for a configuration parameter';
 ALTER TABLE `cloud`.`configuration` ADD COLUMN `updated` datetime COMMENT
'Time this was updated by the server. null means this row is obsolete.';




2015-08-27 12:03 GMT+02:00 Wido den Hollander :

> On 08/26/2015 10:33 PM, Remi Bergsma wrote:
> > Hi all,
> >
> > Not sure if MariaDB is even supported, but for those who use it:
> >
> > Today I run into an issue with the latest MariaDB on CentOS7 (it was
> upgraded from 5.5.41 -> 5.5.44). After the upgrade I could no longer
> install CloudStack due to the following error (traced it to this file by
> executing all steps manually):
> >
> > ---
>
> I've seen this as well on a clean install on Ubuntu 14.04, even with
> MariaDB 10.
>
> I posted it on the list before:
>
> http://mail-archives.apache.org/mod_mbox/cloudstack-dev/201508.mbox/%3c55c1c38f.9090...@widodh.nl%3E
>
> Wido
>
> > [root@cs3 db]# mysql cloud <
> /data/git/cs3/cloudstack/developer/target/db/db/schema-421to430.sql
> > ERROR 2013 (HY000) at line 114: Lost connection to MySQL server during
> query
> >
> > Trying to get some variables.
> > Some pointers may be invalid and cause the dump to abort.
> > Query (0x7fc8909cd318): UPDATE `cloud`.`configuration` SET value =
> CONCAT("*.",(SELECT `temptable`.`value` FROM (SELECT * FROM
> `cloud`.`configuration` WHERE `name`="consoleproxy.url.domain") AS
> `temptable` WHERE `temptable`.`name`="consoleproxy.url.domain")) WHERE
> `name`="consoleproxy.url.domain"
> > Connection ID (thread ID): 10
> > Status: NOT_KILLED
> >
> > Optimizer switch:
> index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=off
> >
> > The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html
> contains
> > information that should help you find out what is causing the crash.
> > ---
> >
> > The MySQL server crashed, then restarted. I haven't debugged it further
> but a downgrade works:
> >
> > systemctl stop mariadb
> > yum remove mariadb-libs
> > yum install mariadb-1:5.5.41-2.el7_0.x86_64
> > yum install mariadb-server-1:5.5.41-2.el7_0.x86_64
> > systemctl start mariadb
> >
> > Just in case someone else runs into it.
> >
> > Regards,
> > Remi
> >
>


[GitHub] cloudstack pull request: Cloudstack:8647 LDAP Trust AD and Autoimp...

2015-08-27 Thread karuturi
GitHub user karuturi opened a pull request:

https://github.com/apache/cloudstack/pull/755

Cloudstack:8647 LDAP Trust AD and Autoimport

Today, CloudStack can automatically import LDAP users based on the 
configuration to a domain or an account. However, any new users in LDAP aren't 
automatically reflected. The admin has to manually import them again.
This feature enables admin to map LDAP group/OU to a CloudStack domain and 
any changes are reflected in ACS as well.
FS: 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/WIP%3A+LDAP%3A+Trust+AD+and+Auto+Import

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/karuturi/cloudstack CLOUDSTACK-8647-2

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/755.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #755


commit 0680648036044e5d9166a0d973b2c9f714a41778
Author: Rajani Karuturi 
Date:   2015-08-04T11:14:58Z

CLOUDSTACK-8647: added cmd and response class for the new api

commit e3ddde841ed4b4ee588927394a2121fefd2d684c
Author: Rajani Karuturi 
Date:   2015-08-06T11:42:24Z

CLOUDSTACK-8647 added new api linkLdapToDomain

also added the required dao, table and vo

commit 7109689fde9895d1e702544e4011de9eecc2c1a6
Author: Rajani Karuturi 
Date:   2015-08-10T12:01:34Z

CLOUDSTACK-8647 changed the authentication flow

added check to see if domain is linked to ldap. If yes and the user is
member of the group/OU, authenticate and import user.

commit 0dc9ccd189682f82abd9ce1ab816213094b037db
Author: Rajani Karuturi 
Date:   2015-08-11T06:37:44Z

CLOUDSTACK-8647 added account_type to the linkDomainToLdap API

commit 59291864fc893935294fc9a8ac60c6c537a7caff
Author: Rajani Karuturi 
Date:   2015-08-11T08:57:55Z

CLOUDSTACK-8647 added nested group enabled config in ldap

querying the nested groups only when nested groups are enabled

commit 2825c07b38795ff541d4e9dc648612ce84fd728f
Author: Rajani Karuturi 
Date:   2015-08-11T09:50:22Z

CLOUDSTACK-8647 support for assigning and admin to linked ldap domain

if an admin username is given to the linkDomainToLdap, added support to
import this user
User will be imported only if the user is available in the group/ou in
ldap and an account with the name doesnt exist in cloudstack.
on successful import, accountid will be returned in response.

commit 6cb5d3a3bc4c02071fb1b1005f9fd40b7468d6e3
Author: Rajani Karuturi 
Date:   2015-08-12T05:12:11Z

CLOUDSTACK-8647: fixed unittests

commit dd6d6d18a588e7884385c74b98c635b487ea4e93
Author: Rajani Karuturi 
Date:   2015-08-24T09:00:37Z

CLOUDSTACK-8647 unittests for LinkDomainToLdap api command

commit 6572abc7b3095d07d003498e06c85bef1fe9dfd9
Author: Rajani Karuturi 
Date:   2015-08-24T11:21:36Z

CLOUDSTACK-8647 added unittests for new methods  in ldapmanager

commit 36340d97bdecbb437dcbfd5ef30b49020ef681a5
Author: Rajani Karuturi 
Date:   2015-08-27T09:11:37Z

CLOUDSTACK-8647: UI for trust AD feature

commit c2b36cb7059e91f6f5e9292cda4bb283017708cc
Author: Rajani Karuturi 
Date:   2015-08-27T10:48:47Z

CLOUDSTACK-8647: formatted LdapAuthenticatorSpec

commit 1c836a8999a28ef8d6161600a3a29586b30cb532
Author: Rajani Karuturi 
Date:   2015-08-27T11:54:40Z

CLOUDSTACK-8647: unittests for LdapAuthenticatorSpec




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: fix debian package after addition of lice...

2015-08-27 Thread pdion891
Github user pdion891 commented on the pull request:

https://github.com/apache/cloudstack/pull/746#issuecomment-135406104
  
Thanks!



On Thu, Aug 27, 2015 at 8:13 AM, asfgit  wrote:

> Merged #746 .
>
> —
> Reply to this email directly or view it on GitHub
> .
>



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: fix debian package after addition of lice...

2015-08-27 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/cloudstack/pull/746


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: fix debian package after addition of lice...

2015-08-27 Thread remibergsma
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/746#issuecomment-135403856
  
@pdion891 All green, merging!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8762: Check to confirm disk ac...

2015-08-27 Thread miguelaferreira
Github user miguelaferreira commented on the pull request:

https://github.com/apache/cloudstack/pull/754#issuecomment-135403411
  
It seems to me that the "VM volume/disk file activity checker" is a good 
candidate to become a new class that can be tested independent, and reused 
elsewhere. What do you think @bhaisaab?

This would also make it easier to test in a Java integration (or unit) 
test. By fiddling with the file system attributes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8766: Fix infinite scrolling p...

2015-08-27 Thread remibergsma
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/751#issuecomment-135403152
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8766: Fix infinite scrolling p...

2015-08-27 Thread remibergsma
Github user remibergsma commented on the pull request:

https://github.com/apache/cloudstack/pull/750#issuecomment-135403029
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Removed unused agent command AttachVolume...

2015-08-27 Thread koushik-das
Github user koushik-das commented on the pull request:

https://github.com/apache/cloudstack/pull/743#issuecomment-135400836
  
Output of the tmp file

$cat .git-tmp-message.txt
Merge pull request #743 from koushik-das/code_cleanup

Removed unused agent command AttachVolumeCommand and corresponding answer 
AttachVolumeAnswer

These types are not used anywhere in the orchestration layer.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8762: Check to confirm disk ac...

2015-08-27 Thread miguelaferreira
Github user miguelaferreira commented on the pull request:

https://github.com/apache/cloudstack/pull/754#issuecomment-135400873
  
I'm reading through the code to see if I understand the change.

The next thing is to find a way to test it. Might be difficult, but since 
it is a corner case (and regressions love corners), it is definitely worth it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8762: Check to confirm disk ac...

2015-08-27 Thread miguelaferreira
Github user miguelaferreira commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/754#discussion_r38087198
  
--- Diff: 
plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/resource/LibvirtComputingResource.java
 ---
@@ -3923,6 +3944,17 @@ public int compare(DiskTO arg0, DiskTO arg1) {
 volPath = physicalDisk.getPath();
 }
 
+// check for disk activity, if detected we should exit because 
vm is running elsewhere
--- End diff --

Wouldn't this block best be refactored into a separate method?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack-www pull request: Python script to generate pmc and com...

2015-08-27 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/cloudstack-www/pull/14


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8762: Check to confirm disk ac...

2015-08-27 Thread bhaisaab
Github user bhaisaab commented on the pull request:

https://github.com/apache/cloudstack/pull/754#issuecomment-135398957
  
@miguelaferreira there is no marvin test written for this, this is a 
specific case of hosts fencing where two vms might be trying to write to the 
same disk, since it's a corner case not sure which existing marvin test could 
be used; unit tests are included.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Removed unused agent command AttachVolume...

2015-08-27 Thread koushik-das
Github user koushik-das commented on the pull request:

https://github.com/apache/cloudstack/pull/743#issuecomment-135398381
  
@remibergsma I merged this using the tool but still the merge commit didn't 
automatically get the messages. I manually added some of the messages for now. 
For another PR also I saw the same. Is the issue not yet fixed?

tools/git/git-pr 743


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8762: Check to confirm disk ac...

2015-08-27 Thread miguelaferreira
Github user miguelaferreira commented on the pull request:

https://github.com/apache/cloudstack/pull/754#issuecomment-135398434
  
I'll be happy to help with reviewing this PR, but I need help testing. Can 
you point me to a Marvin test that tests this functionality? 



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Removed unused agent command AttachVolume...

2015-08-27 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/cloudstack/pull/743


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: fix debian package after addition of lice...

2015-08-27 Thread pdion891
Github user pdion891 closed the pull request at:

https://github.com/apache/cloudstack/pull/746


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: fix debian package after addition of lice...

2015-08-27 Thread pdion891
GitHub user pdion891 reopened a pull request:

https://github.com/apache/cloudstack/pull/746

fix debian package after addition of license header in pom.xml

PR#737 add lines  in pom.xml which break debian build.
This fix debian package build issue.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/pdion891/cloudstack fix-PR737

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/746.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #746


commit 2dca038bf919299657d432b804b758164a57c01a
Author: Pierre-Luc Dion 
Date:   2015-08-26T12:03:55Z

fix debian package after addition of license header in pom.xml




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Removed unused agent command AttachVolume...

2015-08-27 Thread koushik-das
Github user koushik-das commented on the pull request:

https://github.com/apache/cloudstack/pull/743#issuecomment-135395110
  
Merging as 2 LGTMs


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Made following fixes in simulator

2015-08-27 Thread miguelaferreira
Github user miguelaferreira commented on the pull request:

https://github.com/apache/cloudstack/pull/741#issuecomment-135394943
  
Thanks. I'm testing again with a clean environment.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Made following fixes in simulator

2015-08-27 Thread koushik-das
Github user koushik-das commented on the pull request:

https://github.com/apache/cloudstack/pull/741#issuecomment-135394707
  
@miguelaferreira Done


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Made following fixes in simulator

2015-08-27 Thread miguelaferreira
Github user miguelaferreira commented on the pull request:

https://github.com/apache/cloudstack/pull/741#issuecomment-135393345
  
@koushik-das Then, please merge my PR (here: 
https://github.com/koushik-das/cloudstack/pull/1)

And then @wilderrodrigues  and myself will test this PR (#741).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Made following fixes in simulator

2015-08-27 Thread koushik-das
Github user koushik-das commented on the pull request:

https://github.com/apache/cloudstack/pull/741#issuecomment-135391862
  
Ran the test, LGTM.

test_02_scale_vm_without_hypervisor_specifics 
(integration.smoke.test_scale_vm.TestScaleVm) ... === TestName: 
test_02_scale_vm_without_hypervisor_specifics | Status : SUCCESS ===
ok

--
Ran 1 test in 44.475s

OK



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8731-checking usage event for ...

2015-08-27 Thread cloudsadhu
Github user cloudsadhu commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/691#discussion_r38084154
  
--- Diff: test/integration/component/test_persistent_networks.py ---
@@ -1459,6 +1459,135 @@ def test_delete_account(self):
 
 return
 
+def test_volume_delete_event_errorState(self):
+"""
+@summary: Test volume delete event generation in error state 
condition
+@Steps:
+
+Step1: Create  a network using network created in Step1
+Step2: Verifying that  network creation is successful
+Step3: Login to Virtual router and add iptable  rule to block 
insertion of vm rules
+Step6: deploy a vm using network created in step2
+Step7: check the Vm status for failure
+Step8: destroy and expunge the vm
+Step9: list the generated events for volume delete event.
+"""
+
+# Listing all the networks available
+
+account = Account.create(
+self.api_client,
+self.services["account"],
+domainid=self.domain.id)
+
+network = Network.create(
+self.apiclient,
+self.services["isolated_network"],
+networkofferingid=self.isolated_persistent_network_offering.id,
+accountid=self.account.name,
+domainid=self.domain.id,
+zoneid=self.zone.id)
+
+response = verifyNetworkState(
+self.apiclient,
+network.id,
+"implemented")
+exceptionOccured = response[0]
+isNetworkInDesiredState = response[1]
+exceptionMessage = response[2]
+
+if (exceptionOccured or (not isNetworkInDesiredState)):
+self.fail(exceptionMessage)
+self.assertIsNotNone(
+network.vlan,
+"vlan must not be null for persistent network")
+try:
+if self.zone.networktype == "Basic":
+list_router_response = list_routers(
+self.apiclient,
+listall="true"
+)
+else:
+list_router_response = list_routers(
+self.apiclient,
+account=self.account.name,
+domainid=self.account.domainid
+)
+self.assertEqual(
+isinstance(list_router_response, list),
+True,
+"Check list response returns a valid list"
+)
+router = list_router_response[0]
+
+self.debug("Router ID: %s, state: %s" % (router.id, 
router.state))
+
+self.assertEqual(
+router.state,
+'Running',
+"Check list router response for router state"
+)
+self.hypervisor = self.testClient.getHypervisorInfo()
+if self.hypervisor.lower() in ('vmware', 'hyperv'):
+result = get_process_status(
+self.apiclient.connection.mgtSvr,
+22,
+self.apiclient.connection.user,
+self.apiclient.connection.passwd,
+router.linklocalip,
+"iptables -I INPUT 1 -j DROP",
+hypervisor=self.hypervisor
+)
+else:
+try:
+hosts = list_hosts(
+self.apiclient,
+zoneid=router.zoneid,
+type='Routing',
+state='Up',
+id=router.hostid
+)
+
+self.assertEqual(
+isinstance(hosts, list),
+True,
+"Check list host returns a valid list"
+)
+
+host = hosts[0]
+result = get_process_status(
+host.ipaddress,
+22, "root", "xenroot", router.linklocalip,
+"iptables -I INPUT 1 -j DROP"
+)
+
--- End diff --

Thanks for the review comment and its good suggestion, to get the 
credential from configuration.so i have added the code accordingly. 
 host = hosts[0]
result = get_process_status(
host.ipaddress,
22, self.services["host"]["username"], 
self.services["host"]["password"], router.linklocalip,
"iptables -I

[GitHub] cloudstack-www pull request: Python script to generate pmc and com...

2015-08-27 Thread sedukull
Github user sedukull commented on the pull request:

https://github.com/apache/cloudstack-www/pull/14#issuecomment-135375292
  
Was looking to be consistent when referring to global variables, but 
otherwise LGTM. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack-www pull request: Python script to generate pmc and com...

2015-08-27 Thread karuturi
Github user karuturi commented on the pull request:

https://github.com/apache/cloudstack-www/pull/14#issuecomment-135374394
  
:+1: 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8677: Call-home functionality ...

2015-08-27 Thread wido
Github user wido commented on the pull request:

https://github.com/apache/cloudstack/pull/625#issuecomment-135369995
  
@bhaisaab Isn't it already a plug-in?

Don't know if the PR is the right way to discuss it, but I also want to 
know how many Instances and cloud is running. So not only on upgrades. So it 
can send diagnostics every 7 days (default) and that way we can see how clouds 
grow and such.

We know the install data and after that we see the growth.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: FYI: MariaDB upgrade on CentOS 7 breaks install

2015-08-27 Thread Wido den Hollander
On 08/26/2015 10:33 PM, Remi Bergsma wrote:
> Hi all,
> 
> Not sure if MariaDB is even supported, but for those who use it:
> 
> Today I run into an issue with the latest MariaDB on CentOS7 (it was upgraded 
> from 5.5.41 -> 5.5.44). After the upgrade I could no longer install 
> CloudStack due to the following error (traced it to this file by executing 
> all steps manually):
> 
> ---

I've seen this as well on a clean install on Ubuntu 14.04, even with
MariaDB 10.

I posted it on the list before:
http://mail-archives.apache.org/mod_mbox/cloudstack-dev/201508.mbox/%3c55c1c38f.9090...@widodh.nl%3E

Wido

> [root@cs3 db]# mysql cloud < 
> /data/git/cs3/cloudstack/developer/target/db/db/schema-421to430.sql
> ERROR 2013 (HY000) at line 114: Lost connection to MySQL server during query
> 
> Trying to get some variables.
> Some pointers may be invalid and cause the dump to abort.
> Query (0x7fc8909cd318): UPDATE `cloud`.`configuration` SET value = 
> CONCAT("*.",(SELECT `temptable`.`value` FROM (SELECT * FROM 
> `cloud`.`configuration` WHERE `name`="consoleproxy.url.domain") AS 
> `temptable` WHERE `temptable`.`name`="consoleproxy.url.domain")) WHERE 
> `name`="consoleproxy.url.domain"
> Connection ID (thread ID): 10
> Status: NOT_KILLED
> 
> Optimizer switch: 
> index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=off
> 
> The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
> information that should help you find out what is causing the crash.
> ---
> 
> The MySQL server crashed, then restarted. I haven't debugged it further but a 
> downgrade works:
> 
> systemctl stop mariadb
> yum remove mariadb-libs
> yum install mariadb-1:5.5.41-2.el7_0.x86_64
> yum install mariadb-server-1:5.5.41-2.el7_0.x86_64
> systemctl start mariadb
> 
> Just in case someone else runs into it.
> 
> Regards,
> Remi
> 


[GitHub] cloudstack pull request: CLOUDSTACK-8762: Check to confirm disk ac...

2015-08-27 Thread bhaisaab
GitHub user bhaisaab opened a pull request:

https://github.com/apache/cloudstack/pull/754

CLOUDSTACK-8762: Check to confirm disk activity before starting a VM

Implements a VM volume/disk file activity checker that checks if QCOW2 file
has been changed before starting the VM. This is useful as a pessimistic
approach to save VMs that were running on faulty hosts that CloudStack could
try to launch on other hosts while the host was not cleanly fenced. This is
optional and available only if you enable the settings in agent.properties
file, on per-host basis.

Signed-off-by: Rohit Yadav 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/shapeblue/cloudstack 4.5-CLOUDSTACK-8762

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/754.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #754


commit bd12614c2fe56aebb4ea81e128368368fec6f092
Author: Rohit Yadav 
Date:   2015-08-27T09:47:19Z

CLOUDSTACK-8762: Check to confirm disk activity before starting a VM

Implements a VM volume/disk file activity checker that checks if QCOW2 file
has been changed before starting the VM. This is useful as a pessimistic
approach to save VMs that were running on faulty hosts that CloudStack could
try to launch on other hosts while the host was not cleanly fenced. This is
optional and available only if you enable the settings in agent.properties
file, on per-host basis.

Signed-off-by: Rohit Yadav 




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8762: Check to confirm disk ac...

2015-08-27 Thread bhaisaab
GitHub user bhaisaab opened a pull request:

https://github.com/apache/cloudstack/pull/753

CLOUDSTACK-8762: Check to confirm disk activity before starting a VM

Implements a VM volume/disk file activity checker that checks if QCOW2 file
has been changed before starting the VM. This is useful as a pessimistic
approach to save VMs that were running on faulty hosts that CloudStack could
try to launch on other hosts while the host was not cleanly fenced. This is
optional and available only if you enable the settings in agent.properties
file, on per-host basis.

Signed-off-by: Rohit Yadav 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/shapeblue/cloudstack master-CLOUDSTACK-8762

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/753.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #753


commit 758801ed47e3c98f673fba1bf0c1f294953b7840
Author: Rohit Yadav 
Date:   2015-08-27T09:58:54Z

CLOUDSTACK-8762: Check to confirm disk activity before starting a VM

Implements a VM volume/disk file activity checker that checks if QCOW2 file
has been changed before starting the VM. This is useful as a pessimistic
approach to save VMs that were running on faulty hosts that CloudStack could
try to launch on other hosts while the host was not cleanly fenced. This is
optional and available only if you enable the settings in agent.properties
file, on per-host basis.

Signed-off-by: Rohit Yadav 




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack-www pull request: Python script to generate pmc and com...

2015-08-27 Thread wido
Github user wido commented on the pull request:

https://github.com/apache/cloudstack-www/pull/14#issuecomment-135368790
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: [DISCUSS] How to list PMC and Committers on our Web Site

2015-08-27 Thread Wido den Hollander


On 08/27/2015 09:25 AM, Erik Weber wrote:
> Previously[1] committers and PMC members have been listed separately,
> meaning, if you were PMC you weren't listed on the committers list.
> 
> With the commit from Rohit[2] this changed, to listing PMC as both.
> 
> This has led to some discrepany as some do it one way, and others do it
> another way.
> No matter how we end up doing it, we should be consistent about it.
> 
> I think showing PMC members as both are fine, this is also in sync with how
> projects.apache.org[3] and other ASF sites do it.
> 

+1 from my side. Seems like a good way to do it!

> I went ahead and made a simple python tool[4] to generate the list, parsed
> from projects.apache.org.
> This does not require any ASF privileges, and can be used by anyone.
> Currently it will list PMC as both, but this can easily be changed if we
> want it some other way.
> 
> 
> [1]
> https://github.com/apache/cloudstack-www/commit/64ae3ad7680a043ddb65156436e6a48434711018
> [2]
> https://github.com/apache/cloudstack-www/commit/3458edbfb0612e1dfaae92b01ca32256f640bbac
> [3] https://projects.apache.org/committee.html?cloudstack
> [4] https://github.com/apache/cloudstack-www/pull/14
> 


[GitHub] cloudstack pull request: Made following fixes in simulator

2015-08-27 Thread miguelaferreira
Github user miguelaferreira commented on the pull request:

https://github.com/apache/cloudstack/pull/741#issuecomment-135358954
  
@koushik-das my PR to your PR is ready for you to review.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Build failed in Jenkins: simulator-4.5-singlerun #267

2015-08-27 Thread jenkins
See 

--
Started by upstream project "build-4.5-simulator" build number 322
originally caused by:
 Started by upstream project "build-4.5" build number 520
 originally caused by:
  Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on simulator in workspace 

Cloning the remote Git repository
Cloning repository https://git-wip-us.apache.org/repos/asf/cloudstack.git
 > /usr/bin/git init 
 >  # 
 > timeout=400
Fetching upstream changes from 
https://git-wip-us.apache.org/repos/asf/cloudstack.git
 > /usr/bin/git --version # timeout=400
 > /usr/bin/git fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/cloudstack.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error cloning remote repo 'origin'
ERROR: Error cloning remote repo 'origin'
[xUnit] [INFO] - Starting to record.
[xUnit] [INFO] - Processing JUnit
[xUnit] [INFO] - [JUnit] - No test report file(s) were found with the pattern 
'xunit.xml' relative to 
' for the 
testing framework 'JUnit'.  Did you enter a pattern relative to the correct 
directory?  Did you generate the result report(s) for 'JUnit'?
[xUnit] [ERROR] - No test reports found for the metric 'JUnit' with the 
resolved pattern 'xunit.xml'. Configuration error?.
[xUnit] [INFO] - Failing BUILD.
[xUnit] [INFO] - There are errors when processing test results.
[xUnit] [INFO] - Skipping tests recording.
[xUnit] [INFO] - Stop build.


[GitHub] cloudstack pull request: CLOUDSTACK-8731-checking usage event for ...

2015-08-27 Thread sanju1010
Github user sanju1010 commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/691#discussion_r38073932
  
--- Diff: test/integration/component/test_persistent_networks.py ---
@@ -1459,6 +1459,135 @@ def test_delete_account(self):
 
 return
 
+def test_volume_delete_event_errorState(self):
+"""
+@summary: Test volume delete event generation in error state 
condition
+@Steps:
+
+Step1: Create  a network using network created in Step1
+Step2: Verifying that  network creation is successful
+Step3: Login to Virtual router and add iptable  rule to block 
insertion of vm rules
+Step6: deploy a vm using network created in step2
+Step7: check the Vm status for failure
+Step8: destroy and expunge the vm
+Step9: list the generated events for volume delete event.
+"""
+
+# Listing all the networks available
+
+account = Account.create(
+self.api_client,
+self.services["account"],
+domainid=self.domain.id)
+
+network = Network.create(
+self.apiclient,
+self.services["isolated_network"],
+networkofferingid=self.isolated_persistent_network_offering.id,
+accountid=self.account.name,
+domainid=self.domain.id,
+zoneid=self.zone.id)
+
+response = verifyNetworkState(
+self.apiclient,
+network.id,
+"implemented")
+exceptionOccured = response[0]
+isNetworkInDesiredState = response[1]
+exceptionMessage = response[2]
+
+if (exceptionOccured or (not isNetworkInDesiredState)):
+self.fail(exceptionMessage)
+self.assertIsNotNone(
+network.vlan,
+"vlan must not be null for persistent network")
+try:
+if self.zone.networktype == "Basic":
+list_router_response = list_routers(
+self.apiclient,
+listall="true"
+)
+else:
+list_router_response = list_routers(
+self.apiclient,
+account=self.account.name,
+domainid=self.account.domainid
+)
+self.assertEqual(
+isinstance(list_router_response, list),
+True,
+"Check list response returns a valid list"
+)
+router = list_router_response[0]
+
+self.debug("Router ID: %s, state: %s" % (router.id, 
router.state))
+
+self.assertEqual(
+router.state,
+'Running',
+"Check list router response for router state"
+)
+self.hypervisor = self.testClient.getHypervisorInfo()
+if self.hypervisor.lower() in ('vmware', 'hyperv'):
+result = get_process_status(
+self.apiclient.connection.mgtSvr,
+22,
+self.apiclient.connection.user,
+self.apiclient.connection.passwd,
+router.linklocalip,
+"iptables -I INPUT 1 -j DROP",
+hypervisor=self.hypervisor
+)
+else:
+try:
+hosts = list_hosts(
+self.apiclient,
+zoneid=router.zoneid,
+type='Routing',
+state='Up',
+id=router.hostid
+)
+
+self.assertEqual(
+isinstance(hosts, list),
+True,
+"Check list host returns a valid list"
+)
+
+host = hosts[0]
+result = get_process_status(
+host.ipaddress,
+22, "root", "xenroot", router.linklocalip,
+"iptables -I INPUT 1 -j DROP"
+)
+
+except Exception as e:
+raise Exception("Exception raised in accessing/running 
the command on hosts  : %s " % e)
+
+except Exception as e:
+raise Exception("Exception raised in getting hostcredentials: 
%s " % e)
+
+with self.assertRaises(Exception) as context:
+virtual_machine = VirtualMachine.create(
+self.apiclie

[GitHub] cloudstack pull request: CLOUDSTACK-8731-checking usage event for ...

2015-08-27 Thread sanju1010
Github user sanju1010 commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/691#discussion_r38073818
  
--- Diff: test/integration/component/test_persistent_networks.py ---
@@ -1459,6 +1459,135 @@ def test_delete_account(self):
 
 return
 
+def test_volume_delete_event_errorState(self):
+"""
+@summary: Test volume delete event generation in error state 
condition
+@Steps:
+
+Step1: Create  a network using network created in Step1
+Step2: Verifying that  network creation is successful
+Step3: Login to Virtual router and add iptable  rule to block 
insertion of vm rules
+Step6: deploy a vm using network created in step2
+Step7: check the Vm status for failure
+Step8: destroy and expunge the vm
+Step9: list the generated events for volume delete event.
+"""
+
+# Listing all the networks available
+
+account = Account.create(
+self.api_client,
+self.services["account"],
+domainid=self.domain.id)
+
+network = Network.create(
+self.apiclient,
+self.services["isolated_network"],
+networkofferingid=self.isolated_persistent_network_offering.id,
+accountid=self.account.name,
+domainid=self.domain.id,
+zoneid=self.zone.id)
+
+response = verifyNetworkState(
+self.apiclient,
+network.id,
+"implemented")
+exceptionOccured = response[0]
+isNetworkInDesiredState = response[1]
+exceptionMessage = response[2]
+
+if (exceptionOccured or (not isNetworkInDesiredState)):
+self.fail(exceptionMessage)
+self.assertIsNotNone(
+network.vlan,
+"vlan must not be null for persistent network")
+try:
+if self.zone.networktype == "Basic":
+list_router_response = list_routers(
+self.apiclient,
+listall="true"
+)
+else:
+list_router_response = list_routers(
+self.apiclient,
+account=self.account.name,
+domainid=self.account.domainid
+)
+self.assertEqual(
+isinstance(list_router_response, list),
+True,
+"Check list response returns a valid list"
+)
+router = list_router_response[0]
+
+self.debug("Router ID: %s, state: %s" % (router.id, 
router.state))
+
+self.assertEqual(
+router.state,
+'Running',
+"Check list router response for router state"
+)
+self.hypervisor = self.testClient.getHypervisorInfo()
+if self.hypervisor.lower() in ('vmware', 'hyperv'):
+result = get_process_status(
+self.apiclient.connection.mgtSvr,
+22,
+self.apiclient.connection.user,
+self.apiclient.connection.passwd,
+router.linklocalip,
+"iptables -I INPUT 1 -j DROP",
+hypervisor=self.hypervisor
+)
+else:
+try:
+hosts = list_hosts(
+self.apiclient,
+zoneid=router.zoneid,
+type='Routing',
+state='Up',
+id=router.hostid
+)
+
+self.assertEqual(
+isinstance(hosts, list),
+True,
+"Check list host returns a valid list"
+)
+
+host = hosts[0]
+result = get_process_status(
+host.ipaddress,
+22, "root", "xenroot", router.linklocalip,
+"iptables -I INPUT 1 -j DROP"
--- End diff --

Delete this rule once the test is done so that it won't have impact on the 
other tests.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8731-checking usage event for ...

2015-08-27 Thread sanju1010
Github user sanju1010 commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/691#discussion_r38073806
  
--- Diff: test/integration/component/test_persistent_networks.py ---
@@ -1459,6 +1459,135 @@ def test_delete_account(self):
 
 return
 
+def test_volume_delete_event_errorState(self):
+"""
+@summary: Test volume delete event generation in error state 
condition
+@Steps:
+
+Step1: Create  a network using network created in Step1
+Step2: Verifying that  network creation is successful
+Step3: Login to Virtual router and add iptable  rule to block 
insertion of vm rules
+Step6: deploy a vm using network created in step2
+Step7: check the Vm status for failure
+Step8: destroy and expunge the vm
+Step9: list the generated events for volume delete event.
+"""
+
+# Listing all the networks available
+
+account = Account.create(
+self.api_client,
+self.services["account"],
+domainid=self.domain.id)
+
+network = Network.create(
+self.apiclient,
+self.services["isolated_network"],
+networkofferingid=self.isolated_persistent_network_offering.id,
+accountid=self.account.name,
+domainid=self.domain.id,
+zoneid=self.zone.id)
+
+response = verifyNetworkState(
+self.apiclient,
+network.id,
+"implemented")
+exceptionOccured = response[0]
+isNetworkInDesiredState = response[1]
+exceptionMessage = response[2]
+
+if (exceptionOccured or (not isNetworkInDesiredState)):
+self.fail(exceptionMessage)
+self.assertIsNotNone(
+network.vlan,
+"vlan must not be null for persistent network")
+try:
+if self.zone.networktype == "Basic":
+list_router_response = list_routers(
+self.apiclient,
+listall="true"
+)
+else:
+list_router_response = list_routers(
+self.apiclient,
+account=self.account.name,
+domainid=self.account.domainid
+)
+self.assertEqual(
+isinstance(list_router_response, list),
+True,
+"Check list response returns a valid list"
+)
+router = list_router_response[0]
+
+self.debug("Router ID: %s, state: %s" % (router.id, 
router.state))
+
+self.assertEqual(
+router.state,
+'Running',
+"Check list router response for router state"
+)
+self.hypervisor = self.testClient.getHypervisorInfo()
+if self.hypervisor.lower() in ('vmware', 'hyperv'):
+result = get_process_status(
+self.apiclient.connection.mgtSvr,
+22,
+self.apiclient.connection.user,
+self.apiclient.connection.passwd,
+router.linklocalip,
+"iptables -I INPUT 1 -j DROP",
--- End diff --

Delete this rule once the test is done so that it won't have impact on the 
other tests.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8731-checking usage event for ...

2015-08-27 Thread sanju1010
Github user sanju1010 commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/691#discussion_r38073739
  
--- Diff: test/integration/component/test_persistent_networks.py ---
@@ -1459,6 +1459,135 @@ def test_delete_account(self):
 
 return
 
+def test_volume_delete_event_errorState(self):
+"""
+@summary: Test volume delete event generation in error state 
condition
+@Steps:
+
+Step1: Create  a network using network created in Step1
+Step2: Verifying that  network creation is successful
+Step3: Login to Virtual router and add iptable  rule to block 
insertion of vm rules
+Step6: deploy a vm using network created in step2
+Step7: check the Vm status for failure
+Step8: destroy and expunge the vm
+Step9: list the generated events for volume delete event.
+"""
+
+# Listing all the networks available
+
+account = Account.create(
+self.api_client,
+self.services["account"],
+domainid=self.domain.id)
+
+network = Network.create(
+self.apiclient,
+self.services["isolated_network"],
+networkofferingid=self.isolated_persistent_network_offering.id,
+accountid=self.account.name,
+domainid=self.domain.id,
+zoneid=self.zone.id)
+
+response = verifyNetworkState(
+self.apiclient,
+network.id,
+"implemented")
+exceptionOccured = response[0]
+isNetworkInDesiredState = response[1]
+exceptionMessage = response[2]
+
+if (exceptionOccured or (not isNetworkInDesiredState)):
+self.fail(exceptionMessage)
+self.assertIsNotNone(
+network.vlan,
+"vlan must not be null for persistent network")
+try:
+if self.zone.networktype == "Basic":
+list_router_response = list_routers(
+self.apiclient,
+listall="true"
+)
+else:
+list_router_response = list_routers(
+self.apiclient,
+account=self.account.name,
+domainid=self.account.domainid
+)
+self.assertEqual(
+isinstance(list_router_response, list),
+True,
+"Check list response returns a valid list"
+)
+router = list_router_response[0]
+
+self.debug("Router ID: %s, state: %s" % (router.id, 
router.state))
+
+self.assertEqual(
+router.state,
+'Running',
+"Check list router response for router state"
+)
+self.hypervisor = self.testClient.getHypervisorInfo()
+if self.hypervisor.lower() in ('vmware', 'hyperv'):
+result = get_process_status(
+self.apiclient.connection.mgtSvr,
+22,
+self.apiclient.connection.user,
+self.apiclient.connection.passwd,
+router.linklocalip,
+"iptables -I INPUT 1 -j DROP",
+hypervisor=self.hypervisor
+)
+else:
+try:
+hosts = list_hosts(
+self.apiclient,
+zoneid=router.zoneid,
+type='Routing',
+state='Up',
+id=router.hostid
+)
+
+self.assertEqual(
--- End diff --

use validateList here


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: messages: fix string in pt_BR translation...

2015-08-27 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/cloudstack/pull/748


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: messages: fix string in pt_BR translation...

2015-08-27 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/cloudstack/pull/749


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8731-checking usage event for ...

2015-08-27 Thread sanju1010
Github user sanju1010 commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/691#discussion_r38073673
  
--- Diff: test/integration/component/test_persistent_networks.py ---
@@ -1459,6 +1459,135 @@ def test_delete_account(self):
 
 return
 
+def test_volume_delete_event_errorState(self):
+"""
+@summary: Test volume delete event generation in error state 
condition
+@Steps:
+
+Step1: Create  a network using network created in Step1
+Step2: Verifying that  network creation is successful
+Step3: Login to Virtual router and add iptable  rule to block 
insertion of vm rules
+Step6: deploy a vm using network created in step2
+Step7: check the Vm status for failure
+Step8: destroy and expunge the vm
+Step9: list the generated events for volume delete event.
+"""
+
+# Listing all the networks available
+
+account = Account.create(
+self.api_client,
+self.services["account"],
+domainid=self.domain.id)
+
+network = Network.create(
+self.apiclient,
+self.services["isolated_network"],
+networkofferingid=self.isolated_persistent_network_offering.id,
+accountid=self.account.name,
+domainid=self.domain.id,
+zoneid=self.zone.id)
+
+response = verifyNetworkState(
+self.apiclient,
+network.id,
+"implemented")
+exceptionOccured = response[0]
+isNetworkInDesiredState = response[1]
+exceptionMessage = response[2]
+
+if (exceptionOccured or (not isNetworkInDesiredState)):
+self.fail(exceptionMessage)
+self.assertIsNotNone(
+network.vlan,
+"vlan must not be null for persistent network")
+try:
+if self.zone.networktype == "Basic":
+list_router_response = list_routers(
+self.apiclient,
+listall="true"
+)
+else:
+list_router_response = list_routers(
+self.apiclient,
+account=self.account.name,
+domainid=self.account.domainid
+)
+self.assertEqual(
--- End diff --

use validateList instead of this assertEqual method.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8731-checking usage event for ...

2015-08-27 Thread sanju1010
Github user sanju1010 commented on a diff in the pull request:

https://github.com/apache/cloudstack/pull/691#discussion_r38073620
  
--- Diff: test/integration/component/test_persistent_networks.py ---
@@ -1459,6 +1459,135 @@ def test_delete_account(self):
 
 return
 
+def test_volume_delete_event_errorState(self):
+"""
+@summary: Test volume delete event generation in error state 
condition
+@Steps:
+
+Step1: Create  a network using network created in Step1
+Step2: Verifying that  network creation is successful
+Step3: Login to Virtual router and add iptable  rule to block 
insertion of vm rules
+Step6: deploy a vm using network created in step2
+Step7: check the Vm status for failure
+Step8: destroy and expunge the vm
+Step9: list the generated events for volume delete event.
+"""
+
+# Listing all the networks available
+
+account = Account.create(
+self.api_client,
+self.services["account"],
+domainid=self.domain.id)
+
+network = Network.create(
+self.apiclient,
+self.services["isolated_network"],
+networkofferingid=self.isolated_persistent_network_offering.id,
+accountid=self.account.name,
+domainid=self.domain.id,
+zoneid=self.zone.id)
+
+response = verifyNetworkState(
+self.apiclient,
+network.id,
+"implemented")
+exceptionOccured = response[0]
+isNetworkInDesiredState = response[1]
+exceptionMessage = response[2]
+
+if (exceptionOccured or (not isNetworkInDesiredState)):
+self.fail(exceptionMessage)
+self.assertIsNotNone(
+network.vlan,
+"vlan must not be null for persistent network")
+try:
+if self.zone.networktype == "Basic":
--- End diff --

Try to convert it to lower case and compare it with "basic"


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: use fakelocalhost in BasicRestClientTest

2015-08-27 Thread ustcweizhou
GitHub user ustcweizhou opened a pull request:

https://github.com/apache/cloudstack/pull/752

use fakelocalhost in BasicRestClientTest

BasicRestClientTest will fail if the port 443 is open on localhost.
use fakelocalhost instead of localhost can fix it.
Please see the latest discussion in 
https://github.com/apache/cloudstack/pull/737

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ustcweizhou/cloudstack 
BasicRestClientTest-fakelocalhost

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/752.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #752


commit 5e792e33ec99a037f99b62aab45b3b8b92bf4ecf
Author: Wei Zhou 
Date:   2015-08-27T08:32:57Z

use fakelocalhost in BasicRestClientTest




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8766: Fix infinite scrolling p...

2015-08-27 Thread bhaisaab
GitHub user bhaisaab opened a pull request:

https://github.com/apache/cloudstack/pull/751

CLOUDSTACK-8766: Fix infinite scrolling pagination for zonal iso/temp…

…late listing

Due to aggregation of templates and isos on the UI/client side, it could 
result
that for each page we could end up having lesser templates/isos listed to 
have
the scroll shown that triggers infinite scrolling. The fix is to use similar
approach as in projects.js, to use the maximum pagesize of 500. In theory, 
there
is still a chance if there are 500 zones with the same template being listed
resulting in only one aggregated template which could cause the scroll to 
not
get shown; but in practice I believe this fix should work for most users.

(cherry picked from commit 8a1cc7aac6f3d9a0a1686e2dae8dd12b74ed9cdd)
Signed-off-by: Rohit Yadav 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/shapeblue/cloudstack master-CLOUDSTACK-8766

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/751.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #751


commit 9fe2404d83035ee3829fe134d08627a9fd8e1da6
Author: Rohit Yadav 
Date:   2015-08-27T07:01:04Z

CLOUDSTACK-8766: Fix infinite scrolling pagination for zonal iso/template 
listing

Due to aggregation of templates and isos on the UI/client side, it could 
result
that for each page we could end up having lesser templates/isos listed to 
have
the scroll shown that triggers infinite scrolling. The fix is to use similar
approach as in projects.js, to use the maximum pagesize of 500. In theory, 
there
is still a chance if there are 500 zones with the same template being listed
resulting in only one aggregated template which could cause the scroll to 
not
get shown; but in practice I believe this fix should work for most users.

(cherry picked from commit 8a1cc7aac6f3d9a0a1686e2dae8dd12b74ed9cdd)
Signed-off-by: Rohit Yadav 




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: CLOUDSTACK-8766: Fix infinite scrolling p...

2015-08-27 Thread bhaisaab
GitHub user bhaisaab opened a pull request:

https://github.com/apache/cloudstack/pull/750

CLOUDSTACK-8766: Fix infinite scrolling pagination for zonal iso/temp…

…late listing

Due to aggregation of templates and isos on the UI/client side, it could 
result
that for each page we could end up having lesser templates/isos listed to 
have
the scroll shown that triggers infinite scrolling. The fix is to use similar
approach as in projects.js, to use the maximum pagesize of 500. In theory, 
there
is still a chance if there are 500 zones with the same template being listed
resulting in only one aggregated template which could cause the scroll to 
not
get shown; but in practice I believe this fix should work for most users.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/shapeblue/cloudstack 4.5-CLOUDSTACK-8766

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack/pull/750.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #750


commit 8a1cc7aac6f3d9a0a1686e2dae8dd12b74ed9cdd
Author: Rohit Yadav 
Date:   2015-08-27T07:01:04Z

CLOUDSTACK-8766: Fix infinite scrolling pagination for zonal iso/template 
listing

Due to aggregation of templates and isos on the UI/client side, it could 
result
that for each page we could end up having lesser templates/isos listed to 
have
the scroll shown that triggers infinite scrolling. The fix is to use similar
approach as in projects.js, to use the maximum pagesize of 500. In theory, 
there
is still a chance if there are 500 zones with the same template being listed
resulting in only one aggregated template which could cause the scroll to 
not
get shown; but in practice I believe this fix should work for most users.

Signed-off-by: Rohit Yadav 




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: Removed unused agent command AttachVolume...

2015-08-27 Thread snuf
Github user snuf commented on the pull request:

https://github.com/apache/cloudstack/pull/743#issuecomment-135327593
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack pull request: messages: fix string in pt_BR translation...

2015-08-27 Thread snuf
Github user snuf commented on the pull request:

https://github.com/apache/cloudstack/pull/749#issuecomment-135324787
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: FYI: MariaDB upgrade on CentOS 7 breaks install

2015-08-27 Thread Wei ZHOU
This might be because CS tries to UPDATE and SELECT from the same table
cloud.configuration.


2015-08-26 22:33 GMT+02:00 Remi Bergsma :

> Hi all,
>
> Not sure if MariaDB is even supported, but for those who use it:
>
> Today I run into an issue with the latest MariaDB on CentOS7 (it was
> upgraded from 5.5.41 -> 5.5.44). After the upgrade I could no longer
> install CloudStack due to the following error (traced it to this file by
> executing all steps manually):
>
> ---
> [root@cs3 db]# mysql cloud <
> /data/git/cs3/cloudstack/developer/target/db/db/schema-421to430.sql
> ERROR 2013 (HY000) at line 114: Lost connection to MySQL server during
> query
>
> Trying to get some variables.
> Some pointers may be invalid and cause the dump to abort.
> Query (0x7fc8909cd318): UPDATE `cloud`.`configuration` SET value =
> CONCAT("*.",(SELECT `temptable`.`value` FROM (SELECT * FROM
> `cloud`.`configuration` WHERE `name`="consoleproxy.url.domain") AS
> `temptable` WHERE `temptable`.`name`="consoleproxy.url.domain")) WHERE
> `name`="consoleproxy.url.domain"
> Connection ID (thread ID): 10
> Status: NOT_KILLED
>
> Optimizer switch:
> index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=off
>
> The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html
> contains
> information that should help you find out what is causing the crash.
> ---
>
> The MySQL server crashed, then restarted. I haven't debugged it further
> but a downgrade works:
>
> systemctl stop mariadb
> yum remove mariadb-libs
> yum install mariadb-1:5.5.41-2.el7_0.x86_64
> yum install mariadb-server-1:5.5.41-2.el7_0.x86_64
> systemctl start mariadb
>
> Just in case someone else runs into it.
>
> Regards,
> Remi
>
>


[GitHub] cloudstack pull request: messages: fix string in pt_BR translation...

2015-08-27 Thread terbolous
Github user terbolous commented on the pull request:

https://github.com/apache/cloudstack/pull/749#issuecomment-135321371
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack-www pull request: Python script to generate pmc and com...

2015-08-27 Thread terbolous
Github user terbolous commented on a diff in the pull request:

https://github.com/apache/cloudstack-www/pull/14#discussion_r38068791
  
--- Diff: makewholist.py ---
@@ -0,0 +1,68 @@
+#!/usr/bin/env python
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#   http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied.  See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+import json
+import sys
+import urllib
+
+groups_url = "https://projects.apache.org/json/foundation/groups.json";
+names_url = "https://projects.apache.org/json/foundation/people_name.json";
+
+names = {}   # Placeholder for names parsed in getNames()
+groups = {}  # Placeholder for groups parsed in getCommittersAndPMC()
+
+def getCommittersAndPMC():
+global groups
+try:
+response = urllib.urlopen(groups_url)
--- End diff --

It is not really necessary to use global to read variables, is there a 
reason you want it to be?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[DISCUSS] How to list PMC and Committers on our Web Site

2015-08-27 Thread Erik Weber
Previously[1] committers and PMC members have been listed separately,
meaning, if you were PMC you weren't listed on the committers list.

With the commit from Rohit[2] this changed, to listing PMC as both.

This has led to some discrepany as some do it one way, and others do it
another way.
No matter how we end up doing it, we should be consistent about it.

I think showing PMC members as both are fine, this is also in sync with how
projects.apache.org[3] and other ASF sites do it.

I went ahead and made a simple python tool[4] to generate the list, parsed
from projects.apache.org.
This does not require any ASF privileges, and can be used by anyone.
Currently it will list PMC as both, but this can easily be changed if we
want it some other way.


[1]
https://github.com/apache/cloudstack-www/commit/64ae3ad7680a043ddb65156436e6a48434711018
[2]
https://github.com/apache/cloudstack-www/commit/3458edbfb0612e1dfaae92b01ca32256f640bbac
[3] https://projects.apache.org/committee.html?cloudstack
[4] https://github.com/apache/cloudstack-www/pull/14

-- 
Erik


[GitHub] cloudstack-www pull request: Python script to generate pmc and com...

2015-08-27 Thread sedukull
Github user sedukull commented on a diff in the pull request:

https://github.com/apache/cloudstack-www/pull/14#discussion_r38068366
  
--- Diff: makewholist.py ---
@@ -0,0 +1,68 @@
+#!/usr/bin/env python
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#   http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied.  See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+import json
+import sys
+import urllib
+
+groups_url = "https://projects.apache.org/json/foundation/groups.json";
+names_url = "https://projects.apache.org/json/foundation/people_name.json";
+
+names = {}   # Placeholder for names parsed in getNames()
+groups = {}  # Placeholder for groups parsed in getCommittersAndPMC()
+
+def getCommittersAndPMC():
+global groups
+try:
+response = urllib.urlopen(groups_url)
+groups = json.loads(response.read())
+except Exception, e:
+print "Error during groups JSON download or parsing: %s" % 
e.message
+
+def getNames():
+global names
+try:
+response = urllib.urlopen(names_url)
--- End diff --

use global names_url here as well.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack-www pull request: Python script to generate pmc and com...

2015-08-27 Thread sedukull
Github user sedukull commented on a diff in the pull request:

https://github.com/apache/cloudstack-www/pull/14#discussion_r38068341
  
--- Diff: makewholist.py ---
@@ -0,0 +1,68 @@
+#!/usr/bin/env python
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#   http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied.  See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+import json
+import sys
+import urllib
+
+groups_url = "https://projects.apache.org/json/foundation/groups.json";
+names_url = "https://projects.apache.org/json/foundation/people_name.json";
+
+names = {}   # Placeholder for names parsed in getNames()
+groups = {}  # Placeholder for groups parsed in getCommittersAndPMC()
+
+def getCommittersAndPMC():
+global groups
+try:
+response = urllib.urlopen(groups_url)
--- End diff --

mention global for groups_url as well.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack-www pull request: Python script to generate pmc and com...

2015-08-27 Thread terbolous
Github user terbolous commented on the pull request:

https://github.com/apache/cloudstack-www/pull/14#issuecomment-135317900
  
As mentioned in #13, I went ahead and made a script that does not rely on 
any ASF privileges.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] cloudstack-www pull request: Python script to generate pmc and com...

2015-08-27 Thread terbolous
GitHub user terbolous opened a pull request:

https://github.com/apache/cloudstack-www/pull/14

Python script to generate pmc and commiter list

Made a small tool to create pmc and committer list by parsing the JSON
files on projects.apache.org.
This is accessible by anyone and does not require any ASF privileges.

Usage: python makewholist.py

Only dependencies are json, urllib and sys, which should be included by
default on most systems.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/terbolous/cloudstack-www master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/cloudstack-www/pull/14.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #14


commit c264a70f094ee419d224e362bdaf26f9603da33b
Author: Erik Weber 
Date:   2015-08-27T07:12:01Z

Python script to generate pmc and commiter list

Made a small tool to create pmc and committer list by parsing the JSON
files on projects.apache.org.
This is accessible by anyone and does not require any ASF privileges.

Usage: python makewholist.py

Only dependencies are json, urllib and sys, which should be included by
default on most systems.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---