Re: [Engine-devel] about govirt

2013-06-05 Thread wlbleaboy@126
En, yes, and choice a better one.

-Original Message-
From: Itamar Heim [mailto:ih...@redhat.com] 
Sent: Wednesday, June 05, 2013 2:58 PM
To: wlbleaboy@126
Cc: cferg...@redhat.com; engine-devel@ovirt.org; 'Michael Pasternak'
Subject: Re: [Engine-devel] about govirt

On 06/05/2013 09:43 AM, wlbleaboy@126 wrote:
> Hi, Itamar Heim:
>   I used ovirit-engine-sdk-python to connect ovirt-engine and get vms
> It's about 20 seconds, so I felt it's slow.

and just to compare, how much time does a curl/wget takes you?

>
>   I have build govirt success, but how can I use it, I give
> REST_URI="https://192.168.1.201/api";,
> and proxy = ovirt_proxy_new(REST_URI) always return NULL;
>
> -Original Message-
> From: Itamar Heim [mailto:ih...@redhat.com]
> Sent: Wednesday, June 05, 2013 5:29 AM
> To: wlbleaboy@126
> Cc: cferg...@redhat.com; engine-devel@ovirt.org; Michael Pasternak
> Subject: Re: [Engine-devel] about govirt
>
> On 06/04/2013 01:23 PM, wlbleaboy@126 wrote:
>> Hi, cfergeau:
>>
>>Recently, I do something about ovirt-engine-sdk, I just want
to
>>
>> console a vm via sdk, but I found the sdk implemented by python is
>>
>> so slowly, so I want to build a simple sdk use C to do that,
>
> Can you please share more info on what do you mean by "slow"?
>
> Thanks,
>  Itamar
>
>>
>>before I do it, I found the code govirt you worte, I felt
>> luckly, you
>>
>> had do that. So I got the code, but when I build it on ubuntu, it's
failed
>>
>> I used autogen.sh , but got the error message
>>
>> like:
>>
>>configure: error: Package requirements (rest-0.7 >= 0.7.13)
>> were not met:
>>
>> No package 'rest-0.7' found
>>
>>Because I didn't familiar with autogen and configure, such gnu
>> build tools,
>>
>>
>>
>> ___
>> Engine-devel mailing list
>> Engine-devel@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/engine-devel
>>
>
>


___
Engine-devel mailing list
Engine-devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/engine-devel


Re: [Engine-devel] about govirt

2013-06-05 Thread Michael Pasternak
On 06/05/2013 09:43 AM, wlbleaboy@126 wrote:
> Hi, Itamar Heim:
>   I used ovirit-engine-sdk-python to connect ovirt-engine and get vms
> It's about 20 seconds, so I felt it's slow.

20 seconds? How much VMs did you fetched?, How do you measure the time?, can i 
see your code?

> 
>   I have build govirt success, but how can I use it, I give
> REST_URI="https://192.168.1.201/api";,
> and proxy = ovirt_proxy_new(REST_URI) always return NULL;
> 
> -Original Message-
> From: Itamar Heim [mailto:ih...@redhat.com] 
> Sent: Wednesday, June 05, 2013 5:29 AM
> To: wlbleaboy@126
> Cc: cferg...@redhat.com; engine-devel@ovirt.org; Michael Pasternak
> Subject: Re: [Engine-devel] about govirt
> 
> On 06/04/2013 01:23 PM, wlbleaboy@126 wrote:
>> Hi, cfergeau:
>>
>>   Recently, I do something about ovirt-engine-sdk, I just want to
>>
>> console a vm via sdk, but I found the sdk implemented by python is
>>
>> so slowly, so I want to build a simple sdk use C to do that,
> 
> Can you please share more info on what do you mean by "slow"?
> 
> Thanks,
> Itamar
> 
>>
>>   before I do it, I found the code govirt you worte, I felt
>> luckly, you
>>
>> had do that. So I got the code, but when I build it on ubuntu, it's failed
>>
>> I used autogen.sh , but got the error message
>>
>> like:
>>
>>   configure: error: Package requirements (rest-0.7 >= 0.7.13)
>> were not met:
>>
>> No package 'rest-0.7' found
>>
>>   Because I didn't familiar with autogen and configure, such gnu
>> build tools,
>>
>>
>>
>> ___
>> Engine-devel mailing list
>> Engine-devel@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/engine-devel
>>
> 
> 


-- 

Michael Pasternak
RedHat, ENG-Virtualization R&D
___
Engine-devel mailing list
Engine-devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/engine-devel


Re: [Engine-devel] Failed to configure management network on the host

2013-06-05 Thread Sahina Bose

Thanks! will check it out.
On 06/04/2013 07:49 PM, Moti Asayag wrote:

Hi Sahina,

I was able to reproduce it on my setup, it seems that when a host was
already installed and the user re-installed it, it failed to check the
host availability.

I fixed the host polling by the engine by commit
5c03a936df3a09473f1a05b973680c02280d7a5c.

You can either build from master or wait for the nightly build.
Please let me know if there are more issues.

Thanks,
Moti

On 06/04/2013 12:03 PM, Sahina Bose wrote:

Hi Moti,

Had to reproduce this again to get the logs. Attached both engine and
vdsm logs.

engine:
[org.ovirt.engine.core.vdsbroker.vdsbroker.CollectVdsNetworkDataVDSCommand]
(pool-4-thread-4) [59b99e5d] Command CollectVdsNetworkDataVDS execution
failed. Exception: VDSNetworkException: java.net.ConnectException:
Connection refused

vdsm (based on flow id 59b99e5d) - no entries found.

However there's a line (without any flowId) -
Thread-13::DEBUG::2013-06-04
14:21:05,227::BindingXMLRPC::913::vds::(wrapper) client
[10.70.42.245]::call getCapabilities with () {}

thanks
sahina


On 06/04/2013 01:45 PM, Moti Asayag wrote:

On 06/04/2013 09:52 AM, Sahina Bose wrote:

Hi Moti,

Not sure I understand your comment about host activation flow.
commit bdd8966d97e1e02e775ee6f755d0a3637a668911  (engine: Remove mgmt
network setup from host activation) is present in our code base, but we
were not using the host activation flow.

Hi,

My fault, i had a different old thread in my mind.

The relevant part from the engine.log indicates that the host deployment
ended successfully, host was able to ping VDSM, but the first attempt to
run getVdsCaps on vdsm failed.

Could you add the relevant vdsm.log which contains the flow-ID 740c5292
which matches the same correlation-id from the engine.log ?


2013-06-03 20:06:49,638 INFO
[org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation
10.70.43.140: Stage: Termination
2013-06-03 20:06:49,881 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand]
(pool-4-thread-48) [740c5292] java.util.concurrent.ExecutionException:
java.lang.reflect.InvocationTargetException
2013-06-03 20:06:49,882 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand]
(pool-4-thread-48) [740c5292] Command PollVDS execution failed.
Exception: RuntimeException: java.util.concurrent.ExecutionException:
java.lang.reflect.InvocationTargetException
2013-06-03 20:06:50,382 INFO
[org.ovirt.engine.core.bll.network.NetworkConfigurator]
(pool-4-thread-48) [740c5292] Engine managed to communicate with VDSM
agent on host s2
2013-06-03 20:06:50,393 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.CollectVdsNetworkDataVDSCommand]

(pool-4-thread-48) [740c5292] Command CollectVdsNetworkDataVDS execution
failed. Exception: VDSNetworkException: java.net.ConnectException:
Connection refused

Thanks,
Moti


Here's what we tried to do.
Add a host (with vdsm 4.10.2 installed) to engine (built from Jun 2
upstream codebase).

The installation failed with "Failed to configure manamgent network on
the host"

and the logs had this

2013-06-03 19:49:03,390 INFO
[org.ovirt.engine.core.bll.network.NetworkConfigurator]
(pool-4-thread-50) [7bf46c88] Engine managed to communicate with VDSM
agent on host s1
2013-06-03 19:49:03,412 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.CollectVdsNetworkDataVDSCommand]

(pool-4-thread-50) [7bf46c88] Command CollectVdsNetworkDataVDS execution
failed. Exception: VDSNetworkException: java.net.ConnectException:
Connection refused

As Kanagaraj mentioned, reverting the Change Iaf82e104: engine:
Allow engine to configure management network , fixed this issue.

  From the flowchart on
http://www.ovirt.org/Features/Normalized_ovirtmgmt_Initialization, it
seems to fail on the "Configure Management Network (by setup networks)"
action.

Any help on solving this would be appreciated.

thanks
sahina



On 06/04/2013 11:53 AM, Moti Asayag wrote:

Hi,

Same host activation flow should work on the master as well as the
management network will not be created as part of the host activation.
So reverted changes were already merged by commit
bdd8966d97e1e02e775ee6f755d0a3637a668911

For more details about host installation see:
http://www.ovirt.org/Features/Normalized_ovirtmgmt_Initialization

Thanks,
Moti

See
On 06/04/2013 08:51 AM, Kanagaraj wrote:

Host installation went through successfully after reverting the change
eca95e192ebf3e1fe0e9440bb8fac694214ca8fd (Change Iaf82e104: engine:
Allow engine to configure management network ).

Thanks,
Kanagaraj

On 06/04/2013 12:23 AM, Dead Horse wrote:

Seeing this as well but during host activation with latest master
vdsm/engine.
-->
http://lists.ovirt.org/pipermail/engine-devel/2013-June/004752.html



On Mon, Jun 3, 2013 at 9:45 AM, Kanagaraj mailto:kmayi...@redhat.com>> wrote:

   Hi,

After adding a host to a 3.2 cluster, bootstrap went
through fine
   and in the end it failed with the following error.

   "Host s2 installati

Re: [Engine-devel] Network Quality of Service 3.3 - Feature design

2013-06-05 Thread Doron Fediuck
- Original Message -
> From: "Livnat Peer" 
> To: "Ofri Masad" 
> Cc: "engine-devel" 
> Sent: Tuesday, June 4, 2013 12:02:35 PM
> Subject: Re: [Engine-devel] Network Quality of Service 3.3 - Feature design
> 
> On 06/02/2013 09:58 AM, Ofri Masad wrote:
> > Hi all,
> > 
> > A new Feature page for "Network Quality of Service" feature was published.
> > 
> > http://www.ovirt.org/Features/Design/Network_QoS
> > 
> > You are more than welcome to share you thoughts and insights.
> > 
> 
> 
> Hi Ofri,
> 
> Here is another suggestion for you to consider, this suggestion is
> realted only to QoS on the VNIC level -
> 
> Introducing a new entity - VNIC Profile.
> The VNIC profile would include all the properties of a VNIC:
>  - network,
>  - Qos,
>  - Port mirroring,
>  - custom properties
> 
> From now on a user would choose a VNIC profile when he defines a VNIC
> (instead of choosing a network and defining properties directly on the VNIC)
> 
> A network could have multiple profiles defined on it.
> 
> A User would need permissions to use a profile instead of the current
> state that we require permission to use a network.
> 
> The benefits of this approach :
> 
> 1. Limiting the user to a specific QoS on a network is easy you give the
> user permission to use a specific profile.
> 
> 2. A user can add a new VNIC but he would be limited to QoS defined on
> the profile he is able to use (which eliminates the problem that a user
> can add a VNIC to it's VM but won't get any bandwidth limitations).
> 
> 3. An administrator does not add VNIC QoS properties on the network
> entity (to serve as defaults) which are not relevant for non-VM network.
> 
> 4. The network admin who creates the VNIC profile is also the one who
> can configure the QoS to that Network.
> 
> 5. The separation between user portal and admin portal is very clear, in
> user portal we expose only the profile name and in the admin portal a
> user can view the profile details.
> 
> 6. We would leave custom properties also on the VNIC level not only the
> profile level so a user can send VM specific data.
> 
> 7.I can also describe upgrade path but maybe we should discuss the
> general concept before diving into the details.
> 

Hi Livnat,
This design creates a new feature of network profile, which has QoS
included in it, so it's bigger the the original intention. Having that
said, I agree with the concept as we need to take a more holistic
approach which considers other areas of the system, such as SLA policies
and instance types.

So in this view I'll just add that going forward the QoS element of the
profile will be a reference to a policy entity which will include network
QoS as well as other QoS elements.

At this point we're going back to the drawing board to update the design
and will publish an update asap.

Doron

> 
> Livnat
> 
> 
> 
> > Thanks,
> > Ofri.
___
Engine-devel mailing list
Engine-devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/engine-devel


Re: [Engine-devel] about govirt

2013-06-05 Thread wlbleaboy@126
I build a local sdk base on ovirt-engine-sdk-python, I do that like this:

First, I created a python file naked wrap.py, in wrap.py I have 
a class naked CWrap , CWrap have some interface for get vm's information
and connect to ovirt-enginelike:
login(), getVmName(), getVmId(), getVmPort(), getVmTicket() etc.

second, I created a C file named engine-sdk.c, in this file I also implement

some interface like getVmName() etc. but in this file, all the function is 
call python module like 
PyObject *pyVmId;
char *vmId;

pyVmId = PyObject_CallMethod(pInstant, "getVmId", "(i)", vmIndex);

if(pyVmId == NULL)
{
DBG("ERROR:Call py Method getVmDisplayType is failed!\n");
return NULL;
}

vmId = PyString_AsString(pyVmId);

so, the local sdk is used for a client(C/S ) implemented by gtk.

Every time, when I use my client login and get vms's information, it's about
10~20 seconds.

-Original Message-
From: Michael Pasternak [mailto:mpast...@redhat.com] 
Sent: Wednesday, June 05, 2013 3:14 PM
To: wlbleaboy@126
Cc: 'Itamar Heim'; cferg...@redhat.com; engine-devel@ovirt.org
Subject: Re: [Engine-devel] about govirt

On 06/05/2013 09:43 AM, wlbleaboy@126 wrote:
> Hi, Itamar Heim:
>   I used ovirit-engine-sdk-python to connect ovirt-engine and get vms
> It's about 20 seconds, so I felt it's slow.

20 seconds? How much VMs did you fetched?, How do you measure the time?, can
i see your code?

> 
>   I have build govirt success, but how can I use it, I give
> REST_URI="https://192.168.1.201/api";,
> and proxy = ovirt_proxy_new(REST_URI) always return NULL;
> 
> -Original Message-
> From: Itamar Heim [mailto:ih...@redhat.com] 
> Sent: Wednesday, June 05, 2013 5:29 AM
> To: wlbleaboy@126
> Cc: cferg...@redhat.com; engine-devel@ovirt.org; Michael Pasternak
> Subject: Re: [Engine-devel] about govirt
> 
> On 06/04/2013 01:23 PM, wlbleaboy@126 wrote:
>> Hi, cfergeau:
>>
>>   Recently, I do something about ovirt-engine-sdk, I just want to
>>
>> console a vm via sdk, but I found the sdk implemented by python is
>>
>> so slowly, so I want to build a simple sdk use C to do that,
> 
> Can you please share more info on what do you mean by "slow"?
> 
> Thanks,
> Itamar
> 
>>
>>   before I do it, I found the code govirt you worte, I felt
>> luckly, you
>>
>> had do that. So I got the code, but when I build it on ubuntu, it's
failed
>>
>> I used autogen.sh , but got the error message
>>
>> like:
>>
>>   configure: error: Package requirements (rest-0.7 >= 0.7.13)
>> were not met:
>>
>> No package 'rest-0.7' found
>>
>>   Because I didn't familiar with autogen and configure, such gnu
>> build tools,
>>
>>
>>
>> ___
>> Engine-devel mailing list
>> Engine-devel@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/engine-devel
>>
> 
> 


-- 

Michael Pasternak
RedHat, ENG-Virtualization R&D


___
Engine-devel mailing list
Engine-devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/engine-devel


[Engine-devel] if there is a updated debug environment how to?

2013-06-05 Thread bigclouds
hi, engine guys:
i want to make a engine debug environment for a looong time, due to all kinds 
of reasons i have not made it.
now i still have the need for a debug environment. (it seems like that i am 
keeped away from you all)
if  there is a updated doc  for building engine debug environment?
 
thanks so much.___
Engine-devel mailing list
Engine-devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/engine-devel


Re: [Engine-devel] about govirt

2013-06-05 Thread Michael Pasternak
On 06/05/2013 10:51 AM, wlbleaboy@126 wrote:
> I build a local sdk base on ovirt-engine-sdk-python, I do that like this:
> 
> First, I created a python file naked wrap.py, in wrap.py I have 
> a class naked CWrap , CWrap have some interface for get vm's information
> and connect to ovirt-enginelike:
> login(), getVmName(), getVmId(), getVmPort(), getVmTicket() etc.
> 
> second, I created a C file named engine-sdk.c, in this file I also implement
> 
> some interface like getVmName() etc. but in this file, all the function is 
> call python module like 
>   PyObject *pyVmId;
> char *vmId;
> 
> pyVmId = PyObject_CallMethod(pInstant, "getVmId", "(i)", vmIndex);
> 
> if(pyVmId == NULL)
> {
> DBG("ERROR:Call py Method getVmDisplayType is failed!\n");
> return NULL;
> }
> 
> vmId = PyString_AsString(pyVmId);
> 
> so, the local sdk is used for a client(C/S ) implemented by gtk.
> 
> Every time, when I use my client login and get vms's information, it's about
> 10~20 seconds.

i'm confused, are you mixing python with c? so what is CWrap/wrap.py from 
python?
can you post theirs code?

> 
> -Original Message-
> From: Michael Pasternak [mailto:mpast...@redhat.com] 
> Sent: Wednesday, June 05, 2013 3:14 PM
> To: wlbleaboy@126
> Cc: 'Itamar Heim'; cferg...@redhat.com; engine-devel@ovirt.org
> Subject: Re: [Engine-devel] about govirt
> 
> On 06/05/2013 09:43 AM, wlbleaboy@126 wrote:
>> Hi, Itamar Heim:
>>  I used ovirit-engine-sdk-python to connect ovirt-engine and get vms
>> It's about 20 seconds, so I felt it's slow.
> 
> 20 seconds? How much VMs did you fetched?, How do you measure the time?, can
> i see your code?
> 
>>
>>  I have build govirt success, but how can I use it, I give
>> REST_URI="https://192.168.1.201/api";,
>> and proxy = ovirt_proxy_new(REST_URI) always return NULL;
>>
>> -Original Message-
>> From: Itamar Heim [mailto:ih...@redhat.com] 
>> Sent: Wednesday, June 05, 2013 5:29 AM
>> To: wlbleaboy@126
>> Cc: cferg...@redhat.com; engine-devel@ovirt.org; Michael Pasternak
>> Subject: Re: [Engine-devel] about govirt
>>
>> On 06/04/2013 01:23 PM, wlbleaboy@126 wrote:
>>> Hi, cfergeau:
>>>
>>>   Recently, I do something about ovirt-engine-sdk, I just want to
>>>
>>> console a vm via sdk, but I found the sdk implemented by python is
>>>
>>> so slowly, so I want to build a simple sdk use C to do that,
>>
>> Can you please share more info on what do you mean by "slow"?
>>
>> Thanks,
>> Itamar
>>
>>>
>>>   before I do it, I found the code govirt you worte, I felt
>>> luckly, you
>>>
>>> had do that. So I got the code, but when I build it on ubuntu, it's
> failed
>>>
>>> I used autogen.sh , but got the error message
>>>
>>> like:
>>>
>>>   configure: error: Package requirements (rest-0.7 >= 0.7.13)
>>> were not met:
>>>
>>> No package 'rest-0.7' found
>>>
>>>   Because I didn't familiar with autogen and configure, such gnu
>>> build tools,
>>>
>>>
>>>
>>> ___
>>> Engine-devel mailing list
>>> Engine-devel@ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/engine-devel
>>>
>>
>>
> 
> 


-- 

Michael Pasternak
RedHat, ENG-Virtualization R&D
___
Engine-devel mailing list
Engine-devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/engine-devel


Re: [Engine-devel] Performance and scalability

2013-06-05 Thread Eli Mesika


- Original Message -
> From: "Liran Zelkha" 
> To: "Laszlo Hornyak" 
> Cc: "engine-devel" 
> Sent: Tuesday, June 4, 2013 5:27:25 PM
> Subject: Re: [Engine-devel] Performance and scalability
> 
> Hi Laszlo
> 
> I 100% agree with both of your remarks.
> Caching is caching the entities, but also attempting to cache the list of
> entities.
> Batch updates is done as an infrastructure (change was reviewed and now in
> fixes) and after that - we can start using it everywhere.
> 
> - Original Message -
> From: "Laszlo Hornyak" 
> To: "Liran Zelkha" 
> Cc: "engine-devel" 
> Sent: Tuesday, June 4, 2013 5:01:37 PM
> Subject: Re: [Engine-devel] Performance and scalability
> 
> Hi Liran,
> 
> Some comments to start the discussion:
> - Caching: exactly how is this resultset caching going to work? Wouldnt it be
> more simple to just cache the mapped entities? The mapping is not a big
> overhead, but caching the resultset seems to be difficult.
> - Batch updates: sounds cool, transactions are a major overhead on
> performance, so if you can make the update in a single tx and few
> interactions that will rock, but what if we keep the dynamic and statistic
> data in the memory at the first place and synchronize to DB on a background
> process. So that when you look for dynamic/statistics data, you do not have
> to hit the DB.
> 
> Thx,
> Laszlo
> 
> - Original Message -
> > From: "Liran Zelkha" 
> > To: "engine-devel" 
> > Sent: Tuesday, June 4, 2013 1:43:55 PM
> > Subject: [Engine-devel] Performance and scalability
> > 
> > Hi all,
> > 
> > I've added a new feature page for Performance and Scalability. Please
> > review
> > and add your ideas...
> > http://www.ovirt.org/Features/Performance_And_Scalability

Hi Liran

two comments 

1) fn_splitter has few variations (for uuid etc , so all should be handled)
2) Requirements / recommendations on the search engine queries

Thanks
Eli 


> > ___
> > Engine-devel mailing list
> > Engine-devel@ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/engine-devel
> > 
> ___
> Engine-devel mailing list
> Engine-devel@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/engine-devel
> 
___
Engine-devel mailing list
Engine-devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/engine-devel


Re: [Engine-devel] if there is a updated debug environment how to?

2013-06-05 Thread Eli Mesika


- Original Message -
> From: "bigclouds" 
> To: "engine-devel" 
> Sent: Wednesday, June 5, 2013 12:34:30 PM
> Subject: [Engine-devel] if there is a updated debug environment how to?
> 
> hi, engine guys:
> i want to make a engine debug environment for a looong time, due to all kinds
> of reasons i have not made it.
> now i still have the need for a debug environment. (it seems like that i am
> keeped away from you all)
> if there is a updated doc for building engine debug environment?
> thanks so much.
> 

Please follow Allon's B L doc on how to create a development environment 

http://www.ovirt.org/OVirt_Engine_Development_Environment


> 
> 
> ___
> Engine-devel mailing list
> Engine-devel@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/engine-devel
> 
___
Engine-devel mailing list
Engine-devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/engine-devel


[Engine-devel] cluster emulation mode feature

2013-06-05 Thread Roy Golan

Hi,

A new wiki has been published on Cluster Emulation mode 
http://www.ovirt.org/Cluster_emulation_modes


Please review.

Thanks,
Roy
___
Engine-devel mailing list
Engine-devel@ovirt.org
http://lists.ovirt.org/mailman/listinfo/engine-devel