Re: [Openstack-operators] [User-committee] [Fault Genes] WG Meeting Summary

2016-11-23 Thread Nematollah Bidokhti 
​I'm very interested to know if there is data from stackoverflow which other 
groups could use, is there a place where this data is being collected or easily 
queried.  Specifically, I'm wondering if there is data pertaining the DevOpps 
or CloudApp communities which might be sought?​

We will bring in the data from Stackoverflow and other sources to our database 
where you will be able to run queries. The Stackoverflow data is not as crisp 
as you might find in Launchpad. We are going to run some scripts that will grab 
info based on keywords.

BTW, we would like to have the opportunity to work with Operators where we can 
receive OpenStack bugs and mitigations data.

In addition, we are interested in the OpenStack tribal knowledge where they did 
not become bugs in Launchpad, but annoying enough that needs to be addressed.

​Interesting, what would be the audience/intended topic of the whitepaper?
The goal is to make it interesting enough so developers and operators can 
benefit from the concept.

Nemat


From: David F Flanders [mailto:fland...@openstack.org]
Sent: Wednesday, November 23, 2016 2:02 PM
To: Nematollah Bidokhti
Cc: openstack-operators@lists.openstack.org; user-commit...@lists.openstack.org
Subject: Re: [User-committee] [Fault Genes] WG Meeting Summary

Great to see the summary on-list here Nemat (nice work modelling good behaviour 
for other WG chairs), especially for folk on this side of the planet who are 
unable to attend the meeting given timezones.
Comments/questions inline below:

On Thu, Nov 24, 2016 at 5:41 AM, Nematollah Bidokhti 
mailto:nematollah.bidok...@huawei.com>> wrote:
Hi All,

Following is the meeting summary:

-  Launchpad data transformation to Fault Genes database

o   Discussed the design of a new web based database where we can upload info 
and query the database

o   Suli: will develop the database and he will be sending out the plans so all 
team members can review and provide their feedback

o   Michael: will port the latest image of the Launchpad database. He will 
ensure that we bring in all the related fields.

o   Jinzhang mentioned that for the data analysis is best to have the data in 
.csv format

-  Stackoverflow data capture

o   Michael is still working on extracting the applicable data from 
Stackoverflow site that could be used in conjunction with our Launchpad or 
other sources of data

o   He will use the input provided by Zsolt and create the environment on his 
MAC

​I'm very interested to know if there is data from stackoverflow which other 
groups could use, is there a place where this data is being collected or easily 
queried.  Specifically, I'm wondering if there is data pertaining the DevOpps 
or CloudApp communities which might be sought?​


-  User Interface for Operators

o   Suli will create the UI as part of his website design

o   We need to brainstorm on what is the best format to communicate with the 
users

-  Machine learning analysis process

o   Jinzhang provided valuable insights on how we can approach the machine 
learning in our application

o   He mentioned that this is a challenging machine learning project since it 
needs to be applied to natural language instead of some numbers or metrics

o   He suggested to create a training data set which will require OpenStack 
experts

o   For the 1st version of the data we will focus on extracting the fault 
classification first

o   Then share this info with the community and get feedback from appropriate 
experts

-  Collaboration with other projects such as Congress

o   Nemat is communicating with the Congress PTL on future collaboration and 
how Fault Genes data and output can support other projects

-  White Paper

o   Anni Lai suggested to write a white paper to help the community become more 
familiar on the concept that we working towards

o   Team agreed to support this effort

o   Nemat will put together the template and start the paper

o   The team will each contribute based on their areas of expertise
​Interesting, what would be the audience/intended topic of the whitepaper?
/
​dff​

Thanks,

Nemat Bidokhti
Chief Architect, Cloud Resiliency
IT Product Line, Computing Lab
Futurewei Technologies, Inc.
HUAWEI R&D USA
Tel: +1-408-330-4714
Cell:   +1-408-528-4909
Fax:+1-408-330-5088
E-mail: nematollah.bidok...@huawei.com
2330 Central Expressway
Santa Clara, CA 95050
http://www.huawei.com


___
User-committee mailing list
user-commit...@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/user-committee



--
Flanders | OpenStack Foundation | Community Manager (Cloud Application 
Communities)
http://superuser.openstack.org/articles/meet-openstack-s-community-wrangler-david-flanders
___
OpenStack-operat

[Openstack-operators] openstack sdk: how to update image (create image with properties)

2016-11-23 Thread George Shuklin 

Hello.

I'm trying to use openstack SDK in my python code.

I want to upload image and set few properties. And I can't.

My code (without properties):

from openstack import connection
import os
con=connection.Connection(auth_url=os.environ['OS_AUTH_URL'], 
project_name = os.environ['OS_TENANT_NAME'], 
username=os.environ['OS_USERNAME'], password=os.environ['OS_PASSWORD']
con.image.upload_image(name='killme', data=file('/tmp/1','r'), 
disk_format="qcow2", container_format="bare")



with properties (few different attempts):

con.image.upload_image(name='killme', data=file('/tmp/1','r'), 
disk_format="qcow2", container_format="bare", foo="bar")  #ignored


con.image.upload_image(name='killme', data=file('/tmp/1','r'), 
disk_format="qcow2", container_format="bare", properties="foo=bar")  
#set property 'properties' to 'foo=bar'


con.image.upload_image(name='killme', data=file('/tmp/1','r'), 
disk_format="qcow2", container_format="bare", properties={"foo":"bar"})  
#return http error



How can I set properties for images via openstack SDK? This behavior is 
bug or feature?



___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

[Openstack-operators] [Fault Genes] WG Meeting Summary

2016-11-23 Thread Nematollah Bidokhti 
Hi All,

Following is the meeting summary:

-  Launchpad data transformation to Fault Genes database

o   Discussed the design of a new web based database where we can upload info 
and query the database

o   Suli: will develop the database and he will be sending out the plans so all 
team members can review and provide their feedback

o   Michael: will port the latest image of the Launchpad database. He will 
ensure that we bring in all the related fields.

o   Jinzhang mentioned that for the data analysis is best to have the data in 
.csv format

-  Stackoverflow data capture

o   Michael is still working on extracting the applicable data from 
Stackoverflow site that could be used in conjunction with our Launchpad or 
other sources of data

o   He will use the input provided by Zsolt and create the environment on his 
MAC

-  User Interface for Operators

o   Suli will create the UI as part of his website design

o   We need to brainstorm on what is the best format to communicate with the 
users

-  Machine learning analysis process

o   Jinzhang provided valuable insights on how we can approach the machine 
learning in our application

o   He mentioned that this is a challenging machine learning project since it 
needs to be applied to natural language instead of some numbers or metrics

o   He suggested to create a training data set which will require OpenStack 
experts

o   For the 1st version of the data we will focus on extracting the fault 
classification first

o   Then share this info with the community and get feedback from appropriate 
experts

-  Collaboration with other projects such as Congress

o   Nemat is communicating with the Congress PTL on future collaboration and 
how Fault Genes data and output can support other projects

-  White Paper

o   Anni Lai suggested to write a white paper to help the community become more 
familiar on the concept that we working towards

o   Team agreed to support this effort

o   Nemat will put together the template and start the paper

o   The team will each contribute based on their areas of expertise

Thanks,

Nemat Bidokhti
Chief Architect, Cloud Resiliency
IT Product Line, Computing Lab
Futurewei Technologies, Inc.
HUAWEI R&D USA
Tel: +1-408-330-4714
Cell:   +1-408-528-4909
Fax:+1-408-330-5088
E-mail: nematollah.bidok...@huawei.com
2330 Central Expressway
Santa Clara, CA 95050
http://www.huawei.com

___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

[Openstack-operators] [openstack-ansible] tenant VLAN overlays

2016-11-23 Thread Charles Short 

Hi,

I am looking at openstack-ansible and would like to deploy using tenant 
VLAN overlays rather than VXLAN


I have read here however that the VXLAN bridge is mandatory

http://docs.openstack.org/developer/openstack-ansible/liberty/install-guide/overview-hostnetworking.html
>>
OpenStack Networking tunnel/overlay br-vxlan:

 * Mandatory.

<<

Is this still the case with Newton?


Thanks

Charles

--
Charles Short
Cloud Engineer
Virtualization and Cloud Team
European Bioinformatics Institute (EMBL-EBI)
Tel: +44 (0)1223 494205

___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

[Openstack-operators] [telemetry][ceilometer] problem about measures

2016-11-23 Thread 张 盛平 




Hello everyone,

I was reading the Measurements doc today, I got a bit confused about some 
measurements. such as :

disk.capacity and disk.device.capacity

   the disk.capacity explanation: The amount of disk that the instance can 
see.

   the disk.device.capacity explanation: The amount of disk per device that 
the instance can see.


I do not know what is the ‘device’ here.


I grap the disk info here:



DiskInfoData(capacity=21475325952L, allocation=19580554752L, 
physical=21475325952L, per_disk_info={'allocation': {'vda': 19580554752L, 
'hdd': 0L}, 'capacity': {'vda': 21474836480L, 'hdd': 489472L}, 'physical': 
{'vda': 21474836480L, 'hdd': 489472L}})


are these vda and hdd  stand for different device?



what is the different between disk  and disk.device? could you give me some 
helps?


Best regards

Shengping

___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

Re: [Openstack-operators] Snapshot residual data cleaning

2016-11-23 Thread Jack Gao 
Thank you for your advice.

In our production environment, is using the RPM by puppet to deploy based
environment.But there are still a few projects due to the deployment cost
is higher, so choose the snapshot.Actually it's more like image of a
disguised form.

2016-11-22 20:39 GMT+08:00 Saverio Proto :

> Hello,
>
> snapshot are meant to be backups.
> I would not install software on a machine, and then use the snapshot
> as a glance image to start many new instances.
>
> you could just create machines with a clean glance image and install
> the necessary software with ansible/puppet
>
> if the installation time at boot is too long, you could create glance
> images with the software you need with the diskimage-builder creating
> a new dib.
>
> Look at this example of a ubuntu glance image with zeppelin and spark
> preinstalled:
> https://github.com/switch-ch/diskimage-builder/tree/
> SWITCHengines/elements/zeppelin
>
> Saverio
>
>
> 2016-11-22 7:44 GMT+01:00 Jack Gao :
> > Hi everyone，
> >
> > I am using a virtual machine to create a snapshot, and then use this
> > snapshot to create other virtual machines.Will encounter residual data
> > didn't clean the problem, this will lead to network card information is
> > inaccurate, puppet certificate conflict etc.
> >
> > The current practice is to use the sys-virtprep tools manual cleaning,
> > within the opesntack system, whether to have a better solution?
> >
> > Regards.
> >
> > ___
> > OpenStack-operators mailing list
> > OpenStack-operators@lists.openstack.org
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
> >
>
___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators