Re: [openstack-dev] [Openstack][dev][Zuul] Merge Failed Error in CI - GitPython Error

2015-01-27 Thread Punith S
Hi the merge fail error that we reported in ubuntu 12.04 has been solved in
the new ubuntu 14.04 CI master setup.

many thanks to ramy on the update of the repo :)
https://github.com/rasselin/os-ext-testing

cheers!

On Fri, Jan 16, 2015 at 4:58 PM, Punith S punit...@cloudbyte.com wrote:


 Hi stackers,

 i'm running CI for openstack cinder patches, when zuul reads a new patch
 from gerrit, it tries to merge the patch to it's own cinder repo
 @/var/lib/zuul/git/openstack/cinder

 and returns the comment to gerrit saying


 hence it is failing to issue the tempest-job in jenkins via gearman !!!

 on checking the trace the error seems to come from GitPython 0.3.2.1
 ​
 the zuul/merger-debug log snapshot ref -
 http://paste.openstack.org/show/158218/

 *raise ValueError(Failed to parse line: %r % line) *

 *ValueError: Failed to parse line: 'Total 9 (delta 7), reused 9 (delta 7)'*
 '


 is this a problem of python git ?

 i'm using ubuntu 12.04 and git 1.7


 thanks

 regards,

 punith s
 cloudbyte.com



 --
 regards,

 punith s
 cloudbyte.com




-- 
regards,

punith s
cloudbyte.com
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Openstack][infra] Zuul-Merger Error in CI

2015-01-27 Thread Punith S
Hi the merge fail error that we reported in ubuntu 12.04 has been solved in
the new ubuntu 14.04 CI master setup.

many thanks to ramy on the update of the repo :)
https://github.com/rasselin/os-ext-testing

cheers!

On Thu, Jan 8, 2015 at 7:16 PM, Punith S punit...@cloudbyte.com wrote:

 hi,

 i'm running CI for openstack cinder patches, when zuul reads a new patch
 from gerrit, it tries to merge the patch to it's own cinder repo
 @/var/lib/zuul/git/openstack/cinder

 and returns the comment to gerrit saying


 hence it is failing to issue the dsvm-tempest-job in jenkins via gearman
 !!!
 ​
 the zuul/merger-debug log sanpshot


 2015-01-08 19:03:43,320 DEBUG zuul.MergeServer: Got merge job.
 2015-01-08 19:03:43,321 DEBUG zuul.Merger: Merging for change 145778,1.
 2015-01-08 19:03:43,321 DEBUG zuul.Merger: Processing refspec
 refs/changes/78/145778/1 for project openstack/cinder / master ref
 Zbd4a4ad6ff3741c68ce382afa6d8df84
 2015-01-08 19:03:43,383 DEBUG zuul.Merger: Unable to find commit for ref
 master/Zbd4a4ad6ff3741c68ce382afa6d8df84
 2015-01-08 19:03:43,384 DEBUG zuul.Merger: No base commit found for
 (u'openstack/cinder', u'master')
 2015-01-08 19:03:43,384 DEBUG zuul.Repo: Resetting repository
 /var/lib/zuul/git/openstack/cinder
 2015-01-08 19:03:43,385 DEBUG zuul.Repo: Updating repository
 /var/lib/zuul/git/openstack/cinder
 2015-01-08 19:03:54,507 DEBUG zuul.Repo: Checking out
 5993660498f44e96b0f35ccc0f4d4a4c7b430363
 2015-01-08 19:04:02,685 ERROR zuul.Merger: Exception while merging a
 change:
 Traceback (most recent call last):
   File /usr/local/lib/python2.7/dist-packages/zuul/merger/merger.py,
 line 234, in _mergeChange
 commit = repo.merge(item['refspec'], 'resolve')
   File /usr/local/lib/python2.7/dist-packages/zuul/merger/merger.py,
 line 132, in merge
 self.fetch(ref)
   File /usr/local/lib/python2.7/dist-packages/zuul/merger/merger.py,
 line 145, in fetch
 origin.fetch(ref)
   File /usr/local/lib/python2.7/dist-packages/git/remote.py, line 598,
 in fetch
 return self._get_fetch_info_from_stderr(proc, progress or
 RemoteProgress())
   File /usr/local/lib/python2.7/dist-packages/git/remote.py, line 540,
 in _get_fetch_info_from_stderr
 for err_line, fetch_line in zip(fetch_info_lines, fetch_head_info))
   File /usr/local/lib/python2.7/dist-packages/git/remote.py, line 540,
 in genexpr
 for err_line, fetch_line in zip(fetch_info_lines, fetch_head_info))
   File /usr/local/lib/python2.7/dist-packages/git/remote.py, line 252,
 in _from_line
 raise ValueError(Failed to parse line: %r % line)
 ValueError: Failed to parse line: 'Total 7 (delta 5), reused 7 (delta 5)'


 is this a problem of python git ?

 i'm using ubuntu 12.04 and git 1.7


 thanks in advance
 --
 regards,

 punith s
 cloudbyte.com




-- 
regards,

punith s
cloudbyte.com
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help setting up CI

2015-01-16 Thread Punith S
.


 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
regards,

punith s
cloudbyte.com
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Openstack][dev][Zuul] Merge Failed Error in CI - GitPython Error

2015-01-16 Thread Punith S
Hi stackers,

i'm running CI for openstack cinder patches, when zuul reads a new patch
from gerrit, it tries to merge the patch to it's own cinder repo
@/var/lib/zuul/git/openstack/cinder

and returns the comment to gerrit saying


hence it is failing to issue the tempest-job in jenkins via gearman !!!

on checking the trace the error seems to come from GitPython 0.3.2.1
​
the zuul/merger-debug log snapshot ref -
http://paste.openstack.org/show/158218/

*raise ValueError(Failed to parse line: %r % line) *

*ValueError: Failed to parse line: 'Total 9 (delta 7), reused 9 (delta 7)'*'


is this a problem of python git ?

i'm using ubuntu 12.04 and git 1.7


thanks

regards,

punith s
cloudbyte.com



-- 
regards,

punith s
cloudbyte.com
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Cinder] how to delete a volume which is in error_deleting state

2015-01-04 Thread Punith S
Hi Eli,

you have to log-in to MySQL cinder database , and try deleting the required
volume from the volumes table using the id.
if it fails due to foreign key constraints in volume metadata table, try
deleting the corresponding volume metadata and then try to delete the
required volume row.

thanks

On Mon, Jan 5, 2015 at 7:22 AM, Eli Qiao ta...@linux.vnet.ibm.com wrote:


 hi all,
 how to delete a cinder volume which is in error_deleting status ?
 I don't find force delete options in 'cinder delete',  then how we fix it
 if we got such situation ?
 [tagett@stack-01 devstack]$ cinder list

 +--++-+--+-+--+--+
 |  ID  | Status | Name|
 Size | Volume Type | Bootable | Attached to  |

 +--++-+--+-+--+--+
 | 3e0acd0a-f28f-4fe3-b6e9-e65d5c40740b | in-use | with_cirros |
 4   | lvmdriver-1 |   true   | 428f0235-be54-462f-8916-f32965d42e63 |
 | 7039c683-2341-4dd7-a947-e35941245ec4 | error_deleting | None|
 4   | lvmdriver-1 |  false   |  |
 | d576773f-6865-4959-ba26-13602ed32e89 | error_deleting | None|
 4   | lvmdriver-1 |  false   |  |

 +--++-+--+-+--+--+
 [tagett@stack-01 devstack]$ cinder delete
 7039c683-2341-4dd7-a947-e35941245ec4
 Delete for volume 7039c683-2341-4dd7-a947-e35941245ec4 failed: Bad Request
 (HTTP 400) (Request-ID: req-e4d8cdd9-6ed5-4a7f-81de-7f38f2163d33)
 ERROR: Unable to delete any of specified volumes.

 --
 Thanks,
 Eli (Li Yong) Qiao


 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
regards,

punith s
cloudbyte.com
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help setting up CI

2014-12-26 Thread Punith S
hello,

i have setup the CI environment for our cloudbyte storage, running a master
jenkins vm and a slave node vm running devstack.

i have followed the jay's blog using asselin's scripts from github.

all i need to do is to test our cloudbyte cinder driver against the cinder
tempest suit.

currently the noop-check-communication job is coming of successfully on
openstack-dev/sandbox project

but the *dvsm full tempest *job is failing due to an error in failing to
upload the images to the glance service from swift.

how can i hack the dsvm tempest full job so that it only installs my
required services like cinder,nova,horizon etc. ?

does modifying the devstack gate scripts help ?

i'm attaching the links for the failure of dsvm-tempest-full job

devstacklog.txt - http://paste.openstack.org/show/154779/
devstack.txt.summary - http://paste.openstack.org/show/154780/

thanks




On Tue, Dec 23, 2014 at 8:46 PM, Asselin, Ramy ramy.asse...@hp.com wrote:

  You should use 14.04 for the slave. The limitation for using 12.04 is
 only for the master since zuul’s apache configuration is WIP on 14.04 [1],
 and zuul does not run on the slave.

 Ramy

 [1] https://review.openstack.org/#/c/141518/

 *From:* Punith S [mailto:punit...@cloudbyte.com]
 *Sent:* Monday, December 22, 2014 11:37 PM
 *To:* OpenStack Development Mailing List (not for usage questions)
 *Subject:* Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help
 setting up CI



 Hi Asselin,



 i'm following your readme https://github.com/rasselin/os-ext-testing

 for setting up our cloudbyte CI on two ubuntu 12.04 VM's(master and slave)



 currently the scripts and setup went fine as followed with the document.



 now both master and slave have been connected successfully, but in order
 to run the tempest integration test against our proposed cloudbyte cinder
 driver for kilo, we need to have devstack installed in the slave.(in my
 understanding)



 but on installing the master devstack i'm getting permission issues in
 12.04 in executing ./stack.sh since master devstack suggests the 14.04 or
 13.10 ubuntu. and on contrary running install_slave.sh is failing on 13.10
 due to puppet modules on found error.



  is there a way to get this work ?



 thanks in advance



 On Mon, Dec 22, 2014 at 11:10 PM, Asselin, Ramy ramy.asse...@hp.com
 wrote:

  Eduard,



 A few items you can try:

 1.   Double-check that the job is in Jenkins

 a.   If not, then that’s the issue

 2.   Check that the processes are running correctly

 a.   ps -ef | grep zuul

i.  Should
 have 2 zuul-server  1 zuul-merger

 b.  ps -ef | grep Jenkins

i.  Should
 have 1 /usr/bin/daemon --name=jenkins  1 /usr/bin/java

 3.   In Jenkins, Manage Jenkins, Gearman Plugin Config, “Test
 Connection”

 4.   Stop and Zuul  Jenkins. Start Zuul  Jenkins

 a.   service Jenkins stop

 b.  service zuul stop

 c.   service zuul-merger stop

 d.  service Jenkins start

 e.  service zuul start

 f.service zuul-merger start



 Otherwise, I suggest you ask in #openstack-infra irc channel.



 Ramy



 *From:* Eduard Matei [mailto:eduard.ma...@cloudfounders.com]
 *Sent:* Sunday, December 21, 2014 11:01 PM


 *To:* Asselin, Ramy
 *Cc:* OpenStack Development Mailing List (not for usage questions)
 *Subject:* Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help
 setting up CI



 Thanks Ramy,



 Unfortunately i don't see dsvm-tempest-full in the status output.

 Any idea how i can get it registered?



 Thanks,

 Eduard



 On Fri, Dec 19, 2014 at 9:43 PM, Asselin, Ramy ramy.asse...@hp.com
 wrote:

  Eduard,



 If you run this command, you can see which jobs are registered:

 telnet localhost 4730



 status



 There are 3 numbers per job: queued, running and workers that can run job.
 Make sure the job is listed  last ‘workers’ is non-zero.



 To run the job again without submitting a patch set, leave a “recheck”
 comment on the patch  make sure your zuul layout.yaml is configured to
 trigger off that comment. For example [1].

 Be sure to use the sandbox repository. [2]

 I’m not aware of other ways.



 Ramy



 [1]
 https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L20

 [2] https://github.com/openstack-dev/sandbox









 *From:* Eduard Matei [mailto:eduard.ma...@cloudfounders.com]
 *Sent:* Friday, December 19, 2014 3:36 AM
 *To:* Asselin, Ramy
 *Cc:* OpenStack Development Mailing List (not for usage questions)

 *Subject:* Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help
 setting up CI



 Hi all,

 After a little struggle with the config scripts i managed to get a working
 setup that is able to process openstack-dev/sandbox and run
 noop-check-comunication.



 Then, i tried enabling dsvm-tempest-full job but it keeps returning
 NOT_REGISTERED

Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help setting up CI

2014-12-22 Thread Punith S
.



 Any idea how to enable this job?



 Also, i got the Cloud provider setup and i can access it from the
 jenkins master.

 Any idea how i can manually trigger dsvm-tempest-full job to run and test
 the cloud provider without having to push a review to Gerrit?



 Thanks,

 Eduard



 On Thu, Dec 18, 2014 at 7:52 PM, Eduard Matei 
 eduard.ma...@cloudfounders.com wrote:

  Thanks for the input.



 I managed to get another master working (on Ubuntu 13.10), again with some
 issues since it was already setup.

 I'm now working towards setting up the slave.



 Will add comments to those reviews.



 Thanks,

 Eduard



 On Thu, Dec 18, 2014 at 7:42 PM, Asselin, Ramy ramy.asse...@hp.com
 wrote:

  Yes, Ubuntu 12.04 is tested as mentioned in the readme [1]. Note that
 the referenced script is just a wrapper that pulls all the latest from
 various locations in openstack-infra, e.g. [2].

 Ubuntu 14.04 support is WIP [3]

 FYI, there’s a spec to get an in-tree 3rd party ci solution [4]. Please
 add your comments if this interests you.



 [1] https://github.com/rasselin/os-ext-testing/blob/master/README.md

 [2]
 https://github.com/rasselin/os-ext-testing/blob/master/puppet/install_master.sh#L29

 [3] https://review.openstack.org/#/c/141518/

 [4] https://review.openstack.org/#/c/139745/





 *From:* Punith S [mailto:punit...@cloudbyte.com]
 *Sent:* Thursday, December 18, 2014 3:12 AM
 *To:* OpenStack Development Mailing List (not for usage questions);
 Eduard Matei


 *Subject:* Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help
 setting up CI



 Hi Eduard



 we tried running
 https://raw.githubusercontent.com/rasselin/os-ext-testing/master/puppet/install_master.sh

 on ubuntu master 12.04, and it appears to be working fine on 12.04.



 thanks



 On Thu, Dec 18, 2014 at 1:57 PM, Eduard Matei 
 eduard.ma...@cloudfounders.com wrote:

  Hi,

 Seems i can't install using puppet on the jenkins master using
 install_master.sh from
 https://raw.githubusercontent.com/rasselin/os-ext-testing/master/puppet/install_master.sh
 because it's running Ubuntu 11.10 and it appears unsupported.

 I managed to install puppet manually on master and everything else fails

 So i'm trying to manually install zuul and nodepool and jenkins job
 builder, see where i end up.



 The slave looks complete, got some errors on running install_slave so i
 ran parts of the script manually, changing some params and it appears
 installed but no way to test it without the master.



 Any ideas welcome.



 Thanks,



 Eduard



 On Wed, Dec 17, 2014 at 3:37 AM, Asselin, Ramy ramy.asse...@hp.com
 wrote:

   Manually running the script requires a few environment settings. Take a
 look at the README here:

 https://github.com/openstack-infra/devstack-gate



 Regarding cinder, I’m using this repo to run our cinder jobs (fork from
 jaypipes).

 https://github.com/rasselin/os-ext-testing



 Note that this solution doesn’t use the Jenkins gerrit trigger pluggin,
 but zuul.



 There’s a sample job for cinder here. It’s in Jenkins Job Builder format.


 https://github.com/rasselin/os-ext-testing-data/blob/master/etc/jenkins_jobs/config/dsvm-cinder-driver.yaml.sample



 You can ask more questions in IRC freenode #openstack-cinder. (irc#
 asselin)



 Ramy



 *From:* Eduard Matei [mailto:eduard.ma...@cloudfounders.com]
 *Sent:* Tuesday, December 16, 2014 12:41 AM
 *To:* Bailey, Darragh
 *Cc:* OpenStack Development Mailing List (not for usage questions);
 OpenStack
 *Subject:* Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help
 setting up CI



 Hi,



 Can someone point me to some working documentation on how to setup third
 party CI? (joinfu's instructions don't seem to work, and manually running
 devstack-gate scripts fails:

 Running gate_hook

 Job timeout set to: 163 minutes

 timeout: failed to run command 
 ‘/opt/stack/new/devstack-gate/devstack-vm-gate.sh’: No such file or directory

 ERROR: the main setup script run by this job failed - exit code: 127

 please look at the relevant log files to determine the root cause

 Cleaning up host

 ... this takes 3 - 4 minutes (logs at logs/devstack-gate-cleanup-host.txt.gz)

  Build step 'Execute shell' marked build as failure.



 I have a working Jenkins slave with devstack and our internal libraries, i
 have Gerrit Trigger Plugin working and triggering on patches created, i
 just need the actual job contents so that it can get to comment with the
 test results.



 Thanks,



 Eduard



 On Tue, Dec 9, 2014 at 1:59 PM, Eduard Matei 
 eduard.ma...@cloudfounders.com wrote:

  Hi Darragh, thanks for your input



 I double checked the job settings and fixed it:

 - build triggers is set to Gerrit event

 - Gerrit trigger server is Gerrit (configured from Gerrit Trigger Plugin
 and tested separately)

 - Trigger on: Patchset Created

 - Gerrit Project: Type: Path, Pattern openstack-dev/sandbox, Branches:
 Type: Path, Pattern: ** (was Type Plain on both)

 Now the job

Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help setting up CI

2014-12-18 Thread Punith S
 to the named addressee, you are hereby notified that 
 you are not authorized to read, print, retain, copy or disseminate this 
 message or any part of it. If you have received this email in error we 
 request you to notify us by reply e-mail and to delete all electronic files 
 of the message. If you are not the intended recipient you are notified that 
 disclosing, copying, distributing or taking any action in reliance on the 
 contents of this information is strictly prohibited.
 E-mail transmission cannot be guaranteed to be secure or error free as 
 information could be intercepted, corrupted, lost, destroyed, arrive late or 
 incomplete, or contain viruses. The sender therefore does not accept 
 liability for any errors or omissions in the content of this message, and 
 shall have no liability for any loss or damage suffered by the user, which 
 arise as a result of e-mail transmission.





 --

 *Eduard Biceri Matei, Senior Software Developer*

  www.cloudfounders.com

  | eduard.ma...@cloudfounders.com







  *CloudFounders, The Private Cloud Software Company*



  Disclaimer:

  This email and any files transmitted with it are confidential and intended 
 solely for the use of the individual or entity to whom they are addressed.
 If you are not the named addressee or an employee or agent responsible for 
 delivering this message to the named addressee, you are hereby notified that 
 you are not authorized to read, print, retain, copy or disseminate this 
 message or any part of it. If you have received this email in error we 
 request you to notify us by reply e-mail and to delete all electronic files 
 of the message. If you are not the intended recipient you are notified that 
 disclosing, copying, distributing or taking any action in reliance on the 
 contents of this information is strictly prohibited.
 E-mail transmission cannot be guaranteed to be secure or error free as 
 information could be intercepted, corrupted, lost, destroyed, arrive late or 
 incomplete, or contain viruses. The sender therefore does not accept 
 liability for any errors or omissions in the content of this message, and 
 shall have no liability for any loss or damage suffered by the user, which 
 arise as a result of e-mail transmission.


 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




 --

 *Eduard Biceri Matei, Senior Software Developer*
 www.cloudfounders.com
  | eduard.ma...@cloudfounders.com



 *CloudFounders, The Private Cloud Software Company*

 Disclaimer:
 This email and any files transmitted with it are confidential and intended 
 solely for the use of the individual or entity to whom they are addressed.
 If you are not the named addressee or an employee or agent responsible for 
 delivering this message to the named addressee, you are hereby notified that 
 you are not authorized to read, print, retain, copy or disseminate this 
 message or any part of it. If you have received this email in error we 
 request you to notify us by reply e-mail and to delete all electronic files 
 of the message. If you are not the intended recipient you are notified that 
 disclosing, copying, distributing or taking any action in reliance on the 
 contents of this information is strictly prohibited.
 E-mail transmission cannot be guaranteed to be secure or error free as 
 information could be intercepted, corrupted, lost, destroyed, arrive late or 
 incomplete, or contain viruses. The sender therefore does not accept 
 liability for any errors or omissions in the content of this message, and 
 shall have no liability for any loss or damage suffered by the user, which 
 arise as a result of e-mail transmission.


 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



-- 
regards,

punith s
cloudbyte.com
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev