Re: [Xen-devel] [PATCH v4 05/16] osstest: introduce a helper to setup a host to boot using memdisk

2017-07-06 Thread Ian Jackson
oot/ With suitable paths, Acked-by: Ian Jackson ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel

Re: [Xen-devel] [PATCH v4 15/16] osstest: introduce a script to create a FreeBSD flight

2017-07-06 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v4 15/16] osstest: introduce a script to create a FreeBSD flight"): > The logic to create a FreeBSD build job is added to > make-freebsd-flight. This includes creating a FreeBSD build job, and > also testing the output of that build job (by creating another build >

Re: [Xen-devel] [PATCH v4 11/16] osstest: introduce a script to set the runtime hostflags runvar for FreeBSD jobs

2017-07-06 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v4 11/16] osstest: introduce a script to set the runtime hostflags runvar for FreeBSD jobs"): > Due to the nature of the FreeBSD install media, which is > self-generated from the ts-freebsd-build script, the hostflags runvar > set to FreeBSD jobs are related to the

Re: [Xen-devel] [PATCH v4 14/16] osstest: add support for FreeBSD buildjobs to sg-run-job

2017-07-06 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v4 14/16] osstest: add support for FreeBSD buildjobs to sg-run-job"): > Add support and introduce a FreeBSD build job to sg-run-job. ... > proc allocate-build-host {ostype} { > global jobinfo > +if {[string equal $ostype FREEBSD]} { > +run-ts broke

Re: [Xen-devel] [PATCH v4 13/16] osstest: change the meaning of need_build_host

2017-07-06 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v4 13/16] osstest: change the meaning of need_build_host"): > Make need_build_host store a string instead of a boolean. This is > later going to be expanded to handle the FreeBSD build jobs. ... > -if {$need_build_host} { catching-otherwise broken allocate-build

Re: [Xen-devel] [PATCH v4 12/16] osstest: allow catching-otherwise to pass arguments to the called script

2017-07-06 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v4 12/16] osstest: allow catching-otherwise to pass arguments to the called script"): > Allow catching-otherwise to take a variable number of tail arguments, > that will be propagated to the called proc. Err, this is not necessary, I think. The caller can do it.

Re: [Xen-devel] [PATCH v4 11/16] osstest: introduce a script to set the runtime hostflags runvar for FreeBSD jobs

2017-07-06 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v4 11/16] osstest: introduce a script to set the runtime hostflags runvar for FreeBSD jobs"): > Due to the nature of the FreeBSD install media, which is > self-generated from the ts-freebsd-build script, the hostflags runvar > set to FreeBSD jobs are related to the

Re: [Xen-devel] [PATCH v4 10/16] osstest: add support for runtime_IDENT_hostflags

2017-07-06 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v4 10/16] osstest: add support for runtime_IDENT_hostflags"): > This is required for FreeBSD, that will need to set some of the > hostflags at runtime. The current IDENT_hostflags will be keep as-is, > and they should only be set at job creation time. > > Also intr

Re: [Xen-devel] [PATCH v4 09/16] osstest: introduce a FreeBSD build script

2017-07-06 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v4 09/16] osstest: introduce a FreeBSD build script"): > In order to generate the FreeBSD installer image and the install > media. > +sub install_deps () { > +target_install_packages($ho, 'git'); Please say +target_install_packages($ho, qw(git)); > +

Re: [Xen-devel] [PATCH v4 06/16] osstest: add a FreeBSD host install recipe

2017-07-06 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v4 06/16] osstest: add a FreeBSD host install recipe"): > The installation is performed using the bsdinstall tool, which is part > of the FreeBSD base system. The installer image is setup with the > osstest ssh keys and sshd enabled by default, which allows the test

Re: [Xen-devel] [PATCH v4 08/16] osstest: add support for the FreeBSD package manager

2017-07-06 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v4 08/16] osstest: add support for the FreeBSD package manager"): > FreeBSD support is added to target_install_packages and > target_install_packages_norec, although there's no equivalent to the > --no-install-recommends in the FreeBSD package manager. LGTM, just a

Re: [Xen-devel] [PATCH v4 07/16] osstest: introduce build helpers for FreeBSD

2017-07-06 Thread Ian Jackson
> exactly the same as the non-root counterparts. > > Signed-off-by: Roger Pau Monné Acked-by: Ian Jackson ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel

Re: [Xen-devel] [PATCH v4 06/16] osstest: add a FreeBSD host install recipe

2017-07-06 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v4 06/16] osstest: add a FreeBSD host install recipe"): > The installation is performed using the bsdinstall tool, which is part > of the FreeBSD base system. The installer image is setup with the > osstest ssh keys and sshd enabled by default, which allows the test

Re: [Xen-devel] [PATCH v4 04/16] osstest: introduce a helper to calculate the sha256 of a given file

2017-07-06 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v4 04/16] osstest: introduce a helper to calculate the sha256 of a given file"): > The helper is going to be used to calculate the sha256 of the FreeBSD > installer images. > > Signed-off-by: Roger Pau Monné

Re: [Xen-devel] [PATCH v3 6/8] osstest: introduce a script to set the hostflags for FreeBSD jobs

2017-07-05 Thread Ian Jackson
Roger Pau Monne writes ("Re: [PATCH v3 6/8] osstest: introduce a script to set the hostflags for FreeBSD jobs"): > On Fri, Jun 23, 2017 at 04:10:47PM +0100, Ian Jackson wrote: > > In fact, I don't know how this script can have worked for you. > > Currently m

[Xen-devel] [OSSTEST PATCH 3/3] db schema: Make the testid column NOT NLLL

2017-07-03 Thread Ian Jackson
We have to fix some old data. We insist that the old data is indeed old (more than 5 years old) and not part of proper flights (ie, blessed "play" or "crashed" or "unknown"). Signed-off-by: Ian Jackson --- schema/testid-constraint.sql | 28 ++

[Xen-devel] [OSSTEST PATCH 1/3] mg-schema-test-database: Apply updates, regardless of compatibility

2017-07-03 Thread Ian Jackson
The test database should be just like the real one, even if the schema compatibility looks wrong. So pass -ff to mg-schema-update. Signed-off-by: Ian Jackson --- mg-schema-test-database | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/mg-schema-test-database b/mg-schema-test

[Xen-devel] [OSSTEST PATCH 2/3] mg-schema-test-database: New --max-flight option

2017-07-03 Thread Ian Jackson
This can be useful when testing things which involve old data, rather than things which just involve new data. Signed-off-by: Ian Jackson --- mg-schema-test-database | 10 -- 1 file changed, 8 insertions(+), 2 deletions(-) diff --git a/mg-schema-test-database b/mg-schema-test-database

[Xen-devel] [OSSTEST PATCH 0/3] Schema tidying following recent changes

2017-07-03 Thread Ian Jackson
We make mg-schema-test-database work again. Also, we make testid be NOT NULL. (Everything sets it and has done almost forever.) ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel

Re: [Xen-devel] [OSSTEST PATCH v11 20/20] Introduce flight for stable branches of OpenStack

2017-07-03 Thread Ian Jackson
Anthony PERARD writes ("Re: [OSSTEST PATCH v11 20/20] Introduce flight for stable branches of OpenStack"): > On Fri, Jun 23, 2017 at 06:00:29PM +0100, Ian Jackson wrote: > > Anthony PERARD writes ("[OSSTEST PATCH v11 20/20] Introduce flight for > > stable branches

Re: [Xen-devel] [OSSTEST PATCH v11 16/20] ts-openstack-tempest: Update list of skipped tests

2017-06-30 Thread Ian Jackson
Anthony PERARD writes ("Re: [OSSTEST PATCH v11 16/20] ts-openstack-tempest: Update list of skipped tests"): > On Fri, Jun 23, 2017 at 04:38:05PM +0100, Ian Jackson wrote: > > Aha. Well, if the stable branch is stable then the set of tests to > > skip there is probably st

[Xen-devel] [OSSTEST PATCH 08/17] step logfiles: Standalone mode: Do not print uninformative $script value

2017-06-30 Thread Ian Jackson
, as it is not used for method calls). Signed-off-by: Ian Jackson --- Osstest/JobDB/Standalone.pm | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/Osstest/JobDB/Standalone.pm b/Osstest/JobDB/Standalone.pm index 4842e69..af93196 100644 --- a/Osstest/JobDB/Standalone.pm +++

[Xen-devel] [OSSTEST PATCH 06/17] db updates: Make all INSERTs (except into steps) name columns explicitly

2017-06-30 Thread Ian Jackson
: flights_harness_touched jobs resources runvars steps Signed-off-by: Ian Jackson --- Osstest/JobDB/Executive.pm | 4 +++- Osstest/TestSupport.pm | 12 +--- cs-adjust-flight | 7 --- cs-bisection-step | 3 ++- mg-allocate| 2 +- mg-hosts

[Xen-devel] [OSSTEST PATCH 02/17] schema updates: Fix typo in developer doc

2017-06-30 Thread Ian Jackson
Signed-off-by: Ian Jackson --- schema/README.updates | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/schema/README.updates b/schema/README.updates index 25bc11a..c5abc36 100644 --- a/schema/README.updates +++ b/schema/README.updates @@ -109,7 +109,7 @@ on it. There are

[Xen-devel] [OSSTEST PATCH 15/17] step logfiles: sg-run-job: Break out step-log-leafname

2017-06-30 Thread Ian Jackson
No functional change. Signed-off-by: Ian Jackson --- tcl/JobDB-Executive.tcl | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/tcl/JobDB-Executive.tcl b/tcl/JobDB-Executive.tcl index 414a77e..ed636e4 100644 --- a/tcl/JobDB-Executive.tcl +++ b/tcl/JobDB-Executive.tcl

[Xen-devel] [OSSTEST PATCH 13/17] step logfiles: Honour new logfile column

2017-06-30 Thread Ian Jackson
"Populate-then-rely" schema change, as described in schema/README.updates. Specifically, this is the step: 6. Optionally commit: code which reads new column, but which tolerates it containing NULL/DEFAULT. (`add' is already Needed.) Signed-off-by: Ian Jackson --- determine-fail

[Xen-devel] [OSSTEST PATCH 07/17] step logfiles: Break out $logfilename in two places

2017-06-30 Thread Ian Jackson
No functional change. Signed-off-by: Ian Jackson --- determine-failure-reasons | 4 ++-- sg-report-flight | 3 ++- 2 files changed, 4 insertions(+), 3 deletions(-) diff --git a/determine-failure-reasons b/determine-failure-reasons index ecff332..a3b2100 100755 --- a/determine-failure

[Xen-devel] [OSSTEST PATCH 14/17] step logfiles: Make substep_* take $logfile, not $script

2017-06-30 Thread Ian Jackson
es to no longer pass $script. None make their own logfiles, so none pass the new parameter $logfile. Signed-off-by: Ian Jackson --- Osstest/TestSupport.pm | 10 +- ts-examine-serial-post | 2 +- ts-xtf-run | 2 +- 3 files changed, 7 insertions(+), 7 deletions(-)

[Xen-devel] [OSSTEST PATCH 17/17] step logfiles: Rely on new logfile column

2017-06-30 Thread Ian Jackson
"Populate-then-rely" schema change, as described in schema/README.updates. Specifically, the step: 10. Optionally commit: code which relies on new column, and does not necessarily tolerate NULL/DEFAULT; changing `constraint' to Needed. Signed-off-by: Ian Jackson --- determine-

[Xen-devel] [OSSTEST PATCH 11/17] substep logfiles: Populate new logfile column, at all, for substeps

2017-06-30 Thread Ian Jackson
For now we populate it with the sometimes-wrong value based on $script. In detail: * Add a parameter $logfile to $mjobdb->step_start, which currently always gets passed undef. * In JobDB::Executive::step_start, try to use it as the value for the new logfile column. But, if it is not set (wh

[Xen-devel] [OSSTEST PATCH 05/17] schema updates: Be willing to apply Ready changes

2017-06-30 Thread Ian Jackson
If the oldest code declares itself Ready for this change, or (implausibly) Needed, then it is OK to push. Signed-off-by: Ian Jackson --- mg-schema-update | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/mg-schema-update b/mg-schema-update index 43f313a..44e4283 100755 --- a

[Xen-devel] [OSSTEST PATCH 16/17] step logfiles: Populate logfile column with logfile name

2017-06-30 Thread Ian Jackson
This is part of a "Populate-then-rely" schema change, as described in schema/README.updates. Specifically, this is the final part of the step: 5. Commit: code to populate new column; changing `add' to status Needed and `constraint' to status Ready. Signed-off-by: Ian

[Xen-devel] [OSSTEST PATCH 10/17] step logfiles: Provide new column

2017-06-30 Thread Ian Jackson
s Unfinished Signed-off-by: Ian Jackson --- schema/steps-logfile-add.sql| 8 schema/steps-logfile-constraint.sql | 10 ++ 2 files changed, 18 insertions(+) create mode 100644 schema/steps-logfile-add.sql create mode 100644 schema/steps-logfile-constraint.sql diff

[Xen-devel] [OSSTEST PATCH 00/17] Fix substep (eg XTF) logfile links

2017-06-30 Thread Ian Jackson
It kept irritating me that the links to the substeps of xtf-run do not work. To fix this, it is necessary for the database to contain the right information - ie, a schema change. After this series, substep logfile names are recorded and reported properly, and you can click on them. At some point

[Xen-devel] [OSSTEST PATCH 09/17] substep logfiles: Move defaulting of $script into Executive

2017-06-30 Thread Ian Jackson
We are going to want to default this here in a more sophisticated way, but we can't do that if it's already been defaulted from $0 earlier. The other consumer of this default was in JobDB/Standalone, but we have just changed that to ignore it. So, no functional change. Signed-o

[Xen-devel] [OSSTEST PATCH 12/17] substep logfiles: Set logfile and step columns correctly for substeps

2017-06-30 Thread Ian Jackson
-by: Ian Jackson --- Osstest/JobDB/Executive.pm | 13 + 1 file changed, 13 insertions(+) diff --git a/Osstest/JobDB/Executive.pm b/Osstest/JobDB/Executive.pm index e1e2052..a7a6696 100644 --- a/Osstest/JobDB/Executive.pm +++ b/Osstest/JobDB/Executive.pm @@ -254,6 +254,19 @@ END

[Xen-devel] [OSSTEST PATCH 01/17] Developer docs: A rune for flight comparision

2017-06-30 Thread Ian Jackson
Something like this rune can be useful for comparing testids of different flights. Signed-off-by: Ian Jackson --- NOTES.flight-comparison | 22 ++ 1 file changed, 22 insertions(+) create mode 100644 NOTES.flight-comparison diff --git a/NOTES.flight-comparison b

[Xen-devel] [OSSTEST PATCH 03/17] schema updates: Document how to remove a used column

2017-06-30 Thread Ian Jackson
Signed-off-by: Ian Jackson --- schema/README.updates | 26 ++ 1 file changed, 26 insertions(+) diff --git a/schema/README.updates b/schema/README.updates index c5abc36..ca1d37e 100644 --- a/schema/README.updates +++ b/schema/README.updates @@ -147,6 +147,32 @@ finish is

[Xen-devel] [OSSTEST PATCH 04/17] schema updates: mg-schema-test-database: Cope with applied updates

2017-06-30 Thread Ian Jackson
The schema_updates table contents are written by the call to mg-schema-update. Trying to copy the contents from the source db correctly fails with duplicate key errors. So don't do that. Signed-off-by: Ian Jackson --- mg-schema-test-database | 3 +++ 1 file changed, 3 insertions(+)

[Xen-devel] [OSSTEST PATCH] coverity: Switch to tools 2017.07

2017-06-28 Thread Ian Jackson
The old tools are no longer working. Signed-off-by: Ian Jackson CC: Andrew Cooper --- production-config | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/production-config b/production-config index 96831c7..1bc56d8 100644 --- a/production-config +++ b/production-config

Re: [Xen-devel] [adhoc test] 111118: regressions - FAIL [and 1 more messages]

2017-06-27 Thread Ian Jackson
i...@xenbits.xen.org writes ("[adhoc test] 12: regressions - FAIL"): > [adhoc adhoc] <3testing.git (no branch) /dev/pts/29> > harness 702ce3d: sg-run-job: Logfiles: Suppress links to 0-length file... > 12: regressions - FAIL > > flight 12 xen-unstable adhoc [real] > http://logs.test-la

Re: [Xen-devel] [xen-4.9-testing test] 110978: regressions - FAIL

2017-06-27 Thread Ian Jackson
osstest service owner writes ("[xen-4.9-testing test] 110978: regressions - FAIL"): > flight 110978 xen-4.9-testing real [real] > http://logs.test-lab.xenproject.org/osstest/logs/110978/ > > Regressions :-( > > Tests which did not succeed and are blocking, > including tests which could not be ru

Re: [Xen-devel] [PATCH for-4.9] livepatch: Declare live patching as a supported feature

2017-06-27 Thread Ian Jackson
Lars Kurth writes ("Re: [PATCH for-4.9] livepatch: Declare live patching as a supported feature"): > * For Xen 4.9 we can declare live patching supported, without spinning > another RC to update the in-tree documentation: in other words, we would > apply the documentation/policy changes + to the 4

Re: [Xen-devel] [PATCH for-4.9] livepatch: Declare live patching as a supported feature

2017-06-27 Thread Ian Jackson
Julien Grall writes ("Re: [PATCH for-4.9] livepatch: Declare live patching as a supported feature"): > On 06/26/2017 10:07 PM, Konrad Rzeszutek Wilk wrote: > > On Mon, Jun 26, 2017 at 07:29:22PM +0100, Julien Grall wrote: > >> enabled for all architectures by default. > > > > And the OSSTest can

Re: [Xen-devel] [PATCH for-4.9] livepatch: Declare live patching as a supported feature

2017-06-26 Thread Ian Jackson
George Dunlap writes ("Re: [PATCH for-4.9] livepatch: Declare live patching as a supported feature"): > I agree that as long as the patch can be applied after "xl pause", then > the domain cannot be said to be preventing the application of the > livepatch. But if either 'xl pause' doesn't work, o

Re: [Xen-devel] [OSSTEST PATCH v11 11/20] ts-openstack-deploy: Increase fd and memory limits for rabbitmq

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("Re: [OSSTEST PATCH v11 11/20] ts-openstack-deploy: Increase fd and memory limits for rabbitmq"): > On Fri, Jun 23, 2017 at 04:34:41PM +0100, Ian Jackson wrote: > > And if one isn't using systemd ? > > I guess it would have to fix dev

Re: [Xen-devel] [OSSTEST PATCH v11 20/20] Introduce flight for stable branches of OpenStack

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("[OSSTEST PATCH v11 20/20] Introduce flight for stable branches of OpenStack"): > OpenStack have many different repo which should be in sync, so this > patch should grab the revisions of the stable branch of every OpenStack > tree. Tempest does not have stable branch and sho

Re: [Xen-devel] [OSSTEST PATCH v11 20/20] Introduce flight for stable branches of OpenStack

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("Re: [OSSTEST PATCH v11 20/20] Introduce flight for stable branches of OpenStack"): > We decided to track only nova.git, and let osstest clone other trees and > checkout the HEAD (by having REVISION_* empty). That is fine if we track > "master" of nova.git. Right. > The is

Re: [Xen-devel] [OSSTEST PATCH v11 18/20] ts-logs-capture: Capture OpenStack logs

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("Re: [OSSTEST PATCH v11 18/20] ts-logs-capture: Capture OpenStack logs"): > On Fri, Jun 23, 2017 at 02:49:11PM +0100, Ian Jackson wrote: > > This is not fine. If a build host is shared, it will collect all the > > logs from all of the builds.

Re: [Xen-devel] [OSSTEST PATCH v11 16/20] ts-openstack-tempest: Update list of skipped tests

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("Re: [OSSTEST PATCH v11 16/20] ts-openstack-tempest: Update list of skipped tests"): > On Fri, Jun 23, 2017 at 02:47:37PM +0100, Ian Jackson wrote: > > Again, does this not mean we're going to suffer a maintenance burden > > as tempes

Re: [Xen-devel] [OSSTEST PATCH v11 12/20] make-flight: Increase dom0_mem for openstack flight

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("Re: [OSSTEST PATCH v11 12/20] make-flight: Increase dom0_mem for openstack flight"): > On Fri, Jun 23, 2017 at 02:42:53PM +0100, Ian Jackson wrote: > > Anthony PERARD writes ("[OSSTEST PATCH v11 12/20] make-flight: Increase > > dom0_mem for

Re: [Xen-devel] [OSSTEST PATCH v11 11/20] ts-openstack-deploy: Increase fd and memory limits for rabbitmq

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("Re: [OSSTEST PATCH v11 11/20] ts-openstack-deploy: Increase fd and memory limits for rabbitmq"): > On Fri, Jun 23, 2017 at 02:41:59PM +0100, Ian Jackson wrote: > > Anthony PERARD writes ("[OSSTEST PATCH v11 11/20] ts-openstack-deploy: > > Inc

Re: [Xen-devel] [PATCH v3.1 8/8] osstest: hook FreeBSD flight into cr-daily-branch

2017-06-23 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v3.1 8/8] osstest: hook FreeBSD flight into cr-daily-branch"): > +++ b/daily-cron-email-real--freebsd > @@ -0,0 +1,4 @@ > +To: xen-de...@lists.xenproject.org, > +osstest-ad...@xenproject.org, > +roy...@freebsd.org > +Bcc: osstest-out...@lists.xenproject.org

Re: [Xen-devel] [PATCH v3 8/8] osstest: hook FreeBSD flight into cr-daily-branch

2017-06-23 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v3 8/8] osstest: hook FreeBSD flight into cr-daily-branch"): > +++ b/daily-cron-email-freebsd > @@ -0,0 +1 @@ > +To: roy...@freebsd.org Please at least Bcc osstest-output. See daily-cron-email-osstest for an example. Please also provide information about the chan

Re: [Xen-devel] [PATCH v3 7/8] osstest: introduce a script to create a FreeBSD flight

2017-06-23 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v3 7/8] osstest: introduce a script to create a FreeBSD flight"): > +FreeBSDDist > + Path to the folder that contains the FreeBSD install image and > + the FreeBSD compressed install sets, together with the MANIFEST > + file that holds the checksums. This is r

Re: [Xen-devel] [PATCH v3 6/8] osstest: introduce a script to set the hostflags for FreeBSD jobs

2017-06-23 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v3 6/8] osstest: introduce a script to set the hostflags for FreeBSD jobs"): > Due to the nature of the FreeBSD install media, which is > self-generated from the ts-freebsd-build script, the hostflags set to > FreeBSD jobs are related to the current version under te

Re: [Xen-devel] [PATCH v3 5/8] osstest: introduce a FreeBSD build script

2017-06-23 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v3 5/8] osstest: introduce a FreeBSD build script"): > The following new helpers are also introduced, that are only used by > the FreeBSD build script: buildcmd_stamped_logged_root and > target_cmd_build_root, they behave exactly the same as the non-root > counterpa

Re: [Xen-devel] [PATCH v3 4/8] osstest: add a FreeBSD host install recipe

2017-06-23 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v3 4/8] osstest: add a FreeBSD host install recipe"): > The installation is performed using the bsdinstall tool, which is part > of the FreeBSD base system. The installer image is setup with the > osstest ssh keys and sshd enabled by default, which allows the test >

Re: [Xen-devel] [PATCH v3 3/8] osstest: introduce helper to get per-host tftp prefix

2017-06-23 Thread Ian Jackson
Roger Pau Monne writes ("[PATCH v3 3/8] osstest: introduce helper to get per-host tftp prefix"): > This is used in order to get the per-host tftp prefix, used to store > the host initrd file. Acked-by: Ian Jackson ___ Xen-devel mailin

Re: [Xen-devel] [PATCH RFC] Live migration for VMs with QEMU backed local storage

2017-06-23 Thread Ian Jackson
Konrad Rzeszutek Wilk writes ("Re: [Xen-devel] [PATCH RFC] Live migration for VMs with QEMU backed local storage"): > On Fri, Jun 23, 2017 at 03:31:16AM -0400, Bruno Alvisio wrote: > > disks). This are the ones I can think of: > > - Fully Virtualized HVM: QEMU emulation > > - blkback > > - blktap

Re: [Xen-devel] [OSSTEST PATCH v11 10/20] ts-openstack-deploy: Switch to Neutron for network

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("Re: [OSSTEST PATCH v11 10/20] ts-openstack-deploy: Switch to Neutron for network"): > On Fri, Jun 23, 2017 at 02:41:02PM +0100, Ian Jackson wrote: > > Is this kind of thing going to be common ? If so then it will be a > > constant maintenance b

Re: [Xen-devel] [OSSTEST PATCH v11 20/20] Introduce flight for stable branches of OpenStack

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("[OSSTEST PATCH v11 20/20] Introduce flight for stable branches of OpenStack"): > OpenStack have many different repo which should be in sync, so this > patch should grab the revisions of the stable branch of every OpenStack > tree. Tempest does not have stable branch and sho

Re: [Xen-devel] [OSSTEST PATCH v11 19/20] ts-openstack-deploy: Increase devstack timeout

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("[OSSTEST PATCH v11 19/20] ts-openstack-deploy: Increase devstack timeout"): > Signed-off-by: Anthony PERARD Acked-by: Ian Jackson ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel

[Xen-devel] [OSSTEST PATCH v11 18/20] ts-logs-capture: Capture OpenStack logs

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("[OSSTEST PATCH v11 18/20] ts-logs-capture: Capture OpenStack logs"): > + /var/log/openstack/*.log > + /etc/nova/* > + /etc/neutron/* > + /etc/cinder/* This is fine: > + > /home/osstest/b

Re: [Xen-devel] [OSSTEST PATCH v11 17/20] ts-openstack-deploy: Move logs to /var/log/openstack

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("[OSSTEST PATCH v11 17/20] ts-openstack-deploy: Move logs to /var/log/openstack"): > Signed-off-by: Anthony PERARD Acked-by: Ian Jackson Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel

Re: [Xen-devel] [OSSTEST PATCH v11 16/20] ts-openstack-tempest: Update list of skipped tests

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("[OSSTEST PATCH v11 16/20] ts-openstack-tempest: Update list of skipped tests"): > Signed-off-by: Anthony PERARD Again, does this not mean we're going to suffer a maintenance burden as tempest grows new inapplicable tests ? Other possibilities that come to my mind: ideall

Re: [Xen-devel] [OSSTEST PATCH v11 15/20] ts-openstack-tempest: Fix tempest invocation

2017-06-23 Thread Ian Jackson
cd $builddir/tempest > +tempest run --concurrency=2 --regex '$regex' Has /usr/local/bin/tempest or something been created by ts-openstay-deploy, then ? If so, Acked-by: Ian Jackson Otherwise I wonder how this works, since I don't see how `tempest' would be on PATH. Ian. ___

Re: [Xen-devel] [OSSTEST PATCH v11 14/20] ts-openstack-deploy: Ignore libvirt-python version and use latest

2017-06-23 Thread Ian Jackson
requirement and use the latest available instead. Acked-by: Ian Jackson ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel

Re: [Xen-devel] [OSSTEST PATCH v11 13/20] ts-openstack-deploy: Apply a Tempest patch

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("[OSSTEST PATCH v11 13/20] ts-openstack-deploy: Apply a Tempest patch"): > Signed-off-by: Anthony PERARD Acked-by: Ian Jackson > ts-openstack-deploy | 10 ++ > 1 file changed, 10 insertions(+) > > diff --git a/ts-openstack-deploy b/ts

Re: [Xen-devel] [OSSTEST PATCH v11 12/20] make-flight: Increase dom0_mem for openstack flight

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("[OSSTEST PATCH v11 12/20] make-flight: Increase dom0_mem for openstack flight"): > With 4G for dom0_mem, a host running devstack is using about 1.5G of > swap. Is this going to work properly on 8G hosts ? Ian. ___ Xen-devel mai

Re: [Xen-devel] [OSSTEST PATCH v11 11/20] ts-openstack-deploy: Increase fd and memory limits for rabbitmq

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("[OSSTEST PATCH v11 11/20] ts-openstack-deploy: Increase fd and memory limits for rabbitmq"): > Signed-off-by: Anthony PERARD Does this not mean that the upstream defaults are wrong ? In general I like to see at least an upstream bug report url or number mentioned in a co

Re: [Xen-devel] [OSSTEST PATCH v11 10/20] ts-openstack-deploy: Switch to Neutron for network

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("[OSSTEST PATCH v11 10/20] ts-openstack-deploy: Switch to Neutron for network"): > nova-network is not supported anymore and Neutron is the default. Is this kind of thing going to be common ? If so then it will be a constant maintenance burden in osstest. Is there some wa

Re: [Xen-devel] [OSSTEST PATCH v11 09/20] ts-kernel-build: Enable network related modules for Neutron

2017-06-23 Thread Ian Jackson
Anthony PERARD writes ("[OSSTEST PATCH v11 09/20] ts-kernel-build: Enable network related modules for Neutron"): > Those options/modules are needed to run OpenStack Neutron with Open > vSwitch. Acked-by: Ian Jackson ___ Xen-devel

Re: [Xen-devel] [OSSTEST PATCH v11 08/20] ts-openstack-deploy: Try to disable use of SYSTEMD

2017-06-23 Thread Ian Jackson
systemd disable. ^d > Signed-off-by: Anthony PERARD Acked-by: Ian Jackson Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel

Re: [Xen-devel] [OSSTEST PATCH v11 07/20] ts-openstack-deploy: Keep CURL_CA_BUNDLE when sudo is called

2017-06-23 Thread Ian Jackson
xisting environment variables. Acked-by: Ian Jackson ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel

Re: [Xen-devel] [osstest test] 110909: tolerable FAIL - PUSHED

2017-06-23 Thread Ian Jackson
Andrew Cooper writes ("Re: [Xen-devel] [osstest test] 110909: tolerable FAIL - PUSHED"): > XEN_DOMINF_paused is a straight reflection of > d->controller_pause_count. A domain is created with 1 reference count, > requiring the toolstack to call DOMCTL_unpause_domain once to cause it > to start exe

Re: [Xen-devel] [xen-4.9-testing test] 110903: regressions - FAIL

2017-06-22 Thread Ian Jackson
Julien Grall writes ("Re: [Xen-devel] [xen-4.9-testing test] 110903: regressions - FAIL"): > On 21/06/17 17:26, osstest service owner wrote: > > flight 110903 xen-4.9-testing real [real] > > http://logs.test-lab.xenproject.org/osstest/logs/110903/ > > > > Regressions :-( > > > > Tests which did n

Re: [Xen-devel] [PATCH] passthrough: give XEN_DOMCTL_test_assign_device more sane semantics

2017-06-22 Thread Ian Jackson
George Dunlap writes ("Re: [PATCH] passthrough: give XEN_DOMCTL_test_assign_device more sane semantics"): > Well, I'm not sure what to say, because in my view the log message > supports my view. :-) Note that there are two errors, both explaining > why the domain cannot be assigned -- one is "no

Re: [Xen-devel] [PATCH] etherboot: use gzip -n

2017-06-22 Thread Ian Jackson
Bernhard M. Wiedemann writes ("[PATCH] etherboot: use gzip -n"): > to not include current timestamp in results > to allow for reproducible builds. Acked-by: Ian Jackson > See https://reproducible-builds.org/ for why this matters We're sold on this BTW, but our build sys

Re: [Xen-devel] [osstest test] 110909: tolerable FAIL - PUSHED

2017-06-21 Thread Ian Jackson
osstest service owner writes ("[osstest test] 110909: tolerable FAIL - PUSHED"): > flight 110909 osstest real [real] > http://logs.test-lab.xenproject.org/osstest/logs/110909/ > > Failures :-/ but no regressions. ... > Tests which did not succeed, but are not blocking: ... > test-amd64-i386-xl-qe

Re: [Xen-devel] [PATCH] tools/xen-detect: try sysfs node for obtaining guest type

2017-06-21 Thread Ian Jackson
Wei Liu writes ("Re: [Xen-devel] [PATCH] tools/xen-detect: try sysfs node for obtaining guest type"): > On Wed, Jun 21, 2017 at 04:24:33PM +0200, Olaf Hering wrote: > > On Thu, Jun 15, Juergen Gross wrote: > > > +++ b/tools/misc/xen-detect.c > > > > > +asprintf(&ver, "V%u.%u", > > > +

[Xen-devel] [OSSTEST PATCH 06/15] sg-run-job: Execute prep-job/RECIPE if it exists

2017-06-21 Thread Ian Jackson
This allows a job to do its own host allocation, for example. Signed-off-by: Ian Jackson --- v2: New patch --- sg-run-job | 3 +++ 1 file changed, 3 insertions(+) diff --git a/sg-run-job b/sg-run-job index 8acb902..cfbc34b 100755 --- a/sg-run-job +++ b/sg-run-job @@ -73,6 +73,9 @@ proc run-job

[Xen-devel] [OSSTEST PATCH 12/15] sg-run-job: Abolish `anyfailed'

2017-06-21 Thread Ian Jackson
. So overall, no functional change other than to a message in the transcript. Signed-off-by: Ian Jackson --- sg-run-job | 14 ++ 1 file changed, 6 insertions(+), 8 deletions(-) diff --git a/sg-run-job b/sg-run-job index 654ba83..b1f94f4 100755 --- a/sg-run-job +++ b/sg-run-job

[Xen-devel] [OSSTEST PATCH 10/15] sg-run-job: Spawn ts-syslog-server

2017-06-21 Thread Ian Jackson
Every job now gets a syslog server, which starts up after host allocation. The server's address and port are recorded by ts-syslog-server in a runvar and can be used by subsequent test steps. Signed-off-by: Ian Jackson --- v2: Change mistaken TESTID `.' to `='. `.' means l

[Xen-devel] [OSSTEST PATCH 15/15] sg-run-job: Logfiles: Suppress links to 0-length files

2017-06-21 Thread Ian Jackson
These are not really helpful. Making them not be links makes them easier to skip by eye. Signed-off-by: Ian Jackson --- v2: New patch. --- sg-report-flight | 8 ++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/sg-report-flight b/sg-report-flight index f7150a0..fd8a68b

[Xen-devel] [OSSTEST PATCH 14/15] sg-report-flight: Make logfile list into table, with more info

2017-06-21 Thread Ian Jackson
Also print the mtime and the size. Signed-off-by: Ian Jackson --- v2: New patch. --- sg-report-flight | 21 ++--- 1 file changed, 18 insertions(+), 3 deletions(-) diff --git a/sg-report-flight b/sg-report-flight index b7cd03a..f7150a0 100755 --- a/sg-report-flight +++ b/sg

[Xen-devel] [OSSTEST PATCH 09/15] sg-run-job: Break out allocate-build-host, and reorder

2017-06-21 Thread Ian Jackson
We're going to want to start the syslog server after host allocation but before installation, so we need to split these steps up. A side effect is that a build job becomes `running' when it starts its host install, not when it starts the actual build. Signed-off-by: Ian Jackson -

[Xen-devel] [OSSTEST PATCH 01/15] mg-repro-setup: Use new syntax for cs-adjust-flight

2017-06-21 Thread Ian Jackson
in-tree user of that feature. Signed-off-by: Ian Jackson --- mg-repro-setup | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/mg-repro-setup b/mg-repro-setup index 4f2fe54..9663497 100755 --- a/mg-repro-setup +++ b/mg-repro-setup @@ -199,7 +199,7 @@ if $skipcapture; then adjrunv

[Xen-devel] [OSSTEST PATCH 13/15] Debian: Pass sylog server details to debian-installer

2017-06-21 Thread Ian Jackson
This logs the installer output, even during a failed install. Signed-off-by: Ian Jackson --- Osstest/Debian.pm | 5 + 1 file changed, 5 insertions(+) diff --git a/Osstest/Debian.pm b/Osstest/Debian.pm index 8ba48bf..845027a 100644 --- a/Osstest/Debian.pm +++ b/Osstest/Debian.pm @@ -690,6

[Xen-devel] [OSSTEST PATCH 07/15] sg-run-job: examination: Style improvement

2017-06-21 Thread Ian Jackson
This is going to make things a bit clearer. Whitespace change only. Signed-off-by: Ian Jackson --- sg-run-job | 8 ++-- 1 file changed, 2 insertions(+), 6 deletions(-) diff --git a/sg-run-job b/sg-run-job index cfbc34b..dc5fdc2 100755 --- a/sg-run-job +++ b/sg-run-job @@ -647,14 +647,10

[Xen-devel] [OSSTEST PATCH 11/15] sg-run-job: Make catching-otherwise honour $ok

2017-06-21 Thread Ian Jackson
verall, no functional change. Signed-off-by: Ian Jackson --- sg-run-job | 18 -- 1 file changed, 12 insertions(+), 6 deletions(-) diff --git a/sg-run-job b/sg-run-job index 66c2c19..654ba83 100755 --- a/sg-run-job +++ b/sg-run-job @@ -62,7 +62,7 @@ proc run-job {job} {

[Xen-devel] [OSSTEST PATCH 05/15] sg-run-job: Support scripts which need to be told when to quit

2017-06-21 Thread Ian Jackson
We give them a pipe on stdin, whose writing end we close when we want to reap them. Signed-off-by: Ian Jackson --- sg-run-job | 19 +-- 1 file changed, 17 insertions(+), 2 deletions(-) diff --git a/sg-run-job b/sg-run-job index b820642..8acb902 100755 --- a/sg-run-job +++ b/sg

[Xen-devel] [OSSTEST PATCH 03/15] ts-syslog-server: New test script

2017-06-21 Thread Ian Jackson
n with the new "|" spawn-ts mode: it will keep running until it is reaped. Currently it is not part of any jobs. Signed-off-by: Ian Jackson --- ts-syslog-server | 85 1 file changed, 85 insertions(+) create mode 100755 ts-syslog-

[Xen-devel] [OSSTEST PATCH 04/15] sg-run-job: Document run-ts and spawn-ts argument syntaxes

2017-06-21 Thread Ian Jackson
Signed-off-by: Ian Jackson --- v2: More accurate explanation of ! in IFFAIL; and mention $ok. --- sg-run-job | 97 ++ 1 file changed, 97 insertions(+) diff --git a/sg-run-job b/sg-run-job index 4b98e2b..b820642 100755 --- a/sg-run-job

[Xen-devel] [OSSTEST PATCH v2 00/15] capture some syslog output

2017-06-21 Thread Ian Jackson
I discovered that the previous version of this series didn't work because in host examination jobs it started the syslog server before host allocation. This is a bug. It's detected, in a roundabout way, by sg-report-flight: sg-report-flight requires that the testid rows in its output can be topo

[Xen-devel] [OSSTEST PATCH 08/15] sg-run-job: examination: Run host install in prep

2017-06-21 Thread Ian Jackson
We want to run this in prep, so that we can start the syslogd after this. Signed-off-by: Ian Jackson --- sg-run-job | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/sg-run-job b/sg-run-job index dc5fdc2..ea3ea41 100755 --- a/sg-run-job +++ b/sg-run-job @@ -622,8 +622,10

[Xen-devel] [OSSTEST PATCH 02/15] TestSupport: Provide controller_ipaddr

2017-06-21 Thread Ian Jackson
Signed-off-by: Ian Jackson --- Osstest/TestSupport.pm | 11 ++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/Osstest/TestSupport.pm b/Osstest/TestSupport.pm index ce9ffaa..8f8013e 100644 --- a/Osstest/TestSupport.pm +++ b/Osstest/TestSupport.pm @@ -92,7 +92,7 @@ BEGIN

Re: [Xen-devel] [PATCH v1 OSSTEST 3/3] ts-livepatch: Expand testcase to include global/local symbols

2017-06-20 Thread Ian Jackson
Konrad Rzeszutek Wilk writes ("[PATCH v1 OSSTEST 3/3] ts-livepatch: Expand testcase to include global/local symbols"): > testing. The test is to verify that the local symbols > of payloads are ignored during loading. Can we do this with substeps rather than a conditional test execution ? For exa

[Xen-devel] Synoptek extended outage - Xen Project Massachusetts test lab

2017-06-20 Thread Ian Jackson
Our test and CI facility has been off the internet since approximately 0100 UTC last night. This is due to a complete outage of the Synoptek datacentre on Boston Post Road West, in Marlborough, MA. One of our support staff went to the datacentre and reports: I came on site to speak to him per

[Xen-devel] ufs build failure (no __udivdi3) on i386 in linux tip (edf9364d3f92)

2017-06-19 Thread Ian Jackson
osstest service owner writes ("[linux-linus bisection] complete build-i386-pvops"): > branch xen-unstable > xenbranch xen-unstable > job build-i386-pvops > testid kernel-build > > Tree: linux > git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux-2.6.git > Tree: linuxfirmware git://xenbi

<    1   2   3   4   5   6   7   8   9   10   >