[PATCH for-5.1 0/2] block: Fix bdrv_aligned_p*v() for qiov_offset != 0

2020-07-28 Thread Max Reitz
Hi, Patch 1 is the fix, patch 2 adds a test. I think we must get this into 5.1, rc2 or not. Max Reitz (2): block: Fix bdrv_aligned_p*v() for qiov_offset != 0 iotests/028: Add test for cross-base-EOF reads block/io.c | 10 ++ tests/qemu-iotests/028 | 19

[PATCH for-5.1 2/2] iotests/028: Add test for cross-base-EOF reads

2020-07-28 Thread Max Reitz
Signed-off-by: Max Reitz --- tests/qemu-iotests/028 | 19 +++ tests/qemu-iotests/028.out | 11 +++ 2 files changed, 30 insertions(+) diff --git a/tests/qemu-iotests/028 b/tests/qemu-iotests/028 index 5d043cef92..6dd3ae09a3 100755 --- a/tests/qemu-iotests/028 +++ b

Re: migration: broken snapshot saves appear on s390 when small fields in migration stream removed

2020-07-28 Thread Max Reitz
On 28.07.20 13:35, Paolo Bonzini wrote: > On 28/07/20 13:33, Vladimir Sementsov-Ogievskiy wrote: >>> Thanks for both your investigation.  Does the attached patch help? >> >> For me, the reproducer is fixed with your patch. > > Is it possible to make a quick testcase using qemu-io? This seems to w

Re: migration: broken snapshot saves appear on s390 when small fields in migration stream removed

2020-07-28 Thread Max Reitz
93d25ceea3c0dcbe6d6b425309317fab6b22e (refs/bisect/bad) > Author: Vladimir Sementsov-Ogievskiy > Date: Tue Jun 4 19:15:13 2019 +0300 > > block/qcow2: implement .bdrv_co_preadv_part > > Indeed, I am currently able to reliable reproduce the issue with this > commit a

[PULL 2/3] iotests: Select a default machine for the rx and avr targets

2020-07-27 Thread Max Reitz
e already do for the arm- and tricore-softmmu targets. Signed-off-by: Thomas Huth Message-Id: <20200722161908.25383-1-th...@redhat.com> Signed-off-by: Max Reitz --- tests/qemu-iotests/check | 14 +- 1 file changed, 9 insertions(+), 5 deletions(-) diff --git a/tests/qemu-

[PULL 3/3] iotests/197: Fix for compat=0.10

2020-07-27 Thread Max Reitz
test fails. Just force compat=1.1 for that particular case to enforce the cluster to get allocated. Fixes: 61b3043965fe3552ee2684a97e7cc809ca7a71b3 Signed-off-by: Max Reitz Message-Id: <20200727135237.1096841-1-mre...@redhat.com> Reviewed-by: Eric Blake --- tests/qemu-iotests/197 | 4 +

[PULL 0/3] Block patches for 5.1

2020-07-27 Thread Max Reitz
for qcow2 -o compat=0.10 -------- Max Reitz (2): block/amend: Check whether the node exists iotests/197: Fix for compat=0.10 Thomas Huth (1): iotests: Select a default machine for the rx and avr targets block/amend.c

[PULL 1/3] block/amend: Check whether the node exists

2020-07-27 Thread Max Reitz
: ced914d0ab9fb2c900f873f6349a0b8eecd1fdbe Signed-off-by: Max Reitz Message-Id: <20200710095037.10885-1-mre...@redhat.com> Reviewed-by: Maxim Levitsky --- block/amend.c | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/block/amend.c b/block/amend.c index f4612dcf08..392df9ef83 100644

[Bug 1888467] Re: qemu-img http convert bug

2020-07-27 Thread Max Reitz
OK, that’s interesting. To be honest, I have no idea. I’ll keep this in mind and I’ll try to play around with it, but I can’t promise anything. -- You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1888467 T

[PATCH] iotests/197: Fix for compat=0.10

2020-07-27 Thread Max Reitz
test fails. Just force compat=1.1 for that particular case to enforce the cluster to get allocated. Fixes: 61b3043965fe3552ee2684a97e7cc809ca7a71b3 Signed-off-by: Max Reitz --- tests/qemu-iotests/197 | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/tests/qemu-iotests/197 b

Re: [PATCH 2/2] qemu-iotests: Test convert to qcow2 compressed to NBD

2020-07-27 Thread Max Reitz
On 26.07.20 17:25, Nir Soffer wrote: > Add test for "qemu-img convert -O qcow2 -c" to NBD target. The use case > is writing compressed disk content to OVA archive. > > Signed-off-by: Nir Soffer > --- > tests/qemu-iotests/302 | 83 ++ > tests/qemu-iotests/3

Re: [PATCH 1/2] block: nbd: Fix convert qcow2 compressed to nbd

2020-07-27 Thread Max Reitz
On 26.07.20 17:25, Nir Soffer wrote: > When converting to qcow2 compressed format, the last step is a special > zero length compressed write, ending in call to bdrv_co_truncate(). This > call always fail for the nbd driver since it does not implement > bdrv_co_truncate(). > > For block devices, wh

Re: [PATCH v7 34/47] backup: Deal with filters

2020-07-24 Thread Max Reitz
On 23.07.20 17:51, Andrey Shinkevich wrote: > On 25.06.2020 18:22, Max Reitz wrote: >> Signed-off-by: Max Reitz >> --- >>   block/backup-top.c |  2 +- >>   block/backup.c |  9 + >>   blockdev.c | 19 +++ >>   3 files

Re: [PATCH v7 33/47] mirror: Deal with filters

2020-07-24 Thread Max Reitz
On 22.07.20 20:31, Andrey Shinkevich wrote: > On 25.06.2020 18:22, Max Reitz wrote: >> This includes some permission limiting (for example, we only need to >> take the RESIZE permission for active commits where the base is smaller >> than the top). >> >&g

Re: [PATCH v7 29/47] blockdev: Use CAF in external_snapshot_prepare()

2020-07-24 Thread Max Reitz
On 20.07.20 18:08, Andrey Shinkevich wrote: > On 25.06.2020 18:21, Max Reitz wrote: >> This allows us to differentiate between filters and nodes with COW >> backing files: Filters cannot be used as overlays at all (for this >> function). >> >> Signed-off-by: Max

Re: [PATCH v7 28/47] block/null: Implement bdrv_get_allocated_file_size

2020-07-24 Thread Max Reitz
On 20.07.20 17:10, Andrey Shinkevich wrote: > On 25.06.2020 18:21, Max Reitz wrote: >> It is trivial, so we might as well do it. >> >> Signed-off-by: Max Reitz >> --- >>   block/null.c   | 7 +++ >>   tests/qemu-iotests/153.out | 2

Re: [PATCH for-5.1] iotests: Select a default machine for the rx and avr targets

2020-07-24 Thread Max Reitz
On 22.07.20 18:19, Thomas Huth wrote: > If you are building only with either the new rx-softmmu or avr-softmmu > target, "make check-block" fails a couple of tests since there is no > default machine defined in these new targets. We have to select a machine > in the "check" script for these, just l

Re: [PATCH] block/amend: Check whether the node exists

2020-07-24 Thread Max Reitz
On 10.07.20 11:50, Max Reitz wrote: > We should check whether the user-specified node-name actually refers to > a node. The simplest way to do that is to use bdrv_lookup_bs() instead > of bdrv_find_node() (the former wraps the latter, and produces an error > message if necessary). &

Re: [PATCH] block/amend: Check whether the node exists

2020-07-24 Thread Max Reitz
On 23.07.20 19:56, Peter Maydell wrote: > On Fri, 10 Jul 2020 at 10:51, Max Reitz wrote: >> >> We should check whether the user-specified node-name actually refers to >> a node. The simplest way to do that is to use bdrv_lookup_bs() instead >> of bdrv_find_node() (

Re: [PATCH v2 20/20] simplebench: add bench-backup.py

2020-07-23 Thread Max Reitz
On 01.06.20 20:11, Vladimir Sementsov-Ogievskiy wrote: > Add script to benchmark new backup architecture. > > Signed-off-by: Vladimir Sementsov-Ogievskiy > --- > scripts/simplebench/bench-backup.py | 132 > 1 file changed, 132 insertions(+) > create mode 100755 scri

Re: [PATCH v2 19/20] simplebench: bench_block_job: add cmd_options argument

2020-07-23 Thread Max Reitz
b.py > @@ -1,4 +1,4 @@ > -#!/usr/bin/env python > +#!/usr/bin/env python3 Looks a bit unrelated. Apart from that: Reviewed-by: Max Reitz signature.asc Description: OpenPGP digital signature

Re: [PATCH v2 18/20] block/block-copy: drop unused argument of block_copy()

2020-07-23 Thread Max Reitz
ns(-) Reviewed-by: Max Reitz signature.asc Description: OpenPGP digital signature

Re: [PATCH v2 17/20] backup: move to block-copy

2020-07-23 Thread Max Reitz
On 01.06.20 20:11, Vladimir Sementsov-Ogievskiy wrote: > This brings async request handling and block-status driven chunk sizes > to backup out of the box, which improves backup performance. > > Signed-off-by: Vladimir Sementsov-Ogievskiy > --- > include/block/block-copy.h | 9 +-- > block/bac

Re: [PATCH v2 16/20] iotests: 257: prepare for backup over block-copy

2020-07-23 Thread Max Reitz
+++--- > 2 files changed, 154 insertions(+), 153 deletions(-) It’s a shame that we don’t run this test with the default configuration then, but I suppose that’s how it is. For now, at least. Reviewed-by: Max Reitz signature.asc Description: OpenPGP digital signature

Re: [PATCH v2 15/20] iotests: 219: prepare for backup over block-copy

2020-07-23 Thread Max Reitz
On 01.06.20 20:11, Vladimir Sementsov-Ogievskiy wrote: > The further change of moving backup to be a on block-copy call will -on? > make copying chunk-size and cluster-size a separate things. So, even s/a/two/ > with 64k cluster sized qcow2 image, default chunk would be 1M. > Test 219 depends o

Re: [PATCH v2 14/20] iotests: 185: prepare for backup over block-copy

2020-07-23 Thread Max Reitz
;: 65536 } }" \ > + 'speed': 65536, > + 'x-max-chunk': 65536 } }" \ Out of curiosity, would it also suffice to disable copy offloading? But anyway: Reviewed-by: Max Reitz > "return" > > # If we d

Re: [PATCH v2 13/20] iotests: 129: prepare for backup over block-copy

2020-07-23 Thread Max Reitz
On 01.06.20 20:11, Vladimir Sementsov-Ogievskiy wrote: > After introducing parallel async copy requests instead of plain > cluster-by-cluster copying loop, backup job may finish earlier than > final assertion in do_test_stop. Let's require slow backup explicitly > by specifying speed parameter. Is

Re: [PATCH v2 12/20] iotests: 56: prepare for backup over block-copy

2020-07-23 Thread Max Reitz
On 01.06.20 20:11, Vladimir Sementsov-Ogievskiy wrote: > After introducing parallel async copy requests instead of plain > cluster-by-cluster copying loop, we'll have to wait for paused status, > as we need to wait for several parallel request. So, let's gently wait > instead of just asserting that

Re: [PATCH v2 11/20] qapi: backup: add x-max-chunk and x-max-workers parameters

2020-07-23 Thread Max Reitz
On 22.07.20 14:22, Max Reitz wrote: > On 01.06.20 20:11, Vladimir Sementsov-Ogievskiy wrote: >> Add new parameters to configure future backup features. The patch >> doesn't introduce aio backup requests (so we actually have only one >> worker) neither requests larg

Re: [PATCH v2 11/20] qapi: backup: add x-max-chunk and x-max-workers parameters

2020-07-22 Thread Max Reitz
On 01.06.20 20:11, Vladimir Sementsov-Ogievskiy wrote: > Add new parameters to configure future backup features. The patch > doesn't introduce aio backup requests (so we actually have only one > worker) neither requests larger than one cluster. Still, formally we > satisfy these maximums anyway, so

Re: [PATCH v2 10/20] job: call job_enter from job_user_pause

2020-07-22 Thread Max Reitz
ff-by: Vladimir Sementsov-Ogievskiy > --- > job.c | 1 + > 1 file changed, 1 insertion(+) Sounds reasonable to me, although I’d prefer an opinion from John. So, a middle-weak: Reviewed-by: Max Reitz signature.asc Description: OpenPGP digital signature

Re: [PATCH v2 09/20] blockjob: add set_speed to BlockJobDriver

2020-07-22 Thread Max Reitz
.h | 2 ++ > blockjob.c | 6 ++ > 2 files changed, 8 insertions(+) Reviewed-by: Max Reitz signature.asc Description: OpenPGP digital signature

Re: [PATCH v2 08/20] block/block-copy: add block_copy_cancel

2020-07-22 Thread Max Reitz
On 01.06.20 20:11, Vladimir Sementsov-Ogievskiy wrote: > Add function to cancel running async block-copy call. It will be used > in backup. > > Signed-off-by: Vladimir Sementsov-Ogievskiy > --- > include/block/block-copy.h | 7 +++ > block/block-copy.c | 22 +++--- >

Re: [PATCH v2 07/20] block/block-copy: add ratelimit to block-copy

2020-07-22 Thread Max Reitz
On 01.06.20 20:11, Vladimir Sementsov-Ogievskiy wrote: > We are going to directly use one async block-copy operation for backup > job, so we need rate limitator. %s/limitator/limiter/g, I think. > We want to maintain current backup behavior: only background copying is > limited and copy-before-wr

Re: [PATCH v2 06/20] block/block-copy: add max_chunk and max_workers parameters

2020-07-22 Thread Max Reitz
On 01.06.20 20:11, Vladimir Sementsov-Ogievskiy wrote: > They will be used for backup. > > Signed-off-by: Vladimir Sementsov-Ogievskiy > --- > include/block/block-copy.h | 5 + > block/block-copy.c | 10 -- > 2 files changed, 13 insertions(+), 2 deletions(-) > > diff --git

[Bug 1888467] Re: qemu-img http convert bug

2020-07-22 Thread Max Reitz
Hi, What exactly do you mean by “file size”? The file length (as reported by ls -l) or the bytes used on disk (reported as “disk size” by qemu- img, or by du -B1)? You say that qcow2 and vmdk are normal – do you mean as input or as output formats? One thing that comes to my mind is that from ht

[PATCH for-5.2 v3 3/3] iotests: Test node/bitmap aliases during migration

2020-07-22 Thread Max Reitz
Signed-off-by: Max Reitz --- tests/qemu-iotests/300 | 515 + tests/qemu-iotests/300.out | 5 + tests/qemu-iotests/group | 1 + 3 files changed, 521 insertions(+) create mode 100755 tests/qemu-iotests/300 create mode 100644 tests/qemu-iotests/300

[PATCH for-5.2 v3 2/3] iotests.py: Add wait_for_runstate()

2020-07-22 Thread Max Reitz
Signed-off-by: Max Reitz --- tests/qemu-iotests/iotests.py | 5 + 1 file changed, 5 insertions(+) diff --git a/tests/qemu-iotests/iotests.py b/tests/qemu-iotests/iotests.py index 3590ed78a0..20645a6e7d 100644 --- a/tests/qemu-iotests/iotests.py +++ b/tests/qemu-iotests/iotests.py @@ -28,6

[PATCH for-5.2 v3 0/3] migration: Add block-bitmap-mapping parameter

2020-07-22 Thread Max Reitz
Test node/bitmap aliases during migration' Max Reitz (3): migration: Add block-bitmap-mapping parameter iotests.py: Add wait_for_runstate() iotests: Test node/bitmap aliases during migration qapi/migration.json| 104 ++- migration/migration.h | 3 + migrat

[PATCH for-5.2 v3 1/3] migration: Add block-bitmap-mapping parameter

2020-07-22 Thread Max Reitz
(on the source, the destination, or even both with arbitrary aliases in the migration stream). Suggested-by: Vladimir Sementsov-Ogievskiy Signed-off-by: Max Reitz --- qapi/migration.json| 104 - migration/migration.h | 3 + migration/block-dirty-bitmap.c | 373

Re: [PATCH for-5.1 v2 2/2] iotests: Test sparseness for qemu-img convert -n

2020-07-21 Thread Max Reitz
On 21.07.20 15:55, Kevin Wolf wrote: > Signed-off-by: Kevin Wolf > --- > tests/qemu-iotests/122 | 30 ++ > tests/qemu-iotests/122.out | 17 + > 2 files changed, 47 insertions(+) Reviewed-by: Max Reitz signature.asc Description:

[PULL 1/3] block/crypto: disallow write sharing by default

2020-07-21 Thread Max Reitz
key management") Bugzilla: https://bugzilla.redhat.com/show_bug.cgi?id=1857490 Signed-off-by: Maxim Levitsky Message-Id: <20200719122059.59843-2-mlevi...@redhat.com> Signed-off-by: Max Reitz --- block/crypto.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/block/crypt

[PULL 2/3] qemu-iotests: add testcase for bz #1857490

2020-07-21 Thread Max Reitz
From: Maxim Levitsky Test that we can't write-share raw luks images by default, but we still can with share-rw=on Signed-off-by: Maxim Levitsky Message-Id: <20200719122059.59843-3-mlevi...@redhat.com> Signed-off-by: Max Reitz --- tests/qemu-iotests/2

[PULL 3/3] block: fix bdrv_aio_cancel() for ENOMEDIUM requests

2020-07-21 Thread Max Reitz
glink: https://bugs.launchpad.net/qemu/+bug/1878255 Originally-by: Philippe Mathieu-Daudé Signed-off-by: Stefan Hajnoczi Message-Id: <20200720100141.129739-1-stefa...@redhat.com> Signed-off-by: Max Reitz --- block/block-backend.c | 8 1 file changed, 8 insertions(+) diff --git a/block

[PULL 0/3] Block patches for 5.1

2020-07-21 Thread Max Reitz
The following changes since commit af3d69058e09bede9900f266a618ed11f76f49f3: Merge remote-tracking branch 'remotes/pmaydell/tags/pull-target-arm-20200720' into staging (2020-07-20 15:58:07 +0100) are available in the Git repository at: https://github.com/XanClic/qemu.git tags/pull-block-202

Re: [PATCH for-5.1 2/2] iotests: Test sparseness for qemu-img convert -n

2020-07-21 Thread Max Reitz
On 21.07.20 13:20, Kevin Wolf wrote: > Am 21.07.2020 um 12:19 hat Max Reitz geschrieben: >> On 20.07.20 15:18, Kevin Wolf wrote: >>> Signed-off-by: Kevin Wolf >>> --- >>> tests/qemu-iotests/122 | 34 ++

Re: [PATCH for-5.1 2/2] iotests: Test sparseness for qemu-img convert -n

2020-07-21 Thread Max Reitz
On 20.07.20 15:18, Kevin Wolf wrote: > Signed-off-by: Kevin Wolf > --- > tests/qemu-iotests/122 | 34 ++ > tests/qemu-iotests/122.out | 17 + > 2 files changed, 51 insertions(+) > > diff --git a/tests/qemu-iotests/122 b/tests/qemu-iotests/122 >

Re: [PATCH for-5.1 1/2] qcow2: Implement v2 zero writes with discard if possible

2020-07-21 Thread Max Reitz
e source image was empty. > > Reported-by: Nir Soffer > Signed-off-by: Kevin Wolf > --- > block/qcow2-cluster.c | 9 - > 1 file changed, 8 insertions(+), 1 deletion(-) Reviewed-by: Max Reitz signature.asc Description: OpenPGP digital signature

Re: [PATCH for-5.1] block: fix bdrv_aio_cancel() for ENOMEDIUM requests

2020-07-21 Thread Max Reitz
On 20.07.20 12:01, Stefan Hajnoczi wrote: > bdrv_aio_cancel() calls aio_poll() on the AioContext for the given I/O > request until it has completed. ENOMEDIUM requests are special because > there is no BlockDriverState when the drive has no medium! > > Define a .get_aio_context() function for BlkA

Re: [PATCH v2 05/20] block/block-copy: implement block_copy_async

2020-07-21 Thread Max Reitz
On 17.07.20 17:24, Vladimir Sementsov-Ogievskiy wrote: > 17.07.2020 17:00, Max Reitz wrote: >> On 01.06.20 20:11, Vladimir Sementsov-Ogievskiy wrote: >>> We'll need async block-copy invocation to use in backup directly. >>> >>> Signed-off-by: Vladimir S

Re: [PATCH v2 3/3] iotests: Test node/bitmap aliases during migration

2020-07-21 Thread Max Reitz
On 20.07.20 20:02, Vladimir Sementsov-Ogievskiy wrote: > 16.07.2020 16:53, Max Reitz wrote: >> Signed-off-by: Max Reitz >> --- >>   tests/qemu-iotests/300 | 511 + >>   tests/qemu-iotests/300.out |   5 + >>   tests/qemu-iot

Re: [PATCH v2 2/3] iotests.py: Add wait_for_runstate()

2020-07-21 Thread Max Reitz
On 20.07.20 18:46, Vladimir Sementsov-Ogievskiy wrote: > 16.07.2020 16:53, Max Reitz wrote: >> Signed-off-by: Max Reitz >> --- >>   tests/qemu-iotests/iotests.py | 4 >>   1 file changed, 4 insertions(+) >> >> diff --git a/tests/qemu-iotests/iotest

Re: [PATCH v2 1/3] migration: Add block-bitmap-mapping parameter

2020-07-21 Thread Max Reitz
On 20.07.20 18:31, Vladimir Sementsov-Ogievskiy wrote: > 16.07.2020 16:53, Max Reitz wrote: >> This migration parameter allows mapping block node names and bitmap >> names to aliases for the purpose of block dirty bitmap migration. >> >> This way, management tools can us

Re: [PATCH 0/2] Fix for write sharing on luks raw images

2020-07-20 Thread Max Reitz
On 19.07.20 14:20, Maxim Levitsky wrote: > A rebase gone wrong, and I ended up allowing a luks image > to be opened at the same time by two VMs without any warnings/overrides. > > Fix that and also add an iotest to prevent this from happening. > > Best regards, > Maxim Levisky > > Maxim Le

Re: [PATCH v2 05/20] block/block-copy: implement block_copy_async

2020-07-17 Thread Max Reitz
On 01.06.20 20:11, Vladimir Sementsov-Ogievskiy wrote: > We'll need async block-copy invocation to use in backup directly. > > Signed-off-by: Vladimir Sementsov-Ogievskiy > --- > include/block/block-copy.h | 13 + > block/block-copy.c | 40

Re: [PATCH v2 04/20] block/block-copy: More explicit call_state

2020-07-17 Thread Max Reitz
t; +ret = block_copy_dirty_clusters(call_state); It’s possible that much of this code will change in a future patch of this series, but as it is, it might be nice to make block_copy_dirty_clusters’s argument a const pointer so it’s clear that the call to block_copy_wait_one() below will use the

Re: [PATCH v2 03/20] qapi: backup: add x-use-copy-range parameter

2020-07-17 Thread Max Reitz
On 01.06.20 20:11, Vladimir Sementsov-Ogievskiy wrote: > Add parameter to enable/disable copy_range. Keep current default for > now (enabled). Why x-, though? I can’t think of a reason why we would have to remove this. > Signed-off-by: Vladimir Sementsov-Ogievskiy > --- > qapi/block-core.json

Re: [PATCH v2 02/20] iotests: 129 don't check backup "busy"

2020-07-17 Thread Max Reitz
ts/qemu-iotests/129 | 1 - > 1 file changed, 1 deletion(-) Reviewed-by: Max Reitz signature.asc Description: OpenPGP digital signature

Re: [PATCH for-5.1 3/3] file-posix: Fix leaked fd in raw_open_common() error path

2020-07-17 Thread Max Reitz
On 17.07.20 12:54, Kevin Wolf wrote: > Signed-off-by: Kevin Wolf > --- > block/file-posix.c | 3 +++ > 1 file changed, 3 insertions(+) Reviewed-by: Max Reitz signature.asc Description: OpenPGP digital signature

Re: [PATCH for-5.1 2/3] file-posix: Fix check_hdev_writable() with auto-read-only

2020-07-17 Thread Max Reitz
> Signed-off-by: Kevin Wolf > --- > block/file-posix.c | 33 +---- > 1 file changed, 21 insertions(+), 12 deletions(-) Reviewed-by: Max Reitz signature.asc Description: OpenPGP digital signature

Re: [PATCH for-5.1 1/3] file-posix: Move check_hdev_writable() up

2020-07-17 Thread Max Reitz
nged, 33 insertions(+), 33 deletions(-) Reviewed-by: Max Reitz signature.asc Description: OpenPGP digital signature

Re: [PATCH for-5.1 v2 1/2] block: Require aligned image size to avoid assertion failure

2020-07-17 Thread Max Reitz
On 17.07.20 13:32, Kevin Wolf wrote: > Am 17.07.2020 um 13:02 hat Max Reitz geschrieben: >> On 16.07.20 16:26, Kevin Wolf wrote: >>> Unaligned requests will automatically be aligned to bl.request_alignment >>> and we can't extend write requests to access space

Re: [PATCH for-5.1 v2 2/2] file-posix: Allow byte-aligned O_DIRECT with NFS

2020-07-17 Thread Max Reitz
s just look at the file system magic and disable > s->needs_alignment for NFS. This way, O_DIRECT can still be used on NFS > for images that are not aligned to 4k. > > Signed-off-by: Kevin Wolf > Reviewed-by: Eric Blake > --- > block/file-posix.c | 26 +++++

Re: [PATCH for-5.1 v2 1/2] block: Require aligned image size to avoid assertion failure

2020-07-17 Thread Max Reitz
t can have backing files (i.e., qcow2 in practice) because WRITE_UNCHANGED is only used by COR and block jobs doing something with a backing chain, so it shouldn’t matter in practice, but, well. So, either way: Reviewed-by: Max Reitz > +!(cumulative_perms & B

Re: [PATCH v7 21/47] block: Use CAFs in bdrv_refresh_filename()

2020-07-16 Thread Max Reitz
On 15.07.20 14:52, Andrey Shinkevich wrote: > On 25.06.2020 18:21, Max Reitz wrote: >> bdrv_refresh_filename() and the kind of related bdrv_dirname() should >> look to the primary child when they wish to copy the underlying file's >> filename. >> >> Signed-

Re: [PATCH v7 20/47] block: Iterate over children in refresh_limits

2020-07-16 Thread Max Reitz
On 14.07.20 20:37, Andrey Shinkevich wrote: > On 25.06.2020 18:21, Max Reitz wrote: >> Instead of looking at just bs->file and bs->backing, we should look at >> all children that could end up receiving forwarded requests. >> >> Signed-off-by: Max R

Re: [PATCH v7 19/47] vmdk: Drop vmdk_co_flush()

2020-07-16 Thread Max Reitz
On 14.07.20 16:52, Andrey Shinkevich wrote: > On 25.06.2020 18:21, Max Reitz wrote: >> Before HEAD^, we needed this because bdrv_co_flush() by itself would >> only flush bs->file.  With HEAD^, bdrv_co_flush() will flush all >> children on which a WRITE or WRITE_UNCHANGED p

Re: [PATCH v7 17/47] block: Re-evaluate backing file handling in reopen

2020-07-16 Thread Max Reitz
On 10.07.20 21:42, Andrey Shinkevich wrote: > On 25.06.2020 18:21, Max Reitz wrote: >> Reopening a node's backing child needs a bit of special handling because >> the "backing" child has different defaults than all other children >> (among other things).  Addi

Re: [PATCH v7 14/47] stream: Deal with filters

2020-07-16 Thread Max Reitz
On 10.07.20 19:41, Andrey Shinkevich wrote: > On 10.07.2020 18:24, Max Reitz wrote: >> On 09.07.20 16:52, Andrey Shinkevich wrote: >>> On 25.06.2020 18:21, Max Reitz wrote: >>>> Because of the (not so recent anymore) changes that make the stream job >>>>

Re: [PATCH v7 02/47] block: Add chain helper functions

2020-07-16 Thread Max Reitz
On 13.07.20 12:18, Vladimir Sementsov-Ogievskiy wrote: > 25.06.2020 18:21, Max Reitz wrote: >> Add some helper functions for skipping filters in a chain of block >> nodes. >> >> Signed-off-by: Max Reitz >> --- >>   include/block/block_int.h |  3

Re: [PATCH v7 01/47] block: Add child access functions

2020-07-16 Thread Max Reitz
On 13.07.20 11:06, Vladimir Sementsov-Ogievskiy wrote: > 25.06.2020 18:21, Max Reitz wrote: >> There are BDS children that the general block layer code can access, >> namely bs->file and bs->backing.  Since the introduction of filters and >> external data files, their

Re: [PATCH for-5.1] iotests/030: Reduce job speed to make race less likely

2020-07-16 Thread Max Reitz
> Reported-by: Peter Maydell > Signed-off-by: Kevin Wolf > --- > tests/qemu-iotests/030 | 2 +- > 1 file changed, 1 insertion(+), 1 deletion(-) Reviewed-by: Max Reitz signature.asc Description: OpenPGP digital signature

[PATCH v2 3/3] iotests: Test node/bitmap aliases during migration

2020-07-16 Thread Max Reitz
Signed-off-by: Max Reitz --- tests/qemu-iotests/300 | 511 + tests/qemu-iotests/300.out | 5 + tests/qemu-iotests/group | 1 + 3 files changed, 517 insertions(+) create mode 100755 tests/qemu-iotests/300 create mode 100644 tests/qemu-iotests/300

[PATCH v2 1/3] migration: Add block-bitmap-mapping parameter

2020-07-16 Thread Max Reitz
(on the source, the destination, or even both with arbitrary aliases in the migration stream). Suggested-by: Vladimir Sementsov-Ogievskiy Signed-off-by: Max Reitz --- Vladimir noted in v1 that it would be better to ignore bitmaps whose names aren't mapped, or that are on nodes whose names a

[PATCH v2 2/3] iotests.py: Add wait_for_runstate()

2020-07-16 Thread Max Reitz
Signed-off-by: Max Reitz --- tests/qemu-iotests/iotests.py | 4 1 file changed, 4 insertions(+) diff --git a/tests/qemu-iotests/iotests.py b/tests/qemu-iotests/iotests.py index 3590ed78a0..fb240a334c 100644 --- a/tests/qemu-iotests/iotests.py +++ b/tests/qemu-iotests/iotests.py @@ -803,6

[PATCH v2 0/3] migration: Add block-bitmap-mapping parameter

2020-07-16 Thread Max Reitz
] : patch is downstream-only The flags [FC] indicate (F)unctional and (C)ontextual differences, respectively 001/3:[0117] [FC] 'migration: Add block-bitmap-mapping parameter' 002/3:[] [--] 'iotests.py: Add wait_for_runstate()' 003/3:[0202] [FC] 'iotests: Test node/bitmap

Re: [PATCH v11 00/34] Add subcluster allocation to qcow2

2020-07-15 Thread Max Reitz
On 15.07.20 13:51, Alberto Garcia wrote: > On Tue, Jul 14, 2020 at 02:56:57PM +0200, Max Reitz wrote: >> Thanks, fixed up patch 21 (by initializing expected_type to just >> anything, I chose QCOW2_SUBCLUSTER_NORMAL, which I preferred over >> just using 0), resolved some iotes

Re: [PATCH for-5.1 1/2] block: Require aligned image size to avoid assertion failure

2020-07-14 Thread Max Reitz
On 14.07.20 13:08, Kevin Wolf wrote: > Am 14.07.2020 um 11:56 hat Max Reitz geschrieben: >> On 13.07.20 16:29, Kevin Wolf wrote: >>> Am 13.07.2020 um 13:19 hat Max Reitz geschrieben: >>>> On 10.07.20 16:21, Kevin Wolf wrote: >>>>> Unalig

Re: [PATCH v11 00/34] Add subcluster allocation to qcow2

2020-07-14 Thread Max Reitz
On 10.07.20 18:12, Alberto Garcia wrote: > Hi, > > here's the new version of the patches to add subcluster allocation > support to qcow2. > > Please refer to the cover letter of the first version for a full > description of the patches: > >https://lists.gnu.org/archive/html/qemu-block/2019-1

Re: [PATCH v11 31/34] qcow2: Add the 'extended_l2' option and the QCOW2_INCOMPAT_EXTL2 bit

2020-07-14 Thread Max Reitz
d-by: Eric Blake > Reviewed-by: Max Reitz > --- > qapi/block-core.json | 7 +++ > block/qcow2.h| 8 ++- > include/block/block_int.h| 1 + > block/qcow2.c| 66 ++-- > tests/qemu-iotests/031.

Re: [PATCH for-5.1 1/2] block: Require aligned image size to avoid assertion failure

2020-07-14 Thread Max Reitz
On 13.07.20 16:29, Kevin Wolf wrote: > Am 13.07.2020 um 13:19 hat Max Reitz geschrieben: >> On 10.07.20 16:21, Kevin Wolf wrote: >>> Unaligned requests will automatically be aligned to bl.request_alignment >>> and we don't want to extend requests to access space bey

Re: [PATCH for-5.1 1/2] block: Require aligned image size to avoid assertion failure

2020-07-13 Thread Max Reitz
On 13.07.20 13:19, Max Reitz wrote: > On 10.07.20 16:21, Kevin Wolf wrote: >> Unaligned requests will automatically be aligned to bl.request_alignment >> and we don't want to extend requests to access space beyond the end of >> the image, so it's required that the im

Re: [PATCH for-5.1 1/2] block: Require aligned image size to avoid assertion failure

2020-07-13 Thread Max Reitz
On 10.07.20 16:21, Kevin Wolf wrote: > Unaligned requests will automatically be aligned to bl.request_alignment > and we don't want to extend requests to access space beyond the end of > the image, so it's required that the image size is aligned. > > With write requests, this could cause assertion

Re: [PATCH] block: Raise an error when backing file parameter is an empty string

2020-07-13 Thread Max Reitz
On 17.06.20 20:27, Sorry :/ Connor Kuehl wrote: > Providing an empty string for the backing file parameter like so: > > qemu-img create -f qcow2 -b '' /tmp/foo > > allows the flow of control to reach and subsequently fail an assert > statement because passing an empty string to > >

Re: [PATCH v6 01/10] qemu-img: Flush stdout before before potential stderr messages

2020-07-13 Thread Max Reitz
On 06.07.20 22:39, Eric Blake wrote: > During 'qemu-img create ... 2>&1', if --quiet is not in force, we can > end up with buffered I/O in stdout that was produced before failure, > but which appears in output after failure. This is confusing; the fix > is to flush stdout prior to attempting anyth

Re: [PATCH for-5.1] file-posix: Mitigate file fragmentation with extent size hints

2020-07-13 Thread Max Reitz
On 10.07.20 18:12, Max Reitz wrote: > On 07.07.20 18:17, Kevin Wolf wrote: >> Am 07.07.2020 um 16:23 hat Kevin Wolf geschrieben: >>> Espeically when O_DIRECT is used with image files so that the page cache >>> indirection can't cause a merge of allocating request

Re: [PATCH 2/2] iotests: Set LC_ALL=C for sort

2020-07-13 Thread Max Reitz
On 11.07.20 10:57, Alex Bennée wrote: > > Max Reitz writes: > >> Otherwise the result is basically unpredictable. >> >> (Note that the precise environment variable to control sorting order is >> LC_COLLATE, but LC_ALL overrides LC_COLLATE, and we do not want the

Re: [PATCH 0/2] iotests: More _filter_img_create fixes

2020-07-12 Thread Max Reitz
On 10.07.20 19:18, John Snow wrote: > > > On 7/10/20 12:32 PM, Max Reitz wrote: >> Hi, >> >> I’m sorry. >> >> John, could I ask you to test whether this series fixes the problems >> you’re seeing? >> > > This is based on kwolf/block,

[PATCH 0/2] iotests: More _filter_img_create fixes

2020-07-10 Thread Max Reitz
Hi, I’m sorry. John, could I ask you to test whether this series fixes the problems you’re seeing? Max Reitz (2): iotests: Drop readarray from _do_filter_img_create iotests: Set LC_ALL=C for sort tests/qemu-iotests/common.filter | 12 ++-- 1 file changed, 6 insertions(+), 6

[PATCH 2/2] iotests: Set LC_ALL=C for sort

2020-07-10 Thread Max Reitz
: Max Reitz --- tests/qemu-iotests/common.filter | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/tests/qemu-iotests/common.filter b/tests/qemu-iotests/common.filter index 345c3ca03e..4fd5c29b2a 100644 --- a/tests/qemu-iotests/common.filter +++ b/tests/qemu-iotests/common.filter

[PATCH 1/2] iotests: Drop readarray from _do_filter_img_create

2020-07-10 Thread Max Reitz
Some systems where we run tests on do not have a 4.x bash, so they do not have readarray. While it looked a bit nicer than messing with `head` and `tail`, we do not really need it, so we might as well not use it. Reported-by: Claudio Fontana Signed-off-by: Max Reitz --- tests/qemu-iotests

Re: [PATCH for-5.1] file-posix: Mitigate file fragmentation with extent size hints

2020-07-10 Thread Max Reitz
On 07.07.20 18:17, Kevin Wolf wrote: > Am 07.07.2020 um 16:23 hat Kevin Wolf geschrieben: >> Espeically when O_DIRECT is used with image files so that the page cache >> indirection can't cause a merge of allocating requests, the file will >> fragment on the file system layer, with a potentially ver

Re: [PULL v2 00/52] Misc patches for QEMU 5.1 soft freeze

2020-07-10 Thread Max Reitz
On 10.07.20 17:42, Peter Maydell wrote: > On Fri, 10 Jul 2020 at 16:31, Max Reitz wrote: >> >> On 10.07.20 17:18, Peter Maydell wrote: >>> readarray only arrived sometime in bash 4, and the OSX system >>> bash is 3.2.57, so it won't have that builtin. >

Re: [PULL v2 00/52] Misc patches for QEMU 5.1 soft freeze

2020-07-10 Thread Max Reitz
On 10.07.20 17:18, Peter Maydell wrote: > On Fri, 10 Jul 2020 at 16:13, Max Reitz wrote: >> >> On 10.07.20 16:44, Claudio Fontana wrote: >>> Speaking of MacOS and CI, commit 57ee95ed4ee7b4c039ec5f0705c45734c56706bc >>> >>> Author: Max Reitz

Re: [PATCH v7 14/47] stream: Deal with filters

2020-07-10 Thread Max Reitz
On 09.07.20 17:13, Andrey Shinkevich wrote: > On 25.06.2020 18:21, Max Reitz wrote: >> Because of the (not so recent anymore) changes that make the stream job >> independent of the base node and instead track the node above it, we >> have to split that "bottom" node

Re: [PATCH v7 14/47] stream: Deal with filters

2020-07-10 Thread Max Reitz
On 09.07.20 16:52, Andrey Shinkevich wrote: > On 25.06.2020 18:21, Max Reitz wrote: >> Because of the (not so recent anymore) changes that make the stream job >> independent of the base node and instead track the node above it, we >> have to split that "bottom" node

Re: [PULL v2 00/52] Misc patches for QEMU 5.1 soft freeze

2020-07-10 Thread Max Reitz
I see. Yeah, configure by default doesn't enable -Werror for OSX. >>> My build tree has >>> '--extra-cflags=-fdiagnostics-color=never -Werror >>> -Wno-error=deprecated-declarations' >> >> TIL this is different on OSX... >> >>> &g

Re: [PULL 18/31] block/core: add generic infrastructure for x-blockdev-amend qmp command

2020-07-10 Thread Max Reitz
On 09.07.20 17:09, Peter Maydell wrote: > On Mon, 6 Jul 2020 at 11:05, Max Reitz wrote: >> >> From: Maxim Levitsky >> >> blockdev-amend will be used similiar to blockdev-create >> to allow on the fly changes of the structure of the format based block >>

[PATCH] block/amend: Check whether the node exists

2020-07-10 Thread Max Reitz
: ced914d0ab9fb2c900f873f6349a0b8eecd1fdbe Signed-off-by: Max Reitz --- block/amend.c | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/block/amend.c b/block/amend.c index f4612dcf08..392df9ef83 100644 --- a/block/amend.c +++ b/block/amend.c @@ -69,8 +69,12 @@ void qmp_x_blockdev_amend(const

Re: [PATCH v10 31/34] qcow2: Add the 'extended_l2' option and the QCOW2_INCOMPAT_EXTL2 bit

2020-07-09 Thread Max Reitz
d-by: Eric Blake > Reviewed-by: Max Reitz > --- After running basically all test combinations I usually run, I noticed that 191 should also be modified to drop the extended_l2 option from the qemu-img info output (down under “checking image base” and “checking image layer”, where there are

<    9   10   11   12   13   14   15   16   17   18   >