Hello community, here is the log from the commit of package btrfsprogs for openSUSE:Factory checked in at 2014-07-13 14:05:57 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Comparing /work/SRC/openSUSE:Factory/btrfsprogs (Old) and /work/SRC/openSUSE:Factory/.btrfsprogs.new (New) ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Package is "btrfsprogs" Changes: -------- --- /work/SRC/openSUSE:Factory/btrfsprogs/btrfsprogs.changes 2014-06-18 07:52:32.000000000 +0200 +++ /work/SRC/openSUSE:Factory/.btrfsprogs.new/btrfsprogs.changes 2014-07-13 14:06:34.000000000 +0200 @@ -1,0 +2,19 @@ +Wed Jul 9 18:08:37 UTC 2014 - mfas...@suse.com + +- refresh references on the following patches: + * 0200-btrfs-progs-print-qgroup-excl-as-unsigned.patch + * 0201-btrfs-progs-import-ulist.patch + * 0202-btrfs-progs-add-quota-group-verify-code.patch + * 0203-btrfs-progs-show-extent-state-for-a-subvolume.patch +- btrfs-progs: ignore orphaned qgroups by default +- Added patch: + * 0204-btrfs-progs-ignore-orphaned-qgroups-by-default.patch + +------------------------------------------------------------------- +Mon Jul 7 23:04:51 UTC 2014 - mfas...@suse.com + +- btrfs-progs: show extent state for a subvolume (bnc#865621) +- Added patch: + * 0203-btrfs-progs-show-extent-state-for-a-subvolume.patch + +------------------------------------------------------------------- New: ---- 0203-btrfs-progs-show-extent-state-for-a-subvolume.patch 0204-btrfs-progs-ignore-orphaned-qgroups-by-default.patch ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Other differences: ------------------ ++++++ btrfsprogs.spec ++++++ --- /var/tmp/diff_new_pack.U8GSEG/_old 2014-07-13 14:06:35.000000000 +0200 +++ /var/tmp/diff_new_pack.U8GSEG/_new 2014-07-13 14:06:35.000000000 +0200 @@ -68,6 +68,8 @@ Patch200: 0200-btrfs-progs-print-qgroup-excl-as-unsigned.patch Patch201: 0201-btrfs-progs-import-ulist.patch Patch202: 0202-btrfs-progs-add-quota-group-verify-code.patch +Patch203: 0203-btrfs-progs-show-extent-state-for-a-subvolume.patch +Patch204: 0204-btrfs-progs-ignore-orphaned-qgroups-by-default.patch Patch1000: local-version-override.patch BuildRequires: asciidoc @@ -141,6 +143,8 @@ %patch200 -p1 %patch201 -p1 %patch202 -p1 +%patch203 -p1 +%patch204 -p1 %patch1000 -p1 %build ++++++ 0200-btrfs-progs-print-qgroup-excl-as-unsigned.patch ++++++ --- /var/tmp/diff_new_pack.U8GSEG/_old 2014-07-13 14:06:35.000000000 +0200 +++ /var/tmp/diff_new_pack.U8GSEG/_new 2014-07-13 14:06:35.000000000 +0200 @@ -2,7 +2,7 @@ From: Mark Fasheh <mfas...@suse.de> Date: Thu, 1 May 2014 22:35:15 -0700 Subject: [PATCH 1/3] btrfs-progs: print qgroup excl as unsigned -References: bnc#865621 +References: bnc#886493 bnc#865621 Upstream: submitted It's unsigned in the structure definition. ++++++ 0201-btrfs-progs-import-ulist.patch ++++++ --- /var/tmp/diff_new_pack.U8GSEG/_old 2014-07-13 14:06:35.000000000 +0200 +++ /var/tmp/diff_new_pack.U8GSEG/_new 2014-07-13 14:06:35.000000000 +0200 @@ -2,7 +2,7 @@ From: Mark Fasheh <mfas...@suse.de> Date: Thu, 1 May 2014 14:34:30 -0700 Subject: [PATCH 2/3] btrfs-progs: import ulist -References: bnc#865621 +References: bnc#886493 bnc#865621 Upstream: submitted qgroup-verify.c wants this for walking root refs. ++++++ 0202-btrfs-progs-add-quota-group-verify-code.patch ++++++ --- /var/tmp/diff_new_pack.U8GSEG/_old 2014-07-13 14:06:35.000000000 +0200 +++ /var/tmp/diff_new_pack.U8GSEG/_new 2014-07-13 14:06:35.000000000 +0200 @@ -2,7 +2,7 @@ From: Mark Fasheh <mfas...@suse.de> Date: Thu, 1 May 2014 22:44:24 -0700 Subject: [PATCH 3/3] btrfs-progs: add quota group verify code -References: bnc#865621 +References: bnc#886493 bnc#865621 Upstream: submitted This patch adds functionality (in qgroup-verify.c) to compute bytecounts in ++++++ 0203-btrfs-progs-show-extent-state-for-a-subvolume.patch ++++++ >From 23356b0034431d5e809b370ee02375b25cd9ced8 Mon Sep 17 00:00:00 2001 From: Mark Fasheh <mfas...@suse.de> Date: Sat, 31 May 2014 22:05:36 -0700 Subject: [PATCH] btrfs-progs: show extent state for a subvolume References: bnc#886493 bnc#865621 Upstream: submitted The qgroup verification code can trivially be extended to provide extended information on the extents which a subvolume root references. Along with qgroup-verify, I have found this tool to be invaluable when tracking down extent references. The patch adds a switch to the check subcommand '--subvol-extents' which takes as args a single subvolume id. When run with the switch, we'll print out each extent that the subvolume references. The extent printout gives standard extent info you would expect along with information on which other roots reference it. Sample output follows - this is a few lines from a run on a subvolume I've been testing qgroup changes on: Print extent state for subvolume 281 on /dev/vdb2 UUID: 8203ca66-9858-4e3f-b447-5bbaacf79c02 Offset Len Root Refs Roots 12582912 20480 12 257 279 280 281 282 283 284 285 286 287 288 289 12603392 8192 12 257 279 280 281 282 283 284 285 286 287 288 289 12611584 12288 12 257 279 280 281 282 283 284 285 286 287 288 289 <snip a bunch of extents to show some variety> 124583936 16384 4 281 282 283 280 125075456 16384 4 280 281 282 283 126255104 16384 11 257 280 281 282 283 284 285 286 287 288 289 4763508736 4096 3 279 280 281 In case it wasn't clear, this applies on top of my qgroup verify patch: "btrfs-progs: add quota group verify code" A branch with all this can be found on github: https://github.com/markfasheh/btrfs-progs-patches/tree/qgroup-verify Please apply, Signed-off-by: Mark Fasheh <mfas...@suse.de> --- cmds-check.c | 12 +++++++++ qgroup-verify.c | 81 ++++++++++++++++++++++++++++++++++++++++++++++++++++++--- qgroup-verify.h | 2 ++ 3 files changed, 92 insertions(+), 3 deletions(-) diff --git a/cmds-check.c b/cmds-check.c index 5401ad9..18d4341 100644 --- a/cmds-check.c +++ b/cmds-check.c @@ -6428,6 +6428,7 @@ static struct option long_options[] = { { "init-csum-tree", 0, NULL, 0 }, { "init-extent-tree", 0, NULL, 0 }, { "backup", 0, NULL, 0 }, + { "subvol-extents", 1, NULL, 'E' }, { "qgroup-report", 0, NULL, 'Q' }, { NULL, 0, NULL, 0} }; @@ -6442,6 +6443,7 @@ const char * const cmd_check_usage[] = { "--init-csum-tree create a new CRC tree", "--init-extent-tree create a new extent tree", "--qgroup-report print a report on qgroup consistency", + "--subvol-extents print subvolume extents and sharing state", NULL }; @@ -6451,6 +6453,7 @@ int cmd_check(int argc, char **argv) struct btrfs_root *root; struct btrfs_fs_info *info; u64 bytenr = 0; + u64 subvolid = 0; char uuidbuf[BTRFS_UUID_UNPARSED_SIZE]; int ret; u64 num; @@ -6486,6 +6489,9 @@ int cmd_check(int argc, char **argv) case 'Q': qgroup_report = 1; break; + case 'E': + subvolid = arg_strtou64(optarg); + break; case '?': case 'h': usage(cmd_check_usage); @@ -6541,6 +6547,12 @@ int cmd_check(int argc, char **argv) print_qgroup_report(1); goto close_out; } + if (subvolid) { + printf("Print extent state for subvolume %llu on %s\nUUID: %s\n", + subvolid, argv[optind], uuidbuf); + ret = print_extent_state(info, subvolid); + goto close_out; + } printf("Checking filesystem on %s\nUUID: %s\n", argv[optind], uuidbuf); if (!extent_buffer_uptodate(info->tree_root->node) || diff --git a/qgroup-verify.c b/qgroup-verify.c index f7692f9..81a1651 100644 --- a/qgroup-verify.c +++ b/qgroup-verify.c @@ -296,6 +296,8 @@ static void find_parent_roots(struct ulist *roots, u64 parent) } while (node && ref->bytenr == parent); } +static void print_subvol_info(u64 subvolid, u64 bytenr, u64 num_bytes, + struct ulist *roots); /* * Account each ref. Walk the refs, for each set of refs in a * given bytenr: @@ -308,7 +310,7 @@ static void find_parent_roots(struct ulist *roots, u64 parent) * - Walk ref_roots ulist, adding extent bytes to each qgroup count that * cooresponds to a found root. */ -static void account_all_refs(void) +static void account_all_refs(int do_qgroups, u64 search_subvol) { int exclusive; struct ref *ref; @@ -358,11 +360,15 @@ static void account_all_refs(void) else exclusive = 0; + if (search_subvol) + print_subvol_info(search_subvol, bytenr, num_bytes, + roots); + ULIST_ITER_INIT(&uiter); while ((unode = ulist_next(roots, &uiter))) { BUG_ON(unode->val == 0ULL); /* We only want to account fs trees */ - if (is_fstree(unode->val)) + if (is_fstree(unode->val) && do_qgroups) add_bytes(unode->val, num_bytes, exclusive); } } @@ -1072,7 +1078,7 @@ int qgroup_verify_all(struct btrfs_fs_info *info) goto out; } - account_all_refs(); + account_all_refs(1, 0); out: /* @@ -1083,3 +1089,72 @@ out: free_ref_tree(&by_bytenr); return ret; } + +static void __print_subvol_info(u64 bytenr, u64 num_bytes, struct ulist *roots) +{ + int n = roots->nnodes; + struct ulist_iterator uiter; + struct ulist_node *unode; + + printf("%llu\t%llu\t%d\t", bytenr, num_bytes, n); + + ULIST_ITER_INIT(&uiter); + while ((unode = ulist_next(roots, &uiter))) { + printf("%llu ", unode->val); + } + printf("\n"); +} + +static void print_subvol_info(u64 subvolid, u64 bytenr, u64 num_bytes, + struct ulist *roots) +{ + struct ulist_iterator uiter; + struct ulist_node *unode; + + ULIST_ITER_INIT(&uiter); + while ((unode = ulist_next(roots, &uiter))) { + BUG_ON(unode->val == 0ULL); + if (unode->val == subvolid) { + __print_subvol_info(bytenr, num_bytes, roots); + return; + } + } + + +} + +int print_extent_state(struct btrfs_fs_info *info, u64 subvol) +{ + int ret; + + tree_blocks = ulist_alloc(0); + if (!tree_blocks) { + fprintf(stderr, + "ERROR: Out of memory while allocating ulist.\n"); + return ENOMEM; + } + + /* + * Put all extent refs into our rbtree + */ + ret = scan_extents(info, 0, ~0ULL); + if (ret) { + fprintf(stderr, "ERROR: while scanning extent tree: %d\n", ret); + goto out; + } + + ret = map_implied_refs(info); + if (ret) { + fprintf(stderr, "ERROR: while mapping refs: %d\n", ret); + goto out; + } + + printf("Offset\t\tLen\tRoot Refs\tRoots\n"); + account_all_refs(0, subvol); + +out: + free_tree_blocks(); + free_ref_tree(&by_bytenr); + return ret; +} + diff --git a/qgroup-verify.h b/qgroup-verify.h index a222c17..9201407 100644 --- a/qgroup-verify.h +++ b/qgroup-verify.h @@ -22,4 +22,6 @@ int qgroup_verify_all(struct btrfs_fs_info *info); void print_qgroup_report(int all); +int print_extent_state(struct btrfs_fs_info *info, u64 subvol); + #endif /* _BTRFS_QGROUP_VERIFY_H */ -- 1.8.4.5 ++++++ 0204-btrfs-progs-ignore-orphaned-qgroups-by-default.patch ++++++ >From 049554016bb8007c39cebc9d855fea5e600a11a0 Mon Sep 17 00:00:00 2001 From: Mark Fasheh <mfas...@suse.de> Date: Tue, 8 Jul 2014 13:34:18 -0700 Subject: btrfs-progs: ignore orphaned qgroups by default References: bnc#886493 bnc#865621 Upstream: submitted qgroup items are not deleted by btrfs when the underlying subvolume goes away. As a result, btrfsck will print those as inconsistent. This can clutter up the printout so we ignore them by default. They are still printed if a full report (via --qgroup-report) is requested. Signed-off-by: Mark Fasheh <mfas...@suse.de> --- qgroup-verify.c | 14 +++++++++++++- 1 file changed, 13 insertions(+), 1 deletion(-) diff --git a/qgroup-verify.c b/qgroup-verify.c index 81a1651..2e1716d 100644 --- a/qgroup-verify.c +++ b/qgroup-verify.c @@ -38,6 +38,7 @@ static void add_bytes(u64 root_objectid, u64 num_bytes, int exclusive); struct qgroup_count { u64 qgroupid; + int subvol_exists; struct btrfs_disk_key key; struct btrfs_qgroup_info_item diskinfo; @@ -697,8 +698,10 @@ static int load_quota_info(struct btrfs_fs_info *info) { int ret; struct btrfs_root *root = info->quota_root; + struct btrfs_root *tmproot; struct btrfs_path path; struct btrfs_key key; + struct btrfs_key root_key; struct btrfs_disk_key disk_key; struct extent_buffer *leaf; struct btrfs_qgroup_info_item *item; @@ -745,6 +748,15 @@ static int load_quota_info(struct btrfs_fs_info *info) fprintf(stderr, "ERROR: out of memory\n"); goto out; } + + root_key.objectid = key.offset; + root_key.type = BTRFS_ROOT_ITEM_KEY; + root_key.offset = (u64)-1; + tmproot = btrfs_read_fs_root_no_cache(info, &root_key); + if (tmproot && !IS_ERR(tmproot)) { + count->subvol_exists = 1; + free(tmproot); + } } ret = btrfs_next_leaf(root, &path); @@ -1008,7 +1020,7 @@ static void print_qgroup_difference(struct qgroup_count *count, int verbose) is_different = excl_diff || ref_diff; - if (verbose || is_different) { + if (verbose || (is_different && count->subvol_exists)) { printf("Counts for qgroup id: %llu %s\n", (unsigned long long)count->qgroupid, is_different ? "are different" : ""); -- 1.8.4.5 -- To unsubscribe, e-mail: opensuse-commit+unsubscr...@opensuse.org For additional commands, e-mail: opensuse-commit+h...@opensuse.org
