On Mon, May 07 2018, Herbert Xu wrote: > On Sun, May 06, 2018 at 07:50:54AM +1000, NeilBrown wrote: >> >> Do we? How could we fix it for both rhashtable and rhltable? > > Well I suggested earlier to insert the walker object into the > hash table, which would be applicable regardless of whether it > is a normal rhashtable of a rhltable.
Oh yes, that idea. I had considered it and discarded it. Moving a walker object around in an rcu-list is far from straight forward. A lockless iteration of the list would need to be very careful not to be tripped up by the walker-object. I don't think we want to make the search code more complex. I explored the idea a bit more and I think that any solution that we came up with along those lines would look quite different for regular rhash_tables than for rhl_tables. So it is probably best to keep them quite separate. i.e. use the scheme I proposed for rhashtables and use something else entirely for rhltables. My current thinking for a stable walk for rhl tables goes like this: - we embed struct rhl_cursor { struct rhl_cursor *next; int unseen; } in struct rhashtable_iter. - on rhashtable_stop(), we: + lock the current hash chain + find the next object that is still in the table (after ->p). + count the number of objects from there to the end to the end of the rhlist_head.next list. + store that count in rhl_cursor.unseen + change the ->next pointer at the end of the list to point to the rhl_cursor, but with the lsb set. If there was already an rhl_cursor there, they are chained together on ->next. - on rhashtable_start(), we lock the hash chain and search the hash chain and sub-chains for ->p or the rhl_cursor. If ->p is still there, that can be used as a reliable anchor. If ->p isn't found but the rhl_cursor is, then the 'unseen' counter tells us where to start in that rhl_list. If neither are found, then we start at the beginning of the hash chain. If the rhl_cursor is found, it is removed. - lookup and insert can almost completely ignore the cursor. rhl_for_each_rcu() needs to detect the end-of-list by looking for lsb set, but that is the only change. As _insert() adds new objects to the head of the rhlist, that won't disturb the accuracy of the 'unseen' count. The newly inserted object won't be seen by the walk, but that is expected. - delete needs some extra handling. + When an object is deleted from an rhlist and the list does not become empty, then it counts the number of objects to the end of the list, and possibly decrements the 'unseen' counter on any rhl_cursors that are at the end of the list. + when an object is deleted resulting in an empty rhlist, any cursors at the end of the list needs to be moved to the next list in the hash chain, and their 'unseen' count needs to be set to the length of the list. If there is no next object in the hash chain, then the iter.slot is incremented and the rhlist_curs is left unconnected. - rehash needs to remove any cursors from the end of an rhlist before moving them to the new table. The cursors are left disconnected. I'm happy to implement this if you think the approach is workable and the functionality is necessary. However there are no current users of rhltable_walk_inter that would benefit from this. Thanks, NeilBrown
signature.asc
Description: PGP signature