On 2014/10/11 11:00, Weng Meiling wrote:
> ping ...
> 
> On 2014/10/9 20:47, Weng Meiling wrote:
>> On 2014/10/9 20:43, Weng Meiling wrote:
>>> Hi guys,
>>>
>>> I see the mails you discussed the BUG at fs/sysfs/group.c:65! triggered by 
>>> duplicated sysfs link.
>>>
>>> the detail mail:
>>>
>>> https://lkml.org/lkml/2013/3/8/370
>>>
>>> but it seems the problems has no conclusion. In our environment, we 
>>> triggered the bug too, but for error ENOENT:
>>>
>>> we use 3.4 kernel, and do virtual disk device create / remove for many 
>>> times. Before remove we can see the devices:
>>>
>>> #ll /sys/devices/virtual/block/
>>> drwxr-xr-x 7 root root 0 Oct  6 09:17 sd-1a
>>> drwxr-xr-x 7 root root 0 Oct  6 09:17 sd-2a
>>>
>>> when the two virtual devices were removed, the directory block/ was delete 
>>> too.
>>>
>>> after many times create / remove, the kernel trigger the bug (just the main 
>>> call trace):
>>>
>>> [ 3965.441713] WARNING: at 
>>> /usr/src/packages/BUILD/linux-3.4/lib/kobject.c:202 
>>> kobject_add_internal+0x11f/0x280()
>>> [ 3965.441716] Hardware name: Romley
>>> [ 3965.441718] kobject_add_internal failed for sd-1a (error: -2 parent: 
>>> block)
>>>
>>> [ 3965.441817] Call Trace:
>>> [ 3965.441820]  [<ffffffff8103717a>] warn_slowpath_common+0x7a/0xb0
>>> [ 3965.441823]  [<ffffffff81037251>] warn_slowpath_fmt+0x41/0x50
>>> [ 3965.441826]  [<ffffffff81215e0f>] kobject_add_internal+0x11f/0x280
>>> [ 3965.441830]  [<ffffffff81216267>] kobject_add+0x67/0xc0
>>> [ 3965.441833]  [<ffffffff812d2305>] device_add+0x105/0x6d0
>>> [ 3965.441836]  [<ffffffff812d0dbc>] ? dev_set_name+0x3c/0x40
>>> [ 3965.441839]  [<ffffffff812030ac>] add_disk+0x1bc/0x490
>>>
>>> [ 3965.441912] kernel BUG at 
>>> /usr/src/packages/BUILD/linux-3.4/fs/sysfs/group.c:65!
>>> [ 3965.441915] invalid opcode: 0000 [#1] SMP
>>> [ 3965.686738] Call Trace:
>>> [ 3965.686743]  [<ffffffff811a677e>] sysfs_create_group+0xe/0x10
>>> [ 3965.686748]  [<ffffffff810cfb04>] blk_trace_init_sysfs+0x14/0x20
>>> [ 3965.686753]  [<ffffffff811fcabb>] blk_register_queue+0x3b/0x120
>>> [ 3965.686756]  [<ffffffff812030bc>] add_disk+0x1cc/0x490
>>>
>>> from the error "kobject_add_internal failed for sd-1a (error: -2 parent: 
>>> block)", we found that the first
>>> warning was caused by the disk device's parent_sd was null when it was 
>>> added into sysfs:
>>>
>>> int sysfs_create_dir(struct kobject * kobj)
>>> {
>>>     ...
>>>     if (kobj->parent)
>>>         parent_sd = kobj->parent->sd;
>>>     else
>>>         parent_sd = &sysfs_root;
>>>
>>>     if (!parent_sd)
>>>         return -ENOENT;
>>>     ...
>>> }
>>>
>>> The virtual disk device was not added into sysfs because of the above 
>>> failure, and the kobj->sd was
>>> not set, then trigger the bug when creating attribute group under the 
>>> device's directory:
>>>
>>> static int internal_create_group(struct kobject *kobj, int update,
>>>                  const struct attribute_group *grp)
>>> {
>>>     ...
>>>     BUG_ON(!kobj || (!update && !kobj->sd));
>>>     ...
>>> }
>>>
>>> Walk the code, it seems there maybe a race between block/ remove and 
>>> virtual disk devices' register:
>>>
>>> when the two virtual devices were removed, the block/ directory's refcount 
>>> became 0, will into:
>>>
>>> path0(remove the block/)                                             
>>> path1(register virtual device sd-1a)
>>>
>>> kobject_del(){                                                       
>>> get_device_parent(){
>>> ...                                                                  ...
>>>    sysfs_remove_dir(kobj);  //kobj->sd=0                                 
>>> spin_lock(&dev->class->p->glue_dirs.list_lock);
>>
>> this should be kobj->sd = NULL
>>> ...                                                      <=========      
>>> list_for_each_entry(k, &dev->class->p->glue_dirs.list, entry)  //get parent 
>>> kobject from kset list
>>>    kobj_kset_leave(kobj);   //remove kobj from kset list             ...
>>> }                                                                    }
>>>
>>> If getting parent object between " kobj->sd=0 " and 
>>> "remove_kset_leave(kobj)", the sysfs_create_dir() will return ENOENT and 
>>> trigger the BUG later.
>>>
>> this should be kobj->sd = NULL
>>
>>> The lastest kernel seems to be the same. But I am not familiar with block 
>>> device, I am not sure whether the analysis is right or I am missing 
>>> something.
>>> what do you think about this situation? Any suggestion is appreciative. 
>>> Thanks!
>>>
>>>
>>
>>
> 


--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Reply via email to