Hi,
While fuzzing I found several crashes similar to the following:
[ 5.345731] sysfs: cannot create duplicate filename '/devices/virtual/bluetooth/hci0/hci0:0'
[...]
[ 5.430464] BUG: KASAN: use-after-free in klist_add_tail+0x1bd/0x200
[ 5.430464] Write of size 8 at addr ffff88800bfcc468 by task kworker/u3:1/43
[ 5.430464]
[ 5.430464] CPU: 0 PID: 43 Comm: kworker/u3:1 Not tainted 5.19.0-12855-g13f222680b8f #2
[ 5.430464] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org 04/01/2014
[ 5.430464] Workqueue: hci0 hci_rx_work
[ 5.430464] Call Trace:
[ 5.430464] <TASK>
[ 5.430464] dump_stack_lvl+0x45/0x5d
[ 5.430464] print_report.cold+0x5e/0x5e5
[ 5.430464] kasan_report+0xb1/0x1c0
[ 5.430464] klist_add_tail+0x1bd/0x200
[ 5.430464] device_add+0xa6b/0x1b80
[ 5.430464] hci_conn_add_sysfs+0x91/0x110
[ 5.430464] le_conn_complete_evt+0x117f/0x17d0
[ 5.430464] hci_le_conn_complete_evt+0x226/0x2c0
[ 5.430464] hci_le_meta_evt+0x2c0/0x4a0
[ 5.430464] hci_event_packet+0x636/0xf60
[ 5.430464] hci_rx_work+0xa8c/0x1000
[ 5.430464] process_one_work+0x8df/0x1530
[ 5.430464] worker_thread+0x575/0x11a0
[ 5.430464] kthread+0x29d/0x340
[ 5.430464] ret_from_fork+0x22/0x30
[ 5.430464] </TASK>
[ 5.430464]
[ 5.430464] Allocated by task 44:
[ 5.430464] kasan_save_stack+0x1e/0x40
[ 5.430464] __kasan_kmalloc+0x81/0xa0
[ 5.430464] device_add+0xcae/0x1b80
[ 5.430464] hci_conn_add_sysfs+0x91/0x110
[ 5.430464] le_conn_complete_evt+0x117f/0x17d0
[ 5.430464] hci_le_conn_complete_evt+0x226/0x2c0
[ 5.430464] hci_le_meta_evt+0x2c0/0x4a0
[ 5.430464] hci_event_packet+0x636/0xf60
[ 5.430464] hci_rx_work+0xa8c/0x1000
[ 5.430464] process_one_work+0x8df/0x1530
[ 5.430464] worker_thread+0x575/0x11a0
[ 5.430464] kthread+0x29d/0x340
[ 5.430464] ret_from_fork+0x22/0x30
[ 5.430464]
[ 5.430464] Freed by task 43:
[ 5.430464] kasan_save_stack+0x1e/0x40
[ 5.430464] kasan_set_track+0x21/0x30
[ 5.430464] kasan_set_free_info+0x20/0x40
[ 5.430464] __kasan_slab_free+0x108/0x190
[ 5.430464] kfree+0xa9/0x360
[ 5.430464] device_add+0x33a/0x1b80
[ 5.430464] hci_conn_add_sysfs+0x91/0x110
[ 5.430464] hci_le_cis_estabilished_evt+0x517/0xa70
[ 5.430464] hci_le_meta_evt+0x2c0/0x4a0
[ 5.430464] hci_event_packet+0x636/0xf60
[ 5.430464] hci_rx_work+0xa8c/0x1000
[ 5.430464] process_one_work+0x8df/0x1530
[ 5.430464] worker_thread+0x575/0x11a0
[ 5.430464] kthread+0x29d/0x340
[ 5.430464] ret_from_fork+0x22/0x30
I think I fixed a similar issue in d5ebaa7c5f6f ("Bluetooth: hci_event: Ignore multiple conn complete events"). Here, the problem was that multiple connection complete events for the same handle called hci_conn_add_sysfs multiple times, but if it is called with an existing connection conn->dev->p is freed.
This is because device_add is called - its documentation contains this sentence: "Do not call this routine or device_register() more than once for any device structure".
This here is similar: First, an hci_le_conn_complete_evt creates a new connection.
Afterwards, an hci_le_cis_estabilished_evt with the same handle finds that connection, and tries to add it to sysfs again, freeing conn->dev->p. Now, an event that might use that connection such as here the hci_le_conn_complete_evt triggers a use after free.
I bisected this bug and it was introduced with 26afbd826ee3 ("Bluetooth: Add initial implementation of CIS connections").
The same happens with hci_le_create_big_complete_evt: Here, multiple events trigger the following bug:
[ 6.898080] BUG: kernel NULL pointer dereference, address: 0000000000000058
[ 6.898081] #PF: supervisor read access in kernel mode
[ 6.898083] #PF: error_code(0x0000) - not-present page
[ 6.898085] Oops: 0000 [#1] PREEMPT SMP NOPTI
[ 6.898090] Workqueue: hci0 hci_rx_work
[ 6.898092] RIP: 0010:klist_next+0x12/0x160
[ 6.898128] Call Trace:
[ 6.898129] <TASK>
[ 6.898130] ? bt_link_release+0x20/0x20
[ 6.898133] device_find_child+0x37/0xa0
[ 6.898136] hci_conn_del_sysfs+0x71/0xa0
[ 6.898138] hci_conn_cleanup+0x17a/0x2c0
[ 6.898141] hci_conn_del+0x14a/0x240
[ 6.898144] hci_le_create_big_complete_evt+0x3d8/0x470
[ 6.898146] ? hci_le_remote_feat_complete_evt+0x3e0/0x3e0
[ 6.898148] hci_le_meta_evt+0x155/0x230
[ 6.898150] hci_event_packet+0x328/0x820
[ 6.898152] ? hci_conn_drop+0x100/0x100
[ 6.898155] hci_rx_work+0x725/0xb70
[ 6.898157] process_one_work+0x2a6/0x5d0
[ 6.898160] worker_thread+0x4a/0x3e0
[ 6.898162] ? process_one_work+0x5d0/0x5d0
[ 6.898164] kthread+0xed/0x120
[ 6.898165] ? kthread_complete_and_exit+0x20/0x20
[ 6.898167] ret_from_fork+0x22/0x30
[ 6.898170] </TASK>
I bisected this bug and it was introduced with eca0ae4aea66 ("Bluetooth: Add initial implementation of BIS connections").
I am not really sure how to solve that. As far as I understand, previously we simply set an unused handle as connection handle, and checked for that before setting the correct handle and adding it to sysfs. But here, adding it to sysfs seems to happen in a different function and the handle is already set.
Best
Sönke
Hi Sönke,
On Thu, Aug 25, 2022 at 8:08 AM Sönke Huster <[email protected]> wrote:
>
> Hi,
>
>
>
> While fuzzing I found several crashes similar to the following:
>
>
> [ 5.345731] sysfs: cannot create duplicate filename '/devices/virtual/bluetooth/hci0/hci0:0'
>
> [...]
>
> [ 5.430464] BUG: KASAN: use-after-free in klist_add_tail+0x1bd/0x200
>
> [ 5.430464] Write of size 8 at addr ffff88800bfcc468 by task kworker/u3:1/43
>
> [ 5.430464]
>
> [ 5.430464] CPU: 0 PID: 43 Comm: kworker/u3:1 Not tainted 5.19.0-12855-g13f222680b8f #2
>
> [ 5.430464] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org 04/01/2014
>
> [ 5.430464] Workqueue: hci0 hci_rx_work
>
> [ 5.430464] Call Trace:
>
> [ 5.430464] <TASK>
>
> [ 5.430464] dump_stack_lvl+0x45/0x5d
>
> [ 5.430464] print_report.cold+0x5e/0x5e5
>
> [ 5.430464] kasan_report+0xb1/0x1c0
>
> [ 5.430464] klist_add_tail+0x1bd/0x200
>
> [ 5.430464] device_add+0xa6b/0x1b80
>
> [ 5.430464] hci_conn_add_sysfs+0x91/0x110
>
> [ 5.430464] le_conn_complete_evt+0x117f/0x17d0
>
> [ 5.430464] hci_le_conn_complete_evt+0x226/0x2c0
>
> [ 5.430464] hci_le_meta_evt+0x2c0/0x4a0
>
> [ 5.430464] hci_event_packet+0x636/0xf60
>
> [ 5.430464] hci_rx_work+0xa8c/0x1000
>
> [ 5.430464] process_one_work+0x8df/0x1530
>
> [ 5.430464] worker_thread+0x575/0x11a0
>
> [ 5.430464] kthread+0x29d/0x340
>
> [ 5.430464] ret_from_fork+0x22/0x30
>
> [ 5.430464] </TASK>
>
> [ 5.430464]
>
> [ 5.430464] Allocated by task 44:
>
> [ 5.430464] kasan_save_stack+0x1e/0x40
>
> [ 5.430464] __kasan_kmalloc+0x81/0xa0
>
> [ 5.430464] device_add+0xcae/0x1b80
>
> [ 5.430464] hci_conn_add_sysfs+0x91/0x110
>
> [ 5.430464] le_conn_complete_evt+0x117f/0x17d0
>
> [ 5.430464] hci_le_conn_complete_evt+0x226/0x2c0
>
> [ 5.430464] hci_le_meta_evt+0x2c0/0x4a0
>
> [ 5.430464] hci_event_packet+0x636/0xf60
>
> [ 5.430464] hci_rx_work+0xa8c/0x1000
>
> [ 5.430464] process_one_work+0x8df/0x1530
>
> [ 5.430464] worker_thread+0x575/0x11a0
>
> [ 5.430464] kthread+0x29d/0x340
>
> [ 5.430464] ret_from_fork+0x22/0x30
>
> [ 5.430464]
>
> [ 5.430464] Freed by task 43:
>
> [ 5.430464] kasan_save_stack+0x1e/0x40
>
> [ 5.430464] kasan_set_track+0x21/0x30
>
> [ 5.430464] kasan_set_free_info+0x20/0x40
>
> [ 5.430464] __kasan_slab_free+0x108/0x190
>
> [ 5.430464] kfree+0xa9/0x360
>
> [ 5.430464] device_add+0x33a/0x1b80
>
> [ 5.430464] hci_conn_add_sysfs+0x91/0x110
>
> [ 5.430464] hci_le_cis_estabilished_evt+0x517/0xa70
>
> [ 5.430464] hci_le_meta_evt+0x2c0/0x4a0
>
> [ 5.430464] hci_event_packet+0x636/0xf60
>
> [ 5.430464] hci_rx_work+0xa8c/0x1000
>
> [ 5.430464] process_one_work+0x8df/0x1530
>
> [ 5.430464] worker_thread+0x575/0x11a0
>
> [ 5.430464] kthread+0x29d/0x340
>
> [ 5.430464] ret_from_fork+0x22/0x30
>
>
>
> I think I fixed a similar issue in d5ebaa7c5f6f ("Bluetooth: hci_event: Ignore multiple conn complete events"). Here, the problem was that multiple connection complete events for the same handle called hci_conn_add_sysfs multiple times, but if it is called with an existing connection conn->dev->p is freed.
>
> This is because device_add is called - its documentation contains this sentence: "Do not call this routine or device_register() more than once for any device structure".
>
>
>
> This here is similar: First, an hci_le_conn_complete_evt creates a new connection.
>
> Afterwards, an hci_le_cis_estabilished_evt with the same handle finds that connection, and tries to add it to sysfs again, freeing conn->dev->p. Now, an event that might use that connection such as here the hci_le_conn_complete_evt triggers a use after free.
>
>
>
> I bisected this bug and it was introduced with 26afbd826ee3 ("Bluetooth: Add initial implementation of CIS connections").
>
>
>
> The same happens with hci_le_create_big_complete_evt: Here, multiple events trigger the following bug:
>
>
>
> [ 6.898080] BUG: kernel NULL pointer dereference, address: 0000000000000058
>
> [ 6.898081] #PF: supervisor read access in kernel mode
>
> [ 6.898083] #PF: error_code(0x0000) - not-present page
>
> [ 6.898085] Oops: 0000 [#1] PREEMPT SMP NOPTI
>
> [ 6.898090] Workqueue: hci0 hci_rx_work
>
> [ 6.898092] RIP: 0010:klist_next+0x12/0x160
>
> [ 6.898128] Call Trace:
>
> [ 6.898129] <TASK>
>
> [ 6.898130] ? bt_link_release+0x20/0x20
>
> [ 6.898133] device_find_child+0x37/0xa0
>
> [ 6.898136] hci_conn_del_sysfs+0x71/0xa0
>
> [ 6.898138] hci_conn_cleanup+0x17a/0x2c0
>
> [ 6.898141] hci_conn_del+0x14a/0x240
>
> [ 6.898144] hci_le_create_big_complete_evt+0x3d8/0x470
>
> [ 6.898146] ? hci_le_remote_feat_complete_evt+0x3e0/0x3e0
>
> [ 6.898148] hci_le_meta_evt+0x155/0x230
>
> [ 6.898150] hci_event_packet+0x328/0x820
>
> [ 6.898152] ? hci_conn_drop+0x100/0x100
>
> [ 6.898155] hci_rx_work+0x725/0xb70
>
> [ 6.898157] process_one_work+0x2a6/0x5d0
>
> [ 6.898160] worker_thread+0x4a/0x3e0
>
> [ 6.898162] ? process_one_work+0x5d0/0x5d0
>
> [ 6.898164] kthread+0xed/0x120
>
> [ 6.898165] ? kthread_complete_and_exit+0x20/0x20
>
> [ 6.898167] ret_from_fork+0x22/0x30
>
> [ 6.898170] </TASK>
>
>
>
> I bisected this bug and it was introduced with eca0ae4aea66 ("Bluetooth: Add initial implementation of BIS connections").
>
>
>
> I am not really sure how to solve that. As far as I understand, previously we simply set an unused handle as connection handle, and checked for that before setting the correct handle and adding it to sysfs. But here, adding it to sysfs seems to happen in a different function and the handle is already set.
We should probably check if link-type, if it is an ISO link it shall
not be created via Connection Complete events and they have their own
events to create that.
> Best
> Sönke
--
Luiz Augusto von Dentz
Hi Luiz,
On 25.08.22 20:58, Luiz Augusto von Dentz wrote:
> Hi Sönke,
>
> On Thu, Aug 25, 2022 at 8:08 AM Sönke Huster <[email protected]> wrote:
>>
>> Hi,
>>
>>
>>
>> While fuzzing I found several crashes similar to the following:
>>
>>
>> [ 5.345731] sysfs: cannot create duplicate filename '/devices/virtual/bluetooth/hci0/hci0:0'
>>
>> [...]
>>
>> [ 5.430464] BUG: KASAN: use-after-free in klist_add_tail+0x1bd/0x200
>>
>> [ 5.430464] Write of size 8 at addr ffff88800bfcc468 by task kworker/u3:1/43
>>
>> [ 5.430464]
>>
>> [ 5.430464] CPU: 0 PID: 43 Comm: kworker/u3:1 Not tainted 5.19.0-12855-g13f222680b8f #2
>>
>> [ 5.430464] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org 04/01/2014
>>
>> [ 5.430464] Workqueue: hci0 hci_rx_work
>>
>> [ 5.430464] Call Trace:
>>
>> [ 5.430464] <TASK>
>>
>> [ 5.430464] dump_stack_lvl+0x45/0x5d
>>
>> [ 5.430464] print_report.cold+0x5e/0x5e5
>>
>> [ 5.430464] kasan_report+0xb1/0x1c0
>>
>> [ 5.430464] klist_add_tail+0x1bd/0x200
>>
>> [ 5.430464] device_add+0xa6b/0x1b80
>>
>> [ 5.430464] hci_conn_add_sysfs+0x91/0x110
>>
>> [ 5.430464] le_conn_complete_evt+0x117f/0x17d0
>>
>> [ 5.430464] hci_le_conn_complete_evt+0x226/0x2c0
>>
>> [ 5.430464] hci_le_meta_evt+0x2c0/0x4a0
>>
>> [ 5.430464] hci_event_packet+0x636/0xf60
>>
>> [ 5.430464] hci_rx_work+0xa8c/0x1000
>>
>> [ 5.430464] process_one_work+0x8df/0x1530
>>
>> [ 5.430464] worker_thread+0x575/0x11a0
>>
>> [ 5.430464] kthread+0x29d/0x340
>>
>> [ 5.430464] ret_from_fork+0x22/0x30
>>
>> [ 5.430464] </TASK>
>>
>> [ 5.430464]
>>
>> [ 5.430464] Allocated by task 44:
>>
>> [ 5.430464] kasan_save_stack+0x1e/0x40
>>
>> [ 5.430464] __kasan_kmalloc+0x81/0xa0
>>
>> [ 5.430464] device_add+0xcae/0x1b80
>>
>> [ 5.430464] hci_conn_add_sysfs+0x91/0x110
>>
>> [ 5.430464] le_conn_complete_evt+0x117f/0x17d0
>>
>> [ 5.430464] hci_le_conn_complete_evt+0x226/0x2c0
>>
>> [ 5.430464] hci_le_meta_evt+0x2c0/0x4a0
>>
>> [ 5.430464] hci_event_packet+0x636/0xf60
>>
>> [ 5.430464] hci_rx_work+0xa8c/0x1000
>>
>> [ 5.430464] process_one_work+0x8df/0x1530
>>
>> [ 5.430464] worker_thread+0x575/0x11a0
>>
>> [ 5.430464] kthread+0x29d/0x340
>>
>> [ 5.430464] ret_from_fork+0x22/0x30
>>
>> [ 5.430464]
>>
>> [ 5.430464] Freed by task 43:
>>
>> [ 5.430464] kasan_save_stack+0x1e/0x40
>>
>> [ 5.430464] kasan_set_track+0x21/0x30
>>
>> [ 5.430464] kasan_set_free_info+0x20/0x40
>>
>> [ 5.430464] __kasan_slab_free+0x108/0x190
>>
>> [ 5.430464] kfree+0xa9/0x360
>>
>> [ 5.430464] device_add+0x33a/0x1b80
>>
>> [ 5.430464] hci_conn_add_sysfs+0x91/0x110
>>
>> [ 5.430464] hci_le_cis_estabilished_evt+0x517/0xa70
>>
>> [ 5.430464] hci_le_meta_evt+0x2c0/0x4a0
>>
>> [ 5.430464] hci_event_packet+0x636/0xf60
>>
>> [ 5.430464] hci_rx_work+0xa8c/0x1000
>>
>> [ 5.430464] process_one_work+0x8df/0x1530
>>
>> [ 5.430464] worker_thread+0x575/0x11a0
>>
>> [ 5.430464] kthread+0x29d/0x340
>>
>> [ 5.430464] ret_from_fork+0x22/0x30
>>
>>
>>
>> I think I fixed a similar issue in d5ebaa7c5f6f ("Bluetooth: hci_event: Ignore multiple conn complete events"). Here, the problem was that multiple connection complete events for the same handle called hci_conn_add_sysfs multiple times, but if it is called with an existing connection conn->dev->p is freed.
>>
>> This is because device_add is called - its documentation contains this sentence: "Do not call this routine or device_register() more than once for any device structure".
>>
>>
>>
>> This here is similar: First, an hci_le_conn_complete_evt creates a new connection.
>>
>> Afterwards, an hci_le_cis_estabilished_evt with the same handle finds that connection, and tries to add it to sysfs again, freeing conn->dev->p. Now, an event that might use that connection such as here the hci_le_conn_complete_evt triggers a use after free.
>>
>>
>>
>> I bisected this bug and it was introduced with 26afbd826ee3 ("Bluetooth: Add initial implementation of CIS connections").
>>
>>
>>
>> The same happens with hci_le_create_big_complete_evt: Here, multiple events trigger the following bug:
>>
>>
>>
>> [ 6.898080] BUG: kernel NULL pointer dereference, address: 0000000000000058
>>
>> [ 6.898081] #PF: supervisor read access in kernel mode
>>
>> [ 6.898083] #PF: error_code(0x0000) - not-present page
>>
>> [ 6.898085] Oops: 0000 [#1] PREEMPT SMP NOPTI
>>
>> [ 6.898090] Workqueue: hci0 hci_rx_work
>>
>> [ 6.898092] RIP: 0010:klist_next+0x12/0x160
>>
>> [ 6.898128] Call Trace:
>>
>> [ 6.898129] <TASK>
>>
>> [ 6.898130] ? bt_link_release+0x20/0x20
>>
>> [ 6.898133] device_find_child+0x37/0xa0
>>
>> [ 6.898136] hci_conn_del_sysfs+0x71/0xa0
>>
>> [ 6.898138] hci_conn_cleanup+0x17a/0x2c0
>>
>> [ 6.898141] hci_conn_del+0x14a/0x240
>>
>> [ 6.898144] hci_le_create_big_complete_evt+0x3d8/0x470
>>
>> [ 6.898146] ? hci_le_remote_feat_complete_evt+0x3e0/0x3e0
>>
>> [ 6.898148] hci_le_meta_evt+0x155/0x230
>>
>> [ 6.898150] hci_event_packet+0x328/0x820
>>
>> [ 6.898152] ? hci_conn_drop+0x100/0x100
>>
>> [ 6.898155] hci_rx_work+0x725/0xb70
>>
>> [ 6.898157] process_one_work+0x2a6/0x5d0
>>
>> [ 6.898160] worker_thread+0x4a/0x3e0
>>
>> [ 6.898162] ? process_one_work+0x5d0/0x5d0
>>
>> [ 6.898164] kthread+0xed/0x120
>>
>> [ 6.898165] ? kthread_complete_and_exit+0x20/0x20
>>
>> [ 6.898167] ret_from_fork+0x22/0x30
>>
>> [ 6.898170] </TASK>
>>
>>
>>
>> I bisected this bug and it was introduced with eca0ae4aea66 ("Bluetooth: Add initial implementation of BIS connections").
>>
>>
>>
>> I am not really sure how to solve that. As far as I understand, previously we simply set an unused handle as connection handle, and checked for that before setting the correct handle and adding it to sysfs. But here, adding it to sysfs seems to happen in a different function and the handle is already set.
>
> We should probably check if link-type, if it is an ISO link it shall
> not be created via Connection Complete events and they have their own
> events to create that.
>
But then the problem of duplicate hci_le_cis_estabilished_evt / hci_le_create_big_complete_evt still exists, isn't it? For example if the connection is created through a hci_le_cis_req_evt, and afterwards two hci_le_cis_estabilished_evt arrive, the second event calls hci_conn_add_sysfs a second time which frees parts of the device structure.
>> Best
>> Sönke
>
>
>