Received: by 2002:a25:6193:0:0:0:0:0 with SMTP id v141csp3060101ybb; Sun, 22 Mar 2020 14:26:35 -0700 (PDT) X-Google-Smtp-Source: ADFU+vv2HruLRe7p/sCyqrkOLdC4SazS6GoB5YIM2FbUFzogLj+CH2DEvuazSheTCrILuOqFDUhv X-Received: by 2002:aca:db56:: with SMTP id s83mr15260005oig.171.1584912395236; Sun, 22 Mar 2020 14:26:35 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1584912395; cv=none; d=google.com; s=arc-20160816; b=YmDJJLXTJGSM/hSQy4DL4QcnbZ8/wvXX7dcG72V6LbYIavnrYrfzjWEawbm6pzo8mF JRylApPLA37RygN0RONR5Krow2zdJKzJsvaBmS5p3clCv2lEb1ln9/PeU8kz6+rpsmc7 0yD6WF4xqIDRoGT2x89Bm6UO3ciYoBxpmFGrOLLe6WGJXftId8hG+BYc8RZYx4Z09cM+ F0Uy1nLPw8VlzMb6v2XZnrygmuBoyCKpsmRZmXRisIokNvlfhojMo/VT07lHRIudFav+ EK/3fhfx5oh7XJxETz7FCElCBkmch7zuncXKAUqQk2nD0m0Yg8veeTJCkpy0aZg9g2jP abpA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :message-id:date:subject:to:from:dkim-signature; bh=4eC7LgpYmufFPA4go7wViPXd9HrWnapviUO9r1ibY6k=; b=yG2bnqfi+HJLxZSr7IAkY9Fox+o+5Yi/YqDLygeZ2GdbC8HpltzsY3B4zg9znqnLvy VAdpCSv+6RFYS2Ro4IuoYhAWecdbKDZklmjbNFm6IucXRQCJy2DipYRc7ph5T7UBqebD S7BYfG38bZCjWYw2xU7ib6zVwzqsCroHrHJ3U/ZLvt5/W/YaEkpsPY3GTbideRvQIXOU R75xbi10B8pvuLS10BJU/gizdiwpqMiPJEkuh+M2HpsJ5aG/t/AZC1e5VOvLNdr73hQy KYxLHa5wSxgSFzuc3XNTOGFYBDJjwF+BZwtmGmQeghW9Tg/F+/kl0l562N46GmEGVyEm OoUA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=LapJvSgT; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id 5si1969394oin.43.2020.03.22.14.26.22; Sun, 22 Mar 2020 14:26:35 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=LapJvSgT; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726936AbgCVVZA (ORCPT + 99 others); Sun, 22 Mar 2020 17:25:00 -0400 Received: from mail-wm1-f66.google.com ([209.85.128.66]:38213 "EHLO mail-wm1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726783AbgCVVZA (ORCPT ); Sun, 22 Mar 2020 17:25:00 -0400 Received: by mail-wm1-f66.google.com with SMTP id l20so12561376wmi.3; Sun, 22 Mar 2020 14:24:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:date:message-id:mime-version :content-transfer-encoding; bh=4eC7LgpYmufFPA4go7wViPXd9HrWnapviUO9r1ibY6k=; b=LapJvSgTCtjQi9nX184UGsDHpUX/TX22HBxdtaIyBUM0KT5jyDoxRaL5I7XpR2K95E TPbT4BbXDh81HPga7+arn8UlLXszTZ6GSo1m+nPJd4c7c1+vPklZnaZPGVfkVLth8iyy Nzu5E9TxkNlskexMQOg+eQmZ+7kOB7NTFqx3ys+kDksN56Wfmhj7DZ0g2ZGtC6ydF0Qo JBLII/YkKMxsI9/aW+gMUfTJxSvboNTQ4hDtAmllybZK76ZKWrOUrOMxLz0gY+ruVOqP Bb/BQZ6PeUbbsniMAhs6/g7M6kwNS1nzHiJe6M9/+BtpjFYxqwqH2qOkC05T/qTsSE4E DCFg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id:mime-version :content-transfer-encoding; bh=4eC7LgpYmufFPA4go7wViPXd9HrWnapviUO9r1ibY6k=; b=ndUmlNgQ0szG6ir8IeklBsvypsUZNfolPKTW2cgtF+DfWiMMX+GGB+R0FjxlpF1qql a114DNQLAZP3QotIY/2dsBFnT4cC0817cWBYWtBPhtd1mFrkft4Aje6xBALGnzFA0pQH ncBDHL79MOV5OxVV+auqzzE1i6X/2HqhLiGo82ngeuWM2rwtmn9Gf5i5Ldtanf28vAdm eT9akOCP5msyNw+KVgL4WpPxQzfaJTUBTMrSHiYF0b7m9UTizsdXLP+ylGaIVnyW1V1Q S39f6NTQByjv0WeE+o7esKAnOdPovJErfDE0yaF2NqR3SsaOitCjl1KNF6hCRji4iPZm ruOQ== X-Gm-Message-State: ANhLgQ3L2y6BeCHVI6Ia/hxrJHL5XOPsfeau4dx11z3aCNvIQXPoMbuC z6UhOkenwa0dMBGv2q9tiC57hF5X X-Received: by 2002:a7b:c308:: with SMTP id k8mr24245774wmj.40.1584912298099; Sun, 22 Mar 2020 14:24:58 -0700 (PDT) Received: from localhost.localdomain ([109.126.140.227]) by smtp.gmail.com with ESMTPSA id w67sm17620512wmb.41.2020.03.22.14.24.53 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 22 Mar 2020 14:24:57 -0700 (PDT) From: Pavel Begunkov To: Jens Axboe , io-uring@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [PATCH 1/1] io_uring: Fix ->data corruption on re-enqueue Date: Mon, 23 Mar 2020 00:23:29 +0300 Message-Id: X-Mailer: git-send-email 2.24.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org work->data and work->list are shared in union. io_wq_assign_next() sets ->data if a req having a linked_timeout, but then io-wq may want to use work->list, e.g. to do re-enqueue of a request, so corrupting ->data. ->data is not necessary, just remove it and extract linked_timeout through @link_list. Signed-off-by: Pavel Begunkov --- fs/io-wq.h | 5 +---- fs/io_uring.c | 9 ++++----- 2 files changed, 5 insertions(+), 9 deletions(-) diff --git a/fs/io-wq.h b/fs/io-wq.h index 298b21f4a4d2..d2a5684bf673 100644 --- a/fs/io-wq.h +++ b/fs/io-wq.h @@ -63,10 +63,7 @@ static inline void wq_node_del(struct io_wq_work_list *list, } while (0) struct io_wq_work { - union { - struct io_wq_work_node list; - void *data; - }; + struct io_wq_work_node list; void (*func)(struct io_wq_work **); struct files_struct *files; struct mm_struct *mm; diff --git a/fs/io_uring.c b/fs/io_uring.c index 5267e331b4a4..ce8f38aa070a 100644 --- a/fs/io_uring.c +++ b/fs/io_uring.c @@ -1567,9 +1567,10 @@ static void io_free_req(struct io_kiocb *req) static void io_link_work_cb(struct io_wq_work **workptr) { - struct io_wq_work *work = *workptr; - struct io_kiocb *link = work->data; + struct io_kiocb *req = container_of(*workptr, struct io_kiocb, work); + struct io_kiocb *link; + link = list_first_entry(&req->link_list, struct io_kiocb, link_list); io_queue_linked_timeout(link); io_wq_submit_work(workptr); } @@ -1584,10 +1585,8 @@ static void io_wq_assign_next(struct io_wq_work **workptr, struct io_kiocb *nxt) *workptr = &nxt->work; link = io_prep_linked_timeout(nxt); - if (link) { + if (link) nxt->work.func = io_link_work_cb; - nxt->work.data = link; - } } /* -- 2.24.0