Received: by 2002:a05:6358:16cc:b0:ea:6187:17c9 with SMTP id r12csp10555911rwl; Wed, 11 Jan 2023 22:43:23 -0800 (PST) X-Google-Smtp-Source: AMrXdXvrxHIoZbPsBxe/JmuGVpVtC5sWc6rFkjtPnG5BP36NKRg/GmRF1j+QOLuCp34XyElnBLYW X-Received: by 2002:a17:907:c78e:b0:7c1:23f7:623a with SMTP id tz14-20020a170907c78e00b007c123f7623amr62619508ejc.66.1673505803095; Wed, 11 Jan 2023 22:43:23 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1673505803; cv=none; d=google.com; s=arc-20160816; b=xTdg5ZMdIlaFJ8F/6KMik8itySEN0kB3iYOHH2HRWhB5rTQLQ/Gg3ZndmacAieMVGW AuA9Pp9ntbkED5ttcWW8is+IzTAqS2bwYH7nOXMgfFcZzADsJS327XXMp68e/bDZSnjX JKIYlEqGBv3C4Rp5yBTPGx/ZXpQlfptk3CLKoW/pavIgHe3d5YFPfIlM9ENeEYYr3ApA P1Y5WHSXcOGQNNMNGjTG79qEqQovMKqBtUKrRnDzVJBP3sBkHdLCGhhFbGn3svKO2NUm 6hSez+/24Ofj2DoGAbWoZWlRzDJ4JDAyMGWA7UAn9/dS6bQCD7ZAqpXoc7bSUw/7eCnC /9uw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-language:content-transfer-encoding :in-reply-to:mime-version:user-agent:date:message-id:from:references :cc:to:subject; bh=9/6z/37JrH1frFbVzjncwrsvJzwH6qeqbow/sfz5hj4=; b=tVJ77v7dW9bMHpDFDtW64ge1uNj/9GhJfL9U9V1urnczIYmPnkod6y1CoSFZweFLk7 FwY+OLxCvrh6iP/CGUVOJV2Cy6OQ1uiEHOuIfTrSUC5j1Ecc0RCkcMAU1O9c0FTNykZe PffOyfVbSgcmgbBuWyNgf9JhkrFtNsdRHW2twwBkBuNsCdrBM1WNVXEEj5eTVynHilcU j666OvaV+ix7qR/jDiL4ZjLFhLvRcfwgKbPFdwYEl3cQEwTiAum6uQtbKfZPza5hbO4o prgb3XM44a24G6HAg5ItosuxB6E7G/GAE5y6RkHHla2E2iUwuiSUzkABibkQ1kCpfy+c +h0A== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id sh42-20020a1709076eaa00b007820aa60dc3si15973863ejc.74.2023.01.11.22.43.09; Wed, 11 Jan 2023 22:43:23 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S236698AbjALGMe (ORCPT + 52 others); Thu, 12 Jan 2023 01:12:34 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:34362 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S236436AbjALGMd (ORCPT ); Thu, 12 Jan 2023 01:12:33 -0500 Received: from dggsgout11.his.huawei.com (unknown [45.249.212.51]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id C6CA23FC8C for ; Wed, 11 Jan 2023 22:12:30 -0800 (PST) Received: from mail02.huawei.com (unknown [172.30.67.143]) by dggsgout11.his.huawei.com (SkyGuard) with ESMTP id 4NsvN72Ph0z4f41Gs for ; Thu, 12 Jan 2023 14:12:23 +0800 (CST) Received: from [10.174.176.117] (unknown [10.174.176.117]) by APP2 (Coremail) with SMTP id Syh0CgAHrerGpL9jJ4AuBg--.8635S2; Thu, 12 Jan 2023 14:12:25 +0800 (CST) Subject: Re: [PATCH v2 1/2] fscache: Use wait_on_bit() to wait for the freeing of relinquished volume To: Jingbo Xu , David Howells Cc: linux-cachefs@redhat.com, Jeff Layton , linux-erofs@lists.ozlabs.org, linux-kernel@vger.kernel.org, houtao1@huawei.com References: <20221226103309.953112-2-houtao@huaweicloud.com> <20221226103309.953112-1-houtao@huaweicloud.com> <2431838.1673453170@warthog.procyon.org.uk> <6acd0aea-2e7b-e30e-214f-81f4c3766ead@linux.alibaba.com> From: Hou Tao Message-ID: <087d25cc-97b6-7daf-3722-65fba86aaf1d@huaweicloud.com> Date: Thu, 12 Jan 2023 14:12:22 +0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.6.0 MIME-Version: 1.0 In-Reply-To: <6acd0aea-2e7b-e30e-214f-81f4c3766ead@linux.alibaba.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Content-Language: en-US X-CM-TRANSID: Syh0CgAHrerGpL9jJ4AuBg--.8635S2 X-Coremail-Antispam: 1UD129KBjvJXoW7ZFW5JF4UZw4rAF4DAry7Wrg_yoW8Gr1Dpr ZYga4UXFWktr42y397tw17Z3yYgw15Wrs3Cw1fGrZrCF15WrySkFn3KFs8CF1Uuan5Jr1F qw45A3sxtFsYvaDanT9S1TB71UUUUUUqnTZGkaVYY2UrUUUUjbIjqfuFe4nvWSU5nxnvy2 9KBjDU0xBIdaVrnRJUUUkjb4IE77IF4wAFF20E14v26r4j6ryUM7CY07I20VC2zVCF04k2 6cxKx2IYs7xG6rWj6s0DM7CIcVAFz4kK6r1j6r18M28lY4IEw2IIxxk0rwA2F7IY1VAKz4 vEj48ve4kI8wA2z4x0Y4vE2Ix0cI8IcVAFwI0_tr0E3s1l84ACjcxK6xIIjxv20xvEc7Cj xVAFwI0_Gr1j6F4UJwA2z4x0Y4vEx4A2jsIE14v26rxl6s0DM28EF7xvwVC2z280aVCY1x 0267AKxVW0oVCq3wAS0I0E0xvYzxvE52x082IY62kv0487Mc02F40EFcxC0VAKzVAqx4xG 6I80ewAv7VC0I7IYx2IY67AKxVWUJVWUGwAv7VC2z280aVAFwI0_Jr0_Gr1lOx8S6xCaFV Cjc4AY6r1j6r4UM4x0Y48IcVAKI48JMxk0xIA0c2IEe2xFo4CEbIxvr21l42xK82IYc2Ij 64vIr41l4I8I3I0E4IkC6x0Yz7v_Jr0_Gr1lx2IqxVAqx4xG67AKxVWUJVWUGwC20s026x 8GjcxK67AKxVWUGVWUWwC2zVAF1VAY17CE14v26r126r1DMIIYrxkI7VAKI48JMIIF0xvE 2Ix0cI8IcVAFwI0_Jr0_JF4lIxAIcVC0I7IYx2IY6xkF7I0E14v26r1j6r4UMIIF0xvE42 xK8VAvwI8IcIk0rVWrZr1j6s0DMIIF0xvEx4A2jsIE14v26r1j6r4UMIIF0xvEx4A2jsIE c7CjxVAFwI0_Gr0_Gr1UYxBIdaVFxhVjvjDU0xZFpf9x07UWE__UUUUU= X-CM-SenderInfo: xkrx3t3r6k3tpzhluzxrxghudrp/ X-CFilter-Loop: Reflected X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,NICE_REPLY_A, SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi, On 1/12/2023 11:58 AM, Jingbo Xu wrote: > > On 1/12/23 12:06 AM, David Howells wrote: >> Hou Tao wrote: >> >>> clear_bit(FSCACHE_VOLUME_ACQUIRE_PENDING, &cursor->flags); >>> + /* >>> + * Paired with barrier in wait_on_bit(). Check >>> + * wake_up_bit() and waitqueue_active() for details. >>> + */ >>> + smp_mb__after_atomic(); >>> wake_up_bit(&cursor->flags, FSCACHE_VOLUME_ACQUIRE_PENDING); >> What two values are you applying a partial ordering to? > Yeah Hou Tao has explained that a full barrier is needed here to avoid > the potential reordering at the waker side. > > As I was also researching on this these days, I'd like to share my > thought on this, hopefully if it could give some insight :) > > Without the barrier at the waker side, it may suffer from the following > race: > > ``` > CPU0 - waker CPU1 - waiter > > if (waitqueue_active(wq_head)) <-- find no wq_entry in wq_head list > wake_up(wq_head); > > for (;;) { > prepare_to_wait(...); > # add wq_entry into wq_head list > > if (@cond) <-- @cond is false > break; > schedule(); <-- wq_entry still in > wq_head list, > wait for next wakeup > } > finish_wait(&wq_head, &wait); > > @cond = true; > ``` > > in which case the waiter misses the wakeup for one time. Thanks for the details annotation. It is exactly what I tried to say but failed to. >