Received: by 2002:a6b:500f:0:0:0:0:0 with SMTP id e15csp177841iob; Mon, 2 May 2022 16:22:24 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzA+dvJp1n5utNINSIF592uxsSjcu4HU3raxb4qmAPecR/3sKQngyTo9JdoW2FBcA0LGNK1 X-Received: by 2002:a17:902:e5cb:b0:15d:52ec:a2a3 with SMTP id u11-20020a170902e5cb00b0015d52eca2a3mr14049696plf.74.1651533744776; Mon, 02 May 2022 16:22:24 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1651533744; cv=none; d=google.com; s=arc-20160816; b=rrxd8yx8iR63bjmvsMm6kNoEEmVcSsu8XqoysmVP5SsGubs8drI3BuEFOs1lIM1q+c M0DHOQZM7IjxBK6YNhREnLELj/u7xlOE1+878rrXz9AqHmta5YPhDgjbZclRBYxCD9Nb akB0tIP4UGq5VsA3flA8Ok5rsdkmk/iKR9BQhwbe9g1lVL/CrJViCOMNUZsXypg6vF7T ZZuo5Oq5DoGNhS1ZtAXgCyhn8GnvvIyWhKrWxQ8ZYYoWo5HXkfKJOsIvWXaPe47N0pO1 p2Iqntu4KQOdkjl5A0YZVSz4HhD83PXjT/wQ/qM3RPOTrU+YzRT49t/nbxDdyDjKJtA/ Y5pg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to:from :references:cc:to:content-language:subject:user-agent:mime-version :date:message-id:dkim-signature; bh=XJuXYg02F7GZrqi1LIe5DG6ak9PjoEuh2MqhUV/o+CI=; b=vQ/qNZH4Me8nncb9ySPl3v8vSdkFoPux0AywF+D6tTzdosUQYlyYEpriV0VigrHQlX WprLCPyxhrTV057nF227R8SjGA53D7jvih+2Uo3xyednb43s1ruNRqTgjeFMheE5yWtH kjM6Grve5Pt3u3xDfzd74xbTJFIwQG2M8TTlMX9sJfsmnOWJtM1pekzdD7QHFObpOVYe saHTE3Wrnri06bY4tP8zSc8LZYsSknq7opvizKHWYX1j9zRor/Zi0M5FbM7r3uJSMgNx +5SHcllFQozX3cLjrBBpaHOX7sel1Je+ysMo9/RpFK/dIa+xCbHPNy9yiFHDReJ8F4YR 1e1A== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b="Y0/jZvPd"; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net. [23.128.96.19]) by mx.google.com with ESMTPS id m10-20020a170902db0a00b00158dd22994dsi17274114plx.93.2022.05.02.16.22.24 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 02 May 2022 16:22:24 -0700 (PDT) Received-SPF: softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) client-ip=23.128.96.19; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b="Y0/jZvPd"; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 088A8252A8; Mon, 2 May 2022 16:22:17 -0700 (PDT) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S242830AbiEAHFB (ORCPT + 99 others); Sun, 1 May 2022 03:05:01 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:35170 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S236606AbiEAHE5 (ORCPT ); Sun, 1 May 2022 03:04:57 -0400 Received: from mail-pj1-x102d.google.com (mail-pj1-x102d.google.com [IPv6:2607:f8b0:4864:20::102d]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A49AB192B1; Sun, 1 May 2022 00:01:32 -0700 (PDT) Received: by mail-pj1-x102d.google.com with SMTP id o69so9038297pjo.3; Sun, 01 May 2022 00:01:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=message-id:date:mime-version:user-agent:subject:content-language:to :cc:references:from:in-reply-to:content-transfer-encoding; bh=XJuXYg02F7GZrqi1LIe5DG6ak9PjoEuh2MqhUV/o+CI=; b=Y0/jZvPdTwxd5qNAoFtAQjICBif7TP4/uvNGHZ7mCVBNTf5UQZuBLBr192yhB2uGEx QDxEeVMT0F6NrYrr+3q/6enzJft2dUL1ybHYpJkquIl2jGDkU1E16YxjlIYESfMePOS5 AvdLSpWsGU14DMZKwKtUpG28ZbRJ6d8HOsN9+B4h8pmgXfQlTaygGoumWj8cSZdLHBuQ j189Wr+YGPwMxr/LZHsw7p5GG0cVQVUq4Zi6Ptbk9wPoIGav4zbZgO9DNG3k4N0sPmhK jqMCHNaoESkbaHMdYS/QTUPjd1jZcDSW6IA8wEg5/rrTvUsut5omo0OVMBje4tY/yHD3 H/8Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:message-id:date:mime-version:user-agent:subject :content-language:to:cc:references:from:in-reply-to :content-transfer-encoding; bh=XJuXYg02F7GZrqi1LIe5DG6ak9PjoEuh2MqhUV/o+CI=; b=JTkc2wnUSsWluesO/3JWCqwt5GhzUbJinGUto1dlVPTXG5+3Pw1bVcXf2JDtLGXz1b oA21Uu+AmmWZ88xZ8LA6JdhEHwGiRu0I/JMg7zxsx170c8q4pvlS+oWj++oAgsKCwf7R r6qb4pis4spfWy8QYvonJlI/njme88D0cvr7qh7SUranqIfWm5apGaD7NAHPIgJ3BmrL h2K6+K+8TV37iHE1l7A0oOwN9U4C3vCyjPmluO0e/t+ecrD6DsZ4L0hQsxgcIuDXsv2j a/FUW6wQfS4rAyihcheBlQVOydeV/UMBHid5g8SDt4ndwCmkxe3Y/2ws/2LNqaccUpQG QNdg== X-Gm-Message-State: AOAM531gMwh4AhqL5P8KrYR0MLPOpBjAbGFemEFA2UNcugfeufEDtYJj KHWfDDDZT8x/MIe4tvgmEl0= X-Received: by 2002:a17:902:8644:b0:15a:3b4a:538a with SMTP id y4-20020a170902864400b0015a3b4a538amr6513889plt.146.1651388492197; Sun, 01 May 2022 00:01:32 -0700 (PDT) Received: from [127.0.0.1] ([103.121.210.106]) by smtp.gmail.com with ESMTPSA id e3-20020a170903240300b0015e8d4eb28fsm2398872plo.217.2022.05.01.00.01.27 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 01 May 2022 00:01:31 -0700 (PDT) Message-ID: Date: Sun, 1 May 2022 15:00:04 +0800 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.8.1 Subject: Re: [PATCH 7/9] io-wq: implement fixed worker logic Content-Language: en-US To: Jens Axboe , io-uring@vger.kernel.org Cc: Pavel Begunkov , linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org References: <20220429101858.90282-1-haoxu.linux@gmail.com> <20220429101858.90282-8-haoxu.linux@gmail.com> <015f58ed-09c1-cd27-064a-b6c0cc5580d2@kernel.dk> From: Hao Xu In-Reply-To: <015f58ed-09c1-cd27-064a-b6c0cc5580d2@kernel.dk> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-3.3 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,NICE_REPLY_A, RDNS_NONE,SPF_HELO_NONE,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 4/30/22 21:27, Jens Axboe wrote: > On 4/29/22 4:18 AM, Hao Xu wrote: >> @@ -1030,6 +1101,7 @@ static bool io_wq_work_match_item(struct io_wq_work *work, void *data) >> static void io_wqe_enqueue(struct io_wqe *wqe, struct io_wq_work *work) >> { >> struct io_wqe_acct *acct = io_work_get_acct(wqe, work); >> + struct io_wqe_acct *fixed_acct; >> struct io_cb_cancel_data match; >> unsigned work_flags = work->flags; >> bool do_create; >> @@ -1044,8 +1116,14 @@ static void io_wqe_enqueue(struct io_wqe *wqe, struct io_wq_work *work) >> return; >> } >> >> + fixed_acct = io_get_acct(wqe, !acct->index, true); >> + if (fixed_acct->fixed_worker_registered && !io_wq_is_hashed(work)) { >> + if (io_wqe_insert_private_work(wqe, work, fixed_acct)) >> + return; >> + } >> + > > As per previous email, I was going to comment back saying "why don't we > just always do hashed work on the non-fixed workers?" - but that's > already what you are doing. Isn't this fine, does anything else need to > get done here in terms of hashed work and fixed workers? If you need > per-iowq serialization, then you don't get a fixed worker. Hmm, seems we cannot accelerate serialized works with fixed worker. So Let's make it as it is. >