Received: by 2002:a6b:500f:0:0:0:0:0 with SMTP id e15csp4835720iob; Mon, 9 May 2022 02:47:50 -0700 (PDT) X-Google-Smtp-Source: ABdhPJytZpv9VsnhK2RZmzIKYbiNS+yIG6BPEAZmc0Z5IkpJtmHAB/WPnsXcebZSl3qai5FKP5wi X-Received: by 2002:a17:902:b906:b0:158:3120:3b69 with SMTP id bf6-20020a170902b90600b0015831203b69mr15449491plb.33.1652089669808; Mon, 09 May 2022 02:47:49 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1652089669; cv=none; d=google.com; s=arc-20160816; b=bqpVrSucrUsMdwd46E6twESCkXsjJjRm0dCegfzx8qpkV60U6bDIU/NeeWYQXH70kA lFhqPtNptQXOVzLSuGWXgNtFZnhEpPDr+8KyyCNy2Df9cHqOYuXv9YMTr9/N99bY87j9 angrqbuIYY0Bzax+oZghkR791IgqHCkp9tT/CG0fAitR1+P5ZgLGJd1H6vV/IT7DVvl5 9BKmby7j/dwEdaVOoIwgj54HXc8QlRrZv14C6ithEmZL36rMcYLVh9biPlDMoDFWJg43 8kCtHbKav8syjCaZLcvfUMj7wfT4+7H3rp0+8fqyy7EJTn3K+Zcow3fId2jVtaPdQ4VX 5GDw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=hPCChwN70fxKmAN8N/8qwui+OHfL43odd3gHeAPd0q8=; b=M4pEDBFkCSDTl8K3d4nhwhTg2zZMdgGTlfZ5S/X94nM+QoSEDGHCKLoGL5u/LC6aww PZ/HlPWNAPWkWo12xTsou0xw69quhB6lrRRtgApPEq2Y3/gghEu8KZlPhXTXUL5l30wn kUTgvTF0pKCYwVYgYR0fVI7WZFZ2yo74v1umv6EjstxMhVo3zIIns1Za01dCBduPoMkQ NYppDNHaUyVKTh9wIZ+Cu56fak4uTXGLrx2p2TKmUt0xVftI5EWve+LL5mXy8LC0Ea3e R4iQoJGMMstBAWtqkEDsfvfk8IIbu19WXTWvPRaijTgw5W0lvDSUsaTvj3qGODLtJSGC +Rjg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b="Y8DQ/E81"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net. [2620:137:e000::1:18]) by mx.google.com with ESMTPS id y2-20020a170902864200b0015a0ec8d989si11238064plt.172.2022.05.09.02.47.49 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 09 May 2022 02:47:49 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:18 as permitted sender) client-ip=2620:137:e000::1:18; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b="Y8DQ/E81"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 8D9B553B7A; Mon, 9 May 2022 02:30:49 -0700 (PDT) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S244181AbiEEGQp (ORCPT + 99 others); Thu, 5 May 2022 02:16:45 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:35766 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230304AbiEEGQm (ORCPT ); Thu, 5 May 2022 02:16:42 -0400 Received: from mail-pl1-x635.google.com (mail-pl1-x635.google.com [IPv6:2607:f8b0:4864:20::635]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 8DC1C46650; Wed, 4 May 2022 23:13:04 -0700 (PDT) Received: by mail-pl1-x635.google.com with SMTP id i17so3474603pla.10; Wed, 04 May 2022 23:13:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=hPCChwN70fxKmAN8N/8qwui+OHfL43odd3gHeAPd0q8=; b=Y8DQ/E81oo8oXjq/OXlH0hSHb5JxT7Z7U2aSMklNhxdxESdRqmT07BwEoI9nufkmSh XXNl58Jrnf0WfDKwmfcyzU6qrJuB/N4yf5Q5FSw+8QVHrX31IZ49B6u20eNLP+/11PHr E/A9YuuogwWOfTmToJ3Xf/fHevzCaOWbARPWcZUxUZXuOBDyU5BrVxQ+3el74hhAxKod maGAQs7hN+/Qt8wb6KGsZh3V8/YbMqEQolsyvHmJPj9nJEDhl6udCy4T+Gc4kH8RDUqX YWYolo8NoN3kO0YoP17f/Jn8aU+SwlpB95YAjoeTA8xOaiZoydeb2yLqH+cu57aKv29g MRGQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=hPCChwN70fxKmAN8N/8qwui+OHfL43odd3gHeAPd0q8=; b=eIQt/VGRuIDsEFgUQkkWmL15W1nxPXVNjXMCM3mRPEW3enzBApJPHQb7rf5TS6IwZh QHWpdtfiFACJZqH5Ok8+tP57QUDiixyrDJH0J/7E1zZRMmg6/BuUhfQ4cz7GbbRKqyda 04S3gBXydy0urqvUA2tS4pEvIQjLHJf2A39PXWgibEPLTm/2toJxQuMJKKc0xk5/F1Zp 4cFkQ8SXkNPc16s3IYVlBaJ5VPw9jgMMzyBPNKOLry1DxKJ0X9Ke2vw5NN8W7fzWd50F 23MkluFiQ6q/e5Ii/EH44k5ZkaJkwt645n5UYh/1K2N8j3Y+qETGd8BO+wZLv+gEB1jo ZYLQ== X-Gm-Message-State: AOAM532hHaLVtmHuW5KEsHezU4paIBryzmGel4yh2HdMsiiCISdORXRV 3GkO18t0PvdBWA0bIpuiodWAMoEE8bo7KX6K4UM= X-Received: by 2002:a17:902:d2d1:b0:15e:9b06:28b3 with SMTP id n17-20020a170902d2d100b0015e9b0628b3mr21557574plc.148.1651731184006; Wed, 04 May 2022 23:13:04 -0700 (PDT) MIME-Version: 1.0 References: <20220502102521.22875-1-dharamhans87@gmail.com> In-Reply-To: From: Dharmendra Hans Date: Thu, 5 May 2022 11:42:51 +0530 Message-ID: Subject: Re: [PATCH v4 0/3] FUSE: Implement atomic lookup + open/create To: Vivek Goyal Cc: Miklos Szeredi , linux-fsdevel@vger.kernel.org, fuse-devel , linux-kernel@vger.kernel.org, Bernd Schubert Content-Type: text/plain; charset="UTF-8" X-Spam-Status: No, score=-1.7 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,RDNS_NONE, SPF_HELO_NONE,T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, May 5, 2022 at 12:48 AM Vivek Goyal wrote: > > On Mon, May 02, 2022 at 03:55:18PM +0530, Dharmendra Singh wrote: > > In FUSE, as of now, uncached lookups are expensive over the wire. > > E.g additional latencies and stressing (meta data) servers from > > thousands of clients. These lookup calls possibly can be avoided > > in some cases. Incoming three patches address this issue. > > BTW, these patches are designed to improve performance by cutting down > on number of fuse commands sent. Are there any performance numbers > which demonstrate what kind of improvement you are seeing. > > Say, If I do kernel build, is the performance improvement observable? Here are the numbers I took last time. These were taken on tmpfs to actually see the effect of reduced calls. On local file systems it might not be that much visible. But we have observed that on systems where we have thousands of clients hammering the metadata servers, it helps a lot (We did not take numbers yet as we are required to change a lot of our client code but would be doing it later on). Note that for a change in performance number due to the new version of these patches, we have just refactored the code and functionality has remained the same since then. here is the link to the performance numbers https://lore.kernel.org/linux-fsdevel/20220322121212.5087-1-dharamhans87@gmail.com/