Received: by 2002:a05:6358:3188:b0:123:57c1:9b43 with SMTP id q8csp1294863rwd; Thu, 8 Jun 2023 15:50:58 -0700 (PDT) X-Google-Smtp-Source: ACHHUZ4OJmXTcmM0NZHjT990q/8noVFniL0Q0zM2lgFUxfeFrluT3ezlFsCne6vc3Hg54AqQFxiH X-Received: by 2002:a05:6a00:99f:b0:65e:fca6:f2cf with SMTP id u31-20020a056a00099f00b0065efca6f2cfmr6898396pfg.26.1686264657658; Thu, 08 Jun 2023 15:50:57 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1686264657; cv=none; d=google.com; s=arc-20160816; b=0wST1+aUW56+vCjbjG9jyjXCzPgi4TIyQf274Yui7l7ejB0lIzAmYH/JpUQzosBObf Sd7HC40cZEm2rEwjUAC5VWz44Yi0yxIAAxjO5j/P1FJ1n6eH7eaolbxwxLR+nKoC0+1o NKeqITlJI+2KJEp/RctkqxcV2Blm4oZ6vXfvMhXqx/RdxTZSdWbEaxET9NkB5bNdbLsj 7MY3QQ6HHAvgt3UA7H5xeRP2aTcOs+4DCSmyTx9ti+CeV+KgrkARTqy2TCuA7gV9+ONC ftor69p5XAclC0ud+OxYkKD5fWK/RMqFLluHxuypS0EqvocGh+iBODGRt8GDtgCH7eRr OtFg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:from:subject:message-id:mime-version:date :dkim-signature; bh=f9CaDc6GGBWuK7eCpoNYT6YueR8Zbl2jpIpeaKQVQvQ=; b=XnAHiElY2q4ZAu8SxwxpK/4lhk00/NWnudRtz9p/yrPT0yzNtnXu1CeY2HgXpAqry8 nYOhIjKQoqTxREmmokOn+w5J2mTFJ5YHathRhktQUjX4sc114CNfHFhenJ7BZSveZbR0 fNSIuGGmG68l8cnitU2qZQriry31o2MqSmCxOL0f0gE2IBIlyWZwEOfighpOo4eRvkg5 Pj87lhQpl6l1F3hmQZ5QvT67nOVSwEQ6Hrw4fJU4nEIUC41vJhsNeLQQBrtC1r1rIWBd Cs7JKuc8ip8z8BQB5z2rECBkFSwa19AagkJlBawmue2sBZ4OlrWo82vK1VO+uHB7gjne ew4g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20221208 header.b=g6TUacce; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id t21-20020aa79475000000b0064f400fcb99si1459006pfq.148.2023.06.08.15.50.45; Thu, 08 Jun 2023 15:50:57 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20221208 header.b=g6TUacce; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S236855AbjFHWGS (ORCPT + 99 others); Thu, 8 Jun 2023 18:06:18 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:46824 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S236839AbjFHWGP (ORCPT ); Thu, 8 Jun 2023 18:06:15 -0400 Received: from mail-pl1-x64a.google.com (mail-pl1-x64a.google.com [IPv6:2607:f8b0:4864:20::64a]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 7BE5D30D0 for ; Thu, 8 Jun 2023 15:06:12 -0700 (PDT) Received: by mail-pl1-x64a.google.com with SMTP id d9443c01a7336-1b0314f0aadso911115ad.0 for ; Thu, 08 Jun 2023 15:06:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20221208; t=1686261972; x=1688853972; h=cc:to:from:subject:message-id:mime-version:date:from:to:cc:subject :date:message-id:reply-to; bh=f9CaDc6GGBWuK7eCpoNYT6YueR8Zbl2jpIpeaKQVQvQ=; b=g6TUacceAYPEbfsv6EW0WtXBfm6IOz5S5d+OFFFjRuXIN+Gt6qw1Hxz/wxQRodLv6Q fZvF+Q31Rn/FCi8bHs7ONm0lzgg2+m7cQKkQ6aAmUBSZVRKELWdRRtCJE1LkgFGEy3zQ SxZE6ZO51wmiUifCL70ATkprYaVBcUZO8HlrsZfUqqxFI2uuJg2p5Hgbntzk6iKii5ZF qYY0amN96y9UZxoF6WKyTwgEpRR55ljoc844L4vL0UGsBIG0swmXQmOgRXIkO3EUuJIv vyKSVUkn1eQVVuBk8NZ6GWTUIYEHnAR4AAFKiV+taoOoCgyj5MdYG6SmNJrXxexjNXoH ZfQQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1686261972; x=1688853972; h=cc:to:from:subject:message-id:mime-version:date:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=f9CaDc6GGBWuK7eCpoNYT6YueR8Zbl2jpIpeaKQVQvQ=; b=IwMKg5rYBxqYm5H81z1rIR8J0NKqFkAu2mL4Hmx8Uz3R3siBOi53gszCK7KQLEqbMs kegPz7Yt7b8CtAnZ2TlvuvRr8zEVMPhzb1hWIKlk5FzxRPrPkM3zT13leb3ByfYffGr0 +kucu0YzO9QxjS/zhHK2nJRoyzEz8AMTogB01wKCn2hCCiUZTgA80LREpdFTi/dnftK+ 1t1jMegJqW5Uv3qOI993bOfmsJyvQmUYKpZJAMKSQEq61Dzk5N2cQ5oTb/GwGivcGgrD US66fcyPrC/mEwkzERlKISpeODcV7qhA1LPz/7X3CTFoCI06RI+bwyzeLYsfoP/YMVMf /aaw== X-Gm-Message-State: AC+VfDzo71VGssBapnM68Khen5lvKn7a8UENnDYqu/rhvoDWfsa01brJ jXPdRJmUqcbeLQtBB6v9Mc2wFULMgL+JIundLOnb065F/I5ln2w5O3Vh3rCJRbFWO20vSpuhApT Hd8MGoP6fhtRMU9rIQLfVvGdJJR1zEkfR3g17CqvNcAc4H+NvMrWYkuwFCG07dshtytKvSw== X-Received: from colette.c.googlers.com ([fda3:e722:ac3:cc00:24:72f4:c0a8:5cff]) (user=ctshao job=sendgmr) by 2002:a17:902:8c81:b0:1b0:46af:7edf with SMTP id t1-20020a1709028c8100b001b046af7edfmr626301plo.2.1686261971803; Thu, 08 Jun 2023 15:06:11 -0700 (PDT) Date: Thu, 8 Jun 2023 15:05:38 -0700 Mime-Version: 1.0 X-Mailer: git-send-email 2.41.0.162.gfafddb0af9-goog Message-ID: <20230608220558.39094-1-ctshao@google.com> Subject: [PATCH v1 1/3] KVM: arm64: Consistently use free_removed_table() for stage-2 From: Chun-Tse Shao To: linux-kernel@vger.kernel.org, yuzhao@google.com, oliver.upton@linux.dev Cc: Chun-Tse Shao , Marc Zyngier , James Morse , Suzuki K Poulose , Zenghui Yu , Catalin Marinas , Will Deacon , Ben Gardon , Gavin Shan , linux-arm-kernel@lists.infradead.org, kvmarm@lists.linux.dev Content-Type: text/plain; charset="UTF-8" X-Spam-Status: No, score=-9.6 required=5.0 tests=BAYES_00,DKIMWL_WL_MED, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE,USER_IN_DEF_DKIM_WL autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Oliver Upton free_removed_table() is essential to the RCU-protected parallel walking scheme, as behind the scenes the cleanup is deferred until an RCU grace period. Nonetheless, the stage-2 unmap path calls put_page() directly, which leads to table memory being freed inline with the table walk. This is safe for the time being, as the stage-2 unmap walker is called while holding the write lock. A future change to KVM will further relax the locking mechanics around the stage-2 page tables to allow lock-free walkers protected only by RCU. As such, switch to the RCU-safe mechanism for freeing table memory. Signed-off-by: Oliver Upton Signed-off-by: Chun-Tse Shao --- arch/arm64/kvm/hyp/pgtable.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/arch/arm64/kvm/hyp/pgtable.c b/arch/arm64/kvm/hyp/pgtable.c index 5282cb9ca4cf..cc1af0286755 100644 --- a/arch/arm64/kvm/hyp/pgtable.c +++ b/arch/arm64/kvm/hyp/pgtable.c @@ -1042,7 +1042,7 @@ static int stage2_unmap_walker(const struct kvm_pgtable_visit_ctx *ctx, kvm_granule_size(ctx->level)); if (childp) - mm_ops->put_page(childp); + mm_ops->free_removed_table(childp, ctx->level); return 0; } -- 2.41.0.162.gfafddb0af9-goog