Received: by 2002:a05:6358:111d:b0:dc:6189:e246 with SMTP id f29csp593414rwi; Wed, 2 Nov 2022 15:55:55 -0700 (PDT) X-Google-Smtp-Source: AMsMyM7Y8M/WTxGuYK4se/ltGvBYycM5P9EHM/O0QYUJrS7e8zmnEhlbVOJJiid4s4cl+ruVh2X9 X-Received: by 2002:a17:90b:1d83:b0:212:dc2f:8fc7 with SMTP id pf3-20020a17090b1d8300b00212dc2f8fc7mr27742271pjb.131.1667429754900; Wed, 02 Nov 2022 15:55:54 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1667429754; cv=none; d=google.com; s=arc-20160816; b=KiO6hgdvLoJ6xG9yIeBare+zpybeHmZvqTqk1kKgLdWlxNj/HAwMFBksL0n9ZI/P1f qtMqD35n24J6n43VOmmKdfK7KSJPw76oJHpEyB7IN/tampah2nbIrxMw2DXnf/pYl/7v gcxqCnjkYnA4ZlNbFiRgKvMozYOzq4DeM/FaPuFBuboWH4r2h69tvvzmpfyGn77iEgqi Jc1ckxxzV4+Lz3+UGNHKt8o2TCpY6pJAzCCQzQ7MMg7B2RwO7nhxSZ2XqMQcI/tT0eXz e6TMlbGLzzxYtRY33CKnlJz2hUnKXRgAkE1+EETiW8hlkTOZqsaYCA4HsHaX5pdn0y7A SONQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=IkisCoYjfZaTobaBNzuvGkutbPUag6VJeOaYOz4JBAQ=; b=BeVZLxtsqkxoyvE6E+mIpbUrvoLYLnG/VVE0EJJRdl3beHQ23sQfvmJtNgWbgkFzjD W6Z+emNt3pgV5qZzzbsZoJbFjnoZOrVSNC3WitMJeWbQF1jeJIVG6HfoiPVFCPWirkya HoIA0Ah7o3ZRdkM74HbYcYBqopTSFOOHnLCpF74o2QzdsWo8ihCaCzrjvfn6uv4/qCUn xdTwQoE28xtWjHAo0rDcul8z7B1LPlYDhtBAxhTRCuH85/lip/1I+ksde0JoF0MeaYaD 2C7YFZIZy5kuemhjCp2jxTyMNg5Eok6rMuJkfCWW46RAMR1KuOsqIP/qXpt/DFrooBKr hwlA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20210112 header.b=AQER4z7t; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id n16-20020a63f810000000b00457dced8b7dsi17657608pgh.588.2022.11.02.15.55.40; Wed, 02 Nov 2022 15:55:54 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20210112 header.b=AQER4z7t; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231404AbiKBW1d (ORCPT + 97 others); Wed, 2 Nov 2022 18:27:33 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:39660 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229971AbiKBW1b (ORCPT ); Wed, 2 Nov 2022 18:27:31 -0400 Received: from mail-pf1-x42f.google.com (mail-pf1-x42f.google.com [IPv6:2607:f8b0:4864:20::42f]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 7A139D46 for ; Wed, 2 Nov 2022 15:27:30 -0700 (PDT) Received: by mail-pf1-x42f.google.com with SMTP id i3so17655235pfc.11 for ; Wed, 02 Nov 2022 15:27:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=IkisCoYjfZaTobaBNzuvGkutbPUag6VJeOaYOz4JBAQ=; b=AQER4z7tFb0LF1x7APVk/7A/ow3nhFpQBzb68WILdjmb9/J8BP/+FmiJvfG/QJG3QM myCt6XknexcTh1afQOzkYqHg8wCsST+fj2NblSGEUsBMiki0qmOGhddpgZ6GGy4/MH65 TgAD3S4a/p9hO82cEg+68U4CrTdIdUHPAG/zEQ+irNvDFzKG+S5L83bK/J9tQjyCijSB wyevGfiFC/AjWJ9WZH7/tPskPrghURJoVM2YFY9q8vaPQ+v+sGxEzEIIAaOHljoGoKmj kT7iBrNzbRSBPZzFt2HT7rQfrfvnND9m1HiZvcKPlDOG1KSCpvgtWYY/ywOe1umw03s0 qr3A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=IkisCoYjfZaTobaBNzuvGkutbPUag6VJeOaYOz4JBAQ=; b=Hb+VwR0mtJL+EaR025SdVE9FKJUXJDbM/Kp1RI1T49Yi7miOJXkbouC5cZaW47wyjB gdtAIhxA3POcp2m96ImLQtbl1zAVDCedVfLVt87qSDLUoZDOrcq2nS7pKDY4SnTJ7/13 SAtkaZgbjap+e/vYzWgQQaj5Q8f28sGv++GMtz/p9u9eXec9aoB/IYQCTF096QMMnvs8 2DtVFZeNPW8QyzjME700sKAwEEGiqJyOTupmyKYST84rp4wbq6QmHZX8CXJpjWkM4F4A jB8CoFtcbR4221VYIuG7IC6bEPfj1k02GGJEFf1ITWcjBIB7/V9pqLX+eXM+w0K21zmR S/IA== X-Gm-Message-State: ACrzQf0WNaxkbBlWPh57qa8E3PMGvR2i1nvUZGJT7jmKztXhWuyxuITI XQfY4f/hGNugShyqc5KyMEfF6Q== X-Received: by 2002:a05:6a02:10a:b0:461:26b8:1c95 with SMTP id bg10-20020a056a02010a00b0046126b81c95mr22449088pgb.503.1667428049896; Wed, 02 Nov 2022 15:27:29 -0700 (PDT) Received: from google.com (7.104.168.34.bc.googleusercontent.com. [34.168.104.7]) by smtp.gmail.com with ESMTPSA id t29-20020aa7947d000000b005625d6d2999sm8945409pfq.187.2022.11.02.15.27.29 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 02 Nov 2022 15:27:29 -0700 (PDT) Date: Wed, 2 Nov 2022 22:27:26 +0000 From: Sean Christopherson To: Ben Gardon Cc: linux-kernel@vger.kernel.org, kvm@vger.kernel.org, Paolo Bonzini , David Matlack , Anish Ghulati , Greg Thelen Subject: Re: [PATCH v2] KVM: x86: Use SRCU to protect zap in __kvm_set_or_clear_apicv_inhibit() Message-ID: References: <20221102205359.1260980-1-bgardon@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20221102205359.1260980-1-bgardon@google.com> X-Spam-Status: No, score=-17.6 required=5.0 tests=BAYES_00,DKIMWL_WL_MED, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF, ENV_AND_HDR_SPF_MATCH,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS, USER_IN_DEF_DKIM_WL,USER_IN_DEF_SPF_WL autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Nov 02, 2022, Ben Gardon wrote: > kvm_zap_gfn_range() must be called in an SRCU read-critical section, but > there is no SRCU annotation in __kvm_set_or_clear_apicv_inhibit(). This > can lead to the following warning via > kvm_arch_vcpu_ioctl_set_guest_debug() if a Shadow MMU is in use (TDP > MMU disabled or nesting): > > [ 1416.659809] ============================= > [ 1416.659810] WARNING: suspicious RCU usage > [ 1416.659839] 6.1.0-dbg-DEV #1 Tainted: G S I > [ 1416.659853] ----------------------------- > [ 1416.659854] include/linux/kvm_host.h:954 suspicious rcu_dereference_check() usage! > [ 1416.659856] > ... > [ 1416.659904] dump_stack_lvl+0x84/0xaa > [ 1416.659910] dump_stack+0x10/0x15 > [ 1416.659913] lockdep_rcu_suspicious+0x11e/0x130 > [ 1416.659919] kvm_zap_gfn_range+0x226/0x5e0 > [ 1416.659926] ? kvm_make_all_cpus_request_except+0x18b/0x1e0 > [ 1416.659935] __kvm_set_or_clear_apicv_inhibit+0xcc/0x100 > [ 1416.659940] kvm_arch_vcpu_ioctl_set_guest_debug+0x350/0x390 > [ 1416.659946] kvm_vcpu_ioctl+0x2fc/0x620 > [ 1416.659955] __se_sys_ioctl+0x77/0xc0 > [ 1416.659962] __x64_sys_ioctl+0x1d/0x20 > [ 1416.659965] do_syscall_64+0x3d/0x80 > [ 1416.659969] entry_SYSCALL_64_after_hwframe+0x63/0xcd > > Always take the KVM SRCU read lock in __kvm_set_or_clear_apicv_inhibit() > to protect the GFN to memslot translation. The SRCU read lock is not > technically required when no Shadow MMUs are in use, since the TDP MMU > walks the paging structures from the roots and does not need to look up > GFN translations in the memslots, but make the SRCU locking > unconditional for simplicty. > > In most cases, the SRCU locking is taken care of in the vCPU run loop, > but when called through the KVM_SET_GUEST_DEBUG IOCTL, the SRCU read > lock is missing. Nit, it not just KVM_SET_GUEST_DEBUG. If it were just KVM_SET_GUEST_DEBUG, I might have advocated putting the fix KVM_SET_GUEST_DEBUG. > Tested: ran tools/testing/selftests/kvm/x86_64/debug_regs on a DBG > build. This patch causes the suspicious RCU warning to disappear. > Note that the warning is hit in __kvm_zap_rmaps(), so > kvm_memslots_have_rmaps() must return true in order for this to > repro (i.e. the TDP MMU must be off or nesting in use.) > > Reported-by: Greg Thelen > Fixes: 36222b117e36 ("KVM: x86: don't disable APICv memslot when inhibited") > Signed-off-by: Ben Gardon > --- Reviewed-by: Sean Christopherson