Received: by 2002:ac0:a594:0:0:0:0:0 with SMTP id m20-v6csp4284496imm; Fri, 18 May 2018 02:29:07 -0700 (PDT) X-Google-Smtp-Source: AB8JxZooxfWZ02E4evouG6AX/tBVqze2EN2PrfY/rRMPcqm71QXlubimYnRVd8UdB11R2o1AsxWY X-Received: by 2002:a17:902:d886:: with SMTP id b6-v6mr8777712plz.361.1526635747659; Fri, 18 May 2018 02:29:07 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1526635747; cv=none; d=google.com; s=arc-20160816; b=bVezBqRgxa2KsHK/3ZEz/R5e+slIPHtyIhSZJyhH1IHONSmwL08BcVCfj/5H6MklqB oXFepI78bCaFDxxD1yEGd82urVsNS9UXxUEF8M6oDLwCthNCpYw+Lw709SOy/nwoZbUV MacipewJcCxmXNlD89d8315+6IIK7GMO0qkLgJH+100dd+hjEczIWMnQi8UG+jxQoTji PbnruLGifql15FoF8+5StR+bAxypVkuPvEnHsfk+hG0umzqFzWaNdvQZses6BA0ZrN0N TblQap4llYKrmVcxcg02zq3DCTC84XzRyJBRUrTDplDngBN3N/XRZB/axDjqyGGF3WH6 8t6A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:date:subject:cc:to:from :dkim-signature:arc-authentication-results; bh=3Rm3ObuFoVhjXkjbOpMsa/q2R5YfUNleyYpv/8/gWUU=; b=h/NLYIOCgrNK3EKEtjzdRUcTBsRS0x2/w2HhXmu354Tj2iACB1Lp+Ndi8SdDdM/gBU HW3PGKCmjayMvVuchEdNUx/rxablajW4x5Y0JMn1STwCZ9LRK8lqv0dJe/DJNIchwb6A Wjx47p599daWMLw24Pdbj37QkR8ebCRU72kUHHlHiwK6iADed0RP436nC83yoRNolQwt 327ZDzwC/nc4cMdJzhGW+qd6IOvkbQtY4jdsTaZTtm0ODLMicB9PNy0OIuXZesJA33bg oYIBgqvFQkLSLSxhiR4EjRjHcgU/SGbaKcrNyqy11yl/2nsR7YUk73u08kmfVTWNot+b 7m+w== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=b6Rpqxwc; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id q11-v6si5612208pgc.669.2018.05.18.02.28.53; Fri, 18 May 2018 02:29:07 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=b6Rpqxwc; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753327AbeERJ1w (ORCPT + 99 others); Fri, 18 May 2018 05:27:52 -0400 Received: from mail-pl0-f65.google.com ([209.85.160.65]:40718 "EHLO mail-pl0-f65.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751296AbeERJ1r (ORCPT ); Fri, 18 May 2018 05:27:47 -0400 Received: by mail-pl0-f65.google.com with SMTP id t12-v6so4255173plo.7 for ; Fri, 18 May 2018 02:27:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id; bh=3Rm3ObuFoVhjXkjbOpMsa/q2R5YfUNleyYpv/8/gWUU=; b=b6Rpqxwc5qh4FGzTrkLioNYaxn4t3UmkjSKIp042LI4O0KwAjPWME2k3ERdVTokADC 19VevBaOZAdfgqDW0AE4K/Lon2PEf0yvaGzQ8cWsIczw8FeYsBEi4sP5LcqzM+La0kD5 KlKv0HnjA+U9AZLrTE0WYayjJoz6A92D7xHDL1MVqDRkxw0MByH4Ibm9TvErbCko22mU sFvsvSwBZMEj2j1gyJV4tQ78lg/mrltRCSWRHZv07lfKuCeIyS2pUeHqu4o8klYQvp9D 5rMxrIghfXiMceYabPdYgAemuDDsjTAxbggVgnMSoB846lAwTqNtbg6chSVs/TEGPSpj ZtsA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id; bh=3Rm3ObuFoVhjXkjbOpMsa/q2R5YfUNleyYpv/8/gWUU=; b=E7VSE6kWHCA26W0DbvgDwwV6EMd/Xm+tDbvgWlFvbf6xtWYBYjYmyD4ZHsDu8+WC4e ZqOFLJTKNuD/apms1ohrAcW37X6PdTRSGTz4TU1HGa+nLYBNqA7wjMoFeCc+Js2p4BSr BQmyBnWFIEdSoydJAza79pM1wBeBIyRZDpS/iUujlqLtyT0DoYGobr73k8bvJ1eHKsRu 2kbOgwAJWJrxKbCKyFdPegWGe001lzMxs7Az7PXCByd0+GW4cg8wVve6TdoKf7ZUuIpj lwSg8clMkw/l3In4QvY4cB6DSDwLDCzuzfoXZtLqDeLkc6kTk48216i3cjB/s2EgPPOj hUXQ== X-Gm-Message-State: ALKqPwf7vTx9jmuAErnXy8vQe+yOvSpgG4GBlLmDeM2HD3T04a2vi2nK HDQrSw1t0oBp9KiCbO37QoOYKA== X-Received: by 2002:a17:902:bd82:: with SMTP id q2-v6mr8716407pls.77.1526635666741; Fri, 18 May 2018 02:27:46 -0700 (PDT) Received: from ct7host.localdomain ([38.106.11.25]) by smtp.gmail.com with ESMTPSA id o10-v6sm9162338pgp.30.2018.05.18.02.27.42 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 18 May 2018 02:27:46 -0700 (PDT) From: Jia He To: Christoffer Dall , Marc Zyngier , linux-arm-kernel@lists.infradead.org, kvmarm@lists.cs.columbia.edu Cc: Suzuki.Poulose@arm.com, linux-kernel@vger.kernel.org, Jia He , jia.he@hxt-semitech.com Subject: [PATCH v2 1/2] KVM: arm/arm64: add WARN_ON if size is not PAGE_SIZE aligned in unmap_stage2_range Date: Fri, 18 May 2018 17:27:09 +0800 Message-Id: <1526635630-18917-1-git-send-email-hejianet@gmail.com> X-Mailer: git-send-email 1.8.3.1 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org There is a panic in armv8a server(QDF2400) under memory pressure tests (start 20 guests and run memhog in the host). ---------------------------------begin-------------------------------- [35380.800950] BUG: Bad page state in process qemu-kvm pfn:dd0b6 [35380.805825] page:ffff7fe003742d80 count:-4871 mapcount:-2126053375 mapping: (null) index:0x0 [35380.815024] flags: 0x1fffc00000000000() [35380.818845] raw: 1fffc00000000000 0000000000000000 0000000000000000 ffffecf981470000 [35380.826569] raw: dead000000000100 dead000000000200 ffff8017c001c000 0000000000000000 [35380.805825] page:ffff7fe003742d80 count:-4871 mapcount:-2126053375 mapping: (null) index:0x0 [35380.815024] flags: 0x1fffc00000000000() [35380.818845] raw: 1fffc00000000000 0000000000000000 0000000000000000 ffffecf981470000 [35380.826569] raw: dead000000000100 dead000000000200 ffff8017c001c000 0000000000000000 [35380.834294] page dumped because: nonzero _refcount [35380.839069] Modules linked in: vhost_net vhost tap ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter fcoe libfcoe libfc 8021q garp mrp stp llc scsi_transport_fc openvswitch nf_conntrack_ipv6 nf_nat_ipv6 nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_defrag_ipv6 nf_nat nf_conntrack vfat fat rpcrdma ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm mlx5_ib ib_core crc32_ce ipmi_ssif tpm_tis tpm_tis_core sg nfsd auth_rpcgss nfs_acl lockd grace sunrpc dm_multipath ip_tables xfs libcrc32c mlx5_core mlxfw devlink ahci_platform libahci_platform libahci qcom_emac sdhci_acpi sdhci hdma mmc_core hdma_mgmt i2c_qup dm_mirror dm_region_hash dm_log dm_mod [35380.908341] CPU: 29 PID: 18323 Comm: qemu-kvm Tainted: G W 4.14.15-5.hxt.aarch64 #1 [35380.917107] Hardware name: [35380.930909] Call trace: [35380.933345] [] dump_backtrace+0x0/0x22c [35380.938723] [] show_stack+0x24/0x2c [35380.943759] [] dump_stack+0x8c/0xb0 [35380.948794] [] bad_page+0xf4/0x154 [35380.953740] [] free_pages_check_bad+0x90/0x9c [35380.959642] [] free_pcppages_bulk+0x464/0x518 [35380.965545] [] free_hot_cold_page+0x22c/0x300 [35380.971448] [] __put_page+0x54/0x60 [35380.976484] [] unmap_stage2_range+0x170/0x2b4 [35380.982385] [] kvm_unmap_hva_handler+0x30/0x40 [35380.988375] [] handle_hva_to_gpa+0xb0/0xec [35380.994016] [] kvm_unmap_hva_range+0x5c/0xd0 [35380.999833] [] kvm_mmu_notifier_invalidate_range_start+0x60/0xb0 [35381.007387] [] __mmu_notifier_invalidate_range_start+0x64/0x8c [35381.014765] [] try_to_unmap_one+0x78c/0x7a4 [35381.020493] [] rmap_walk_ksm+0x124/0x1a0 [35381.025961] [] rmap_walk+0x94/0x98 [35381.030909] [] try_to_unmap+0x100/0x124 [35381.036293] [] unmap_and_move+0x480/0x6fc [35381.041847] [] migrate_pages+0x10c/0x288 [35381.047318] [] compact_zone+0x238/0x954 [35381.052697] [] compact_zone_order+0xc4/0xe8 [35381.058427] [] try_to_compact_pages+0x160/0x294 [35381.064503] [] __alloc_pages_direct_compact+0x68/0x194 [35381.071187] [] __alloc_pages_nodemask+0xc20/0xf7c [35381.077437] [] alloc_pages_vma+0x1a4/0x1c0 [35381.083080] [] do_huge_pmd_anonymous_page+0x128/0x324 [35381.089677] [] __handle_mm_fault+0x71c/0x7e8 [35381.095492] [] handle_mm_fault+0xf8/0x194 [35381.101049] [] __get_user_pages+0x124/0x34c [35381.106777] [] populate_vma_page_range+0x90/0x9c [35381.112941] [] __mm_populate+0xc4/0x15c [35381.118322] [] SyS_mlockall+0x100/0x164 [35381.123705] Exception stack(0xffff800dce5f3ec0 to 0xffff800dce5f4000) [35381.130128] 3ec0: 0000000000000003 d6e6024cc9b87e00 0000aaaabe94f000 0000000000000000 [35381.137940] 3ee0: 0000000000000002 0000000000000000 0000000000000000 0000aaaacf6fc3c0 [35381.145753] 3f00: 00000000000000e6 0000aaaacf6fc490 0000ffffeeeab0f0 d6e6024cc9b87e00 [35381.153565] 3f20: 0000000000000000 0000aaaabe81b3c0 0000000000000020 00009e53eff806b5 [35381.161379] 3f40: 0000aaaabe94de48 0000ffffa7c269b0 0000000000000011 0000ffffeeeabf68 [35381.169190] 3f60: 0000aaaaceacfe60 0000aaaabe94f000 0000aaaabe9ba358 0000aaaabe7ffb80 [35381.177003] 3f80: 0000aaaabe9ba000 0000aaaabe959f64 0000000000000000 0000aaaabe94f000 [35381.184815] 3fa0: 0000000000000000 0000ffffeeeabdb0 0000aaaabe5f3bf8 0000ffffeeeabdb0 [35381.192628] 3fc0: 0000ffffa7c269b8 0000000060000000 0000000000000003 00000000000000e6 [35381.200440] 3fe0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000 [35381.208254] [] __sys_trace_return+0x0/0x4 [35381.213809] Disabling lock debugging due to kernel taint --------------------------------end-------------------------------------- The root cause might be what I fixed at [1]. But from arm kvm points of view, it would be better we caught the exception earlier and clearer. If the size is not PAGE_SIZE aligned, unmap_stage2_range might unmap the wrong(more or less) page range. Hence it caused the "BUG: Bad page state" [1] https://lkml.org/lkml/2018/5/3/1042 Signed-off-by: jia.he@hxt-semitech.com Reviewed-by: Suzuki K Poulose --- v2: refine the commit log virt/kvm/arm/mmu.c | 2 ++ 1 file changed, 2 insertions(+) diff --git a/virt/kvm/arm/mmu.c b/virt/kvm/arm/mmu.c index 7f6a944..8dac311 100644 --- a/virt/kvm/arm/mmu.c +++ b/virt/kvm/arm/mmu.c @@ -297,6 +297,8 @@ static void unmap_stage2_range(struct kvm *kvm, phys_addr_t start, u64 size) phys_addr_t next; assert_spin_locked(&kvm->mmu_lock); + WARN_ON(size & ~PAGE_MASK); + pgd = kvm->arch.pgd + stage2_pgd_index(addr); do { /* -- 1.8.3.1