Received: by 2002:a25:4158:0:0:0:0:0 with SMTP id o85csp677058yba; Thu, 16 May 2019 07:16:32 -0700 (PDT) X-Google-Smtp-Source: APXvYqwCJ9Z8dFD/tNjWjEbf1+LEoxVcwpR0o71VzdCONixPWPojIkHM0Xysz505Fs1YHB2OEd5w X-Received: by 2002:a63:2ace:: with SMTP id q197mr50033597pgq.371.1558016192750; Thu, 16 May 2019 07:16:32 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1558016192; cv=none; d=google.com; s=arc-20160816; b=q8Tz5lCmglte4fxUybF2UYPRoZpvz4CGxdIMtArbwhpY5oITbx4n1niHxYr8WWwBBS 8vYi54hs19C9XF5esaarXa3A5HOgOTTgLeUvTbjHj/KLhjsUoFNMvH8dNIZYR9o2li6L co5DsEdU/srtoBQMW1hrMao8wtHLyUgEpjxPCBxNPKP6BbpR1IAaVbcYkeJ8wXfZf2Ah 9QloxMBmhUs65T+aXVbzBXSGGVEZd1rAEMB2K8WTmB37AY+FucKX8wHHIlf8f3Uyu8FK FbHTx1lTBLgKc3hJVOJt13231MAWpJr5RW4T3+hZRyzt97An6qV05ukw+p5urwEWPsY2 fp+w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:content-language :content-transfer-encoding:mime-version:user-agent:date:subject:from :cc:to; bh=ZeumksqGkCDANGTnRsZg/KlgCHz3n5EIggZyTk8tNdk=; b=xy7Lf3iEWKqCUc0/ijPsFVgAEiRbR0ZrJuTrVsKktzzF3y1FEOlc/ZwTFk6mXRvqW4 NlyZt3ypxVuXxrvBmKr+W1+sXPVL6vBclkLmnqnGtSlAoma1MiGBipqMMrUQ+1bi4MYl wYAhy1LI9FfBjka98RcsWdWWDfktNX6s43Q+XJoMkYRT4UMvw0aHlhieOXOdcCaL+CiZ FF/VXmmPIv/JrjlQmTzLk9OFsaZLYUe+hZW5YSmKW9qNG7NPlJorI/VvzreSeCKY5IBX jrweSrWMWCxCG4gVWqalCXAqb64rtr1D2dRjWm+AxlBxtZZsnqUJNMdoaNUS+F8+fOmm cN6g== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id a25si5325894pff.119.2019.05.16.07.16.11; Thu, 16 May 2019 07:16:32 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727697AbfEPOOc (ORCPT + 99 others); Thu, 16 May 2019 10:14:32 -0400 Received: from mx0a-001b2d01.pphosted.com ([148.163.156.1]:50106 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726758AbfEPOOc (ORCPT ); Thu, 16 May 2019 10:14:32 -0400 Received: from pps.filterd (m0098396.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.16.0.27/8.16.0.27) with SMTP id x4GE4AVK080456 for ; Thu, 16 May 2019 10:14:31 -0400 Received: from e06smtp03.uk.ibm.com (e06smtp03.uk.ibm.com [195.75.94.99]) by mx0a-001b2d01.pphosted.com with ESMTP id 2sh8wq9tfm-1 (version=TLSv1.2 cipher=AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 16 May 2019 10:14:30 -0400 Received: from localhost by e06smtp03.uk.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Thu, 16 May 2019 15:14:28 +0100 Received: from b06cxnps4075.portsmouth.uk.ibm.com (9.149.109.197) by e06smtp03.uk.ibm.com (192.168.101.133) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; (version=TLSv1/SSLv3 cipher=AES256-GCM-SHA384 bits=256/256) Thu, 16 May 2019 15:14:25 +0100 Received: from d06av25.portsmouth.uk.ibm.com (d06av25.portsmouth.uk.ibm.com [9.149.105.61]) by b06cxnps4075.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id x4GEEOnS58196156 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 16 May 2019 14:14:24 GMT Received: from d06av25.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 7E6A511C04A; Thu, 16 May 2019 14:14:24 +0000 (GMT) Received: from d06av25.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 2497E11C050; Thu, 16 May 2019 14:14:22 +0000 (GMT) Received: from bssrikanth.in.ibm.com (unknown [9.85.163.55]) by d06av25.portsmouth.uk.ibm.com (Postfix) with ESMTP; Thu, 16 May 2019 14:14:21 +0000 (GMT) To: linuxppc-dev@lists.ozlabs.org Cc: bharata@linux.vnet.ibm.com, mpe@ellerman.id.au, linux-kernel@vger.kernel.org, linux-next@vger.kernel.org From: srikanth Subject: PROBLEM: Power9: kernel oops on memory hotunplug from ppc64le guest Date: Thu, 16 May 2019 19:44:20 +0530 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-TM-AS-GCONF: 00 x-cbid: 19051614-0012-0000-0000-0000031C5F48 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 19051614-0013-0000-0000-000021550108 Message-Id: <16a7a635-c592-27e2-75b4-d02071833278@linux.vnet.ibm.com> X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2019-05-16_12:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1810050000 definitions=main-1905160092 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hello, On power9 host, performing memory hotunplug from ppc64le guest results in kernel oops. Kernel used : https://github.com/torvalds/linux/tree/v5.1 built using ppc64le_defconfig for host and ppc64le_guest_defconfig for guest. Recreation steps: 1. Boot a guest with below mem configuration:   33554432   8388608   4194304                   2. From host hotplug 8G memory -> verify memory hotadded succesfully -> now reboot guest -> once guest comes back try to unplug 8G memory mem.xml used: 8 0 Memory attach and detach commands used:     virsh attach-device vm1 ./mem.xml --live     virsh detach-device vm1 ./mem.xml --live Trace seen inside guest after unplug, guest just hangs there forever: [   21.962986] kernel BUG at arch/powerpc/mm/pgtable-frag.c:113! [   21.963064] Oops: Exception in kernel mode, sig: 5 [#1] [   21.963090] LE PAGE_SIZE=64K MMU=Radix MMU=Hash SMP NR_CPUS=2048 NUMA pSeries [   21.963131] Modules linked in: xt_tcpudp iptable_filter squashfs fuse vmx_crypto ib_iser rdma_cm iw_cm ib_cm ib_core libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs zstd_decompress zstd_compress lzo_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq multipath crc32c_vpmsum [   21.963281] CPU: 11 PID: 316 Comm: kworker/u64:5 Kdump: loaded Not tainted 5.1.0-dirty #2 [   21.963323] Workqueue: pseries hotplug workque pseries_hp_work_fn [   21.963355] NIP:  c000000000079e18 LR: c000000000c79308 CTR: 0000000000008000 [   21.963392] REGS: c0000003f88034f0 TRAP: 0700   Not tainted (5.1.0-dirty) [   21.963422] MSR:  800000000282b033   CR: 28002884  XER: 20040000 [   21.963470] CFAR: c000000000c79304 IRQMASK: 0 [   21.963470] GPR00: c000000000c79308 c0000003f8803780 c000000001521000 0000000000fff8c0 [   21.963470] GPR04: 0000000000000001 00000000ffe30005 0000000000000005 0000000000000020 [   21.963470] GPR08: 0000000000000000 0000000000000001 c00a000000fff8e0 c0000000016d21a0 [   21.963470] GPR12: c0000000016e7b90 c000000007ff2700 c00a000000a00000 c0000003ffe30100 [   21.963470] GPR16: c0000003ffe30000 c0000000014aa4de c00a0000009f0000 c0000000016d21b0 [   21.963470] GPR20: c0000000014de588 0000000000000001 c0000000016d21b8 c00a000000a00000 [   21.963470] GPR24: 0000000000000000 ffffffffffffffff c00a000000a00000 c0000003ffe96000 [   21.963470] GPR28: c00a000000a00000 c00a000000a00000 c0000003fffec000 c00a000000fff8c0 [   21.963802] NIP [c000000000079e18] pte_fragment_free+0x48/0xd0 [   21.963838] LR [c000000000c79308] remove_pagetable+0x49c/0x5b4 [   21.963873] Call Trace: [   21.963890] [c0000003f8803780] [c0000003ffe997f0] 0xc0000003ffe997f0 (unreliable) [   21.963933] [c0000003f88037b0] [0000000000000000] (null) [   21.963969] [c0000003f88038c0] [c00000000006f038] vmemmap_free+0x218/0x2e0 [   21.964006] [c0000003f8803940] [c00000000036f100] sparse_remove_one_section+0xd0/0x138 [   21.964050] [c0000003f8803980] [c000000000383a50] __remove_pages+0x410/0x560 [   21.964093] [c0000003f8803a90] [c000000000c784d8] arch_remove_memory+0x68/0xdc [   21.964136] [c0000003f8803ad0] [c000000000385d74] __remove_memory+0xc4/0x110 [   21.964180] [c0000003f8803b10] [c0000000000d44e4] dlpar_remove_lmb+0x94/0x140 [   21.964223] [c0000003f8803b50] [c0000000000d52b4] dlpar_memory+0x464/0xd00 [   21.964259] [c0000003f8803be0] [c0000000000cd5c0] handle_dlpar_errorlog+0xc0/0x190 [   21.964303] [c0000003f8803c50] [c0000000000cd6bc] pseries_hp_work_fn+0x2c/0x60 [   21.964346] [c0000003f8803c80] [c00000000013a4a0] process_one_work+0x2b0/0x5a0 [   21.964388] [c0000003f8803d10] [c00000000013a818] worker_thread+0x88/0x610 [   21.964434] [c0000003f8803db0] [c000000000143884] kthread+0x1a4/0x1b0 [   21.964468] [c0000003f8803e20] [c00000000000bdc4] ret_from_kernel_thread+0x5c/0x78 [   21.964506] Instruction dump: [   21.964527] fbe1fff8 f821ffd1 78638502 78633664 ebe90000 7fff1a14 395f0020 813f0020 [   21.964569] 7d2907b4 7d2900d0 79290fe0 69290001 <0b090000> 7c0004ac 7d205028 3129ffff [   21.964613] ---[ end trace aaa571aa1636fee6 ]--- [   21.966349] [   21.966383] Sending IPI to other CPUs [   21.978335] IPI complete [   21.981354] kexec: Starting switchover sequence. I'm in purgatory