Received: by 2002:a25:e7d8:0:0:0:0:0 with SMTP id e207csp738000ybh; Wed, 11 Mar 2020 09:48:39 -0700 (PDT) X-Google-Smtp-Source: ADFU+vu/B3YNX3xGX+QfFutiXinsAwNAuNE/Jn/NN5h2f6vwuL58dbTiaOGK0HjprYO5pmTn33WR X-Received: by 2002:a9d:4e16:: with SMTP id p22mr3204506otf.152.1583945319728; Wed, 11 Mar 2020 09:48:39 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1583945319; cv=none; d=google.com; s=arc-20160816; b=skOpxOE2W/QRf/Z7Qxr9d45jTCE3sBGSZkdLLtpqOXt+hFBcAoibzFKFEopvr3mHDi zTJXjMtnqXDIDuTlcHkTcwlc+xrIJZNPH+nbUvt4q7Pfzt+woWuCUyXbLx7503qFth1i DHWWeG6lUbjNpxMmsuW+ATI3LsNsjpeN74bzcFf/wPsVD3WRgZm8Lo3jxNnrn/J+YpNK a+z9+YD/vnY67kuNfjhJ1mIE1B8rHfbacBnP/IZAnqhFxCm8i4IHC99la5ccoDc04Zhx aDNV/uU34hW17fZvkAn3TFCtfKXAhGW4RuD0k6ZW0LKOr0ZYZ2xHeuZDanHbVmtT+Ri7 PfIg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:to:references:message-id :content-transfer-encoding:cc:date:in-reply-to:from:subject :mime-version:dkim-signature; bh=V9EY4KDofWkwhjUEvJPP+GUrvr5a7Sdf/5Qkn729OGw=; b=TpRV6hTaRjTacm7ro5AXzVIS7VuKMuAbGtx4hucCbTleeCDuEWvpTPFjmQo5NVUGcI 2wPWMEc1ScT/bvXYsc41wA65zC7dBZnp6ou8fGtoWkM82n8oPI8Fm9s/rW2133f0r6bQ /NIyyH92VxINQLda0H6MCLzbc/7vlVeninVdckYgf1F2jNQFWyWFubo4AkvGxDOzjXa9 5NzTKmqhYmeZXeXuWDPMQEuCbxUn88HCW3KKSxSc2ZCYeXOVDpfSEfNu+rtnqrzXHgOW 2u+1sF0vmwONcjJlfcgyoZi8MV19vz8EMFYiXLtACdRtQIIeSSJmtEpDNtkNz0srzpry uuJw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2020-01-29 header.b=bFJKyjE9; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id 48si1480507otv.320.2020.03.11.09.48.24; Wed, 11 Mar 2020 09:48:39 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2020-01-29 header.b=bFJKyjE9; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730344AbgCKQqx (ORCPT + 99 others); Wed, 11 Mar 2020 12:46:53 -0400 Received: from aserp2120.oracle.com ([141.146.126.78]:54826 "EHLO aserp2120.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1730175AbgCKQqw (ORCPT ); Wed, 11 Mar 2020 12:46:52 -0400 Received: from pps.filterd (aserp2120.oracle.com [127.0.0.1]) by aserp2120.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 02BGeUMn154538; Wed, 11 Mar 2020 16:46:35 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=content-type : mime-version : subject : from : in-reply-to : date : cc : content-transfer-encoding : message-id : references : to; s=corp-2020-01-29; bh=V9EY4KDofWkwhjUEvJPP+GUrvr5a7Sdf/5Qkn729OGw=; b=bFJKyjE9WmTRXfFpb5GsFj5ZBlyELSAdatDtJq4ZKUtAwV2/e842JvF88Sfq8NQ2jzTW RGrMVnm9quVgBek7gpZfjvEKi4alJpJ4BHGKqx/0Ft/pf1BWvrowRmmvvz3OWDgsWuAd EUeUfFHBbFtSzdoUAtGzrxOmLQbVNHIPSM2XwMVH7ibJIvQYF5qWpA3altxotZNptP6c aXRM8b9DL5hbRHS9gPG5WHmn9s8bp3/Ee9zy7Ka850d0vI+1hA+Akck8zTxEc2zt7SOx KGU8cuS05I1Hc0U5//UO1DkIkBkMGpEZY4giIvyylpX3f8CEh8JWr3VTgCS5kX0hlLPe DQ== Received: from userp3020.oracle.com (userp3020.oracle.com [156.151.31.79]) by aserp2120.oracle.com with ESMTP id 2yp9v680pd-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 11 Mar 2020 16:46:35 +0000 Received: from pps.filterd (userp3020.oracle.com [127.0.0.1]) by userp3020.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 02BGcb3C104687; Wed, 11 Mar 2020 16:46:34 GMT Received: from aserv0121.oracle.com (aserv0121.oracle.com [141.146.126.235]) by userp3020.oracle.com with ESMTP id 2ypv9vpsm6-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 11 Mar 2020 16:46:33 +0000 Received: from abhmp0011.oracle.com (abhmp0011.oracle.com [141.146.116.17]) by aserv0121.oracle.com (8.14.4/8.13.8) with ESMTP id 02BGkWjd012907; Wed, 11 Mar 2020 16:46:32 GMT Received: from [10.39.222.44] (/10.39.222.44) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Wed, 11 Mar 2020 09:46:32 -0700 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Re: [PATCH v7 2/4] arm64: kdump: reserve crashkenel above 4G for crash dump kernel From: John Donnelly In-Reply-To: Date: Wed, 11 Mar 2020 11:46:29 -0500 Cc: Chen Zhou , Ganapatrao Prabhakerrao Kulkarni , Linux Kernel Mailing List , Bhupesh Sharma , kexec mailing list Content-Transfer-Encoding: quoted-printable Message-Id: <3FAE086D-E5F8-4FF1-B2E4-8637B6CFDC4A@oracle.com> References: <20191223152349.180172-1-chenzhou10@huawei.com> <20191223152349.180172-3-chenzhou10@huawei.com> <0c00f14a-15ca-44db-7f82-00f15ddd3c88@huawei.com> <8a4e3fca-ef77-eb1b-0ec6-a158b7fe5c0c@Oracle.com> To: Prabhakar Kushwaha X-Mailer: Apple Mail (2.3445.9.1) X-Proofpoint-Virus-Version: vendor=nai engine=6000 definitions=9556 signatures=668685 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 mlxlogscore=999 spamscore=0 malwarescore=0 mlxscore=0 adultscore=0 phishscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2001150001 definitions=main-2003110100 X-Proofpoint-Virus-Version: vendor=nai engine=6000 definitions=9556 signatures=668685 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 spamscore=0 mlxscore=0 priorityscore=1501 lowpriorityscore=0 bulkscore=0 mlxlogscore=999 phishscore=0 adultscore=0 clxscore=1015 impostorscore=0 malwarescore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2001150001 definitions=main-2003110100 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi > On Mar 10, 2020, at 9:42 PM, Prabhakar Kushwaha = wrote: >=20 > Dear John, >=20 >=20 > On Tue, Mar 10, 2020 at 11:25 PM John Donnelly > wrote: >>=20 >>=20 >>=20 >>> On Mar 10, 2020, at 12:34 PM, John Donnelly = wrote: >>>=20 >>> On 3/10/20 12:04 PM, Prabhakar Kushwaha wrote: >>>> On 3/9/2020 11:53 PM, John Donnelly wrote: >>>>> On 3/9/20 10:51 AM, Prabhakar Kushwaha wrote: >>>>>> On 3/9/2020 10:18 AM, Prabhakar Kushwaha wrote: >>>>>>> Hi Chen, >>>>>>>=20 >>>>>>> On Sat, Mar 7, 2020 at 4:36 PM Chen Zhou = wrote: >>>>>>>>=20 >>>>>>>>=20 >>>>>>>>=20 >>>>>>>> On 2020/3/5 18:13, Prabhakar Kushwaha wrote: >>>>>>>>> On Mon, Dec 23, 2019 at 8:57 PM Chen Zhou = >>>>>>>>> wrote: >>>>>>>>>>=20 >>>>>>>>>> Crashkernel=3DX tries to reserve memory for the crash dump = kernel under >>>>>>>>>> 4G. If crashkernel=3DX,low is specified simultaneously, = reserve >>>>>>>>>> spcified >>>>>>>>>> size low memory for crash kdump kernel devices firstly and = then >>>>>>>>>> reserve >>>>>>>>>> memory above 4G. >>>>>>>>>>=20 >>>>>>>>>> Signed-off-by: Chen Zhou >>>>>>>>>> --- >>>>>>>>>> arch/arm64/kernel/setup.c | 8 +++++++- >>>>>>>>>> arch/arm64/mm/init.c | 31 = +++++++++++++++++++++++++++++-- >>>>>>>>>> 2 files changed, 36 insertions(+), 3 deletions(-) >>>>>>>>>>=20 >>>>>>>>>> diff --git a/arch/arm64/kernel/setup.c = b/arch/arm64/kernel/setup.c >>>>>>>>>> index 56f6645..04d1c87 100644 >>>>>>>>>> --- a/arch/arm64/kernel/setup.c >>>>>>>>>> +++ b/arch/arm64/kernel/setup.c >>>>>>>>>> @@ -238,7 +238,13 @@ static void __init >>>>>>>>>> request_standard_resources(void) >>>>>>>>>> kernel_data.end <=3D res->end) >>>>>>>>>> request_resource(res, &kernel_data); >>>>>>>>>> #ifdef CONFIG_KEXEC_CORE >>>>>>>>>> - /* Userspace will find "Crash kernel" region = in >>>>>>>>>> /proc/iomem. */ >>>>>>>>>> + /* >>>>>>>>>> + * Userspace will find "Crash kernel" region = in >>>>>>>>>> /proc/iomem. >>>>>>>>>> + * Note: the low region is renamed as Crash = kernel >>>>>>>>>> (low). >>>>>>>>>> + */ >>>>>>>>>> + if (crashk_low_res.end && = crashk_low_res.start >=3D >>>>>>>>>> res->start && >>>>>>>>>> + crashk_low_res.end <=3D = res->end) >>>>>>>>>> + request_resource(res, = &crashk_low_res); >>>>>>>>>> if (crashk_res.end && crashk_res.start >=3D >>>>>>>>>> res->start && >>>>>>>>>> crashk_res.end <=3D res->end) >>>>>>>>>> request_resource(res, &crashk_res); >>>>>>>>>> diff --git a/arch/arm64/mm/init.c b/arch/arm64/mm/init.c >>>>>>>>>> index b65dffd..0d7afd5 100644 >>>>>>>>>> --- a/arch/arm64/mm/init.c >>>>>>>>>> +++ b/arch/arm64/mm/init.c >>>>>>>>>> @@ -80,6 +80,7 @@ static void __init = reserve_crashkernel(void) >>>>>>>>>> { >>>>>>>>>> unsigned long long crash_base, crash_size; >>>>>>>>>> int ret; >>>>>>>>>> + phys_addr_t crash_max =3D arm64_dma32_phys_limit; >>>>>>>>>>=20 >>>>>>>>>> ret =3D parse_crashkernel(boot_command_line, >>>>>>>>>> memblock_phys_mem_size(), >>>>>>>>>> &crash_size, &crash_base); >>>>>>>>>> @@ -87,12 +88,38 @@ static void __init = reserve_crashkernel(void) >>>>>>>>>> if (ret || !crash_size) >>>>>>>>>> return; >>>>>>>>>>=20 >>>>>>>>>> + ret =3D reserve_crashkernel_low(); >>>>>>>>>> + if (!ret && crashk_low_res.end) { >>>>>>>>>> + /* >>>>>>>>>> + * If crashkernel=3DX,low specified, there = may be >>>>>>>>>> two regions, >>>>>>>>>> + * we need to make some changes as follows: >>>>>>>>>> + * >>>>>>>>>> + * 1. rename the low region as "Crash kernel = (low)" >>>>>>>>>> + * In order to distinct from the high region = and >>>>>>>>>> make no effect >>>>>>>>>> + * to the use of existing kexec-tools, rename = the >>>>>>>>>> low region as >>>>>>>>>> + * "Crash kernel (low)". >>>>>>>>>> + * >>>>>>>>>> + * 2. change the upper bound for crash memory >>>>>>>>>> + * Set MEMBLOCK_ALLOC_ACCESSIBLE upper bound = for >>>>>>>>>> crash memory. >>>>>>>>>> + * >>>>>>>>>> + * 3. mark the low region as "nomap" >>>>>>>>>> + * The low region is intended to be used for = crash >>>>>>>>>> dump kernel >>>>>>>>>> + * devices, just mark the low region as = "nomap" >>>>>>>>>> simply. >>>>>>>>>> + */ >>>>>>>>>> + const char *rename =3D "Crash kernel (low)"; >>>>>>>>>> + >>>>>>>>>> + crashk_low_res.name =3D rename; >>>>>>>>>> + crash_max =3D MEMBLOCK_ALLOC_ACCESSIBLE; >>>>>>>>>> + memblock_mark_nomap(crashk_low_res.start, >>>>>>>>>> + = resource_size(&crashk_low_res)); >>>>>>>>>> + } >>>>>>>>>> + >>>>>>>>>> crash_size =3D PAGE_ALIGN(crash_size); >>>>>>>>>>=20 >>>>>>>>>> if (crash_base =3D=3D 0) { >>>>>>>>>> /* Current arm64 boot protocol requires 2MB >>>>>>>>>> alignment */ >>>>>>>>>> - crash_base =3D memblock_find_in_range(0, >>>>>>>>>> arm64_dma32_phys_limit, >>>>>>>>>> - crash_size, SZ_2M); >>>>>>>>>> + crash_base =3D memblock_find_in_range(0, = crash_max, >>>>>>>>>> crash_size, >>>>>>>>>> + SZ_2M); >>>>>>>>>> if (crash_base =3D=3D 0) { >>>>>>>>>> pr_warn("cannot allocate crashkernel >>>>>>>>>> (size:0x%llx)\n", >>>>>>>>>> crash_size); >>>>>>>>>> -- >>>>>>>>>=20 >>>>>>>>> I tested this patch series on ARM64-ThunderX2 with no issue = with >>>>>>>>> bootargs crashkenel=3DX@Y crashkernel=3D250M,low >>>>>>>>>=20 >>>>>>>>> $ dmesg | grep crash >>>>>>>>> [ 0.000000] crashkernel reserved: 0x0000000b81200000 - >>>>>>>>> 0x0000000c81200000 (4096 MB) >>>>>>>>> [ 0.000000] Kernel command line: >>>>>>>>> BOOT_IMAGE=3D/boot/vmlinuz-5.6.0-rc4+ >>>>>>>>> root=3DUUID=3D866b8df3-14f4-4e11-95a1-74a90ee9b694 ro >>>>>>>>> crashkernel=3D4G@0xb81200000 crashkernel=3D250M,low nowatchdog = earlycon >>>>>>>>> [ 29.310209] crashkernel=3D250M,low >>>>>>>>>=20 >>>>>>>>> $ kexec -p -i /boot/vmlinuz-`uname -r` >>>>>>>>> --initrd=3D/boot/initrd.img-`uname -r` --reuse-cmdline >>>>>>>>> $ echo 1 > /proc/sys/kernel/sysrq ; echo c > = /proc/sysrq-trigger >>>>>>>>>=20 >>>>>>>>> But when i tried with crashkernel=3D4G crashkernel=3D250M,low = as bootargs. >>>>>>>>> Kernel is not able to allocate memory. >>>>>>>>> [ 0.000000] cannot allocate crashkernel (size:0x100000000) >>>>>>>>> [ 0.000000] Kernel command line: >>>>>>>>> BOOT_IMAGE=3D/boot/vmlinuz-5.6.0-rc4+ >>>>>>>>> root=3DUUID=3D866b8df3-14f4-4e11-95a1-74a90ee9b694 ro = crashkernel=3D4G >>>>>>>>> crashkernel=3D250M,low nowatchdog >>>>>>>>> [ 29.332081] crashkernel=3D250M,low >>>>>>>>>=20 >>>>>>>>> does crashkernel=3DX@Y mandatory to get allocated beyond 4G? >>>>>>>>> am I missing something? >>>>>>>>=20 >>>>>>>> I can't reproduce the problem in my environment, can you test = with >>>>>>>> other size, >>>>>>>> such as "crashkernel=3D1G crashkernel=3D250M,low", see if there = is the >>>>>>>> same issue. >>>>>>>>=20 >>>>>>> I tried 1G also. Same error, please find the logs >>>>>>>=20 >>>>>>> $ dmesg | grep crash >>>>>>> [ 0.000000] cannot allocate crashkernel (size:0x40000000) >>>>>>> [ 0.000000] Kernel command line: >>>>>>> BOOT_IMAGE=3D/boot/vmlinuz-5.6.0-rc4+ >>>>>>> root=3DUUID=3D866b8df3-14f4-4e11-95a1-74a90ee9b694 ro nowatchdog = earlycon >>>>>>> crashkernel=3D1G crashkernel=3D250M,low >>>>>>> [ 29.326916] crashkernel=3D250M,low >>>>>>>=20 >>>>>>>=20 >>>>>>>> Besides, crashkernel=3DX@Y isn't mandatory to get allocated = beyond 4G, >>>>>>>=20 >>>>>>> this was my understanding also. >>>>>>>=20 >>>>>>>> can you show the whole file /proc/iomem. >>>>>>>>=20 >>>>>>>=20 >>>>>>> $ cat /proc/iomem >>>>>>> 00000000-00000000 : PCI ECAM >>>>>>> 00000000-00000000 : PCI ECAM >>>>>>> 00000000-00000000 : PCI Bus 0000:00 >>>>>>> 00000000-00000000 : PCI Bus 0000:0f >>>>>>> 00000000-00000000 : PCI Bus 0000:10 >>>>>>> 00000000-00000000 : 0000:10:00.0 >>>>>>> 00000000-00000000 : 0000:10:00.0 >>>>>>> 00000000-00000000 : PCI Bus 0000:01 >>>>>>> 00000000-00000000 : 0000:01:00.0 >>>>>>> 00000000-00000000 : 0000:01:00.1 >>>>>>> 00000000-00000000 : PCI Bus 0000:05 >>>>>>> 00000000-00000000 : 0000:05:00.0 >>>>>>> 00000000-00000000 : 0000:05:00.1 >>>>>>> 00000000-00000000 : PCI Bus 0000:09 >>>>>>> 00000000-00000000 : 0000:09:00.0 >>>>>>> 00000000-00000000 : 0000:09:00.1 >>>>>>> 00000000-00000000 : 0000:00:10.0 >>>>>>> 00000000-00000000 : ahci >>>>>>> 00000000-00000000 : 0000:00:10.1 >>>>>>> 00000000-00000000 : ahci >>>>>>> 00000000-00000000 : PCI Bus 0000:80 >>>>>>> 00000000-00000000 : PCI Bus 0000:83 >>>>>>> 00000000-00000000 : 0000:83:00.0 >>>>>>> 00000000-00000000 : 0000:83:00.0 >>>>>>> 00000000-00000000 : nvme >>>>>>> 00000000-00000000 : PCI Bus 0000:89 >>>>>>> 00000000-00000000 : 0000:89:00.0 >>>>>>> 00000000-00000000 : e1000e >>>>>>> 00000000-00000000 : 0000:89:00.0 >>>>>>> 00000000-00000000 : 0000:89:00.0 >>>>>>> 00000000-00000000 : e1000e >>>>>>> 00000000-00000000 : 0000:89:00.0 >>>>>>> 00000000-00000000 : e1000e >>>>>>> 00000000-00000000 : PCI Bus 0000:8d >>>>>>> 00000000-00000000 : 0000:8d:00.0 >>>>>>> 00000000-00000000 : 0000:8d:00.0 >>>>>>> 00000000-00000000 : mpt3sas >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : System RAM >>>>>>> 00000000-00000000 : Kernel code >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : Kernel data >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : System RAM >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : System RAM >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : System RAM >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : System RAM >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : System RAM >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : System RAM >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : CAV901C:00 >>>>>>> 00000000-00000000 : CAV901D:00 >>>>>>> 00000000-00000000 : CAV901C:00 >>>>>>> 00000000-00000000 : CAV901E:00 >>>>>>> 00000000-00000000 : CAV901C:00 >>>>>>> 00000000-00000000 : CAV901F:00 >>>>>>> 00000000-00000000 : CAV901C:00 >>>>>>> 00000000-00000000 : CAV9006:00 >>>>>>> 00000000-00000000 : CAV9006:00 >>>>>>> 00000000-00000000 : ARMH0011:00 >>>>>>> 00000000-00000000 : ARMH0011:00 >>>>>>> 00000000-00000000 : arm-smmu-v3.0.auto >>>>>>> 00000000-00000000 : arm-smmu-v3.0.auto >>>>>>> 00000000-00000000 : arm-smmu-v3.1.auto >>>>>>> 00000000-00000000 : arm-smmu-v3.1.auto >>>>>>> 00000000-00000000 : arm-smmu-v3.2.auto >>>>>>> 00000000-00000000 : arm-smmu-v3.2.auto >>>>>>> 00000000-00000000 : CAV901C:01 >>>>>>> 00000000-00000000 : CAV901D:01 >>>>>>> 00000000-00000000 : CAV901C:01 >>>>>>> 00000000-00000000 : CAV901E:01 >>>>>>> 00000000-00000000 : CAV901C:01 >>>>>>> 00000000-00000000 : CAV901F:01 >>>>>>> 00000000-00000000 : CAV901C:01 >>>>>>> 00000000-00000000 : CAV9007:06 >>>>>>> 00000000-00000000 : CAV9007:06 >>>>>>> 00000000-00000000 : arm-smmu-v3.3.auto >>>>>>> 00000000-00000000 : arm-smmu-v3.3.auto >>>>>>> 00000000-00000000 : arm-smmu-v3.4.auto >>>>>>> 00000000-00000000 : arm-smmu-v3.4.auto >>>>>>> 00000000-00000000 : arm-smmu-v3.5.auto >>>>>>> 00000000-00000000 : arm-smmu-v3.5.auto >>>>>>> 00000000-00000000 : System RAM >>>>>>> 00000000-00000000 : System RAM >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : System RAM >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : reserved >>>>>>> 00000000-00000000 : PCI Bus 0000:00 >>>>>>> 00000000-00000000 : PCI Bus 0000:01 >>>>>>> 00000000-00000000 : 0000:01:00.0 >>>>>>> 00000000-00000000 : 0000:01:00.1 >>>>>>> 00000000-00000000 : 0000:01:00.0 >>>>>>> 00000000-00000000 : 0000:01:00.1 >>>>>>> 00000000-00000000 : 0000:01:00.0 >>>>>>> 00000000-00000000 : 0000:01:00.1 >>>>>>> 00000000-00000000 : PCI Bus 0000:05 >>>>>>> 00000000-00000000 : 0000:05:00.0 >>>>>>> 00000000-00000000 : bnx2x >>>>>>> 00000000-00000000 : 0000:05:00.1 >>>>>>> 00000000-00000000 : bnx2x >>>>>>> 00000000-00000000 : 0000:05:00.0 >>>>>>> 00000000-00000000 : bnx2x >>>>>>> 00000000-00000000 : 0000:05:00.0 >>>>>>> 00000000-00000000 : bnx2x >>>>>>> 00000000-00000000 : 0000:05:00.1 >>>>>>> 00000000-00000000 : bnx2x >>>>>>> 00000000-00000000 : 0000:05:00.1 >>>>>>> 00000000-00000000 : bnx2x >>>>>>> 00000000-00000000 : PCI Bus 0000:09 >>>>>>> 00000000-00000000 : 0000:09:00.0 >>>>>>> 00000000-00000000 : i40e >>>>>>> 00000000-00000000 : 0000:09:00.1 >>>>>>> 00000000-00000000 : i40e >>>>>>> 00000000-00000000 : 0000:09:00.0 >>>>>>> 00000000-00000000 : 0000:09:00.1 >>>>>>> 00000000-00000000 : 0000:09:00.0 >>>>>>> 00000000-00000000 : i40e >>>>>>> 00000000-00000000 : 0000:09:00.1 >>>>>>> 00000000-00000000 : i40e >>>>>>> 00000000-00000000 : 0000:09:00.0 >>>>>>> 00000000-00000000 : 0000:09:00.1 >>>>>>> 00000000-00000000 : 0000:00:0f.0 >>>>>>> 00000000-00000000 : xhci-hcd >>>>>>> 00000000-00000000 : 0000:00:0f.0 >>>>>>> 00000000-00000000 : 0000:00:0f.1 >>>>>>> 00000000-00000000 : xhci-hcd >>>>>>> 00000000-00000000 : 0000:00:0f.1 >>>>>>> 00000000-00000000 : 0000:00:10.0 >>>>>>> 00000000-00000000 : ahci >>>>>>> 00000000-00000000 : 0000:00:10.1 >>>>>>> 00000000-00000000 : ahci >>>>>>> 00000000-00000000 : PCI Bus 0000:80 >>>>>>>=20 >>>>>>=20 >>>>>> resending with correct logs (after login as root) >>>>>>=20 >>>>>> $ cat /proc/iomem >>>>>> 30000000-37ffffff : PCI ECAM >>>>>> 38000000-3fffffff : PCI ECAM >>>>>> 40000000-5fffffff : PCI Bus 0000:00 >>>>>> 40000000-417fffff : PCI Bus 0000:0f >>>>>> 40000000-417fffff : PCI Bus 0000:10 >>>>>> 40000000-40ffffff : 0000:10:00.0 >>>>>> 41000000-4101ffff : 0000:10:00.0 >>>>>> 41800000-418fffff : PCI Bus 0000:01 >>>>>> 41800000-4183ffff : 0000:01:00.0 >>>>>> 41840000-4187ffff : 0000:01:00.1 >>>>>> 41900000-419fffff : PCI Bus 0000:05 >>>>>> 41900000-4197ffff : 0000:05:00.0 >>>>>> 41980000-419fffff : 0000:05:00.1 >>>>>> 41a00000-41afffff : PCI Bus 0000:09 >>>>>> 41a00000-41a7ffff : 0000:09:00.0 >>>>>> 41a80000-41afffff : 0000:09:00.1 >>>>>> 41b00000-41b0ffff : 0000:00:10.0 >>>>>> 41b00000-41b0ffff : ahci >>>>>> 41b10000-41b1ffff : 0000:00:10.1 >>>>>> 41b10000-41b1ffff : ahci >>>>>> 60000000-7fffffff : PCI Bus 0000:80 >>>>>> 60000000-600fffff : PCI Bus 0000:83 >>>>>> 60000000-6001ffff : 0000:83:00.0 >>>>>> 60020000-60023fff : 0000:83:00.0 >>>>>> 60020000-60023fff : nvme >>>>>> 60100000-601fffff : PCI Bus 0000:89 >>>>>> 60100000-6017ffff : 0000:89:00.0 >>>>>> 60100000-6017ffff : e1000e >>>>>> 60180000-601bffff : 0000:89:00.0 >>>>>> 601c0000-601dffff : 0000:89:00.0 >>>>>> 601c0000-601dffff : e1000e >>>>>> 601e0000-601e3fff : 0000:89:00.0 >>>>>> 601e0000-601e3fff : e1000e >>>>>> 60200000-603fffff : PCI Bus 0000:8d >>>>>> 60200000-602fffff : 0000:8d:00.0 >>>>>> 60300000-6030ffff : 0000:8d:00.0 >>>>>> 60300000-6030ffff : mpt3sas >>>>>> 802f0000-8030ffff : reserved >>>>>> e6247000-e6247fff : reserved >>>>>> e6720000-e690ffff : reserved >>>>>> e6a90000-e6a9ffff : reserved >>>>>> e6ab0000-e721ffff : reserved >>>>>> e7240000-e7240fff : reserved >>>>>> fac00000-fafdffff : reserved >>>>>> 400040400-40004041f : CAV901C:00 >>>>>> 400040480-400040567 : CAV901D:00 >>>>>> 400040480-400040567 : CAV901C:00 >>>>>> 400040600-40004073b : CAV901E:00 >>>>>> 400040600-40004073b : CAV901C:00 >>>>>> 400041400-40004177f : CAV901F:00 >>>>>> 400041400-40004177f : CAV901C:00 >>>>>> 402000100-402000fff : CAV9006:00 >>>>>> 402000100-402000fff : CAV9006:00 >>>>>> 402020000-40202ffff : ARMH0011:00 >>>>>> 402020000-40202ffff : ARMH0011:00 >>>>>> 402300000-40230ffff : arm-smmu-v3.0.auto >>>>>> 402300000-40230ffff : arm-smmu-v3.0.auto >>>>>> 402320000-40232ffff : arm-smmu-v3.1.auto >>>>>> 402320000-40232ffff : arm-smmu-v3.1.auto >>>>>> 402340000-40234ffff : arm-smmu-v3.2.auto >>>>>> 402340000-40234ffff : arm-smmu-v3.2.auto >>>>>> 440040400-44004041f : CAV901C:01 >>>>>> 440040480-440040567 : CAV901D:01 >>>>>> 440040480-440040567 : CAV901C:01 >>>>>> 440040600-44004073b : CAV901E:01 >>>>>> 440040600-44004073b : CAV901C:01 >>>>>> 440041400-44004177f : CAV901F:01 >>>>>> 440041400-44004177f : CAV901C:01 >>>>>> 4421a0000-4421affff : CAV9007:06 >>>>>> 4421a0000-4421affff : CAV9007:06 >>>>>> 442300000-44230ffff : arm-smmu-v3.3.auto >>>>>> 442300000-44230ffff : arm-smmu-v3.3.auto >>>>>> 442320000-44232ffff : arm-smmu-v3.4.auto >>>>>> 442320000-44232ffff : arm-smmu-v3.4.auto >>>>>> 442340000-44234ffff : arm-smmu-v3.5.auto >>>>>> 442340000-44234ffff : arm-smmu-v3.5.auto >>>>>> b81200000-c811fffff : System RAM >>>>>> b81280000-b8270ffff : Kernel code >>>>>> b82710000-b82dfffff : reserved >>>>>> b82e00000-b83168fff : Kernel data >>>>>> b83169000-baccd7fff : reserved >>>>>> c78a00000-c7fffffff : reserved >>>>>> c80129000-c801a9fff : reserved >>>>>> c801aa000-c809e9fff : reserved >>>>>> c809ec000-c809eefff : reserved >>>>>> c809ef000-c811fffff : reserved >>>>>> 10000000000-13fffffffff : PCI Bus 0000:00 >>>>>> 10000000000-100013fffff : PCI Bus 0000:01 >>>>>> 10000000000-100007fffff : 0000:01:00.0 >>>>>> 10000800000-10000ffffff : 0000:01:00.1 >>>>>> 10001000000-1000101ffff : 0000:01:00.0 >>>>>> 10001020000-1000103ffff : 0000:01:00.1 >>>>>> 10001040000-1000104ffff : 0000:01:00.0 >>>>>> 10001050000-1000105ffff : 0000:01:00.1 >>>>>> 10001400000-100037fffff : PCI Bus 0000:05 >>>>>> 10001400000-1000140ffff : 0000:05:00.0 >>>>>> 10001400000-1000140ffff : bnx2x >>>>>> 10001410000-1000141ffff : 0000:05:00.1 >>>>>> 10001410000-1000141ffff : bnx2x >>>>>> 10001800000-10001ffffff : 0000:05:00.0 >>>>>> 10001800000-10001ffffff : bnx2x >>>>>> 10002000000-100027fffff : 0000:05:00.0 >>>>>> 10002000000-100027fffff : bnx2x >>>>>> 10002800000-10002ffffff : 0000:05:00.1 >>>>>> 10002800000-10002ffffff : bnx2x >>>>>> 10003000000-100037fffff : 0000:05:00.1 >>>>>> 10003000000-100037fffff : bnx2x >>>>>> 10003800000-100053fffff : PCI Bus 0000:09 >>>>>> 10003800000-10003ffffff : 0000:09:00.0 >>>>>> 10003800000-10003ffffff : i40e >>>>>> 10004000000-100047fffff : 0000:09:00.1 >>>>>> 10004000000-100047fffff : i40e >>>>>> 10004800000-10004bfffff : 0000:09:00.0 >>>>>> 10004c00000-10004ffffff : 0000:09:00.1 >>>>>> 10005000000-10005007fff : 0000:09:00.0 >>>>>> 10005000000-10005007fff : i40e >>>>>> 10005008000-1000500ffff : 0000:09:00.1 >>>>>> 10005008000-1000500ffff : i40e >>>>>> 10005010000-1000510ffff : 0000:09:00.0 >>>>>> 10005110000-1000520ffff : 0000:09:00.1 >>>>>> 10005400000-1000540ffff : 0000:00:0f.0 >>>>>> 10005400000-1000540ffff : xhci-hcd >>>>>> 10005410000-1000541ffff : 0000:00:0f.0 >>>>>> 10005420000-1000542ffff : 0000:00:0f.1 >>>>>> 10005420000-1000542ffff : xhci-hcd >>>>>> 10005430000-1000543ffff : 0000:00:0f.1 >>>>>> 10005440000-1000544ffff : 0000:00:10.0 >>>>>> 10005440000-1000544ffff : ahci >>>>>> 10005450000-1000545ffff : 0000:00:10.1 >>>>>> 10005450000-1000545ffff : ahci >>>>>> 14000000000-17fffffffff : PCI Bus 0000:80 >>>>>>=20 >>>>>>=20 >>>>>> failure with crashkernel=3D1G >>>>>>=20 >>>>>> :~$ dmesg | grep crash >>>>>> [ 0.000000] cannot allocate crashkernel (size:0x40000000) >>>>>> [ 0.000000] Kernel command line: = BOOT_IMAGE=3D/boot/vmlinuz-5.6.0-rc4+ >>>>>> root=3DUUID=3D866b8df3-14f4-4e11-95a1-74a90ee9b694 ro nowatchdog = earlycon >>>>>> crashkernel=3D1G crashkernel=3D250M,low >>>>>> [ 29.326916] crashkernel=3D250M,low >>>>>=20 >>>>> Hi, >>>>>=20 >>>>> My mistake . I thought you were trying to allocate crashkernel = AT 4G. >>>>>=20 >>>>> That would be : >>>>>=20 >>>>> crashkernel=3D1024M@4G >>>>>=20 >>>>>=20 >>>>> But you are also allocating an additional 250M low too ? >>>>>=20 >>>>> In your example >>>>>=20 >>>>> crashkernel=3D1G - that is asking for 1024M in low memory. >>>>>=20 >>>>> That likely won't work - from your own memory map there is no = free >>>>> segment that size : >>>>>=20 >>>>>> 802f0000-8030ffff : reserved >>>>>> e6247000-e6247fff : reserved >>>>>> e6720000-e690ffff : reserved >>>>>> e6a90000-e6a9ffff : reserved >>>>>> e6ab0000-e721ffff : reserved >>>>>> e7240000-e7240fff : reserved >>>>>> fac00000-fafdffff : reserved >>>>>=20 >>>>> The maximum size I've been able to use is 800M in the low 4GB = range >>>>> using a 5.4.17 kernel. >>>>>=20 >>>> I am confused. I was following "[PATCH v7 4/4] kdump: update >>>> Documentation about crashkernel on arm64" >>>> + On arm64, use "crashkernel=3DY[@X]". Note that the start = address of >>>> the kernel, X if explicitly specified, must be aligned to 2MiB >>>> (0x200000). >>>> + If crashkernel=3DZ,low is specified simultaneously, reserve = spcified size >>>> + low memory for crash kdump kernel devices firstly and then = reserve >>>> memory >>>> + above 4G. >>>> here is my understanding, if i pass crashkernel=3D1G = crashkernel=3D250M,low >>>> in bootargs. >>>> - Linux will allocate first 250M in low memory (< 4G mem range) >>>> - Than rest 850M will be allocate from above 4G memory. >>>> So, parameters passed by me is correct and memory should be = allocated. >>>> please help me if my understanding is wrong. >>>> --pk >>>=20 >>> Hi >>>=20 >>> Have you built a 5.5 kernel with these v4 patches applied ? >>>=20 >>> These changes are not in a release yet. >>>=20 >>=20 >>=20 >> I meant with v7 patches ;-). You also need a corresponding kexec = CLI with fixes in it . >>=20 >=20 > Yes, I have applied v7 patches to 5.6-rc4. > After using kexec-tools() patches[1] on kexec-tools 2.0.20.git, It is > working now. Logs are below. Thanks!! >=20 >=20 > $ dmesg | grep crash > [ 0.000000] Reserving 500MB of low memory at 3182MB for crashkernel > (System low RAM: 2029MB) > [ 0.000000] crashkernel reserved: 0x000000be98c00000 - > 0x000000bf98c00000 (4096 MB) > [ 0.000000] Kernel command line: = BOOT_IMAGE=3D/boot/vmlinuz-5.6.0-rc4+ > root=3DUUID=3D866b8df3-14f4-4e11-95a1-74a90ee9b694 ro crashkernel=3D4G > crashkernel=3D500M,low nowatchdog earlycon module_blacklist=3Dqed,qede > [ 29.322393] crashkernel=3D500M,low >=20 >=20 When you set crashkernel=3D4G , it automatically picked a range above = 4GB ?=20 I was under the impression it attempts to use < 4GB . > Tested-by: Prabhakar Kushwaha >=20 > you asked about built kernel version.. is this patch-set not valid for > previous kernel version like 5.4.18. >=20 >=20 > --pk >=20 > [1] = https://urldefense.com/v3/__http://lists.infradead.org/pipermail/kexec/201= 9-August/023569.html__;!!GqivPVa7Brio!PIxiVWMSpcXDRnKwjE182qTrYb27B4lLL-f6= hMvBL3ybcYF8KJ6C_73vETbA88m63CcU$=20 >=20 > _______________________________________________ > kexec mailing list > kexec@lists.infradead.org > = https://urldefense.com/v3/__http://lists.infradead.org/mailman/listinfo/ke= xec__;!!GqivPVa7Brio!PIxiVWMSpcXDRnKwjE182qTrYb27B4lLL-f6hMvBL3ybcYF8KJ6C_= 73vETbA83h74nFT$