Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67;
IronPort-SDR: Z4E2GuT5R7DOkREu5TNXGE0CEejSWa4Xmh/VcGw/DWRIOYlrNVA8rugqFfhxfDsGG1Z5s8SjZK
 0uAtFbN7OjqpHa1dUPwpIaRFeigEsGSi0bR4SzGEFBLJApjeOJCpRxMSoQOwXAZ4C2VRSS1KFB
 97xfY4K1XQBukiua8jJ+pBv1LY58w60oIKm6Gg2CQ3j6oD2YE1OwcrtTIoyAzzEwaaA6sU0PRz
 fCDiXqGRQpPlrXM2CtSJ5rjalgy/fsEKJB3VXfKsLZW89wIxw86BkwbV+M+cNjQVjQ9MkIDKdd
 2GI=
From:   "d.hatayama@fujitsu.com" <d.hatayama@fujitsu.com>
To:     'Masayoshi Mizuma' <msys.mizuma@gmail.com>,
        Ard Biesheuvel <ard.biesheuvel@linaro.org>,
        "linux-arm-kernel@lists.infradead.org" 
        <linux-arm-kernel@lists.infradead.org>,
        "linux-efi@vger.kernel.org" <linux-efi@vger.kernel.org>
CC:     "m.mizuma@jp.fujitsu.com" <m.mizuma@jp.fujitsu.com>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        "kexec@lists.infradead.org" <kexec@lists.infradead.org>
Subject: RE: [RFC PATCH] efi: arm64: Introduce /sys/firmware/efi/memreserve to
 tell the persistent pages
Thread-Topic: [RFC PATCH] efi: arm64: Introduce /sys/firmware/efi/memreserve
 to tell the persistent pages
Thread-Index: AQHVmXnc+H1L3uC5sEGo7W/YjoCzWqeIuDNQ
Date:   Wed, 13 Nov 2019 07:59:04 +0000
Message-ID: <OSBPR01MB4006D6F586695E2B867C95F095760@OSBPR01MB4006.jpnprd01.prod.outlook.com>
References: <20191112165303.24270-1-msys.mizuma@gmail.com>
In-Reply-To: <20191112165303.24270-1-msys.mizuma@gmail.com>
Accept-Language: ja-JP, en-US
Content-Language: ja-JP
Content-Type: text/plain; charset="iso-2022-jp"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: ec8e323a-36f0-459c-d136-08d7680f5a9f
X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Nov 2019 07:59:04.8916
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: a19f121d-81e1-4858-a9d8-736e267fd4c7
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: sU2NlG6rU4qzWbbzUyEoQCquxDzaTcpGR8o2bsArBaMzEHk/I9CgOZnbt3HCQPKXvgC1w7LWGSCUoNwIxqcEjrD87XjD/e/hc0nX6LHi3Wk=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: OSBPR01MB2135
Sender: linux-kernel-owner@vger.kernel.org
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org


> -----Original Message-----
> From: linux-kernel-owner@vger.kernel.org
> [mailto:linux-kernel-owner@vger.kernel.org] On Behalf Of Masayoshi Mizuma
> Sent: Wednesday, November 13, 2019 1:53 AM
> To: Ard Biesheuvel <ard.biesheuvel@linaro.org>;
> linux-arm-kernel@lists.infradead.org; linux-efi@vger.kernel.org
> Cc: Masayoshi Mizuma <msys.mizuma@gmail.com>; Mizuma, Masayoshi/=1B$B?e4V=
=1B(B =1B$BM}?N=1B(B
> <m.mizuma@jp.fujitsu.com>; linux-kernel@vger.kernel.org;
> kexec@lists.infradead.org
> Subject: [RFC PATCH] efi: arm64: Introduce /sys/firmware/efi/memreserve t=
o
> tell the persistent pages
>=20
> From: Masayoshi Mizuma <m.mizuma@jp.fujitsu.com>
>=20
> kexec reboot stucks because efi_config_parse_tables() refers garbage
>  (with memblock=3Ddebug):
>=20
>   efi:  ACPI 2.0=3D0x9821790014  PROP=3D0x8757f5c0  SMBIOS 3.0=3D0x982074=
0000
> MEMRESERVE=3D0x9820bfdc58
>   memblock_reserve: [0x0000009820bfdc58-0x0000009820bfdc67]
> efi_config_parse_tables+0x228/0x278
>   memblock_reserve: [0x0000000082760000-0x00000000324d07ff]
> efi_config_parse_tables+0x228/0x278
>   memblock_reserve: [0xcc4f84ecc0511670-0x5f6e5214a7fd91f9]
> efi_config_parse_tables+0x244/0x278
>   memblock_reserve: [0xd2fd4144b9af693d-0xad0c1db1086f40a2]
> efi_config_parse_tables+0x244/0x278
>   memblock_reserve: [0x0c719bb159b1fadc-0x5aa6e62a1417ce12]
> efi_config_parse_tables+0x244/0x278
>   ...
>=20
> That happens because 0x82760000, struct linux_efi_memreserve, is destroye=
d.
> 0x82760000 is pointed from efi.mem_reseve, and efi.mem_reserve points the
> head page of pending table and prop table which are allocated by
> gic_reserve_range().
>=20
> The destroyer is kexec. kexec locates the inird to the area:
>=20
> # kexec -d -l /boot/vmlinuz-5.4.0-rc7 /boot/initramfs-5.4.0-rc7.img
> --reuse-cmdline
> ...
> initrd: base 82290000, size 388dd8ah (59301258)
> ...
>=20
> From dynamic debug log:
>   machine_kexec_prepare:70:
>     kexec kimage info:
>       type:        0
>       start:       85b30680
>       head:        0
>       nr_segments: 4
>         segment[0]: 0000000080480000 - 0000000082290000, 0x1e10000 bytes,=
 481
> pages
>         segment[1]: 0000000082290000 - 0000000085b20000, 0x3890000 bytes,=
 905
> pages
>         segment[2]: 0000000085b20000 - 0000000085b30000, 0x10000 bytes, 1
> pages
>         segment[3]: 0000000085b30000 - 0000000085b40000, 0x10000 bytes, 1
> pages
>=20
> kexec searches the appropriate memory region to locate initrd through "Sy=
stem
> RAM"
> in /proc/iomem. The pending tables are included in "System RAM" because t=
hey
> are
> allocated by alloc_pages(), so kexec destroys the pending tables.
>=20
> Introduce /sys/firmware/efi/memreserve to tell the pages pointed by
> efi.mem_reserve
> so that kexec can avoid the area to locate initrd.
>=20
> Signed-off-by: Masayoshi Mizuma <m.mizuma@jp.fujitsu.com>
> ---
>  drivers/firmware/efi/efi.c | 32 +++++++++++++++++++++++++++++++-
>  1 file changed, 31 insertions(+), 1 deletion(-)
>=20
> diff --git a/drivers/firmware/efi/efi.c b/drivers/firmware/efi/efi.c
> index e98bbf8e5..67b21ae7a 100644
> --- a/drivers/firmware/efi/efi.c
> +++ b/drivers/firmware/efi/efi.c
> @@ -141,6 +141,36 @@ static ssize_t systab_show(struct kobject *kobj,
>=20
>  static struct kobj_attribute efi_attr_systab =3D __ATTR_RO_MODE(systab, =
0400);
>=20
> +static struct linux_efi_memreserve *efi_memreserve_root __ro_after_init;
> +static ssize_t memreserve_show(struct kobject *kobj,
> +			   struct kobj_attribute *attr, char *buf)
> +{
> +	struct linux_efi_memreserve *rsv;
> +	unsigned long prsv;
> +	char *str =3D buf;
> +	int index, i;
> +
> +	if (!kobj || !buf)
> +		return -EINVAL;
> +
> +	if (!efi_memreserve_root)
> +		return -ENODEV;

Other functions use different conditions.
The latter efi_memreserve_root =3D=3D (void *)ULONG_MAX is correct?

static int __init efi_memreserve_map_root(void)
{
        if (efi.mem_reserve =3D=3D EFI_INVALID_TABLE_ADDR)
                return -ENODEV;

int __ref efi_mem_reserve_persistent(phys_addr_t addr, u64 size)
{
        struct linux_efi_memreserve *rsv;
        unsigned long prsv;
        int rc, index;

        if (efi_memreserve_root =3D=3D (void *)ULONG_MAX)
                return -ENODEV;

> +
> +	for (prsv =3D efi_memreserve_root->next; prsv; prsv =3D rsv->next) {
> +		rsv =3D memremap(prsv, sizeof(*rsv), MEMREMAP_WB);

memremap() could fail with NULL as a return value.
You need to deal with such case.

It looks to me efi_mem_reserve_persistent() also doesn't deal with this.
Maybe you should fix this, too.

> +		index =3D atomic_read(&rsv->count);
> +		for (i =3D 0; i < index; i++)
> +			str +=3D sprintf(str, "%llx-%llx\n",
> +				rsv->entry[i].base,
> +				rsv->entry[i].base + rsv->entry[i].size -
> 1);

Is memreserve supported on 32-bit system?
If so, phy_addr_t could have a type of 4-byte length in such system
(not so if with PAE) and then %llx could lead to inconsistent type error.
It's enough to add a cast to unsigned long long.

> +		memunmap(rsv);
> +	}
> +
> +	return str - buf;
> +}
> +
> +static struct kobj_attribute efi_attr_memreserve =3D
> __ATTR_RO_MODE(memreserve, 0444);
> +
>  #define EFI_FIELD(var) efi.var
>=20
>  #define EFI_ATTR_SHOW(name) \
> @@ -172,6 +202,7 @@ static struct attribute *efi_subsys_attrs[] =3D {
>  	&efi_attr_runtime.attr,
>  	&efi_attr_config_table.attr,
>  	&efi_attr_fw_platform_size.attr,
> +	&efi_attr_memreserve.attr,
>  	NULL,
>  };
>=20
> @@ -955,7 +986,6 @@ int efi_status_to_err(efi_status_t status)
>  }
>=20
>  static DEFINE_SPINLOCK(efi_mem_reserve_persistent_lock);
> -static struct linux_efi_memreserve *efi_memreserve_root __ro_after_init;
>=20
>  static int __init efi_memreserve_map_root(void)
>  {
> --
> 2.18.1