Received: by 2002:a05:6a10:f3d0:0:0:0:0 with SMTP id a16csp191166pxv; Wed, 7 Jul 2021 23:57:16 -0700 (PDT) X-Google-Smtp-Source: ABdhPJz7+9niO/86kV+FTOg4mdcxkxwv7KgywvoudYHbpz7bT6oEK3I6DtxRO7CQy/pDM8oFxSqP X-Received: by 2002:a05:6e02:80a:: with SMTP id u10mr20713220ilm.298.1625727436615; Wed, 07 Jul 2021 23:57:16 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1625727436; cv=none; d=google.com; s=arc-20160816; b=IPVmuLOSBkFgIvAh9EzwIsbNjkuPbicDOIfuYrZZUH13vnHJtL8g9OEATaWq4w+Hn1 4TDtgcIlnkkCqE8ObtbR26PVLvUJ1ZzHWFKXHON+/E2YMlbtJDtYhhdbS6FQiQrqi46B S/17KWMndfLj1N82bt5iZcZGtUiee3i7geT21I1UmXfIFxsxr6gHT7na69k85qx6daq9 dYfI2YGW6m2nUvJPLC35i1GX/BMQsi0944It5GWlSmX0qXWLE7qM85GQG3mMFwYmx0gq fbB2Ny+7qyz+DRgm7I92Vs+nnOGEHn6jcbOfcLOJ+UfyMjhxdCJyks6o6I1Oq5w/1vqW W8fg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject:dkim-signature; bh=pzpJd3wum4aNU6Y2GxC23OoRKpVJ36kzq4QF+hF+b2M=; b=gpl1jiF0Otvwk8b2mlYnteDGeDkF3MdHKOHLvr34QunY2DqyUNBEp5MWBBDc1LZ7iv 2Xo98sBgkj+mSL3TvlDowB1UvRCl+5U6ISGvXoWh/ZYWqP81PemEW4oCqBfgNcMw/TT1 H5DdaIB1VtphmlUE2USB04ggZ4mGKHObt3Oe2WGl903FUSeOYgDVEm1wrBRFAVPs2f5x FKOQ3frsJe85I9fTyi95YPanHWFA+kI6gpm9F+CbdFVvhaG8QQ6tVxL6lsUWsMi098+O dDFddzk5rxY9xp/Z3ERQo/e42VC7+iDGJrxcPkMlG0eOnWULzbWuugL+CZUzH7xryN45 iPXg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@suse.com header.s=susede1 header.b=ZnxekhEJ; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=NONE dis=NONE) header.from=suse.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id l22si1428488jaj.38.2021.07.07.23.57.04; Wed, 07 Jul 2021 23:57:16 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@suse.com header.s=susede1 header.b=ZnxekhEJ; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=NONE dis=NONE) header.from=suse.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229815AbhGHG6p (ORCPT + 99 others); Thu, 8 Jul 2021 02:58:45 -0400 Received: from smtp-out1.suse.de ([195.135.220.28]:34738 "EHLO smtp-out1.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229735AbhGHG6n (ORCPT ); Thu, 8 Jul 2021 02:58:43 -0400 Received: from imap1.suse-dmz.suse.de (imap1.suse-dmz.suse.de [192.168.254.73]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by smtp-out1.suse.de (Postfix) with ESMTPS id 6D88B21F87; Thu, 8 Jul 2021 06:56:01 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1625727361; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=pzpJd3wum4aNU6Y2GxC23OoRKpVJ36kzq4QF+hF+b2M=; b=ZnxekhEJ4KE96uKTKCiRKpRw0ZWRYRbFPM3Vcn/Euf6ob40iij//2fXiJFRR2EvBGg6akw /4xynNwA2HJN86WzVtgNEMXngDgYgzhxHl0JqMgxMxY6MSC4X5EEXJyEeFhK8rcYhtWPdv 8R3OZwYxVmImQ+xAD0pDDi8YNt8n4vA= Received: from imap1.suse-dmz.suse.de (imap1.suse-dmz.suse.de [192.168.254.73]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by imap1.suse-dmz.suse.de (Postfix) with ESMTPS id 28E9613743; Thu, 8 Jul 2021 06:56:01 +0000 (UTC) Received: from dovecot-director2.suse.de ([192.168.254.65]) by imap1.suse-dmz.suse.de with ESMTPSA id V5kKCIGh5mDDEAAAGKfGzw (envelope-from ); Thu, 08 Jul 2021 06:56:01 +0000 Subject: Re: [PATCH 4/8] xen/blkfront: don't trust the backend response data blindly To: Jan Beulich Cc: Konrad Rzeszutek Wilk , =?UTF-8?Q?Roger_Pau_Monn=c3=a9?= , Boris Ostrovsky , Stefano Stabellini , Jens Axboe , xen-devel@lists.xenproject.org, linux-block@vger.kernel.org, linux-kernel@vger.kernel.org References: <20210513100302.22027-1-jgross@suse.com> <20210513100302.22027-5-jgross@suse.com> <315ad8b9-8a98-8d3e-f66c-ab32af2731a8@suse.com> <6095c4b9-a9bb-8a38-fb6c-a5483105b802@suse.com> <030ef85e-b5af-f46e-c8dc-88b8d195c4e1@suse.com> <477f01cd-8793-705c-10f9-cf0c0cd6ed84@suse.com> <5a9dcc69-385a-eda5-6974-cb962ae62601@suse.com> <7f606c27-173a-542d-406d-196dae784edd@suse.com> From: Juergen Gross Message-ID: <0fec3ba6-266d-260e-716a-ae33d7670d34@suse.com> Date: Thu, 8 Jul 2021 08:56:00 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="iZDWzuLK32AToNJitjcVRgYW0sgvaJdX9" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --iZDWzuLK32AToNJitjcVRgYW0sgvaJdX9 Content-Type: multipart/mixed; boundary="qwxjABwKaKe3ZcM8poVIJe67PZhiHrrfz"; protected-headers="v1" From: Juergen Gross To: Jan Beulich Cc: Konrad Rzeszutek Wilk , =?UTF-8?Q?Roger_Pau_Monn=c3=a9?= , Boris Ostrovsky , Stefano Stabellini , Jens Axboe , xen-devel@lists.xenproject.org, linux-block@vger.kernel.org, linux-kernel@vger.kernel.org Message-ID: <0fec3ba6-266d-260e-716a-ae33d7670d34@suse.com> Subject: Re: [PATCH 4/8] xen/blkfront: don't trust the backend response data blindly References: <20210513100302.22027-1-jgross@suse.com> <20210513100302.22027-5-jgross@suse.com> <315ad8b9-8a98-8d3e-f66c-ab32af2731a8@suse.com> <6095c4b9-a9bb-8a38-fb6c-a5483105b802@suse.com> <030ef85e-b5af-f46e-c8dc-88b8d195c4e1@suse.com> <477f01cd-8793-705c-10f9-cf0c0cd6ed84@suse.com> <5a9dcc69-385a-eda5-6974-cb962ae62601@suse.com> <7f606c27-173a-542d-406d-196dae784edd@suse.com> In-Reply-To: --qwxjABwKaKe3ZcM8poVIJe67PZhiHrrfz Content-Type: multipart/mixed; boundary="------------EDFAA6DF7F3CF735D9D48B84" Content-Language: en-US This is a multi-part message in MIME format. --------------EDFAA6DF7F3CF735D9D48B84 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable On 08.07.21 08:52, Jan Beulich wrote: > On 08.07.2021 08:40, Juergen Gross wrote: >> On 08.07.21 08:37, Jan Beulich wrote: >>> On 08.07.2021 07:47, Juergen Gross wrote: >>>> On 17.05.21 17:33, Jan Beulich wrote: >>>>> On 17.05.2021 17:22, Juergen Gross wrote: >>>>>> On 17.05.21 17:12, Jan Beulich wrote: >>>>>>> On 17.05.2021 16:23, Juergen Gross wrote: >>>>>>>> On 17.05.21 16:11, Jan Beulich wrote: >>>>>>>>> On 13.05.2021 12:02, Juergen Gross wrote: >>>>>>>>>> @@ -1574,10 +1580,16 @@ static irqreturn_t blkif_interrupt(int= irq, void *dev_id) >>>>>>>>>> spin_lock_irqsave(&rinfo->ring_lock, flags); >>>>>>>>>> again: >>>>>>>>>> rp =3D rinfo->ring.sring->rsp_prod; >>>>>>>>>> + if (RING_RESPONSE_PROD_OVERFLOW(&rinfo->ring, rp)) { >>>>>>>>>> + pr_alert("%s: illegal number of responses %u\n", >>>>>>>>>> + info->gd->disk_name, rp - rinfo->ring.rsp_cons); >>>>>>>>>> + goto err; >>>>>>>>>> + } >>>>>>>>>> rmb(); /* Ensure we see queued responses up to 'rp'. */= >>>>>>>>> >>>>>>>>> I think you want to insert after the barrier. >>>>>>>> >>>>>>>> Why? The relevant variable which is checked is "rp". The result = of the >>>>>>>> check is in no way depending on the responses themselves. And an= y change >>>>>>>> of rsp_cons is protected by ring_lock, so there is no possibilit= y of >>>>>>>> reading an old value here. >>>>>>> >>>>>>> But this is a standard double read situation: You might check a v= alue >>>>>>> and then (via a separate read) use a different one past the barri= er. >>>>>> >>>>>> Yes and no. >>>>>> >>>>>> rsp_cons should never be written by the other side, and additional= ly >>>>>> it would be read multiple times anyway. >>>>> >>>>> But I'm talking about rsp_prod, as that's what rp gets loaded from.= >>>> >>>> Oh, now I get your problem. >>>> >>>> But shouldn't that better be solved by using READ_ONCE() for reading= rp >>>> instead? >>> >>> Not sure - the rmb() is needed anyway aiui, and hence you could as we= ll >>> move your code addition. >> >> Sure. >> >> My question was rather: does the rmb() really eliminate the possibilit= y >> of a double read introduced by the compiler? If yes, moving the code i= s >> the correct solution. >=20 > It doesn't eliminate the possibility of a double read, but (leaving > aside split accesses) that's not what you care about here. What you > need is a single stable value to operate on. No matter how many > (non-split) reads the compiler may issue to fill "rp", the final > read's value will be used in the subsequent calculation. Or at > least that's been my understanding; thinking about it the compiler > might issue multiple reads into distinct registers ahead of the > barrier, and use different registers for different subsequent > operations. While this would look like intentionally inefficient > code generation to me, you may indeed want to play safe and use > ACCESS_ONCE() _and_ the barrier. I guess there are more places then > which would want similar treatment, and it's not a problem that > this change introduces ... Nevertheless I think I can change it right away. It will also help against load tearing. Juergen --------------EDFAA6DF7F3CF735D9D48B84 Content-Type: application/pgp-keys; name="OpenPGP_0xB0DE9DD628BF132F.asc" Content-Transfer-Encoding: quoted-printable Content-Description: OpenPGP public key Content-Disposition: attachment; filename="OpenPGP_0xB0DE9DD628BF132F.asc" -----BEGIN PGP PUBLIC KEY BLOCK----- xsBNBFOMcBYBCACgGjqjoGvbEouQZw/ToiBg9W98AlM2QHV+iNHsEs7kxWhKMjrioyspZKOBy= cWx w3ie3j9uvg9EOB3aN4xiTv4qbnGiTr3oJhkB1gsb6ToJQZ8uxGq2kaV2KL9650I1SJvedYm8O= f8Z d621lSmoKOwlNClALZNew72NjJLEzTalU1OdT7/i1TXkH09XSSI8mEQ/ouNcMvIJNwQpd369y= 9bf IhWUiVXEK7MlRgUG6MvIj6Y3Am/BBLUVbDa4+gmzDC9ezlZkTZG2t14zWPvxXP3FAp2pkW0xq= G7/ 377qptDmrk42GlSKN4z76ELnLxussxc7I2hx18NUcbP8+uty4bMxABEBAAHNHEp1ZXJnZW4gR= 3Jv c3MgPGpnQHBmdXBmLm5ldD7CwHkEEwECACMFAlOMcBYCGwMHCwkIBwMCAQYVCAIJCgsEFgIDA= QIe AQIXgAAKCRCw3p3WKL8TL0KdB/93FcIZ3GCNwFU0u3EjNbNjmXBKDY4FUGNQH2lvWAUy+dnyT= hpw dtF/jQ6j9RwE8VP0+NXcYpGJDWlNb9/JmYqLiX2Q3TyevpB0CA3dbBQp0OW0fgCetToGIQrg0= MbD 1C/sEOv8Mr4NAfbauXjZlvTj30H2jO0u+6WGM6nHwbh2l5O8ZiHkH32iaSTfN7Eu5RnNVUJbv= oPH Z8SlM4KWm8rG+lIkGurqqu5gu8q8ZMKdsdGC4bBxdQKDKHEFExLJK/nRPFmAuGlId1E3fe10v= 5QL +qHI3EIPtyfE7i9Hz6rVwi7lWKgh7pe0ZvatAudZ+JNIlBKptb64FaiIOAWDCx1SzR9KdWVyZ= 2Vu IEdyb3NzIDxqZ3Jvc3NAc3VzZS5jb20+wsB5BBMBAgAjBQJTjHCvAhsDBwsJCAcDAgEGFQgCC= QoL BBYCAwECHgECF4AACgkQsN6d1ii/Ey/HmQf/RtI7kv5A2PS4RF7HoZhPVPogNVbC4YA6lW7Dr= Wf0 teC0RR3MzXfy6pJ+7KLgkqMlrAbN/8Dvjoz78X+5vhH/rDLa9BuZQlhFmvcGtCF8eR0T1v0nC= /nu AFVGy+67q2DH8As3KPu0344TBDpAvr2uYM4tSqxK4DURx5INz4ZZ0WNFHcqsfvlGJALDeE0Lh= ITT d9jLzdDad1pQSToCnLl6SBJZjDOX9QQcyUigZFtCXFst4dlsvddrxyqT1f17+2cFSdu7+ynLm= XBK 7abQ3rwJY8SbRO2iRulogc5vr/RLMMlscDAiDkaFQWLoqHHOdfO9rURssHNN8WkMnQfvUewRz= 80h SnVlcmdlbiBHcm9zcyA8amdyb3NzQG5vdmVsbC5jb20+wsB5BBMBAgAjBQJTjHDXAhsDBwsJC= AcD AgEGFQgCCQoLBBYCAwECHgECF4AACgkQsN6d1ii/Ey8PUQf/ehmgCI9jB9hlgexLvgOtf7PJn= FOX gMLdBQgBlVPO3/D9R8LtF9DBAFPNhlrsfIG/SqICoRCqUcJ96Pn3P7UUinFG/I0ECGF4EvTE1= jnD kfJZr6jrbjgyoZHiw/4BNwSTL9rWASyLgqlA8u1mf+c2yUwcGhgkRAd1gOwungxcwzwqgljf0= N51 N5JfVRHRtyfwq/ge+YEkDGcTU6Y0sPOuj4Dyfm8fJzdfHNQsWq3PnczLVELStJNdapwPOoE+l= otu fe3AM2vAEYJ9rTz3Cki4JFUsgLkHFqGZarrPGi1eyQcXeluldO3m91NK/1xMI3/+8jbO0tsn1= tqS EUGIJi7ox80eSnVlcmdlbiBHcm9zcyA8amdyb3NzQHN1c2UuZGU+wsB5BBMBAgAjBQJTjHDrA= hsD BwsJCAcDAgEGFQgCCQoLBBYCAwECHgECF4AACgkQsN6d1ii/Ey+LhQf9GL45eU5vOowA2u5N3= g3O ZUEBmDHVVbqMtzwlmNC4k9Kx39r5s2vcFl4tXqW7g9/ViXYuiDXb0RfUpZiIUW89siKrkzmQ5= dM7 wRqzgJpJwK8Bn2MIxAKArekWpiCKvBOB/Cc+3EXE78XdlxLyOi/NrmSGRIov0karw2RzMNOu5= D+j LRZQd1Sv27AR+IP3I8U4aqnhLpwhK7MEy9oCILlgZ1QZe49kpcumcZKORmzBTNh30FVKK1Evm= V2x AKDoaEOgQB4iFQLhJCdP1I5aSgM5IVFdn7v5YgEYuJYx37IoN1EblHI//x/e2AaIHpzK5h88N= Eaw QsaNRpNSrcfbFmAg987ATQRTjHAWAQgAyzH6AOODMBjgfWE9VeCgsrwH3exNAU32gLq2xvjpW= nHI s98ndPUDpnoxWQugJ6MpMncr0xSwFmHEgnSEjK/PAjppgmyc57BwKII3sV4on+gDVFJR6Y8ZR= wgn BC5mVM6JjQ5xDk8WRXljExRfUX9pNhdE5eBOZJrDRoLUmmjDtKzWaDhIg/+1Hzz93X4fCQkNV= bVF LELU9bMaLPBG/x5q4iYZ2k2ex6d47YE1ZFdMm6YBYMOljGkZKwYde5ldM9mo45mmwe0icXKLk= pEd IXKTZeKDO+Hdv1aqFuAcccTg9RXDQjmwhC3yEmrmcfl0+rPghO0Iv3OOImwTEe4co3c1mwARA= QAB wsBfBBgBAgAJBQJTjHAWAhsMAAoJELDendYovxMvQ/gH/1ha96vm4P/L+bQpJwrZ/dneZcmEw= Tbe 8YFsw2V/Buv6Z4Mysln3nQK5ZadD534CF7TDVft7fC4tU4PONxF5D+/tvgkPfDAfF77zy2AH1= vJz Q1fOU8lYFpZXTXIHb+559UqvIB8AdgR3SAJGHHt4RKA0F7f5ipYBBrC6cyXJyyoprT10EMvU8= VGi wXvTyJz3fjoYsdFzpWPlJEBRMedCot60g5dmbdrZ5DWClAr0yau47zpWj3enf1tLWaqcsuylW= svi uGjKGw7KHQd3bxALOknAp4dN3QwBYCKuZ7AddY9yjynVaD5X7nF9nO5BjR/i1DG86lem3iBDX= zXs ZDn8R38=3D =3D2wuH -----END PGP PUBLIC KEY BLOCK----- --------------EDFAA6DF7F3CF735D9D48B84-- --qwxjABwKaKe3ZcM8poVIJe67PZhiHrrfz-- --iZDWzuLK32AToNJitjcVRgYW0sgvaJdX9 Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEhRJncuj2BJSl0Jf3sN6d1ii/Ey8FAmDmoYAFAwAAAAAACgkQsN6d1ii/Ey+8 hwf9HndM8XWYHXr73UbskVZip/eM/AyRiyuc8mneuBGjivFC/ycCeFwoe+iAEsc0H2F5Edl1jAB7 5a4NqjIBQx9tpLwsggRWDUXQNhprdY1dbK/mkeqhELciVuW1blfjqlASlbi8BgIpizHo9ep/i5uC 97NBzCfQYUi3ZiKtFXecCX5ETPyc8OJWOMBvynDrJZ3Oahc88f8X3FYbFSYy1VYnRI7txGygEck5 Kyf6wiZw88afh3qc+MAq5Y4EeppwMIZ2sgE5ei/YtNdkII77hyI3L7AMmqCTIGdr98fr7QID32fc 8ZI9SiOqAXPThMQZhktOMmuBnwtH4wHGhfkM9+PGUg== =OUo5 -----END PGP SIGNATURE----- --iZDWzuLK32AToNJitjcVRgYW0sgvaJdX9--