Received: by 2002:ac0:a5a7:0:0:0:0:0 with SMTP id m36-v6csp1629293imm; Thu, 19 Jul 2018 05:18:20 -0700 (PDT) X-Google-Smtp-Source: AAOMgpc1WZnsXEMNImTKyhM0+Kj5VeONzss6gCEDomkdpAdwT5CkHfK5wU1XN4byVOabU3yFWLWi X-Received: by 2002:a17:902:24c7:: with SMTP id l7-v6mr9903899plg.170.1532002700881; Thu, 19 Jul 2018 05:18:20 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1532002700; cv=none; d=google.com; s=arc-20160816; b=BRRGinTx9FK6+71dwO+1BqBsMLaCFhxhrdfbFTA4x/eWeUQ78aSrBzeLj5xBGdzm+O aR0IrFMyu7uZQ/LlBW9YxcbvFn1YY6O5m4tyuFwvvvynnP180eJPc61jqPpRBinNED2q /7gUf7tMFyarOrcQnnDfuMYDb7t2Vo8pvHsnvThrEoIr6X+uU1j/YcClIGZ8M8rS+DlD IK9FC/y2BGY1PwYBubKVvQtJNXYRV7adBSd667dkQmDft/Pk4ApHuTEZeF4+1VFQ3kEv eJpwQ5FXvitxK4EfqYzs8qt+EgfMleMPEmY7VrRK7V9xpry6plbWlJnTE+M3PXUqSVAL jj6w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:arc-authentication-results; bh=+6MILBwfOChGEHfdqRloPrjlA9d3SWDzhCd0rO26gPQ=; b=pBObzT8emoTOsMfGYK37L0wPhyPRAYSZ96dQbz09X8nFUx2CWyh/Ls3oROywCJmmhD IBtGyBqldCU0aLyoHsdszRr2wZt2nvV3nP+zLb2v50D4xPHKtQFvi8y7rvVvEVy6E6i7 9vmT6QdBalRDpru8kLDx8LWGWeFyzP8zttp3IXyq9g/USNgUUOrvCe0Ebc4autMQbdGu W/pFaJ8TCpPanx8nk1KKhowzcqSIYjqXRksGnGLus2Sd6u21ZdVxUHwwFGEluPPOs/Ea mrcxItfRh6k1oIkS72OejcBNUiYixRlqSfDxHmuzO1vvbkOmDVMPaHZ2emr9+6iP61C0 FvUA== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id t6-v6si6023198pgk.215.2018.07.19.05.18.06; Thu, 19 Jul 2018 05:18:20 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1731598AbeGSM7g (ORCPT + 99 others); Thu, 19 Jul 2018 08:59:36 -0400 Received: from mx3-rdu2.redhat.com ([66.187.233.73]:54734 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1727584AbeGSM7g (ORCPT ); Thu, 19 Jul 2018 08:59:36 -0400 Received: from smtp.corp.redhat.com (int-mx05.intmail.prod.int.rdu2.redhat.com [10.11.54.5]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 6632C87A74; Thu, 19 Jul 2018 12:16:42 +0000 (UTC) Received: from localhost (ovpn-117-80.ams2.redhat.com [10.36.117.80]) by smtp.corp.redhat.com (Postfix) with ESMTP id 932D81C59F; Thu, 19 Jul 2018 12:16:36 +0000 (UTC) Date: Thu, 19 Jul 2018 13:16:35 +0100 From: Stefan Hajnoczi To: Pankaj Gupta Cc: Luiz Capitulino , kwolf@redhat.com, haozhong zhang , jack@suse.cz, xiaoguangrong eric , kvm@vger.kernel.org, riel@surriel.com, linux-nvdimm@ml01.01.org, david@redhat.com, ross zwisler , linux-kernel@vger.kernel.org, qemu-devel@nongnu.org, hch@infradead.org, imammedo@redhat.com, mst@redhat.com, niteshnarayanlal@hotmail.com, pbonzini@redhat.com, dan j williams , nilal@redhat.com Subject: Re: [Qemu-devel] [RFC v3] qemu: Add virtio pmem device Message-ID: <20180719121635.GA28107@stefanha-x1.localdomain> References: <20180713075232.9575-1-pagupta@redhat.com> <20180713075232.9575-4-pagupta@redhat.com> <20180718085529.133a0a22@doriath> <367397176.52317488.1531979293251.JavaMail.zimbra@redhat.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="azLHFNyN32YCQGCU" Content-Disposition: inline In-Reply-To: <367397176.52317488.1531979293251.JavaMail.zimbra@redhat.com> User-Agent: Mutt/1.10.0 (2018-05-17) X-Scanned-By: MIMEDefang 2.79 on 10.11.54.5 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.11.55.1]); Thu, 19 Jul 2018 12:16:42 +0000 (UTC) X-Greylist: inspected by milter-greylist-4.5.16 (mx1.redhat.com [10.11.55.1]); Thu, 19 Jul 2018 12:16:42 +0000 (UTC) for IP:'10.11.54.5' DOMAIN:'int-mx05.intmail.prod.int.rdu2.redhat.com' HELO:'smtp.corp.redhat.com' FROM:'stefanha@redhat.com' RCPT:'' Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org --azLHFNyN32YCQGCU Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Jul 19, 2018 at 01:48:13AM -0400, Pankaj Gupta wrote: >=20 > >=20 > > > This patch adds virtio-pmem Qemu device. > > >=20 > > > This device presents memory address range information to guest > > > which is backed by file backend type. It acts like persistent > > > memory device for KVM guest. Guest can perform read and persistent > > > write operations on this memory range with the help of DAX capable > > > filesystem. > > >=20 > > > Persistent guest writes are assured with the help of virtio based > > > flushing interface. When guest userspace space performs fsync on > > > file fd on pmem device, a flush command is send to Qemu over VIRTIO > > > and host side flush/sync is done on backing image file. > > >=20 > > > Changes from RFC v2: > > > - Use aio_worker() to avoid Qemu from hanging with blocking fsync > > > call - Stefan > > > - Use virtio_st*_p() for endianess - Stefan > > > - Correct indentation in qapi/misc.json - Eric > > >=20 > > > Signed-off-by: Pankaj Gupta > > > --- > > > hw/virtio/Makefile.objs | 3 + > > > hw/virtio/virtio-pci.c | 44 +++++ > > > hw/virtio/virtio-pci.h | 14 ++ > > > hw/virtio/virtio-pmem.c | 241 > > > ++++++++++++++++++++++++++++ > > > include/hw/pci/pci.h | 1 + > > > include/hw/virtio/virtio-pmem.h | 42 +++++ > > > include/standard-headers/linux/virtio_ids.h | 1 + > > > qapi/misc.json | 26 ++- > > > 8 files changed, 371 insertions(+), 1 deletion(-) > > > create mode 100644 hw/virtio/virtio-pmem.c > > > create mode 100644 include/hw/virtio/virtio-pmem.h > > >=20 > > > diff --git a/hw/virtio/Makefile.objs b/hw/virtio/Makefile.objs > > > index 1b2799cfd8..7f914d45d0 100644 > > > --- a/hw/virtio/Makefile.objs > > > +++ b/hw/virtio/Makefile.objs > > > @@ -10,6 +10,9 @@ obj-$(CONFIG_VIRTIO_CRYPTO) +=3D virtio-crypto.o > > > obj-$(call land,$(CONFIG_VIRTIO_CRYPTO),$(CONFIG_VIRTIO_PCI)) +=3D > > > virtio-crypto-pci.o > > > =20 > > > obj-$(CONFIG_LINUX) +=3D vhost.o vhost-backend.o vhost-user.o > > > +ifeq ($(CONFIG_MEM_HOTPLUG),y) > > > +obj-$(CONFIG_LINUX) +=3D virtio-pmem.o > > > +endif > > > obj-$(CONFIG_VHOST_VSOCK) +=3D vhost-vsock.o > > > endif > > > =20 > > > diff --git a/hw/virtio/virtio-pci.c b/hw/virtio/virtio-pci.c > > > index 3a01fe90f0..93d3fc05c7 100644 > > > --- a/hw/virtio/virtio-pci.c > > > +++ b/hw/virtio/virtio-pci.c > > > @@ -2521,6 +2521,49 @@ static const TypeInfo virtio_rng_pci_info =3D { > > > .class_init =3D virtio_rng_pci_class_init, > > > }; > > > =20 > > > +/* virtio-pmem-pci */ > > > + > > > +static void virtio_pmem_pci_realize(VirtIOPCIProxy *vpci_dev, Error > > > **errp) > > > +{ > > > + VirtIOPMEMPCI *vpmem =3D VIRTIO_PMEM_PCI(vpci_dev); > > > + DeviceState *vdev =3D DEVICE(&vpmem->vdev); > > > + > > > + qdev_set_parent_bus(vdev, BUS(&vpci_dev->bus)); > > > + object_property_set_bool(OBJECT(vdev), true, "realized", errp); > > > +} > > > + > > > +static void virtio_pmem_pci_class_init(ObjectClass *klass, void *dat= a) > > > +{ > > > + DeviceClass *dc =3D DEVICE_CLASS(klass); > > > + VirtioPCIClass *k =3D VIRTIO_PCI_CLASS(klass); > > > + PCIDeviceClass *pcidev_k =3D PCI_DEVICE_CLASS(klass); > > > + k->realize =3D virtio_pmem_pci_realize; > > > + set_bit(DEVICE_CATEGORY_MISC, dc->categories); > > > + pcidev_k->vendor_id =3D PCI_VENDOR_ID_REDHAT_QUMRANET; > > > + pcidev_k->device_id =3D PCI_DEVICE_ID_VIRTIO_PMEM; > > > + pcidev_k->revision =3D VIRTIO_PCI_ABI_VERSION; > > > + pcidev_k->class_id =3D PCI_CLASS_OTHERS; > > > +} > > > + > > > +static void virtio_pmem_pci_instance_init(Object *obj) > > > +{ > > > + VirtIOPMEMPCI *dev =3D VIRTIO_PMEM_PCI(obj); > > > + > > > + virtio_instance_init_common(obj, &dev->vdev, sizeof(dev->vdev), > > > + TYPE_VIRTIO_PMEM); > > > + object_property_add_alias(obj, "memdev", OBJECT(&dev->vdev), "me= mdev", > > > + &error_abort); > > > +} > > > + > > > +static const TypeInfo virtio_pmem_pci_info =3D { > > > + .name =3D TYPE_VIRTIO_PMEM_PCI, > > > + .parent =3D TYPE_VIRTIO_PCI, > > > + .instance_size =3D sizeof(VirtIOPMEMPCI), > > > + .instance_init =3D virtio_pmem_pci_instance_init, > > > + .class_init =3D virtio_pmem_pci_class_init, > > > +}; > > > + > > > + > > > /* virtio-input-pci */ > > > =20 > > > static Property virtio_input_pci_properties[] =3D { > > > @@ -2714,6 +2757,7 @@ static void virtio_pci_register_types(void) > > > type_register_static(&virtio_balloon_pci_info); > > > type_register_static(&virtio_serial_pci_info); > > > type_register_static(&virtio_net_pci_info); > > > + type_register_static(&virtio_pmem_pci_info); > > > #ifdef CONFIG_VHOST_SCSI > > > type_register_static(&vhost_scsi_pci_info); > > > #endif > > > diff --git a/hw/virtio/virtio-pci.h b/hw/virtio/virtio-pci.h > > > index 813082b0d7..fe74fcad3f 100644 > > > --- a/hw/virtio/virtio-pci.h > > > +++ b/hw/virtio/virtio-pci.h > > > @@ -19,6 +19,7 @@ > > > #include "hw/virtio/virtio-blk.h" > > > #include "hw/virtio/virtio-net.h" > > > #include "hw/virtio/virtio-rng.h" > > > +#include "hw/virtio/virtio-pmem.h" > > > #include "hw/virtio/virtio-serial.h" > > > #include "hw/virtio/virtio-scsi.h" > > > #include "hw/virtio/virtio-balloon.h" > > > @@ -57,6 +58,7 @@ typedef struct VirtIOInputHostPCI VirtIOInputHostPC= I; > > > typedef struct VirtIOGPUPCI VirtIOGPUPCI; > > > typedef struct VHostVSockPCI VHostVSockPCI; > > > typedef struct VirtIOCryptoPCI VirtIOCryptoPCI; > > > +typedef struct VirtIOPMEMPCI VirtIOPMEMPCI; > > > =20 > > > /* virtio-pci-bus */ > > > =20 > > > @@ -274,6 +276,18 @@ struct VirtIOBlkPCI { > > > VirtIOBlock vdev; > > > }; > > > =20 > > > +/* > > > + * virtio-pmem-pci: This extends VirtioPCIProxy. > > > + */ > > > +#define TYPE_VIRTIO_PMEM_PCI "virtio-pmem-pci" > > > +#define VIRTIO_PMEM_PCI(obj) \ > > > + OBJECT_CHECK(VirtIOPMEMPCI, (obj), TYPE_VIRTIO_PMEM_PCI) > > > + > > > +struct VirtIOPMEMPCI { > > > + VirtIOPCIProxy parent_obj; > > > + VirtIOPMEM vdev; > > > +}; > > > + > > > /* > > > * virtio-balloon-pci: This extends VirtioPCIProxy. > > > */ > > > diff --git a/hw/virtio/virtio-pmem.c b/hw/virtio/virtio-pmem.c > > > new file mode 100644 > > > index 0000000000..08c96d7e80 > > > --- /dev/null > > > +++ b/hw/virtio/virtio-pmem.c > > > @@ -0,0 +1,241 @@ > > > +/* > > > + * Virtio pmem device > > > + * > > > + * Copyright (C) 2018 Red Hat, Inc. > > > + * Copyright (C) 2018 Pankaj Gupta > > > + * > > > + * This work is licensed under the terms of the GNU GPL, version 2. > > > + * See the COPYING file in the top-level directory. > > > + * > > > + */ > > > + > > > +#include "qemu/osdep.h" > > > +#include "qapi/error.h" > > > +#include "qemu-common.h" > > > +#include "qemu/error-report.h" > > > +#include "hw/virtio/virtio-access.h" > > > +#include "hw/virtio/virtio-pmem.h" > > > +#include "hw/mem/memory-device.h" > > > +#include "block/aio.h" > > > +#include "block/thread-pool.h" > > > + > > > +typedef struct VirtIOPMEMresp { > > > + int ret; > > > +} VirtIOPMEMResp; > > > + > > > +typedef struct VirtIODeviceRequest { > > > + VirtQueueElement elem; > > > + int fd; > > > + VirtIOPMEM *pmem; > > > + VirtIOPMEMResp resp; > > > +} VirtIODeviceRequest; > > > + > > > +static int worker_cb(void *opaque) > > > +{ > > > + VirtIODeviceRequest *req =3D opaque; > > > + int err =3D 0; > > > + > > > + /* flush raw backing image */ > > > + err =3D fsync(req->fd); > > > + if (err !=3D 0) { > > > + err =3D errno; > > > + } > > > + req->resp.ret =3D err; > >=20 > > Host question: are you returning the guest errno code to the host? >=20 > No. I am returning error code from the host in-case of host fsync > failure, otherwise returning zero. I think that's what Luiz meant. errno constants are not portable between operating systems and architectures. Therefore they cannot be used in external interfaces in software that expects to communicate with other systems. It will be necessary to define specific constants for virtio-pmem instead of passing errno from the host to guest. Stefan --azLHFNyN32YCQGCU Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJbUIEjAAoJEJykq7OBq3PIJxgIALhsccHLQSqX6n5jXBBdCxLY tik3zenShvVbzv4cXvBPRD9kHFQXEet9f5/GLVidUmtgjo9KIydkL23hRfS+CGm1 ducL6odYDnFD2tIatTJ6ooQ0JMm5yuM4v/CTerwzPHdN/r9URo8vhwbXufeXq6UZ GMNlAuDSgziDeGjrQQ0bcd6UUwGUBgxnkYM+AuvZXzOpIgNaBSWuFR4pNQi+cRqQ 6rsVUNMJulo9fJsVHqjhrgnnfR5PammV0cRe4STDkWlevRESbhK7N+uWxbK868Es vXdPzKUUSqwIUksdoy82VuPiOxAVBF5f6EMQ0BSDZORMGKZR5A9hv+eGIX2XvnY= =wLDi -----END PGP SIGNATURE----- --azLHFNyN32YCQGCU--