Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67;
Date:   Wed, 6 Nov 2019 14:22:37 -0800
From:   Ram Pai <linuxram@us.ibm.com>
To:     Michael Roth <mdroth@linux.vnet.ibm.com>
Cc:     "Michael S. Tsirkin" <mst@redhat.com>,
        Alexey Kardashevskiy <aik@ozlabs.ru>,
        linuxppc-dev@lists.ozlabs.org, benh@kernel.crashing.org,
        david@gibson.dropbear.id.au, mpe@ellerman.id.au, paulus@ozlabs.org,
        hch@lst.de, andmike@us.ibm.com, sukadev@linux.vnet.ibm.com,
        ram.n.pai@gmail.com, cai@lca.pw, tglx@linutronix.de,
        bauerman@linux.ibm.com, linux-kernel@vger.kernel.org
Reply-To: Ram Pai <linuxram@us.ibm.com>
References: <1572902923-8096-1-git-send-email-linuxram@us.ibm.com>
 <265679db-9cb3-1660-0cf6-97f740b1b48b@ozlabs.ru>
 <20191106130558-mutt-send-email-mst@kernel.org>
 <157306632211.17570.17567742230498149897@sif>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <157306632211.17570.17567742230498149897@sif>
User-Agent: Mutt/1.5.21 (2010-09-15)
Message-Id: <20191106222237.GE5201@oc0525413822.ibm.com>
Subject: RE: [RFC v1 0/2] Enable IOMMU support for pseries Secure VMs
Sender: linux-kernel-owner@vger.kernel.org
Precedence: bulk

On Wed, Nov 06, 2019 at 12:52:02PM -0600, Michael Roth wrote:
> Quoting Michael S. Tsirkin (2019-11-06 12:06:37)
> > On Wed, Nov 06, 2019 at 12:59:50PM +1100, Alexey Kardashevskiy wrote:
> > > 
> > > 
> > > On 05/11/2019 08:28, Ram Pai wrote:
> > > > This patch series enables IOMMU support for pseries Secure VMs.
> > > > 
> > > > 
> > > > Tested using QEMU command line option:
> > > > 
> > > >  "-device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4,
> > > >     iommu_platform=on,disable-modern=off,disable-legacy=on"
> > > >  and 
> > > > 
> > > >  "-device virtio-blk-pci,scsi=off,bus=pci.0,
> > > >     addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0,
> > > >     iommu_platform=on,disable-modern=off,disable-legacy=on"
> > > 
> > > 
> > > Worth mentioning that SLOF won't boot with such devices as SLOF does not know about iommu_platform=on.
> > 
> > Shouldn't be hard to support: set up the iommu to allow everything
> > and ack the feature. Right?
> 
> It's not a static/linear mapping in this case so we need calls to map DMA
> buffers as-needed. I've gotten it to boot with virtio-blk, but the patches
> have some hacks and need cleanup, hoping to post them soon.
> 
> I'm a bit perplexed how we would manage to boot a guest without those
> changes though, this is what I get with qemu 4.1.0:
> 
>   qemu-system-ppc64 -M pseries,ic-mode=xics -m 512M -bios /home/mdroth/w/build/qemu-4.1.0-build/pc-bios/slof.bin -device virtio-blk-pci,drive=drive0,id=blk0,disable-modern=off,disable-legacy=on,iommu_platform=on -drive file=/home/mdroth/vm/bionic-server-cloudimg-ppc64el.img,if=none,id=drive0 -trace enable=spapr_iommu\*,file=trace.out -monitor unix:/tmp/mon.sock,server,nowait -vga none -nographic
>   qemu-system-ppc64: warning: TCG doesn't support requested feature, cap-cfpc=workaround
>   qemu-system-ppc64: warning: TCG doesn't support requested feature, cap-sbbc=workaround
>   qemu-system-ppc64: warning: TCG doesn't support requested feature, cap-ibs=workaround
>   
>   
>   SLOF **********************************************************************
>   QEMU Starting
>    Build Date = Jul  3 2019 12:26:14
>    FW Version = git-ba1ab360eebe6338
>    Press "s" to enter Open Firmware.
>   
>   Populating /vdevice methods
>   Populating /vdevice/vty@71000000
>   Populating /vdevice/nvram@71000001
>   Populating /vdevice/l-lan@71000002
>   Populating /vdevice/v-scsi@71000003
>          SCSI: Looking for devices
>             8200000000000000 CD-ROM   : "QEMU     QEMU CD-ROM      2.5+"
>   Populating /pci@800000020000000
>                        00 0000 (D) : 1af4 1042    virtio [ block ]
>   No NVRAM common partition, re-initializing...
>   Scanning USB
>   Using default console: /vdevice/vty@71000000
>   
>     Welcome to Open Firmware
>   
>     Copyright (c) 2004, 2017 IBM Corporation All rights reserved.
>     This program and the accompanying materials are made available
>     under the terms of the BSD License available at
>     https://urldefense.proofpoint.com/v2/url?u=http-3A__www.opensource.org_licenses_bsd-2Dlicense.php&d=DwIFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=m-UrKChQVkZtnPpjbF6YY99NbT8FBByQ-E-ygV8luxw&m=-xG4gaWE7BANKGOFx0wmF5ZgZVd8A1r-tsN44n4JUW4&s=QcpPgRqeZAk1pICsA-kk2gNKKiMJLASiPVi-hPinur0&e= 
>   
>   
>   Trying to load:  from: /pci@800000020000000/scsi@0 ... virtioblk_init: failed
>   virtioblk_transfer: Access beyond end of device!
> 
> And then it hangs. This is with TCG so maybe it behaves differently with
> KVM, but that's the result I would expect with the current SLOF code.

you are right. In my case, I was providing the kernel image
on the qemu command line. So there was no need for SLOF to read the
virtio disk. Hence it continued without hanging. SLOF needs to be enhanced
to support IOMMU.


RP