Received: by 2002:a05:6902:102b:0:0:0:0 with SMTP id x11csp551047ybt; Wed, 8 Jul 2020 06:20:06 -0700 (PDT) X-Google-Smtp-Source: ABdhPJymaf5Rj5pzrnRRz8coN6YzKj+jNjw2W77UfrY1FIDOZ5eqkTpp371mU4wQBoECIZuGr47E X-Received: by 2002:a17:906:57da:: with SMTP id u26mr53230308ejr.157.1594214406511; Wed, 08 Jul 2020 06:20:06 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1594214406; cv=none; d=google.com; s=arc-20160816; b=tOFbMlQuB6AZhR0SfwMypVtbHktLBLp7f26oWOOYXyxB+iuTzfJ5HrvZnxLtX/8tSf HZI8OvOZOTL9EXTOXu1vvq3vNGDtHueRcPBU8Nc+T0EHBfVsHT2J8ale1coKWjuU900E 14qYUzD9s9UGjwD+hUHjXfDbj872AOQJhUTwmYJDQgoqMSD2sLQvmp32HEBI45kgFStf P2/CHpJ4eFTaCOYBDMRBeTY5JQ7j9u9phs8njzEOMtKRT4SMJJ/ixaLPRL0gzm6BYu/M WNirKoko/EO7+4K/lexEG52WPNktEjBf4zGoB4aDUnEMvc4UbSD7pPyLCRb33kTsikqt Q3tA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:in-reply-to:content-disposition :mime-version:references:reply-to:message-id:subject:cc:to:from:date; bh=RV/YfnBv2kV1k7XNY9imaClYCBPkf2+9jGtQaE9Zwsg=; b=bzQ1FIe4Sm9tVsxvJH47JIxKOv4x+OEjaOdrN82LFwn5sfJ7v96sXdkV7pkWg13beN HVQtfY6ehDxoaPaicWEFhQKLHZoDACSKpjBVkUx3ojAWYAnsVO1fPV7/S7OC4eFM1Isp acUIQKZbuA8xm4wBJzRXpZSPzjFidWBfy6KarnWWgsKXyC9Gabv235VE0gZPUMFgk1LX pxaTUW4IqqI5SrQ1g4FPqemc7qup9Yv4m7BF+HEdgvEjwxQkYwAWBDD7sPCNWCgVFmpa ca4xZJmLQcWw7BCIkUXcBFgb8GUHXyhx7AL47O9bkAWFfuj9jq2K5sNYPjt3C8honiev Zuvw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id j13si15754266ejc.314.2020.07.08.06.19.43; Wed, 08 Jul 2020 06:20:06 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729476AbgGHNS1 (ORCPT + 99 others); Wed, 8 Jul 2020 09:18:27 -0400 Received: from mx0a-001b2d01.pphosted.com ([148.163.156.1]:17018 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729404AbgGHNS1 (ORCPT ); Wed, 8 Jul 2020 09:18:27 -0400 Received: from pps.filterd (m0187473.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 068D2RCA106547; Wed, 8 Jul 2020 09:18:17 -0400 Received: from pps.reinject (localhost [127.0.0.1]) by mx0a-001b2d01.pphosted.com with ESMTP id 325dxe9ryn-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 08 Jul 2020 09:18:16 -0400 Received: from m0187473.ppops.net (m0187473.ppops.net [127.0.0.1]) by pps.reinject (8.16.0.36/8.16.0.36) with SMTP id 068D34YN107846; Wed, 8 Jul 2020 09:18:15 -0400 Received: from ppma05fra.de.ibm.com (6c.4a.5195.ip4.static.sl-reverse.com [149.81.74.108]) by mx0a-001b2d01.pphosted.com with ESMTP id 325dxe9rvk-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 08 Jul 2020 09:18:14 -0400 Received: from pps.filterd (ppma05fra.de.ibm.com [127.0.0.1]) by ppma05fra.de.ibm.com (8.16.0.42/8.16.0.42) with SMTP id 068DHqDE031516; Wed, 8 Jul 2020 13:18:10 GMT Received: from b06cxnps3075.portsmouth.uk.ibm.com (d06relay10.portsmouth.uk.ibm.com [9.149.109.195]) by ppma05fra.de.ibm.com with ESMTP id 3251w8gbx9-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 08 Jul 2020 13:18:09 +0000 Received: from d06av24.portsmouth.uk.ibm.com (mk.ibm.com [9.149.105.60]) by b06cxnps3075.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 068DI7C955836784 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 8 Jul 2020 13:18:07 GMT Received: from d06av24.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id AFF504204C; Wed, 8 Jul 2020 13:18:07 +0000 (GMT) Received: from d06av24.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 5F63642042; Wed, 8 Jul 2020 13:18:05 +0000 (GMT) Received: from in.ibm.com (unknown [9.85.75.251]) by d06av24.portsmouth.uk.ibm.com (Postfix) with ESMTPS; Wed, 8 Jul 2020 13:18:05 +0000 (GMT) Date: Wed, 8 Jul 2020 18:48:03 +0530 From: Bharata B Rao To: Ralph Campbell Cc: linux-rdma@vger.kernel.org, linux-mm@kvack.org, nouveau@lists.freedesktop.org, kvm-ppc@vger.kernel.org, linux-kselftest@vger.kernel.org, linux-kernel@vger.kernel.org, Jerome Glisse , John Hubbard , Christoph Hellwig , Jason Gunthorpe , Andrew Morton , Shuah Khan , Ben Skeggs Subject: Re: [PATCH 0/5] mm/migrate: avoid device private invalidations Message-ID: <20200708131803.GB7902@in.ibm.com> Reply-To: bharata@linux.ibm.com References: <20200706222347.32290-1-rcampbell@nvidia.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20200706222347.32290-1-rcampbell@nvidia.com> X-TM-AS-GCONF: 00 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.235,18.0.687 definitions=2020-07-08_11:2020-07-08,2020-07-08 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 spamscore=0 malwarescore=0 mlxlogscore=999 lowpriorityscore=0 cotscore=-2147483648 mlxscore=0 phishscore=0 clxscore=1011 adultscore=0 priorityscore=1501 bulkscore=0 impostorscore=0 suspectscore=1 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2004280000 definitions=main-2007080091 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Jul 06, 2020 at 03:23:42PM -0700, Ralph Campbell wrote: > The goal for this series is to avoid device private memory TLB > invalidations when migrating a range of addresses from system > memory to device private memory and some of those pages have already > been migrated. The approach taken is to introduce a new mmu notifier > invalidation event type and use that in the device driver to skip > invalidation callbacks from migrate_vma_setup(). The device driver is > also then expected to handle device MMU invalidations as part of the > migrate_vma_setup(), migrate_vma_pages(), migrate_vma_finalize() process. > Note that this is opt-in. A device driver can simply invalidate its MMU > in the mmu notifier callback and not handle MMU invalidations in the > migration sequence. In the kvmppc secure guest usecase, 1. We ensure that we don't issue migrate_vma() calls for pages that have already been migrated to the device side (which is actually secure memory for us that is managed by Ultravisor firmware) 2. The page table mappings on the device side (secure memory) are managed transparent to the kernel by the Ultravisor firmware. Hence I assume that no specific action would be required by the kvmppc usecase due to this patchset. In fact, we never registered for this mmu notifier events. Regards, Bharata.