Received: by 2002:a05:6a10:9e8c:0:0:0:0 with SMTP id y12csp620584pxx; Mon, 26 Oct 2020 17:09:14 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxPPEHzNp8glhWXS/3z7j/D7033+CunmBJeK5y4ladts/6OVVJMYxvE9oDMl245XUhAgSdO X-Received: by 2002:a17:906:4ac2:: with SMTP id u2mr17871540ejt.224.1603757354106; Mon, 26 Oct 2020 17:09:14 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1603757354; cv=none; d=google.com; s=arc-20160816; b=lrJdE0kwwHLTy/DSy3cLZBGowB9Ma3MezHRRKzxoI9yoO44nLhlHuKkYOnAaysSXRR 5+B2DDMkGyXZD0DhhXeE+41OBxaqTw6aVJ4zTkVG8fZwJbg5G3H7NZWTI1+PMR/78aW2 YCqG1kEFtVAMDeX8JpAlvZJb45rLAZicSmim3NbXRImTwuRRyNB2CKPz9/mgCklevVuG pXLz2bMcWJZtHBIpTQc/pKyJUsSVEaYKnkkdJ5683EFW1O+gGwfsXb1lQff0oGtVq5+l A9VlSQcCYRbLeTnTrKjFgl7jk49o6htf14ewvetaZECM9tjm3ZNEIjv4Dv/cHw6B9LW4 m7vw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-transfer-encoding :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature; bh=wSFQl5tEZJlMW2FF6sx0fmEDfKkZOvTzLyUG7GjevAQ=; b=vbLuvtEMUFbZujcJ77JoMw3NjgHnB4ELqjI5phRCcS6Sz9ac87nVuNJt1/ImxeCV8r HkpLdfVrsKBCnOQjxcJjkAxVD/ab6v1swHt9+VZzg8qrCEGc1oB1r76BxIS5QZirFkbd Gcl9CHeTLImU1a8dPOdeI05ECKIxr+ropEY3orTilSIDXyUVjYUEY5KU2iW3i0chc6t9 K0OLjRHJw2Dbx8AdeiLasp/EIN1jwcISVX9BcQWck/OIzn3N5S+5gwDKxJinNnTSatbg 2FbUAeVF5lS6NdPkkKzSv2eatKIiVMCAwnw9D9wGCETUCA4Y2gKGyeHmX5SsZe5yXnJf BPZg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@chromium.org header.s=google header.b=kkBWmOfR; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=chromium.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id h4si7974406eds.217.2020.10.26.17.08.52; Mon, 26 Oct 2020 17:09:14 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@chromium.org header.s=google header.b=kkBWmOfR; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=chromium.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2392629AbgJZWP1 (ORCPT + 99 others); Mon, 26 Oct 2020 18:15:27 -0400 Received: from mail-wm1-f65.google.com ([209.85.128.65]:33289 "EHLO mail-wm1-f65.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S2392613AbgJZWP0 (ORCPT ); Mon, 26 Oct 2020 18:15:26 -0400 Received: by mail-wm1-f65.google.com with SMTP id l20so6118805wme.0 for ; Mon, 26 Oct 2020 15:15:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=chromium.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to; bh=wSFQl5tEZJlMW2FF6sx0fmEDfKkZOvTzLyUG7GjevAQ=; b=kkBWmOfRGiGfynKFUUsY6Bg1cuklrhT3VBOwm/J9YiPw9z4cVdpY9sATV1o7Idrq4y 00hLvWtKsiLWja7bX9HLg4TGqnRGU4YCOAVHW3FIdKeAgKvYbKa00UPb9+F6C9BiFdwx tqpkyBwyQ5Oqzusk6GTT3vSRGHf/YxvJsuWk8= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:content-transfer-encoding :in-reply-to; bh=wSFQl5tEZJlMW2FF6sx0fmEDfKkZOvTzLyUG7GjevAQ=; b=K5n2KUVGPGtfY1Banf4cTYLEyXvQ+b/KhQxKUtyPUwEjaZwPy8bLjRoY/ZpyRCYO1u /SJzOHA0l7iVVDZTNrDGbP/k0hzyprdmEasxTNpqF5mLCDhUI+iDjvNqTUbLaJxptBs6 ervnJN63psNclXLRUIa/SGPRDb7Wm9GECBFfNzq/lqlz7DhnumM1eiah1UWiww+UCtTt /iU0q82VUEpu/6xjpmOEOiACV+CZ0F8vUdnR2TCs8BtTGTvjb956t8/GLOAOlyn4Dbfl dPA51o27mE1Z8YPtq3RcAmd6i+r4JSUYAiKrvFOqMLdH9rBdGP9DtEOye19TapwRo6Hj vqww== X-Gm-Message-State: AOAM530KasB8Q80W1epwKVwVDuSiXV7KftJy2kBjaMKpOCTg08ZNHYoE P3ae6eBDtMFmBHnzpm+kVNQSnQ== X-Received: by 2002:a1c:3243:: with SMTP id y64mr18039466wmy.175.1603750522164; Mon, 26 Oct 2020 15:15:22 -0700 (PDT) Received: from chromium.org (216.131.76.34.bc.googleusercontent.com. [34.76.131.216]) by smtp.gmail.com with ESMTPSA id f17sm23103391wme.22.2020.10.26.15.15.21 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 26 Oct 2020 15:15:21 -0700 (PDT) Date: Mon, 26 Oct 2020 22:15:20 +0000 From: Tomasz Figa To: Daniel Vetter Cc: DRI Development , LKML , kvm@vger.kernel.org, linux-mm@kvack.org, linux-arm-kernel@lists.infradead.org, linux-samsung-soc@vger.kernel.org, linux-media@vger.kernel.org, linux-s390@vger.kernel.org, Daniel Vetter , Jason Gunthorpe , Pawel Osciak , Marek Szyprowski , Kyungmin Park , Mauro Carvalho Chehab , Andrew Morton , John Hubbard , =?iso-8859-1?B?Suly9G1l?= Glisse , Jan Kara , Dan Williams Subject: Re: [PATCH v4 05/15] mm/frame-vector: Use FOLL_LONGTERM Message-ID: <20201026221520.GC2802004@chromium.org> References: <20201026105818.2585306-1-daniel.vetter@ffwll.ch> <20201026105818.2585306-6-daniel.vetter@ffwll.ch> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20201026105818.2585306-6-daniel.vetter@ffwll.ch> Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Daniel, On Mon, Oct 26, 2020 at 11:58:08AM +0100, Daniel Vetter wrote: > This is used by media/videbuf2 for persistent dma mappings, not just > for a single dma operation and then freed again, so needs > FOLL_LONGTERM. > > Unfortunately current pup_locked doesn't support FOLL_LONGTERM due to > locking issues. Rework the code to pull the pup path out from the > mmap_sem critical section as suggested by Jason. > > By relying entirely on the vma checks in pin_user_pages and follow_pfn > (for vm_flags and vma_is_fsdax) we can also streamline the code a lot. > > Signed-off-by: Daniel Vetter > Cc: Jason Gunthorpe > Cc: Pawel Osciak > Cc: Marek Szyprowski > Cc: Kyungmin Park > Cc: Tomasz Figa > Cc: Mauro Carvalho Chehab > Cc: Andrew Morton > Cc: John Hubbard > Cc: J?r?me Glisse > Cc: Jan Kara > Cc: Dan Williams > Cc: linux-mm@kvack.org > Cc: linux-arm-kernel@lists.infradead.org > Cc: linux-samsung-soc@vger.kernel.org > Cc: linux-media@vger.kernel.org > Signed-off-by: Daniel Vetter > -- > v2: Streamline the code and further simplify the loop checks (Jason) > --- > mm/frame_vector.c | 50 ++++++++++++++--------------------------------- > 1 file changed, 15 insertions(+), 35 deletions(-) > Thank you for the patch. Please see my comments inline. > diff --git a/mm/frame_vector.c b/mm/frame_vector.c > index 10f82d5643b6..d44779e56313 100644 > --- a/mm/frame_vector.c > +++ b/mm/frame_vector.c > @@ -38,7 +38,6 @@ int get_vaddr_frames(unsigned long start, unsigned int nr_frames, > struct vm_area_struct *vma; > int ret = 0; > int err; > - int locked; > > if (nr_frames == 0) > return 0; > @@ -48,40 +47,25 @@ int get_vaddr_frames(unsigned long start, unsigned int nr_frames, > > start = untagged_addr(start); > > - mmap_read_lock(mm); > - locked = 1; > - vma = find_vma_intersection(mm, start, start + 1); > - if (!vma) { > - ret = -EFAULT; > - goto out; > - } > - > - /* > - * While get_vaddr_frames() could be used for transient (kernel > - * controlled lifetime) pinning of memory pages all current > - * users establish long term (userspace controlled lifetime) > - * page pinning. Treat get_vaddr_frames() like > - * get_user_pages_longterm() and disallow it for filesystem-dax > - * mappings. > - */ > - if (vma_is_fsdax(vma)) { > - ret = -EOPNOTSUPP; > - goto out; > - } > - > - if (!(vma->vm_flags & (VM_IO | VM_PFNMAP))) { > + ret = pin_user_pages_fast(start, nr_frames, > + FOLL_FORCE | FOLL_WRITE | FOLL_LONGTERM, > + (struct page **)(vec->ptrs)); > + if (ret > 0) { > vec->got_ref = true; > vec->is_pfns = false; > - ret = pin_user_pages_locked(start, nr_frames, > - gup_flags, (struct page **)(vec->ptrs), &locked); Should we drop the gup_flags argument, since it's ignored now? > - goto out; > + goto out_unlocked; > } > Should we initialize ret with 0 here, since pin_user_pages_fast() can return a negative error code, but below we use it as a counter for the looked up frames? Best regards, Tomasz > + mmap_read_lock(mm); > vec->got_ref = false; > vec->is_pfns = true; > do { > unsigned long *nums = frame_vector_pfns(vec); > > + vma = find_vma_intersection(mm, start, start + 1); > + if (!vma) > + break; > + > while (ret < nr_frames && start + PAGE_SIZE <= vma->vm_end) { > err = follow_pfn(vma, start, &nums[ret]); > if (err) { > @@ -92,17 +76,13 @@ int get_vaddr_frames(unsigned long start, unsigned int nr_frames, > start += PAGE_SIZE; > ret++; > } > - /* > - * We stop if we have enough pages or if VMA doesn't completely > - * cover the tail page. > - */ > - if (ret >= nr_frames || start < vma->vm_end) > + /* Bail out if VMA doesn't completely cover the tail page. */ > + if (start < vma->vm_end) > break; > - vma = find_vma_intersection(mm, start, start + 1); > - } while (vma && vma->vm_flags & (VM_IO | VM_PFNMAP)); > + } while (ret < nr_frames); > out: > - if (locked) > - mmap_read_unlock(mm); > + mmap_read_unlock(mm); > +out_unlocked: > if (!ret) > ret = -EFAULT; > if (ret > 0) > -- > 2.28.0 >