Received: by 2002:a05:7412:37c9:b0:e2:908c:2ebd with SMTP id jz9csp2427542rdb; Thu, 21 Sep 2023 20:07:23 -0700 (PDT) X-Google-Smtp-Source: AGHT+IFic4YEXpwW6dnFfPeBkNWFgiNQKZKSmFMAPbuazRESmwkbPsq6yLb1gbFAKpvPbnFtY8Gr X-Received: by 2002:a05:6a00:1950:b0:68e:4955:c405 with SMTP id s16-20020a056a00195000b0068e4955c405mr6747012pfk.27.1695352042756; Thu, 21 Sep 2023 20:07:22 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1695352042; cv=none; d=google.com; s=arc-20160816; b=DBmXHNgQIaAII7ZwjVJi3OKkbZ/keuVsIGPcSGUoE5nsiO4E6rLCTd+MANhKGU3YlZ XxIa+gmOR/3AFMunzGCBPAbfc148p8Pncx0fqFcINjkaTJps44WYjbdJLMsbbAbaNafE l2B9lXjymrzRyH3StfJskv0FkFyzNV4cv2Hv69++oeMQkduG8nnO0jm5AKPeNyA9z/hG kPr+QL7HignbkDPfJ1SU/YpqmuRfUEaZyHMTuwzL9XmlHlyh6p3QZFYlEMBPuyZj0lkO IMI2IjuevKmp42n3m1wejxsJsLtpkmv/1F965VHEYPdvOkl/4pSkHsSym4fLsYH6NzUc q0XQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:cc:to:subject :message-id:date:from:in-reply-to:references:mime-version :dkim-signature; bh=0VO+Ge+AE8f/BpXh60ZRTwmlgGyLBpX4NWc4kauL7gk=; fh=VgNU4hvvciN7wCBodKBxYQKTfkyRb8UMoUyYkuL70QU=; b=NJSSadoktNrgXLxUQBwu6HH5jzwIDjxZWIgNK17cxDzlPfRgDaDem1NPBYdKgByqDr 2QjS36k1z8/2QkQ2dupcBUMM3r/96NQD3rW/7t06ValLgDMGH769+6Qw/u8quoUQNsKy b/wTVwhYg2w+JDR93chFymQPI7vaBD8x+X7/ndxnVw/bsjL/vMLzPUPBTuKgH1CYdvLv +jf60kMnNffN3KmJoYN/KQ0y0ZSmeckU+MalZW90Wjs4h9UeZ0WHyvfnJb5oe19lqFqD XV11mQQEUM2Xo/jcgaiJdMSmSSCTbqbeNuYI76o7vmDQES9oCQU8DvCtod8K26dkxqXu sK6A== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20230601 header.b=pmQOuQek; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.37 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from snail.vger.email (snail.vger.email. [23.128.96.37]) by mx.google.com with ESMTPS id a21-20020a63e855000000b00565e865d381si2772842pgk.447.2023.09.21.20.07.22 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 21 Sep 2023 20:07:22 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.37 as permitted sender) client-ip=23.128.96.37; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20230601 header.b=pmQOuQek; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.37 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by snail.vger.email (Postfix) with ESMTP id 37D34830C307; Thu, 21 Sep 2023 18:58:10 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.10 at snail.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230286AbjIVB6D (ORCPT + 99 others); Thu, 21 Sep 2023 21:58:03 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:58174 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229770AbjIVB6C (ORCPT ); Thu, 21 Sep 2023 21:58:02 -0400 Received: from mail-yb1-xb29.google.com (mail-yb1-xb29.google.com [IPv6:2607:f8b0:4864:20::b29]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 1A672E8 for ; Thu, 21 Sep 2023 18:57:56 -0700 (PDT) Received: by mail-yb1-xb29.google.com with SMTP id 3f1490d57ef6-d818d4230f6so1993436276.1 for ; Thu, 21 Sep 2023 18:57:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20230601; t=1695347875; x=1695952675; darn=vger.kernel.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=0VO+Ge+AE8f/BpXh60ZRTwmlgGyLBpX4NWc4kauL7gk=; b=pmQOuQek+Dl/zj3tPrIx7LwBXB4aerpHjaEzxIZuB7M/N3H1KuPpemDl6z0YPLq0CM 3uAkTbLuX+PZb46BGuARtF1YHeCEzkpzP+r59XPuhw2JHxDTTnlqB5zwdHxVFuVDlitV MQiWo/qKUdmaxb1EmRVw8jC6ZnQ63IQ3tOYvPAFZwpZlQgUfhkeKkpIhu1cSPYhkdYJi gi5HGnq9FcwvIXhwU0wVH8IExu3D5n6Ssiz0dgWxGvUkcx2eqA3VhDvCPz06IafRmSHV 8N37wdUbbqKQ3x9pV2A9vC+7cZfoK6lRC6wQHaxc+mai2/dCIBxyT90eO6b5YDUuev7E yjHw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1695347875; x=1695952675; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=0VO+Ge+AE8f/BpXh60ZRTwmlgGyLBpX4NWc4kauL7gk=; b=eMuI/CW2s5xLXC2PaQkEDIoM1BxuPmi+7qrduOaniD1kQ++aZ1Y3I0fDA3nMW0AN9a nDgTsDOZAkB+Hm8oT+fy/+AG34ay/HzaYBXyHAaQYrml1WEpko/TE4631NAabEj+HHoe l3Fv6I1zIPmCF1T0XVy1uFxeNlPO5Ylhl1Km/dBK3+tSmU5fUjarp4bXuK1yIKkCQZae aQco+GzFDgutMbDw66MI+OZKkBFM6izVXUmrLhDeNrz/TPFflC3xEsUcaKM0jJdWexM4 KV5sTPQByLXfCXPCsU/zf01UPzNYijab+7qAcA6vdTcX902VG/lJ/YJYkfVeUUsOrfHn 8OUw== X-Gm-Message-State: AOJu0YwXhTgIS/R1NPFP4nhWiqLffr+dE1cNEwB783Q3HGeIP9iqOf+n PRUbTcVh4cPlAUF/BjRM9C57xRMAqfK/LnGN5GSDHQ== X-Received: by 2002:a25:cf48:0:b0:d7e:df89:dda1 with SMTP id f69-20020a25cf48000000b00d7edf89dda1mr7254798ybg.7.1695347874999; Thu, 21 Sep 2023 18:57:54 -0700 (PDT) MIME-Version: 1.0 References: <20230914152620.2743033-1-surenb@google.com> <20230914152620.2743033-3-surenb@google.com> <354f2508-74d5-2723-502c-32d009f77a3e@redhat.com> In-Reply-To: <354f2508-74d5-2723-502c-32d009f77a3e@redhat.com> From: Suren Baghdasaryan Date: Thu, 21 Sep 2023 18:57:42 -0700 Message-ID: Subject: Re: [PATCH 2/3] userfaultfd: UFFDIO_REMAP uABI To: David Hildenbrand Cc: Matthew Wilcox , akpm@linux-foundation.org, viro@zeniv.linux.org.uk, brauner@kernel.org, shuah@kernel.org, aarcange@redhat.com, lokeshgidra@google.com, peterx@redhat.com, hughd@google.com, mhocko@suse.com, axelrasmussen@google.com, rppt@kernel.org, Liam.Howlett@oracle.com, jannh@google.com, zhangpeng362@huawei.com, bgeffon@google.com, kaleshsingh@google.com, ngeoffray@google.com, jdduke@google.com, linux-mm@kvack.org, linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, linux-kselftest@vger.kernel.org, kernel-team@android.com Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-17.6 required=5.0 tests=BAYES_00,DKIMWL_WL_MED, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF, ENV_AND_HDR_SPF_MATCH,RCVD_IN_DNSWL_BLOCKED,SPF_HELO_NONE,SPF_PASS, USER_IN_DEF_DKIM_WL,USER_IN_DEF_SPF_WL autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (snail.vger.email [0.0.0.0]); Thu, 21 Sep 2023 18:58:10 -0700 (PDT) On Thu, Sep 21, 2023 at 11:17=E2=80=AFAM David Hildenbrand wrote: > > On 21.09.23 20:04, Suren Baghdasaryan wrote: > > On Thu, Sep 14, 2023 at 6:45=E2=80=AFPM David Hildenbrand wrote: > >> > >> On 14.09.23 20:43, David Hildenbrand wrote: > >>> On 14.09.23 20:11, Matthew Wilcox wrote: > >>>> On Thu, Sep 14, 2023 at 08:26:12AM -0700, Suren Baghdasaryan wrote: > >>>>> +++ b/include/linux/userfaultfd_k.h > >>>>> @@ -93,6 +93,23 @@ extern int mwriteprotect_range(struct mm_struct = *dst_mm, > >>>>> extern long uffd_wp_range(struct vm_area_struct *vma, > >>>>> unsigned long start, unsigned long len, bool= enable_wp); > >>>>> > >>>>> +/* remap_pages */ > >>>>> +extern void double_pt_lock(spinlock_t *ptl1, spinlock_t *ptl2); > >>>>> +extern void double_pt_unlock(spinlock_t *ptl1, spinlock_t *ptl2); > >>>>> +extern ssize_t remap_pages(struct mm_struct *dst_mm, > >>>>> + struct mm_struct *src_mm, > >>>>> + unsigned long dst_start, > >>>>> + unsigned long src_start, > >>>>> + unsigned long len, __u64 flags); > >>>>> +extern int remap_pages_huge_pmd(struct mm_struct *dst_mm, > >>>>> + struct mm_struct *src_mm, > >>>>> + pmd_t *dst_pmd, pmd_t *src_pmd, > >>>>> + pmd_t dst_pmdval, > >>>>> + struct vm_area_struct *dst_vma, > >>>>> + struct vm_area_struct *src_vma, > >>>>> + unsigned long dst_addr, > >>>>> + unsigned long src_addr); > >>>> > >>>> Drop the 'extern' markers from function declarations. > >>>> > >>>>> +int remap_pages_huge_pmd(struct mm_struct *dst_mm, > >>>>> + struct mm_struct *src_mm, > >>>>> + pmd_t *dst_pmd, pmd_t *src_pmd, > >>>>> + pmd_t dst_pmdval, > >>>>> + struct vm_area_struct *dst_vma, > >>>>> + struct vm_area_struct *src_vma, > >>>>> + unsigned long dst_addr, > >>>>> + unsigned long src_addr) > >>>>> +{ > >>>>> + pmd_t _dst_pmd, src_pmdval; > >>>>> + struct page *src_page; > >>>>> + struct anon_vma *src_anon_vma, *dst_anon_vma; > >>>>> + spinlock_t *src_ptl, *dst_ptl; > >>>>> + pgtable_t pgtable; > >>>>> + struct mmu_notifier_range range; > >>>>> + > >>>>> + src_pmdval =3D *src_pmd; > >>>>> + src_ptl =3D pmd_lockptr(src_mm, src_pmd); > >>>>> + > >>>>> + BUG_ON(!pmd_trans_huge(src_pmdval)); > >>>>> + BUG_ON(!pmd_none(dst_pmdval)); > >>>>> + BUG_ON(!spin_is_locked(src_ptl)); > >>>>> + mmap_assert_locked(src_mm); > >>>>> + mmap_assert_locked(dst_mm); > >>>>> + BUG_ON(src_addr & ~HPAGE_PMD_MASK); > >>>>> + BUG_ON(dst_addr & ~HPAGE_PMD_MASK); > >>>>> + > >>>>> + src_page =3D pmd_page(src_pmdval); > >>>>> + BUG_ON(!PageHead(src_page)); > >>>>> + BUG_ON(!PageAnon(src_page)); > >>>> > >>>> Better to add a src_folio =3D page_folio(src_page); > >>>> and then folio_test_anon() here. > >>>> > >>>>> + if (unlikely(page_mapcount(src_page) !=3D 1)) { > >>>> > >>>> Brr, this is going to miss PTE mappings of this folio. I think you > >>>> actually want folio_mapcount() instead, although it'd be more effici= ent > >>>> to look at folio->_entire_mapcount =3D=3D 1 and _nr_pages_mapped =3D= =3D 0. > >>>> Not wure what a good name for that predicate would be. > >>> > >>> We have > >>> > >>> * It only works on non shared anonymous pages because those can > >>> * be relocated without generating non linear anon_vmas in the rma= p > >>> * code. > >>> * > >>> * It provides a zero copy mechanism to handle userspace page faul= ts. > >>> * The source vma pages should have mapcount =3D=3D 1, which can b= e > >>> * enforced by using madvise(MADV_DONTFORK) on src vma. > >>> > >>> Use PageAnonExclusive(). As long as KSM is not involved and you don't > >>> use fork(), that flag should be good enough for that use case here. > >>> > >> ... and similarly don't do any of that swapcount stuff and only check = if > >> the swap pte is anon exclusive. > > > > I'm preparing v2 and this is the only part left for me to address but > > I'm not clear how. David, could you please clarify how I should be > > checking swap pte to be exclusive without swapcount? > > If you have a real swp pte (not a non-swap pte like migration entries) > you should be able to just use pte_swp_exclusive(). Got it. Thanks! > > -- > Cheers, > > David / dhildenb >