Received: by 2002:a05:7412:3784:b0:e2:908c:2ebd with SMTP id jk4csp1598539rdb; Mon, 2 Oct 2023 15:00:40 -0700 (PDT) X-Google-Smtp-Source: AGHT+IGmVtoKTrSvJEXGtz8TsT734fSTDIdAaK/mrcumqdWItXMDriwb3ZvvcxnaPy7CsIBj84mV X-Received: by 2002:aca:1101:0:b0:3ab:5e9e:5206 with SMTP id 1-20020aca1101000000b003ab5e9e5206mr14628781oir.5.1696284040381; Mon, 02 Oct 2023 15:00:40 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1696284040; cv=none; d=google.com; s=arc-20160816; b=LGAug4+RG8Jthk9+qrLoEUMi60RqGaSwgMEia+lOJBVfXrvmpcXnBUEyRE0Qs3Baq/ LcMDnJDnYYxxuYSszObLyKowYSB2EjrhkzMZfGQaBCkLrk2rbMHPYM395In1l9Lbwpqa zI1GUMER5i/uifI9IxScVMgb4jFpZdBKibn/NZoKncA6dEwLDJQ+1z/nWwaIvnvXGu52 52rPVCsVq969xszklKVND9+63dt1TBNdS7DB948BhPnG9brtHw/ZmBFV2U2V+ziqHSj6 DmMoGZxjyo/gIyLeopTqZhHIe9xrxMLozZZaro/we9XpJfpCUOeWp9VEL1IXGCQWzakt 1I/Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to :organization:from:references:cc:to:content-language:subject :user-agent:mime-version:date:message-id:dkim-signature; bh=ycaPEXE57RgkhfEN2l1Hbx0ds50RPCHq0uPD2XiXlY0=; fh=MDU24jSgRWQwNFl40U2PL4F4FDBGL7b/QeWQPYWwNyo=; b=OtLBqJfYjg+P4mNSKonQf78ry30uYPxnLDtpVUSc6NsCBrnSn4Eiyblgr4qcBdaOfY 3cX87GI35eiHpJ4Q4tB1cMQMta7X2gEWAMUQr8CIsdd1utDpehEd+6cp+0WcL1Ltd7Ts wO/+DvV6eGGd8hjnyXVtyVnFVmlpUORN5LyfLigP2zmxTPdp/Ft0RKy++mslvOYuRJDP /GPFlJ4IW1GXLVPkDhJfVqr5grFrBcmQW0t8RO5kwnadgyGmuAfF2zslr3IA31ZBblox p6sTfOZOOsWVaLqU9YecZv4E1o1eMeKu0vxPXDIP583BtS149u4CXzay1ieFAKkLNcYJ konQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=dIiPrq6N; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.33 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from lipwig.vger.email (lipwig.vger.email. [23.128.96.33]) by mx.google.com with ESMTPS id cw16-20020a056a00451000b0068fef323e54si27493271pfb.296.2023.10.02.15.00.40 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 02 Oct 2023 15:00:40 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.33 as permitted sender) client-ip=23.128.96.33; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=dIiPrq6N; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.33 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by lipwig.vger.email (Postfix) with ESMTP id B36A78063007; Mon, 2 Oct 2023 10:34:47 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.10 at lipwig.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S237923AbjJBRek (ORCPT + 99 others); Mon, 2 Oct 2023 13:34:40 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:34206 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231835AbjJBRej (ORCPT ); Mon, 2 Oct 2023 13:34:39 -0400 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A9316AD for ; Mon, 2 Oct 2023 10:33:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1696268035; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ycaPEXE57RgkhfEN2l1Hbx0ds50RPCHq0uPD2XiXlY0=; b=dIiPrq6NZzD2ZyRbUQ/LDI2OJatMF9+dZE1+L8yQ93Tx81pvtGBIp8wnBPKj0NIbKJm8sl vzx+GKBZ3iSfTadigcxn8gNZTQKatPpyTCyPcnMfqYi7oQgl+se0i4PGgF/2IUxFWZal3D sYkOdBzMzP0m9ooPRrHrlhEa+GqJi/c= Received: from mail-wr1-f72.google.com (mail-wr1-f72.google.com [209.85.221.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-647-NwxJlj0LOkqtfM8KznIiLA-1; Mon, 02 Oct 2023 13:33:54 -0400 X-MC-Unique: NwxJlj0LOkqtfM8KznIiLA-1 Received: by mail-wr1-f72.google.com with SMTP id ffacd0b85a97d-3172a94b274so43460f8f.0 for ; Mon, 02 Oct 2023 10:33:54 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1696268033; x=1696872833; h=content-transfer-encoding:in-reply-to:organization:from:references :cc:to:content-language:subject:user-agent:mime-version:date :message-id:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ycaPEXE57RgkhfEN2l1Hbx0ds50RPCHq0uPD2XiXlY0=; b=PipC7rPLzT1PUO6N2D725gcVS3qXrt5k0xFmZmqWAh0F7HZLdblLcxl0QjuuVHR6O8 9wfzGaLDq6rNNjuR8PkeoCp7ieoeOsJWL4ZXjm3T6PKXLbxTNyu1QhywzomjnqnQGQVh eA7e9ptrxymeEptR5zALtAZf/8ZXUqpBvzHHFdum8wERMbW7ctdLtkYapboR4Y0QsIWa +zJQQbd+vwNO/4AJeO2yb6Pm7zBHQLPyrqmSvkehIBr6FVqU0xoRqtC8hyiYxC4BZziP spk0d4wdsXhVUIbffJtpakiFACJ65qfxTwb469SM+7847OX0ECqE3951LruJcNzOvkQz uWaA== X-Gm-Message-State: AOJu0YxiU5UbZIpT35MSNg9Y2b0GhrN7FKcFi60/l7lIfxT8RmwHiDRU yA7sBNsMlG/ByKkE/Q13Lg+YCVe29P2OQDePCydHUyFedECkA/Xp6ro6MRNTuBzAaUuvpfuX/Ir K25mRA/3tbV+LlDRcg2PEA9mX X-Received: by 2002:a7b:c392:0:b0:405:4a9d:b2bc with SMTP id s18-20020a7bc392000000b004054a9db2bcmr10174637wmj.22.1696268033346; Mon, 02 Oct 2023 10:33:53 -0700 (PDT) X-Received: by 2002:a7b:c392:0:b0:405:4a9d:b2bc with SMTP id s18-20020a7bc392000000b004054a9db2bcmr10174607wmj.22.1696268032828; Mon, 02 Oct 2023 10:33:52 -0700 (PDT) Received: from ?IPV6:2003:cb:c735:f200:cb49:cb8f:88fc:9446? (p200300cbc735f200cb49cb8f88fc9446.dip0.t-ipconnect.de. [2003:cb:c735:f200:cb49:cb8f:88fc:9446]) by smtp.gmail.com with ESMTPSA id r1-20020a05600c298100b0040586360a36sm7706418wmd.17.2023.10.02.10.33.51 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 02 Oct 2023 10:33:52 -0700 (PDT) Message-ID: Date: Mon, 2 Oct 2023 19:33:50 +0200 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.15.1 Subject: Re: [PATCH v2 2/3] userfaultfd: UFFDIO_REMAP uABI Content-Language: en-US To: Peter Xu Cc: Jann Horn , Suren Baghdasaryan , akpm@linux-foundation.org, viro@zeniv.linux.org.uk, brauner@kernel.org, shuah@kernel.org, aarcange@redhat.com, lokeshgidra@google.com, hughd@google.com, mhocko@suse.com, axelrasmussen@google.com, rppt@kernel.org, willy@infradead.org, Liam.Howlett@oracle.com, zhangpeng362@huawei.com, bgeffon@google.com, kaleshsingh@google.com, ngeoffray@google.com, jdduke@google.com, linux-mm@kvack.org, linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, linux-kselftest@vger.kernel.org, kernel-team@android.com References: <20230923013148.1390521-1-surenb@google.com> <20230923013148.1390521-3-surenb@google.com> <03f95e90-82bd-6ee2-7c0d-d4dc5d3e15ee@redhat.com> <98b21e78-a90d-8b54-3659-e9b890be094f@redhat.com> <85e5390c-660c-ef9e-b415-00ee71bc5cbf@redhat.com> From: David Hildenbrand Organization: Red Hat In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-3.2 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lipwig.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (lipwig.vger.email [0.0.0.0]); Mon, 02 Oct 2023 10:34:47 -0700 (PDT) On 02.10.23 17:21, Peter Xu wrote: > On Mon, Oct 02, 2023 at 10:00:03AM +0200, David Hildenbrand wrote: >> In case we cannot simply remap the page, the fallback sequence (from the >> cover letter) would be triggered. >> >> 1) UFFDIO_COPY >> 2) MADV_DONTNEED >> >> So we would just handle the operation internally without a fallback. > > Note that I think there will be a slight difference on whole remap > atomicity, on what happens if the page is modified after UFFDIO_COPY but > before DONTNEED. If the page is writable (implies PAE), we can always move it. If it is R/O, it cannot change before we get a page fault and grab the PT lock (well, and page lock). So I think something atomic can be implemented without too much issues. > > UFFDIO_REMAP guarantees full atomicity when moving the page, IOW, threads > can be updating the pages when ioctl(UFFDIO_REMAP), data won't get lost > during movement, and it will generate a missing event after moved, with > latest data showing up on dest. If the page has to be copied, grab a reference and unmap it, then copy it and map it into the new process. Should be doable and handle all kinds of situations just fine. Just throwing out ideas to get a less low-level interface. [if one really wants to get notified when one cannot move without a copy, one could have a flag for such power users to control the behavior] -- Cheers, David / dhildenb