Received: by 2002:a05:6a10:a841:0:0:0:0 with SMTP id d1csp3897245pxy; Mon, 26 Apr 2021 12:24:33 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxszZnyi2H55AXiA1K4BrpYOSQbF22pI5t8hkK4tbkaFovBMmZdzQF1J6D4UUDCQva2Mtxx X-Received: by 2002:a17:90a:4d86:: with SMTP id m6mr708913pjh.35.1619465073619; Mon, 26 Apr 2021 12:24:33 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1619465073; cv=none; d=google.com; s=arc-20160816; b=vRIBDEEyUi1ntSxEZ5VDBgKbdBSjI3Ore+xmpu7ZLxxgaOod4JnyCRAgEWDzh88jz/ 8RdyepYtwuaOafF0h/uM0Ic/rQx0toXHqE/S/cWFmTTVgKxDexvt6QeKcDoSOciUMy4r lc0mtfyHiwfwBUBKr4Yrpuse5KrdsE0akgzRhs2qJp8oqW2j6SvP7JxzBdp05r2yjjZa S4uaFZebAkUCbr9Ow+IH8JU1qsjnzVapsS0Qnj+r2oEk0asXECXI7HvwTiIIi0zRbx0V T98/QGC+ltKnUOQwMCBIT8sLxxgVQJzFRc3frTS9sbl7Y56Ba43EUcMFfXZGEJOeItf5 yAUg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :user-agent:references:in-reply-to:date:cc:to:from:subject :message-id:dkim-signature; bh=NjlPen1encdZDkGM0wilUuVPtH5U8CDDV8DYPkgdQBU=; b=paPYfhpLnttFt68bpbmLz/F07Kw8wU2e6jyslsUd1hfzeCkKGze41Fw9kL+972Nz2I LRVE245f1pAhoqRZm4i3ah6gGMotSohNQC5fDeKZBHustQKvXC0YS+9vwyzzQYan9bF3 pRWpAnRMBMHC5gZJG689Wya3z6fwdAnMpDkH2MXYwOIjHxsGeuyxHEAP6Lw9MlWsJeVZ GG97WqOl689NY0RNMQVRcJQgx5NSxro6ygtKMG9/b3c/jBoHOq4jzSUz2/RUClUqJqAz kIwFiN1TQkP1zXN/tCVDybSoDmlS+c24Q0VtOkbcHlmniDfPaToKhmK0GDKRiWr30KAd xSMw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b="i/jhZeHG"; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id s53si732391pfw.136.2021.04.26.12.24.13; Mon, 26 Apr 2021 12:24:33 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b="i/jhZeHG"; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S239835AbhDZTQ3 (ORCPT + 99 others); Mon, 26 Apr 2021 15:16:29 -0400 Received: from us-smtp-delivery-124.mimecast.com ([170.10.133.124]:54387 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S238085AbhDZTQ1 (ORCPT ); Mon, 26 Apr 2021 15:16:27 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1619464545; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NjlPen1encdZDkGM0wilUuVPtH5U8CDDV8DYPkgdQBU=; b=i/jhZeHGBpZUzi72TqQ6dwfZSK4OhJIYhawDDlDroEkpOdwv7ORQZQK63e7G6x7qUJXNDT 9o2ocHbbwuu7/qPd3Lg4B/98Bw/Icip1P3Ml1XDzM4lNAqxxfFhkfa4e45J3/vAEnHFAzB Y24bShZNYayCCITzaE+ElgJyI/8Vx70= Received: from mail-qt1-f199.google.com (mail-qt1-f199.google.com [209.85.160.199]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-378-uAqvDAQePWu8hgOXyZvK6g-1; Mon, 26 Apr 2021 15:15:41 -0400 X-MC-Unique: uAqvDAQePWu8hgOXyZvK6g-1 Received: by mail-qt1-f199.google.com with SMTP id r20-20020ac85c940000b02901bac34fa2eeso74448qta.11 for ; Mon, 26 Apr 2021 12:15:41 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:subject:from:to:cc:date:in-reply-to :references:user-agent:mime-version:content-transfer-encoding; bh=NjlPen1encdZDkGM0wilUuVPtH5U8CDDV8DYPkgdQBU=; b=FoHoDhtO+sGLoQHJX6nQaJaIHeRVBz7BBdd01INmvPsQSFUhuNwNDT3O+9Qf4Zi+qB uKQpwQOiZv85lKpNc2wdc4j/RgOa84mm8t21oY5YlsXhmXGc/BsShW3FsuxTxRViKi+0 ntwqEXnn/vNA1G4uIrhCOA2GodzckiVtZ7YjeasUDjgisRHv2m/FcDyY6nh3W4MGje8r dJNtvS6EFn3FLpjoPDhg/jm/ifyQONJZ5B4kdF7dswpPWGyQtcp7cGVvbvAFPz7o+35O Qyr4owWs73kvmyZ787fktjaa/LYoZLSGp23a05PJwnJa8gs9fEfK+TuLwL+uN7ejLYc7 E8XA== X-Gm-Message-State: AOAM530bJ2U2fErLQumElHHlJe0pQJUHQczAlEzsk1qrFsyD+g42Co6I EoCfIOWIIONO1zA36iskCv6mQM1QRZRJcyhfnOCEomx+Bl1MHjRDxd2oRD9WAzHgsVA1xQ2GIZK ZDFvToZdCL3pUQtg8d4DQ X-Received: by 2002:a37:de14:: with SMTP id h20mr18965529qkj.34.1619464540670; Mon, 26 Apr 2021 12:15:40 -0700 (PDT) X-Received: by 2002:a37:de14:: with SMTP id h20mr18965510qkj.34.1619464540455; Mon, 26 Apr 2021 12:15:40 -0700 (PDT) Received: from [192.168.1.180] (68-20-15-154.lightspeed.rlghnc.sbcglobal.net. [68.20.15.154]) by smtp.gmail.com with ESMTPSA id c15sm12638215qtg.31.2021.04.26.12.15.39 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 26 Apr 2021 12:15:40 -0700 (PDT) Message-ID: <8114b7a1151edf52e3a20cf30d2673cd177191bf.camel@redhat.com> Subject: Re: [PATCH v7 01/31] iov_iter: Add ITER_XARRAY From: Jeff Layton To: Al Viro , David Howells Cc: linux-fsdevel@vger.kernel.org, Dave Wysochanski , Marc Dionne , "Matthew Wilcox (Oracle)" , Christoph Hellwig , linux-mm@kvack.org, linux-cachefs@redhat.com, linux-afs@lists.infradead.org, linux-nfs@vger.kernel.org, linux-cifs@vger.kernel.org, ceph-devel@vger.kernel.org, v9fs-developer@lists.sourceforge.net, Trond Myklebust , Anna Schumaker , Steve French , Dominique Martinet , linux-kernel@vger.kernel.org Date: Mon, 26 Apr 2021 15:15:39 -0400 In-Reply-To: References: <161918446704.3145707.14418606303992174310.stgit@warthog.procyon.org.uk> <161918448151.3145707.11541538916600921083.stgit@warthog.procyon.org.uk> Content-Type: text/plain; charset="UTF-8" User-Agent: Evolution 3.40.0 (3.40.0-1.fc34) MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: linux-nfs@vger.kernel.org On Mon, 2021-04-26 at 18:54 +0000, Al Viro wrote: > On Fri, Apr 23, 2021 at 02:28:01PM +0100, David Howells wrote: > > -#define iterate_all_kinds(i, n, v, I, B, K) { \ > > +#define iterate_xarray(i, n, __v, skip, STEP) { \ > > + struct page *head = NULL; \ > > + size_t wanted = n, seg, offset; \ > > + loff_t start = i->xarray_start + skip; \ > > + pgoff_t index = start >> PAGE_SHIFT; \ > > + int j; \ > > + \ > > + XA_STATE(xas, i->xarray, index); \ > > + \ > > + rcu_read_lock(); \ > > + xas_for_each(&xas, head, ULONG_MAX) { \ > > + if (xas_retry(&xas, head)) \ > > + continue; \ > > OK, now I'm really confused; what's to guarantee that restart will not have > you hit the same entry more than once? STEP might be e.g. > > memcpy_to_page(v.bv_page, v.bv_offset, > (from += v.bv_len) - v.bv_len, v.bv_len) > > which is clearly not idempotent - from gets incremented, after all. > What am I missing here? > Not sure I understand the issue you see. If xas_retry returns true, we'll restart, but we won't have called STEP yet for that entry. I don't see how we'd retry there and have an issue with idempotency. > > + if (WARN_ON(xa_is_value(head))) \ > > + break; \ > > + if (WARN_ON(PageHuge(head))) \ > > + break; \ > > + for (j = (head->index < index) ? index - head->index : 0; \ > > + j < thp_nr_pages(head); j++) { \ > > + __v.bv_page = head + j; \ > > + offset = (i->xarray_start + skip) & ~PAGE_MASK; \ > > + seg = PAGE_SIZE - offset; \ > > + __v.bv_offset = offset; \ > > + __v.bv_len = min(n, seg); \ > > + (void)(STEP); \ > > + n -= __v.bv_len; \ > > + skip += __v.bv_len; \ > > + if (n == 0) \ > > + break; \ > > + } \ > > + if (n == 0) \ > > + break; \ > > + } \ > > + rcu_read_unlock(); \ > > + n = wanted - n; \ > > +}