Received: by 2002:a05:6358:51dd:b0:131:369:b2a3 with SMTP id 29csp232795rwl; Wed, 9 Aug 2023 13:44:18 -0700 (PDT) X-Google-Smtp-Source: AGHT+IEH8+4a5vKgsN62A450FwCk63Dx7HdgR56VULcz7cy68dHHtuJ8JfzfhhMIXMhJnFzrWxIr X-Received: by 2002:a5d:5051:0:b0:317:3f70:9dc4 with SMTP id h17-20020a5d5051000000b003173f709dc4mr382369wrt.31.1691613858138; Wed, 09 Aug 2023 13:44:18 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1691613858; cv=none; d=google.com; s=arc-20160816; b=asHdmln3Ufp2sXxa/FBVfOvEF1upfSSyqnzG0s6C/Jq1YFSr/uTsvhFDCU5/tSuy+H nv4EabZ0nvYEa+9EEq5kIlYO2R/PXW3rggVtof92s2J8a7QTqK+xJFG65CJ9JbWa3eGQ fykzV2agG/2j8YCfvcAE/Yn3Mk/+iCdDR5EtF+30/480et/mrfBGePc2IsV27dhXpZlo 373W9uWIPw3nKh4poCWeOW936cgPiyHTeYfUXl64vUeduoJNjDtNED6/aQvMLATQWbXl wGGVe5U5CHhQDN0D5ydc9u99CHPLIyhBfVHcB08zTS1yxQFAkTE7r69ctJSCbeOYI5CC fTqg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to :organization:from:references:cc:to:content-language:subject :user-agent:mime-version:date:message-id:dkim-signature; bh=k6xf89mSS43Mh9qXicJVyXd+LHrtdJLi91ztEImliwY=; fh=/8QGzd5vqLz3S6JuWFwfyHVVca9sRbSBQHEPTEW6GfA=; b=jUTS1/TUF6AanPJJMtESP12sp+NZXa1T/xABVOl/u8bs65RV3opKG3rPYQLMA3pMBa Gz3KegfBIYVdQi25xKLq7jbP+teUvoFIViD7oeU5w4PZ53yh4IAPJgbow7+kQkBRRBFf ZVOzaPPnGYSdfak8pFHOEeqIJ7L4dKQhelHirMGfqFyYPyCc+jQYo/ORjiTuqE6xKOxH aimCAPi6nLWRQOcCW/wbXx26yOfTgXXctiIMcGmjmsW4+jnPvBjpSIGjFsgIHEkc0lFA /OVF0Mv1uXnLc65YwUkAXsO8YVrUq0KULSxHmyFDbefrVcmJeDnpWHZRGyWZVHftq4ax Yaxg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=LTbHLjlt; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id a10-20020a17090682ca00b00991cb7517bdsi9710927ejy.948.2023.08.09.13.43.52; Wed, 09 Aug 2023 13:44:18 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=LTbHLjlt; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233721AbjHIT1m (ORCPT + 99 others); Wed, 9 Aug 2023 15:27:42 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:46500 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233934AbjHIT1d (ORCPT ); Wed, 9 Aug 2023 15:27:33 -0400 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id D69462706 for ; Wed, 9 Aug 2023 12:26:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1691609175; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=k6xf89mSS43Mh9qXicJVyXd+LHrtdJLi91ztEImliwY=; b=LTbHLjltYnGm25OKkgk7EjCmRKmiSDCDqkIZB/hlRxNUsDFTG90ZQ56vgzKQTAAcPzBPFF H8myRhbJVrgOwbD7lHAJ7iklQoli2EdPXm3bc8PEPFXN0RahQTSmlDR9z2Wiy+aY52o+Oe hl0TT4mPIDysCP5uKfzQbuqwWpqBhZ4= Received: from mail-wr1-f71.google.com (mail-wr1-f71.google.com [209.85.221.71]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-201-uAUZH_XAOVCWrKUtsF1jzg-1; Wed, 09 Aug 2023 15:26:13 -0400 X-MC-Unique: uAUZH_XAOVCWrKUtsF1jzg-1 Received: by mail-wr1-f71.google.com with SMTP id ffacd0b85a97d-315af0252c2so139199f8f.0 for ; Wed, 09 Aug 2023 12:26:13 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1691609172; x=1692213972; h=content-transfer-encoding:in-reply-to:organization:from:references :cc:to:content-language:subject:user-agent:mime-version:date :message-id:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=k6xf89mSS43Mh9qXicJVyXd+LHrtdJLi91ztEImliwY=; b=Er137L1ZLMi6dLH5GVEj8oufjUvgGNpQbwgbPSMPOhqdmJzgIGocQIuguBistTL+Yn DXWxnngDX/4HgdgZpuoZZLlPhnyHCFQp6VW8j19ymjDrgVfKziEGsE4UTrW2uHUmKNyU NqRcodFZ6OFZll7fc8D2NTp4Pf4TJ5yxpNBULQNzrhgLW2XEC8lNDby/556nGeJkXVZ6 ZbjVJxkLq3/Ij86fkaQzPIfKtUGKWjPvqq1H3eP9NDznzVcMLG/+3ldLiV42elz8N5KV /x80W1j2UqUjPIclh03KiN8ERMwJJSaC3V4j0rofpBdThhoIPfHNCdBX+mq6iWK8X/9K pzXQ== X-Gm-Message-State: AOJu0YyIvG0HNDimC+avRjr+n4Xp83UJVI1dk+pQ5KBks8WxjWs7FPiO 2Ml2JvinlDq/JbFxcBKQ3s1T7GipJ0XXbriAA2ZIacqdT4fJgI8ssy8lKjMa2tJwxW3ttObXCVj 4p3JegClGjM3euaWIDnUQVFs8BAT5iJCe X-Received: by 2002:a5d:6a4f:0:b0:314:3a3d:5d1f with SMTP id t15-20020a5d6a4f000000b003143a3d5d1fmr255542wrw.19.1691609172341; Wed, 09 Aug 2023 12:26:12 -0700 (PDT) X-Received: by 2002:a5d:6a4f:0:b0:314:3a3d:5d1f with SMTP id t15-20020a5d6a4f000000b003143a3d5d1fmr255527wrw.19.1691609171991; Wed, 09 Aug 2023 12:26:11 -0700 (PDT) Received: from ?IPV6:2003:cb:c70e:6800:9933:28db:f83a:ef5? (p200300cbc70e6800993328dbf83a0ef5.dip0.t-ipconnect.de. [2003:cb:c70e:6800:9933:28db:f83a:ef5]) by smtp.gmail.com with ESMTPSA id h5-20020a05600004c500b003143aa0ca8asm17747899wri.13.2023.08.09.12.26.11 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 09 Aug 2023 12:26:11 -0700 (PDT) Message-ID: <703bb7de-aba7-ee4b-c2fb-3562318072a5@redhat.com> Date: Wed, 9 Aug 2023 21:26:10 +0200 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: [PATCH mm-unstable v1] mm: add a total mapcount for large folios Content-Language: en-US To: Matthew Wilcox , Ryan Roberts Cc: linux-kernel@vger.kernel.org, linux-mm@kvack.org, linux-doc@vger.kernel.org, Andrew Morton , Jonathan Corbet , Mike Kravetz , Hugh Dickins , Yin Fengwei , Yang Shi , Zi Yan References: <20230809083256.699513-1-david@redhat.com> <181fcc79-b1c6-412f-9ca1-d1f21ef33e32@arm.com> From: David Hildenbrand Organization: Red Hat In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-2.9 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H4,RCVD_IN_MSPIKE_WL, SPF_HELO_NONE,SPF_NONE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 09.08.23 21:21, Matthew Wilcox wrote: > On Wed, Aug 09, 2023 at 08:07:43PM +0100, Ryan Roberts wrote: >>> +++ b/mm/hugetlb.c >>> @@ -1479,7 +1479,7 @@ static void __destroy_compound_gigantic_folio(struct folio *folio, >>> struct page *p; >>> >>> atomic_set(&folio->_entire_mapcount, 0); >>> - atomic_set(&folio->_nr_pages_mapped, 0); >>> + atomic_set(&folio->_total_mapcount, 0); >> >> Just checking this is definitely what you intended? _total_mapcount is -1 when >> it means "no pages mapped", so 0 means 1 page mapped? > > We're destroying the page here, so rather than setting the meaning of > this, we're setting the contents of this memory to 0. > > > Other thoughts that ran through my mind ... can we wrap? I don't think > we can; we always increment total_mapcount by 1, no matter whether we're > incrementing entire_mapcount or an individual page's mapcount, and we > always call folio_get() first, so we can't increment total_mapcount > past 2^32 because folio_get() will die first. We might be able to > wrap past 2^31, but I don't think so. From my understanding, if we wrap the total mapcount, we already wrapped the refcount -- as you say, grabbing a reference ahead of time for each mapping is mandatory. Both are 31bit values. We could treat the total mapcount as an unsigned int, but that's rather future work. Also, even folio_mapcount() and total_mapcount() return an "int" as of now. But yes, I also thought about that. In the future we might want (at least) for bigger folios refcount+total_mapcount to be 64bit. Or we manage to decouple both and only have the total_mapcount be 64bit only. -- Cheers, David / dhildenb