Received: by 2002:a05:6359:c8b:b0:c7:702f:21d4 with SMTP id go11csp671613rwb; Thu, 22 Sep 2022 05:08:52 -0700 (PDT) X-Google-Smtp-Source: AMsMyM5okEFBUpwZLuwsbaySQwcyG6IqM4IjseARq79hsLdw0hdt3BkVkU9SBwfPJFWXjKfPTv9j X-Received: by 2002:a17:907:8a17:b0:782:6e72:7aba with SMTP id sc23-20020a1709078a1700b007826e727abamr845480ejc.474.1663848531770; Thu, 22 Sep 2022 05:08:51 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1663848531; cv=none; d=google.com; s=arc-20160816; b=Os1himH4wIAwVESa3gUcC+j+j01js0VCa2D/sVli3Nz7D2ERSqHPazM2oX86/Fu6RU PRSSLbJEyPS9wknT0ByyuD587cO103Pnd9a3SXzqwEVXHPP++x/gSb57uztX8vSxCYv4 c3ouoJuFEeMNak+ZxT7NIgMQhRArc77qiffOz886ufKLD84cv4tVCUCcgyHpITv09UvH AGR8lsV3OR4soqAkGZAowmeIJLC8TltmxcE8Uq6mQIXlVrLPejh6sqc6IP2I94O+LRt5 3k2JS5MBL0s1fqohgXWbhsmHejPkaZ9euPWMWL5CJy0AWX5Qia/HHf/qhPjveOqXh+c1 P1pg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=mSVzbtwG3pcZhP+jamKTNbTzfDJqHaUJWm9ar+D8Jtw=; b=Kb/aIeFxrt6Zs8QZZoeHj94PQorqfy9tvmhHdTQTY+P+TGY/5yWnHU420B8lP2Kf9r xu7+wfR/5N9tYxEsT0IbjEKsCCau4qfCUwVy1L4I5EIqXfnYxzUiVY5oYhQGAXk8/6ae f0rUotDBjYR0BrNPoAGG6xb0NBo3s6oDAiHgIZnL+MQvtwc+cH1ES+x7THb/RO6BCFFr 6U6U6zN5BnND5WH3niRJnU1YwvF/3km33dBACqby6kdrLr1gU8r5T43xGuMNFUYtEa/u WzUw36R2QRyKSzQdGho2b/iRhsh56CCknAvf6mHHCnTu+O7gBkboEE6CdwlKpuQPK6hM ootg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@efficios.com header.s=smtpout1 header.b=BuIbajCg; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=efficios.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id tz14-20020a170907c78e00b00730936657d1si4352754ejc.552.2022.09.22.05.08.25; Thu, 22 Sep 2022 05:08:51 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@efficios.com header.s=smtpout1 header.b=BuIbajCg; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=efficios.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230366AbiIVLFn (ORCPT + 99 others); Thu, 22 Sep 2022 07:05:43 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:40072 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230034AbiIVLFW (ORCPT ); Thu, 22 Sep 2022 07:05:22 -0400 Received: from smtpout.efficios.com (smtpout.efficios.com [IPv6:2607:5300:203:5aae::31e5]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id C913FD74DA; Thu, 22 Sep 2022 04:05:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=efficios.com; s=smtpout1; t=1663844384; bh=/QQrNnvXDKnSREykPdUSiR8Sh8yIfQgEV+lIvslB0AQ=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=BuIbajCgNovoaQ0oztWQ795DD8FSseu3sMjHG8HMB1Cep28Az9Qaf4qlSn4jaU8DA icc8MOGKQu2TlhRJ+9V/ukHI6m10DKbP5FoDbQtCclesUo56LzkRakfZqo6INcQjyb qZQk+uvXlBmOSWH7fyXUeryD6rN4vj8NudIIlYLjxGvgBAswPgLyMBCWUKRkXVP8LN AzKSiuLktrBe7Hbb7916OQ9o5CtuSNDzZ0uGNAesr8rtpCtrdALtxQfJ1ZQ40uC9wG nQaO5ZqiiudV0wZKaoKBQCjHhjLKabV45FuXdS0TFulQ9tZdbV81HJfXYHCRyZa7Us mCbcNS1pvp/Uw== Received: from localhost.localdomain (192-222-180-24.qc.cable.ebox.net [192.222.180.24]) by smtpout.efficios.com (Postfix) with ESMTPSA id 4MYC3N3RLszNbv; Thu, 22 Sep 2022 06:59:44 -0400 (EDT) From: Mathieu Desnoyers To: Peter Zijlstra Cc: linux-kernel@vger.kernel.org, Thomas Gleixner , "Paul E . McKenney" , Boqun Feng , "H . Peter Anvin" , Paul Turner , linux-api@vger.kernel.org, Christian Brauner , Florian Weimer , David.Laight@ACULAB.COM, carlos@redhat.com, Peter Oskolkov , Alexander Mikhalitsyn , Mathieu Desnoyers Subject: [PATCH v4 07/25] lib: Implement find_{first,next}_{zero,one}_and_zero_bit Date: Thu, 22 Sep 2022 06:59:22 -0400 Message-Id: <20220922105941.237830-8-mathieu.desnoyers@efficios.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20220922105941.237830-1-mathieu.desnoyers@efficios.com> References: <20220922105941.237830-1-mathieu.desnoyers@efficios.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Allow finding the first or next bit within two input bitmasks which is either: - both zero and zero, - respectively one and zero. Signed-off-by: Mathieu Desnoyers --- include/linux/find.h | 110 +++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 110 insertions(+) diff --git a/include/linux/find.h b/include/linux/find.h index 935892da576e..325707b8bd56 100644 --- a/include/linux/find.h +++ b/include/linux/find.h @@ -76,6 +76,66 @@ unsigned long find_next_and_bit(const unsigned long *addr1, } #endif +#ifndef find_next_one_and_zero_bit +/** + * find_next_one_and_zero_bit - find the next bit which is one in addr1 and zero in addr2 memory region + * @addr1: The first address to base the search on + * @addr2: The second address to base the search on + * @offset: The bitnumber to start searching at + * @size: The bitmap size in bits + * + * Returns the bit number for the next bit set in addr1 and cleared in addr2 + * If no corresponding bits meet this criterion, returns @size. + */ +static inline +unsigned long find_next_one_and_zero_bit(const unsigned long *addr1, + const unsigned long *addr2, unsigned long size, + unsigned long offset) +{ + if (small_const_nbits(size)) { + unsigned long val; + + if (unlikely(offset >= size)) + return size; + + val = *addr1 & ~*addr2 & GENMASK(size - 1, offset); + return val ? __ffs(val) : size; + } + + return _find_next_bit(addr1, addr2, size, offset, 0UL, ~0UL, 0); +} +#endif + +#ifndef find_next_zero_and_zero_bit +/** + * find_next_zero_and_zero_bit - find the next bit which is zero in addr1 and addr2 memory regions + * @addr1: The first address to base the search on + * @addr2: The second address to base the search on + * @offset: The bitnumber to start searching at + * @size: The bitmap size in bits + * + * Returns the bit number for the next bit cleared in addr1 and addr2 + * If no corresponding bits meet this criterion, returns @size. + */ +static inline +unsigned long find_next_zero_and_zero_bit(const unsigned long *addr1, + const unsigned long *addr2, unsigned long size, + unsigned long offset) +{ + if (small_const_nbits(size)) { + unsigned long val; + + if (unlikely(offset >= size)) + return size; + + val = ~*addr1 & ~*addr2 & GENMASK(size - 1, offset); + return val ? __ffs(val) : size; + } + + return _find_next_bit(addr1, addr2, size, offset, ~0UL, ~0UL, 0); +} +#endif + #ifndef find_next_zero_bit /** * find_next_zero_bit - find the next cleared bit in a memory region @@ -173,6 +233,56 @@ unsigned long find_first_zero_bit(const unsigned long *addr, unsigned long size) } #endif +#ifndef find_first_one_and_zero_bit +/** + * find_first_one_and_zero_bit - find the first bit which is one in addr1 and zero in addr2 memory region + * @addr1: The first address to base the search on + * @addr2: The second address to base the search on + * @size: The bitmap size in bits + * + * Returns the bit number for the first bit set in addr1 and cleared in addr2 + * If no corresponding bits meet this criterion, returns @size. + */ +static inline +unsigned long find_first_one_and_zero_bit(const unsigned long *addr1, + const unsigned long *addr2, + unsigned long size) +{ + if (small_const_nbits(size)) { + unsigned long val = *addr1 & ~*addr2 & GENMASK(size - 1, 0); + + return val ? __ffs(val) : size; + } + + return _find_next_bit(addr1, addr2, size, 0, 0UL, ~0UL, 0); +} +#endif + +#ifndef find_first_zero_and_zero_bit +/** + * find_first_zero_and_zero_bit - find the first bit which is zero in addr1 and addr2 memory regions + * @addr1: The first address to base the search on + * @addr2: The second address to base the search on + * @size: The bitmap size in bits + * + * Returns the bit number for the first bit cleared in addr1 and addr2 + * If no corresponding bits meet this criterion, returns @size. + */ +static inline +unsigned long find_first_zero_and_zero_bit(const unsigned long *addr1, + const unsigned long *addr2, + unsigned long size) +{ + if (small_const_nbits(size)) { + unsigned long val = ~*addr1 & ~*addr2 & GENMASK(size - 1, 0); + + return val ? __ffs(val) : size; + } + + return _find_next_bit(addr1, addr2, size, 0, ~0UL, ~0UL, 0); +} +#endif + #ifndef find_last_bit /** * find_last_bit - find the last set bit in a memory region -- 2.25.1