Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1757110AbZDTUdW (ORCPT ); Mon, 20 Apr 2009 16:33:22 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1756216AbZDTUdD (ORCPT ); Mon, 20 Apr 2009 16:33:03 -0400 Received: from mail.vyatta.com ([76.74.103.46]:33542 "EHLO mail.vyatta.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1756108AbZDTUdA convert rfc822-to-8bit (ORCPT ); Mon, 20 Apr 2009 16:33:00 -0400 Date: Mon, 20 Apr 2009 13:32:53 -0700 From: Stephen Hemminger To: Eric Dumazet Cc: paulmck@linux.vnet.ibm.com, Evgeniy Polyakov , David Miller , kaber@trash.net, torvalds@linux-foundation.org, jeff.chua.linux@gmail.com, paulus@samba.org, mingo@elte.hu, laijs@cn.fujitsu.com, jengelh@medozas.de, r000n@r000n.net, linux-kernel@vger.kernel.org, netfilter-devel@vger.kernel.org, netdev@vger.kernel.org, benh@kernel.crashing.org, mathieu.desnoyers@polymtl.ca Subject: Re: [PATCH] netfilter: use per-cpu recursive lock (v10) Message-ID: <20090420133253.422747b4@nehalam> In-Reply-To: <49ECBE0A.7010303@cosmosbay.com> References: <20090415170111.6e1ca264@nehalam> <49E72E83.50702@trash.net> <20090416.153354.170676392.davem@davemloft.net> <20090416234955.GL6924@linux.vnet.ibm.com> <20090417012812.GA25534@linux.vnet.ibm.com> <20090418094001.GA2369@ioremap.net> <20090418141455.GA7082@linux.vnet.ibm.com> <20090420103414.1b4c490f@nehalam> <49ECBE0A.7010303@cosmosbay.com> Organization: Vyatta X-Mailer: Claws Mail 3.6.1 (GTK+ 2.16.1; x86_64-pc-linux-gnu) Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8BIT Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 2022 Lines: 47 On Mon, 20 Apr 2009 20:25:14 +0200 Eric Dumazet wrote: > Stephen Hemminger a écrit : > > This version of x_tables (ip/ip6/arp) locking uses a per-cpu > > recursive lock that can be nested. It is sort of like existing kernel_lock, > > rwlock_t and even old 2.4 brlock. > > > > "Reader" is ip/arp/ip6 tables rule processing which runs per-cpu. > > It needs to ensure that the rules are not being changed while packet > > is being processed. > > > > "Writer" is used in two cases: first is replacing rules in which case > > all packets in flight have to be processed before rules are swapped, > > then counters are read from the old (stale) info. Second case is where > > counters need to be read on the fly, in this case all CPU's are blocked > > from further rule processing until values are aggregated. > > > > The idea for this came from an earlier version done by Eric Dumazet. > > Locking is done per-cpu, the fast path locks on the current cpu > > and updates counters. This reduces the contention of a > > single reader lock (in 2.6.29) without the delay of synchronize_net() > > (in 2.6.30-rc2). > > > > The mutex that was added for 2.6.30 in xt_table is unnecessary since > > there already is a mutex for xt[af].mutex that is held. > > > > Signed-off-by: Stephen Hemminger > > > --- > > Changes from earlier patches. > > - function name changes > > - disable bottom half in info_rdlock > > OK, but we still have a problem on machines with >= 250 cpus, > because calling 250 times spin_lock() is going to overflow preempt_count, > as each spin_lock() increases preempt_count by one. Ok, not that I have one of those. The problem which lockdep has is that it seems to associate all the locks with same name. -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/