Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753504AbaGVISt (ORCPT ); Tue, 22 Jul 2014 04:18:49 -0400 Received: from mail.skyhub.de ([78.46.96.112]:59885 "EHLO mail.skyhub.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752795AbaGVISo (ORCPT ); Tue, 22 Jul 2014 04:18:44 -0400 Date: Tue, 22 Jul 2014 10:18:40 +0200 From: Borislav Petkov To: Realtek linux nic maintainers Cc: netdev@vger.kernel.org, lkml Subject: 3.16-rc6+: r8169 fresh new irq lock inversion Message-ID: <20140722081840.GA6462@pd.tnic> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline User-Agent: Mutt/1.5.23 (2014-03-12) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi all, I got this new lockdep splat after booting rc6 + tip/master this morning. I haven't seen it before so it must be new in rc6 which should be easy to pinpoint... or maybe there's already a fix queued somewhere. :) [ 10.033876] NET: Registered protocol family 10 [ 11.510454] r8169 0000:02:00.0 eth0: link down [ 11.510566] r8169 0000:02:00.0 eth0: link down [ 11.522573] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 13.024024] r8169 0000:02:00.0 eth0: link up [ 13.031636] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 14.024289] [ 14.028860] ========================================================= [ 14.038419] [ INFO: possible irq lock inversion dependency detected ] [ 14.047992] 3.16.0-rc6+ #1 Not tainted [ 14.054806] --------------------------------------------------------- [ 14.064269] swapper/2/0 just changed the state of lock: [ 14.072523] (&tb->tb6_lock){++--..}, at: [] ip6_ins_rt+0x47/0x80 [ipv6] [ 14.083983] but this lock took another, SOFTIRQ-READ-unsafe lock in the past: [ 14.094142] (nl_table_lock){.+.?..} [ 14.094142] [ 14.094142] and interrupts could create inverse lock ordering between them. [ 14.094142] [ 14.115623] [ 14.115623] other info that might help us debug this: [ 14.128001] Possible interrupt unsafe locking scenario: [ 14.128001] [ 14.140632] CPU0 CPU1 [ 14.148080] ---- ---- [ 14.155494] lock(nl_table_lock); [ 14.161756] local_irq_disable(); [ 14.170487] lock(&tb->tb6_lock); [ 14.179272] lock(nl_table_lock); [ 14.188002] [ 14.193397] lock(&tb->tb6_lock); [ 14.199835] [ 14.199835] *** DEADLOCK *** [ 14.199835] [ 14.214025] 1 lock held by swapper/2/0: [ 14.220632] #0: (rcu_read_lock){......}, at: [] __netif_receive_skb_core+0x65/0xc00 [ 14.232984] [ 14.232984] the shortest dependencies between 2nd lock and 1st lock: [ 14.246511] -> (nl_table_lock){.+.?..} ops: 4153 { [ 14.254361] HARDIRQ-ON-R at: [ 14.260442] [] __lock_acquire+0x39c/0x2230 [ 14.270889] [] lock_acquire+0xb9/0x200 [ 14.280886] [] _raw_read_lock+0x44/0x80 [ 14.291002] [] netlink_broadcast_filtered+0x42/0x360 [ 14.302244] [] netlink_broadcast+0x1d/0x20 [ 14.312580] [] nlmsg_notify+0xbd/0xd0 [ 14.322462] [] rtmsg_ifinfo+0xdc/0x100 [ 14.332448] [] register_netdevice+0x495/0x570 [ 14.343009] [] register_netdev+0x1f/0x30 [ 14.353107] [] loopback_net_init+0x3b/0x7f [ 14.363390] [] ops_init.constprop.8+0xaf/0x180 [ 14.374001] [] register_pernet_operations.isra.5+0x6c/0xb0 [ 14.385668] [] register_pernet_device+0x27/0x70 [ 14.396421] [] net_dev_init+0x18c/0x1e8 [ 14.406439] [] do_one_initcall+0xa0/0x1f0 [ 14.416660] [] kernel_init_freeable+0x114/0x19c [ 14.427385] [] kernel_init+0xe/0xe0 [ 14.437061] [] ret_from_fork+0x7c/0xb0 [ 14.446978] IN-SOFTIRQ-R at: [ 14.452894] [] __lock_acquire+0x929/0x2230 [ 14.463166] [] lock_acquire+0xb9/0x200 [ 14.473085] [] _raw_read_lock+0x44/0x80 [ 14.483106] [] netlink_broadcast_filtered+0x42/0x360 [ 14.494290] [] netlink_broadcast+0x1d/0x20 [ 14.504553] [] nlmsg_notify+0xbd/0xd0 [ 14.514385] [] rtnl_notify+0x3b/0x40 [ 14.524087] [] __neigh_notify+0xb7/0xe0 [ 14.534057] [] neigh_update+0x444/0x950 [ 14.544043] [] arp_process+0x30d/0x820 [ 14.553910] [] arp_rcv+0x10b/0x140 [ 14.563412] [] __netif_receive_skb_core+0x24c/0xc00 [ 14.574412] [] __netif_receive_skb+0x1b/0x70 [ 14.584771] [] netif_receive_skb_internal+0x2d/0x1e0 [ 14.595832] [] napi_gro_receive+0x90/0x1b0 [ 14.606029] [] rtl8169_poll+0x30b/0x640 [r8169] [ 14.616675] [] net_rx_action+0x132/0x310 [ 14.626757] [] __do_softirq+0xed/0x4d0 [ 14.636621] [] irq_exit+0x8e/0xb0 [ 14.646038] [] do_IRQ+0x71/0x110 [ 14.655368] [] ret_from_intr+0x0/0x13 [ 14.665093] [] cpuidle_enter+0x17/0x20 [ 14.674883] [] cpu_startup_entry+0x287/0x7c0 [ 14.685180] [] start_secondary+0x210/0x250 [ 14.695290] SOFTIRQ-ON-R at: [ 14.701042] [] __lock_acquire+0x985/0x2230 [ 14.711157] [] lock_acquire+0xb9/0x200 [ 14.720920] [] _raw_read_lock+0x44/0x80 [ 14.730742] [] netlink_broadcast_filtered+0x42/0x360 [ 14.741691] [] netlink_broadcast+0x1d/0x20 [ 14.751731] [] nlmsg_notify+0xbd/0xd0 [ 14.761310] [] rtmsg_ifinfo+0xdc/0x100 [ 14.770969] [] register_netdevice+0x495/0x570 [ 14.781224] [] register_netdev+0x1f/0x30 [ 14.791022] [] loopback_net_init+0x3b/0x7f [ 14.801016] [] ops_init.constprop.8+0xaf/0x180 [ 14.811359] [] register_pernet_operations.isra.5+0x6c/0xb0 [ 14.822731] [] register_pernet_device+0x27/0x70 [ 14.833162] [] net_dev_init+0x18c/0x1e8 [ 14.842907] [] do_one_initcall+0xa0/0x1f0 [ 14.852842] [] kernel_init_freeable+0x114/0x19c [ 14.863305] [] kernel_init+0xe/0xe0 [ 14.872712] [] ret_from_fork+0x7c/0xb0 [ 14.882387] INITIAL USE at: [ 14.887992] [] __lock_acquire+0x443/0x2230 [ 14.898013] [] lock_acquire+0xb9/0x200 [ 14.907664] [] _raw_write_lock_irq+0x47/0x80 [ 14.917850] [] netlink_table_grab+0x1a/0x110 [ 14.928054] [] netlink_proto_init+0x161/0x1e0 [ 14.938379] [] do_one_initcall+0xa0/0x1f0 [ 14.948354] [] kernel_init_freeable+0x114/0x19c [ 14.958803] [] kernel_init+0xe/0xe0 [ 14.968157] [] ret_from_fork+0x7c/0xb0 [ 14.977763] } [ 14.981921] ... key at: [] nl_table_lock+0x18/0x80 [ 14.991364] ... acquired at: [ 14.996836] [] lock_acquire+0xb9/0x200 [ 15.004876] [] _raw_read_lock+0x44/0x80 [ 15.012999] [] netlink_broadcast_filtered+0x42/0x360 [ 15.022260] [] netlink_broadcast+0x1d/0x20 [ 15.030645] [] nlmsg_notify+0xbd/0xd0 [ 15.038596] [] rtnl_notify+0x3b/0x40 [ 15.046462] [] inet6_rt_notify+0xe4/0x160 [ipv6] [ 15.055393] [] fib6_add+0x577/0xaa0 [ipv6] [ 15.063802] [] ip6_ins_rt+0x5c/0x80 [ipv6] [ 15.072240] [] __ipv6_ifa_notify+0x335/0x340 [ipv6] [ 15.081439] [] ipv6_ifa_notify+0x7c/0x130 [ipv6] [ 15.090369] [] add_addr+0x64/0x90 [ipv6] [ 15.098608] [] addrconf_notify+0x589/0xb50 [ipv6] [ 15.107642] [] notifier_call_chain+0x55/0x110 [ 15.116311] [] raw_notifier_call_chain+0x16/0x20 [ 15.125242] [] call_netdevice_notifiers_info+0x40/0x70 [ 15.134709] [] __dev_notify_flags+0x40/0xc0 [ 15.143224] [] dev_change_flags+0x5a/0x70 [ 15.151548] [] do_setlink+0x3f1/0xb50 [ 15.159492] [] rtnl_newlink+0x5bd/0x770 [ 15.167634] [] rtnetlink_rcv_msg+0x98/0x250 [ 15.176105] [] netlink_rcv_skb+0xa1/0xc0 [ 15.184309] [] rtnetlink_rcv+0x2a/0x40 [ 15.192345] [] netlink_unicast+0x146/0x1e0 [ 15.200730] [] netlink_sendmsg+0x348/0x440 [ 15.209107] [] sock_sendmsg+0x73/0x90 [ 15.217051] [] ___sys_sendmsg+0x408/0x420 [ 15.225348] [] __sys_sendmsg+0x49/0x80 [ 15.233387] [] SyS_sendmsg+0x12/0x20 [ 15.241250] [] system_call_fastpath+0x1a/0x1f [ 15.249896] [ 15.253820] -> (&tb->tb6_lock){++--..} ops: 6 { [ 15.260915] HARDIRQ-ON-W at: [ 15.266511] [] __lock_acquire+0x952/0x2230 [ 15.276411] [] lock_acquire+0xb9/0x200 [ 15.285947] [] _raw_write_lock_bh+0x45/0x80 [ 15.295926] [] ip6_ins_rt+0x47/0x80 [ipv6] [ 15.305827] [] __ipv6_ifa_notify+0x335/0x340 [ipv6] [ 15.316524] [] ipv6_ifa_notify+0x7c/0x130 [ipv6] [ 15.326970] [] add_addr+0x64/0x90 [ipv6] [ 15.336733] [] addrconf_notify+0x589/0xb50 [ipv6] [ 15.347273] [] notifier_call_chain+0x55/0x110 [ 15.357459] [] raw_notifier_call_chain+0x16/0x20 [ 15.367897] [] call_netdevice_notifiers_info+0x40/0x70 [ 15.378847] [] __dev_notify_flags+0x40/0xc0 [ 15.388841] [] dev_change_flags+0x5a/0x70 [ 15.398660] [] do_setlink+0x3f1/0xb50 [ 15.408178] [] rtnl_newlink+0x5bd/0x770 [ 15.417817] [] rtnetlink_rcv_msg+0x98/0x250 [ 15.427813] [] netlink_rcv_skb+0xa1/0xc0 [ 15.437549] [] rtnetlink_rcv+0x2a/0x40 [ 15.447120] [] netlink_unicast+0x146/0x1e0 [ 15.457036] [] netlink_sendmsg+0x348/0x440 [ 15.466990] [] sock_sendmsg+0x73/0x90 [ 15.476458] [] ___sys_sendmsg+0x408/0x420 [ 15.486263] [] __sys_sendmsg+0x49/0x80 [ 15.495808] [] SyS_sendmsg+0x12/0x20 [ 15.505172] [] system_call_fastpath+0x1a/0x1f [ 15.515334] HARDIRQ-ON-R at: [ 15.520963] [] __lock_acquire+0x39c/0x2230 [ 15.530908] [] lock_acquire+0xb9/0x200 [ 15.540485] [] _raw_read_lock_bh+0x48/0x80 [ 15.550405] [] ip6_pol_route.isra.41+0x67/0x3f0 [ipv6] [ 15.561371] [] ip6_pol_route_output+0x2a/0x30 [ipv6] [ 15.572165] [] fib6_rule_lookup+0x1a/0x20 [ipv6] [ 15.582601] [] ip6_route_output+0x74/0xc0 [ipv6] [ 15.593031] [] ip6_dst_lookup_tail+0xcf/0xf0 [ipv6] [ 15.603736] [] ip6_dst_lookup_flow+0x35/0x90 [ipv6] [ 15.614415] [] ip6_datagram_connect+0x169/0x4b0 [ipv6] [ 15.625375] [] inet_dgram_connect+0x45/0xa0 [ 15.635360] [] SyS_connect+0x8a/0xe0 [ 15.644741] [] system_call_fastpath+0x1a/0x1f [ 15.654912] IN-SOFTIRQ-W at: [ 15.660543] [] __lock_acquire+0x929/0x2230 [ 15.670451] [] lock_acquire+0xb9/0x200 [ 15.680030] [] _raw_write_lock_bh+0x45/0x80 [ 15.690035] [] ip6_ins_rt+0x47/0x80 [ipv6] [ 15.699953] [] ip6_pol_route.isra.41+0x2e4/0x3f0 [ipv6] [ 15.711016] [] ip6_pol_route_input+0x2b/0x30 [ipv6] [ 15.721730] [] fib6_rule_lookup+0x1a/0x20 [ipv6] [ 15.732185] [] ip6_route_input_lookup.isra.39.constprop.46+0x4c/0x60 [ipv6] [ 15.745012] [] ip6_route_input+0x9b/0xc0 [ipv6] [ 15.755416] [] ip6_rcv_finish+0x170/0x2a0 [ipv6] [ 15.765897] [] ipv6_rcv+0x4f5/0x8b0 [ipv6] [ 15.775849] [] __netif_receive_skb_core+0x24c/0xc00 [ 15.786590] [] __netif_receive_skb+0x1b/0x70 [ 15.796706] [] netif_receive_skb_internal+0x2d/0x1e0 [ 15.807525] [] napi_gro_receive+0x90/0x1b0 [ 15.817469] [] rtl8169_poll+0x30b/0x640 [r8169] [ 15.827855] [] net_rx_action+0x132/0x310 [ 15.837644] [] __do_softirq+0xed/0x4d0 [ 15.847232] [] irq_exit+0x8e/0xb0 [ 15.856370] [] do_IRQ+0x71/0x110 [ 15.865431] [] ret_from_intr+0x0/0x13 [ 15.874924] [] cpuidle_enter+0x17/0x20 [ 15.884503] [] cpu_startup_entry+0x287/0x7c0 [ 15.894604] [] start_secondary+0x210/0x250 [ 15.904530] IN-SOFTIRQ-R at: [ 15.910206] [] __lock_acquire+0x929/0x2230 [ 15.920174] [] lock_acquire+0xb9/0x200 [ 15.929832] [] _raw_read_lock_bh+0x48/0x80 [ 15.939810] [] ip6_pol_route.isra.41+0x67/0x3f0 [ipv6] [ 15.950856] [] ip6_pol_route_input+0x2b/0x30 [ipv6] [ 15.961631] [] fib6_rule_lookup+0x1a/0x20 [ipv6] [ 15.972154] [] ip6_route_input_lookup.isra.39.constprop.46+0x4c/0x60 [ipv6] [ 15.985043] [] ip6_route_input+0x9b/0xc0 [ipv6] [ 15.995508] [] ip6_rcv_finish+0x170/0x2a0 [ipv6] [ 16.006075] [] ipv6_rcv+0x4f5/0x8b0 [ipv6] [ 16.016080] [] __netif_receive_skb_core+0x24c/0xc00 [ 16.026872] [] __netif_receive_skb+0x1b/0x70 [ 16.037043] [] netif_receive_skb_internal+0x2d/0x1e0 [ 16.047911] [] napi_gro_receive+0x90/0x1b0 [ 16.057925] [] rtl8169_poll+0x30b/0x640 [r8169] [ 16.068355] [] net_rx_action+0x132/0x310 [ 16.078177] [] __do_softirq+0xed/0x4d0 [ 16.087844] [] irq_exit+0x8e/0xb0 [ 16.097033] [] do_IRQ+0x71/0x110 [ 16.106146] [] ret_from_intr+0x0/0x13 [ 16.115667] [] cpuidle_enter+0x17/0x20 [ 16.125271] [] cpu_startup_entry+0x287/0x7c0 [ 16.135406] [] start_secondary+0x210/0x250 [ 16.145395] INITIAL USE at: [ 16.151015] [] __lock_acquire+0x443/0x2230 [ 16.160924] [] lock_acquire+0xb9/0x200 [ 16.170531] [] _raw_write_lock_bh+0x45/0x80 [ 16.180534] [] ip6_ins_rt+0x47/0x80 [ipv6] [ 16.190463] [] __ipv6_ifa_notify+0x335/0x340 [ipv6] [ 16.201185] [] ipv6_ifa_notify+0x7c/0x130 [ipv6] [ 16.211657] [] add_addr+0x64/0x90 [ipv6] [ 16.221428] [] addrconf_notify+0x589/0xb50 [ipv6] [ 16.231995] [] notifier_call_chain+0x55/0x110 [ 16.242216] [] raw_notifier_call_chain+0x16/0x20 [ 16.252697] [] call_netdevice_notifiers_info+0x40/0x70 [ 16.263699] [] __dev_notify_flags+0x40/0xc0 [ 16.273747] [] dev_change_flags+0x5a/0x70 [ 16.283596] [] do_setlink+0x3f1/0xb50 [ 16.293090] [] rtnl_newlink+0x5bd/0x770 [ 16.302738] [] rtnetlink_rcv_msg+0x98/0x250 [ 16.312743] [] netlink_rcv_skb+0xa1/0xc0 [ 16.322487] [] rtnetlink_rcv+0x2a/0x40 [ 16.332057] [] netlink_unicast+0x146/0x1e0 [ 16.341976] [] netlink_sendmsg+0x348/0x440 [ 16.351886] [] sock_sendmsg+0x73/0x90 [ 16.361396] [] ___sys_sendmsg+0x408/0x420 [ 16.371219] [] __sys_sendmsg+0x49/0x80 [ 16.380773] [] SyS_sendmsg+0x12/0x20 [ 16.390147] [] system_call_fastpath+0x1a/0x1f [ 16.400306] } [ 16.404472] ... key at: [] __key.43500+0x0/0xffffffffffff2221 [ipv6] [ 16.415507] ... acquired at: [ 16.420999] [] check_usage_forwards+0x15b/0x160 [ 16.429956] [] mark_lock+0x444/0x760 [ 16.437959] [] __lock_acquire+0x929/0x2230 [ 16.446473] [] lock_acquire+0xb9/0x200 [ 16.454641] [] _raw_write_lock_bh+0x45/0x80 [ 16.463225] [] ip6_ins_rt+0x47/0x80 [ipv6] [ 16.471723] [] ip6_pol_route.isra.41+0x2e4/0x3f0 [ipv6] [ 16.481368] [] ip6_pol_route_input+0x2b/0x30 [ipv6] [ 16.490675] [] fib6_rule_lookup+0x1a/0x20 [ipv6] [ 16.499711] [] ip6_route_input_lookup.isra.39.constprop.46+0x4c/0x60 [ipv6] [ 16.511119] [] ip6_route_input+0x9b/0xc0 [ipv6] [ 16.520092] [] ip6_rcv_finish+0x170/0x2a0 [ipv6] [ 16.529134] [] ipv6_rcv+0x4f5/0x8b0 [ipv6] [ 16.537666] [] __netif_receive_skb_core+0x24c/0xc00 [ 16.546961] [] __netif_receive_skb+0x1b/0x70 [ 16.555692] [] netif_receive_skb_internal+0x2d/0x1e0 [ 16.565082] [] napi_gro_receive+0x90/0x1b0 [ 16.573613] [] rtl8169_poll+0x30b/0x640 [r8169] [ 16.582589] [] net_rx_action+0x132/0x310 [ 16.590965] [] __do_softirq+0xed/0x4d0 [ 16.599165] [] irq_exit+0x8e/0xb0 [ 16.606911] [] do_IRQ+0x71/0x110 [ 16.614550] [] ret_from_intr+0x0/0x13 [ 16.622598] [] cpuidle_enter+0x17/0x20 [ 16.630731] [] cpu_startup_entry+0x287/0x7c0 [ 16.639410] [] start_secondary+0x210/0x250 [ 16.647919] [ 16.651927] [ 16.651927] stack backtrace: [ 16.661241] CPU: 2 PID: 0 Comm: swapper/2 Not tainted 3.16.0-rc6+ #1 [ 16.670118] Hardware name: To be filled by O.E.M. To be filled by O.E.M./M5A97 EVO R2.0, BIOS 1503 01/16/2013 [ 16.682584] ffffffff82830c40 ffff88042da03910 ffffffff8161810e ffffffff82830c40 [ 16.692638] ffff88042da03950 ffffffff8161752f ffffffff8183b499 ffff88042b9e8760 [ 16.702704] ffff88042b9e8000 ffffffff8183b499 0000000000000000 ffffffff82830c40 [ 16.712777] Call Trace: [ 16.717802] [] dump_stack+0x4e/0x7a [ 16.726192] [] print_irq_inversion_bug.part.31+0x1b8/0x1c4 [ 16.735953] [] check_usage_forwards+0x15b/0x160 [ 16.744763] [] mark_lock+0x444/0x760 [ 16.752609] [] ? print_shortest_lock_dependencies+0x1d0/0x1d0 [ 16.762658] [] __lock_acquire+0x929/0x2230 [ 16.771050] [] ? print_shortest_lock_dependencies+0x1d0/0x1d0 [ 16.781134] [] ? find_usage_backwards+0x4e/0x90 [ 16.789996] [] lock_acquire+0xb9/0x200 [ 16.798112] [] ? ip6_ins_rt+0x47/0x80 [ipv6] [ 16.806712] [] _raw_write_lock_bh+0x45/0x80 [ 16.815218] [] ? ip6_ins_rt+0x47/0x80 [ipv6] [ 16.823794] [] ip6_ins_rt+0x47/0x80 [ipv6] [ 16.832197] [] ip6_pol_route.isra.41+0x2e4/0x3f0 [ipv6] [ 16.841744] [] ip6_pol_route_input+0x2b/0x30 [ipv6] [ 16.850959] [] fib6_rule_lookup+0x1a/0x20 [ipv6] [ 16.859888] [] ip6_route_input_lookup.isra.39.constprop.46+0x4c/0x60 [ipv6] [ 16.871192] [] ip6_route_input+0x9b/0xc0 [ipv6] [ 16.880052] [] ip6_rcv_finish+0x170/0x2a0 [ipv6] [ 16.889016] [] ipv6_rcv+0x4f5/0x8b0 [ipv6] [ 16.897427] [] ? ipv6_rcv+0x28/0x8b0 [ipv6] [ 16.905917] [] __netif_receive_skb_core+0x24c/0xc00 [ 16.915098] [] ? __netif_receive_skb_core+0x65/0xc00 [ 16.924421] [] __netif_receive_skb+0x1b/0x70 [ 16.933003] [] netif_receive_skb_internal+0x2d/0x1e0 [ 16.942280] [] napi_gro_receive+0x90/0x1b0 [ 16.950703] [] rtl8169_poll+0x30b/0x640 [r8169] [ 16.959561] [] net_rx_action+0x132/0x310 [ 16.967818] [] ? __this_cpu_preempt_check+0x13/0x20 [ 16.977041] [] __do_softirq+0xed/0x4d0 [ 16.985139] [] irq_exit+0x8e/0xb0 [ 16.992803] [] do_IRQ+0x71/0x110 [ 17.000378] [] common_interrupt+0x6f/0x6f [ 17.008764] [] ? cpuidle_enter_state+0x5f/0xd0 [ 17.018246] [] ? cpuidle_enter_state+0x5b/0xd0 [ 17.027079] [] cpuidle_enter+0x17/0x20 [ 17.035257] [] cpu_startup_entry+0x287/0x7c0 [ 17.043910] [] start_secondary+0x210/0x250 [ 28.960885] ip_tables: (C) 2000-2006 Netfilter Core Team [ 28.974767] nf_conntrack version 0.5.0 (16384 buckets, 65536 max) -- Regards/Gruss, Boris. Sent from a fat crate under my desk. Formatting is fine. -- -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/