Received: by 2002:ac0:a5a7:0:0:0:0:0 with SMTP id m36-v6csp4513096imm; Sat, 21 Jul 2018 22:33:17 -0700 (PDT) X-Google-Smtp-Source: AAOMgpejZj+nmksWNDTYCJXyaXd1w+U5dcZy5MDjGpgqlkUHoWOAHnAzZCQP4V17wYj+Awh19n4N X-Received: by 2002:a17:902:708b:: with SMTP id z11-v6mr7881816plk.262.1532237597911; Sat, 21 Jul 2018 22:33:17 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1532237597; cv=none; d=google.com; s=arc-20160816; b=BG/VpMKgdw0KdTtOfioUAk24sstCPZKIc4e//fMLZPbKRLFFBz6v0hq2D4iRt3O9Wt IwIc+uoIG5R6uhuvusS71i3wm9gIeuJWZRIO6J2WzXSjEbJfYvoxrGsnoc92EUj3ac/D 2fcYagUMISRgGA/B64acpqF21xNKz9BTNPrksvBoRTx6jjIFpNSU9p9UXZM4yphR+t9m wyRvKiMQUaS5HDXBvHWctIW+re+aSmjA2INRFNOWqByLgogQgfd4sM0ARhZ1uf3gcSG7 22r+bSVVOSO7NHwZiRzvGkVdPpmBIlojkGJLsVvVEcfhFw58vskZGjFZQgteKG/h64ro VsXQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:subject:openpgp:from:references:cc:to:dkim-signature :arc-authentication-results; bh=QWJIKdH0ytydD1bXsTYnDfNlvp/z/S2KAdC8oL8MDuM=; b=v5EaHBHOxivfTotdTeFquvkYJWyI4i8YEHen/NGE/jYrHSQrRBlA+qlNfPiiC9vYEZ 11QZHA9RVkwaIH3FYAeJNFPkJ2lhRAoECzqoaG+VLo/ONQcgS4SZ1hV9Ur6OZXh4lHN0 dvUPbj19h1yuj7535wPlMiQMRLweMWs8CJLQ28KaEUs9D5dB++uAKiaRJbz9Tbv3B9ai StE6/8O4vdG00USiiWC64Vv7N5JAPxTpObsTDcaGMbnMmqrCXbKOyNm3g7ZvNWCtvls8 +zSv0Vir19pVZrJKin/wHUD6qWKdzuSSgz5Y49yhK2IJVjavJCtV+9dqzUwRDjBooAMT GCHw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@ka9q-net.20150623.gappssmtp.com header.s=20150623 header.b=ixJLm7ur; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id d22-v6si5622644pfj.311.2018.07.21.22.33.03; Sat, 21 Jul 2018 22:33:17 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@ka9q-net.20150623.gappssmtp.com header.s=20150623 header.b=ixJLm7ur; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727990AbeGVG13 (ORCPT + 99 others); Sun, 22 Jul 2018 02:27:29 -0400 Received: from mail-pf1-f175.google.com ([209.85.210.175]:46925 "EHLO mail-pf1-f175.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727793AbeGVG13 (ORCPT ); Sun, 22 Jul 2018 02:27:29 -0400 Received: by mail-pf1-f175.google.com with SMTP id u24-v6so355872pfn.13 for ; Sat, 21 Jul 2018 22:32:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ka9q-net.20150623.gappssmtp.com; s=20150623; h=to:cc:references:from:openpgp:subject:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=QWJIKdH0ytydD1bXsTYnDfNlvp/z/S2KAdC8oL8MDuM=; b=ixJLm7urWiifEGhlL2Zz/zgdyEzVL6Kz3KNyPc9BZerlnr8GTbqCiJyneqTwmupAkc 68Jy9dOD/twK64Pv3UfuBe8lSfU2aK6SmOoNsjFgpm6PEzpazgw8xBQdqn7cbUgu4X5p 4SCPbN6eqpG5kk3gmkJvDesInXmrjaHsQUjMP3jTjPdIBMK25m4i1tu4uetG7BRXqBId eNkN/Y5Iz3CEzMpiiFtTFhT1qqVwBGtCGLsN+lcQ5zOYdhKwRQLihr8b8g9tsUG4Q7VC ZfkCDAJe3rciHh4Kptx9ZBe5H4AayIi0i4U9XwUm09q8uv9G2tHCLqlaMnSksnzFX0Hf fOCw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:cc:references:from:openpgp:subject:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=QWJIKdH0ytydD1bXsTYnDfNlvp/z/S2KAdC8oL8MDuM=; b=PRzlZvM72cAHSr0VdC6QX4UMR3RkHxwfSZVxVzc+BCsn8DpRKtTlEBwEZ3jLX/05SZ 4hheQ0ZBTv0GmfHzM2IYVM+KMMinbhxFboFJNT6IsTiLkTbATzylvWz+dgbH146mHP4u AIH8J6zcN23pv8qz5H00fIFoukoWpAIrkU44j6g2G4MLmnEEea7qW0v3uwcMXz6d+tZA AwNe5fh8bdYWNTxNICUqGQ4kyc6LgAr6XmoIHYTZe6VD2Oo10v0vv3P76xnLxkZ+eV1m dsfxoZ4ujDocTQ8XClKJ5s+BKIVwpulaSKcWNNApbK4oP0jHG4p9DfuCxGS2O+5BZU88 scOQ== X-Gm-Message-State: AOUpUlEHmNI/EtN5sBmf584ZeUCv9hNIf7369Rezspjxatt1tfDZzDPX TE6ePGqdlb6HvENjzAyhYz7tjw== X-Received: by 2002:a62:2b4c:: with SMTP id r73-v6mr8277771pfr.134.1532237525530; Sat, 21 Jul 2018 22:32:05 -0700 (PDT) Received: from patty.ka9q.net ([2605:e000:1c0e:4055:ec02:f11d:3638:80f5]) by smtp.gmail.com with ESMTPSA id t63-v6sm7694585pgt.57.2018.07.21.22.32.03 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 21 Jul 2018 22:32:03 -0700 (PDT) To: David Miller Cc: kuznet@ms2.inr.ac.ru, yoshfuji@linux-ipv6.org, netdev@vger.kernel.org, linux-kernel@vger.kernel.org References: <147f730b-8cbf-b76d-f693-b3fdaf72a89c@ka9q.net> <20180721.220309.1193443933653884021.davem@davemloft.net> From: Phil Karn Openpgp: preference=signencrypt Subject: Re: hard-coded limit on unresolved multicast route cache in ipv4/ipmr.c causes slow, unreliable creation of multicast routes on busy networks Message-ID: <0e085e9b-1e49-126c-f5f7-6ce2cfdd478d@ka9q.net> Date: Sat, 21 Jul 2018 22:32:02 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: <20180721.220309.1193443933653884021.davem@davemloft.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 07/21/2018 10:03 PM, David Miller wrote: > There does have to be some limit, because we are depending upon a user > process (mrouted or whatever) to receive the netlink message, resolve > the cache entry, and update the kernel. Wow, thanks for the quick response. I notice that an "unresolved" entry seems to be created whenever the router sees multicast traffic from a particular source to a particular group. The entry seems to "resolve" when an IGMP membership message is also seen for that particular group. There are a whole bunch of active multicast streams on my UCSD network segment for which there are apparently no listeners, and that seems to be why I always see a mroute cache full of "unresolved" entries. (If I run a local application that joins a group, the entry "resolves".) What puzzles me is that the Iif field is given as "unresolved" even though we know where the multicast traffic is coming from. We only don't know who might want it. I'm intimately familiar with unicast IP but I'm still learning about multicast routing so I am probably missing something important. I tried a workaround by using iptables to block the unwanted multicast traffic (the senders are on one well-defined non-local subnet). I created drop entries in both the INPUT and FORWARD chains but the hit counts remain zero. I guess the mroute table is populated before the packets reach netfilter. Is that how it should work? Phil