Received: by 2002:ac0:a5a6:0:0:0:0:0 with SMTP id m35-v6csp327750imm; Thu, 13 Sep 2018 22:07:21 -0700 (PDT) X-Google-Smtp-Source: ANB0VdY9HxuSTEtAvaMGGQJSamNRh9Wuk/U/7nxg8Wrpq/535AYJh3g0q2dTjUfLKI+pP6maKC4G X-Received: by 2002:a63:1c61:: with SMTP id c33-v6mr9928739pgm.109.1536901641119; Thu, 13 Sep 2018 22:07:21 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1536901641; cv=none; d=google.com; s=arc-20160816; b=AoBTMpmbo4/687VasU3lgqDjpYNPymhPb9/N2sriIAMVGHWKgF7ZnYi7VimRqgpXKO swHb6Mx+BVRfh8arDj0rQ761SujYA2KFIZ5D1IpGh5TNpex+KE5KbYTFfygm9b9f2ALv Ak/FRGHcIjRh2J8oJlWzTEv32FV7ysMvfNRbpKhbOkkFJIUACx80qWQlHqif9TmhXL7T 5QcUZokHHwEQaePLQ0+G79BchmE37BG+zKY9pmDcpBDK2ix5d36vTfGJEySoL8KgHa/O iTbqkd/as8uTUZ8zl/ABtGbBcwCzB3+ZDJyUg8Kj9yW+9Tk7OP1ElBTvp7Bo4N6vUVco 6xEQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date; bh=Wby3nz7Z1TJn5sfjti7qsyGgOHJ5rbYBwjnu/NZbE0I=; b=mpS+Ig2w6HwaP3kPQwrTh71nueZBMKT2zCAiYnzUfNxjuJUqNSU8bC2dZpA6h52K+U O/JpB5XoDhC8OIg6NM5vGkV7ngjBqYqKgNVZJ2u700sRQ3kgKkTA/f2dO6WUUeMhukYp dS6dacLhAqoT4/hBjquWZ8nQbOdFZV1o841//cxGyUlyutf90c7qs7LebxMobEf9osSh nUBymzwUd35dCYhj9TKQza1/Kxa9ISML3Fc6i6gy4IfT4jZhbEp5FmNVcaHIUHuaj9v+ n2DCeReDay9t0Zb22c5q2C9jGhgyAGXtGBJepZHT2gIr/PziivOTfkRKWftJcLQCIR/f R//w== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id y6-v6si6041702plp.279.2018.09.13.22.07.04; Thu, 13 Sep 2018 22:07:21 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727384AbeINKTk (ORCPT + 99 others); Fri, 14 Sep 2018 06:19:40 -0400 Received: from a.mx.secunet.com ([62.96.220.36]:45684 "EHLO a.mx.secunet.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726756AbeINKTk (ORCPT ); Fri, 14 Sep 2018 06:19:40 -0400 Received: from localhost (localhost [127.0.0.1]) by a.mx.secunet.com (Postfix) with ESMTP id CD1C4201D5; Fri, 14 Sep 2018 09:06:36 +0200 (CEST) X-Virus-Scanned: by secunet Received: from a.mx.secunet.com ([127.0.0.1]) by localhost (a.mx.secunet.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qIw_a_sAuVdG; Fri, 14 Sep 2018 09:06:34 +0200 (CEST) Received: from mail-essen-02.secunet.de (mail-essen-02.secunet.de [10.53.40.205]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by a.mx.secunet.com (Postfix) with ESMTPS id 9B9EB20097; Fri, 14 Sep 2018 09:06:34 +0200 (CEST) Received: from gauss2.secunet.de (10.182.7.193) by mail-essen-02.secunet.de (10.53.40.205) with Microsoft SMTP Server id 14.3.408.0; Fri, 14 Sep 2018 07:06:51 +0200 Received: by gauss2.secunet.de (Postfix, from userid 1000) id 34F22318060A; Fri, 14 Sep 2018 07:06:51 +0200 (CEST) Date: Fri, 14 Sep 2018 07:06:51 +0200 From: Steffen Klassert To: Florian Westphal CC: David Miller , , , , , Subject: Re: Regression: kernel 4.14 an later very slow with many ipsec tunnels Message-ID: <20180914050651.GD23674@gauss3.secunet.de> References: <20180913135844.3ut6fxgx67t6ndtu@breakpoint.cc> <3448099.9yk84El3Sa@stwm.de> <20180913163848.ni5xc4gc4d6uusdn@breakpoint.cc> <20180913.102305.939671149040995911.davem@davemloft.net> <20180913210325.5usfj2rorvuvtyc7@breakpoint.cc> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <20180913210325.5usfj2rorvuvtyc7@breakpoint.cc> User-Agent: Mutt/1.9.4 (2018-02-28) X-G-Data-MailSecurity-for-Exchange-State: 0 X-G-Data-MailSecurity-for-Exchange-Error: 0 X-G-Data-MailSecurity-for-Exchange-Sender: 23 X-G-Data-MailSecurity-for-Exchange-Server: cbe3d3f7-b9e3-4256-b890-f24c4306a01c X-EXCLAIMER-MD-CONFIG: 2c86f778-e09b-4440-8b15-867914633a10 X-G-Data-MailSecurity-for-Exchange-Guid: 5A3DAFA0-D46D-459B-ADC5-B24AE2ECD78E Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Sep 13, 2018 at 11:03:25PM +0200, Florian Westphal wrote: > David Miller wrote: > > From: Florian Westphal > > Date: Thu, 13 Sep 2018 18:38:48 +0200 > > > > > Wolfgang Walter wrote: > > >> What I can say is that it depends mainly on number of policy rules and SA. > > > > > > Thats already a good hint, I guess we're hitting long hash chains in > > > xfrm_policy_lookup_bytype(). > > > > I don't really see how recent changes can influence that. > > I don't think there is a recent change that did this. > > Walter says < 4.14 is ok, so this is likely related to flow cache removal. > > F.e. it looks like all prefixed policies end up in a linked list > (net->xfrm.policy_inexact) and are not even in a hash table. > > I am staring at b58555f1767c9f4e330fcf168e4e753d2d9196e0 > but can't figure out how to configure that away from the > 'no hashing for prefixed policies' default or why we even have > policy_inexact in first place :/ The hash threshold can be configured like this: ip x p set hthresh4 0 0 This sets the hash threshold to local /0 and remote /0 netmasks. With this configuration, all policies should go to the hashtable. This might help to balance the hash chains better. Default hash thresholds are local /32 and remote /32 netmasks, so all prefixed policies go to the inexact list. To view the configuration: ip -s -s x p count