Received: by 2002:a05:6a10:af89:0:0:0:0 with SMTP id iu9csp1407969pxb; Fri, 21 Jan 2022 17:58:45 -0800 (PST) X-Google-Smtp-Source: ABdhPJxccP5JpEmH3Ws5q6H4Eum72xrwkecjTeQu8mUGlDJRO1wCZ71TY//zNyqIMBJjk7n7eoNx X-Received: by 2002:a17:90b:3010:: with SMTP id hg16mr3310497pjb.62.1642816725504; Fri, 21 Jan 2022 17:58:45 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1642816725; cv=none; d=google.com; s=arc-20160816; b=lAJY/qHixDUl1eJBgAyxL7VG+LWhGjr2NIi16hS/elrDaKZ5/CJl4y0IcKFgh1qrHM ilJI3E/19Uh+4VzagzJiZ6PMMRI1xXcBsNWPdSPyoTGyqrssDfBWpfOoFkeDcQN0cGf/ GQkHH97s9CpbQ9+0xN+ftzaJBkOrXbjmboKK4P2QPG8ptS/1m8rrCp+dXF3woaHjtDwv +q7MkvIXS4CHcHwRc6/i8ZMddh/+mTsywsLlsYpuVjbPKoQHUXeNOLWk3t2KtPetfjWm F3R1AVtgsehwOHT4lqP2atAKD0i9LZzQW/OJaWb/OQkIi6J6WouvzNxloBosBCgfOOXG cCug== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to:from :references:cc:to:content-language:subject:user-agent:mime-version :date:message-id; bh=WMfX9JSOyjGkxGPhkUnnJDI/FGXLneCPgh12oy6js3E=; b=QriKzJn2xZPy8T9cs94Qf9uscp+c4Jb1JN/NC8nRWZdm8b2fZY0s3wlC+gPib8An5t Gt13aq/tEoYq9CyJrt6QOl/CtMeaVDtwzb7dojcaAxPupZZScdv/XClD1Gm59H7lcX5O 2vyAaDnOMqPs2FTQm4JHDHmSJjHczuE8w/cEJU0byIGXuPeqM7bHKauCdj6GSdAuFziI UhK1NdhqtrEClK6BrqqRXUybZs1ibnnoLjMRJa9BakRZtbelBMeY9Jh/PGZxl2oITH7n pJyVhQrGNbtXUV9+VtXVt+GsUInxqIavYhYk6pA5fG339VYLJDFnGHcTD9iyy2x4eqpk Ngcg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id k17si6548326plc.448.2022.01.21.17.58.34; Fri, 21 Jan 2022 17:58:45 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1350058AbiAUQso (ORCPT + 99 others); Fri, 21 Jan 2022 11:48:44 -0500 Received: from out30-56.freemail.mail.aliyun.com ([115.124.30.56]:33739 "EHLO out30-56.freemail.mail.aliyun.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1349221AbiAUQsk (ORCPT ); Fri, 21 Jan 2022 11:48:40 -0500 X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R521e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=e01e04394;MF=guangguan.wang@linux.alibaba.com;NM=1;PH=DS;RN=7;SR=0;TI=SMTPD_---0V2SWIhF_1642783712; Received: from 30.39.181.79(mailfrom:guangguan.wang@linux.alibaba.com fp:SMTPD_---0V2SWIhF_1642783712) by smtp.aliyun-inc.com(127.0.0.1); Sat, 22 Jan 2022 00:48:33 +0800 Message-ID: <0b73df73-d5e8-32a8-1495-63596b256392@linux.alibaba.com> Date: Sat, 22 Jan 2022 00:48:32 +0800 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:91.0) Gecko/20100101 Thunderbird/91.5.0 Subject: Re: [RFC PATCH net-next] net/smc: Introduce receive queue flow control support Content-Language: en-US To: Tony Lu Cc: kgraul@linux.ibm.com, davem@davemloft.net, kuba@kernel.org, linux-s390@vger.kernel.org, netdev@vger.kernel.org, linux-kernel@vger.kernel.org References: <20220120065140.5385-1-guangguan.wang@linux.alibaba.com> From: Guangguan Wang In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2022/1/20 22:22, Tony Lu wrote:>> #include "smc_ib.h" >> >> -#define SMC_RMBS_PER_LGR_MAX 255 /* max. # of RMBs per link group */ >> +#define SMC_RMBS_PER_LGR_MAX 32 /* max. # of RMBs per link group. Correspondingly, >> + * SMC_WR_BUF_CNT should not be less than 2 * >> + * SMC_RMBS_PER_LGR_MAX, since every connection at >> + * least has two rq/sq credits in average, otherwise >> + * may result in waiting for credits in sending process. >> + */ > > This gives a fixed limit for per link group connections. Using tunable > knobs to control this for different workload would be better. It also > reduce the completion of free slots in the same link group and link. > It is a good idea, but I find a patch (https://lore.kernel.org/linux-s390/20220114054852.38058-7-tonylu@linux.alibaba.com/) where you have already done this idea.