Received: by 10.192.165.148 with SMTP id m20csp1528995imm; Wed, 25 Apr 2018 21:05:22 -0700 (PDT) X-Google-Smtp-Source: AIpwx4+D5tt4HINPU4a5LfNGbeOx7u8VLB90ips4WtOtAAoPGm5RntgMIY95nN9iHzaZO+52M5vh X-Received: by 2002:a17:902:4545:: with SMTP id m63-v6mr32590228pld.268.1524715521910; Wed, 25 Apr 2018 21:05:21 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1524715521; cv=none; d=google.com; s=arc-20160816; b=k/pGU+Xhr+rI+sZX+YQS2cwWeABN+Ob4x1xG3i6Q9jbrt0MjDb+AZL68nqREGxvO0w 0XTNqkcxCwFMEdQUJDR7xxVsH4epVqifrkYPJE1B1ES2ax+AOwY8UHABVMItwjUyO9Lw xrb+WzGEkmqGCtuOMv9FsXt9y3m6rLVvNTfUo4oILvY/+M1Y5kQkSbn1JY8UUFhkFHMK uERYqkMdH2Jcg9jRy9VaCSY9ey8Jfet94BiL1pf8cjUNnhOtPjpQCCEJZX+Vng2xKusX RhCfyt+snTXp64ObvT0yciMAlK2SuXCBQzmC49vKq8Nd+unvf/3jbtIqWF1IpkYmB5Sp f2yQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-language :content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:organization:from:references:cc:to:subject :dkim-signature:arc-authentication-results; bh=WFnyrrzpmanfvsFqempj9QFJDdp9+bJVZTSowQ9M9j4=; b=zngb8FecNV7R630n2AHVDYzLdNYJVw7m4Mp67CmYWz0ACkc1fYkWA3/tXnEeL3JB4x 21FbYu7rj1yrxzLG4l/p9xpA/fF/V/xRGcs7SnXEvxFgpc84BQSMbctXykl9PfuFtXUP qs6jfnCcu2Rh+rBfa4T0vmP09/ed6A0qe+zL9J/BVujK0RfViInySce9EMltp0nKGR42 IvEpHQ+ahCP/B1c+5VDOBi/QE/os4TmCCaM3dex+MikB9Heivze8tK5mbGPeWIgYK+SJ JchU02GviUY+aEzq/LDUpUY8YEp07H3I1t/ZzHhQEoB4cJ8uISPI32i1WCeQZKJBN2S/ Ou/g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2017-10-26 header.b=clTJOBdU; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id bg7-v6si18296990plb.537.2018.04.25.21.04.56; Wed, 25 Apr 2018 21:05:21 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@oracle.com header.s=corp-2017-10-26 header.b=clTJOBdU; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=oracle.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751405AbeDZEDK (ORCPT + 99 others); Thu, 26 Apr 2018 00:03:10 -0400 Received: from userp2130.oracle.com ([156.151.31.86]:53570 "EHLO userp2130.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750891AbeDZEDI (ORCPT ); Thu, 26 Apr 2018 00:03:08 -0400 Received: from pps.filterd (userp2130.oracle.com [127.0.0.1]) by userp2130.oracle.com (8.16.0.22/8.16.0.22) with SMTP id w3Q42Alu147404; Thu, 26 Apr 2018 04:02:47 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=subject : to : cc : references : from : message-id : date : mime-version : in-reply-to : content-type : content-transfer-encoding; s=corp-2017-10-26; bh=WFnyrrzpmanfvsFqempj9QFJDdp9+bJVZTSowQ9M9j4=; b=clTJOBdUH/N+uBRPAebzNSIDdzquo3dnMG7oRNRibk1L5wi7OUQL1TdCGPzxZyITtlfS POtAFjmMmXFasjrOWkN+tT/2v4T9+BVfPWNOEOzfbYc/HoD5LEyW+TWW3s7chgf8LYaT a8Gac6m1K4bdPoVHoewHm5BAWcMwuYGJQC56kL+kzkB0wbFVtprcGMcqBqgkFrddkZSp AvufF2b66CrtFyHY9WDroMFGJ5JZCfoAEhjICxuva+TYVPwpg5D/vxqpj1jo/ty8Vc6x bgLLosFHLSCmF/j6LhGdfFnQZm40XwB0DgZKuNP1iJnNqjm5sDu49sAM0elRskMduR1I 0w== Received: from userv0021.oracle.com (userv0021.oracle.com [156.151.31.71]) by userp2130.oracle.com with ESMTP id 2hfvrc1bfe-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 26 Apr 2018 04:02:47 +0000 Received: from userv0121.oracle.com (userv0121.oracle.com [156.151.31.72]) by userv0021.oracle.com (8.14.4/8.14.4) with ESMTP id w3Q42l6u027266 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 26 Apr 2018 04:02:47 GMT Received: from abhmp0007.oracle.com (abhmp0007.oracle.com [141.146.116.13]) by userv0121.oracle.com (8.14.4/8.13.8) with ESMTP id w3Q42kYq007197; Thu, 26 Apr 2018 04:02:46 GMT Received: from [10.182.71.69] (/10.182.71.69) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Wed, 25 Apr 2018 21:02:46 -0700 Subject: Re: [PATCH] IB/rxe: add RXE_START_MASK for rxe_opcode IB_OPCODE_RC_SEND_ONLY_INV To: Jianchao Wang , monis@mellanox.com, dledford@redhat.com, jgg@ziepe.ca Cc: linux-rdma@vger.kernel.org, linux-kernel@vger.kernel.org References: <1524714759-14654-1-git-send-email-jianchao.w.wang@oracle.com> From: Yanjun Zhu Organization: Oracle Corporation Message-ID: Date: Thu, 26 Apr 2018 12:02:40 +0800 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <1524714759-14654-1-git-send-email-jianchao.w.wang@oracle.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Proofpoint-Virus-Version: vendor=nai engine=5900 definitions=8874 signatures=668698 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 mlxscore=0 mlxlogscore=964 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1711220000 definitions=main-1804260038 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2018/4/26 11:52, Jianchao Wang wrote: > w/o RXE_START_MASK, the last_psn of IB_OPCODE_RC_SEND_ONLY_INV > will not be updated in update_wqe_psn, and the corresponding > wqe will not be acked in rxe_completer due to its last_psn is > zero. Finally, the other wqe will also not be able to be acked, > because the wqe of IB_OPCODE_RC_SEND_ONLY_INV with last_psn 0 > is still there. This causes large amount of io timeout when > nvmeof is over rxe. > > Add RXE_START_MASK for IB_OPCODE_RC_SEND_ONLY_INV to fix this. > > Signed-off-by: Jianchao Wang Reviewed-by: Zhu Yanjun > --- > drivers/infiniband/sw/rxe/rxe_opcode.c | 2 +- > 1 file changed, 1 insertion(+), 1 deletion(-) > > diff --git a/drivers/infiniband/sw/rxe/rxe_opcode.c b/drivers/infiniband/sw/rxe/rxe_opcode.c > index 61927c1..4cf1106 100644 > --- a/drivers/infiniband/sw/rxe/rxe_opcode.c > +++ b/drivers/infiniband/sw/rxe/rxe_opcode.c > @@ -390,7 +390,7 @@ struct rxe_opcode_info rxe_opcode[RXE_NUM_OPCODE] = { > .name = "IB_OPCODE_RC_SEND_ONLY_INV", > .mask = RXE_IETH_MASK | RXE_PAYLOAD_MASK | RXE_REQ_MASK > | RXE_COMP_MASK | RXE_RWR_MASK | RXE_SEND_MASK > - | RXE_END_MASK, > + | RXE_END_MASK | RXE_START_MASK, > .length = RXE_BTH_BYTES + RXE_IETH_BYTES, > .offset = { > [RXE_BTH] = 0,