Received: by 2002:a05:6358:3188:b0:123:57c1:9b43 with SMTP id q8csp31702288rwd; Fri, 7 Jul 2023 03:15:28 -0700 (PDT) X-Google-Smtp-Source: APBJJlH5REri7tM9q8Zx7Hy19l5VDH19wm1gGne1fRjd6vPaEv0mPgwKeDsebO46FJdfCTNr1tS3 X-Received: by 2002:a05:6870:e24a:b0:1b3:b987:26a5 with SMTP id d10-20020a056870e24a00b001b3b98726a5mr5812315oac.4.1688724928617; Fri, 07 Jul 2023 03:15:28 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1688724928; cv=none; d=google.com; s=arc-20160816; b=dNmuEE3vJRmrpZdnZ3PmzfwX23BjFb8gR3C8eIJfn2HQDYjjds7JXdaYEtqgY5L0Io 27jSVOvWgG5p4+L/ww3hQC401eYL8QpQXe2C0W9oG//0ke67jVLAxc+8cdKUFlHsqzIR su61H0PzgPA3QThpAQu5g7q3ZF1wFwHJsHQRSOmsT8etAnZwWUIez+cO4Ku9F8E6E2fs YEPVeqg54sok/SIyKKWHUgkZK008qsXaen5mFgodWwLmtxO/kdkYHlP9mOPqJ8Lofp38 KS1dju93+0m7nd6t2qXyj8fsWizzzPIon9xFcp7QZLL0qDL8T0ZlhL26+wBHHvwkQwfA o7Tg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:user-agent:in-reply-to:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :dkim-signature:dkim-filter; bh=a/sMoA43bpwnpyt6+FH3u3GT4BVZVjsgGoWC97yYW/g=; fh=QkZ6mz6I+1sHmUWHDTN5FbuGLhkvpmIF0HzZNn5Pxdg=; b=p8RewiYBhFvDvYJCWaXGinb0tPhSGRhKnvDdSv6h6yesf+o8TsHpA8UIzZJSRMWT/g iXYYonIjik5SCYRPds75yXW+nfc3X7PbFFmtCWanMvfWZzzyQr4SfQJCRdiL2zo6k0do boPOlCf3qyBhXm016R/Ipwiexe+fUbO94ekHtiC5rJ+koLjhOdQTWarBUB/XEqQ10KoJ UqfVaVdVmV8ukNxk9XhC6gAa+9T1YHn7xUKTho7mM+nZ9tOyLm23nnvzQoLKC39OUkIM n/eKiFjGnQ2vH4WE98aUORDvo3BAlThBRbgjpr7527jt85v5e6PDfPbFCCE617s3WDGR mYDw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linux.microsoft.com header.s=default header.b=GSx803oo; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linux.microsoft.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id u11-20020a170903124b00b001b8866a4abfsi3624611plh.82.2023.07.07.03.15.14; Fri, 07 Jul 2023 03:15:28 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@linux.microsoft.com header.s=default header.b=GSx803oo; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linux.microsoft.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232506AbjGGJsb (ORCPT + 99 others); Fri, 7 Jul 2023 05:48:31 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:57550 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232308AbjGGJsa (ORCPT ); Fri, 7 Jul 2023 05:48:30 -0400 Received: from linux.microsoft.com (linux.microsoft.com [13.77.154.182]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 91E6E1737; Fri, 7 Jul 2023 02:48:28 -0700 (PDT) Received: by linux.microsoft.com (Postfix, from userid 1099) id 22F1820AECAD; Fri, 7 Jul 2023 02:48:28 -0700 (PDT) DKIM-Filter: OpenDKIM Filter v2.11.0 linux.microsoft.com 22F1820AECAD DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.microsoft.com; s=default; t=1688723308; bh=a/sMoA43bpwnpyt6+FH3u3GT4BVZVjsgGoWC97yYW/g=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=GSx803oog6rdYrpf3jRJBkWqXBZVNAZqcps9Vt5S2uPe4B6rG6pQOhhoqqP2aFnKp +gFRCCimxlBsYacECU36xPNQlIj7IZ10qEMQxoo9rzjPpeAJ5O1IsWFHEIEo0PxFGt ni+Wn5wE3gAsRga9tFvPURDh93O9S1XgrMhap9Xg= Date: Fri, 7 Jul 2023 02:48:28 -0700 From: Souradeep Chakrabarti To: Saurabh Singh Sengar Cc: KY Srinivasan , Haiyang Zhang , "wei.liu@kernel.org" , Dexuan Cui , "davem@davemloft.net" , "edumazet@google.com" , "kuba@kernel.org" , "pabeni@redhat.com" , Long Li , Ajay Sharma , "leon@kernel.org" , "cai.huoqing@linux.dev" , "ssengar@linux.microsoft.com" , "vkuznets@redhat.com" , "tglx@linutronix.de" , "linux-hyperv@vger.kernel.org" , "netdev@vger.kernel.org" , "linux-kernel@vger.kernel.org" , "linux-rdma@vger.kernel.org" , "stable@vger.kernel.org" , Souradeep Chakrabarti Subject: Re: [PATCH net] net: mana: Configure hwc timeout from hardware Message-ID: <20230707094828.GA15082@linuxonhyperv3.guj3yctzbm1etfxqx2vob5hsef.xx.internal.cloudapp.net> References: <1688549578-12906-1-git-send-email-schakrabarti@linux.microsoft.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-Spam-Status: No, score=-19.8 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,ENV_AND_HDR_SPF_MATCH,RCVD_IN_DNSWL_MED, SPF_HELO_PASS,SPF_PASS,T_SCC_BODY_TEXT_LINE,USER_IN_DEF_DKIM_WL, USER_IN_DEF_SPF_WL autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Jul 05, 2023 at 11:11:50AM +0000, Saurabh Singh Sengar wrote: > > > > -----Original Message----- > > From: Souradeep Chakrabarti > > Sent: Wednesday, July 5, 2023 3:03 PM > > To: KY Srinivasan ; Haiyang Zhang > > ; wei.liu@kernel.org; Dexuan Cui > > ; davem@davemloft.net; edumazet@google.com; > > kuba@kernel.org; pabeni@redhat.com; Long Li ; Ajay > > Sharma ; leon@kernel.org; > > cai.huoqing@linux.dev; ssengar@linux.microsoft.com; > > vkuznets@redhat.com; tglx@linutronix.de; linux-hyperv@vger.kernel.org; > > netdev@vger.kernel.org; linux-kernel@vger.kernel.org; linux- > > rdma@vger.kernel.org > > Cc: stable@vger.kernel.org; Souradeep Chakrabarti > > ; Souradeep Chakrabarti > > > > Subject: [PATCH net] net: mana: Configure hwc timeout from hardware > > > > At present hwc timeout value is a fixed value. > > This patch sets the hwc timeout from the hardware. > > > > Signed-off-by: Souradeep Chakrabarti > > --- > > .../net/ethernet/microsoft/mana/gdma_main.c | 27 +++++++++++++++++++ > > .../net/ethernet/microsoft/mana/hw_channel.c | 25 ++++++++++++++++- > > include/net/mana/gdma.h | 20 +++++++++++++- > > include/net/mana/hw_channel.h | 5 ++++ > > 4 files changed, 75 insertions(+), 2 deletions(-) > > > > diff --git a/drivers/net/ethernet/microsoft/mana/gdma_main.c > > b/drivers/net/ethernet/microsoft/mana/gdma_main.c > > index 8f3f78b68592..5d30347e0137 100644 > > --- a/drivers/net/ethernet/microsoft/mana/gdma_main.c > > +++ b/drivers/net/ethernet/microsoft/mana/gdma_main.c > > @@ -106,6 +106,30 @@ static int mana_gd_query_max_resources(struct > > pci_dev *pdev) > > return 0; > > } > > > > +static int mana_gd_query_hwc_timeout(struct pci_dev *pdev, u32 > > +*timeout_val) { > > + struct gdma_context *gc = pci_get_drvdata(pdev); > > + struct gdma_query_hwc_timeout_req req = {}; > > + struct gdma_query_hwc_timeout_resp resp = {}; > > + int err; > > + > > + mana_gd_init_req_hdr(&req.hdr, GDMA_QUERY_HWC_TIMEOUT, > > + sizeof(req), sizeof(resp)); > > + req.timeout_ms = *timeout_val; > > + err = mana_gd_send_request(gc, sizeof(req), &req, sizeof(resp), > > &resp); > > + if (err || resp.hdr.status) { > > + dev_err(gc->dev, "Failed to query timeout: %d, 0x%x\n", err, > > + resp.hdr.status); > > + return err ? err : -EPROTO; > > + } > > + > > + *timeout_val = resp.timeout_ms; > > + dev_info(gc->dev, "Successfully changed the timeout value %u\n", > > + *timeout_val); > > + > > + return 0; > > +} > > + > > static int mana_gd_detect_devices(struct pci_dev *pdev) { > > struct gdma_context *gc = pci_get_drvdata(pdev); @@ -879,6 +903,7 > > @@ int mana_gd_verify_vf_version(struct pci_dev *pdev) > > struct gdma_context *gc = pci_get_drvdata(pdev); > > struct gdma_verify_ver_resp resp = {}; > > struct gdma_verify_ver_req req = {}; > > + struct hw_channel_context *hwc = gc->hwc.driver_data; > > int err; > > > > mana_gd_init_req_hdr(&req.hdr, > > GDMA_VERIFY_VF_DRIVER_VERSION, @@ -907,6 +932,8 @@ int > > mana_gd_verify_vf_version(struct pci_dev *pdev) > > err, resp.hdr.status); > > return err ? err : -EPROTO; > > } > > + if (resp.pf_cap_flags1 & > > GDMA_DRV_CAP_FLAG_1_HWC_TIMEOUT_RECONFIG) > > + mana_gd_query_hwc_timeout(pdev, &hwc->hwc_timeout); > > > > return 0; > > } > > diff --git a/drivers/net/ethernet/microsoft/mana/hw_channel.c > > b/drivers/net/ethernet/microsoft/mana/hw_channel.c > > index 9d1507eba5b9..f5980c26fd09 100644 > > --- a/drivers/net/ethernet/microsoft/mana/hw_channel.c > > +++ b/drivers/net/ethernet/microsoft/mana/hw_channel.c > > @@ -174,7 +174,25 @@ static void mana_hwc_init_event_handler(void *ctx, > > struct gdma_queue *q_self, > > complete(&hwc->hwc_init_eqe_comp); > > break; > > > > + case GDMA_EQE_HWC_SOC_RECONFIG_DATA: > > + type_data.as_uint32 = event->details[0]; > > + type = type_data.type; > > + val = type_data.value; > > + > > + switch (type) { > > + case HWC_DATA_CFG_HWC_TIMEOUT: > > + hwc->hwc_timeout = val; > > + break; > > + > > + default: > > + dev_warn(hwc->dev, "Received unknown reconfig > > type %u\n", type); > > + break; > > + } > > + > > + break; > > + > > default: > > + dev_warn(hwc->dev, "Received unknown gdma event %u\n", > > event->type); > > /* Ignore unknown events, which should never happen. */ > > break; > > } > > @@ -704,6 +722,7 @@ int mana_hwc_create_channel(struct gdma_context > > *gc) > > gd->pdid = INVALID_PDID; > > gd->doorbell = INVALID_DOORBELL; > > > > + hwc->hwc_timeout = > > HW_CHANNEL_WAIT_RESOURCE_TIMEOUT_MS; > > /* mana_hwc_init_queues() only creates the required data structures, > > * and doesn't touch the HWC device. > > */ > > @@ -770,6 +789,8 @@ void mana_hwc_destroy_channel(struct > > gdma_context *gc) > > hwc->gdma_dev->doorbell = INVALID_DOORBELL; > > hwc->gdma_dev->pdid = INVALID_PDID; > > > > + hwc->hwc_timeout = 0; > > + > > kfree(hwc); > > gc->hwc.driver_data = NULL; > > gc->hwc.gdma_context = NULL; > > @@ -818,6 +839,7 @@ int mana_hwc_send_request(struct > > hw_channel_context *hwc, u32 req_len, > > dest_vrq = hwc->pf_dest_vrq_id; > > dest_vrcq = hwc->pf_dest_vrcq_id; > > } > > + dev_err(hwc->dev, "HWC: timeout %u ms\n", hwc->hwc_timeout); > > Can avoid dev_err here I have fixed it in v2 patch > > > > > err = mana_hwc_post_tx_wqe(txq, tx_wr, dest_vrq, dest_vrcq, false); > > if (err) { > > @@ -825,7 +847,8 @@ int mana_hwc_send_request(struct > > hw_channel_context *hwc, u32 req_len, > > goto out; > > } > > > > - if (!wait_for_completion_timeout(&ctx->comp_event, 30 * HZ)) { > > + if (!wait_for_completion_timeout(&ctx->comp_event, > > + (hwc->hwc_timeout / 1000) * HZ)) { > > dev_err(hwc->dev, "HWC: Request timed out!\n"); > > err = -ETIMEDOUT; > > goto out; > > diff --git a/include/net/mana/gdma.h b/include/net/mana/gdma.h index > > 96c120160f15..88b6ef7ce1a6 100644 > > --- a/include/net/mana/gdma.h > > +++ b/include/net/mana/gdma.h > > @@ -33,6 +33,7 @@ enum gdma_request_type { > > GDMA_DESTROY_PD = 30, > > GDMA_CREATE_MR = 31, > > GDMA_DESTROY_MR = 32, > > + GDMA_QUERY_HWC_TIMEOUT = 84, /* 0x54 */ > > }; > > > > #define GDMA_RESOURCE_DOORBELL_PAGE 27 > > @@ -57,6 +58,8 @@ enum gdma_eqe_type { > > GDMA_EQE_HWC_INIT_EQ_ID_DB = 129, > > GDMA_EQE_HWC_INIT_DATA = 130, > > GDMA_EQE_HWC_INIT_DONE = 131, > > + GDMA_EQE_HWC_SOC_RECONFIG = 132, > > + GDMA_EQE_HWC_SOC_RECONFIG_DATA = 133, > > }; > > > > enum { > > @@ -531,10 +534,12 @@ enum { > > * so the driver is able to reliably support features like busy_poll. > > */ > > #define GDMA_DRV_CAP_FLAG_1_NAPI_WKDONE_FIX BIT(2) > > +#define GDMA_DRV_CAP_FLAG_1_HWC_TIMEOUT_RECONFIG BIT(3) > > > > #define GDMA_DRV_CAP_FLAGS1 \ > > (GDMA_DRV_CAP_FLAG_1_EQ_SHARING_MULTI_VPORT | \ > > - GDMA_DRV_CAP_FLAG_1_NAPI_WKDONE_FIX) > > + GDMA_DRV_CAP_FLAG_1_NAPI_WKDONE_FIX | \ > > + GDMA_DRV_CAP_FLAG_1_HWC_TIMEOUT_RECONFIG) > > > > #define GDMA_DRV_CAP_FLAGS2 0 > > > > @@ -664,6 +669,19 @@ struct gdma_disable_queue_req { > > u32 alloc_res_id_on_creation; > > }; /* HW DATA */ > > > > +/* GDMA_QUERY_HWC_TIMEOUT */ > > +struct gdma_query_hwc_timeout_req { > > + struct gdma_req_hdr hdr; > > + u32 timeout_ms; > > + u32 reserved; > > +}; > > + > > +struct gdma_query_hwc_timeout_resp { > > + struct gdma_resp_hdr hdr; > > + u32 timeout_ms; > > + u32 reserved; > > +}; > > + > > enum atb_page_size { > > ATB_PAGE_SIZE_4K, > > ATB_PAGE_SIZE_8K, > > diff --git a/include/net/mana/hw_channel.h > > b/include/net/mana/hw_channel.h index 6a757a6e2732..3d3b5c881bc1 > > 100644 > > --- a/include/net/mana/hw_channel.h > > +++ b/include/net/mana/hw_channel.h > > @@ -23,6 +23,10 @@ > > #define HWC_INIT_DATA_PF_DEST_RQ_ID 10 > > #define HWC_INIT_DATA_PF_DEST_CQ_ID 11 > > > > +#define HWC_DATA_CFG_HWC_TIMEOUT 1 > > + > > +#define HW_CHANNEL_WAIT_RESOURCE_TIMEOUT_MS 30000 > > + > > /* Structures labeled with "HW DATA" are exchanged with the hardware. All > > of > > * them are naturally aligned and hence don't need __packed. > > */ > > @@ -182,6 +186,7 @@ struct hw_channel_context { > > > > u32 pf_dest_vrq_id; > > u32 pf_dest_vrcq_id; > > + u32 hwc_timeout; > > > > struct hwc_caller_ctx *caller_ctx; > > }; > > -- > > 2.34.1