Received: by 10.223.176.46 with SMTP id f43csp1988302wra; Sun, 21 Jan 2018 08:43:57 -0800 (PST) X-Google-Smtp-Source: AH8x227l/4VMKK5K0Z0IIheqW5qLYvxg1DMBQqQmZhq/0BZvXndSlt+nI3bnDseRa4m1x89s1vde X-Received: by 2002:a17:902:b212:: with SMTP id t18-v6mr2081927plr.293.1516553037837; Sun, 21 Jan 2018 08:43:57 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1516553037; cv=none; d=google.com; s=arc-20160816; b=LfsnDk0WJ8GFGATnyz4Abe8q1EJIOvUQzygsupI1Hgvht/obXiblbqLblywWWiH5kz jL9OtXYQ8gQRRVpWzMEw0y+8jlHiXF8Zdgex2/rnJjmgxneSK81N2jBBIxtuKiuqLkXP iPkmQO9YJI/ikvUX9VCn12zc0AeEcbz5pf6LBnMOZ+VxmK9lqiUOkEwbNCcb1AW8cF7M 4eiZstoYy5vd5ps+/VbhTC3dFNBOf2KOy8KtMsIDFwdHFg4e+URMU5k4+AewC4ZPo1jG VohzDHPPmb5E38dp8kCRTS+wRJx9s5dqgyt9E8d1cl2oI/4E68fPp6KqxmpEUgrDgLiz nPuw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :references:in-reply-to:date:cc:to:from:subject:message-id :dkim-signature:arc-authentication-results; bh=Uj0zbkVtSuPJ6KZs9WlaO7ncWvsXK2Ohtj2cCIQ4HmQ=; b=ZV0q3X39SDDM7gH60dExA4267eaIH1fYzXLpzSELWTShrgHe9sioJyle/wXskbyTpx S+heJatDYS0sF2iym8Uk9/GTVPYBDI0wydsTJ+i6qROFWVwJjBfF94pxF8WVhuZP6Rb4 /mjG4Js/JTHPEpAoQ1q3sq8EZcIVTBelSPsBJNuKc5dZXFJTYPr32Vh0utTSycv5jpxX 8hog36ytSrONMpcDKGHW3nG+r56Y1aazMwbGk8F1AkZMwGfd1IvB8+lDSlGEJVpaQwpE tWOyqLUR5DFTB5QKro/lhIO7PC44mSm4tcDlpO5sdDjVtItBcly4Onrxx3QBVMZWIZrr sJOg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=vFOmPDD4; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id n15si13886801pfh.258.2018.01.21.08.43.43; Sun, 21 Jan 2018 08:43:57 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=vFOmPDD4; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751085AbeAUQnW (ORCPT + 99 others); Sun, 21 Jan 2018 11:43:22 -0500 Received: from mail-pg0-f43.google.com ([74.125.83.43]:39002 "EHLO mail-pg0-f43.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750825AbeAUQnV (ORCPT ); Sun, 21 Jan 2018 11:43:21 -0500 Received: by mail-pg0-f43.google.com with SMTP id w17so5190908pgv.6; Sun, 21 Jan 2018 08:43:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=message-id:subject:from:to:cc:date:in-reply-to:references :mime-version:content-transfer-encoding; bh=Uj0zbkVtSuPJ6KZs9WlaO7ncWvsXK2Ohtj2cCIQ4HmQ=; b=vFOmPDD4eG1fdGMZQe9HCh10VLI92V2ZqXkmted6RWylHGyo53n9ADOcKuajsCc1hu 6rB51YZjCBHvp16Ej1gU8vDHHRg2dOObUgqMIwH1dAAQRZqzGCZl28d7TDtbQlDcYrnt C58e5/U+k+6wiXLOMrkvYTjmjxctwI2sYQDO2dreCmT1z31a6qoblNIB+2rFB548pf5g Ag56XcHbDsKEbzoNMzvZhbVDDcwvHN2JLvvPdr8N+Zv6LBT7uTN1S6HFnEU9tHT57+nu JILpyyXkRvKQDADuCSSntHE6ZLX5C1bFyPlW+h9DUV1wqnriP7BGUCWN05Bxufi2TS5b 5l/g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:subject:from:to:cc:date:in-reply-to :references:mime-version:content-transfer-encoding; bh=Uj0zbkVtSuPJ6KZs9WlaO7ncWvsXK2Ohtj2cCIQ4HmQ=; b=ioKCCNnulp5z5I4e74zLXk9iMDOv5epyAE635uliOxg6QsUp/HmMryxHM/lCmQEKvt xoHiXOWWXzSxzGrf5WUq1H9TEtMLcsfyOgk0kaQHMUzOSZKVS2sOQ1pQjeg+WPOYNYVl dZQToqzV6bVvVtrbGrQms4+nox+TvyzTIZyPlkS0tA1BN32bb86bCqA4qwqQd6pOcVTj TU4piysoKD6PSISsYF+UVdPMcJBx5Tl1YHEnAcpZuutXWSKMtBJq1ofYb9/5VClIz4Jp JeouE3XfF3LgXd4egB64b1TW6V+NydX9fOwmpWEktDAZzXUGCI8S6f0gJ3hl2t0AZQhm poYQ== X-Gm-Message-State: AKwxytcmCpE1GkU8drpwhtfgM/YqNVEkhQbT9sPE/Pj/F2gm3ZNy/Wzt gQCkQjGD9eYcoVP5QgzQdDw= X-Received: by 10.101.81.7 with SMTP id f7mr4810341pgq.451.1516553000395; Sun, 21 Jan 2018 08:43:20 -0800 (PST) Received: from edumazet-glaptop3.lan (c-67-180-167-114.hsd1.ca.comcast.net. [67.180.167.114]) by smtp.googlemail.com with ESMTPSA id e12sm23805618pgu.48.2018.01.21.08.43.19 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Sun, 21 Jan 2018 08:43:19 -0800 (PST) Message-ID: <1516552998.3478.5.camel@gmail.com> Subject: Re: [PATCH] net/mlx4_en: ensure rx_desc updating reaches HW before prod db updating From: Eric Dumazet To: Tariq Toukan , "jianchao.wang" , Jason Gunthorpe Cc: junxiao.bi@oracle.com, netdev@vger.kernel.org, linux-rdma@vger.kernel.org, linux-kernel@vger.kernel.org, Saeed Mahameed Date: Sun, 21 Jan 2018 08:43:18 -0800 In-Reply-To: <339a7156-9ef1-1f3c-30b8-3cc3558d124e@mellanox.com> References: <1515728542-3060-1-git-send-email-jianchao.w.wang@oracle.com> <339a7156-9ef1-1f3c-30b8-3cc3558d124e@mellanox.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.22.6-1+deb9u1 Mime-Version: 1.0 Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Sun, 2018-01-21 at 18:24 +0200, Tariq Toukan wrote: > > On 21/01/2018 11:31 AM, Tariq Toukan wrote: > > > > > > On 19/01/2018 5:49 PM, Eric Dumazet wrote: > > > On Fri, 2018-01-19 at 23:16 +0800, jianchao.wang wrote: > > > > Hi Tariq > > > > > > > > Very sad that the crash was reproduced again after applied the patch. > > Memory barriers vary for different Archs, can you please share more > details regarding arch and repro steps? Yeah, mlx4 NICs in Google fleet receive trillions of packets per second, and we never noticed an issue. Although we are using a slightly different driver, using order-0 pages and fast pages recycling.