Received: by 2002:a4a:3008:0:0:0:0:0 with SMTP id q8-v6csp3594363oof; Mon, 10 Sep 2018 17:40:01 -0700 (PDT) X-Google-Smtp-Source: ANB0VdY0QivQDBFrVFmJxMS6gS0MNUeABhexSP2sncH/RXK/e54ChO1FSDQrxfTQV3ms8HYTPE68 X-Received: by 2002:a17:902:3c5:: with SMTP id d63-v6mr24375133pld.145.1536626401243; Mon, 10 Sep 2018 17:40:01 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1536626401; cv=none; d=google.com; s=arc-20160816; b=p6gow5sBUfzn3bWFltmEEE8yDjgbs0wJSkHjwS7Hr6u7BNeXZ61rSI84G/mkxxT+Li bQKVFZ4ico9I217hVLUa9OumtiCWgWGPZCKdKbbk+LJ0w9MZUtcoN+d/4bPLm74YoAK2 SioVbexa4NNqTXBma0soSoCUAciNJlO5EYfIY/17dMgtxBQV/AxUJtu9wBYdtG8Sg/Rz ZwUClKU/wqiQ9rrmdSjHZwM0mz+xjGggAWtSq0FJTfjN0UcIOKD15W/JE3X3Xh2meXtC w8I1wAR2CAuKwIf0+BTxzrNf7WFDgEDorH4wKZ/ysHr0rHP06xPIAR13lDCWDeailJrb QlKQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=Z7FB6bqAOlG4uIEe/nr0yx2nqUjewBB/CMSvvMakjfI=; b=cRPcqidTVL2w5FdwGuE9aZ4bGjw7qy4MQ3fkacPFdxlyjmj8aSd3WPpKbf8FIztfEB AuhQ0+WQ8OaMp2/11sCQgZh3kaa1KFYSbj0tEtGq8yAM+tDuTYdsJKgFEyHeFkZZyRnS wkHn8/L3pPr9nFREbPRjsi4bDpx576Z4Sb7cXVvMkovdbqIBNpU/klvrvPkpy4MukM9u 8GtxqBapIT3PCsYhcFRxkVy6dNp2xu2AXJ+C0TnEYJ0So2v/Z7cLP3pVehmISJ3ped+v FKCUcEAsC/H5RbJeV61Ms/eJxz8C696JoOYpUAvqb6H17Q+xL9/W6hupb3PqhTycD88+ KC0Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=pqBwf4fA; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id h23-v6si17021613pgv.356.2018.09.10.17.39.45; Mon, 10 Sep 2018 17:40:01 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=pqBwf4fA; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726338AbeIKFei (ORCPT + 99 others); Tue, 11 Sep 2018 01:34:38 -0400 Received: from mail-it0-f67.google.com ([209.85.214.67]:55169 "EHLO mail-it0-f67.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725945AbeIKFeh (ORCPT ); Tue, 11 Sep 2018 01:34:37 -0400 Received: by mail-it0-f67.google.com with SMTP id f14-v6so32053877ita.4 for ; Mon, 10 Sep 2018 17:38:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Z7FB6bqAOlG4uIEe/nr0yx2nqUjewBB/CMSvvMakjfI=; b=pqBwf4fAPDJWIkQkunFO0US7T+cT09SxEgSF8P6IusI4+/OeE2G+UYRR30D2REydNp AJLw3fjYoS8PNLeMkJlqdt+MPM91LxoW2UEKTWNqamIYfty7Ih8Xb5Tz1sl0HImwgRix 1AoIdovTLRIYGQFnViN+mVRgYKx+0AS7PCg5vDEtPiTdii5WN04/LMhJXj5v63e/lix1 nOsP+osKkBxQr+E6glIynnUX9MhgIDLPg6OHnpf4afKidVzj+dgMI8UoUcXu8oVeFskb 3CJNIbuxhf+GTmkw+ee0xAm8g3QGfiak2PQneim5JEmlTrLhAc7JnC/8apQTGZoV+M2Y pRKA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Z7FB6bqAOlG4uIEe/nr0yx2nqUjewBB/CMSvvMakjfI=; b=jtzqt/jk9P600l4wp839a/CLfEaDiuCbBxWB5v/WzOU6i5M0WvuO8HBhOEoPj0iW1l kX5CKFUDiZo3JsEZfrprpqONLaf1tsdP1DpZNnA5SNWHW0Zqhpd2DjhUystZFpQ375C4 Tv5WOAvKhbsX67Iy4JRkfnblP8LrFfnvd2vxC4u3CRcxMgz/ZtMUT0zmYGCo5QiRpuuO GXMG4vQ3jQgKn22DCBjnbyIQ0DTRIGpm/2X09VHLp76lwTlNFspqZrWUvJc0KV8tlgdX gcor/6yrixlQHJgUE6pcS8aZvrBvtj8y8GH6DqHNn8hEH6ril8W9BVY7U7CexopP+ZCy pdCQ== X-Gm-Message-State: APzg51BYcqkHgkCzMQalFfg+BKAzVpGaUJDK9RgfApOmL29bNfdzCVzh fbTO9P8hZvDJ40Ka5iFKVF1A5qGB1aSZXFOWs9g= X-Received: by 2002:a24:ed84:: with SMTP id r126-v6mr21634946ith.58.1536626282318; Mon, 10 Sep 2018 17:38:02 -0700 (PDT) MIME-Version: 1.0 References: <20180910232615.4068.29155.stgit@localhost.localdomain> <20180910234400.4068.15541.stgit@localhost.localdomain> In-Reply-To: <20180910234400.4068.15541.stgit@localhost.localdomain> From: Alexander Duyck Date: Mon, 10 Sep 2018 17:37:50 -0700 Message-ID: Subject: Re: [PATCH 4/4] nvdimm: Trigger the device probe on a cpu local to the device To: linux-mm , LKML , linux-nvdimm@lists.01.org Cc: pavel.tatashin@microsoft.com, Michal Hocko , dave.jiang@intel.com, Ingo Molnar , Dave Hansen , jglisse@redhat.com, Andrew Morton , logang@deltatee.com, dan.j.williams@intel.com, "Kirill A. Shutemov" Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Sep 10, 2018 at 4:44 PM Alexander Duyck wrote: > > From: Alexander Duyck > > This patch is based off of the pci_call_probe function used to initialize > PCI devices. The general idea here is to move the probe call to a location > that is local to the memory being initialized. By doing this we can shave > significant time off of the total time needed for initialization. > > With this patch applied I see a significant reduction in overall init time > as without it the init varied between 23 and 37 seconds to initialize a 3GB > node. With this patch applied the variance is only between 23 and 26 > seconds to initialize each node. Same mistake here as in patch 1. It is 3TB, not 3GB. I will fix for the next version. - Alex