Received: by 2002:ac0:a5a7:0:0:0:0:0 with SMTP id m36-v6csp3840629imm; Mon, 30 Jul 2018 04:34:08 -0700 (PDT) X-Google-Smtp-Source: AAOMgpe1Ub5qVMzWW3wuXY8pBteB6BogNFAQTKXA4u8sC+Xx4+rQJ/KlWsMCc7jBS/LXcqeQlYb5 X-Received: by 2002:a62:3306:: with SMTP id z6-v6mr17187046pfz.85.1532950448733; Mon, 30 Jul 2018 04:34:08 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1532950448; cv=none; d=google.com; s=arc-20160816; b=cAL4OmlAu1UeIySgE3E+aP/LDkFT4TYx27VBQtb9gRXCtyns/tuPU1zzHnE1A1+m2N S4APxpJbRrzu8dx/6BgLLWpbYDgArunJHzixnDKa5R0s/IeH7VX6idgyCASvXVC4rsIX WAK79IbW9v6LXzpFrNbS7KXeEa1tuRr/tjIcObQS/tMUQWM8+i+kxkxpD6mGlnmxi/Bu H+1gaV6/S0DiVsHwngvpv4wzmfVrorcV+8PdM9JTO2cMqRNVu0f27uj0LKra79q168FV uEly7HXGWWnIQQ5yP23HKDLOsJExWJsLnwpi59vG0d+ZZzGCi1WXxGhEhmfvnBg5mzfV At2g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:dkim-signature:arc-authentication-results; bh=ZFfXN/qfEFg2u5Cm17benULjMPnGAIyAtMVyGj+bs7M=; b=JRFwhwNJw8Em/gdRPTE7gFTXbuN/BNrICxXIZlBk0SKU5OdhPqaI9qZ1egGN91NcrG 09W/ILQjaet3VRbMgx9a8SqRQ3nXQACcWK58rJFsBQ5TkmFOf3VdpkvTD+OOVfFCNJ+H 0IynkaxMfkWUW8yddlaqN8WG1ArOmig0uOpaPubYpa6FKWjrX9ZHel1vYG3Kdsvx9YBr n34OtwYgVPJIjCrPDkt9xAVL/gc0ZtR1auTkamqce3te+IBaE986K/m5KTVrqwpNo5Zx 8D49BVoeLAAbb3nevleUzukj+f2Ch/T2IdbU+rAt7yLN2kW6QPzDT9AeS167/ag9ANAs Z7DQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@gmail.com header.s=20161025 header.b=VLzwUdNf; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id x68-v6si10648031pfc.239.2018.07.30.04.33.53; Mon, 30 Jul 2018 04:34:08 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=fail header.i=@gmail.com header.s=20161025 header.b=VLzwUdNf; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727642AbeG3NHZ (ORCPT + 99 others); Mon, 30 Jul 2018 09:07:25 -0400 Received: from mail-wr1-f66.google.com ([209.85.221.66]:46634 "EHLO mail-wr1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726884AbeG3NHZ (ORCPT ); Mon, 30 Jul 2018 09:07:25 -0400 Received: by mail-wr1-f66.google.com with SMTP id h14-v6so12494603wrw.13 for ; Mon, 30 Jul 2018 04:32:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=ZFfXN/qfEFg2u5Cm17benULjMPnGAIyAtMVyGj+bs7M=; b=VLzwUdNfe4/8KuHEd8VARVomOYL0xcjUThe9/T7EZDL9wXNVpj255Mqv43DFKiuwbF YU7BRJ4XfSHJv5Gz3cbSB4P4nq3ciaZWSP8ZkaGu/dwfDPFaEZLx7qJKd6VSemtMCAX9 AK2yLLexdYJDjoqKS6zq+8+tSxGYEFRAzcdtdU8OsR+tIvRq3fiHCeqODtCcGQMmApjc 2ynpaE7BQkBWiaIyuYfO70lEPrNpmbeGltWWYEhjUrwqPncasD8PHEPJBqfsjb3UnE6u ynoRXA/ej1wuW8oDklcArUU8q8znqoTX1HNSGizC9m9JK4aO36zvsr1Umv2d+GEkBmCO yRMA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to:user-agent; bh=ZFfXN/qfEFg2u5Cm17benULjMPnGAIyAtMVyGj+bs7M=; b=Nbq9hMnBu7wV6aDRpI4xjyNv9LEA0eHflKqqgV6po69vo2Z7qFipaQCCJf3kmlnsxz 1yPasg+/xD/OhE8IndJrJhFFSwA+L3Fj0XJ9V5g9zR10+G+tw1fm5E5yjpgSMxKuYu5b MunidFIDD9YZD+EuSxOubbinmy38cNorrM5FDJy7HEfKsYOtHd9gE+UY3Cg1r6N9a5ql ERtfEQFWa2yjDPC38wvYcQuf/DEsz0d03MP3XKR6JrgwTSO0VLskLiezI1pprpC/DF1+ QIFrdYejERCUapmJ7nuJ8ExThmA90LyWaySwHqYr3eQPbEShnN5XgB60/oxeutN2J6LW /eWQ== X-Gm-Message-State: AOUpUlEcwoAsUBu6fmRHh4ftbZnSF0J3qEo0QZBYCBNHWJ8t82hwWp8V E2GiGoGiyI4G1LJsCab2WU0= X-Received: by 2002:adf:8503:: with SMTP id 3-v6mr17827466wrh.100.1532950370780; Mon, 30 Jul 2018 04:32:50 -0700 (PDT) Received: from gmail.com (2E8B0CD5.catv.pool.telekom.hu. [46.139.12.213]) by smtp.gmail.com with ESMTPSA id x7-v6sm20844269wrr.95.2018.07.30.04.32.49 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Mon, 30 Jul 2018 04:32:50 -0700 (PDT) Date: Mon, 30 Jul 2018 13:32:47 +0200 From: Ingo Molnar To: Rik van Riel Cc: linux-kernel@vger.kernel.org, kernel-team@fb.com, peterz@infradead.org, luto@kernel.org, x86@kernel.org, vkuznets@redhat.com, efault@gmx.de, dave.hansen@intel.com, will.daecon@arm.com, catalin.marinas@arm.com, benh@kernel.crashing.org Subject: Re: [PATCH 0/10] x86,tlb,mm: more lazy TLB cleanups & optimizations Message-ID: <20180730113247.GA21619@gmail.com> References: <20180728215357.3249-1-riel@surriel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180728215357.3249-1-riel@surriel.com> User-Agent: Mutt/1.9.4 (2018-02-28) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org * Rik van Riel wrote: > This patch series implements the cleanups suggested by Peter and Andy, > removes lazy TLB mm refcounting on x86, and shows how other architectures > could implement that same optimization. > > The previous patch series already seems to have removed most of the > cache line contention I was seeing at context switch time, so CPU use > of the memcache and memcache-like workloads has not changed measurably > with this patch series. > > However, the memory bandwidth used by the memcache system has been > reduced by about 1%, to serve the same number of queries per second. > > This happens on two socket Haswell and Broadwell systems. Maybe on > larger systems (4 or 8 socket) one might also see a measurable drop > in the amount of CPU time used, with workloads where the previous > patch series does not remove all cache line contention on the mm. > > This is against the latest -tip tree, and seems to be stable (on top > of another tree) with workloads that do over a million context switches > a second. Just a quick logistics request: once all the review feedback from Andy and PeterZ is sorted out, could you please (re-)send this series with the Reviewed-by and Acked-by tags added? If any patch is still under discussion then please leave it out from the next series temporarily, so that I can just apply them all immediately to tip:x86/mm before the next merge window opens. ( If the series reaches this state later today then don't hesitate to do a resend with the tags added - I don't want to delay these improvements. ) Thanks! Ingo