Received: by 2002:ac0:a5a6:0:0:0:0:0 with SMTP id m35-v6csp1677860imm; Sun, 9 Sep 2018 07:05:04 -0700 (PDT) X-Google-Smtp-Source: ANB0Vdb/tK9GsKyoffvdIyxWRTgtkgXtV3axE6fsQZtatENzfV+SiLk3q5JNLSaDOik3SxGGE+No X-Received: by 2002:a63:e811:: with SMTP id s17-v6mr17642773pgh.176.1536501904837; Sun, 09 Sep 2018 07:05:04 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1536501904; cv=none; d=google.com; s=arc-20160816; b=noyJpSgx+Rmp0mBLQDHvK845TnW884/L6QvT4ADl5N2l/+zwWwRiOfgcWkXAPl5OaW EdPigz0PNzyZXJLFpVqVAdiaEvWhkH6sRECAXR7f50ws6uD/rTby1fGk7BLChRU87lF2 h3HFeSaCXD04pHgvofJM7bVItVY3lRQT9Z0cLiyJHff24OcKb+feD0gbUF1PaSNp86Ej MYCxTWkRJix+jQkJ3pxLMEuBK8O2wcN1FiUC6nPWlx9PcWR65g2KvwtIzRnJ06gxW7Ox oll2/QFm1IEpsBEpPFDjUQY+E0Ad0DkiBzI7R4sNi2wz2Ysb7Tyjbn51nImouky8v03R KDUA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :references:in-reply-to:mime-version; bh=9v0oWjiA/0vEv6M5PTbwag6kWsZl6tMBluejWQsS99c=; b=h1IxkXQP26KRi64PDxQxHM1DLGK9VURA7WiyJS17GdJDNTbPQ26L78H1MzQ/ZYWxWM IT2XCvELBCLwpPgaBHsfv4jIwhtTDhk4Wi4y4iTG6rT/jM+ymDWkMafSYYerpX4bXG0U p4dtKBZ14W0tp7j91cc8qPNTGRierPGjL7OCueL1xTWHt7jHnMca0/YIHdWMz3TmKvGu wEka4XkYPJOWM1eoCXo5rnSeTM2vNtNVZHQp+1ibcJP14wSKv+ZQJY7i+yWQRrfh/SIW 9e3Ryk6vBywGkPg0PJXv4MQr23prCNp3nq95ekiQ+KP73cMBtIO0RP2YqwJuUk0MQATl B+Bw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id 35-v6si14744089pgo.639.2018.09.09.07.04.47; Sun, 09 Sep 2018 07:05:04 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727241AbeIISxT (ORCPT + 99 others); Sun, 9 Sep 2018 14:53:19 -0400 Received: from mail-oi0-f67.google.com ([209.85.218.67]:37868 "EHLO mail-oi0-f67.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726948AbeIISxS (ORCPT ); Sun, 9 Sep 2018 14:53:18 -0400 Received: by mail-oi0-f67.google.com with SMTP id p84-v6so35437942oic.4 for ; Sun, 09 Sep 2018 07:03:31 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=9v0oWjiA/0vEv6M5PTbwag6kWsZl6tMBluejWQsS99c=; b=FwBdlSVqU3SxFPAKwg9XzchkhHQdiHLNbF6EGoWnJIU6DCurjBrxN8y3Xde/aYjMZB VsZI+S3h4ThMvCI4Dt7k6pq1JxREid+V6CIRH/29emyZshNvsmOGufMtA+q95lM2c1Aj vcffoDA/jD1PmrUA1jhYblGEdci9j3asA5go8wJsE5ZXjqSoBzE8VhcAtpBTW549X1U3 j3qd6FJV4RIhjU1LbjzZ/ilgaDeVIpjAE15fyVI/S5mFtx7IWAADKYa9O4JsbSYYRnJi Jgo/VZZuW6vm08BSbzxZyteMBroObG3MiVkZqchpHwtgIrbxpqHzDd83yUdkBBfh2zif lmVQ== X-Gm-Message-State: APzg51Cgt/k6uo5ppl673+EjGHlzQGmtpGwj7mllpQZjHr9rS6a3MIIE O1+61gbFXjb9n/T6hLEfK03XjnBhXTqhaZKGbu5VQw== X-Received: by 2002:aca:cf44:: with SMTP id f65-v6mr18352566oig.356.1536501810853; Sun, 09 Sep 2018 07:03:30 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a4a:554b:0:0:0:0:0 with HTTP; Sun, 9 Sep 2018 07:03:30 -0700 (PDT) In-Reply-To: <20180907135235.GE24106@hirez.programming.kicks-ass.net> References: <20180907125649.GA3995@linux.vnet.ibm.com> <20180907131923.GB24106@hirez.programming.kicks-ass.net> <20180907134420.GD3995@linux.vnet.ibm.com> <20180907135235.GE24106@hirez.programming.kicks-ass.net> From: Jirka Hladky Date: Sun, 9 Sep 2018 16:03:30 +0200 Message-ID: Subject: Re: [SCHEDULER] Performance drop in 4.19 compared to 4.18 kernel To: Peter Zijlstra Cc: Srikar Dronamraju , Mel Gorman , "Jakub Ra??ek" , linux-kernel , "kkolakow@redhat.com" , Ingo Molnar Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Peter and Srikar, thanks a lot for the information and for the patches to test! > I have bounced the 5 patches to you, (one of the 6 has not been applied by > Peter) so I have skipped that. > They can also be fetched from > http://lore.kernel.org/lkml/1533276841-16341-1-git-send-email-srikar@linux.vnet.ibm.com We have started the benchmarks, I will report the results on Monday. > I generally run specjbb2005 (single and multi instance). We also run a single and multi-instance specjbb2005 test. > I have tried running NAS but I couldn't set it up properly. We run the OMP variant and we control the number of threads with the OMP_NUM_THREADS env variable. The setup is quite simple: cd NPB_sources/config/ mv suite_x86_64.def suite.def cd .. make suite FYI - starting from 4.17 kernel there is a significant performance drop compared to 4.16 kernel. Mel has come up with a sched-numa-fast-crossnode-v1r12 patch series git.kernel.org/pub/scm/linux/kernel/git/mel/linux.git which we have tested extensively and with it, the benchmarks results are back at 4.16 level. As I understand it, Mel's patch series depends on your patch series and can be only merged when your patches are completed. Thanks! Jirka On Fri, Sep 7, 2018 at 3:52 PM, Peter Zijlstra wrote: > > On Fri, Sep 07, 2018 at 07:14:20PM +0530, Srikar Dronamraju wrote: > > * Peter Zijlstra [2018-09-07 15:19:23]: > > > > > On Fri, Sep 07, 2018 at 06:26:49PM +0530, Srikar Dronamraju wrote: > > > > > > > Can you please pick > > > > > > > > > > > > 1. 69bb3230297e881c797bbc4b3dbf73514078bc9d sched/numa: Stop multiple tasks > > > > from moving to the cpu at the same time > > > > 2. dc62cfdac5e5b7a61cd8a2bd4190e80b9bb408fc sched/numa: Avoid task migration > > > > for small numa improvement > > > > 3. 76e18a67cdd9e3609716c8a074c03168734736f9 sched/numa: Pass destination cpu as > > > > a parameter to migrate_task_rq > > > > 4. 489c19b440ebdbabffe530b9a41389d0a8b315d9 sched/numa: Reset scan rate > > > > whenever task moves across nodes > > > > 5. b7e9ae1ae3825f35cd0f38f1f0c8e91ea145bc30 sched/numa: Limit the > > > > conditions where scan period is reset > > > > > > > > from https://git.kernel.org/pub/scm/linux/kernel/git/peterz/queue.git/commit/kernel/sched > > > > > > That is not a stable tree; the whole thing is re-generated from my quilt > > > set every time I feel like it. > > > > > > It is likely those commit ids will no longer exist in a few hours. > > > > > > > Okay, I will forward the relevant mails to Jirka. > > Or he can click on that link and find new IDs :-)