Received: by 2002:a25:c593:0:0:0:0:0 with SMTP id v141csp782143ybe; Thu, 5 Sep 2019 06:00:39 -0700 (PDT) X-Google-Smtp-Source: APXvYqwCO+c9ayqSK/lKlb5in4oRUFXuAcFf43TwBG6+XKrdHfEXJPCK0IW1lATJ4w4Mf1kvJ+1n X-Received: by 2002:a17:90a:17c5:: with SMTP id q63mr3725187pja.106.1567688439788; Thu, 05 Sep 2019 06:00:39 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1567688439; cv=none; d=google.com; s=arc-20160816; b=xBNW1WgM4yCeyUratXEyZOawYoySKxTDxON41yDpukhlGXiJmpNfA8ymWZlVrYFOTH W6NG2nNNcoXgeT3do8Gdp9QC531o2oXEvJaBY8iAd3hK/y6aOGEKSywyz5Hlzym8HuVG IEWczux9E/Tsvzd3+x2A3OOna25bhz7X3GLz2v6lbJJVTMX0djDVt+pGxRcauc+mmJOY yHG0wwmZk2mx2aNCSTJJxmobJDQp1SaTgZCLQ6G2j/xTUaMi3AK6bmn/cLXc2MyWu+jK VIvCih4iEOuLtj7MnU6ORJG4f3u6BzaTPssnaSCY28bIFIL+SpdZ73IaMe1HRdmze3Gf 4fYA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date; bh=Pwt0enm3/aaeG6YlKCfMyxRU2+52CtkWRXsirD4PlQ4=; b=Xj78RGuoWGibR2oT8GI98lUMq6K+w64DjXosB86bAZD2ZpYT3vn/e7P+R8Knn4lVxs 4hJWpIax4RaiufJJ7whCe+4HfiElz+ReF/ZfusFN3tytNwvH+G5QZcBeN9D8zKmI5VMl dqX6PonbZEF0Ceipcc+LoI+tmN6Xmi+uO9wxe4GS4rceMVkLQNn8JVdR5ttSWr/Y3FK0 JVytqDTIOZxSZy5gToD5yE38wyV/gMGmf1oNYw6rBsn58aCgXQCk5BSN37Yltw5hYmkJ Dv+Mj5CLpX5zFrh41JVyJY5tFGcrM74uqYYXT3iB30F2y3Qxg/odN6B80e0yWZTCqNO2 KgwQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id u126si1751346pgb.400.2019.09.05.06.00.23; Thu, 05 Sep 2019 06:00:39 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1732949AbfIEKy1 (ORCPT + 99 others); Thu, 5 Sep 2019 06:54:27 -0400 Received: from mx2.suse.de ([195.135.220.15]:36990 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1730973AbfIEKy1 (ORCPT ); Thu, 5 Sep 2019 06:54:27 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 2D7E8AC50; Thu, 5 Sep 2019 10:54:26 +0000 (UTC) Date: Thu, 5 Sep 2019 12:54:24 +0200 From: Michal Hocko To: Joel Fernandes Cc: linux-kernel@vger.kernel.org, Tim Murray , carmenjackson@google.com, mayankgupta@google.com, dancol@google.com, rostedt@goodmis.org, minchan@kernel.org, akpm@linux-foundation.org, kernel-team@android.com, "Aneesh Kumar K.V" , Dan Williams , Jerome Glisse , linux-mm@kvack.org, Matthew Wilcox , Ralph Campbell , Vlastimil Babka Subject: Re: [PATCH v2] mm: emit tracepoint when RSS changes by threshold Message-ID: <20190905105424.GG3838@dhcp22.suse.cz> References: <20190903200905.198642-1-joel@joelfernandes.org> <20190904084508.GL3838@dhcp22.suse.cz> <20190904153258.GH240514@google.com> <20190904153759.GC3838@dhcp22.suse.cz> <20190904162808.GO240514@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190904162808.GO240514@google.com> User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed 04-09-19 12:28:08, Joel Fernandes wrote: > On Wed, Sep 4, 2019 at 11:38 AM Michal Hocko wrote: > > > > On Wed 04-09-19 11:32:58, Joel Fernandes wrote: > > > On Wed, Sep 04, 2019 at 10:45:08AM +0200, Michal Hocko wrote: > > > > On Tue 03-09-19 16:09:05, Joel Fernandes (Google) wrote: > > > > > Useful to track how RSS is changing per TGID to detect spikes in RSS and > > > > > memory hogs. Several Android teams have been using this patch in various > > > > > kernel trees for half a year now. Many reported to me it is really > > > > > useful so I'm posting it upstream. > > > > > > > > > > Initial patch developed by Tim Murray. Changes I made from original patch: > > > > > o Prevent any additional space consumed by mm_struct. > > > > > o Keep overhead low by checking if tracing is enabled. > > > > > o Add some noise reduction and lower overhead by emitting only on > > > > > threshold changes. > > > > > > > > Does this have any pre-requisite? I do not see trace_rss_stat_enabled in > > > > the Linus tree (nor in linux-next). > > > > > > No, this is generated automatically by the tracepoint infrastructure when a > > > tracepoint is added. > > > > OK, I was not aware of that. > > > > > > Besides that why do we need batching in the first place. Does this have a > > > > measurable overhead? How does it differ from any other tracepoints that we > > > > have in other hotpaths (e.g. page allocator doesn't do any checks). > > > > > > We do need batching not only for overhead reduction, > > > > What is the overhead? > > The overhead is occasionally higher without the threshold (that is if we > trace every counter change). I would classify performance benefit to be > almost the same and within the noise. OK, so the additional code is not really justified. -- Michal Hocko SUSE Labs