Received: by 2002:a25:8b91:0:0:0:0:0 with SMTP id j17csp4268457ybl; Mon, 13 Jan 2020 10:41:14 -0800 (PST) X-Google-Smtp-Source: APXvYqxu7grpHxrKKR5+FHaICAG8WshCEkbY6enuwhX6Tn/beY1nB4yO9t4E1dqbU4hG95TKoDxt X-Received: by 2002:aca:4b14:: with SMTP id y20mr13025151oia.160.1578940874170; Mon, 13 Jan 2020 10:41:14 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1578940874; cv=none; d=google.com; s=arc-20160816; b=XHp1ceeS1xBIDDmFqNIGfp923iZ7AkEuO1/PgZCLICLPVRxZmcwmMAtmq4T+rjn1zl V/9BcySwsPO3aOP+E5mDlnSULrQvAktl9EHhFfDofSTQ/zT+WLE2ngtRsMW94RDkNDOW D6Hjq1ZfNoyXKzBds3WyG3h1I1Rq0QruxN9rgJ7fzZdsva38VVAfyO0rATmPFFo7C+DY v4pwheTM0sLTTU6IBhXsmVmvCZqOOi7CV1ZmpOJYseA1Q7dF4OwEpLO8S/9ue1GiDQyj 2PVTMI9ms2ljq47Y1FNpcTjYR3XEOGZetHQjOV1VAlzvEi6vyHJv0m6NWQYd4bLDVQGh 5K3g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=cGW0Khst53+VyBuFsjl4dOwNiUvK/2GW3tg88oBHadY=; b=hDay5ujNppwXwtVlY6EZ3SBp1pIg/OWmEpx3KfsvaGiYSMnvf88K21uCTBOqDZY9nA btdFjvNJlsRQHe6r9X7Fbfuk0JOajIaT4rZ9gpdoKAJ74XVgbPjQ1RaXcSocAXBNg9p8 HWUr+dh8S8JDAUnsFh5VltPC2rzNxofGRrhPRumxCuEZppLpFfraewpyB4Xb0G8OZsJC Ib0iCj8yk9BLJ88T95LnwNSgxydEm1QwgRruHvtitZxPDYIYVdRlEJA05ZD+2TBlX82X aBlZnT0MV8QqRu664iH0bRXyQbAGoB8PTsE3F+3IagiDTj/OLJOlj6qp/9Sz8IZCiJdG orgA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=d8i7XTNW; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id j16si7408554otq.23.2020.01.13.10.41.01; Mon, 13 Jan 2020 10:41:14 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=d8i7XTNW; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728885AbgAMSi6 (ORCPT + 99 others); Mon, 13 Jan 2020 13:38:58 -0500 Received: from mail-oi1-f193.google.com ([209.85.167.193]:40259 "EHLO mail-oi1-f193.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728516AbgAMSi5 (ORCPT ); Mon, 13 Jan 2020 13:38:57 -0500 Received: by mail-oi1-f193.google.com with SMTP id c77so9237773oib.7 for ; Mon, 13 Jan 2020 10:38:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=cGW0Khst53+VyBuFsjl4dOwNiUvK/2GW3tg88oBHadY=; b=d8i7XTNWkg4Lcja5cQM/ZeAXWJtULssp/GxEbRAb21HJFYTJsuU9CH9fG1w4dy9LYq ROJh4sTI1Wfl9dCF/Sf96ukTS4L2H6vQZ6aI0xjM/zUhz2EQXM52TTZsoe0jwqlxUdRj zi4VnGwztAfYw1eG97WDypmdrM8xeLiU4jctcbo/GqiKiRAAQIds7B2If5zgPfOdVzDD 6vP3owEKYV881z+qbBmxo8EjocHlEVEb4ntwHkUs9Bn+3E86YMVc/U75j+qdfVHkiRWl 8ghwEe0mue9wLH4jSDISd90OVBlg/qOs7bWvYKYBeVwx4zDuTNTs3v92wiQ1w+qGHTCz Xy4Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=cGW0Khst53+VyBuFsjl4dOwNiUvK/2GW3tg88oBHadY=; b=ILysw/Iw81yXZhOggfdG4knunineyQgI25xOzoa8vJr5IL121YeHTTVWN6+lwqcQFU jm95O35qNzseyJd7UKbxCw+tVXohMa4jaO4KndWJ4OXiM+CWNbGcGq4qCzFK5u3vtsJ+ +x1k5b9e1LUOQfgZQjDX1vbumdSXFIN0jBXx5HuX73En6vXYk7zfY/qz4d3ccFFHL0G6 YyarLseQMsm9VTBXsBtI1za3YJdqoaVSNMMbL1nxPKc/8wGkjBD8h4hmp6p7hnOFt/SC jwymU3xpgoSq90NVrbjz/zYfaYCUUFNe+xhzIKI8A2sYAcL6BgH5OIC8VEzvt0VeX+No ixfA== X-Gm-Message-State: APjAAAXtpDr84F2u9otOBS+Xf4qZssIHhGuhS4FphMzZnhrVVG1ecgtM HuZ0ePPr5mbhnkJ7NdcuoGrmX8dhp4LwKjD+WK63Vw== X-Received: by 2002:aca:4183:: with SMTP id o125mr13027850oia.125.1578940736791; Mon, 13 Jan 2020 10:38:56 -0800 (PST) MIME-Version: 1.0 References: <20200108202311.GA40461@romley-ivt3.sc.intel.com> <20200108214250.GB40461@romley-ivt3.sc.intel.com> In-Reply-To: From: Shakeel Butt Date: Mon, 13 Jan 2020 10:38:45 -0800 Message-ID: Subject: Re: [bug report] resctrl high memory comsumption To: Reinette Chatre Cc: Fenghua Yu , Borislav Petkov , LKML , Thomas Gleixner , Ingo Molnar , x86@kernel.org Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Jan 8, 2020 at 1:54 PM Reinette Chatre wrote: > > Hi Fenghua, > > On 1/8/2020 1:42 PM, Fenghua Yu wrote: > > On Wed, Jan 08, 2020 at 12:42:17PM -0800, Reinette Chatre wrote: > >> Hi Fenghua, > >> On 1/8/2020 12:23 PM, Fenghua Yu wrote: > >>> On Wed, Jan 08, 2020 at 09:07:41AM -0800, Shakeel Butt wrote: > >>>> Recently we had a bug in the system software writing the same pids to > >>>> the tasks file of resctrl group multiple times. The resctrl code > >>> Subject: [RFC PATCH] x86/resctrl: Fix redundant task movements > >> I think your fix would address this specific use case but a slightly > >> different use case will still encounter the problem of high memory > >> consumption. If for example, sleeping tasks are moved (many times) > >> between resource or monitoring groups then their task_works queue would > >> just keep growing. It seems that a call to task_work_cancel() before > >> adding a new work item should address all these cases? > > > > The checking code in this patch is also helpful to avoid redundant > > task move preparation (kzalloc(), task_work_add(), etc) in the same > > rdtgroup. > > Indeed. > > > > > How about adding both the checking code and task_work_cancel()? > > That does sound good to me. > Hi Fenghua, any updates here? > There is something in the current implementation that I would appreciate > your feedback on: Currently the task's closid and rmid are initialized > _after_ the call to task_work_add() succeeds. Should these not be > initialized before the call to task_work_add()? > This seems like a potential race. thanks, Shakeel