Received: by 2002:a25:86ce:0:0:0:0:0 with SMTP id y14csp587931ybm; Mon, 20 May 2019 23:29:01 -0700 (PDT) X-Google-Smtp-Source: APXvYqxvEHDANK4BjZUh6XAhWkfxfLBKfDBQGyQaTwtc2ieK/vF1A5xWqLVG2gRAmahYGZY4FoXB X-Received: by 2002:a63:2c4a:: with SMTP id s71mr63132158pgs.343.1558420141396; Mon, 20 May 2019 23:29:01 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1558420141; cv=none; d=google.com; s=arc-20160816; b=tP5bCtvqpqtvEkxiLBJfYGBfLY6tGiBrPbQ35/9mQ3GOT5tc1PLb3JXrmAdrdkl3Jf 712pRYDYdhTYfxTED1yudvKAQqmF9dR2KiLk0vEdnXT1+4oktIPAxGelOi1XVCWcq+H2 eurkED8sQFrxNG3ur3+JrdddSpI+CJ7P/LMVlRx6BF5nU3V1KMKRoYDlXkkDMQCz4qjP 5ZZyBDvCiB4d1wyUMYn/IUcHEALI7Ry1zgAm9pUUSOsfMNc0EA99r6faS3N2iTQB1bV0 FESUSQwyZipHPLnlDWljXUPz5W/EyfibyvdoIaZrvR5gNbmYvBd8OTQiRPlsylifWhW4 uoAw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date; bh=CzppJZV98yTh7mhgyQj10DGJb6ANdtEoPKV4ajF34Zc=; b=vr5SK2mGqkTJkOpo3puEFwmrGX9i79HdG1kAFz56qwvFWTIvrc9+GfiPuha9Ih2KT/ cWdiLvgW1C9skzCR2Pd39A5bOgopyZEteXXt9XArP8wJPsTkYJS3dyw12tB9aIbIeu/V PiaiAUB99DBLYTD3G4oTTxX9DtmHr74P8vEvysd81aFTgfpZI6e4kud/m0OUBXS40Eg7 Sjt0ODg+Eq7Pzg73GZ2cL/OP0/g18nGNdqC5Knc97RoLf0jqYQoHgGrDPCDWuZ6+GpY6 i8SiPswpfXrdmOs9tvbRhtmP4xDdSh/YQcKzeIfl4wHqT5YOYtpixqQsPFR7CoO1K75n WnjA== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id f8si18688565pgc.267.2019.05.20.23.28.46; Mon, 20 May 2019 23:29:01 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726719AbfEUG0b (ORCPT + 99 others); Tue, 21 May 2019 02:26:31 -0400 Received: from mx2.suse.de ([195.135.220.15]:53092 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1725798AbfEUG0a (ORCPT ); Tue, 21 May 2019 02:26:30 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 7FB96AE08; Tue, 21 May 2019 06:26:29 +0000 (UTC) Date: Tue, 21 May 2019 08:26:28 +0200 From: Michal Hocko To: Minchan Kim Cc: Andrew Morton , LKML , linux-mm , Johannes Weiner , Tim Murray , Joel Fernandes , Suren Baghdasaryan , Daniel Colascione , Shakeel Butt , Sonny Rao , Brian Geffon , linux-api@vger.kernel.org Subject: Re: [RFC 7/7] mm: madvise support MADV_ANONYMOUS_FILTER and MADV_FILE_FILTER Message-ID: <20190521062628.GE32329@dhcp22.suse.cz> References: <20190520035254.57579-1-minchan@kernel.org> <20190520035254.57579-8-minchan@kernel.org> <20190520092801.GA6836@dhcp22.suse.cz> <20190521025533.GH10039@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190521025533.GH10039@google.com> User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue 21-05-19 11:55:33, Minchan Kim wrote: > On Mon, May 20, 2019 at 11:28:01AM +0200, Michal Hocko wrote: > > [cc linux-api] > > > > On Mon 20-05-19 12:52:54, Minchan Kim wrote: > > > System could have much faster swap device like zRAM. In that case, swapping > > > is extremely cheaper than file-IO on the low-end storage. > > > In this configuration, userspace could handle different strategy for each > > > kinds of vma. IOW, they want to reclaim anonymous pages by MADV_COLD > > > while it keeps file-backed pages in inactive LRU by MADV_COOL because > > > file IO is more expensive in this case so want to keep them in memory > > > until memory pressure happens. > > > > > > To support such strategy easier, this patch introduces > > > MADV_ANONYMOUS_FILTER and MADV_FILE_FILTER options in madvise(2) like > > > that /proc//clear_refs already has supported same filters. > > > They are filters could be Ored with other existing hints using top two bits > > > of (int behavior). > > > > madvise operates on top of ranges and it is quite trivial to do the > > filtering from the userspace so why do we need any additional filtering? > > > > > Once either of them is set, the hint could affect only the interested vma > > > either anonymous or file-backed. > > > > > > With that, user could call a process_madvise syscall simply with a entire > > > range(0x0 - 0xFFFFFFFFFFFFFFFF) but either of MADV_ANONYMOUS_FILTER and > > > MADV_FILE_FILTER so there is no need to call the syscall range by range. > > > > OK, so here is the reason you want that. The immediate question is why > > cannot the monitor do the filtering from the userspace. Slightly more > > work, all right, but less of an API to expose and that itself is a > > strong argument against. > > What I should do if we don't have such filter option is to enumerate all of > vma via /proc//maps and then parse every ranges and inode from string, > which would be painful for 2000+ vmas. Painful is not an argument to add a new user API. If the existing API suits the purpose then it should be used. If it is not usable, we can think of a different way. -- Michal Hocko SUSE Labs