Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1756153AbXJZMQz (ORCPT ); Fri, 26 Oct 2007 08:16:55 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1751244AbXJZMQr (ORCPT ); Fri, 26 Oct 2007 08:16:47 -0400 Received: from twin.jikos.cz ([213.151.79.26]:33476 "EHLO twin.jikos.cz" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751241AbXJZMQr (ORCPT ); Fri, 26 Oct 2007 08:16:47 -0400 Date: Fri, 26 Oct 2007 14:16:21 +0200 (CEST) From: Jiri Kosina To: Hugh Dickins , Andrew Morton cc: Sami Farin , Linux kernel Mailing List , Jiri Kosina , Arjan van de Ven Subject: Re: [PATCH] [RFC] brk randomization: compute RLIMIT_DATA properly (was Re: x86: randomize brk() and RLIMIT_DATA) In-Reply-To: Message-ID: References: <20071025134124.wc44gdud7ixghfxv@m.safari.iki.fi> <20071025071324.2eac21d6@laptopd505.fenrus.org> <20071025171942.pjff7jbpempfcuri@m.safari.iki.fi> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1460 Lines: 41 On Fri, 26 Oct 2007, Hugh Dickins wrote: > > - if (rlim < RLIM_INFINITY && brk - mm->start_data > rlim) > > + if (rlim < RLIM_INFINITY && brk - mm->start_data - > > + (mm->start_brk - mm->end_data) > rlim) > I find the order in that test mysterious. I agree that the order you proposed is easier to understand on the first sight. From: Jiri Kosina brk randomization: compute RLIMIT_DATA properly In cases of heap area placed at randomly-generated offset from mm->end_data (arch_randomize_brk()), we need to subtract the value of the offset for setrlimit(RLIMIT_DATA) to work properly -- otherwise we count the unoccupied memory between mm->end_data and mm->start_brk as occupied. Signed-off-by: Jiri Kosina diff --git a/mm/mmap.c b/mm/mmap.c index facc1a7..673ac7d 100644 --- a/mm/mmap.c +++ b/mm/mmap.c @@ -251,7 +251,8 @@ asmlinkage unsigned long sys_brk(unsigned long brk) * not page aligned -Ram Gupta */ rlim = current->signal->rlim[RLIMIT_DATA].rlim_cur; - if (rlim < RLIM_INFINITY && brk - mm->start_data > rlim) + if (rlim < RLIM_INFINITY && (brk - mm->start_brk) + + (mm->end_data - mm->start_data) > rlim) goto out; newbrk = PAGE_ALIGN(brk); - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/