Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S932208AbYBNTjk (ORCPT ); Thu, 14 Feb 2008 14:39:40 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1756405AbYBNTjb (ORCPT ); Thu, 14 Feb 2008 14:39:31 -0500 Received: from netops-testserver-3-out.sgi.com ([192.48.171.28]:45910 "EHLO relay.sgi.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1754937AbYBNTja (ORCPT ); Thu, 14 Feb 2008 14:39:30 -0500 Date: Thu, 14 Feb 2008 11:39:29 -0800 (PST) From: Christoph Lameter X-X-Sender: clameter@schroedinger.engr.sgi.com To: Steve Wise cc: Felix Marti , Roland Dreier , Rik van Riel , steiner@sgi.com, Andrea Arcangeli , a.p.zijlstra@chello.nl, izike@qumranet.com, linux-kernel@vger.kernel.org, avi@qumranet.com, linux-mm@kvack.org, daniel.blueman@quadrics.com, Robin Holt , general@lists.openfabrics.org, Andrew Morton , kvm-devel@lists.sourceforge.net Subject: Re: [ofa-general] Re: Demand paging for memory regions In-Reply-To: <47B45994.7010805@opengridcomputing.com> Message-ID: References: <20080208234302.GH26564@sgi.com><20080208155641.2258ad2c.akpm@linux-foundation.org><20080209012446.GB7051@v2.random><20080209015659.GC7051@v2.random><20080209075556.63062452@bree.surriel.com><47B2174E.5000708@opengridcomputing.com> <8A71B368A89016469F72CD08050AD334026D5C23@maui.asicdesigners.com> <47B45994.7010805@opengridcomputing.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1410 Lines: 27 On Thu, 14 Feb 2008, Steve Wise wrote: > Note that for T3, this involves suspending _all_ rdma connections that are in > the same PD as the MR being remapped. This is because the driver doesn't know > who the application advertised the rkey/stag to. So without that knowledge, > all connections that _might_ rdma into the MR must be suspended. If the MR > was only setup for local access, then the driver could track the connections > with references to the MR and only quiesce those connections. > > Point being, it will stop probably all connections that an application is > using (assuming the application uses a single PD). Right but if the system starts reclaiming pages of the application then we have a memory shortage. So the user should address that by not running other apps concurrently. The stopping of all connections is still better than the VM getting into major trouble. And the stopping of connections in order to move the process memory into a more advantageous memory location (f.e. using page migration) or stopping of connections in order to be able to move the process memory out of a range of failing memory is certainly good. -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/