Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id ; Thu, 1 Mar 2001 10:37:40 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id ; Thu, 1 Mar 2001 10:37:30 -0500 Received: from brutus.conectiva.com.br ([200.250.58.146]:53744 "EHLO brutus.conectiva.com.br") by vger.kernel.org with ESMTP id ; Thu, 1 Mar 2001 10:37:11 -0500 Date: Thu, 1 Mar 2001 12:36:35 -0300 (BRST) From: Rik van Riel X-X-Sender: To: Mike Galbraith cc: Marcelo Tosatti , linux-kernel , Alan Cox Subject: Re: [patch][rfc][rft] vm throughput 2.4.2-ac4 In-Reply-To: Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org On Thu, 1 Mar 2001, Mike Galbraith wrote: > On Wed, 28 Feb 2001, Rik van Riel wrote: > > On Wed, 28 Feb 2001, Marcelo Tosatti wrote: > > > On Wed, 28 Feb 2001, Mike Galbraith wrote: > > > > > > That's one reason I tossed it out. I don't _think_ it should have any > > > > negative effect on other loads, but a test run might find otherwise. > > > > > > Writes are more expensive than reads. Apart from the aggressive read > > > caching on the disk, writes have limited caching or no caching at all if > > > you need security (journalling, for example). (I'm not sure about write > > > caching details, any harddisk expert?) > > > > I suspect Mike needs to change his benchmark load a little > > so that it dirties only 10% of the pages (might be realistic > > for web and/or database loads). > > Asking the user to not dirty so many pages is wrong. My benchmark > load is many compute intensive tasks which each dirty a few pages > while doing real work. It would be unrealistic if it just dirtied > pages as fast as possible to intentionally jam up the vm, but it > doesn't do that. Asking you to test a different kind of workload is wrong ?? The kind of load I described _is_ realistic, think for example about ftp/www/MySQL servers... > > At that point, you should be able to see that doing writes > > all the time can really mess up read performance due to extra > > introduced seeks. > > The fact that writes are painful doesn't change the fact that data > must be written in order to free memory and proceed. Besides, the > elevator is supposed to solve that not the allocator.. or? But if the amount of dirtied pages is _small_, it means that we can allow the reads to continue uninterrupted for a while before we flush all dirty pages in one go... Also, the elevator can only try to optimise whatever you throw at it. If you throw random requests at the elevator, you cannot expect it to do ANY GOOD ... The merging at the elevator level only works if the requests sent to it are right next to each other on disk. This means that randomly sending stuff to disk really DOES DESTROY PERFORMANCE and there's nothing the elevator could ever hope to do about that. > > We probably want some in-between solution (like FreeBSD has today). > > The first time they see a dirty page, they mark it as seen, the > > second time they come across it in the inactive list, they flush it. > > This way IO is still delayed a bit and not done if there are enough > > clean pages around. > > (delayed write is fine, but I'll be upset if vmlinux doesn't show up > after I buy more ram;) Writing out of old data is a task independent of the VM. This is a job done by kupdate. The only thing the VM does is write pages out earlier when it's under memory pressure. > > Another solution would be to do some more explicit IO clustering and > > only flush _large_ clusters ... no need to invoke extra disk seeks > > just to free a single page, unless you only have single pages left. > > This sounds good.. except I keep thinking about the elevator. > Clusters disappear as soon as they hit the queues so clustering > at the vm level doesn't make any sense to me. You should think about the elevator a bit more. Feel for the poor thing and try to send it requests it can actually do something useful with ;) regards, Rik -- Linux MM bugzilla: http://linux-mm.org/bugzilla.shtml Virtual memory is like a game you can't win; However, without VM there's truly nothing to lose... http://www.surriel.com/ http://www.conectiva.com/ http://distro.conectiva.com/ - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/