Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S934405Ab1CYBwG (ORCPT ); Thu, 24 Mar 2011 21:52:06 -0400 Received: from smtp-out.google.com ([74.125.121.67]:36963 "EHLO smtp-out.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754610Ab1CYBwD (ORCPT ); Thu, 24 Mar 2011 21:52:03 -0400 DomainKey-Signature: a=rsa-sha1; c=nofws; d=google.com; s=beta; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; b=HKB7J8U0jDjou4ZHtea6us86CbNaOdRf5Fs1jKZ8ipgPZ40+VTEASV3qF0q2dul1Mw 0EsHko/JdXHQETP+PQzQ== MIME-Version: 1.0 In-Reply-To: <20110324135657.GC20434@redhat.com> References: <1300835335-2777-1-git-send-email-teravest@google.com> <20110323012755.GA10325@redhat.com> <20110323200621.GJ13315@redhat.com> <20110324135657.GC20434@redhat.com> From: Justin TerAvest Date: Thu, 24 Mar 2011 18:51:24 -0700 Message-ID: Subject: Re: [RFC] [PATCH v2 0/8] Provide cgroup isolation for buffered writes. To: Vivek Goyal Cc: jaxboe@fusionio.com, m-ikeda@ds.jp.nec.com, ryov@valinux.co.jp, taka@valinux.co.jp, kamezawa.hiroyu@jp.fujitsu.com, righi.andrea@gmail.com, guijianfeng@cn.fujitsu.com, balbir@linux.vnet.ibm.com, ctalbott@google.com, linux-kernel@vger.kernel.org Content-Type: text/plain; charset=ISO-8859-1 X-System-Of-Record: true Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 2298 Lines: 60 On Thu, Mar 24, 2011 at 6:56 AM, Vivek Goyal wrote: > On Wed, Mar 23, 2011 at 03:32:51PM -0700, Justin TerAvest wrote: > > [..] >> > Ok, In the past I had tried it with 2 cgroups (running dd inside these >> > cgroups) and I had no success. I am wondering what has changed. >> >> It could just be a difference in workload, or dd size, or filesystem? > > Once you have sorted out the bug and I can boot my system, I will test > it to see what's happening. Thanks. I'll send out a version 3 of the patch (and organize my current results better in the cover letter), as soon as I have the problem resolved. I see a very similar panic during fsck that I'm trying to track down. > >> >> > >> > In the past a high priority throttled process can very well try to >> > pick up a inode from low prio cgroup and start writting it and get >> > blocked. I believe similar thing should happen now. >> >> You're right that it's very dependent on what inodes get picked up >> when from writeback. > > So then above results should not be reproducible consistently? Are you > using additional patches internally to make this work reliably. My > concenrn is that it will not make sense to have half baked pieces > in upstream kernel. That's why I was hoping that this piece can go in > once we have sorted out following. I am not using additional patches to make this work reliably. However, I've noticed the behavior is better with some filesystems than others. > > - IO less throttling > - Per cgroup dirty ratio > - Some work w.r.t cgroup aware writeback. > > In fact cgroup aware writeback can be part of this patch series once > first two pieces are in the kernel. I understand your preference for a complete, reliable solution for all of this. Right now, I'm concerned that it's hard to tie all these systems together, and I haven't seen an overall plan for how all of these things work together. If this patchset works reliably for enough workloads, we'll just see isolation improve as writeback is more cgroup aware. > > Thanks > Vivek > -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/