Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752770AbbFLTMr (ORCPT ); Fri, 12 Jun 2015 15:12:47 -0400 Received: from mx1.redhat.com ([209.132.183.28]:42510 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751002AbbFLTMp (ORCPT ); Fri, 12 Jun 2015 15:12:45 -0400 Message-ID: <557B2F26.20109@redhat.com> Date: Fri, 12 Jun 2015 15:12:38 -0400 From: Rik van Riel User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Mike Galbraith CC: Sasha Levin , Frederic Weisbecker , Ingo Molnar , LKML , Chris Metcalf , "Rafael J . Wysocki" , Peter Zijlstra , Dave Jones , Thomas Gleixner , Oleg Nesterov , "Paul E . McKenney" , Ingo Molnar , Martin Schwidefsky Subject: Re: [PATCH 4/4] nohz: Set isolcpus when nohz_full is set References: <1430928266-24888-1-git-send-email-fweisbec@gmail.com> <1430928266-24888-5-git-send-email-fweisbec@gmail.com> <55579CE0.5060801@gmail.com> <1431840650.3222.78.camel@gmail.com> <55594BC0.9070005@redhat.com> <1431919756.2518.51.camel@gmail.com> <5559F216.8050007@redhat.com> <1431958931.2496.189.camel@gmail.com> <5559FC90.1000603@redhat.com> <1432002632.2508.33.camel@gmail.com> In-Reply-To: <1432002632.2508.33.camel@gmail.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1754 Lines: 42 On 05/18/2015 10:30 PM, Mike Galbraith wrote: > On Mon, 2015-05-18 at 10:52 -0400, Rik van Riel wrote: > >> For real time KVM, it is desirable to run the VCPU threads on >> isolated CPUs as real time tasks. >> >> Meanwhile, the emulator threads can run as normal tasks anywhere >> on the system. >> >> This means the /machine cpuset, which all guests live under, >> needs to contain all the system's CPUs, both isolated and >> non-isolated, otherwise it will be unable to have the VCPU >> threads on isolated CPUs and the emulator threads on other >> CPUs. > > Ok, I know next to nothing about virtualization only because I failed at > maintaining the desired absolute zero, but... > > Why do you use isolcpus for this? This KVM setup sounds very similar to > what I do for real realtime. I use a shield script to set up an > exclusive isolated set and a system set and move the mundane world into > the system set. Inject realtime proggy into its exclusive home, it > creates/pins worker bees, done. Why the cpuset isolcpus hybrid? Because libvirt doesn't know any better currently. Ideally in the long run, we would use only cpusets, and not boot with isolcpus at all. Of course, things like irqbalance also key off isolcpus, to avoid assigning irqs to the isolated cpus, so there are quite a few puzzle pieces, and the best I can hope for in the short term is to simply resolve the incompatibilities where one piece of software undoes the settings required by another... -- All rights reversed -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/