Received: by 2002:ac0:a5a7:0:0:0:0:0 with SMTP id m36-v6csp2833789imm; Fri, 20 Jul 2018 05:52:36 -0700 (PDT) X-Google-Smtp-Source: AAOMgpfRxCE56pPBzbbngmrpXIWFnlAtszUVTOtQEHW8MmaJkqwCdQnlgYgS2KxNOFW10YgjLbLF X-Received: by 2002:a63:7a0a:: with SMTP id v10-v6mr1958908pgc.444.1532091156259; Fri, 20 Jul 2018 05:52:36 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1532091156; cv=none; d=google.com; s=arc-20160816; b=am6ksXbgOM2kz92G+h9pyeSfMMbmSngauqiPYxk4+1ixWwVsInWSy6z6bG8kwQhoXZ AIIdg8+H4OMEPgUuk5aZxjMAxc095+2DHlTiMGum9x3kw0I9CPqX+QgAGM/L7oTNiPpQ wtS8xS7G5RKPuYDfz/hfnIyR/MvwZGAQTvVoS+Wgoj4Feomc1orMqpzWiM5p21NdHCOa oX9Db3KeHCLWTyGrUMG4FWA/u/LKFpB8vgfOsqMj08BwThvFSdl5a+nlpYAu8dq4vzM3 s0Wq48x8r+ycQ/d/QsJtOhcIiWaxLIDDfNLGiklPcoEr3v18aFV0UyCT2N5a7ceBWMwG B76A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:in-reply-to:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :arc-authentication-results; bh=neLLlns1MKXSkURRWv7QD+QFzpaResUPjKO1VH3wSs4=; b=JqzS3Q0xUwGmxgL8NpQTPviPFcFWOjD0ISVDuKsGd1iYxloESvwVHVSPv+qKvX+3eJ kgk/T3GJHAA5qAkU3NrKj+qLvS7LvwAdQogorEvVpDAG/m53LqN4CCQ8v2cusOaUd/5x kRjmAwS85lC//KWY6pF+NDVcCMdzIfT0+omopN9WRg7OsPpwseOHYJ67zNe7kmYLcNhZ PL5KOwl2XJOJ1OWCVvbYIZ3VfErtWnCkY/AnGFsE0fDJ5rJEjmWqH9aGjn6JKYoYk2+p VISdWGrxClABBX7wWgPIpJFOUk1zh/YJHefOA1LnhyNk9pESoj0Z2oIOABz4mi7l/S+H ohpQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id bh7-v6si1557763plb.367.2018.07.20.05.52.21; Fri, 20 Jul 2018 05:52:36 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2389870AbeGTNjr (ORCPT + 99 others); Fri, 20 Jul 2018 09:39:47 -0400 Received: from mx3-rdu2.redhat.com ([66.187.233.73]:41578 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S2389601AbeGTNjq (ORCPT ); Fri, 20 Jul 2018 09:39:46 -0400 Received: from smtp.corp.redhat.com (int-mx06.intmail.prod.int.rdu2.redhat.com [10.11.54.6]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id C1D974021CC2; Fri, 20 Jul 2018 12:51:37 +0000 (UTC) Received: from redhat.com (ovpn-121-184.rdu2.redhat.com [10.10.121.184]) by smtp.corp.redhat.com (Postfix) with SMTP id 694AE2156700; Fri, 20 Jul 2018 12:51:33 +0000 (UTC) Date: Fri, 20 Jul 2018 15:51:32 +0300 From: "Michael S. Tsirkin" To: Wei Wang Cc: virtio-dev@lists.oasis-open.org, linux-kernel@vger.kernel.org, virtualization@lists.linux-foundation.org, kvm@vger.kernel.org, linux-mm@kvack.org, mhocko@kernel.org, akpm@linux-foundation.org, torvalds@linux-foundation.org, pbonzini@redhat.com, liliang.opensource@gmail.com, yang.zhang.wz@gmail.com, quan.xu0@gmail.com, nilal@redhat.com, riel@redhat.com, peterx@redhat.com Subject: Re: [PATCH v36 0/5] Virtio-balloon: support free page reporting Message-ID: <20180720154922-mutt-send-email-mst@kernel.org> References: <1532075585-39067-1-git-send-email-wei.w.wang@intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1532075585-39067-1-git-send-email-wei.w.wang@intel.com> X-Scanned-By: MIMEDefang 2.78 on 10.11.54.6 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.11.55.7]); Fri, 20 Jul 2018 12:51:37 +0000 (UTC) X-Greylist: inspected by milter-greylist-4.5.16 (mx1.redhat.com [10.11.55.7]); Fri, 20 Jul 2018 12:51:37 +0000 (UTC) for IP:'10.11.54.6' DOMAIN:'int-mx06.intmail.prod.int.rdu2.redhat.com' HELO:'smtp.corp.redhat.com' FROM:'mst@redhat.com' RCPT:'' Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Jul 20, 2018 at 04:33:00PM +0800, Wei Wang wrote: > This patch series is separated from the previous "Virtio-balloon > Enhancement" series. The new feature, VIRTIO_BALLOON_F_FREE_PAGE_HINT, > implemented by this series enables the virtio-balloon driver to report > hints of guest free pages to the host. It can be used to accelerate live > migration of VMs. Here is an introduction of this usage: > > Live migration needs to transfer the VM's memory from the source machine > to the destination round by round. For the 1st round, all the VM's memory > is transferred. From the 2nd round, only the pieces of memory that were > written by the guest (after the 1st round) are transferred. One method > that is popularly used by the hypervisor to track which part of memory is > written is to write-protect all the guest memory. > > This feature enables the optimization by skipping the transfer of guest > free pages during VM live migration. It is not concerned that the memory > pages are used after they are given to the hypervisor as a hint of the > free pages, because they will be tracked by the hypervisor and transferred > in the subsequent round if they are used and written. > > * Tests > - Test Environment > Host: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz > Guest: 8G RAM, 4 vCPU > Migration setup: migrate_set_speed 100G, migrate_set_downtime 2 second Can we split out patches 1 and 2? They seem appropriate for this release ... > - Test Results > - Idle Guest Live Migration Time (results are averaged over 10 runs): > - Optimization v.s. Legacy = 409ms vs 1757ms --> ~77% reduction > (setting page poisoning zero and enabling ksm don't affect the > comparison result) > - Guest with Linux Compilation Workload (make bzImage -j4): > - Live Migration Time (average) > Optimization v.s. Legacy = 1407ms v.s. 2528ms --> ~44% reduction > - Linux Compilation Time > Optimization v.s. Legacy = 5min4s v.s. 5min12s > --> no obvious difference > > ChangeLog: > v35->v36: > - remove the mm patch, as Linus has a suggestion to get free page > addresses via allocation, instead of reading from the free page > list. > - virtio-balloon: > - replace oom notifier with shrinker; > - the guest to host communication interface remains the same as > v32. > - allocate free page blocks and send to host one by one, and free > them after sending all the pages. > > For ChangeLogs from v22 to v35, please reference > https://lwn.net/Articles/759413/ > > For ChangeLogs before v21, please reference > https://lwn.net/Articles/743660/ > > Wei Wang (5): > virtio-balloon: remove BUG() in init_vqs > virtio_balloon: replace oom notifier with shrinker > virtio-balloon: VIRTIO_BALLOON_F_FREE_PAGE_HINT > mm/page_poison: expose page_poisoning_enabled to kernel modules > virtio-balloon: VIRTIO_BALLOON_F_PAGE_POISON > > drivers/virtio/virtio_balloon.c | 456 ++++++++++++++++++++++++++++++------ > include/uapi/linux/virtio_balloon.h | 7 + > mm/page_poison.c | 6 + > 3 files changed, 394 insertions(+), 75 deletions(-) > > -- > 2.7.4