Received: by 2002:a6b:fb09:0:0:0:0:0 with SMTP id h9csp3726615iog; Tue, 28 Jun 2022 01:07:43 -0700 (PDT) X-Google-Smtp-Source: AGRyM1uv9buBKOyMd5eqJRI9MuT7Gm3B5JzAQzDfgPHy2mMo4oWSgtxGFU3slq9pxqjt3kKgl47t X-Received: by 2002:a05:6402:3490:b0:435:9802:96ac with SMTP id v16-20020a056402349000b00435980296acmr21600514edc.40.1656403662782; Tue, 28 Jun 2022 01:07:42 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1656403662; cv=none; d=google.com; s=arc-20160816; b=kXBnSziLfy15JQMvDCxA89YioUgKOCEg0ZTeCsmT1VchvayQzGe11kT+omtwtAdxsZ bNoDjTO+wl62fWuVPtzbETC/l7dzy7fNeMauJnV9d6wO9+NRVIfH+nnHf18xvSf/hKQO Osjme3O3I/o9HEa5jiFbIy1mkIJ3s16Sj0eY2gIkKELqFbTkhNgF9IT24svqI9KBcQ0Z DmpdUGbOcsabV0UQMxO/SUmyV0FRvXlgGG8hTifMrcHl+AcXyG9F1p+4pOflA+yMt9iN JPECMAIIIvAGDSejJykQ+evB+mvtNpa4JfQT8/1dd9JulX8m8N0scbZtKOYX6Jn7yCh/ HNmw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to:from :references:cc:to:content-language:subject:user-agent:mime-version :date:message-id:dkim-signature; bh=vRd10tbRU3GrRqkFqod18FMMMAuVENCemO367KSTGP4=; b=i86agS0w3qGN41zyAi4clyl8QBBnAj+c97sxAGij2LpxGmZ2MxZaepOD4azLAIFe65 1AxHxI35hZS/ZCeWU7x0CJEzloOgXvLiwzeVCrVRoNwnocEKw/8bhpUQ9ut2AFMmVIyB zviCWbyPW0nuGtYUmO91hsXBG6WjjRVHR3U5CeNWKjk5F4yypCu5++bfYOn1MWCG1Bm7 XpGS7/E14xUa3vm3uLrcAKqtrBx0OnRxPJhScPso6sM66hsoG8m9OWTa8nuFGe1QiH+F LfJrQ6EYNIVTdDW4PyTgRRvq/kl1004izTeP/L4msBKzdNFOpdCqfUAUu4j/2yXZbpAj J7IA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=umwjtXui; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id ds19-20020a170907725300b00722ded3416esi16015214ejc.355.2022.06.28.01.07.16; Tue, 28 Jun 2022 01:07:42 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=umwjtXui; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S243416AbiF1H7P (ORCPT + 99 others); Tue, 28 Jun 2022 03:59:15 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:55094 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S243381AbiF1H7H (ORCPT ); Tue, 28 Jun 2022 03:59:07 -0400 Received: from dfw.source.kernel.org (dfw.source.kernel.org [IPv6:2604:1380:4641:c500::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id B8CF01145B for ; Tue, 28 Jun 2022 00:59:06 -0700 (PDT) Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by dfw.source.kernel.org (Postfix) with ESMTPS id 4BDBF60F40 for ; Tue, 28 Jun 2022 07:59:06 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id CD9C9C3411D; Tue, 28 Jun 2022 07:59:04 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1656403145; bh=JlHZRvNeuPAR9wk+beT+xWy5Hdyw9LBkS/k8Jq5Jvus=; h=Date:Subject:To:Cc:References:From:In-Reply-To:From; b=umwjtXui2y/QZCygfh/MJtMzKxmaIfZjdNYELWuvP12XjQWdp4Wwwh28ghOzUy4QI Enn+6t5rAl4PbWQ+z3x6+uF2T/1ZEhfDq/w9FUqIit5asKYdgqKRhuHBB3PftKM9oF +tOFCpkVe30+06uGIf392ZX67GYAEKk2aw7FP1YfI3GOXjD0OjFtD53m9HKzFbQD3L UhWLXtiCvzzQI5uL+cxoku4peWWkZZCT3WPZ9/Hx1kCkrfwcz4chotTrBJEyHP3d5i nV67254I33W2lX0Uf0bzIH1R14MvlNKiInH1fGSELF2ROHe5F/fLAAOKLsfIyVpk9I g6EmSA7Srdf/g== Message-ID: Date: Tue, 28 Jun 2022 15:59:01 +0800 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.10.0 Subject: Re: [f2fs-dev] [PATCH 2/3] f2fs: run GCs synchronously given user requests Content-Language: en-US To: Jaegeuk Kim Cc: linux-kernel@vger.kernel.org, linux-f2fs-devel@lists.sourceforge.net References: <20220617223106.3517374-1-jaegeuk@kernel.org> <20220617223106.3517374-2-jaegeuk@kernel.org> <27138a10-a6b2-edad-1985-687a95b9039b@kernel.org> From: Chao Yu In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-7.5 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A, RCVD_IN_DNSWL_HI,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2022/6/23 0:58, Jaegeuk Kim wrote: > On 06/22, Chao Yu wrote: >> On 2022/6/20 6:34, Jaegeuk Kim wrote: >>> On 06/19, Chao Yu wrote: >>>> On 2022/6/18 6:31, Jaegeuk Kim wrote: >>>>> When users set GC_URGENT or GC_MID, they expected to do GCs right away. >>>>> But, there's a condition to bypass it. Let's indicate we need to do now >>>>> in the thread. >>>> >>>> .should_migrate_blocks is used to force migrating blocks in full >>>> section, so what is the condition here? GC should not never select >>>> a full section, right? >>> >>> I think it'll move a full section given .victim_segno is not NULL_SEGNO, >>> as __get_victim will give a dirty segment all the time. wdyt? >> >> However, in gc_thread_fun() victim_segno is NULL_SEGNO all the time. > > What do you mean? The gc_thread thread sets NULL_SEGNO, which prevents > from selecting the full section. But, f2fs_ioc_flush_device will set the > segno to move, and f2fs_resize_fs calls do_garbage_collect directly. Yes, but I didn't get why this patch updates .should_migrate_blocks for gc_thread_func() case? If this is added to avoid breaking from below condition, I guess it's not necessary, since victim selected from gc_thread_func() will always be dirty, so get_valid_blocks(sbi, segno, true) == BLKS_PER_SEC(sbi) will be false anyway? or am I missing something? /* * stop BG_GC if there is not enough free sections. * Or, stop GC if the segment becomes fully valid caused by * race condition along with SSR block allocation. */ if ((gc_type == BG_GC && has_not_enough_free_secs(sbi, 0, 0)) || (!force_migrate && get_valid_blocks(sbi, segno, true) == BLKS_PER_SEC(sbi))) return submitted; Thanks, > >> >> I guess .should_migrate_blocks should only be set to true for >> F2FS_IOC_FLUSH_DEVICE/F2FS_IOC_RESIZE_FS case? rather than GC_URGENT or GC_MID >> case? See commit 7dede88659df ("f2fs: fix to allow migrating fully valid segment"). >> >> Thanks, >> >>> >>>> >>>> Thanks, >>>> >>>>> >>>>> Signed-off-by: Jaegeuk Kim >>>>> --- >>>>> fs/f2fs/gc.c | 8 ++++++-- >>>>> 1 file changed, 6 insertions(+), 2 deletions(-) >>>>> >>>>> diff --git a/fs/f2fs/gc.c b/fs/f2fs/gc.c >>>>> index d5fb426e0747..f4aa3c88118b 100644 >>>>> --- a/fs/f2fs/gc.c >>>>> +++ b/fs/f2fs/gc.c >>>>> @@ -37,7 +37,6 @@ static int gc_thread_func(void *data) >>>>> unsigned int wait_ms; >>>>> struct f2fs_gc_control gc_control = { >>>>> .victim_segno = NULL_SEGNO, >>>>> - .should_migrate_blocks = false, >>>>> .err_gc_skipped = false }; >>>>> wait_ms = gc_th->min_sleep_time; >>>>> @@ -113,7 +112,10 @@ static int gc_thread_func(void *data) >>>>> sbi->gc_mode == GC_URGENT_MID) { >>>>> wait_ms = gc_th->urgent_sleep_time; >>>>> f2fs_down_write(&sbi->gc_lock); >>>>> + gc_control.should_migrate_blocks = true; >>>>> goto do_gc; >>>>> + } else { >>>>> + gc_control.should_migrate_blocks = false; >>>>> } >>>>> if (foreground) { >>>>> @@ -139,7 +141,9 @@ static int gc_thread_func(void *data) >>>>> if (!foreground) >>>>> stat_inc_bggc_count(sbi->stat_info); >>>>> - sync_mode = F2FS_OPTION(sbi).bggc_mode == BGGC_MODE_SYNC; >>>>> + sync_mode = F2FS_OPTION(sbi).bggc_mode == BGGC_MODE_SYNC || >>>>> + sbi->gc_mode == GC_URGENT_HIGH || >>>>> + sbi->gc_mode == GC_URGENT_MID; >>>>> /* foreground GC was been triggered via f2fs_balance_fs() */ >>>>> if (foreground)