Received: by 2002:a05:6358:9144:b0:117:f937:c515 with SMTP id r4csp1809923rwr; Thu, 20 Apr 2023 23:08:40 -0700 (PDT) X-Google-Smtp-Source: AKy350aVbEyHcjHikJXMm29cNU6MLwZBgrQw1QE8n5qaT4Uxwe0FzlaHC9r/eaEXrR/aaPGDC7/3 X-Received: by 2002:a05:6a20:1596:b0:f2:9d49:5236 with SMTP id h22-20020a056a20159600b000f29d495236mr215926pzj.20.1682057319913; Thu, 20 Apr 2023 23:08:39 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1682057319; cv=none; d=google.com; s=arc-20160816; b=G7U//J9POhp9gspEC56xtxiJhDTmi1sm1c8zBsf2giUmM/IXUwywhqlvuKZxMooggB y0TvGuoKRDjAR7qyi+6c3EE7W2knX1SMOHhhyI9+sGe9UAIe/w8HzrcjLdwNo/Xjl5S7 dASRyNjN/sM0X0dcMbLr/ZZUJy0lSmf6iWJeg1dALha34A3ZY2Xy/O5GSS3FPdtOGGYj qPXUkOTev1ppcoSrRPzqUg3GCfRzxo/z3C4Lu6XRgTFxFOWViTR+Vs5+pXbiBZedDc/r ltEp3RWvUw5RLqkJnJSkDRmq8cnUqEpOpf+vLWnYpOJ/Kqa4cEzmUMXh/1zQplAoNTSk Vsug== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature:dkim-signature; bh=p7TNLB57J6X+UfMywwYnNOVkSohxa+bcFxW5iBNiQqQ=; b=UJhWtBT3bY1RQg4FdP21WFEyNMr0Cmce4Ntrh6FOhfpLqdkIpiI19zDE77x7GUahcJ 5QhNV5D5+Yz97feJrWvpfxfKDj6fEsqgS0zD/oUaQ4tsEF9sXcalQo4Qt+9n/J+a4QvO cxfPCkuub2jIr2004GD105iv/VClmFvRg4kS+ZqYg+Brk0hz3tnomUu0YpxuZB1zfGgF ypbYhouQSvWSueB9owc9TQqlXnZCIcGV5HvpcEbxtyrEroUltOmt87xut1OQiUR6h8nL I1hrPzmbTDFatJwno73lyfvP4vPrXSr6dUoStQX6x2iJYdSrB6EICMQMPJWfkXzgTD9I vXGA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@suse.de header.s=susede2_rsa header.b=Xk3P78rW; dkim=neutral (no key) header.i=@suse.de header.b="/V4zuvST"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=suse.de Return-Path: Received: from vger.kernel.org ([23.128.96.18]) by mx.google.com with ESMTP id 19-20020a630a13000000b004fbc2116e0esi3161375pgk.205.2023.04.20.23.08.26; Thu, 20 Apr 2023 23:08:39 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@suse.de header.s=susede2_rsa header.b=Xk3P78rW; dkim=neutral (no key) header.i=@suse.de header.b="/V4zuvST"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=suse.de Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233637AbjDUGFW (ORCPT + 99 others); Fri, 21 Apr 2023 02:05:22 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:46884 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229642AbjDUGFU (ORCPT ); Fri, 21 Apr 2023 02:05:20 -0400 Received: from smtp-out1.suse.de (smtp-out1.suse.de [195.135.220.28]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 8133A65B7; Thu, 20 Apr 2023 23:05:18 -0700 (PDT) Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by smtp-out1.suse.de (Postfix) with ESMTPS id C5FC121A4A; Fri, 21 Apr 2023 06:05:15 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1682057115; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding; bh=p7TNLB57J6X+UfMywwYnNOVkSohxa+bcFxW5iBNiQqQ=; b=Xk3P78rWD4YmQXDynQ7B8RpbLiszjbXzKRHXQRUUe97R/ZGQ5xfKJ9AqCRQkE08DdUHkew 0/uUVo7Licj4va+ow3O0HENGpCjNZivwCy3UkuTnJ7yb1gV7esr3bpQVg6fF5aR+p61Cll io1hJzqClPR0E8l9B22clyEPVxAvKto= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1682057115; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding; bh=p7TNLB57J6X+UfMywwYnNOVkSohxa+bcFxW5iBNiQqQ=; b=/V4zuvSTTq5s8hxVKPwmikUx0ksjIY+PEeAht+kXlA9J+ePg6BBIeTEQn/UsXL26NaZ9JJ NIdRACGjUyBcQpDw== Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by imap2.suse-dmz.suse.de (Postfix) with ESMTPS id B88AE1390E; Fri, 21 Apr 2023 06:05:15 +0000 (UTC) Received: from dovecot-director2.suse.de ([192.168.254.65]) by imap2.suse-dmz.suse.de with ESMTPSA id fjIKLZsnQmRnZgAAMHmgww (envelope-from ); Fri, 21 Apr 2023 06:05:15 +0000 From: Daniel Wagner To: linux-nvme@lists.infradead.org Cc: linux-kernel@vger.kernel.org, linux-block@vger.kernel.org, Chaitanya Kulkarni , Shin'ichiro Kawasaki , Daniel Wagner Subject: [PATCH REPOST blktests v2 0/9] nvme testsuite runtime optimization Date: Fri, 21 Apr 2023 08:04:56 +0200 Message-Id: <20230421060505.10132-1-dwagner@suse.de> X-Mailer: git-send-email 2.40.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-4.4 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_MED,SPF_HELO_NONE, SPF_PASS,T_SCC_BODY_TEXT_LINE,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Refactored v1 into more smaller bits and fixed a bunch of bugs alongside. For example the fio jobs size for rand rw used --jobs=$(nproc) which needs to fit with the test device size. The loop transport runs a few more test but the largest contributer why it runs so much longer are the iteratons in 002. So I made them also configurable. nvme_num_iter=100 nvme_img_size=350M (new defaults) loop real 4m3.524s user 0m7.931s sys 1m35.871s rdma real 4m20.559s user 0m8.895s sys 1m5.714s tcp real 3m55.292s user 0m8.654s sys 1m15.314s fc real 3m18.977s user 0m8.868s sys 0m58.655s nvme_num_iter=1000 nvme_img_size=1G (previous/ defaults) loop real 8m22.109s user 0m27.582s sys 3m0.484s rdma real 9m1.784s user 0m14.274s sys 2m5.479s tcp real 8m28.443s user 0m13.952s sys 2m55.544s fc real 6m24.426s user 0m13.944s sys 2m2.489s The fc tests are bit faster because some of them are failing. changes: v2: - made image size configurable via nvme_img_size env - make number of iteration configurable via nvme_num_iter - do not hard code test values - calculate job size - use runtime for fio background jobs v1: - initial version - https://lore.kernel.org/linux-nvme/20230419085643.25714-1-dwagner@suse.de/ Daniel Wagner (9): nvme-rc: Auto convert test device size info nvme: Do not hard code device size for dd test common-xfs: Make size argument optional for _xfs_run_fio_verify_io nvme: Use runtime fio background jobs nvme: Make test image size configurable nvme-rc: Add minimal test image size requirement nvme-rc: Calculate IO size for fio jobs nvme-rc: Move discovery generation counter code to rc nvme: Make the number iterations configurable common/rc | 30 +- common/xfs | 6 + tests/nvme/002 | 6 +- tests/nvme/002.out | 3004 -------------------------------------------- tests/nvme/004 | 2 +- tests/nvme/005 | 2 +- tests/nvme/006 | 2 +- tests/nvme/007 | 2 +- tests/nvme/008 | 2 +- tests/nvme/009 | 2 +- tests/nvme/010 | 6 +- tests/nvme/011 | 6 +- tests/nvme/012 | 5 +- tests/nvme/013 | 5 +- tests/nvme/014 | 12 +- tests/nvme/015 | 12 +- tests/nvme/016 | 2 +- tests/nvme/017 | 4 +- tests/nvme/018 | 2 +- tests/nvme/019 | 2 +- tests/nvme/020 | 2 +- tests/nvme/021 | 2 +- tests/nvme/022 | 2 +- tests/nvme/023 | 2 +- tests/nvme/024 | 2 +- tests/nvme/025 | 2 +- tests/nvme/026 | 2 +- tests/nvme/027 | 2 +- tests/nvme/028 | 2 +- tests/nvme/029 | 2 +- tests/nvme/030 | 22 +- tests/nvme/031 | 2 +- tests/nvme/032 | 6 +- tests/nvme/034 | 4 +- tests/nvme/035 | 4 +- tests/nvme/040 | 9 +- tests/nvme/041 | 2 +- tests/nvme/042 | 2 +- tests/nvme/043 | 2 +- tests/nvme/044 | 2 +- tests/nvme/045 | 6 +- tests/nvme/047 | 8 +- tests/nvme/048 | 2 +- tests/nvme/rc | 50 + 44 files changed, 176 insertions(+), 3079 deletions(-) -- 2.40.0