Received: by 2002:a05:7412:98c1:b0:fa:551:50a7 with SMTP id kc1csp1500541rdb; Mon, 8 Jan 2024 00:40:37 -0800 (PST) X-Google-Smtp-Source: AGHT+IGyUPYdlO0VFBxLCLmK/HnwNA65NG+n3Q6UXVFCf/R8II5FO/wIibU3rkHZxWsNHL6CniMb X-Received: by 2002:a05:6214:f24:b0:680:4ea0:b4fd with SMTP id iw4-20020a0562140f2400b006804ea0b4fdmr5836043qvb.118.1704703237231; Mon, 08 Jan 2024 00:40:37 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1704703237; cv=none; d=google.com; s=arc-20160816; b=gkkjRLlkNWrTApvipakx6Kjmf3/8NaF3RZ4WFJ0pH4XqZ/W8QX/2yrzkuoBV3Xwmvd GjhZGd/GsEylRPBLrS1YdXOGBp/YV23xUY+cDZSZQEbaRBNDG82wY/9kcyY/QA/R1WjS PpgHyvSpgKoGYnfUdHMqyzdkINmqGIUlg4Bz/txGP3SGLICK7wjTXiIC2xmx9NrmJaKu ZF9NbJDOdEk3Hd4YxlcvgAyVQndsfm25RPEocTz25teDUx5VulfKnG9SK7SBsD96PCVj UCHxAwG4fLxKk+UovKij73+U/DMrvpukJoFVtWgm+Mh1DUrPd9EriB5MjOfyss3J4WFs /Utg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:message-id:date:subject:cc:to :from:dkim-signature; bh=YpqF1f9anpG1eDKVArDObggVaRKdrnVPpWpOrbD3T8o=; fh=VXU7sxoZI+f9Xo+bFMhiKGSyUw1iVmt5e2RWdHBLGpI=; b=j8oBNa11CYsiISxG2M2UCleHVHEMjKxjuD4KCFaWjswIbdg8VHCaDuEZHh3BjML3aW iqgLQqyFYGmWIJUA7HUWci2yRt6OOkZVUBLnygqE0NDnlam1Erd/UPJQk0ThCG5rbglQ LCRan7lLb9RRzDJ0UjGA0Yb4a56G3OtgPCkhjmt8m5ImrN8Xhf2envcecEHW68S1xMGr Lt3/A2uGfFjjxmR7tiN037T9E2VFpIwFA19ygNnZaeKVc8YMt7rSc4Gx5FE1vPZl0ais GLpCYBkDO46cYwnyQONN+YzAqNFWssig0ortx+NcCQAIsrLsQ6AvuyjChUL4CX3nu9v/ jIeA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@ibm.com header.s=pp1 header.b=nkHee835; spf=pass (google.com: domain of linux-kernel+bounces-19198-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-19198-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=REJECT sp=NONE dis=NONE) header.from=ibm.com Return-Path: Received: from ny.mirrors.kernel.org (ny.mirrors.kernel.org. [147.75.199.223]) by mx.google.com with ESMTPS id qd7-20020ad44807000000b006801adc03a4si4759587qvb.332.2024.01.08.00.40.37 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 08 Jan 2024 00:40:37 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-19198-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) client-ip=147.75.199.223; Authentication-Results: mx.google.com; dkim=pass header.i=@ibm.com header.s=pp1 header.b=nkHee835; spf=pass (google.com: domain of linux-kernel+bounces-19198-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-19198-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=REJECT sp=NONE dis=NONE) header.from=ibm.com Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ny.mirrors.kernel.org (Postfix) with ESMTPS id E50741C219A4 for ; Mon, 8 Jan 2024 08:40:36 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id B2165BE7F; Mon, 8 Jan 2024 08:40:29 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=ibm.com header.i=@ibm.com header.b="nkHee835" X-Original-To: linux-kernel@vger.kernel.org Received: from mx0b-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 20572BA39; Mon, 8 Jan 2024 08:40:26 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.ibm.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linux.ibm.com Received: from pps.filterd (m0353725.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 4085vVwO029634; Mon, 8 Jan 2024 08:40:23 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=from : to : cc : subject : date : message-id : mime-version : content-transfer-encoding; s=pp1; bh=YpqF1f9anpG1eDKVArDObggVaRKdrnVPpWpOrbD3T8o=; b=nkHee835CvZGC0oqAn1jmZEwjimTrGMC+NICWI3Klfh3FyacBhQB/1jffGnaW0ZNZEKZ eDB0J1btqRrnhwolIRhjYNNjet5v9KlGsl6NKFAPbwohcCfmpzQxBy7RfvDK6eSGgsoB jaCNEuU2jZq94n2pmmgFxQ5U8EsXr7gHw8qEMwYq6/zUNKk5ss44qn9FZkrhaxFkeipz YfHq06UQck6k++sTDbVLXkTCOd7QcTzcUqhN4aLfBmuEzLjIt7pWSlBDhHDHs7xFWgeZ nxDEFzhHIVYgTf83YVQJqpq1Uom2eR4PV0ld7hKyguUdbzNZiwZHHZPfVK1dSKBK9+k4 Iw== Received: from pps.reinject (localhost [127.0.0.1]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3vg9jjd8uu-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 08 Jan 2024 08:40:23 +0000 Received: from m0353725.ppops.net (m0353725.ppops.net [127.0.0.1]) by pps.reinject (8.17.1.5/8.17.1.5) with ESMTP id 4088KPwx007108; Mon, 8 Jan 2024 08:40:23 GMT Received: from ppma21.wdc07v.mail.ibm.com (5b.69.3da9.ip4.static.sl-reverse.com [169.61.105.91]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3vg9jjd8uh-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 08 Jan 2024 08:40:23 +0000 Received: from pps.filterd (ppma21.wdc07v.mail.ibm.com [127.0.0.1]) by ppma21.wdc07v.mail.ibm.com (8.17.1.19/8.17.1.19) with ESMTP id 4085janP023399; Mon, 8 Jan 2024 08:40:22 GMT Received: from smtprelay06.fra02v.mail.ibm.com ([9.218.2.230]) by ppma21.wdc07v.mail.ibm.com (PPS) with ESMTPS id 3vfj6n6uk4-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 08 Jan 2024 08:40:22 +0000 Received: from smtpav02.fra02v.mail.ibm.com (smtpav02.fra02v.mail.ibm.com [10.20.54.101]) by smtprelay06.fra02v.mail.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 4088eJH541222748 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 8 Jan 2024 08:40:19 GMT Received: from smtpav02.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 296AD20043; Mon, 8 Jan 2024 08:40:19 +0000 (GMT) Received: from smtpav02.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id F1BEB20040; Mon, 8 Jan 2024 08:40:18 +0000 (GMT) Received: from tuxmaker.boeblingen.de.ibm.com (unknown [9.152.85.9]) by smtpav02.fra02v.mail.ibm.com (Postfix) with ESMTP; Mon, 8 Jan 2024 08:40:18 +0000 (GMT) From: Thomas Richter To: linux-kernel@vger.kernel.org, linux-perf-users@vger.kernel.org, acme@kernel.org, namhyung@kernel.org, acme@redhat.com Cc: svens@linux.ibm.com, gor@linux.ibm.com, sumanthk@linux.ibm.com, hca@linux.ibm.com, Thomas Richter Subject: [PING PATCH] perf test: raise limit to 20 percent for perf_stat_--bpf-counters_test Date: Mon, 8 Jan 2024 09:40:09 +0100 Message-Id: <20240108084009.3959211-1-tmricht@linux.ibm.com> X-Mailer: git-send-email 2.40.1 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-TM-AS-GCONF: 00 X-Proofpoint-ORIG-GUID: 3U6kAR89xj3zXKGpW9WD37BFWa39K9K5 X-Proofpoint-GUID: 3cwtGXwP4TiAsCQVmw3BQKVv8OSz1VCP X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.272,Aquarius:18.0.997,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2024-01-07_15,2024-01-08_01,2023-05-22_02 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 mlxlogscore=999 spamscore=0 mlxscore=0 clxscore=1015 bulkscore=0 malwarescore=0 impostorscore=0 suspectscore=0 phishscore=0 lowpriorityscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2311290000 definitions=main-2401080071 This test case often fails on s390 (about 2 out of 10) because the 10% percent limit on the difference between --bpf-counters event counting and s390 hardware counting is more than 10% in all failure cases. Raise the limit to 20% on s390 and the test case succeeds. Signed-off-by: Thomas Richter Acked-by: Namhyung Kim Cc: Namhyung Kim --- tools/perf/tests/shell/stat_bpf_counters.sh | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/tools/perf/tests/shell/stat_bpf_counters.sh b/tools/perf/tests/shell/stat_bpf_counters.sh index a87bb2814b4c..2d9209874774 100755 --- a/tools/perf/tests/shell/stat_bpf_counters.sh +++ b/tools/perf/tests/shell/stat_bpf_counters.sh @@ -4,19 +4,19 @@ set -e -# check whether $2 is within +/- 10% of $1 +# check whether $2 is within +/- 20% of $1 compare_number() { first_num=$1 second_num=$2 - # upper bound is first_num * 110% - upper=$(expr $first_num + $first_num / 10 ) - # lower bound is first_num * 90% - lower=$(expr $first_num - $first_num / 10 ) + # upper bound is first_num * 120% + upper=$(expr $first_num + $first_num / 5 ) + # lower bound is first_num * 80% + lower=$(expr $first_num - $first_num / 5 ) if [ $second_num -gt $upper ] || [ $second_num -lt $lower ]; then - echo "The difference between $first_num and $second_num are greater than 10%." + echo "The difference between $first_num and $second_num are greater than 20%." exit 1 fi } -- 2.43.0