Received: by 2002:a05:7412:3b8b:b0:fc:a2b0:25d7 with SMTP id nd11csp2737011rdb; Mon, 12 Feb 2024 15:12:38 -0800 (PST) X-Forwarded-Encrypted: i=3; AJvYcCVpNMOctyehvdh/OnjNdHm7SLToikUvObD37dMyPGGjaCnvKdQRRl6wmYQjqnFmqMXJ9y2gnsa0xtyCOlxPFehBEny+KwWBVVjrRIER8Q== X-Google-Smtp-Source: AGHT+IEPAtxQOlhbzpvCfRpGlIGTbj/5NS2CBFWyEegDx/Zqs+6mdGNTb6Eeasr/TV/HQ+QFpB7Y X-Received: by 2002:a05:6a20:d04d:b0:19e:3c7f:3d2b with SMTP id hv13-20020a056a20d04d00b0019e3c7f3d2bmr7918431pzb.9.1707779558553; Mon, 12 Feb 2024 15:12:38 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1707779558; cv=pass; d=google.com; s=arc-20160816; b=jAHjlFtT5e2cVTALegEA2Za1TpR9r8xXblwT9ty9Q0US7+kHNHVZvpk/HiemixPzPX 9quiMHRjupk01F96+X/j73yPEQzJZDkga0K6/qp8j5cEh2DxgL4trYYWZ4PO5cDirbrr pQWIwKEvTSVIJfqnJXS3Y6tjMUVkaCzhJhdssKV+NeTZqIESEOMf6jCgBuVYkB4avjU6 CLiFv1UQG4EroUgKCp44tb2CNzL985BYS8djbjfFVg8SshSCAG8STXY/cz3MvlZL27v2 4rw+o0+5lFwOLhiwkcDB+SvrquwW28YpYIl22tqjDg2Rekt6NFFOp8VrW6Rzw5Zf1IBj gRAA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :subject:cc:to:from:date; bh=lnTCD/hoT8+S7cV1cggRhox5KCaDRfZYxQHoh4eYYoY=; fh=OMBBqyVHcFUfpTnNHv4yEYD0ITCIzrcuLtpvQykHi6Q=; b=Cbyn5lyWCmxqGJ5mTwPrqoSuX68SViQ0ghghQ2L6u7WiTXufOjYib/I5NVDezkims/ 3iS/x3bCeYI8dY7C89CG9qhzwK5EUaNePbuLJbpMZGu86fceXeJmhboiEbv3yAJcCOR7 5GwjwmPHOI1aUtFkOFB3DLyk7+HXBqXme0amnbwvZVOSfUxAJUXFJDnhf13woKRWj3SC Z12ulyayCgFRtFHQjqTCtyxSavD8AMuzpo2SShJrmMRCQbF8UWVGFvDHpMAst5KISZIg TB5HProrGpGTaFf3YJBKgUAaLqpyHKpa/B2w7ivsZwMYiUqrS4vGruRf+KRPJV0yBQbF Y+Jg==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; arc=pass (i=1); spf=pass (google.com: domain of linux-kernel+bounces-62523-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-62523-linux.lists.archive=gmail.com@vger.kernel.org" X-Forwarded-Encrypted: i=2; AJvYcCU+W6uO8sAqMQsewtFJ98i7lvUS/23TTloV97t3M5V+Q3elpK/YR5ORMMLKAsiyuQxyFnBhfKQI4zq3IRTwgpi/Kix57gxfxa0yYjOXFA== Return-Path: Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org. [2604:1380:40f1:3f00::1]) by mx.google.com with ESMTPS id x4-20020a17090aca0400b00296fba17af7si940904pjt.160.2024.02.12.15.12.38 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 12 Feb 2024 15:12:38 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-62523-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) client-ip=2604:1380:40f1:3f00::1; Authentication-Results: mx.google.com; arc=pass (i=1); spf=pass (google.com: domain of linux-kernel+bounces-62523-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-62523-linux.lists.archive=gmail.com@vger.kernel.org" Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sy.mirrors.kernel.org (Postfix) with ESMTPS id 4DE5EB22DDE for ; Mon, 12 Feb 2024 23:11:28 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 878C14F610; Mon, 12 Feb 2024 23:11:21 +0000 (UTC) Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id EE1BF4F1E0; Mon, 12 Feb 2024 23:11:20 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707779481; cv=none; b=LpL/gXp6MNJ8MofNeIE4+7RFTlqso/RBwubn9fwIVGhAZu1dwkzDm+LlkXuP+SeHreNq5TZ8k112cmpE0JV8S2wtjvdXNhxnTbCXZcybNaTyqZJeqiFoKn+kX8E6dNhPPYa9oRJt6iEswnLlLJNM+T0+lJME+zqULtDpsErU0i4= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707779481; c=relaxed/simple; bh=IeqVsqHBBxkRlvWKuRk+BM+q2fCSQTabzCOE3hEGlcc=; h=Date:From:To:Cc:Subject:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=QsbRWtgiD28n0YCwOarpTDvPQUz1SgZqSPHDqfmL7TLdMRGoqBaY9Zf54ED+mafGr1DcHrtSWRGzigJ/vV+vvlWch36u7buYCPx4O/TLE2s3psK4k0VzDVsICerCVGm6LSEqbAVjujM+CUTyySOci0pqMFMryq9hMVQ9VZxuBKc= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id C22F4C43394; Mon, 12 Feb 2024 23:11:19 +0000 (UTC) Date: Mon, 12 Feb 2024 18:12:02 -0500 From: Steven Rostedt To: Mete Durlu Cc: Sven Schnelle , Masami Hiramatsu , Mathieu Desnoyers , linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org Subject: Re: [PATCH] tracing: use ring_buffer_record_is_set_on() in tracer_tracing_is_on() Message-ID: <20240212181202.70f47870@gandalf.local.home> In-Reply-To: <957e4c37-954f-4c35-98ba-df5edde4b5ce@linux.ibm.com> References: <20240205065340.2848065-1-svens@linux.ibm.com> <20240205075504.1b55f29c@rorschach.local.home> <20240205092353.523cc1ef@rorschach.local.home> <20240206060113.39c0f5bc@rorschach.local.home> <20240207060923.182ecb55@rorschach.local.home> <9a062196-ccbe-440e-a2f9-23eb8c5eb837@linux.ibm.com> <20240207072812.4a29235f@rorschach.local.home> <20240207104703.071ee985@rorschach.local.home> <8c986cb3-61b3-4f65-81c9-ffcfa994390f@linux.ibm.com> <20240212135320.26f90f28@gandalf.local.home> <957e4c37-954f-4c35-98ba-df5edde4b5ce@linux.ibm.com> X-Mailer: Claws Mail 3.19.1 (GTK+ 2.24.33; x86_64-pc-linux-gnu) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit On Mon, 12 Feb 2024 23:54:00 +0100 Mete Durlu wrote: > On 2/12/24 19:53, Steven Rostedt wrote: > > > > Right, it will definitely force the race window to go away. > > > > Can you still trigger this issue with just Sven's patch and not this change? > Sven's patch makes the test cases much more resilient. I needed to ramp > up the load up to 4 stressors on a 4 core system before the test starts > to fail again. At this point it is fair to say that the system is under > significant load. > > The failing condition is now different, which tells me that > Sven's patch have already solved(or improved) the previous issue. > What is failing now: > > echo '** ENABLE TRACING' > enable_tracing > > cnt=`cnt_trace` > if [ $cnt -eq 0 ]; then > fail "Nothing found in trace" > fi > > Adding a sleep between enable_tracing and cnt_trace seems to improve the > situation a lot. (my guess is that, the trace writer isn't getting any > runtime before the test checks the trace output) > > echo '** ENABLE TRACING' > enable_tracing > > +sleep $SLEEP_TIME > cnt=`cnt_trace` > if [ $cnt -eq 0 ]; then > fail "Nothing found in trace" > fi > > Didn't see any failure while increasing the system load until 8 > stressors (this might have been luck). When system was under load with > 8 stressors, I have seen the test failing 2 out of 10 times. Definitely > an improvement over the current situation. > So, I plan on adding Sven's patch for my next pull request to Linus. I had forgotten it when I did my last one (largely due to traveling). I'll hold off a week to see if any other fixes come in. -- Steve