Received: by 2002:ab2:60d1:0:b0:1f7:5705:b850 with SMTP id i17csp1426184lqm; Thu, 2 May 2024 14:42:46 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCXv6ieUOwWxwVaCS3Mk6daNvi4UvvGSCRTfKD/2OaAg+VMhd5utYHIpoD/XI0WE6GC23PJPuySno+VSm1Ta2L7v6zj8qdZhtt6TGquxGw== X-Google-Smtp-Source: AGHT+IF8Q7PDqeFnEv2AMZojsr/xgaUP4IWR/Dkusdi1vxqj/96hjRO1LcDh1EPCIfdLBzoIZfSE X-Received: by 2002:a17:906:b304:b0:a52:143c:1901 with SMTP id n4-20020a170906b30400b00a52143c1901mr467106ejz.22.1714686166784; Thu, 02 May 2024 14:42:46 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1714686166; cv=pass; d=google.com; s=arc-20160816; b=BXphfXwlvxvSZYjUJVqoZUUe1W7kTgneAA0ndnCBhUN8yrPjxFCEzvPaqrI/iXNpXA ez/ntl7A9Jkob7Qo/mIcG0acrarTDF3p+jW9INQV+p4mNLZjoIT2mllCu6v5iIQhiSv/ MuO46HNcnMdaadCHU4A2OP7sB560CGoKnm0+0+0pdffeTVaj1mD+nNGdeW/9glJyGhB5 czpaS1dKLY7EkhySVnsPwdzdNyjszcT6iiVwtEuvGmjOO1Td8Lz+80IPncIQ8ZCjLqp2 xL6UxZwh+p9Td2siZFEQpYkLVKSnVU8cJMFU/Vo+rwHupELxyKf6sDuX/9aXpG5Qnf80 We3w== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:dkim-signature:dkim-signature:from; bh=Sk0j1OodFRAFjoCizT58vRe3D/jMHkQlUpYUl6q8Mbc=; fh=pKnPKUsir0uEGSsor+4Zc2vgbu+g+ayvUgsdzkuXaoA=; b=w9FNdIJIoVa1Q/NaN4flDX1i1hXBTx4KDo9za60L7dimTi6aUhYI3etPe+7lSTejH2 Zofe4YOT/HxsZYYvDT0nsFHagf1KpL4F+0r0/pCkXGCux7HhjTkxDdlAi0l+MFvsK4Bx UbIjS/azUs5j1u87FIJ6EDSZPKIJY2oIvgy7C1GwaD2wbrE2dY8KqIwygPPJWVhM2AoF +bLHwlbYjrIqnkKh9XL7vmioh9sX3MkZ1smjwVKhVuxvy3/1HUjLUIQC91Bi/fWYrTQR ZhMzWyQ7GLtCjwl61NTfit0XEXw51G4zdkExt/AMSguROg7/Vm1iV8h2v5OzwN5imzzS E5tg==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b=tRZfC0cA; dkim=neutral (no key) header.i=@linutronix.de; arc=pass (i=1 spf=pass spfdomain=linutronix.de dkim=pass dkdomain=linutronix.de dmarc=pass fromdomain=linutronix.de); spf=pass (google.com: domain of linux-kernel+bounces-166972-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-166972-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Return-Path: Received: from am.mirrors.kernel.org (am.mirrors.kernel.org. [147.75.80.249]) by mx.google.com with ESMTPS id a7-20020a170906468700b00a58f81de102si846772ejr.466.2024.05.02.14.42.46 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 02 May 2024 14:42:46 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-166972-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249; Authentication-Results: mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b=tRZfC0cA; dkim=neutral (no key) header.i=@linutronix.de; arc=pass (i=1 spf=pass spfdomain=linutronix.de dkim=pass dkdomain=linutronix.de dmarc=pass fromdomain=linutronix.de); spf=pass (google.com: domain of linux-kernel+bounces-166972-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-166972-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by am.mirrors.kernel.org (Postfix) with ESMTPS id 0DF071F21597 for ; Thu, 2 May 2024 21:42:46 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 6010D201279; Thu, 2 May 2024 21:38:58 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="tRZfC0cA"; dkim=permerror (0-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="WlpJQE+e" Received: from galois.linutronix.de (Galois.linutronix.de [193.142.43.55]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id E917C1C68BF for ; Thu, 2 May 2024 21:38:53 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=193.142.43.55 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1714685936; cv=none; b=M01xQm+yrIS6wK1F+m4BDUq7B+Qx4LfmIRO4+DrLtHzkr5V9EH694wrVjD5Y7bST+e2vQs9s6iLXWdeNjEN6nMKf0Wmp0GrKIYIkN79DczA5DSxLRiAo1NvgGOSWtmcctsce7E5Ovb4YsxyewdMhTSn99qS+NEtn9sl1woIfQ9w= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1714685936; c=relaxed/simple; bh=grpdJaz2UnvW0mDQQgbmHL68Ekyu1fs7+Qvt44D7P+8=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=SYFpn6QxJP0LmYInAuP2K3FpKTIyolbLbfmNSJKRNFNv7GI6dowdFsJzX0ZEIdGBYM8iAnFQc+yu8J/uGTe+R9utjNjiyqEqoJnG/iOXf2EoIw8vMXa/+L7v6TV0yOKWsQloyt9wGlHEiBHBhQF6Ko7sSlLdsw/YtOGxkGzxNYE= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linutronix.de; spf=pass smtp.mailfrom=linutronix.de; dkim=pass (2048-bit key) header.d=linutronix.de header.i=@linutronix.de header.b=tRZfC0cA; dkim=permerror (0-bit key) header.d=linutronix.de header.i=@linutronix.de header.b=WlpJQE+e; arc=none smtp.client-ip=193.142.43.55 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linutronix.de Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linutronix.de From: John Ogness DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020; t=1714685932; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Sk0j1OodFRAFjoCizT58vRe3D/jMHkQlUpYUl6q8Mbc=; b=tRZfC0cAVDtRZP6zFbRixAbjMArOplm27oBGPNT1DlyYE1rk1weeKUcSL0QhtpHOaHnrBT II2p3mP/aJaE93HfuHWQEWmkWa2xEtnCSqZGeNa3JRhcOfhKibaEBbDR+nf+u+LQ+IEJdf F/q2fJzIz2ALlP1xvG5CCvfWWW9LIVmIxRsZD/OqGRtnp9lS4SoAFkNdQ5/0ZwbxUd1bq1 ysJ2dyEYowR27A3HZ5k7fvHnh588q3tqUUjmXaEfuAr8u6ObrlB0xj5fEu9nncNKYCtmvb H8IAm58Fj+RCbmbU5Xz25ZnUIYZoB5hW6yrXn95TF1lBx3Ee0vpU7Y8sFY+7mw== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020e; t=1714685932; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Sk0j1OodFRAFjoCizT58vRe3D/jMHkQlUpYUl6q8Mbc=; b=WlpJQE+e9Yv/UrAMasJShPvTyy0u96jmWqFIeERiFrdAVgUAg/+GL1tKu8xd8ypEvhNr2a ekgt+jXmD+JnBZAg== To: Petr Mladek Cc: Sergey Senozhatsky , Steven Rostedt , Thomas Gleixner , linux-kernel@vger.kernel.org Subject: [PATCH printk v5 21/30] printk: nbcon: Use nbcon consoles in console_flush_all() Date: Thu, 2 May 2024 23:44:30 +0206 Message-Id: <20240502213839.376636-22-john.ogness@linutronix.de> In-Reply-To: <20240502213839.376636-1-john.ogness@linutronix.de> References: <20240502213839.376636-1-john.ogness@linutronix.de> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Allow nbcon consoles to print messages in the legacy printk() caller context (printing via unlock) by integrating them into console_flush_all(). The write_atomic() callback is used for printing. Provide nbcon_legacy_emit_next_record(), which acts as the nbcon variant of console_emit_next_record(). Call this variant within console_flush_all() for nbcon consoles. Since nbcon consoles use their own @nbcon_seq variable to track the next record to print, this also must be appropriately handled in console_flush_all(). Note that the legacy printing logic uses @handover to detect handovers for printing all consoles. For nbcon consoles, handovers/takeovers occur on a per-console basis and thus do not cause the console_flush_all() loop to abort. Signed-off-by: John Ogness --- kernel/printk/internal.h | 6 +++ kernel/printk/nbcon.c | 87 ++++++++++++++++++++++++++++++++++++++++ kernel/printk/printk.c | 17 +++++--- 3 files changed, 105 insertions(+), 5 deletions(-) diff --git a/kernel/printk/internal.h b/kernel/printk/internal.h index 5a93825871de..91bc0ee43f8d 100644 --- a/kernel/printk/internal.h +++ b/kernel/printk/internal.h @@ -78,6 +78,8 @@ void defer_console_output(void); u16 printk_parse_prefix(const char *text, int *level, enum printk_info_flags *flags); +void console_lock_spinning_enable(void); +int console_lock_spinning_disable_and_check(int cookie); u64 nbcon_seq_read(struct console *con); void nbcon_seq_force(struct console *con, u64 seq); @@ -86,6 +88,8 @@ void nbcon_init(struct console *con, u64 init_seq); void nbcon_free(struct console *con); enum nbcon_prio nbcon_get_default_prio(void); void nbcon_atomic_flush_pending(void); +bool nbcon_legacy_emit_next_record(struct console *con, bool *handover, + int cookie); /* * Check if the given console is currently capable and allowed to print @@ -142,6 +146,8 @@ static inline void nbcon_init(struct console *con, u64 init_seq) { } static inline void nbcon_free(struct console *con) { } static inline enum nbcon_prio nbcon_get_default_prio(void) { return NBCON_PRIO_NONE; } static inline void nbcon_atomic_flush_pending(void) { } +static inline bool nbcon_legacy_emit_next_record(struct console *con, bool *handover, + int cookie) { return false; } static inline bool console_is_usable(struct console *con, short flags) { return false; } diff --git a/kernel/printk/nbcon.c b/kernel/printk/nbcon.c index 7532eba55d15..abd3835a3466 100644 --- a/kernel/printk/nbcon.c +++ b/kernel/printk/nbcon.c @@ -953,6 +953,93 @@ enum nbcon_prio nbcon_get_default_prio(void) } /* + * nbcon_atomic_emit_one - Print one record for an nbcon console using the + * write_atomic() callback + * @wctxt: An initialized write context struct to use for this context + * + * Return: True, when a record has been printed and there are still + * pending records. The caller might want to continue flushing. + * + * False, when there is no pending record, or when the console + * context cannot be acquired, or the ownership has been lost. + * The caller should give up. Either the job is done, cannot be + * done, or will be handled by the owning context. + * + * This is an internal helper to handle the locking of the console before + * calling nbcon_emit_next_record(). + */ +static bool nbcon_atomic_emit_one(struct nbcon_write_context *wctxt) +{ + struct nbcon_context *ctxt = &ACCESS_PRIVATE(wctxt, ctxt); + + if (!nbcon_context_try_acquire(ctxt)) + return false; + + /* + * nbcon_emit_next_record() returns false when the console was + * handed over or taken over. In both cases the context is no + * longer valid. + * + * The higher priority printing context takes over responsibility + * to print the pending records. + */ + if (!nbcon_emit_next_record(wctxt)) + return false; + + nbcon_context_release(ctxt); + + return ctxt->backlog; +} + +/** + * nbcon_legacy_emit_next_record - Print one record for an nbcon console + * in legacy contexts + * @con: The console to print on + * @handover: Will be set to true if a printk waiter has taken over the + * console_lock, in which case the caller is no longer holding + * both the console_lock and the SRCU read lock. Otherwise it + * is set to false. + * @cookie: The cookie from the SRCU read lock. + * + * Context: Any context except NMI. + * Return: True, when a record has been printed and there are still + * pending records. The caller might want to continue flushing. + * + * False, when there is no pending record, or when the console + * context cannot be acquired, or the ownership has been lost. + * The caller should give up. Either the job is done, cannot be + * done, or will be handled by the owning context. + * + * This function is meant to be called by console_flush_all() to print records + * on nbcon consoles from legacy context (printing via console unlocking). + * Essentially it is the nbcon version of console_emit_next_record(). + */ +bool nbcon_legacy_emit_next_record(struct console *con, bool *handover, + int cookie) +{ + struct nbcon_write_context wctxt = { }; + struct nbcon_context *ctxt = &ACCESS_PRIVATE(&wctxt, ctxt); + unsigned long flags; + bool progress; + + /* Use the same procedure as console_emit_next_record(). */ + printk_safe_enter_irqsave(flags); + console_lock_spinning_enable(); + stop_critical_timings(); + + ctxt->console = con; + ctxt->prio = nbcon_get_default_prio(); + + progress = nbcon_atomic_emit_one(&wctxt); + + start_critical_timings(); + *handover = console_lock_spinning_disable_and_check(cookie); + printk_safe_exit_irqrestore(flags); + + return progress; +} + +/** * __nbcon_atomic_flush_pending_con - Flush specified nbcon console using its * write_atomic() callback * @con: The nbcon console to flush diff --git a/kernel/printk/printk.c b/kernel/printk/printk.c index e1cf0f7d6ff2..d17b0e057e22 100644 --- a/kernel/printk/printk.c +++ b/kernel/printk/printk.c @@ -1860,7 +1860,7 @@ static bool console_waiter; * there may be a waiter spinning (like a spinlock). Also it must be * ready to hand over the lock at the end of the section. */ -static void console_lock_spinning_enable(void) +void console_lock_spinning_enable(void) { /* * Do not use spinning in panic(). The panic CPU wants to keep the lock. @@ -1899,7 +1899,7 @@ static void console_lock_spinning_enable(void) * * Return: 1 if the lock rights were passed, 0 otherwise. */ -static int console_lock_spinning_disable_and_check(int cookie) +int console_lock_spinning_disable_and_check(int cookie) { int waiter; @@ -2951,13 +2951,20 @@ static bool console_flush_all(bool do_cond_resched, u64 *next_seq, bool *handove cookie = console_srcu_read_lock(); for_each_console_srcu(con) { short flags = console_srcu_read_flags(con); + u64 printk_seq; bool progress; if (!console_is_usable(con, flags)) continue; any_usable = true; - progress = console_emit_next_record(con, handover, cookie); + if (flags & CON_NBCON) { + progress = nbcon_legacy_emit_next_record(con, handover, cookie); + printk_seq = nbcon_seq_read(con); + } else { + progress = console_emit_next_record(con, handover, cookie); + printk_seq = con->seq; + } /* * If a handover has occurred, the SRCU read lock @@ -2967,8 +2974,8 @@ static bool console_flush_all(bool do_cond_resched, u64 *next_seq, bool *handove return false; /* Track the next of the highest seq flushed. */ - if (con->seq > *next_seq) - *next_seq = con->seq; + if (printk_seq > *next_seq) + *next_seq = printk_seq; if (!progress) continue; -- 2.39.2