Received: by 2002:a05:6358:3188:b0:123:57c1:9b43 with SMTP id q8csp6091326rwd; Mon, 5 Jun 2023 12:55:49 -0700 (PDT) X-Google-Smtp-Source: ACHHUZ549oHEEew/aOGFZDmEB8uI/E2xk6lU1/zUJwiR0k2PAkFVwe/UF3TD5VpSyAF/vG3CFCrx X-Received: by 2002:ac8:5acb:0:b0:3f6:bb5e:dd21 with SMTP id d11-20020ac85acb000000b003f6bb5edd21mr10586458qtd.39.1685994949316; Mon, 05 Jun 2023 12:55:49 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1685994949; cv=none; d=google.com; s=arc-20160816; b=UaxdB3rF71uOpjcBwIrH53vl7GN/piWOuSboE0vlXwUqFXoOfbkBxpYrNlNfKNnUV5 FAqFB1PNJ/00lDMhK0hp1fwlHdV8I3oAaTr45UjWgRCm8LZSO024FuC19zMmSnrLQkIv 5ELzFSv9UUo+4xAmRnG7pcEtDlHFSuITxJFAZboKZLEIwsL4B3qfqHXRwbrSeMQtdJjH XCjt6aLtAu8jJHU9H6yv7BjGjDGURsYwU6z7NWISKNn/a276bl1wg4onLCwleLp+Klyx 1NQnqvwwGllM+VdeWWOuMo7hvPHhUL+g/J4OsAalzbFqbZCTUWJctNl4ov/5Kkuuh2hS hvoA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:in-reply-to :content-language:references:cc:to:subject:from:user-agent :mime-version:date:message-id:dkim-signature; bh=CIqcWezF5DbL9kbCtnrWj6Qycb88Kq0qilAfYATVCUc=; b=QTTM6P29cAjqRkLB5kzfkrrT5DeyBjHxdZ20CfQmSXGyZkJmwHhp6D9TkeoX7ee5Bb kP8WPR2Dx3rW4CUeTqhkBuD53NCKwGncCDlKeD0gF8i6rk67VUzZJgmbFHDRGgMPuMbd H8f7T4kUuNZbD+f4GT1x+qBn7IDLy6xTYKvEj3D30JIRPTr+vvQC/geFQ2CaEcCSoMGD KtV9jOHNutXuzc9vJleG9OKJsFE02nrcNvdYo5ckn8qEqQZ3be6yYa1ndqpxxUGLgLlz d6FmbS2Dd1XSajUqKp/Q7dS7PUbxJBFsNnuJGWBHL1NR+8bmGtHFQpRYMEYmHcLruGCE F4rQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=rZxRdp0e; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id o14-20020a05622a044e00b003f9a7510049si1276459qtx.528.2023.06.05.12.55.35; Mon, 05 Jun 2023 12:55:49 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=rZxRdp0e; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S235871AbjFETsA (ORCPT + 99 others); Mon, 5 Jun 2023 15:48:00 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:55880 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S235843AbjFETrx (ORCPT ); Mon, 5 Jun 2023 15:47:53 -0400 Received: from mail-io1-xd36.google.com (mail-io1-xd36.google.com [IPv6:2607:f8b0:4864:20::d36]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A36CC19C for ; Mon, 5 Jun 2023 12:47:45 -0700 (PDT) Received: by mail-io1-xd36.google.com with SMTP id ca18e2360f4ac-7748d634a70so202512739f.2 for ; Mon, 05 Jun 2023 12:47:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1685994464; x=1688586464; h=content-transfer-encoding:in-reply-to:content-language:references :cc:to:subject:from:user-agent:mime-version:date:message-id:from:to :cc:subject:date:message-id:reply-to; bh=CIqcWezF5DbL9kbCtnrWj6Qycb88Kq0qilAfYATVCUc=; b=rZxRdp0eW9jJRcVN1bDfdYocssgwuz6YOSdnGAihVAPu/t7Tl5eGNQjDco+RrO5wEi gBxOncmiWbzA36vGgZwT7xErqOKJb0sLysWpX2cM9YLd//XB3021Wlw8oAl0xTSdLmfS +Et4ztUCGb511SZeKN9cPwjR9pzttTZx8tM9K0K6Qb4Gm76xbdQptom17CR9y9umBits edMht9OY2Cty8YtD7NMIzLVOCVZgvw9f6gA2FKDjxvt4SzGOBGzejlpg6mwbF1DOCgvm 06t6ycOV1JGzoNWQfuGy6pgb1/qm9Jf/iEzMId7qKk5RKdkBX9bcUHwwc3Kluj2DBfcw N0ZQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1685994464; x=1688586464; h=content-transfer-encoding:in-reply-to:content-language:references :cc:to:subject:from:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=CIqcWezF5DbL9kbCtnrWj6Qycb88Kq0qilAfYATVCUc=; b=aitdoFcxq/MKPJhZFqbbIERcvVuB4HQf4lLQc3ksSChpE6PM3obxVvywW40GA5W+eK s1OBhTN/P3pJrlm/OMMlBaQ1Tj+0T7TAA0ayvtKoVg6sdKlz9tJQAVjWg/zlbgg/PXJz ijVSR60xg+hgGL9Yyu+D+Y0+4BPj7CYcf1dvBVACtvSsyjChUsre5pXWsYZT8+BjpDqS 8sViQpw1i/QYveNk5ZSMF9cabh+Zj7Fk86MCvzeSN1pAGdoTId1tphDO6mvr9jL64xVQ Pin6OHZ08mEc+vGx8bU1E4dEvkKSXluY8TGVgx5hsMVPreQ8wjYqEwgLCkR5yTgl+bvO DDOQ== X-Gm-Message-State: AC+VfDzpfCydy/rUUpJTlSvBU3DGH5L/gW+w4ocaYUKL7CeW0A7o6lsO AJPUDXcz7Sf+Vm3k4t/cWd7+Ug== X-Received: by 2002:a6b:7e48:0:b0:774:8210:3c6a with SMTP id k8-20020a6b7e48000000b0077482103c6amr159308ioq.11.1685994464529; Mon, 05 Jun 2023 12:47:44 -0700 (PDT) Received: from [172.22.22.28] ([98.61.227.136]) by smtp.gmail.com with ESMTPSA id l9-20020a02a889000000b00408b3bc8061sm2451565jam.43.2023.06.05.12.47.43 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 05 Jun 2023 12:47:44 -0700 (PDT) Message-ID: Date: Mon, 5 Jun 2023 14:47:42 -0500 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.11.0 From: Alex Elder Subject: Re: [PATCH v13 05/24] mailbox: Add Gunyah message queue mailbox To: Elliot Berman , Srinivas Kandagatla , Prakruthi Deepak Heragu , Jonathan Corbet , Jassi Brar Cc: Murali Nalajala , Trilok Soni , Srivatsa Vaddagiri , Carl van Schaik , Dmitry Baryshkov , Bjorn Andersson , Konrad Dybcio , Arnd Bergmann , Greg Kroah-Hartman , Rob Herring , Krzysztof Kozlowski , Bagas Sanjaya , Will Deacon , Andy Gross , Catalin Marinas , linux-arm-msm@vger.kernel.org, devicetree@vger.kernel.org, linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org, linux-arm-kernel@lists.infradead.org References: <20230509204801.2824351-1-quic_eberman@quicinc.com> <20230509204801.2824351-6-quic_eberman@quicinc.com> Content-Language: en-US In-Reply-To: <20230509204801.2824351-6-quic_eberman@quicinc.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-2.2 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A,RCVD_IN_DNSWL_NONE, SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 5/9/23 3:47 PM, Elliot Berman wrote: > Gunyah message queues are a unidirectional inter-VM pipe for messages up > to 1024 bytes. This driver supports pairing a receiver message queue and > a transmitter message queue to expose a single mailbox channel. > > Signed-off-by: Elliot Berman This patch does not apply properly, because it updates "message-queue.rst", which does not currently exist. I'm going to ignore that for now, though. I'm generally OK with giving you my "Reviewed-by" on this but I'll wait until you send v14 with the full content of "message-queue.rst". Also, I suggest below that you update all your SPDX tags to no longer use the deprecated "GPL-2.0" identifier. -Alex > --- > Documentation/virt/gunyah/message-queue.rst | 8 + > drivers/mailbox/Makefile | 2 + > drivers/mailbox/gunyah-msgq.c | 212 ++++++++++++++++++++ > include/linux/gunyah.h | 57 ++++++ > 4 files changed, 279 insertions(+) > create mode 100644 drivers/mailbox/gunyah-msgq.c > > diff --git a/Documentation/virt/gunyah/message-queue.rst b/Documentation/virt/gunyah/message-queue.rst > index b352918ae54b..70d82a4ef32d 100644 > --- a/Documentation/virt/gunyah/message-queue.rst > +++ b/Documentation/virt/gunyah/message-queue.rst > @@ -61,3 +61,11 @@ vIRQ: two TX message queues will have two vIRQs (and two capability IDs). > | | | | | | > | | | | | | > +---------------+ +-----------------+ +---------------+ > + > +Gunyah message queues are exposed as mailboxes. To create the mailbox, create > +a mbox_client and call `gh_msgq_init()`. On receipt of the RX_READY interrupt, > +all messages in the RX message queue are read and pushed via the `rx_callback` > +of the registered mbox_client. > + > +.. kernel-doc:: drivers/mailbox/gunyah-msgq.c > + :identifiers: gh_msgq_init > diff --git a/drivers/mailbox/Makefile b/drivers/mailbox/Makefile > index fc9376117111..5f929bb55e9a 100644 > --- a/drivers/mailbox/Makefile > +++ b/drivers/mailbox/Makefile > @@ -55,6 +55,8 @@ obj-$(CONFIG_MTK_CMDQ_MBOX) += mtk-cmdq-mailbox.o > > obj-$(CONFIG_ZYNQMP_IPI_MBOX) += zynqmp-ipi-mailbox.o > > +obj-$(CONFIG_GUNYAH) += gunyah-msgq.o > + > obj-$(CONFIG_SUN6I_MSGBOX) += sun6i-msgbox.o > > obj-$(CONFIG_SPRD_MBOX) += sprd-mailbox.o > diff --git a/drivers/mailbox/gunyah-msgq.c b/drivers/mailbox/gunyah-msgq.c > new file mode 100644 > index 000000000000..b7a54f233680 > --- /dev/null > +++ b/drivers/mailbox/gunyah-msgq.c > @@ -0,0 +1,212 @@ > +// SPDX-License-Identifier: GPL-2.0-only After seeing this tag I looked into it, and see that SPDX has deprecated "GPL-2.0" in favor of "GPL-2.0-only". Please update all SPDX licenses that use "GPL-2.0" to use this new tag instead. > +/* > + * Copyright (c) 2022-2023 Qualcomm Innovation Center, Inc. All rights reserved. > + */ > + > +#include > +#include > +#include > +#include > +#include > +#include > +#include > +#include > + > +#define mbox_chan_to_msgq(chan) (container_of(chan->mbox, struct gh_msgq, mbox)) Parentheses are not needed around a container_of() call. > + > +static irqreturn_t gh_msgq_rx_irq_handler(int irq, void *data) > +{ > + struct gh_msgq *msgq = data; > + struct gh_msgq_rx_data rx_data; > + enum gh_error gh_error; > + bool ready = true; > + > + while (ready) { > + gh_error = gh_hypercall_msgq_recv(msgq->rx_ghrsc->capid, > + &rx_data.data, sizeof(rx_data.data), > + &rx_data.length, &ready); > + if (gh_error != GH_ERROR_OK) { > + if (gh_error != GH_ERROR_MSGQUEUE_EMPTY) > + dev_warn(msgq->mbox.dev, "Failed to receive data: %d\n", gh_error); > + break; > + } > + if (likely(gh_msgq_chan(msgq)->cl)) > + mbox_chan_received_data(gh_msgq_chan(msgq), &rx_data); > + } > + > + return IRQ_HANDLED; > +} > + > +/* Fired when message queue transitions from "full" to "space available" to send messages */ > +static irqreturn_t gh_msgq_tx_irq_handler(int irq, void *data) > +{ > + struct gh_msgq *msgq = data; > + > + mbox_chan_txdone(gh_msgq_chan(msgq), 0); > + > + return IRQ_HANDLED; > +} > + > +/* Fired after sending message and hypercall told us there was more space available. */ > +static void gh_msgq_txdone_tasklet(struct tasklet_struct *tasklet) > +{ > + struct gh_msgq *msgq = container_of(tasklet, struct gh_msgq, txdone_tasklet); > + > + mbox_chan_txdone(gh_msgq_chan(msgq), msgq->last_ret); > +} > + > +static int gh_msgq_send_data(struct mbox_chan *chan, void *data) > +{ > + struct gh_msgq *msgq = mbox_chan_to_msgq(chan); > + struct gh_msgq_tx_data *msgq_data = data; > + u64 tx_flags = 0; > + enum gh_error gh_error; > + bool ready; > + > + if (!msgq->tx_ghrsc) > + return -EOPNOTSUPP; > + > + if (msgq_data->push) > + tx_flags |= GH_HYPERCALL_MSGQ_TX_FLAGS_PUSH; > + > + gh_error = gh_hypercall_msgq_send(msgq->tx_ghrsc->capid, msgq_data->length, msgq_data->data, > + tx_flags, &ready); > + > + /** > + * unlikely because Linux tracks state of msgq and should not try to > + * send message when msgq is full. > + */ > + if (unlikely(gh_error == GH_ERROR_MSGQUEUE_FULL)) > + return -EAGAIN; > + > + /** > + * Propagate all other errors to client. If we return error to mailbox > + * framework, then no other messages can be sent and nobody will know > + * to retry this message. > + */ > + msgq->last_ret = gh_error_remap(gh_error); > + > + /** > + * This message was successfully sent, but message queue isn't ready to > + * accept more messages because it's now full. Mailbox framework > + * requires that we only report that message was transmitted when > + * we're ready to transmit another message. We'll get that in the form > + * of tx IRQ once the other side starts to drain the msgq. > + */ > + if (gh_error == GH_ERROR_OK) { > + if (!ready) > + return 0; > + } else Standard style would add curly braces to the else block. } else { > + dev_err(msgq->mbox.dev, "Failed to send data: %d (%d)\n", gh_error, msgq->last_ret); > + > + /** > + * We can send more messages. Mailbox framework requires that tx done > + * happens asynchronously to sending the message. Gunyah message queues > + * tell us right away on the hypercall return whether we can send more > + * messages. To work around this, defer the txdone to a tasklet. > + */ > + tasklet_schedule(&msgq->txdone_tasklet); > + > + return 0; > +} . . .