Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:1 as permitted sender) client-ip=2620:137:e000::3:1;
From:   Quan Nguyen <quan@os.amperecomputing.com>
To:     Brendan Higgins <brendan.higgins@linux.dev>,
        Benjamin Herrenschmidt <benh@kernel.crashing.org>,
        Joel Stanley <joel@jms.id.au>,
        Andi Shyti <andi.shyti@kernel.org>,
        Andrew Jeffery <andrew@codeconstruct.com.au>,
        Wolfram Sang <wsa@kernel.org>,
        Jae Hyun Yoo <jae.hyun.yoo@linux.intel.com>,
        Guenter Roeck <linux@roeck-us.net>, linux-i2c@vger.kernel.org,
        openbmc@lists.ozlabs.org, linux-arm-kernel@lists.infradead.org,
        linux-aspeed@lists.ozlabs.org, linux-kernel@vger.kernel.org
Cc:     Cosmo Chou <chou.cosmo@gmail.com>,
        Open Source Submission <patches@amperecomputing.com>,
        Phong Vo <phong@os.amperecomputing.com>,
        "Thang Q . Nguyen" <thang@os.amperecomputing.com>,
        Quan Nguyen <quan@os.amperecomputing.com>
Subject: [PATCH v3 2/2] i2c: aspeed: Acknowledge Tx done with and without ACK irq late
Date:   Fri,  8 Dec 2023 10:31:42 +0700
Message-Id: <20231208033142.1673232-3-quan@os.amperecomputing.com>
In-Reply-To: <20231208033142.1673232-1-quan@os.amperecomputing.com>
References: <20231208033142.1673232-1-quan@os.amperecomputing.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?yJP4exEKch3CkzPFSPfMms+t1cRdqzQsozSyuSBYjKGMlyiwOKdr7N9HOE9O?=
 =?us-ascii?Q?BqHIZXrqGyEy6UGsvPE11Sb8O8WkZURJzpNU0HDID6ll7R3n0gFbL+RkjpN6?=
 =?us-ascii?Q?FR58fapIFQu0oMrmxUwG5Hgh+V83x2uILmsNTRofiCPrQoCfs/zuyZY2v/pP?=
 =?us-ascii?Q?6rmLaqFrKj99LLVP95NbmcgXceT6DD34uMheNLGPjNVq6GyhpE/3QnyriZz0?=
 =?us-ascii?Q?zX9OVqBURkmilSPZ1tXb7AzYUncpJzujd4AYcUso27Bj5l9Gc87JGYSGcSa5?=
 =?us-ascii?Q?SdO+7N9hoUCLFjSsOl/nrlb75tUHe7wuqTsdG0+6m30QVQeliJcYb2XH955Q?=
 =?us-ascii?Q?z/xjRbr097IVAkH0guelYKCJMvYa82jJAsiFqVgBG4E0ifzkyrdqHQ+izzjN?=
 =?us-ascii?Q?9iNutMydRk7HMApBa9XHCzY6wDiEbn+SM84xMB18fxyHY0PElBtiNdlAu8Dm?=
 =?us-ascii?Q?PB9e3vSp7ipI/ysJZvmfSI3MB1MpBlMd+mE+5gnG1TzSAx5BaHO/A9db2C2p?=
 =?us-ascii?Q?Hi1biIOXDs8/f5ZF3xHA7EgG2IXy1QbbX5r8xzcbo3YEu5JR6sUlucfi6o0P?=
 =?us-ascii?Q?ErYOHgc/oOfqfq49MRQ0ruIGJM5kIoKiyhSPL2ZM3XcSzll8RG1MHFQ9Rkh1?=
 =?us-ascii?Q?xfh9u2S8Mc3kAIcW7FrbP73idb9TtTuAu4mYRE1yjmwHwr7u8pBnzTopWVY3?=
 =?us-ascii?Q?EgMTsAoVnQ3Y8Xq7VibrWV1glrnRshlih+/0TtnN0HDCdi5coMX97kGqyLCQ?=
 =?us-ascii?Q?axDl39oQpyEnQjV/aQSdv32YMDiGbdd0477HNr662XZX9WdiH06TYzJi35dL?=
 =?us-ascii?Q?+EQTTyN8YcM6aBq/qwOhUVOUNOokdbwVm31Hyhdjhw/Nn28PQWl5eE0msqe3?=
 =?us-ascii?Q?rF7zFptcNgqjnJ7F+1/+9rsugMM2xPtE1yCQiMRuQJSCKrJxzlxUGsmaiqhK?=
 =?us-ascii?Q?I3/hORiReqcbi3gdKlrVUeuUscYOMMk/icW6ySV1fKxGYYunixz52gDcNCec?=
 =?us-ascii?Q?uKL3on9+Xntsc1BkSHnc9Jb6T2InHoeaF7nklCgHuPAfs4QfZi6NPEWx99+u?=
 =?us-ascii?Q?J2BG6vtE1GF3CXPYbVFC4kXMFS7YgyLHpfMC782aMXK5OG3S3DmmeBwdqQLO?=
 =?us-ascii?Q?vL+GMJj//aX+m16dPzGDWB2RlK3y4yEHYLB9c/BrxaJPZCwpb0Pf0YOZhavL?=
 =?us-ascii?Q?WlLDHzBKK+ehPoMNnnO6DBz1SydVPw0Yi19WyKN8fSPLG/ztTaxwgS727jM+?=
 =?us-ascii?Q?dstsyqaa1J5vorWH9xvIaexx0775dbATNpbc8Zs55i6gGrOyJPWZwtyJhQAq?=
 =?us-ascii?Q?wie6XutnoqmeXUEcRjhjOgeZ9MoFGfLBRrdaFnjB8UiPQcjOjr2xU7Lhu+Ks?=
 =?us-ascii?Q?GuL0cItVtL0GLToCEDdAevmUGsX7pnJJh1a2TcVP12Lq9uUJd4LdUctO5J/r?=
 =?us-ascii?Q?Yyr1Be62iAyH1gGxVEBBg7mDTB/FLBVL+qwHM07QqwHNZQsHh4DFLUNekj7B?=
 =?us-ascii?Q?DURZzybma3jOxb08jlCHF9dd9ljGrpr8d4CZSfqu2wG6nKH7jn5FER1YyJvK?=
 =?us-ascii?Q?GD8pEaHaFzctMbU5Gx/qaYC8NUks8uFeqB1qLE5Gq7GQKEG3EtGunKS/loWQ?=
 =?us-ascii?Q?qY58MzlnFW9nnGepG79sOQU=3D?=
X-OriginatorOrg: os.amperecomputing.com
X-MS-Exchange-CrossTenant-Network-Message-Id: a89b4120-66dc-4f5f-b8e2-08dbf79e45b0
X-MS-Exchange-CrossTenant-AuthSource: SN4PR01MB7455.prod.exchangelabs.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Dec 2023 03:32:15.3008
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3bc2b170-fd94-476d-b0ce-4229bdc904a7
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: uz7HCNU0kVg1jpTNGtYD8qORLzFZwnOWOWoo/LIoYqY6xFPqeQBwVLQS0ch0Ht73ZgvIJgNsolVPnv5SeTiW8m27jG+A0h7DAFeHQfLcH3o=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS7PR01MB7784
X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIM_SIGNED,DKIM_VALID,
	DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,
	SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable
	autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on morse.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (morse.vger.email [0.0.0.0]); Thu, 07 Dec 2023 19:32:44 -0800 (PST)

Commit 2be6b47211e1 ("i2c: aspeed: Acknowledge most interrupts early in
interrupt handler") acknowledges most interrupts early before the slave
irq handler is executed, except for the "Receive Done Interrupt status"
which is acknowledged late in the interrupt.
However, it has been observed that the early acknowledgment of "Transmit
Done Interrupt Status" (with ACK or NACK) often causes the interrupt to
be raised in READ REQUEST state, that shows the
"Unexpected ACK on read request." complaint messages.

Assuming that the "Transmit Done" interrupt should only be acknowledged
once it is truly processed, this commit fixes that issue by acknowledging
interrupts for both ACK and NACK cases late in the interrupt handler.

Fixes: 2be6b47211e1 ("i2c: aspeed: Acknowledge most interrupts early in interrupt handler")
Signed-off-by: Quan Nguyen <quan@os.amperecomputing.com>
---
v3:
  + Fix the unconditinal write when ack the irqs               [Andrew]
  + Refactor the code to enhance code readability                [Quan]
  + Fix grammar in commit message                                [Quan]

v2:
  + Split to separate series                                     [Joel]
  + Added the Fixes line                                         [Joel]
  + Fixed multiline comment                                      [Joel]
  + Refactor irq clearing code                          [Joel, Guenter]
  + Revised commit message                                       [Joel]
  + Revised commit message                                       [Quan]
  + About a note to remind why the readl() should immediately follow the
writel() to fix the race condition when clearing irq status from commit
c926c87b8e36 ("i2c: aspeed: Avoid i2c interrupt status clear race
condition"), I think it looks straight forward in this patch and decided
not to add that note.                                            [Joel]

v1:
  + First introduced in
https://lore.kernel.org/all/20210519074934.20712-1-quan@os.amperecomputing.com/
---
 drivers/i2c/busses/i2c-aspeed.c | 21 +++++++++++++--------
 1 file changed, 13 insertions(+), 8 deletions(-)

diff --git a/drivers/i2c/busses/i2c-aspeed.c b/drivers/i2c/busses/i2c-aspeed.c
index 1c2a4f4c4e1b..967a26dd4ffa 100644
--- a/drivers/i2c/busses/i2c-aspeed.c
+++ b/drivers/i2c/busses/i2c-aspeed.c
@@ -617,13 +617,19 @@ static u32 aspeed_i2c_master_irq(struct aspeed_i2c_bus *bus, u32 irq_status)
 static irqreturn_t aspeed_i2c_bus_irq(int irq, void *dev_id)
 {
 	struct aspeed_i2c_bus *bus = dev_id;
-	u32 irq_received, irq_remaining, irq_handled;
+	u32 irq_received, irq_remaining, irq_handled, irq_ack_last;
 
 	spin_lock(&bus->lock);
 	irq_received = readl(bus->base + ASPEED_I2C_INTR_STS_REG);
-	/* Ack all interrupts except for Rx done */
-	writel(irq_received & ~ASPEED_I2CD_INTR_RX_DONE,
-	       bus->base + ASPEED_I2C_INTR_STS_REG);
+
+	/*
+	 * Early acking of INTR_RX_DONE and INTR_TX_[ACK|NAK] would indicate HW to
+	 * start receiving or sending new data, and this may cause a race condition
+	 * as the irq handler has not yet handled these irqs but is being acked.
+	 * Let's ack them late at the end of the irq handler when those are truly processed.
+	 */
+	irq_ack_last = ASPEED_I2CD_INTR_RX_DONE | ASPEED_I2CD_INTR_TX_ACK | ASPEED_I2CD_INTR_TX_NAK;
+	writel(irq_received & ~irq_ack_last, bus->base + ASPEED_I2C_INTR_STS_REG);
 	readl(bus->base + ASPEED_I2C_INTR_STS_REG);
 	irq_received &= ASPEED_I2CD_INTR_RECV_MASK;
 	irq_remaining = irq_received;
@@ -667,12 +673,11 @@ static irqreturn_t aspeed_i2c_bus_irq(int irq, void *dev_id)
 			"irq handled != irq. expected 0x%08x, but was 0x%08x\n",
 			irq_received, irq_handled);
 
-	/* Ack Rx done */
-	if (irq_received & ASPEED_I2CD_INTR_RX_DONE) {
-		writel(ASPEED_I2CD_INTR_RX_DONE,
-		       bus->base + ASPEED_I2C_INTR_STS_REG);
+	if (irq_received & irq_ack_last) {
+		writel(irq_received & irq_ack_last, bus->base + ASPEED_I2C_INTR_STS_REG);
 		readl(bus->base + ASPEED_I2C_INTR_STS_REG);
 	}
+
 	spin_unlock(&bus->lock);
 	return irq_remaining ? IRQ_NONE : IRQ_HANDLED;
 }
-- 
2.35.1