Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:5 as permitted sender) client-ip=2620:137:e000::3:5;
Message-ID: <706506b7-a89c-4dfc-b233-be7822eb056e@os.amperecomputing.com>
Date:   Thu, 30 Nov 2023 15:39:45 +0700
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH] mctp i2c: Requeue the packet when arbitration is lost
Content-Language: en-CA
To:     Jeremy Kerr <jk@codeconstruct.com.au>,
        Matt Johnston <matt@codeconstruct.com.au>,
        "David S . Miller" <davem@davemloft.net>,
        Eric Dumazet <edumazet@google.com>,
        Jakub Kicinski <kuba@kernel.org>,
        Paolo Abeni <pabeni@redhat.com>, netdev@vger.kernel.org,
        linux-kernel@vger.kernel.org, openbmc@lists.ozlabs.org,
        Open Source Submission <patches@amperecomputing.com>
Cc:     Phong Vo <phong@os.amperecomputing.com>,
        Thang Nguyen <thang@os.amperecomputing.com>,
        Dung Cao <dung@os.amperecomputing.com>
References: <20231130075247.3078931-1-quan@os.amperecomputing.com>
 <473048522551f1cae5273eb4cd31b732d6e33e53.camel@codeconstruct.com.au>
From:   Quan Nguyen <quan@os.amperecomputing.com>
In-Reply-To: <473048522551f1cae5273eb4cd31b732d6e33e53.camel@codeconstruct.com.au>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?clArZ2hvOUlmNXl4bEhVYkk3RjhweDVYWHZzMnNzYi92UGROb2c3R2hTNFlN?=
 =?utf-8?B?L1VieWtFMDNtWk9WZm1sT3M3OGo5U1BNK2hoOUhueUNUSE8za1hZWXhVZ08z?=
 =?utf-8?B?S1ZSUDdpV1hyc0w1ZFUwNDhoamhhTkZweDJWcjIyemJ1NE9hZ0ZJVnFUOThv?=
 =?utf-8?B?Zk9LY2NMS1d6ZnVMaEtFU0x3WW9TRUIrMDRrVWFxOXR4U3AxeXpNUWRPY2NW?=
 =?utf-8?B?RTVsdGNmMHllbVYyVWFUWFRQSWhtRXpWNkErYzJrQ0FnZVBBSXV0Q1ZZTXRK?=
 =?utf-8?B?M1hCMnBQcythS0ZpN2hMU0VtRDJoN2dRcmJzT3lNZ1J0VDM4NjBjTWowUEtY?=
 =?utf-8?B?Mkh4MC9WdlIxMnN4YlVUUW41YmY5bkxQekdpbExEbGdhMFJkUFA3cFVSMjAx?=
 =?utf-8?B?OFZTS2dtRm5LWThQeUFtNWRGaTdoZGpDaExZQmczS2M1YXE0R3lXTlFPcWZN?=
 =?utf-8?B?VGFkN0puMlVOQlZ5T1RqaDNmTzR6OGh3WVFjMTRSQnBvZ2dtNFRkRXRDMDlG?=
 =?utf-8?B?QVR1dEZSc0dtYktMSThBYnFxeGRRQXFCTnRVT0U0V2JqMjlLcmNGb1pCTGJs?=
 =?utf-8?B?Tlc3ZFpHUGFpWmhlSTJDdXhHeHdNZ2w4SGp6S0hMTE1zYUs1TWlZeGVxcDA0?=
 =?utf-8?B?Yk9Jb2lORTBLME81dDl4MmFLcnYxVXRSbGFPSkxEQ2U2OGpKZTkvSVJKQ1I5?=
 =?utf-8?B?eVBWdmNvaGRic1B6alF3NFV4bmR6QXNJVklROGZZc0J1RS9JcXVadjFicUlp?=
 =?utf-8?B?WXBOUm5NbEhraHNRUmFiNVJENVF6NjFyY2YvMFUzcnJIaWduWDdqTkpsbDZa?=
 =?utf-8?B?WWEvd1VNaytPL3VSU3ZCN2N2UnpqNnNQWDNKVlNYak5hc25TeGJhTnViZEhG?=
 =?utf-8?B?dVZya0tDSVhwcFFDTDJmN2RrQ056dm1vY3F5cUx2c0dHQ201d3Y5Q092YUUx?=
 =?utf-8?B?NjFobDFwWCsxa0lOVWtSem5Eekt0Qk1GdXJxMTNDSzhkekJZZk94dE1GNlVR?=
 =?utf-8?B?ZVJld1dTYWJMN0trNnd0bGJZOXFOSnZrOE1OSnNiZUlkdjlrNGJocUhkdXBt?=
 =?utf-8?B?VFdOdDhJSVpMeG43clVyRFc2Qi9zMmJCcWRhUE4wRHJ3c1ppYktCblpna2dz?=
 =?utf-8?B?L0M5OE5BbWtXbmhmbHlpT3VHbFF4cThpdzU2MWVidVl3NE9CRU1RNWRtM0lp?=
 =?utf-8?B?NnN5M3BTcU5kb3U2aTRKa0drdjdERW9xTVFTdE1valordUZvaU1JKzA5aFpt?=
 =?utf-8?B?aGdWZFo5UXJMTlk3Tkp5LzdMY1RuVFgwbEhVOGpTMTYyM0NwRW1xRG5jeDdp?=
 =?utf-8?B?Y2VVeXdsR0pQdkg4UkI0MjNVSFZnNGtueC9DMUNLZFZNT1dycXdDZlNOenZT?=
 =?utf-8?B?dlVjMVE3SUw1REI0UXVCMVAyTHRIaERTOW9aVC94SUhyMVk1b1MrazNSRUlV?=
 =?utf-8?B?bTFHbE5ibCtqd3QrenIrUytBQ243dE9MWGhpZjNlY2tOT0JmS1hXdWVDTEFq?=
 =?utf-8?B?dFNxRGxsU2hmbE1BTko2Qzl5S2tPSjZtMkZzbFVkem5EM1Fhd3BoTUVzV1Nq?=
 =?utf-8?B?UU93TlgzSW1YSmhpVURyWHJHcTdmbXhEWW84eFdyWnVsc2g2dERhUGhXVWs2?=
 =?utf-8?B?SHZzS2N3c0hhdHord3h0Q1dsbnhPT3JMNEZmb2xyTEt3MFNFYlVWNEcyY0hp?=
 =?utf-8?B?dGJ1RjVEVlFZNG9ybnJUVHpUaTFLRldkWE1TTjdSeDVOa3ZhdXg1NHpTNnFW?=
 =?utf-8?B?Q1YyUGVzTTBNMkhyTkNEZVlBZEJJNStFcUI2YzhQVlBndDlmcEVPZzNZTDJx?=
 =?utf-8?B?WWtlRnRBNHhxMkYvaVdKMUJXcDBIR29aY3E1ekFIZ3RtUWpSMzVGTFlNcHR3?=
 =?utf-8?B?ZU1DZWxjQjFxNENJeWNPMThVRWVWQ3o4dFE0WDc2UytJdm9xejhIUWVpMEtG?=
 =?utf-8?B?UzhOMGFVKzJWc29PU09qQXBwV3dUNldsZUFBU2pQUHFVblRiM1hUU090NU1G?=
 =?utf-8?B?b1hJVVUrQVpaUElmMmlvK0lEdE93bFpNRmtYNkxGWCsvTm9sdDkrODZjTDZU?=
 =?utf-8?B?L3Y4ZW1UdnBGWWVlSmU0Ry9OeXFvY0J4bHJuOVBoaEp0YkhRTkJxTmVrWnV1?=
 =?utf-8?B?V3lZS2RMVkY2NUVVQXd5MjUvU3Qyci84Vm4rUXpQMTFmYUM3eGR0SUxBWGtH?=
 =?utf-8?Q?7/2spUU9rCg9a4vnEONCFJs=3D?=
X-OriginatorOrg: os.amperecomputing.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 1ba9933a-9f55-4a36-d22b-08dbf17fee39
X-MS-Exchange-CrossTenant-AuthSource: SN4PR01MB7455.prod.exchangelabs.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Nov 2023 08:39:56.8262
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3bc2b170-fd94-476d-b0ce-4229bdc904a7
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: yS0FznNfA++d7BvfiXnhfp0xhbnZx4MwDb2837VqOiM+LdJXu1pphfZ4o/hr92kzBwK64huNxtqNvx4JZyvUcDNdhJ3/pwCQ91xppJ6/rt8=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR01MB6560
X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIM_SIGNED,DKIM_VALID,
	DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,
	SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable
	autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on groat.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (groat.vger.email [0.0.0.0]); Thu, 30 Nov 2023 00:40:17 -0800 (PST)


On 30/11/2023 15:03, Jeremy Kerr wrote:
> Hi Quan,
> 
>> If arbitration is lost, __i2c_transfer() returns -EAGAIN and the
>> packet should be resent.
>>
>> Requeue the packet and increase collisions count on this case.
> 
> Are you sure you want to re-queue the packet here? The i2c core would
> have already retried on arbitration loss:
> 
>    https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/drivers/i2c/i2c-core-base.c#n2223
> 
> With this change, we would be disregarding the limits in adap->retries
> and/or adap->timeout.
> 

Yes, the __i2c_transfer() does try its best to send the packet but if it 
still fail with -EAGAIN, that means it still unable to win the arbitration.

Without this patch we usually see the error below. The consequence is it 
stop and need the PLDM layer to retry when timed out, which takes time.

"[   61.616210] i2c i2c-3: __i2c_transfer failed -11"

With this commit, we all see the packets go through peacefully just by 
requeueing the packets at MCTP layer and eliminated the need to retry in 
PLDM layer which would need more time.

The result in our test is as below (Note: would needs some addition 
debug print code). I also think it is worth noting that in our setup 
there are multiple Masters.

[73183.511487] i2c i2c-3: Arbitration loss, re-queue the packet
[73192.550519] i2c i2c-3: __i2c_transfer failed -11
[73192.555734] i2c i2c-3: Arbitration loss, re-queue the packet
[73207.250036] i2c i2c-3: __i2c_transfer failed -11
[73207.255247] i2c i2c-3: Arbitration loss, re-queue the packet
[73429.499875] i2c i2c-3: __i2c_transfer failed -11
[73429.505116] i2c i2c-3: Arbitration loss, re-queue the packet
[73504.672065] i2c i2c-3: __i2c_transfer failed -11
[73504.677317] i2c i2c-3: Arbitration loss, re-queue the packet
[73540.762984] i2c i2c-3: __i2c_transfer failed -11
[73540.768242] i2c i2c-3: Arbitration loss, re-queue the packet
[73631.040049] i2c i2c-3: __i2c_transfer failed -11
[73631.045333] i2c i2c-3: Arbitration loss, re-queue the packet
[73648.538967] i2c i2c-3: __i2c_transfer failed -11

Thanks,
- Quan