Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Subject: Re: [PATCH v2 5/9] arm64: dts: ls1046a: make dma-coherent global to
 the SoC
To:     Leo Li <leoyang.li@nxp.com>,
        "shawnguo@kernel.org" <shawnguo@kernel.org>,
        "devicetree@vger.kernel.org" <devicetree@vger.kernel.org>
Cc:     "robh+dt@kernel.org" <robh+dt@kernel.org>,
        "linux-arm-kernel@lists.infradead.org" 
        <linux-arm-kernel@lists.infradead.org>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        Laurentiu Tudor <laurentiu.tudor@nxp.com>
References: <20220915233432.31660-1-leoyang.li@nxp.com>
 <20220915233432.31660-6-leoyang.li@nxp.com>
 <e27d295b-abbf-716c-5e0d-97dd63ce07df@seco.com>
 <AM0PR04MB6289919428F12CD125357D4F8F519@AM0PR04MB6289.eurprd04.prod.outlook.com>
From:   Sean Anderson <sean.anderson@seco.com>
Message-ID: <1db9ffaa-3c93-9e09-8966-73aba061f52e@seco.com>
Date:   Fri, 23 Sep 2022 12:35:00 -0400
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101
 Thunderbird/68.10.0
In-Reply-To: <AM0PR04MB6289919428F12CD125357D4F8F519@AM0PR04MB6289.eurprd04.prod.outlook.com>
Content-Type: text/plain; charset=utf-8
Content-Language: en-US
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?M0Q0aTF4WmdodDVvT24rZjVQNjRzRlh1dGdsbkZmaDBSQkdPbGJBQjlJbzBZ?=
 =?utf-8?B?VmJlWS9Ud3U1K3FjVTBFTmZwMmU4SXhmOEllZTdWN3BxN1Bzajl3Sjc3Z1pu?=
 =?utf-8?B?L2UwKzc3SzhxZW9obUFMMlBkRndaVk53R0tBUE9EUjFCZnZTN1lpMXRVaC9D?=
 =?utf-8?B?Qlh1YVJoeWkvY3hxK0RQNWhxd2pjNTBxYUhYaTFUK3JETWxYME41aFFEU0ht?=
 =?utf-8?B?cUZIREpwa0EyTzdrSU8xemJ3dks0TS92TWFuWUM2TUZYNHJycVVxY0ZqMlZW?=
 =?utf-8?B?NlIydTVIdi9vdmluOGhnOGg4QjNwNU10ZnB5VmU0eGhvTmVkNzJMVGVIMWh2?=
 =?utf-8?B?dFptRml6N3lUVUw2VjdBMklwKzBpclRVb2czQnBIeUE2UEE3MjhNRWQ3TDhY?=
 =?utf-8?B?d3FCTGw2UmQ2eXFodEF6R211RERxeUwvMHJYSTd2WWorWHlmRGszMXF4WUhR?=
 =?utf-8?B?SGIwMmVYN1JjR1ZvY0hTbHFBWmgzZVczVjFPY1ovMlNXVHlvN0o2Q0JtY0V4?=
 =?utf-8?B?cjFRcWlSMXpBdmxOeXVkQ0hEbmluS2lDUkxlNGlua3M5NjkwSjZlK3hyUnhP?=
 =?utf-8?B?dVdobzhmTktCb0p2VTF2Q0cvM0RTczlvUXMzY3VCZVhrVk5jdWt5K1YwWHNK?=
 =?utf-8?B?R0JZMy9lclpOcmJNOVNMNk4vSFFiY3JDaVZCN01ndEtrTVJtRzhkaW1tV1Fp?=
 =?utf-8?B?V2ltdmplZ1BpUm04RjNRcXR2SU40YXlLMWVwQWZOaTNQMVFqWC9pUSt5YlVK?=
 =?utf-8?B?aEJTSnJVc2xJaHlIMURFUWlEMWZsRXhxVFFLWUpFVmxSZmtSeTdaR3NCcTcv?=
 =?utf-8?B?T2xuSjZodnJwWWtKbnN1TVBDOG5GbG9oNmxVaGtNTTJhNGFWaFZRclFZK3Fs?=
 =?utf-8?B?VS9HQTkvOFlLUDNwcHZoUHFQUXNVS2FnL29SOThSVTVvdjdzWkVXZXdwYXZJ?=
 =?utf-8?B?ZzVaMFJzV1RXM25obHhWaUg0eExGbUVHcWY0TVBTMU85Vyt2aTlNenFMdGp0?=
 =?utf-8?B?TEFKL2ZzZnFlQ2RjMmpSY25zUktoYjlndDdPWXZNVlhtRUlQbzAzNGpqcUlO?=
 =?utf-8?B?RzN2bE9YK0RNakMvcStIRno2Q3BYNC8vTjQvQjNuRkwrTzZoTEh2UVJvMVFr?=
 =?utf-8?B?cWNjMmRQUzJGSCswNEoxZHJTNDdsVVhFNkxOOWRHZTFzTnJic3J5WkN3S3Vv?=
 =?utf-8?B?WXBsZTZmbU8zbTIxWEsrejBERjBTMzNoTzNDK2NJT3I1RmJlMVlBbTVjV0Nk?=
 =?utf-8?B?VkgrNml6ZkVwbnBJU1VxaHl6RldreHpYa0xjV2VXcXFmTk0rRmFuT3gvZzVp?=
 =?utf-8?B?RmdvMWpuUjJBMFJxcFo3dWtsbnR6NWhCREF6MDBjYm1OZW9pbWlvUm12bFMw?=
 =?utf-8?B?UXdYNFhjelJIL2JvQ0d4bk9INkVnRHdocDdmeWFlR3M1eExxeVdkdnM2eU9Y?=
 =?utf-8?B?R3lYdFhQQWJDSEFscncyczMyOGZ6bVF3SDNxUVNFcEVObXlCRmJNVXBnWExr?=
 =?utf-8?B?THNmb0tsTEhhdDNIbEo2UXYzZVl2NFhQMzdZb3U5WXNxNnZuSmw1dWw4eGcx?=
 =?utf-8?B?cUVPRUJHNXVvL2g0eHZHWFozMnY3cmlCVXZiby92Vit2bDY0V044cXRsN1c1?=
 =?utf-8?B?Y0xYelpBclJzNDh4ODhNOGRQemFRQU4yODFOa3F1TzdMWEZGVlVySGhrV01B?=
 =?utf-8?B?M3NoUVZSaklkQm0xYzR4MkRIamo5OXBCbUlNQlg1NGl1N2w5R0ZFOVltT3pm?=
 =?utf-8?B?M3RBZGVrSktDMHZEMHhmTXUzaXNva25uRWZ5dkNGN3dldkdXR2VxeG5mUm1D?=
 =?utf-8?B?WWJGYWdhdjR3SzZuRmN0dUVBbFNFZFR0a2xTM3o4UjJGdXJQaVVndGZlQUMz?=
 =?utf-8?B?T3pGMGtPUXV2aG83K0YyWkN5M2IzYjNHb3dVTngzTklRUXdlSzh3YnBLNTBC?=
 =?utf-8?B?Qi9kSGRkV2RYZEtBckZ1UWtlMGRTL2E5bWdmNklzd3FPM016a2ovclU5NjQ2?=
 =?utf-8?B?d2NobFB0OXVHMDFuVGtsZVp2RnBjSk5hNkVEd2ExWGF5Ym1MZ0R6OUNVcWhr?=
 =?utf-8?B?b3lwY0dwTHdZYWlKV1BPQ0NzZHZEc3NHQXZ1QVBDOXJSTGEyRzNkeXVIUCtn?=
 =?utf-8?B?c3Y3dW1EN1JMTVFVUWVYVFNseGVLN0FaaUpJell6UkYvd2xNTmM4WEFhMU45?=
 =?utf-8?B?THc9PQ==?=
X-OriginatorOrg: seco.com
X-MS-Exchange-CrossTenant-Network-Message-Id: d397c17a-62d1-4a81-8863-08da9d819181
X-MS-Exchange-CrossTenant-AuthSource: DB7PR03MB4972.eurprd03.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Sep 2022 16:35:04.4967
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: bebe97c3-6438-442e-ade3-ff17aa50e733
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: fCffODS3kAaFCcpk/dbTTbiXc5DwM5GXf8CSQ9AVEoUTexRfLZJyIYl3PoDPTv557sCFdFX6zWGZ+zQ11VNBrQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DU2PR03MB8123
X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A,RCVD_IN_DNSWL_NONE,
        RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS autolearn=ham
        autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org


On 9/23/22 12:26 PM, Leo Li wrote:
> 
> 
>> -----Original Message-----
>> From: Sean Anderson <sean.anderson@seco.com>
>> Sent: Friday, September 23, 2022 11:11 AM
>> To: Leo Li <leoyang.li@nxp.com>; shawnguo@kernel.org;
>> devicetree@vger.kernel.org
>> Cc: robh+dt@kernel.org; linux-arm-kernel@lists.infradead.org; linux-
>> kernel@vger.kernel.org; Laurentiu Tudor <laurentiu.tudor@nxp.com>
>> Subject: Re: [PATCH v2 5/9] arm64: dts: ls1046a: make dma-coherent global
>> to the SoC
>> 
>> 
>> Hi All,
>> 
>> On 9/15/22 7:34 PM, Li Yang wrote:
>> > These SoCs are really completely dma coherent in their entirety so add
>> > the dma-coherent property at the soc level in the device tree and drop
>> > the instances where it's specifically added to a few select devices.
>> >
>> > Signed-off-by: Laurentiu Tudor <laurentiu.tudor@nxp.com>
>> > Signed-off-by: Li Yang <leoyang.li@nxp.com>
>> > ---
>> >  arch/arm64/boot/dts/freescale/fsl-ls1046a.dtsi | 5 +----
>> >  1 file changed, 1 insertion(+), 4 deletions(-)
>> >
>> > diff --git a/arch/arm64/boot/dts/freescale/fsl-ls1046a.dtsi
>> > b/arch/arm64/boot/dts/freescale/fsl-ls1046a.dtsi
>> > index 27033c558e3e..e406499a26b4 100644
>> > --- a/arch/arm64/boot/dts/freescale/fsl-ls1046a.dtsi
>> > +++ b/arch/arm64/boot/dts/freescale/fsl-ls1046a.dtsi
>> > @@ -273,6 +273,7 @@ soc: soc {
>> >  		#size-cells = <2>;
>> >  		ranges;
>> >  		dma-ranges = <0x0 0x0 0x0 0x0 0x10000 0x00000000>;
>> > +		dma-coherent;
>> >
>> >  		ddr: memory-controller@1080000 {
>> >  			compatible = "fsl,qoriq-memory-controller"; @@ -
>> 355,7 +356,6 @@
>> > crypto: crypto@1700000 {
>> >  			ranges = <0x0 0x00 0x1700000 0x100000>;
>> >  			reg = <0x00 0x1700000 0x0 0x100000>;
>> >  			interrupts = <GIC_SPI 75 IRQ_TYPE_LEVEL_HIGH>;
>> > -			dma-coherent;
>> >
>> >  			sec_jr0: jr@10000 {
>> >  				compatible = "fsl,sec-v5.4-job-ring", @@ -
>> 794,7 +794,6 @@ pcie1:
>> > pcie@3400000 {
>> >  			#address-cells = <3>;
>> >  			#size-cells = <2>;
>> >  			device_type = "pci";
>> > -			dma-coherent;
>> >  			num-viewport = <8>;
>> >  			bus-range = <0x0 0xff>;
>> >  			ranges = <0x81000000 0x0 0x00000000 0x40
>> 0x00010000 0x0 0x00010000   /* downstream I/O */
>> > @@ -834,7 +833,6 @@ pcie2: pcie@3500000 {
>> >  			#address-cells = <3>;
>> >  			#size-cells = <2>;
>> >  			device_type = "pci";
>> > -			dma-coherent;
>> >  			num-viewport = <8>;
>> >  			bus-range = <0x0 0xff>;
>> >  			ranges = <0x81000000 0x0 0x00000000 0x48
>> 0x00010000 0x0 0x00010000   /* downstream I/O */
>> > @@ -874,7 +872,6 @@ pcie3: pcie@3600000 {
>> >  			#address-cells = <3>;
>> >  			#size-cells = <2>;
>> >  			device_type = "pci";
>> > -			dma-coherent;
>> >  			num-viewport = <8>;
>> >  			bus-range = <0x0 0xff>;
>> >  			ranges = <0x81000000 0x0 0x00000000 0x50
>> 0x00010000 0x0 0x00010000   /* downstream I/O */
>> >
>> 
>> I'd like to summarize the conclusions of [1] below. This patch breaks I2C0,
>> which is the only user of eDMA at the moment. eDMA is noncoherent
>> because snooping is not enabled for it. I have submitted a patch [2] to U-
>> Boot to enable snooping for eDMA. For now, this patch must add dma-
>> noncoherent to the i2c0 node.
> 
> I have sent a V3 yesterday to set dma-noncoherent on edma node.  But are you saying that the dma-noncoherent need to be added to the i2c node to make it work?

I believe dma coherency is a property of the consumer, not the provider. See
e.g. really_probe/platform_dma_configure/of_dma_configure/of_dma_is_coherent.

> For the u-boot patch, I will check with the hardware team to see if it is safe to set the reserved bit for edma snooping.

Thanks. I'm curious as to whether this omission is intentional or not.

> There is a problem with this is that it breaks the i2c for older u-boot.  Probably the best way is to make the default to be non-coherent in dts and update it in u-boot when snooping is enabled?

Yes, that is what I propose.

--Sean