Received: by 2002:ac0:a582:0:0:0:0:0 with SMTP id m2-v6csp2584480imm; Thu, 11 Oct 2018 12:39:33 -0700 (PDT) X-Google-Smtp-Source: ACcGV635weuSe4OOWMOkGMQAI9Z3B2iAa4dkYqYm8NKj9f7hXHHxtYW39kmJmp6eUxYh6Dr27+HN X-Received: by 2002:a63:214d:: with SMTP id s13-v6mr2639478pgm.148.1539286773008; Thu, 11 Oct 2018 12:39:33 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1539286772; cv=none; d=google.com; s=arc-20160816; b=UMkTwJ03vG7OwnnVeKw2WUO54vPs8Kq5TQ6Vg/9cgCIk/o5KI2vNojBfioAiY72UOM aHNQ9XrEc7tQ5WYdVgeL/mtz6SIuG3slPchywByw1RBXnxV4Zf+VYqiUtU1g/aOEa2Gm rRRbeoKGCeFVlNVcLzMzyi0YJhbiz5WpDmD9rcfqvVnQpeMDmnijw8Fw46rAp2qh1UXh UZIFfr9WrjvPmCn9OoOJte2ZYS+pAjThz/5/WZSDX+sRFXMT0CUGJ7IeMqdk20lKMhwT HIY66lQv1al67wab9zCtPHp9XCAV9rZ54NP6NLpeufx+ZO99/U+y4DnOzGPBk3Syt8To iu0A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=5Gxhi87AUzW7sp3YfDtyNbDcrvoJDr0+FljGNkt1jqE=; b=jHw3vm2CPvShrAk+8X95FgvPORmhBfvkqvXixxgARqXM78yZZwvExAtgtZXSK8tB8i Wcr66btl4SbozPeb2nAQNeWJ1G89WEWsrtzWSaMpTmJpylyeEJCJGQCRyylU2jQvRmrO cn6FZZLbwL8ee2zIgsVJKCUQmt8WUql5ByjiT+6zuXS0c7kZuaRn9/YacKEUDroWFgiO H3MKQ0KxC4oHogKT2Zk8ax0n7GvcUgi6/7chGRzauxqlRPC7/S861oziVkXEpzRZVA41 xl1sLBpPSzUjRBCMj5gd+3T+Cm2tPxIGPLxvzoF2Z4xcYkWtQ3bHMoF8lrVyaiJsA8vT B1kQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=hyRfyEU8; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id z12-v6si25249797pgv.387.2018.10.11.12.39.17; Thu, 11 Oct 2018 12:39:32 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=hyRfyEU8; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728234AbeJLDCr (ORCPT + 99 others); Thu, 11 Oct 2018 23:02:47 -0400 Received: from mail.kernel.org ([198.145.29.99]:42742 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726691AbeJLDCq (ORCPT ); Thu, 11 Oct 2018 23:02:46 -0400 Received: from mail-ed1-f49.google.com (mail-ed1-f49.google.com [209.85.208.49]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id A97B72148C; Thu, 11 Oct 2018 19:34:06 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1539286447; bh=zqgx2pIivn7Ux9M/b303jA60rKWMgt6xDAk/V5tHA8Y=; h=References:In-Reply-To:From:Date:Subject:To:Cc:From; b=hyRfyEU8qu/A1eYLSiddNscati2DkJSDGgMi2BLDhhFy7sjPSDydFPiaiEZZMG+Xn BNMyF0UrEfeiXejq+mqOj+hVEaJiZWuuoio5Qhfdfth1paDbMYastjal82JWbHeG+X MWMJrFuMZ8GPDDCGWu4KD71snPDUBTuUPznMh0os= Received: by mail-ed1-f49.google.com with SMTP id v18-v6so9329973edq.12; Thu, 11 Oct 2018 12:34:06 -0700 (PDT) X-Gm-Message-State: ABuFfohp0iapBRUvQiQBa9+7CdtH/fXaPiG1aL9pFTQhqlQTNJJ20fxc DsxaaC+ShmfGPFB9ZNXpaIDgQ67q/WJyPtNJkRU= X-Received: by 2002:a50:8bd5:: with SMTP id n21-v6mr4852793edn.41.1539286444998; Thu, 11 Oct 2018 12:34:04 -0700 (PDT) MIME-Version: 1.0 References: <1539151495-8110-1-git-send-email-frowand.list@gmail.com> In-Reply-To: From: Alan Tull Date: Thu, 11 Oct 2018 14:33:28 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: [PATCH 05.1/16] of:overlay: missing name, phandle, linux,phandle in new nodes To: Frank Rowand Cc: Rob Herring , Pantelis Antoniou , Michael Ellerman , Benjamin Herrenschmidt , Paul Mackerras , Moritz Fischer , linux-kernel , linuxppc-dev , "open list:OPEN FIRMWARE AND FLATTENED DEVICE TREE BINDINGS" , linux-fpga@vger.kernel.org Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Oct 11, 2018 at 12:39 AM Frank Rowand wrote: [resend of my messed up rejected email of a minute ago, sorry] > > On 10/10/18 14:03, Frank Rowand wrote: > > On 10/10/18 13:40, Alan Tull wrote: > >> On Wed, Oct 10, 2018 at 1:49 AM Frank Rowand wrote: > >>> > >>> On 10/09/18 23:04, frowand.list@gmail.com wrote: > >>>> From: Frank Rowand > >>>> > >>>> > >>>> "of: overlay: use prop add changeset entry for property in new nodes" > >>>> fixed a problem where an 'update property' changeset entry was > >>>> created for properties contained in nodes added by a changeset. > >>>> The fix was to use an 'add property' changeset entry. > >>>> > >>>> This exposed more bugs in the apply overlay code. The properties > >>>> 'name', 'phandle', and 'linux,phandle' were filtered out by > >>>> add_changeset_property() as special properties. Change the filter > >>>> to be only for existing nodes, not newly added nodes. > >>>> > >>>> The second bug is that the 'name' property does not exist in the > >>>> newest FDT version, and has to be constructed from the node's > >>>> full_name. Construct an 'add property' changeset entry for > >>>> newly added nodes. > >>>> > >>>> Signed-off-by: Frank Rowand > >>>> --- > >>>> > >>>> > >>>> Hi Alan, > >>>> > >>>> Thanks for reporting the problem with missing node names. > >>>> > >>>> I was able to replicate the problem, and have created this preliminary > >>>> version of a patch to fix the problem. > >>>> > >>>> I have not extensively reviewed the patch yet, but would appreciate > >>>> if you can confirm this fixes your problem. > >>>> > >>>> I created this patch as patch 17 of the series, but have also > >>>> applied it as patch 05.1, immediately after patch 05/16, and > >>>> built the kernel, booted, and verified name and phandle for > >>>> one of the nodes in a unittest overlay for both cases. So > >>>> minimal testing so far on my part. > >>>> > >>>> I have not verified whether the series builds and boots after > >>>> each of patches 06..16 if this patch is applied as patch 05.1. > >>>> > >>>> There is definitely more work needed for me to complete this > >>>> patch because it allocates some more memory, but does not yet > >>>> free it when the overlay is released. > >>>> > >>>> -Frank > >>>> > >>>> > >>>> drivers/of/overlay.c | 72 ++++++++++++++++++++++++++++++++++++++++++++++++---- > >>>> 1 file changed, 67 insertions(+), 5 deletions(-) > >>>> > >>>> diff --git a/drivers/of/overlay.c b/drivers/of/overlay.c > >>>> index 0b0904f44bc7..9746cea2aa91 100644 > >>>> --- a/drivers/of/overlay.c > >>>> +++ b/drivers/of/overlay.c > >>>> @@ -301,10 +301,11 @@ static int add_changeset_property(struct overlay_changeset *ovcs, > >>>> struct property *new_prop = NULL, *prop; > >>>> int ret = 0; > >>>> > >>>> - if (!of_prop_cmp(overlay_prop->name, "name") || > >>>> - !of_prop_cmp(overlay_prop->name, "phandle") || > >>>> - !of_prop_cmp(overlay_prop->name, "linux,phandle")) > >>>> - return 0; > >>>> + if (target->in_livetree) > >>>> + if (!of_prop_cmp(overlay_prop->name, "name") || > >>>> + !of_prop_cmp(overlay_prop->name, "phandle") || > >>>> + !of_prop_cmp(overlay_prop->name, "linux,phandle")) > >>>> + return 0; > >>> > >>> This is a big hammer patch. > >>> > >>> Nobody should waste time reviewing this patch. > >> > >> I wasn't clear if you still could use the testing so I did re-run my > >> test. This patch adds back some of the missing properties, but the > >> the kobject names aren't set as dev_name() returns NULL: > >> > >> * without this patch some of_node properties don't show up in sysfs: > >> root@arria10:~# ls > >> /sys/bus/platform/drivers/altera_freeze_br/ff200450.\/of_node > >> clocks compatible interrupt-parent interrupts reg > >> > >> * with this patch, the of_node properties phandle and name are back: > >> root@arria10:~# ls > >> /sys/bus/platform/drivers/altera_freeze_br/ff200450.\/of_node > >> clocks compatible interrupt-parent interrupts > >> name phandle reg > > > > Thanks for the testing. I'll keep chasing after this problem today. Glad to help! Thanks for all your work in this area! > > > > This is useful data for me as I was not looking under the /sys/bus/... > > tree that you reported, but was instead looking at /proc/device-tree/... > > which showed the same type of problem since the overlay I was using > > does not show up under /sys/bus/... > > > > I'll have to create a useful overlay test case that will show up under > > /sys/bus/... > > > > In the meantime, can you send me the base FDT and the overlay FDT for > > your test case? > > I now have a test case that shows the problem under /sys/bus/... so I > no longer need the base FDT and overlay FDT for your test case. > > I have determined the location that sets the name to "" but do > not have the fix yet. Still working on that. I understand you're quite busy with all this, but I'm wondering whether it might be worth it go ahead and make the properties be kernel objects also at this point. That would be an improvement for the case of overlay properties added to non-overlay nodes, so the lifespan of the overlay property memory can be coupled with the properties kobj's instead of the node kobj's. Alan