Received: by 2002:ac0:a582:0:0:0:0:0 with SMTP id m2-v6csp1770791imm; Wed, 10 Oct 2018 22:40:07 -0700 (PDT) X-Google-Smtp-Source: ACcGV63hHqCJT0oP7Pby7bW2ikJb7mdcDEnrEXySvoJ+hpCG2LygZa8YH0qmUha8446giTSY5Sto X-Received: by 2002:a63:d256:: with SMTP id t22-v6mr117618pgi.335.1539236407789; Wed, 10 Oct 2018 22:40:07 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1539236407; cv=none; d=google.com; s=arc-20160816; b=o8sNaR72nZUXuLCwCE55EdwSLBg7rYb9ehFPA0fABINP8MM2Hzn7XRLj5XL1fi+tC/ S2Ms7W0Z7GjXlzENUAJ+zRfpvm4kZX6GwRLvBM8fwn6rEDy9rg5DYeJu/oHmS7MAUqJ/ v53gu315H96khCCnJ9UZPoQR7nQftmsztbTWw7XniDtXyeG9s5sL+ftUUDiTImNaLW7x GFZybYtPUZj5AVGpd6HKjYmiS5V2AoFBCpMF8sYbdUYJaiNTuGAYWKnq0DcyTcM2oUtb cV07pk7yr4T/bE+xStBUTXRS/WbmkQkUmLYkiGsH0xZvz9nSqqUABCi/+nYRSyMIUC1k FZkA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:references:cc:to:from:subject:dkim-signature; bh=MRJ2JkSQVQLcCyhOF6PIPBESqPWGBQbMJ2kc83eAAp8=; b=W6E+aeeH+E2ak45h7lSE10pog4WGrQC9NIazvfQJVOPIrh8zFNODojLK/6b/AOH3ba /cU0M8/y2iDU2Gi0MCfu+ySskTszWWoj9fh4z+l39aeludy5fLEsFVCfRJKZ0ORTYlCG ByoAbEx84lmusJqBkfMiYtMJF6w9jcyjecw28N2z92QcDpgHeIOGLsBorZn7u6MoXyV9 Enx1PC8ezctflUgXdSK4MdEZ78XT8+f4cBl1nAyuzWnKzJXXJ+Y1hgne5MOra6CJqpYg sgPGj0ViLxufb4iu/7wpR0pVCpjgEy6gG/lKtzimjLqLjUAbjosJzedAPHUUcZecTcv4 8crA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=PzqnqfTg; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id c27-v6si31487628pfk.235.2018.10.10.22.39.52; Wed, 10 Oct 2018 22:40:07 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=PzqnqfTg; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727713AbeJKNFI (ORCPT + 99 others); Thu, 11 Oct 2018 09:05:08 -0400 Received: from mail-pf1-f196.google.com ([209.85.210.196]:33731 "EHLO mail-pf1-f196.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727065AbeJKNFI (ORCPT ); Thu, 11 Oct 2018 09:05:08 -0400 Received: by mail-pf1-f196.google.com with SMTP id 78-v6so1420148pfq.0; Wed, 10 Oct 2018 22:39:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:from:to:cc:references:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=MRJ2JkSQVQLcCyhOF6PIPBESqPWGBQbMJ2kc83eAAp8=; b=PzqnqfTgNKNaOrxLPkda81K5gBS/BtUhArjE2wvFiF1qZeFx5NVRdwwV2cTYPdDfdY mXt/RxVtub/mA7L/OZFsUto/I7LkoOaPBElwQX+Jbtp8D30UF8jScVCASjfVjwBUYCA6 m1tZWAiF0t8e+p6oZLBm1V7GWHiLGZbmQLgqZpIGDDV6CJAk+NW0aqaxx+nns8AAac+X 8WKW4T6k3pT7opA6yTbyvYjRaifX1hbsr2gRBpPUiNRduh5jfa4rFhWDfkloJyUkgp7k XGK+Mo16GIFArSHYg11joMxSu+c+CMOoIvuEpyGAFvg9eeQL5cyfM36BK+cC3UstpqRx ljLA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:from:to:cc:references:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=MRJ2JkSQVQLcCyhOF6PIPBESqPWGBQbMJ2kc83eAAp8=; b=udTggbnYCKnbXajTTKjDESwvYvxX8SnzoT7gnA6rnj+G6m+O2PMR36Y2n85YDO5+/Z bCAxY8gS6onpxzjDkzEJtfffLGr2IhXgkwCmrie+JD0faWWFGUsYb5bWxz+4bcD1vbgZ aH24J2sQAY+Tmcs6qZJgNPZlSXhPN7F5+9ZT2vgNkUIXuGA64EPq0o3hcusrG18FK6Qp K1DxcEBzLheTDeR5YHus8CHLl+9/VKi4P5q+6isDNJnZ1XYBDw5u9Nn8IIvJqoqsnIOa +r0HFzvvOieFgW2DEJgFrqgBJ96THgA6pxMa203l9WiwrgElJ7u8Pi+THN1eZT1f+9dR Fl3A== X-Gm-Message-State: ABuFfogAxNiU14yzc/SGiJgWYD1d2ITBlFio25Yl/TY5enU38L3PTc2/ jIFAJ3qEMMRxgsgE5IXxTxc= X-Received: by 2002:a62:c957:: with SMTP id k84-v6mr135249pfg.205.1539236370295; Wed, 10 Oct 2018 22:39:30 -0700 (PDT) Received: from [192.168.1.70] (c-24-6-192-50.hsd1.ca.comcast.net. [24.6.192.50]) by smtp.gmail.com with ESMTPSA id x17-v6sm31399937pfn.59.2018.10.10.22.39.28 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 10 Oct 2018 22:39:29 -0700 (PDT) Subject: Re: [PATCH 05.1/16] of:overlay: missing name, phandle, linux,phandle in new nodes From: Frank Rowand To: Alan Tull Cc: Rob Herring , Pantelis Antoniou , Michael Ellerman , Benjamin Herrenschmidt , Paul Mackerras , Moritz Fischer , linux-kernel , linuxppc-dev , "open list:OPEN FIRMWARE AND FLATTENED DEVICE TREE BINDINGS" , linux-fpga@vger.kernel.org References: <1539151495-8110-1-git-send-email-frowand.list@gmail.com> Message-ID: Date: Wed, 10 Oct 2018 22:39:28 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 10/10/18 14:03, Frank Rowand wrote: > On 10/10/18 13:40, Alan Tull wrote: >> On Wed, Oct 10, 2018 at 1:49 AM Frank Rowand wrote: >>> >>> On 10/09/18 23:04, frowand.list@gmail.com wrote: >>>> From: Frank Rowand >>>> >>>> >>>> "of: overlay: use prop add changeset entry for property in new nodes" >>>> fixed a problem where an 'update property' changeset entry was >>>> created for properties contained in nodes added by a changeset. >>>> The fix was to use an 'add property' changeset entry. >>>> >>>> This exposed more bugs in the apply overlay code. The properties >>>> 'name', 'phandle', and 'linux,phandle' were filtered out by >>>> add_changeset_property() as special properties. Change the filter >>>> to be only for existing nodes, not newly added nodes. >>>> >>>> The second bug is that the 'name' property does not exist in the >>>> newest FDT version, and has to be constructed from the node's >>>> full_name. Construct an 'add property' changeset entry for >>>> newly added nodes. >>>> >>>> Signed-off-by: Frank Rowand >>>> --- >>>> >>>> >>>> Hi Alan, >>>> >>>> Thanks for reporting the problem with missing node names. >>>> >>>> I was able to replicate the problem, and have created this preliminary >>>> version of a patch to fix the problem. >>>> >>>> I have not extensively reviewed the patch yet, but would appreciate >>>> if you can confirm this fixes your problem. >>>> >>>> I created this patch as patch 17 of the series, but have also >>>> applied it as patch 05.1, immediately after patch 05/16, and >>>> built the kernel, booted, and verified name and phandle for >>>> one of the nodes in a unittest overlay for both cases. So >>>> minimal testing so far on my part. >>>> >>>> I have not verified whether the series builds and boots after >>>> each of patches 06..16 if this patch is applied as patch 05.1. >>>> >>>> There is definitely more work needed for me to complete this >>>> patch because it allocates some more memory, but does not yet >>>> free it when the overlay is released. >>>> >>>> -Frank >>>> >>>> >>>> drivers/of/overlay.c | 72 ++++++++++++++++++++++++++++++++++++++++++++++++---- >>>> 1 file changed, 67 insertions(+), 5 deletions(-) >>>> >>>> diff --git a/drivers/of/overlay.c b/drivers/of/overlay.c >>>> index 0b0904f44bc7..9746cea2aa91 100644 >>>> --- a/drivers/of/overlay.c >>>> +++ b/drivers/of/overlay.c >>>> @@ -301,10 +301,11 @@ static int add_changeset_property(struct overlay_changeset *ovcs, >>>> struct property *new_prop = NULL, *prop; >>>> int ret = 0; >>>> >>>> - if (!of_prop_cmp(overlay_prop->name, "name") || >>>> - !of_prop_cmp(overlay_prop->name, "phandle") || >>>> - !of_prop_cmp(overlay_prop->name, "linux,phandle")) >>>> - return 0; >>>> + if (target->in_livetree) >>>> + if (!of_prop_cmp(overlay_prop->name, "name") || >>>> + !of_prop_cmp(overlay_prop->name, "phandle") || >>>> + !of_prop_cmp(overlay_prop->name, "linux,phandle")) >>>> + return 0; >>> >>> This is a big hammer patch. >>> >>> Nobody should waste time reviewing this patch. >> >> I wasn't clear if you still could use the testing so I did re-run my >> test. This patch adds back some of the missing properties, but the >> the kobject names aren't set as dev_name() returns NULL: >> >> * without this patch some of_node properties don't show up in sysfs: >> root@arria10:~# ls >> /sys/bus/platform/drivers/altera_freeze_br/ff200450.\/of_node >> clocks compatible interrupt-parent interrupts reg >> >> * with this patch, the of_node properties phandle and name are back: >> root@arria10:~# ls >> /sys/bus/platform/drivers/altera_freeze_br/ff200450.\/of_node >> clocks compatible interrupt-parent interrupts >> name phandle reg > > Thanks for the testing. I'll keep chasing after this problem today. > > This is useful data for me as I was not looking under the /sys/bus/... > tree that you reported, but was instead looking at /proc/device-tree/... > which showed the same type of problem since the overlay I was using > does not show up under /sys/bus/... > > I'll have to create a useful overlay test case that will show up under > /sys/bus/... > > In the meantime, can you send me the base FDT and the overlay FDT for > your test case? I now have a test case that shows the problem under /sys/bus/... so I no longer need the base FDT and overlay FDT for your test case. I have determined the location that sets the name to "" but do not have the fix yet. Still working on that. -Frank > > Thanks, > > Frank > > >> >> root@arria10:~# cat >> /sys/bus/platform/drivers/altera_freeze_br/ff200450.\/of_node/name >> freeze_controllerroot@arria10:~# ("freeze_controller" w/o the \n so >> the name is correct) >> >> * with or without the patch I see the behavior I reported yesterday, >> kobj names are NULL. >> root@arria10:~# ls /sys/bus/platform/drivers/altera_freeze_br/ >> bind ff200450. uevent unbind >> >> root@arria10:~# ls /sys/bus/platform/drivers/altera_gpio/ >> bind ff200010. ff200020. ff200030. >> uevent unbind >> >> Alan >> >> Alan >> >>> >>> The following part should not be needed (though the above section might have >>> to become _slightly_ more complex). >>> >>> -Frank >>>> >>>> if (target->in_livetree) >>>> prop = of_find_property(target->np, overlay_prop->name, NULL); >>>> @@ -443,10 +444,13 @@ static int build_changeset_next_level(struct overlay_changeset *ovcs, >>>> struct target *target, const struct device_node *overlay_node) >>>> { >>>> struct device_node *child; >>>> - struct property *prop; >>>> + struct property *prop, *name_prop; >>>> + bool has_name = false; >>>> int ret; >>>> >>>> for_each_property_of_node(overlay_node, prop) { >>>> + if (!strcmp(prop->name, "name")) >>>> + has_name = true; >>>> ret = add_changeset_property(ovcs, target, prop, 0); >>>> if (ret) { >>>> pr_debug("Failed to apply prop @%pOF/%s, err=%d\n", >>>> @@ -455,6 +459,57 @@ static int build_changeset_next_level(struct overlay_changeset *ovcs, >>>> } >>>> } >>>> >>>> + /* >>>> + * With FDT version 0x10 we may not have the name property, >>>> + * recreate it here from the unit name if absent >>>> + */ >>>> + >>>> + if (!has_name) { >>>> + const char *p = target->np->full_name, *ps = p, *pa = NULL; >>>> + int len; >>>> + >>>> + /* >>>> + * zzz >>>> + * TODO: stash name_prop on a list in ovcs, to be freed >>>> + * after overlay removed >>>> + */ >>>> + >>>> + while (*p) { >>>> + if ((*p) == '@') >>>> + pa = p; >>>> + else if ((*p) == '/') >>>> + ps = p + 1; >>>> + p++; >>>> + } >>>> + >>>> + if (pa < ps) >>>> + pa = p; >>>> + len = (pa - ps) + 1; >>>> + >>>> + name_prop = kmalloc(sizeof(*name_prop), GFP_KERNEL); >>>> + if (!name_prop) >>>> + return -ENOMEM; >>>> + >>>> + name_prop->name = kstrdup("name", GFP_KERNEL); >>>> + name_prop->value = kmalloc(len, GFP_KERNEL); >>>> + if (!name_prop->name || !name_prop->value) { >>>> + ret = -ENOMEM; >>>> + goto err_free_name_prop; >>>> + } >>>> + >>>> + memcpy(name_prop->value, ps, len - 1); >>>> + ((char *)name_prop->value)[len - 1] = 0; >>>> + >>>> + name_prop->length = strlen(name_prop->value) + 1; >>>> + >>>> + ret = add_changeset_property(ovcs, target, name_prop, 0); >>>> + if (ret) { >>>> + pr_debug("Failed to apply name_prop @%pOF/%s, err=%d\n", >>>> + target->np, name_prop->name, ret); >>>> + goto err_free_name_prop; >>>> + } >>>> + } >>>> + >>>> for_each_child_of_node(overlay_node, child) { >>>> ret = add_changeset_node(ovcs, target, child); >>>> if (ret) { >>>> @@ -466,6 +521,13 @@ static int build_changeset_next_level(struct overlay_changeset *ovcs, >>>> } >>>> >>>> return 0; >>>> + >>>> +err_free_name_prop: >>>> + kfree(name_prop->name); >>>> + kfree(name_prop->value); >>>> + kfree(name_prop); >>>> + return ret; >>>> + >>>> } >>>> >>>> /* >>>> >>> >> > >