Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <3da164b4269ac2ed9573560847c59aa1e54d2d9c.camel@egluetechnologies.com>
Subject: Re: [PATCH RESEND] can: j1939: do not wait 250ms if the same addr
 was already claimed
From:   Devid Antonio Filoni <devid.filoni@egluetechnologies.com>
To:     Oleksij Rempel <o.rempel@pengutronix.de>
Cc:     Kurt Van Dijck <dev.kurt@vandijck-laurijssen.be>,
        kbuild test robot <lkp@intel.com>,
        Maxime Jayat <maxime.jayat@mobile-devices.fr>,
        Oliver Hartkopp <socketcan@hartkopp.net>,
        David Jander <david@protonic.nl>, linux-kernel@vger.kernel.org,
        Oleksij Rempel <linux@rempel-privat.de>,
        netdev@vger.kernel.org, Marc Kleine-Budde <mkl@pengutronix.de>,
        kernel@pengutronix.de, Robin van der Gracht <robin@protonic.nl>,
        Jakub Kicinski <kuba@kernel.org>,
        Paolo Abeni <pabeni@redhat.com>,
        "David S. Miller" <davem@davemloft.net>, linux-can@vger.kernel.org
Date:   Sun, 20 Nov 2022 20:18:32 +0100
In-Reply-To: <20221120084509.GB7626@pengutronix.de>
References: <e0f6b26e2c724439752f3c13b53af1a56a42a5bf.camel@egluetechnologies.com>
         <20221117162251.5e5933c1@erd992> <20221118060647.GE12278@pengutronix.de>
         <7b575cface09a2817ac53485507985a7fef7b835.camel@egluetechnologies.com>
         <20221118123013.GF12278@pengutronix.de>
         <1fd663d232c7fba5f956faf1ad45fb410a675086.camel@egluetechnologies.com>
         <20221118134447.GG12278@pengutronix.de>
         <a01fe547c052e861d47089d6767aba639250adda.camel@egluetechnologies.com>
         <20221119101211.GA7626@pengutronix.de>
         <6c13c3072ca4c8c3217f9449f56921a8496c32eb.camel@egluetechnologies.com>
         <20221120084509.GB7626@pengutronix.de>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
User-Agent: Evolution 3.44.4-0ubuntu1 
MIME-Version: 1.0
Precedence: bulk

On Sun, 2022-11-20 at 09:45 +0100, Oleksij Rempel wrote:
> On Sun, Nov 20, 2022 at 01:11:52AM +0100, Devid Antonio Filoni wrote:
> > On Sat, 2022-11-19 at 11:12 +0100, Oleksij Rempel wrote:
> > > On Fri, Nov 18, 2022 at 04:12:40PM +0100, Devid Antonio Filoni wrote:
> > > > Hi Oleksij,
> > > >=20
> > > > honestly I would apply proposed patch because it is the easier solu=
tion
> > > > and makes the driver compliant with the standard for the following
> > > > reasons:
> > > > - on the first claim, the kernel will wait 250 ms as stated by the
> > > > standard
> > > > + on successive claims with the same name, the kernel will not wait
> > > > 250ms, this implies:
> > > >   - it will not wait after sending the address-claimed message when=
 the
> > > > claimed address has been spoofed, but the standard does not explici=
tly
> > > > states what to do in this case (see previous emails in this thread)=
, so
> > > > it would be up to the application developer to decide how to manage=
 the
> > > > conflict
> > > >   - it will not wait after sending the address-claimed message when=
 a
> > > > request for address-claimed message has been received as stated by =
the
> > > > standard
> > >=20
> > > Standard says:
> > > 1. No CF _shall_ begin, or resume, transmission on the network until =
250 ms
> > >    after it has successfully claimed an address (Figure 4).
> > > 2. This does not apply when responding to a request for address claim=
ed.
> > >=20
> > > With current patch state: 1. is implemented and working as expected, =
2.
> > > is not implemented.
> > > With this patch: 1. is partially broken and 2. is partially faking
> > > needed behavior.
> > >=20
> > > It will not wait if remote ECU which rebooted for some reasons. With =
this patch
> > > we are breaking one case of the standard in favor to fake compatibili=
ty to the
> > > other case. We should avoid waiting only based on presence of RfAC no=
t based
> > > on the old_addr =3D=3D new_addr.
> >=20
> > I'm sorry, I don't think I understood the point about reboot ("It will
> > not wait if remote ECU which rebooted for some reasons"). If another EC=
U
> > rebooted, then *it* will have to perform the claim procedure again
> > waiting 250 ms before beginning the transmission. Your ECU doesn't have
> > to check if the other ECUs respected the 250 ms wait.
>=20
> With proposed patch:
> - local application which is sending to the remote NAME, will start or co=
ntinue
>   communication with ECU which should stay silent.

And this is not forbidden by the standard, the standard states that the
remote ECU shall not start or continue the communication but it can
*receive* messages.
For example, what would you do if:
- during the 250 ms wait, another ECU sends a request-for-address-
claimed message meant to the address you're claiming?
From "4.5.3 Other requirements for initialization":
A CF shall respond to a request-for-address-claimed message when the
destination address is the same as the CF's address and shall transmit
its response to the Global address (255).
- during the 250 ms wait another ECU sends a normal message (non
address-claim related) using the SA you're currently claiming?

> - local application which was manually or automatically restarted (see
>   application watchdogs), will bypass address claim procedure
>   completion and start sending without 250ms delay.

Then the application will be violating the standard, you're right,
however please note that, as per driver implementation, each time the
socket is closed and opened again (if bound with a name) you have to
send the address-claimed message again.
The standard also states how to treat this kind of violations on the
remote ECU side.

>=20
> > Also, the ISO11783-5 standard, with "Figure 6 (Resolving address
> > contention between two self-configurable-address CF)" of=C2=A0"4.5.4.2 =
-
> > Address-claim prioritization", shows that:
> > - ECU1 claims the address (time: 0 ms)
> > - ECU2 claims the same address (time: 0+x ms)
> > - ECU1 NAME has the higher priority, so ECU1 sends again the address
> > claimed message as soon as it received the address-claim from ECU2
> > (time: 0+x+y ms)
> > - ECU1 starts normal transmission (time: 250 ms)
> > With current implementation, the ECU1 would start the transmission at
> > time 0+x+y+250 ms, with proposed patch it would not.
>=20
> You are right, this should be fixed.
> But proposed patch closes one issues and opens another, with this patch i=
t will
> be enough to send at least two address claimed messages to bypass the del=
ay.

No, because the timer associated with the first claim *is not stopped*.

>=20
> > Same is showed in "Figure 7 (Resolving address contention between a non=
-
> > configurable address CF and a self-configurable address CF)", the ECU
> > waits again 250 ms only when claiming a different address.
>=20
> Ack
>=20
> > Also, as previously discussed in this thread, the standard states in
> > 4.4.4.3 - Address violation:
> > If a CF receives a message, other than the address-claimed message,
> > which uses the CF's own SA,
> > then the CF:
> > - shall send the address-claim message to the Global address;
> > - shall activate a diagnostic trouble code with SPN =3D 2000+SA and FMI=
 =3D
> > 31
> > It is not *explicitly* stated that you have to wait 250 ms after the
> > address-claim message has been sent.
>=20
> There is no need to explicitly state it. The requirement is clearly descr=
ibed
> in the 4.5.2.d part 1 with clearly defined exception in  4.5.2.d part 2.
> If something is not explicitly stated, the stated requirement has always
> priority.
>=20
> > Please note that the 250 ms wait is  mentioned only in "4.5 - Network
> > initialization"
>=20
> OK, we need to refer to the wording used in a specifications, in
> general:
> Shall =E2=80=93 Shall is used to designate a mandatory requirement.
> Should =E2=80=93 Should is used for requirements that are considered good=
 and are
>          recommended, but are not absolutely mandatory.
> May =E2=80=93 May is used to for requirements that are optional.
>=20
> If a requirement with strong wording as "shall" is not strong enough for
> you and you are suing words as ".. mentioned only in .." then even a
> statistical analysis of this spec will have no meaning. In all
> cases we can just invalidate all arguments by using: it is only X or Y.=
=20
>=20
> > while above statements come from "4.4 - Network-management procedures".
> > Also in this case, the proposed patch is still standard compliant.
>=20
> If we remove 4.5.2.d from the spec, then yes.
>=20
> > So I'm sorry but I have to disagree with you, there are many things
> > broken in the current implementation because it is forcing the 250 wait
> > to all cases but it should not.
>=20
> If we remove 4.5.2.d from the spec, then yes. Every construction is
> logical if we adopt input variables to the construction.

From "4.4.4.3 - Address violation":
- *shall send the address-claim message* to the Global address
From "4.5.2 Address claim requirements":
- No CF shall begin, or resume, transmission on the network until 250 ms
after it has successfully *claimed an address*, except when responding
to a request for address-claimed.

Do you see any difference?
With your interpretation of the standard, then above 4.5.2.d sentence
shall be:
- No CF shall begin, or resume, transmission on the network until 250 ms
after it has successfully *sent the address-claim message*, except when
responding to a request for address-claimed.

I think "it has successfully claimed an address" is valid for the whole
claim procedure and not for the address-claimed message only.

Please note that the ECU shall send the address-claim message also when
it receives a request for a matching NAME ("4.4.3.2 NAME management (NM)
message"). This does not mean that is claiming again the address.

>=20
> > > Without words 2. part should be implemented without breaking 1.
> > >=20
> > > > Otherwise you will have to keep track of above cases and decide if =
the
> > > > wait is needed or not, but this is hard do accomplish because is th=
e
> > > > application in charge of sending the address-claimed message, so yo=
u
> > > > would have to decide how much to keep track of the request for addr=
ess-
> > > > claimed message thus adding more complexity to the code of the driv=
er.
> > >=20
> > > Current kernel already tracks all claims on the bus and knows all reg=
istered
> > > NAMEs. I do not see increased complicity in this case.
> >=20
> > The kernel tracks the claims but it does *not track* incoming requests
> > for address-claimed message, it would have to and it would have to
>=20
> yes
>=20
> > allow the application to answer to it *within a defined time window*.
>=20
> yes.
>=20
> > But keep in mind that there are other cases when the 250 ms wait is wro=
ng
> > or it is not explicitly stated by the standard.
>=20
> If it is not stated in the standard how can we decide if it is wrong?
And how can we decide if it is right? :)

> And if strongly worded statements have no value just because it is
> stated only one time, how proper standard should look like?=20
See above.

>=20
> > > IMHO, only missing part i a user space interface. Some thing like "ip=
 n"
> > > will do.
> > >=20
> > > > Another solution is to let the driver send the address-claimed mess=
age
> > > > waiting or without waiting 250 ms for successive messages depending=
 on
> > > > the case.
> > >=20
> > > You can send "address-claimed message" in any time you wont. Kernel w=
ill
> > > just not resolve the NAME to address until 1. part of the spec will
> > > apply. Do not forget, the NAME cache is used for local _and_ remote
> > > names. You can trick out local system, not remote.
> > >=20
> > > Even if you implement "smart" logic in user space and will know bette=
r
> > > then kernel, that this application is responding to RfAC. You will ne=
wer
> > > know if address-claimed message of remote system is a response to RfA=
C.
> > >=20
> > > From this perspective, I do not know, how allowing the user space bre=
ak
> > > the rules will help to solve the problem?
> >=20
> > I think you did not understand this last proposal: since the driver is
> > already implementing part of the standard, then it might as well send
> > the address-claimed message when needed and wait 250 ms or not dependin=
g
> > on the case.
>=20
> Let's try following test:
> j1939acd -r 80 -c /tmp/1122334455667788.jacd 11223344556677 vcan0 &
> while(true); do testj1939 -s8 vcan0:0x80 :0x90,0x12300; done
>=20
> And start candump with delta time stamps:
> :~ candump -t d vcan0                                                =20
>  (000.000000)  vcan0  18EAFFFE   [3]  00 EE 00              =20
>  (000.002437)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF <---- no 25=
0ms delay
>  (000.011458)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.011964)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.011712)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012585)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012891)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012082)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012604)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012357)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012790)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012765)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012483)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012680)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012144)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
> ... snip ...
>  (000.012592)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012515)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.013183)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012653)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.011886)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012836)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.009494)  vcan0  18EEFF80   [8]  77 66 55 44 33 22 11 00 <---- SA 0x=
80 address claimed=20
>  (000.003362)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF <---- next =
packet from SA 0x80 3 usecs after previous. No 250ms delay.
>  (000.012351)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012983)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012602)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012594)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.012348)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>  (000.011922)  vcan0  19239080   [8]  01 23 45 67 89 AB CD EF
>=20
> As you can see, the j1939 stack do not forcing application to use NAMEs a=
nd
> do not preventing sending any message withing 250ms delay. The only thing
> what has the 250 timer is NAME to address resolution which should be fixe=
d in
> respect of 4.5.2.d without breaking every thing else.

Yes this is clear, this is working because the socket used by testj1939
is not bound to any name.

Just to clarify: are you suggesting to applications developer to use one
socket (bound with the name) to manage the address-claim and another one
(bound without the name) for other transmissions? If so, then why that
code exists in the driver?
Honestly I would consider this proposal really bad since this would
allow to completely violate the standard. I really hope you agree with
me about this.

>=20
> > In this way, for example, you won't have to keep track of a request for
> > address-claimed, you just would have to answer to it directly.
>=20
> see example above.
>=20
> > Feel free to implement what you think is more appropriate but please
> > read the ISO11783-5 standard carefully too before changing the code,
> > there are many cases and it is not possible to simplify everything into
> > one rule.
>=20
> this is why we have this discussion.
>=20
> > Meanwhile I'm going to apply the patch to my own kernel, I've tried to
> > workaround the limitation using a CAN_RAW socket to send the address-
> > claimed message but the J1939 driver refuses to send other messages in
> > the 250 ms time window because it has detected the address-claimed
> > message sent from the other socket, so I can only apply the patch to
> > make it compliant with the standard.
>=20
> If you can use CAN_RAW you can use above example without any delay.
>=20
> Regards,
> Oleksij

Best Regards,
Devid