Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Date:   Tue, 21 Jun 2022 00:29:27 +0000
To:     linux-kernel <linux-kernel@vger.kernel.org>
From:   "Ryan P. Nicholl" <rnicholl@protonmail.com>
Reply-To: "Ryan P. Nicholl" <rnicholl@protonmail.com>
Subject: Networking Question
Message-ID: <6_nVwntZEyEq2Gn0PYDz5w_yuD20E9Je_Bk2rJHsOersGq3v2x3_6hXnyjNm-X83-OTl1KKo4eLoHzyBVM_nzCcDrpPtz4dz3_71A3QezfI=@protonmail.com>
Feedback-ID: 15386781:user:proton
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Precedence: bulk

I've been unable to find any Linux API for asynchronously waiting for the T=
CP send buffer to drain.

The problem I have, in a nutshell, is noted in this part of the documentati=
on:

       If fildes refers to a socket, close() shall cause the socket to
       be destroyed. If the socket is in connection-mode, and the
       SO_LINGER option is set for the socket with non-zero linger time,
       and the socket has untransmitted data, then close() shall block
       for up to the current linger interval until all data is
       transmitted.

Ok, so not good for asynchronous programming, so I could disable the SO_LIN=
GER option, but that leaves me with another problem, namely that I *want* t=
he socket to linger.

The behavior I want is something like, calling "close", getting EAGAIN inst=
ead of triggering TCP RST, and something like EPOLLWRITEFLUSHED to wait for=
 the TCP send buffer to be drained. I know neither of these are possible.

Right now the only solution I can think of is to enable SO_LINGER and spawn=
 a thread to run close in, but this might spawn a lot of threads, and doesn=
't support cancellation well.

Alternatively, I could call getsockopt with TCP_INFO in a loop, but this tr=
iggers a lot of wake-ups and might result in sockets hanging around a lot l=
onger than they need to.

I want to allow linger indefinitely on close until some event happens like =
running out of ram or other resources, basically to intelligently do someth=
ing like: "OK, we're running low on RAM/resources, time to send RST and dro=
p the send buffer for the 5k worst behaving connections". So unfortunately =
even with the timeout provided by SO_LINGER, even assuming close would some=
how complete in the background, this could be an issue.

Is there any way to do this properly on Linux? If not, any possibility that=
 something like adding EPOLLWRITEFLUSHED would be a welcome addition?

Please CC me on responses.

--
Ryan P. Nicholl