Received: by 2002:a05:6a10:c604:0:0:0:0 with SMTP id y4csp402476pxt; Fri, 6 Aug 2021 05:01:15 -0700 (PDT) X-Google-Smtp-Source: ABdhPJw2xEJxWLutYFqrTxAf/Ty1bCGwTsPRGZA6RXq7BILnhWZBH+zyciaNk0BbGNtspaogmGBT X-Received: by 2002:a17:906:acf:: with SMTP id z15mr9484687ejf.512.1628251275481; Fri, 06 Aug 2021 05:01:15 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1628251275; cv=none; d=google.com; s=arc-20160816; b=X19kljj/XuEeReY0EYSUSD/jkmTOQQm2lqTkpo2JnAyacWmyy+HHBixEwO58nLjb3V Xro+/qx+jJ7lmSqdOqCwrqldHQgof/6SsUJpoKwffYnRifedldjpE0lVXE4N+bzLSdfB OsDNHiMOGh0vXz9AhVOm6OvZJm/bWDpr5MvAvrhUpx81mCtAHZoI/Kb2SzmIFQEJGY+J j3hSa6eXotLhJ/aG80mXcEGgXeqVrr4Gq6o4TfrhROOiyx2S1DXu56KSLjOE601xPQgL e1cO4pLpLga/lI4Cz3jg7YAX9mLwHRwFhsTZwF167hf89dJncHuj6zCS0Pi4nJkjRd5L BbLw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=4h9NXCahpaPwahhaO5hMLHu+0Sj92iJsupdJcdmnrx4=; b=DhuHIMlKz+of2kfv5HtM7Z8Raxqus3wOekbWa07KoxS6h6CbHmkNDu89UJkK1aDodw nv/s1Gca2OF3azTqQ+VxHZI3UyLQ0vycDwVspLkORBDCS9CaODAa/FbijgDjqVmKz1Kl pskeLs8lNd8XdWvbZRh7mUJeoPjbSp/F6WJ7u2Tg5XRgVYSPB2swXBAq7fxKpjRPjrJY Rsc8umXfLL37v+dBXSXGCHSZOuSa3pQcbmLcVLW/bZeeMfXWhlg+dt1feiodm+o5uDqk y6MJSwdoyiEomSMxsdAC30ioecrTCwoL9PYQ5x6V2/OKER1V2iRebNBuPy7IY7Y2bnYe w7/Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=QyZvqAEa; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id e24si8410582edr.66.2021.08.06.05.00.48; Fri, 06 Aug 2021 05:01:15 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=QyZvqAEa; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S243565AbhHFHRG (ORCPT + 99 others); Fri, 6 Aug 2021 03:17:06 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:37985 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S243553AbhHFHRF (ORCPT ); Fri, 6 Aug 2021 03:17:05 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1628234209; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=4h9NXCahpaPwahhaO5hMLHu+0Sj92iJsupdJcdmnrx4=; b=QyZvqAEae9RwU2R0wLA6NaPiHcc/a+2+C0owzLknw8Q1Qj1llWV8wkmcsG3Q6SxYK+PszG 3jPOe19/VP3p5+VzlPJpuFx7MSqGb83bb9gRRf/l05XxtifBphT1M48vnOwc8vmxYGGsk0 Q7y2O5vUIbBCDMFxyF/Ig1DjUtFf9Q4= Received: from mail-ej1-f69.google.com (mail-ej1-f69.google.com [209.85.218.69]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-587-zUZgUsTYNwirvLCxYnmUDQ-1; Fri, 06 Aug 2021 03:16:48 -0400 X-MC-Unique: zUZgUsTYNwirvLCxYnmUDQ-1 Received: by mail-ej1-f69.google.com with SMTP id lu19-20020a170906fad3b029058768348f55so2872808ejb.12 for ; Fri, 06 Aug 2021 00:16:48 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=4h9NXCahpaPwahhaO5hMLHu+0Sj92iJsupdJcdmnrx4=; b=OaK4ar70hS5xkkyxDSnyiA2llI/5vBP/l77nsPNRu+JotN+rrvqCO0mhWI6g2ENhJx DQwVnVva230pI4KgDxqLhTRS5quhgHMMpua5cM/coz/H0wG8ZxyS66zUSYUBaWiOxLsd G57eylrXFxOHSnqLENK0oZez+3ujQX0Au8FAMaxgkasnEQAvhSbVUeQYTaY4QxUvuIMF lZUgpWOQPsT9ke7QHoEAKAs4NibEvVJ5BWLweeG5b7XnVRax21/C5VssezlTmyRE9DWC iXDF3Nw0pyU9DkUv9ORH6JMfun4GWUhEcr5mUPs1XrMe6jKvQ0flrotS1RhCZQbCb49r SPBA== X-Gm-Message-State: AOAM530XEGT/9WZ6rtnR+8ZD+nXt63V5HN7jbkpwdi2LzPgUNWHB5ipg dLK/KQTv78bdlWJWiwA+P/VjZzCH9Q6Tv/QrH7igO5gs2JBPEkOqw1QVhpPrNpuwXe2353lt8dd nYPnQirjffeBJvejto4i2wJjb X-Received: by 2002:a05:6402:3552:: with SMTP id f18mr11179140edd.82.1628234206525; Fri, 06 Aug 2021 00:16:46 -0700 (PDT) X-Received: by 2002:a05:6402:3552:: with SMTP id f18mr11179120edd.82.1628234206380; Fri, 06 Aug 2021 00:16:46 -0700 (PDT) Received: from steredhat (host-79-18-148-79.retail.telecomitalia.it. [79.18.148.79]) by smtp.gmail.com with ESMTPSA id gv7sm2535932ejc.5.2021.08.06.00.16.45 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 06 Aug 2021 00:16:46 -0700 (PDT) Date: Fri, 6 Aug 2021 09:16:43 +0200 From: Stefano Garzarella To: Arseny Krasnov Cc: Stefan Hajnoczi , "Michael S. Tsirkin" , Jason Wang , "David S. Miller" , Jakub Kicinski , Colin Ian King , Andra Paraschiv , Norbert Slusarek , "kvm@vger.kernel.org" , "virtualization@lists.linux-foundation.org" , "netdev@vger.kernel.org" , "linux-kernel@vger.kernel.org" , "oxffffaa@gmail.com" Subject: Re: [!!Mass Mail KSE][MASSMAIL KLMS] Re: [RFC PATCH v1 0/7] virtio/vsock: introduce MSG_EOR flag for SEQPACKET Message-ID: <20210806071643.byebg4hmm3dtnb2x@steredhat> References: <20210726163137.2589102-1-arseny.krasnov@kaspersky.com> <20210804125737.kbgc6mg2v5lw25wu@steredhat> <8e44442c-4cac-dcbc-a88d-17d9878e7d32@kaspersky.com> <20210805090657.y2sz3pzhruuolncq@steredhat> <8bd80d3f-3e00-5e31-42a1-300ff29100ae@kaspersky.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <8bd80d3f-3e00-5e31-42a1-300ff29100ae@kaspersky.com> Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Aug 05, 2021 at 12:21:57PM +0300, Arseny Krasnov wrote: > >On 05.08.2021 12:06, Stefano Garzarella wrote: >> Caution: This is an external email. Be cautious while opening links or attachments. >> >> >> >> On Thu, Aug 05, 2021 at 11:33:12AM +0300, Arseny Krasnov wrote: >>> On 04.08.2021 15:57, Stefano Garzarella wrote: >>>> Caution: This is an external email. Be cautious while opening links or attachments. >>>> >>>> >>>> >>>> Hi Arseny, >>>> >>>> On Mon, Jul 26, 2021 at 07:31:33PM +0300, Arseny Krasnov wrote: >>>>> This patchset implements support of MSG_EOR bit for SEQPACKET >>>>> AF_VSOCK sockets over virtio transport. >>>>> Idea is to distinguish concepts of 'messages' and 'records'. >>>>> Message is result of sending calls: 'write()', 'send()', 'sendmsg()' >>>>> etc. It has fixed maximum length, and it bounds are visible using >>>>> return from receive calls: 'read()', 'recv()', 'recvmsg()' etc. >>>>> Current implementation based on message definition above. >>>> Okay, so the implementation we merged is wrong right? >>>> Should we disable the feature bit in stable kernels that contain it? Or >>>> maybe we can backport the fixes... >>> Hi, >>> >>> No, this is correct and it is message boundary based. Idea of this >>> patchset is to add extra boundaries marker which i think could be >>> useful when we want to send data in seqpacket mode which length >>> is bigger than maximum message length(this is limited by transport). >>> Of course we can fragment big piece of data too small messages, but >>> this >>> requires to carry fragmentation info in data protocol. So In this case >>> when we want to maintain boundaries receiver calls recvmsg() until >>> MSG_EOR found. >>> But when receiver knows, that data is fit in maximum datagram length, >>> it doesn't care about checking MSG_EOR just calling recv() or >>> read()(e.g. >>> message based mode). >> I'm not sure we should maintain boundaries of multiple send(), from >> POSIX standard [1]: > >Yes, but also from POSIX: such calls like send() and sendmsg() > >operates with "message" and if we check recvmsg() we will > >find the following thing: > > >For message-based sockets, such as SOCK_DGRAM and SOCK_SEQPACKET, the entire > >message shall be read in a single operation. If a message is too long to fit in the supplied > >buffers, and MSG_PEEK is not set in the flags argument, the excess bytes shall be discarded. > > >I understand this, that send() boundaries also must be maintained. > >I've checked SEQPACKET in AF_UNIX and AX_25 - both doesn't support > >MSG_EOR, so send() boundaries must be supported. > >> >> SOCK_SEQPACKET >> Provides sequenced, reliable, bidirectional, connection-mode >> transmission paths for records. A record can be sent using one or >> more output operations and received using one or more input >> operations, but a single operation never transfers part of more than >> one record. Record boundaries are visible to the receiver via the >> MSG_EOR flag. >> >> From my understanding a record could be sent with multiple send() >> and >> received, for example, with a single recvmsg(). >> The only boundary should be the MSG_EOR flag set by the user on the >> last >> send() of a record. >You are right, if we talking about "record". >> >> From send() description [2]: >> >> MSG_EOR >> Terminates a record (if supported by the protocol). >> >> From recvmsg() description [3]: >> >> MSG_EOR >> End-of-record was received (if supported by the protocol). >> >> Thanks, >> Stefano >> >> [1] >> https://pubs.opengroup.org/onlinepubs/9699919799/functions/socket.html >> [2] >> https://pubs.opengroup.org/onlinepubs/9699919799/functions/send.html >> [3] >> https://pubs.opengroup.org/onlinepubs/9699919799/functions/recvmsg.html > >P.S.: seems SEQPACKET is too exotic thing that everyone implements it >in > >own manner, because i've tested SCTP seqpacket implementation, and >found > >that: > >1) It doesn't support MSG_EOR bit at send side, but uses MSG_EOR at >receiver > >side to mark MESSAGE boundary. > >2) According POSIX any extra bytes that didn't fit in user's buffer >must be dropped, > >but SCTP doesn't drop it - you can read rest of datagram in next calls. > Thanks for this useful information, now I see the differences and why we should support both. I think is better to include them in the cover letter. I'm going to review the paches right now :-) Stefano