Received: by 2002:a05:7412:8d10:b0:f3:1519:9f41 with SMTP id bj16csp4732630rdb; Tue, 12 Dec 2023 07:55:41 -0800 (PST) X-Google-Smtp-Source: AGHT+IFpK0J9+CMaU1TC+B7gGwInovdZNN9mr9hHY+2T9REq+EQoBz2lX567BLqyrtRt0YfrzPRz X-Received: by 2002:a05:6a21:78a3:b0:18f:97c:615a with SMTP id bf35-20020a056a2178a300b0018f097c615amr8081767pzc.87.1702396541432; Tue, 12 Dec 2023 07:55:41 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1702396541; cv=none; d=google.com; s=arc-20160816; b=UDt94KkTlUxrGbv7WOZNAbfCo+hdTcs4AWF+VO/StnLhpTZe+XLaNw/4H2NlyujNwk Y5IFlm+lgGc/+36zusn+GbPYusMVIOIzZ9k6mcxj5mofVDSroyWTREXHUN+BpJrZaqxk ldnDu/PgIOZIaGQzU7XQH4QiCRNs3ldeYKF2MICtIlS6YGNuw3t8c/qc/A6JDPs67rDC 5RwKbR1W/NfuLA0EU1UEDtN1hJIGVNCXqRq93aUvykEA3Gx80mzYrRJ4OW9Nr9bpts4z XImWdxbeUVDUDCmlQ0Liu+P47a18s881SqTOSTVIYeyaA6+N+O72QD5ga0xgDOHHKyCk rxFA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=txHf+m37wKb+jlfgEujM/pT7BGBPXZR98p4Uri23mF0=; fh=mgDOnflgqBhki4srQQbjlV/AUGmKs0Gt5yx+zXhaHYo=; b=XN30swFRgM2VK9d4llhPXXlIHmPW1V89hGnr29nU2JUU/Y6Xfosdb/KfcF93kdmjDs /C4ETZZ8m+L4TcblV2hjVPuV991jnpcUypGSlB2+gHLiCnSwFoNPuzC4NRR48tEe4LmF J6UqW+eHgPr3NyM8d8tYZCjfy46lGjN1h4tjhRb5WaL9CzVl/iyMHYriAen+48ow0fIP +CxczA2UFqbBNCrhWKjJTMHUYnDI3lMN4q2E1ZvytxU6i+LiwOSgayMqqOv7ujOJXN1W qn32LkRLIH1W5vVTyGWYjV1G8AInXaC+JMJIjTJ7c/yQnF9uFasjQfjsTA1qOtWqR9xb ITbw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=TZw7s9GB; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.31 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from morse.vger.email (morse.vger.email. [23.128.96.31]) by mx.google.com with ESMTPS id d17-20020a056a00245100b006d09555a9efsi3040134pfj.120.2023.12.12.07.55.40 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 12 Dec 2023 07:55:41 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.31 as permitted sender) client-ip=23.128.96.31; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=TZw7s9GB; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.31 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by morse.vger.email (Postfix) with ESMTP id 07D1D803B37E; Tue, 12 Dec 2023 07:55:15 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.11 at morse.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1376558AbjLLPyy (ORCPT + 99 others); Tue, 12 Dec 2023 10:54:54 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:60932 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232716AbjLLPyw (ORCPT ); Tue, 12 Dec 2023 10:54:52 -0500 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 0896BAC for ; Tue, 12 Dec 2023 07:54:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1702396498; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=txHf+m37wKb+jlfgEujM/pT7BGBPXZR98p4Uri23mF0=; b=TZw7s9GB6rRkmFZIrZyBvvsIi+Fu6OSardRgd/GXQleBnSSg85PcKk2n9eFnjtYtHnU2KX XZNOZwhfe+VUN37o/L8//HqNZBUdwsrDsaivRX/hs96Wuny8QrqhogXDDYK7qnTl4gr3Ls MgFjuw1p8lfrufZZDCjr1cLa9lK8HDI= Received: from mail-wm1-f71.google.com (mail-wm1-f71.google.com [209.85.128.71]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-60-H6t3UppFPX2n_3qgLduqWg-1; Tue, 12 Dec 2023 10:54:56 -0500 X-MC-Unique: H6t3UppFPX2n_3qgLduqWg-1 Received: by mail-wm1-f71.google.com with SMTP id 5b1f17b1804b1-40c27a351e2so37619705e9.2 for ; Tue, 12 Dec 2023 07:54:56 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1702396495; x=1703001295; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=txHf+m37wKb+jlfgEujM/pT7BGBPXZR98p4Uri23mF0=; b=S/aAIgaYvcvBfF3qIEfYJUFgEho7pUM/vlEDYyuilsbfzf7cvp1rXVZGHvRVLdGWTR WSmjTdT2/Oa+Y182Jg7fDCwgxhh85fD9M14lqWPhV7czM+8k3XW0tY05QsVKYvzg2Fpq 6M+Go4p/Xxx+HHMySDlKfcHMRKiOpiRdIrRB8PjFo21p6bHPcDJ4pMtteuQgSVqH5P4/ Oq5ZcWxOh2hAvy6ZQaU4Pw5Y3FDyre3wT7iLgatwVURxzQRHwDk+E7IJsAk6ZDv3F41e CsAC2KYDiTBK8nayVEvMIioK/tSo0qJxba73ru1Ubn8RPp4IvqlPV62Clm4F9CEwTSVX POQw== X-Gm-Message-State: AOJu0YzJk24us9XEbRTQlnpvN+7XmGO9JXgEvoblkn8vMW9lVbfZYYVx vbCKIhd1+8RA9BEtZyt80M4BwEFDuDQfZu/4ImJlSjzR/VaQQVVpRrUorJbHnNs7CFp7VYSTbO+ 85ZFGXzaOwGgcNww7iQ8a5/If X-Received: by 2002:a05:600c:231a:b0:40c:25ab:d6fc with SMTP id 26-20020a05600c231a00b0040c25abd6fcmr1447481wmo.216.1702396495531; Tue, 12 Dec 2023 07:54:55 -0800 (PST) X-Received: by 2002:a05:600c:231a:b0:40c:25ab:d6fc with SMTP id 26-20020a05600c231a00b0040c25abd6fcmr1447475wmo.216.1702396495084; Tue, 12 Dec 2023 07:54:55 -0800 (PST) Received: from redhat.com ([2.52.23.105]) by smtp.gmail.com with ESMTPSA id h11-20020adffd4b000000b003333298eb4bsm11227676wrs.61.2023.12.12.07.54.52 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 12 Dec 2023 07:54:54 -0800 (PST) Date: Tue, 12 Dec 2023 10:54:50 -0500 From: "Michael S. Tsirkin" To: Arseniy Krasnov Cc: Stefan Hajnoczi , Stefano Garzarella , "David S. Miller" , Eric Dumazet , Jakub Kicinski , Paolo Abeni , Jason Wang , Bobby Eshleman , kvm@vger.kernel.org, virtualization@lists.linux-foundation.org, netdev@vger.kernel.org, linux-kernel@vger.kernel.org, kernel@sberdevices.ru, oxffffaa@gmail.com Subject: Re: [PATCH net-next v8 0/4] send credit update during setting SO_RCVLOWAT Message-ID: <20231212105423-mutt-send-email-mst@kernel.org> References: <20231211211658.2904268-1-avkrasnov@salutedevices.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20231211211658.2904268-1-avkrasnov@salutedevices.com> X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on morse.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (morse.vger.email [0.0.0.0]); Tue, 12 Dec 2023 07:55:15 -0800 (PST) On Tue, Dec 12, 2023 at 12:16:54AM +0300, Arseniy Krasnov wrote: > Hello, > > DESCRIPTION > > This patchset fixes old problem with hungup of both rx/tx sides and adds > test for it. This happens due to non-default SO_RCVLOWAT value and > deferred credit update in virtio/vsock. Link to previous old patchset: > https://lore.kernel.org/netdev/39b2e9fd-601b-189d-39a9-914e5574524c@sberdevices.ru/ Patchset: Acked-by: Michael S. Tsirkin But I worry whether we actually need 3/8 in net not in net-next. Thanks! > Here is what happens step by step: > > TEST > > INITIAL CONDITIONS > > 1) Vsock buffer size is 128KB. > 2) Maximum packet size is also 64KB as defined in header (yes it is > hardcoded, just to remind about that value). > 3) SO_RCVLOWAT is default, e.g. 1 byte. > > > STEPS > > SENDER RECEIVER > 1) sends 128KB + 1 byte in a > single buffer. 128KB will > be sent, but for 1 byte > sender will wait for free > space at peer. Sender goes > to sleep. > > > 2) reads 64KB, credit update not sent > 3) sets SO_RCVLOWAT to 64KB + 1 > 4) poll() -> wait forever, there is > only 64KB available to read. > > So in step 4) receiver also goes to sleep, waiting for enough data or > connection shutdown message from the sender. Idea to fix it is that rx > kicks tx side to continue transmission (and may be close connection) > when rx changes number of bytes to be woken up (e.g. SO_RCVLOWAT) and > this value is bigger than number of available bytes to read. > > I've added small test for this, but not sure as it uses hardcoded value > for maximum packet length, this value is defined in kernel header and > used to control deferred credit update. And as this is not available to > userspace, I can't control test parameters correctly (if one day this > define will be changed - test may become useless). > > Head for this patchset is: > https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net-next.git/commit/?id=021b0c952f226236f2edf89c737efb9a28d1422d > > Link to v1: > https://lore.kernel.org/netdev/20231108072004.1045669-1-avkrasnov@salutedevices.com/ > Link to v2: > https://lore.kernel.org/netdev/20231119204922.2251912-1-avkrasnov@salutedevices.com/ > Link to v3: > https://lore.kernel.org/netdev/20231122180510.2297075-1-avkrasnov@salutedevices.com/ > Link to v4: > https://lore.kernel.org/netdev/20231129212519.2938875-1-avkrasnov@salutedevices.com/ > Link to v5: > https://lore.kernel.org/netdev/20231130130840.253733-1-avkrasnov@salutedevices.com/ > Link to v6: > https://lore.kernel.org/netdev/20231205064806.2851305-1-avkrasnov@salutedevices.com/ > Link to v7: > https://lore.kernel.org/netdev/20231206211849.2707151-1-avkrasnov@salutedevices.com/ > > Changelog: > v1 -> v2: > * Patchset rebased and tested on new HEAD of net-next (see hash above). > * New patch is added as 0001 - it removes return from SO_RCVLOWAT set > callback in 'af_vsock.c' when transport callback is set - with that > we can set 'sk_rcvlowat' only once in 'af_vsock.c' and in future do > not copy-paste it to every transport. It was discussed in v1. > * See per-patch changelog after ---. > v2 -> v3: > * See changelog after --- in 0003 only (0001 and 0002 still same). > v3 -> v4: > * Patchset rebased and tested on new HEAD of net-next (see hash above). > * See per-patch changelog after ---. > v4 -> v5: > * Change patchset tag 'RFC' -> 'net-next'. > * See per-patch changelog after ---. > v5 -> v6: > * New patch 0003 which sends credit update during reading bytes from > socket. > * See per-patch changelog after ---. > v6 -> v7: > * Patchset rebased and tested on new HEAD of net-next (see hash above). > * See per-patch changelog after ---. > v7 -> v8: > * See per-patch changelog after ---. > > Arseniy Krasnov (4): > vsock: update SO_RCVLOWAT setting callback > virtio/vsock: send credit update during setting SO_RCVLOWAT > virtio/vsock: fix logic which reduces credit update messages > vsock/test: two tests to check credit update logic > > drivers/vhost/vsock.c | 1 + > include/linux/virtio_vsock.h | 1 + > include/net/af_vsock.h | 2 +- > net/vmw_vsock/af_vsock.c | 9 +- > net/vmw_vsock/hyperv_transport.c | 4 +- > net/vmw_vsock/virtio_transport.c | 1 + > net/vmw_vsock/virtio_transport_common.c | 43 +++++- > net/vmw_vsock/vsock_loopback.c | 1 + > tools/testing/vsock/vsock_test.c | 175 ++++++++++++++++++++++++ > 9 files changed, 229 insertions(+), 8 deletions(-) > > -- > 2.25.1