Received: by 2002:a05:6a11:4021:0:0:0:0 with SMTP id ky33csp400432pxb; Sat, 18 Sep 2021 06:08:56 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzSAqOTQr9HAMFkGVednXA7X9Jdq0lsd3/grChLEJpcfR4ZIF1+9lCu0jH/bxPuqDhoAvXF X-Received: by 2002:a02:7813:: with SMTP id p19mr12758499jac.38.1631970536311; Sat, 18 Sep 2021 06:08:56 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1631970536; cv=none; d=google.com; s=arc-20160816; b=nL8N5guxbCbr0MkcPH8lmdp+3DvV1v5N9KQAaKx/YSYvnd+Nt6ROWEwcnQ8vZZptT4 XYKLnumkzaXjw3uY1oCigGdplDEs/j9DJK/rvk379hNTV0mL7bGw21Wq1cILZ6n6fa9f y4TuUtAydJk5Qd9NJYupzq4i3d1h8rY5e5FajjbqLC240d/geAw12f2450aTTVaUxQ/V aNBHDLPp1iy+54eZQPd40lAlvcIfYfy72bXsumO+xrLu8U6Y8OgsRCdjQalLtssnW93D dOMpSiu1IMDok8p2D6T6lV3MQRKroOqSN27rccV4b+e6ta+rCep7mfT9kUF5Cw7o8zbW n9Kg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :user-agent:references:in-reply-to:date:cc:to:from:subject :message-id:dkim-signature; bh=zmuCIjjYAicvT9fQ2NLTNSYZZwYgf35ciPvsfXCVk54=; b=pX6Tlh1KBvN0S4jDGXOZ4ScAibVjcTTuJeXDXXpjSwvI8OU79gTpPjOs8nl9oMQKoZ U6Ztw9ScUA0yu5V6NzLbREO9iDjpFcqWwwTKydJuLsVeWmnHjrmT8qJZzR6YrujeVXmB LGHVziDXdWJaBllQk4aM8/RWmu3ZOqMH5DirD+lYqAl/hkWHlajWjT3byvCwBeXeNKLI dL/ON+YnxA7I5wGh4lIQ+5/6acgVQ8jn6bXH8eAIgEeMfeU76oEAhm4OO9PCJ7seWd73 fhf2iZVBYM3Rw5EKCXmaJGthIvnz9EtWIjHkgBtXh+BedQf7bm8obP/UVNkLpFYxetEj PySg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmx.net header.s=badeba3b8450 header.b="U/kMCv8g"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=gmx.de Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id f46si8184003jaa.87.2021.09.18.06.08.37; Sat, 18 Sep 2021 06:08:56 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@gmx.net header.s=badeba3b8450 header.b="U/kMCv8g"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=gmx.de Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S237112AbhIRGfJ (ORCPT + 99 others); Sat, 18 Sep 2021 02:35:09 -0400 Received: from mout.gmx.net ([212.227.17.20]:47039 "EHLO mout.gmx.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229476AbhIRGfI (ORCPT ); Sat, 18 Sep 2021 02:35:08 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1631946819; bh=RnpfFmJKZ+V6UBKtrnzi9iy3Rg2pAScBEx5Sxcf24A4=; h=X-UI-Sender-Class:Subject:From:To:Cc:Date:In-Reply-To:References; b=U/kMCv8gexE+q7UKulPR6gQoxI69cFfYu2X+o6/W3EOpTIZ0LXXNCRPpqU+YcRAhF wAAhTROfLPRCf8+t2VLHLgVOH4TKpZcnxj1c4CXusw/vGLvWLwZh69NTkVdBTVkBRY BLVFkKKsHBIm0r9+Z9Sx3ZrFyP8jNdAdWb64xK8k= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from homer.fritz.box ([185.191.216.59]) by mail.gmx.net (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MFKGP-1mgeLq2ucr-00FlFV; Sat, 18 Sep 2021 08:33:39 +0200 Message-ID: <9bd95c0ad91bd490adf2b6e57495411a0f72fe50.camel@gmx.de> Subject: Re: data loss when doing ls-remote and piped to command From: Mike Galbraith To: Rolf Eike Beer , Linus Torvalds , Junio C Hamano Cc: Git List Mailing , Tobias Ulmer , Linux Kernel Mailing List Date: Sat, 18 Sep 2021 08:33:38 +0200 In-Reply-To: <2722184.bRktqFsmb4@devpool47> References: <6786526.72e2EbofS7@devpool47> <2722184.bRktqFsmb4@devpool47> Content-Type: text/plain; charset="UTF-8" User-Agent: Evolution 3.41.2 MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:D+OqzmU9Yf2Wd93LvHRaZwCa/Q+J42EDYyKg7wE0/8nmmHYR2oS 1MTQLJIwc1wMDMPZWotJupCDDmmsRq07fjer1FjJ5ORxCrR3ijsouNEW3uGc3/gW+VGoZIr xCnwc9KzV2v1xSFhamRGq5TB374IdKiD7uQgy9LylwsfZm4PIlGYKgPm3TBYF8aXp5/VDZ6 nhjgEsJ6q+flT4M+wUd0w== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:6siFrffE2AA=:CQGYv4WyYAGxTpd1cx6kno G8hG0emZRcPeqWQTPC5e5a+k3hAhkste9/P7i11OD7kBt0Od+ksnf5GWNFv82TGmUzBZvmxBP dnpy147022QeVSxmbam2r3lcPlrbgzV4AnQXhZLRwNSbjlaQ5dgfGpOUwgcBCopnuXPIYTnh7 K/BbS+KDnB8wD2pfCLnH7LnSaSIx0oNQpNXonnOnBTjZLCLDVNSOvQle1zhzvduIUyMxqD4NQ AdoB4DD0EiaIc498gXk+ot2s7IoK9yU9zNsKB6Bn7inSp0vVSpSvLKlu8gMe7+22aOKMQVhul FyjJg9sD+LLsNHrnwm5Olb03m8ZSxnwO+505Y2vx464bwMiUAwlAvgNURMt+2cZs0vGLA2jRn 4o42FIip6tbVIhmWz3I9lUkJ4Uq+8RV5WLiJBtAk/8uSYG50lOWYs/j7EpHUlNcCSSoVkWCNZ D0ou20w4slr9vYE0opOlfhmctXlU5V1FeW592QU2rs9YHq34IpojmPyRdX2HKATlIqk9BYYzT 53xOvjGpmTdfcSSUkLyMHtb/fFAIOF+CVTiV/IZUHqnXnH4QmdNocyiedixtlyThjsCKCkM6p qQPecqBeCy/RiYLrcmb1hnL/E03OAtGW9V1HBJ3Zqozqsn4+ECfXiTHDBdunNFfFprVvm7+I6 UPqkaH02gDIURyNRD+60Ao9UfUGEqkKO4OC48VhK7DiXOOQKgZM8heakZI+W/tzyoMJZ+oSYs 0Pp8DHuSEab7E1BnTS/VfePMaU7589bev/E45KDdllPD12MyFwAx/u9XWmz/jW4jAZZ2Kiyl9 131ad99iEniLwp8KZTZ/DJipsLvj5720OMZIGO2V5W7Op2ePc+oaGgfCUxxQfu/78z2KuGw+y hgmEUtnHZXj5JN1k0qsVbKmBuoQ6fzqzNI67/Zr2l6s4GneWJXZhWc9OHvqM4OaXHnb2EXmC5 PHfRPSHLg3enOQcFByaeIJnRbEV+WWfxAQi7BS61Qh8IP36lE0LYeubKt6rQv26HrlZkqNjBn I0yDkEiZwsXIjsIkOWvsiOkv47d8U3VI8Hhc+0XdMmx29JGNkYIywD++TiCe1sIXLbXnf/hMR P2H7oAmFHHM3gM= Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, 2021-09-17 at 08:59 +0200, Rolf Eike Beer wrote: > > What you need is a _fast_ git server. kernel.org or github.com seem to b= e too > slow for this if you don't sit somewhere in their datacenter. Use someth= ing in > your local network, a Xeon E5 with lot's of RAM and connected with 1GBit= /s > Ethernet in my case. Even faster: what's coming across that wire should be a constant (is?), variable is only delivery/consumption jitter. If there's really really a pipe problem lurking, you should also be able to trigger by saving the data once, and just catting it, letting interrupts etc provide jitter. Which stdout is left of '|' in a script shouldn't matter one whit to the interpreter/kernel conversation, they're all the same. That said, if I had a reproducer I was confident pointed to the kernel, I'd try to bisect.. boring as hell, but highly effective. -Mike