Received: by 2002:a05:6a10:206:0:0:0:0 with SMTP id 6csp1394062pxj; Fri, 21 May 2021 13:09:24 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyOfbzQNYDkuVW18SqBCAqyHt17Nq+694Yc5eVX+lieyCgNTJ+vskaSeugsNrIEtzzvoi6g X-Received: by 2002:a02:6d13:: with SMTP id m19mr6798518jac.65.1621627763941; Fri, 21 May 2021 13:09:23 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1621627763; cv=none; d=google.com; s=arc-20160816; b=RC4GWtctsOq8BQOva3lI8QSgmzMX5lOb9IEE1f2rwr+cR2ZLxezJJa7Fal1hc9wm+Y p4aFsL3C0NPRaJ4pek49DZf914ieSwViTAhj0p5Y4ujjlJISNETDk/243iw36em8qP2C VEuovYSsgEP8Tk+MH8dvZWDtFsdXnyaXC3tqCbCeytEvDv27w+Pa4f35nWotKF3OUJXL FQ72Q4IwGXmN/FCMV7RaCR26PjqaFY+S2m3bvzLpbCYaI1h5iAQPs4U6SyUUzDnzZB7k yAcK0YyYzD1HVppu62ZAr22rcHlKzx9IULB63pACv3GpaNIObZDv3G7jevU0N/Q2Vc7e KiOg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:user-agent:organization:references :in-reply-to:date:cc:to:from:subject:message-id; bh=8Qa1O5D+o6iSSyObS1DYslTl2nzCW1YFwMTxK6xdaZg=; b=qG0VpbB1u0PflETgX9Q8ESXVufez0PZymyHDcC+mTpcEftPxzp5+eXeMUcQFLxFpOZ oEJZrZil98ELEtf6uUCqIKFsTlikQHfT6Wtsz/xrwMPV4cccZhH1MCSS0FcwlD4AbjBj a/RnIflhpLhTdW6xih1q4N0vFErPN5o7roa+MY/EOo1KNdLxpQssYIWMxhryP8GPRXnB JEefMAFZUWQAYm66SNlihWp2c4T5sYA1b2v0DzU9GqusDhDSGeGlXsJRxmBY6VVqd6s2 TLmBojV6RAl0lIWSqNkZ3VPqK9jFaczIRdaIgUzO8xzBpf1QFvD8Sx0Tss/cdggU6/9g N2qQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id u8si6648934ilv.32.2021.05.21.13.09.11; Fri, 21 May 2021 13:09:23 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S236079AbhEUHdS (ORCPT + 99 others); Fri, 21 May 2021 03:33:18 -0400 Received: from cloud48395.mywhc.ca ([173.209.37.211]:43998 "EHLO cloud48395.mywhc.ca" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233932AbhEUHdR (ORCPT ); Fri, 21 May 2021 03:33:17 -0400 Received: from modemcable064.203-130-66.mc.videotron.ca ([66.130.203.64]:55588 helo=[192.168.1.177]) by cloud48395.mywhc.ca with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1ljzdP-0003FQ-TF; Fri, 21 May 2021 03:31:51 -0400 Message-ID: <4390e9fb839ebc0581083fc4fa7a82606432c0c0.camel@trillion01.com> Subject: Re: [PATCH] io_thread/x86: don't reset 'cs', 'ss', 'ds' and 'es' registers for io_threads From: Olivier Langlois To: Jens Axboe , Linus Torvalds Cc: Stefan Metzmacher , Thomas Gleixner , Andy Lutomirski , Linux Kernel Mailing List , io-uring , the arch/x86 maintainers Date: Fri, 21 May 2021 03:31:50 -0400 In-Reply-To: References: <8735v3ex3h.ffs@nanos.tec.linutronix.de> <3C41339D-29A2-4AB1-958F-19DB0A92D8D7@amacapital.net> <8735v3jujv.ffs@nanos.tec.linutronix.de> <12710fda-1732-ee55-9ac1-0df9882aa71b@samba.org> <59ea3b5a-d7b3-b62e-cc83-1f32a83c4ac2@kernel.dk> <17471c9fec18765449ef3a5a4cddc23561b97f52.camel@trillion01.com> <3df541c3-728c-c63d-eaeb-a4c382e01f0b@kernel.dk> Organization: Trillion01 Inc Content-Type: multipart/mixed; boundary="=-LuIFA0+NKzOxj7b4hLdf" User-Agent: Evolution 3.40.1 MIME-Version: 1.0 X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - cloud48395.mywhc.ca X-AntiAbuse: Original Domain - vger.kernel.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - trillion01.com X-Get-Message-Sender-Via: cloud48395.mywhc.ca: authenticated_id: olivier@trillion01.com X-Authenticated-Sender: cloud48395.mywhc.ca: olivier@trillion01.com X-Source: X-Source-Args: X-Source-Dir: Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org --=-LuIFA0+NKzOxj7b4hLdf Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit On Thu, 2021-05-20 at 00:13 -0400, Olivier Langlois wrote: > I know that my test case isn't conclusive. It is a failed attempt to > capture what my program is doing. > > The priority of investigating my core dump issue has substantially > dropped last week because I did solve my primary issue (A buffer leak > in the provided buffers to io_uring during disconnection). My program > did run for days but it did crash morning without any core dump > again. > It is a very frustrating situation because it would probably be a bug > trivial to diagnostic and fix but without the core, the logs are > opaque > and they just don't give no clue about why the program did crash. > > A key characteristic of my program, it is that it generates at least > 1 > io-worker thread per io_uring instance. As I get more familiar with io_uring source code, I have come to realize that it is practically impossible to not end up with NO io-wq threads. They are created in from io_uring_install_fd() which is called for every instances created. I'm a bit lazy for rebooting my desktop and I am still running 5.11.5 on it. I guess that with this kernel version, the io_uring threads weren't threads belonging to the user process and arent showing with ps by searching for a specific process LWPs. I correctly see all the generated threads when I run the test program on an up-to-date server (5.12.4). I have rewritten the whole test program. It has now become an io_uring multi connection http client (it could make a nice io_uring example program, IMHO). Still no success in reproducing the problem with it. So, I am giving up the idea of reproducing the problem with a showcase program unless I have some clue about how to reproduce it. However, I can reproduce it at will with my real program. So as Linus has suggested, I'll investigate by searching where the PF_IO_WORKER is used. I'll keep the list updated if I discover something. Greetings, --=-LuIFA0+NKzOxj7b4hLdf Content-Disposition: attachment; filename="test_io_uring_coredump.cpp" Content-Type: text/x-c++src; name="test_io_uring_coredump.cpp"; charset="ISO-8859-1" Content-Transfer-Encoding: base64 LyoKICogVGVzdCBwcm9ncmFtIHRvIHJlcHJvZHVjZSBpc3N1ZSBnZW5lcmF0aW5nIGNvcmUgZHVt cHMgd2hpbGUgdXNpbmcgaW9fdXJpbmcuCiAqCiAqIFRvIGNvbXBpbGU6IGcrKyAtcHRocmVhZCB0 ZXN0X2lvX3VyaW5nX2NvcmVkdW1wLmNwcCAtbHVyaW5nCiAqCiAqLwoKI2luY2x1ZGUgPGxpYnVy aW5nLmg+CiNpbmNsdWRlIDxzdGRpby5oPgojaW5jbHVkZSA8c3RkbGliLmg+ICAgLy8gZm9yIGFi b3J0KCkKI2luY2x1ZGUgPHVuaXN0ZC5oPiAgIC8vIGZvciBjbG9zZSgpCiNpbmNsdWRlIDxlcnJu by5oPgojaW5jbHVkZSA8ZmNudGwuaD4KI2luY2x1ZGUgPHBvbGwuaD4KI2luY2x1ZGUgPHN0cmlu Zy5oPiAgIC8vIGZvciBzdHJlcnJvcigpCiNpbmNsdWRlIDxtZW1vcnkuaD4gICAvLyBmb3IgbWVt c2V0KCkKI2luY2x1ZGUgPGFycGEvaW5ldC5oPgojaW5jbHVkZSA8c3lzL3NvY2tldC5oPgojaW5j bHVkZSA8bmV0ZGIuaD4KI2luY2x1ZGUgPHN0ZGludC5oPiAgIC8vIGZvciB1aW50MzJfdCwgdWlu dDY0X3QKI2luY2x1ZGUgPHB0aHJlYWQuaD4KI2luY2x1ZGUgPHNzdHJlYW0+CiNpbmNsdWRlIDxz dHJpbmc+CgojZGVmaW5lIFFEIDI1NgojZGVmaW5lIEJHSUQxIDAKI2RlZmluZSBCR0lEMiAxCiNk ZWZpbmUgUE9SVDEgMTk3NQojZGVmaW5lIFBPUlQyIDE5NzYKI2RlZmluZSBCVUZTWiA1KjQwOTYK CmVudW0gewogICAgSU9VUklOR19QT0xMX0FERCwKICAgIElPVVJJTkdfUE9MTF9SRU1PVkUsCiAg ICBJT1VSSU5HX1BST1ZfQlVGLAogICAgSU9VUklOR19CVUZfUkVBRCwKICAgIElPVVJJTkdfV1JJ VEUKfTsKCnN0YXRpYwpjb25zdCBjaGFyICpJb19VcmluZ19PcFR5cGVUb1N0cihjaGFyIHR5cGUp CnsKICAgIGNvbnN0IGNoYXIgKnJlczsKICAgIHN3aXRjaCAodHlwZSkgewogICAgICAgIGNhc2Ug SU9VUklOR19QT0xMX0FERDoKICAgICAgICAgICAgcmVzID0gIklPVVJJTkdfUE9MTF9BREQiOwog ICAgICAgICAgICBicmVhazsKICAgICAgICBjYXNlIElPVVJJTkdfUE9MTF9SRU1PVkU6CiAgICAg ICAgICAgIHJlcyA9ICJJT1VSSU5HX1BPTExfUkVNT1ZFIjsKICAgICAgICAgICAgYnJlYWs7CiAg ICAgICAgY2FzZSBJT1VSSU5HX1BST1ZfQlVGOgogICAgICAgICAgICByZXMgPSAiSU9VUklOR19Q Uk9WX0JVRiI7CiAgICAgICAgICAgIGJyZWFrOwogICAgICAgIGNhc2UgSU9VUklOR19CVUZfUkVB RDoKICAgICAgICAgICAgcmVzID0gIklPVVJJTkdfQlVGX1JFQUQiOwogICAgICAgICAgICBicmVh azsKICAgICAgICBjYXNlIElPVVJJTkdfV1JJVEU6CiAgICAgICAgICAgIHJlcyA9ICJJT1VSSU5H X1dSSVRFIjsKICAgICAgICAgICAgYnJlYWs7CiAgICAgICAgZGVmYXVsdDoKICAgICAgICAgICAg cmVzID0gIlVua25vd24iOwogICAgfQogICAgcmV0dXJuIHJlczsKfQoKZW51bSB7IFRIUkVBRF9N QVhfRkQgPSA4NiwgQklPX1JJTkdfU1ogPSA4IH07CgppbmxpbmUKdm9pZCAqCmlvdXJpbmdfYnVp bGRfdXNlcl9kYXRhKGNoYXIgdHlwZSwgaW50IGZkLCB1aW50MzJfdCBjbGllbnRJZCkKewogICAg cmV0dXJuICh2b2lkICopKCh1aW50MzJfdClmZCB8ICgoX191NjQpKGNsaWVudElkICYgMHgwMGZm ZmZmZikgPDwgMzIgKSB8CiAgICAgICAgICAgICAgICAgICAgKChfX3U2NCl0eXBlIDw8IDU2KSk7 Cn0KCmlubGluZQp2b2lkCmlvdXJpbmdfZGVjb2RlX3VzZXJfZGF0YSh1aW50NjRfdCBkYXRhLCBj aGFyICp0eXBlLCBpbnQgKmZkLCB1aW50MzJfdCAqY2xpZW50SWQpCnsKICAgICp0eXBlID0gZGF0 YSA+PiA1NjsKICAgICpmZCAgID0gZGF0YSAmIDB4ZmZmZmZmZmZVOwogICAgKmNsaWVudElkID0g KGRhdGEgPj4gMzIpICYgMHgwMGZmZmZmZlU7Cn0KCi8qCiAqIHByb3ZpZGVTaW1wbGVCdWZmZXIo KQogKi8Kc3RhdGljIGludCBwcm92aWRlU2ltcGxlQnVmZmVyKHN0cnVjdCBpb191cmluZyAqcmlu Zywgdm9pZCAqYWRkciwgaW50IGxlbiwgaW50IG5yLCBpbnQgYmdpZCwgaW50IGJpZCwgaW50IGJs b2NrKQp7CiAgICBpbnQgcmVzOwogICAgLy8gcmVnaXN0ZXIgYnVmZmVycyBmb3IgYnVmZmVyIHNl bGVjdGlvbgogICAgc3RydWN0IGlvX3VyaW5nX3NxZSAqc3FlOwogICAgc3RydWN0IGlvX3VyaW5n X2NxZSAqY3FlOwoKICAgIHNxZSA9IGlvX3VyaW5nX2dldF9zcWUocmluZyk7CiAgICBpb191cmlu Z19wcmVwX3Byb3ZpZGVfYnVmZmVycyhzcWUsIGFkZHIsIGxlbiwgbnIsIGJnaWQsIGJpZCk7CiAg ICBpb191cmluZ19zcWVfc2V0X2RhdGEoc3FlLCBpb3VyaW5nX2J1aWxkX3VzZXJfZGF0YShJT1VS SU5HX1BST1ZfQlVGLCAwLCAtMSkpOwogICAgaWYgKGJsb2NrKSB7CiAgICAgICAgaW9fdXJpbmdf c3VibWl0KHJpbmcpOwogICAgICAgIGlvX3VyaW5nX3dhaXRfY3FlKHJpbmcsICZjcWUpOwogICAg ICAgIHJlcyA9IGNxZS0+cmVzOwogICAgICAgIGlmIChyZXMgPCAwKSB7CiAgICAgICAgICAgIGVy cm5vID0gLXJlczsKICAgICAgICB9CiAgICAgICAgaW9fdXJpbmdfY3FlX3NlZW4ocmluZywgY3Fl KTsKICAgIH0KICAgIGVsc2UgewogICAgICAgIHJlcyA9IDA7CiAgICB9CiAgICByZXR1cm4gcmVz Owp9CgovKgogKiBpbml0QnVmU2VsZWN0UmVhZCgpCiAqLwpzdGF0aWMgdm9pZCBpbml0QnVmU2Vs ZWN0UmVhZChzdHJ1Y3QgaW9fdXJpbmcgKnJpbmcsIGludCBmZCwgc2l6ZV90IG1heF9yZWFkLCBp bnQgZ2lkLCB1aW50MzJfdCBjbGllbnRJZCkKewogICAgc3RydWN0IGlvX3VyaW5nX3NxZSAqc3Fl ID0gaW9fdXJpbmdfZ2V0X3NxZShyaW5nKTsKICAgIGlvX3VyaW5nX3ByZXBfcmVhZChzcWUsIGZk LCBOVUxMLCBtYXhfcmVhZCwgMCk7CiAgICBpb191cmluZ19zcWVfc2V0X2ZsYWdzKHNxZSwgSU9T UUVfQlVGRkVSX1NFTEVDVHxJT1NRRV9BU1lOQyk7CiAgICBzcWUtPmJ1Zl9ncm91cCA9IGdpZDsK ICAgIGlvX3VyaW5nX3NxZV9zZXRfZGF0YShzcWUsIGlvdXJpbmdfYnVpbGRfdXNlcl9kYXRhKElP VVJJTkdfQlVGX1JFQUQsIGZkLCBjbGllbnRJZCkpOwp9CgpzdGF0aWMgdm9pZAppb3VyaW5nX3dy aXRlKHN0cnVjdCBpb191cmluZyAqcmluZywgaW50IGZkLCBjb25zdCB2b2lkICphZGRyLCBpbnQg bGVuLCB1aW50MzJfdCBjbGllbnRJZCkKewogIHN0cnVjdCBpb191cmluZ19zcWUgKnNxZSA9IGlv X3VyaW5nX2dldF9zcWUocmluZyk7CiAgaW9fdXJpbmdfcHJlcF93cml0ZShzcWUsIGZkLCBhZGRy LCBsZW4sIDApOwogIGlvX3VyaW5nX3NxZV9zZXRfZGF0YShzcWUsIGlvdXJpbmdfYnVpbGRfdXNl cl9kYXRhKElPVVJJTkdfV1JJVEUsIGZkLCBjbGllbnRJZCkpOwp9CgpjbGFzcyBCdWZmZXJNYW5h Z2VyCnsKcHVibGljOgogICAgQnVmZmVyTWFuYWdlcihzdHJ1Y3QgaW9fdXJpbmcgKnJpbmcsIGlu dCBuciwgaW50IG1heF9zeiwgaW50IGdpZCk7CiAgICB+QnVmZmVyTWFuYWdlcigpOwogICAgCiAg ICBjaGFyICpnZXRCdWZmZXIoaW50IGJpZCkgeyByZXR1cm4gbV9idWZmZXJCYXNlICsgYmlkKm1f bWF4X3N6OyB9CiAgICB2b2lkICByZWxlYXNlQnVmZmVyKGludCBiaWQpOwogICAgaW50IGdldE1h eFN6KCkgY29uc3QgeyByZXR1cm4gbV9tYXhfc3o7IH0KICAgIGludCBnZXRHaWQoKSAgIGNvbnN0 IHsgcmV0dXJuIG1fZ2lkOyB9CiAgICAKcHJpdmF0ZToKICAgIHN0cnVjdCBpb191cmluZyAqbV9y aW5nOwogICAgY2hhciAqbV9idWZmZXJCYXNlOwogICAgaW50ICAgbV9ucjsKICAgIGludCAgIG1f bWF4X3N6OwogICAgaW50ICAgbV9naWQ7Cn07CgpCdWZmZXJNYW5hZ2VyOjpCdWZmZXJNYW5hZ2Vy KHN0cnVjdCBpb191cmluZyAqcmluZywgaW50IG5yLCBpbnQgbWF4X3N6LCBpbnQgZ2lkKQo6IG1f cmluZyhyaW5nKSwKICBtX2J1ZmZlckJhc2UobnVsbHB0ciksCiAgbV9ucihuciksCiAgbV9tYXhf c3oobWF4X3N6KSwKICBtX2dpZChnaWQpCnsKICAgIGludCByZXMgPSBwb3NpeF9tZW1hbGlnbihy ZWludGVycHJldF9jYXN0PHZvaWQgKio+KCZtX2J1ZmZlckJhc2UpLCAxMDI0LCBtX25yKm1fbWF4 X3N6KTsKICAgIGlmIChyZXMpIHsKICAgICAgICBmcHJpbnRmKHN0ZGVyciwgInBvc2l4X21lbWFs aWduOiAoJWQpICVzIiwgcmVzLCBzdHJlcnJvcihyZXMpKTsKICAgICAgICBleGl0KDApOwogICAg fQogICAgaWYgKHByb3ZpZGVTaW1wbGVCdWZmZXIobV9yaW5nLCBtX2J1ZmZlckJhc2UsIG1fbWF4 X3N6LCBtX25yLCBnaWQsIDAsIDEpIDwgMCkgewogICAgICAgIGZwcmludGYoc3RkZXJyLCAicHJv dmlkZVNpbXBsZUJ1ZmZlcigpIGZhaWxlZDogKCVkKSAlc1xuIiwgZXJybm8sIHN0cmVycm9yKGVy cm5vKSk7CiAgICAgICAgZXhpdCgwKTsKICAgIH0KfQoKQnVmZmVyTWFuYWdlcjo6fkJ1ZmZlck1h bmFnZXIoKQp7CiAgICAvLyBXZSBjb3VsZCByZW1vdmUgdGhlIGJ1ZmZlciBmcm9tIGlvX3VyaW5n IGhlcmUgYnV0IGZvciB0aGUgc2FrZSBvZiB0aGUgdGVzdCB3ZSB3b24ndAp9CgovKgogKiByZWxl YXNlQnVmZmVyKCkKICovCnZvaWQgQnVmZmVyTWFuYWdlcjo6cmVsZWFzZUJ1ZmZlcihpbnQgYmlk KQp7CiAgICBwcm92aWRlU2ltcGxlQnVmZmVyKG1fcmluZywgZ2V0QnVmZmVyKGJpZCksIG1fbWF4 X3N6LCAxLCBtX2dpZCwgYmlkLCAwKTsKfQoKY2xhc3MgSHR0cENsaWVudAp7CnB1YmxpYzoKICAg IEh0dHBDbGllbnQoKTsKICAgIH5IdHRwQ2xpZW50KCk7CiAgICAKICAgIC8qCiAgICAgKiBJIGRv bid0IHdhbnQgdG8gd3JpdGUgYW4gVVJMIHBhcnNlciBmb3IgYSB0ZXN0LgogICAgICovCiAgICB2 b2lkIGluaXRpYXRlKHN0cnVjdCBpb191cmluZyAqcmluZywgY29uc3QgY2hhciAqaG9zdCwgY29u c3QgY2hhciAqcGF0aCwgdWludDMyX3QgY2xpZW50SWQpOwogICAgLyoKICAgICAqIEFzIGxvbmcg YXMgdGhlIHJlYWQgc3VjY2VlZHMsIHdlIGluaXRpYXRlIGEgbmV3IHJlYWQuIEV2ZW50dWFsbHks IHRoZSBzZXJ2ZXIKICAgICAqIGlzIGdvaW5nIHRvIGNsb3NlIGl0cyBzaWRlIG9mIHRoZSBjb25u ZWN0aW9uIGFuZCB3ZSB3aWxsIHN0b3Agc3VibWl0dGluZyBvcGVyYXRpb25zLgogICAgICogV2hl biBhbGwgdGhlIGNsaWVudHMgcmVhY2ggdGhhdCBzdGF0ZSwgdGhlIHRocmVhZCBzaG91bGQgYmxv Y2sgaW50byBpb191cmluZ19lbnRlciB3YWl0aW5nCiAgICAgKiBmb3IgbmV3IGNvbXBsZXRpb24g dGhhdCB3aWxsIG5ldmVyIGNvbWUKICAgICAqLwogICAgdm9pZCBwcm9jZXNzQ29tcGxldGlvbihz dHJ1Y3QgaW9fdXJpbmcgKnJpbmcsIHN0cnVjdCBpb191cmluZ19jcWUgKmNxZSwgQnVmZmVyTWFu YWdlciAmYnVmbWdyKTsKCnByaXZhdGU6CiAgICB2b2lkIHNlbmRSZXF1ZXN0KHN0cnVjdCBpb191 cmluZyAqcmluZywgdWludDMyX3QgY2xpZW50SWQpOwogICAgdm9pZCByZWN2UmVwbHkoc3RydWN0 IGlvX3VyaW5nICpyaW5nLCBzdHJ1Y3QgaW9fdXJpbmdfY3FlICpjcWUsIEJ1ZmZlck1hbmFnZXIg JmJ1Zm1ncik7CiAgICBpbnQgbV9mZDsKICAgIGVudW0geyBET1dOLCBDT05ORUNUSU5HLCBXQUlU X1JFUExZIH0gbV9zdGF0ZTsKICAgIGNvbnN0IGNoYXIgKm1faG9zdDsKICAgIGNvbnN0IGNoYXIg Km1fcGF0aDsKICAgIHN0ZDo6c3RyaW5nIG1fcmVxdWVzdDsKfTsKCkh0dHBDbGllbnQ6Okh0dHBD bGllbnQoKQo6IG1fZmQoLTEpLAogIG1fc3RhdGUoRE9XTiksCiAgbV9ob3N0KG51bGxwdHIpLAog IG1fcGF0aChudWxscHRyKQp7Cn0KCkh0dHBDbGllbnQ6On5IdHRwQ2xpZW50KCkKewogICAgaWYg KG1fZmQgPj0gMCkKICAgICAgICBjbG9zZShtX2ZkKTsKICAgIG1fZmQgPSAtMTsKfQoKdm9pZCBI dHRwQ2xpZW50Ojppbml0aWF0ZShzdHJ1Y3QgaW9fdXJpbmcgKnJpbmcsIGNvbnN0IGNoYXIgKmhv c3QsIGNvbnN0IGNoYXIgKnBhdGgsIHVpbnQzMl90IGNsaWVudElkKQp7CiAgICBtX2hvc3QgPSBo b3N0OwogICAgbV9wYXRoID0gcGF0aDsKCiAgICBzdHJ1Y3QgYWRkcmluZm8gaGludHM7CiAgICBz dHJ1Y3QgYWRkcmluZm8gKnJlc3VsdCA9IG51bGxwdHI7CiAgICBtZW1zZXQoJmhpbnRzLCAwLCBz aXplb2YoaGludHMpKTsKICAgIGhpbnRzLmFpX3NvY2t0eXBlID0gU09DS19TVFJFQU07CiAgICBo aW50cy5haV9mYW1pbHkgPSBBRl9JTkVUOwogICAgaWYgKGdldGFkZHJpbmZvKG1faG9zdCwgbnVs bHB0ciwgJmhpbnRzLCAmcmVzdWx0KSA8IDApIHsKICAgICAgICBmcHJpbnRmKHN0ZGVyciwgImdl dGFkZGluZm8oKSBmYWlsZWQ6ICglZCkgJXNcbiIsIGVycm5vLCBzdHJlcnJvcihlcnJubykpOwog ICAgICAgIGV4aXQoMCk7CiAgICB9CiAgICB2b2lkICpwID0gTlVMTDsKICAgIHN0cnVjdCBhZGRy aW5mbyAqcmVzID0gcmVzdWx0OwoKICAgIC8qIHBpY2sgdGhlIGZpcnN0IEFGX0lORVQgKElQdjQp IHJlc3VsdCAqLwoKICAgIHdoaWxlICghcCAmJiByZXMpIHsKICAgICAgICBzd2l0Y2ggKHJlcy0+ YWlfZmFtaWx5KSB7CiAgICAgICAgICAgIGNhc2UgQUZfSU5FVDoKICAgICAgICAgICAgICAgIHAg PSAmKChzdHJ1Y3Qgc29ja2FkZHJfaW4gKilyZXMtPmFpX2FkZHIpLT5zaW5fYWRkcjsKICAgICAg ICAgICAgICAgIGJyZWFrOwogICAgICAgIH0KICAgICAgICByZXMgPSByZXMtPmFpX25leHQ7CiAg ICB9CiAgICBzdHJ1Y3Qgc29ja2FkZHJfaW4gc29ja0FkZHI7CiAgICBtZW1zZXQoJnNvY2tBZGRy LCAwLCBzaXplb2Yoc3RydWN0IHNvY2thZGRyX2luKSk7CiAgICBzb2NrQWRkci5zaW5fZmFtaWx5 ID0gQUZfSU5FVDsKICAgIHNvY2tBZGRyLnNpbl9hZGRyID0gKigoc3RydWN0IGluX2FkZHIgKilw KTsKICAgIHNvY2tBZGRyLnNpbl9wb3J0ID0gaHRvbnMoODApOwogICAgZnJlZWFkZHJpbmZvKHJl c3VsdCk7CiAgICBtX2ZkID0gc29ja2V0KEFGX0lORVQsIFNPQ0tfU1RSRUFNLCAwKTsKICAgIGlm IChtX2ZkIDwgMCkgewogICAgICAgIGZwcmludGYoc3RkZXJyLCAic29ja2V0KCkgZmFpbGVkOiAo JWQpICVzXG4iLCBlcnJubywgc3RyZXJyb3IoZXJybm8pKTsKICAgICAgICBleGl0KDApOwogICAg fQogICAgaWYgKGZjbnRsKG1fZmQsIEZfU0VURkwsIE9fTk9OQkxPQ0spIDwgMCkgewogICAgICAg IGZwcmludGYoc3RkZXJyLCAiZmNudGwoKSBmYWlsZWQ6ICglZCkgJXNcbiIsIGVycm5vLCBzdHJl cnJvcihlcnJubykpOwogICAgICAgIGV4aXQoMCk7CiAgICB9CiAgICBpZiAoY29ubmVjdChtX2Zk LCByZWludGVycHJldF9jYXN0PHN0cnVjdCBzb2NrYWRkciAqPigmc29ja0FkZHIpLCBzaXplb2Yo c3RydWN0IHNvY2thZGRyX2luKSkgPCAwICYmCiAgICAgICAgZXJybm8gIT0gRUlOUFJPR1JFU1Mp IHsKICAgICAgICBmcHJpbnRmKHN0ZGVyciwgImNvbm5lY3QoKSBmYWlsZWQ6ICglZCkgJXNcbiIs IGVycm5vLCBzdHJlcnJvcihlcnJubykpOwogICAgICAgIGV4aXQoMCk7CiAgICB9CiAgICBzdHJ1 Y3QgaW9fdXJpbmdfc3FlICpzcWUgPSBpb191cmluZ19nZXRfc3FlKHJpbmcpOwogICAgaW9fdXJp bmdfcHJlcF9wb2xsX2FkZChzcWUsIG1fZmQsIFBPTExPVVQpOwogICAgaW9fdXJpbmdfc3FlX3Nl dF9kYXRhKHNxZSwgaW91cmluZ19idWlsZF91c2VyX2RhdGEoSU9VUklOR19QT0xMX0FERCwgbV9m ZCwgY2xpZW50SWQpKTsKCiAgICBtX3N0YXRlID0gQ09OTkVDVElORzsKfQoKLyoKICogc2VuZFJl cXVlc3QoKQogKiAKICogR0VUIC8gSFRUUC8xLjEKICogSG9zdDoga2VybmVsLm9yZzo4MAogKi8K dm9pZCBIdHRwQ2xpZW50OjpzZW5kUmVxdWVzdChzdHJ1Y3QgaW9fdXJpbmcgKnJpbmcsIHVpbnQz Ml90IGNsaWVudElkKQp7CiAgICBzdGQ6Om9zdHJpbmdzdHJlYW0gb3N0OwogICAgb3N0IDw8ICJH RVQgIiA8PCBtX3BhdGggPDwgIiBIVFRQLzEuMVxyXG4iOwogICAgb3N0IDw8ICJIb3N0OiAiIDw8 IG1faG9zdCA8PCAiOjgwXHJcbiI7CiAgICBvc3QgPDwgIlVzZXItQWdlbnQ6IGlvX3VyaW5nIGNv cmVkdW1wIHRlc3QgMS4wXHJcblxyXG4iOwogICAgbV9yZXF1ZXN0ID0gb3N0LnN0cigpOwogICAg aW91cmluZ193cml0ZShyaW5nLCBtX2ZkLCBtX3JlcXVlc3QuY19zdHIoKSwgbV9yZXF1ZXN0LnNp emUoKSwgY2xpZW50SWQpOwp9CgovKgogKiByZWN2UmVwbHkoKQogKi8Kdm9pZCBIdHRwQ2xpZW50 OjpyZWN2UmVwbHkoc3RydWN0IGlvX3VyaW5nICpyaW5nLCBzdHJ1Y3QgaW9fdXJpbmdfY3FlICpj cWUsIEJ1ZmZlck1hbmFnZXIgJmJ1Zm1ncikKewogICAgY2hhciB0eXBlOwogICAgaW50ICBmZCwg YmlkOwogICAgdWludDMyX3QgY2xpZW50SWQ7CiAgICBpbnQgcmVzID0gY3FlLT5yZXM7CgogICAg aW91cmluZ19kZWNvZGVfdXNlcl9kYXRhKGNxZS0+dXNlcl9kYXRhLCAmdHlwZSwgJmZkLCAmY2xp ZW50SWQpOwogICAgYmlkID0gY3FlLT5mbGFncyA+PiBJT1JJTkdfQ1FFX0JVRkZFUl9TSElGVDsK ICAgIGNoYXIgKmJ1ZiA9IGJ1Zm1nci5nZXRCdWZmZXIoYmlkKTsKICAgIGZwcmludGYoc3RkZXJy LCAiY2xpZW50ICVkIHJlcGx5OlxuXG4lLipzXG4iLCBjbGllbnRJZCwgcmVzLCBidWYpOwogICAg CiAgICAvLyByZXR1cm5zIHRoZSBidWZmZXIgYmFjayB0byBpb191cmluZy4KICAgIHByb3ZpZGVT aW1wbGVCdWZmZXIocmluZywgYnVmLCBidWZtZ3IuZ2V0TWF4U3ooKSwgMSwgYnVmbWdyLmdldEdp ZCgpLCBiaWQsIDApOwp9CgovKgogKiBwcm9jZXNzQ29tcGxldGlvbigpCiAqLwp2b2lkIEh0dHBD bGllbnQ6OnByb2Nlc3NDb21wbGV0aW9uKHN0cnVjdCBpb191cmluZyAqcmluZywKICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICBzdHJ1Y3QgaW9fdXJpbmdfY3FlICpjcWUsCiAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgQnVmZmVyTWFuYWdlciAmYnVmbWdyKQp7CiAg ICBjaGFyIHR5cGU7CiAgICBpbnQgIGZkLCBiaWQ7CiAgICB1aW50MzJfdCBjbGllbnRJZDsKICAg IGludCByZXMgPSBjcWUtPnJlczsKCiAgICBpb3VyaW5nX2RlY29kZV91c2VyX2RhdGEoY3FlLT51 c2VyX2RhdGEsICZ0eXBlLCAmZmQsICZjbGllbnRJZCk7CiAgICBzd2l0Y2ggKHR5cGUpIHsKICAg ICAgICBjYXNlIElPVVJJTkdfUE9MTF9BREQ6CiAgICAgICAgICAgIGlmIChtX3N0YXRlICE9IENP Tk5FQ1RJTkcpIHsKICAgICAgICAgICAgICAgIGZwcmludGYoc3RkZXJyLCAiY2xpZW50ICVkOiB1 bmV4cGVjdGVkIElPVVJJTkdfUE9MTF9BREQgY29tcGxldGlvblxuIiwgY2xpZW50SWQpOwogICAg ICAgICAgICAgICAgYWJvcnQoKTsKICAgICAgICAgICAgfQogICAgICAgICAgICAvLyBjbGVhciB0 aGUgT19OT05CTE9DSyBmbGFnCiAgICAgICAgICAgIGZjbnRsKG1fZmQsIEZfU0VURkwsIDApOwog ICAgICAgICAgICAvKgogICAgICAgICAgICAgKiBTZXR1cCB0aGUgbmV4dCByZWFkIGJlZm9yZSBz ZW5kaW5nIHRoZSByZXF1ZXN0LgogICAgICAgICAgICAgKiBNYXliZSBpdCBpcyBoYXZpbmcgbXVs dGlwbGUgY29uY3VycmVudCBvcGVyYXRpb25zIG9uIHRoZSBzYW1lCiAgICAgICAgICAgICAqIGZk IHRoYXQgaXMgdHJpZ2dlcmluZyB0aGUgaW8gdGhyZWFkIHNwYXduLgogICAgICAgICAgICAgKi8K ICAgICAgICAgICAgaW5pdEJ1ZlNlbGVjdFJlYWQocmluZywgbV9mZCwgYnVmbWdyLmdldE1heFN6 KCksIGJ1Zm1nci5nZXRHaWQoKSwgY2xpZW50SWQpOwogICAgICAgICAgICBzZW5kUmVxdWVzdChy aW5nLCBjbGllbnRJZCk7CiAgICAgICAgICAgIG1fc3RhdGUgPSBXQUlUX1JFUExZOwogICAgICAg ICAgICBicmVhazsKICAgICAgICBjYXNlIElPVVJJTkdfUE9MTF9SRU1PVkU6CiAgICAgICAgICAg IGZwcmludGYoc3RkZXJyLCAiY2xpZW50ICVkOiB1bmV4cGVjdGVkIElPVVJJTkdfUE9MTF9SRU1P VkUgY29tcGxldGlvblxuIiwgY2xpZW50SWQpOwogICAgICAgICAgICBhYm9ydCgpOwogICAgICAg ICAgICBicmVhazsKICAgICAgICBjYXNlIElPVVJJTkdfUFJPVl9CVUY6CiAgICAgICAgICAgIGlm IChyZXMgPCAwKSB7CiAgICAgICAgICAgICAgICBmcHJpbnRmKHN0ZGVyciwgImNsaWVudCAlZDog dW5leHBlY3RlZCBJT1VSSU5HX1BST1ZfQlVGIGZhaWx1cmU6ICglZCkgJXNcbiIsCiAgICAgICAg ICAgICAgICAgICAgICAgIGNsaWVudElkLCAtcmVzLCBzdHJlcnJvcigtcmVzKSk7CiAgICAgICAg ICAgICAgICBhYm9ydCgpOwogICAgICAgICAgICB9CiAgICAgICAgICAgIGJyZWFrOwogICAgICAg IGNhc2UgSU9VUklOR19CVUZfUkVBRDoKICAgICAgICAgICAgaWYgKHJlcyA8PSAwKSB7CiAgICAg ICAgICAgICAgICBmcHJpbnRmKHN0ZGVyciwgImNsaWVudCAlZDogdW5leHBlY3RlZCBJT1VSSU5H X0JVRl9SRUFEIHJlczogJWRcbiIsCiAgICAgICAgICAgICAgICAgICAgICAgIGNsaWVudElkLCBy ZXMpOwogICAgICAgICAgICB9CiAgICAgICAgICAgIGVsc2UgewogICAgICAgICAgICAgICAgcmVj dlJlcGx5KHJpbmcsIGNxZSwgYnVmbWdyKTsKICAgICAgICAgICAgICAgIC8vIFJlbG9hZCB0aGUg cmVhZAogICAgICAgICAgICAgICAgaW5pdEJ1ZlNlbGVjdFJlYWQocmluZywgbV9mZCwgYnVmbWdy LmdldE1heFN6KCksIGJ1Zm1nci5nZXRHaWQoKSwgY2xpZW50SWQpOwogICAgICAgICAgICB9CiAg ICAgICAgICAgIGJyZWFrOwogICAgICAgIGNhc2UgSU9VUklOR19XUklURToKICAgICAgICAgICAg ZnByaW50ZihzdGRlcnIsICJjbGllbnQgJWQ6IHJlcXVlc3QgdHggY29tcGxldGVkOiAlZFxuIiwg Y2xpZW50SWQsIHJlcyk7CiAgICAgICAgICAgIGJyZWFrOwogICAgfQp9CgojZGVmaW5lIE5VTUNM SUVOVFMgNgoKaW50IG1haW4oaW50IGFyZ2MsIGNoYXIgKmFyZ3ZbXSkKewogICAgaW50IHJlczsK ICAgIHN0cnVjdCBpb191cmluZ19wYXJhbXMgcGFyYW1zOwogICAgc3RydWN0IGlvX3VyaW5nIHJp bmc7CiAgICAKICAgIG1lbXNldCgmcGFyYW1zLCAwLCBzaXplb2YocGFyYW1zKSk7CgogICAgaWYg KGlvX3VyaW5nX3F1ZXVlX2luaXRfcGFyYW1zKFFELCAmcmluZywgJnBhcmFtcykgPCAwKSB7CiAg ICAgICAgZnByaW50ZihzdGRlcnIsICJpb191cmluZ19xdWV1ZV9pbml0X3BhcmFtcygpIGZhaWxl ZDogKCVkKSAlc1xuIiwgZXJybm8sIHN0cmVycm9yKGVycm5vKSk7CiAgICAgICAgcmV0dXJuIHJl czsKICAgIH0KICAgIEJ1ZmZlck1hbmFnZXIgYnVmbWdyKCZyaW5nLCBUSFJFQURfTUFYX0ZEKkJJ T19SSU5HX1NaLCBCVUZTWiwgQkdJRDEpOwoKICAgIGNvbnN0IGNoYXIgKnNlcnZlcnNbTlVNQ0xJ RU5UU10gPSB7CiAgICAgICAgImdvb2dsZS5jb20iLAogICAgICAgICJmYWNlYm9vay5jb20iLAog ICAgICAgICJ0d2l0dGVyLmNvbSIsCiAgICAgICAgInd3dy5jbG91ZGZsYXJlLmNvbSIsCiAgICAg ICAgImtlcm5lbC5vcmciLAogICAgICAgICJwaG9yb25peC5jb20iCiAgICB9OwoKICAgIEh0dHBD bGllbnQgY2xpZW50c1tOVU1DTElFTlRTXTsKCiAgICAvKgogICAgICogR2l2ZSB0aGUgdGVzdGVy CiAgICAgKi8KICAgIHNsZWVwKDEwKTsKICAgIAogICAgZm9yICh1aW50MzJfdCBpID0gMDsgaSA8 IE5VTUNMSUVOVFM7ICsraSkgewogICAgICAgIGNsaWVudHNbaV0uaW5pdGlhdGUoJnJpbmcsIHNl cnZlcnNbaV0sICIvIiwgaSk7CiAgICB9CgogICAgd2hpbGUgKDEpIHsKICAgICAgICBpb191cmlu Z19zdWJtaXRfYW5kX3dhaXQoJnJpbmcsIDEpOwogICAgICAgIHVuc2lnbmVkIGNvbXBsZXRlZCA9 IDA7CiAgICAgICAgdW5zaWduZWQgaGVhZDsKICAgICAgICBzdHJ1Y3QgaW9fdXJpbmdfY3FlICpj cWU7CiAgICAgICAgaW9fdXJpbmdfZm9yX2VhY2hfY3FlKCZyaW5nLCBoZWFkLCBjcWUpIHsKICAg ICAgICAgICAgKytjb21wbGV0ZWQ7CiAgICAgICAgICAgIGNoYXIgdHlwZTsKICAgICAgICAgICAg aW50ICBmZCwgYmlkOwogICAgICAgICAgICB1aW50MzJfdCBjbGllbnRJZDsKICAgICAgICAgICAg aW91cmluZ19kZWNvZGVfdXNlcl9kYXRhKGNxZS0+dXNlcl9kYXRhLCAmdHlwZSwgJmZkLCAmY2xp ZW50SWQpOwogICAgICAgICAgICBpZiAoY2xpZW50SWQgPCBOVU1DTElFTlRTKSB7CiAgICAgICAg ICAgICAgICBjbGllbnRzW2NsaWVudElkXS5wcm9jZXNzQ29tcGxldGlvbigmcmluZywgY3FlLCBi dWZtZ3IpOwogICAgICAgICAgICB9CiAgICAgICAgICAgIGVsc2UgewogICAgICAgICAgICAgICAg LyoKICAgICAgICAgICAgICAgICAqIFRoZSBvbmx5IG9wZXJhdGlvbiBmb3Igd2hpY2ggd2UgZG9u J3QgYXNzaWduIGEgY2xpZW50IGlkIGlzIElPUklOR19PUF9QUk9WSURFX0JVRkZFUlMKICAgICAg ICAgICAgICAgICAqLwogICAgICAgICAgICAgICAgaWYgKHR5cGUgIT0gSU9VUklOR19QUk9WX0JV RikgewogICAgICAgICAgICAgICAgICAgIGZwcmludGYoc3RkZXJyLCAiVW5leHBlY3RlZCBjb21w bGV0aW9uIGV2ZW50IHdpdGggbm8gY2xpZW50IGFzc29jaWF0aW9uOiAlc1xuIiwKICAgICAgICAg ICAgICAgICAgICAgICAgICAgIElvX1VyaW5nX09wVHlwZVRvU3RyKHR5cGUpKTsKICAgICAgICAg ICAgICAgICAgICBhYm9ydCgpOwogICAgICAgICAgICAgICAgfQogICAgICAgICAgICAgICAgZWxz ZSBpZiAoY3FlLT5yZXMgPCAwKSB7CiAgICAgICAgICAgICAgICAgICAgZnByaW50ZihzdGRlcnIs ICJ1bmV4cGVjdGVkIElPVVJJTkdfUFJPVl9CVUYgZmFpbHVyZTogKCVkKSAlc1xuIiwKICAgICAg ICAgICAgICAgICAgICAgICAgICAgIC1jcWUtPnJlcywgc3RyZXJyb3IoLWNxZS0+cmVzKSk7CiAg ICAgICAgICAgICAgICAgICAgYWJvcnQoKTsKICAgICAgICAgICAgICAgIH0KICAgICAgICAgICAg fQogICAgICAgIH0KICAgICAgICBpZiAoY29tcGxldGVkKSB7CiAgICAgICAgICAgIGlvX3VyaW5n X2NxX2FkdmFuY2UoJnJpbmcsIGNvbXBsZXRlZCk7CiAgICAgICAgfQogICAgfQplcnIyOgogICAg aW9fdXJpbmdfcXVldWVfZXhpdCgmcmluZyk7CmVycjE6CiAgICByZXR1cm4gcmVzOwp9Cg== --=-LuIFA0+NKzOxj7b4hLdf--