Received: by 2002:a05:6a10:8c0a:0:0:0:0 with SMTP id go10csp732563pxb; Thu, 21 Jan 2021 19:48:27 -0800 (PST) X-Google-Smtp-Source: ABdhPJzO/gQHdIbXCyuBx/58Cu4IcvRL5ay1MJhHlJeqfEf0NbjJYJVqQ/mMvkiWIDgRYuKgxqW5 X-Received: by 2002:a50:da8b:: with SMTP id q11mr1746518edj.352.1611287307182; Thu, 21 Jan 2021 19:48:27 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1611287307; cv=none; d=google.com; s=arc-20160816; b=0XY4XCvUfjDIdS/XGWT280NVSCQbmVR+ExOok1JzngofD6Wrtqty/Qxwl8oGqy03+3 f+WJJx4nKwXLIWlRleUIR23A+9TciBOGMcKQMGUbKwu7uGc7M7TDVNQGWSEe5PMv31wV cdA5KjJ89saFVjCyqxSlFz+ZeP7E/TScN9w9EFmtEgs6Dy1cl9zz5pRt21mp2r5UvNEZ fB46QPydQVdTrVyNYG6epMy8nGMY2LfN5/1wYrnnqEUgqX7b7aj9FdD6HTcqzmkoaCqF ONh3TQRhYTt3QMMkw42Way0itwyMBLr473pnhnVciMuvVdQwHJsCfKlOaB2J2pCyWN+U 92Rw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:content-language :mime-version:user-agent:date:message-id:subject:from:cc:to :dkim-signature; bh=NJ9U3OGX+WDIyRWYMZrmoXmKa8stwDrYWxhTKHNjBzs=; b=CbiHtYb5fyQf07XYM+H1DerjK9FxTnz28WNrmiGNDfVCsSl6Qamiug1OsjNF2hhi0+ xG4siZYvHViXbIi8aoNI97NwlSEZp1hYzfzQ34mMHgr2byyXZ7dT4DqWZ7AMisOP4Jlr GVedRjjv9elIXUQSqXgpZlFFKcprR9O5JZRXDqzQp2mU/suZbvm+WtkhcjKjND7jBota Ekxf2ddQGvGG1uFGiFTJbsetWoqx9YwDAiiJenUldYkv6fXPhTi9sb7+tBTLDeD94Evr 3TsrW2eYNPtyp+oJ5kFKD9F6vsDkrOPEmOz1/zfDSMnqRiJiEulNMIIR+MG1vUyzU7JE JzBQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@ozlabs-ru.20150623.gappssmtp.com header.s=20150623 header.b=cuxGRlZe; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id dd20si3047962edb.489.2021.01.21.19.48.02; Thu, 21 Jan 2021 19:48:27 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@ozlabs-ru.20150623.gappssmtp.com header.s=20150623 header.b=cuxGRlZe; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726806AbhAVDoe (ORCPT + 99 others); Thu, 21 Jan 2021 22:44:34 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:54620 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726769AbhAVDoc (ORCPT ); Thu, 21 Jan 2021 22:44:32 -0500 Received: from mail-pg1-x530.google.com (mail-pg1-x530.google.com [IPv6:2607:f8b0:4864:20::530]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 5AB3FC06174A for ; Thu, 21 Jan 2021 19:43:51 -0800 (PST) Received: by mail-pg1-x530.google.com with SMTP id c22so2759019pgg.13 for ; Thu, 21 Jan 2021 19:43:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ozlabs-ru.20150623.gappssmtp.com; s=20150623; h=to:cc:from:subject:message-id:date:user-agent:mime-version :content-language:content-transfer-encoding; bh=NJ9U3OGX+WDIyRWYMZrmoXmKa8stwDrYWxhTKHNjBzs=; b=cuxGRlZemOE+Vo1mIcyH+tUOQQxDLRKG2dqpRXI42CND43HFTSfZd9WaEM3RGLn96r bnLf+1ynQsrl2GRQuD3anrNcSd9KuzUjfY/dKhq7duWuhQYF7LOUasVHTSG5t+oCjkhs +ChQl6ZhYuvfE9OA+7p+ew1+dTUQ8BR4638qIiOanMgWrdEsnA4UstCo2nEqoYwqh3/0 OQrRstDKDPbw+M9+vsA8MwZbUBJGf1Erj/xqF8PJo1WhlMaQ1/XZ+8kVR9+05lXO0adE 1HBin76Vc9p9f+gwymqqao6XB3lqMj2EYv5zRKZ4sUC2dsYoI73QoMK1r8gSnNtXlK14 aqYw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:cc:from:subject:message-id:date:user-agent :mime-version:content-language:content-transfer-encoding; bh=NJ9U3OGX+WDIyRWYMZrmoXmKa8stwDrYWxhTKHNjBzs=; b=ASp+Fl6pcpCnqWasv7KfBTqxWISvu/Rp9+mSB1KZi1Jx3PhxHCLN/RIWNDyRs9J1f1 4icLxOd/HKwYgkkiIaA+Wws3TPYLcVV2WMJZlFlkJmQ9iNnQtzPDA5GZdqXlxZsiVxXK QPawX+0MQRqR8OFgKuLkmpbpq5xkTIlW8HnmfdBiLMLU53bzvqopZyyeollQIwvPmLbQ yWXQV823DyzRw2rcbwhUSmj7fUMzVKfMuJNpNYvplpWZl7YppbvuRQjQgWbxvxzmHsp2 gyqVT4bodDps5WYM429JO3vx40UNj7FPZ+xaeemj3aRkQKD8LxkjXBx+Z3MYlpGkNp8M 2ZDA== X-Gm-Message-State: AOAM533HlnwSB8RBUes0NCZbzUV04JQN0y6O+UTlZyodAFKFGDdm2wcU TE80VW7qv0OaYSbOIYQ0M8qFfQ== X-Received: by 2002:a62:444:0:b029:1bc:ebb6:71f8 with SMTP id 65-20020a6204440000b02901bcebb671f8mr2701784pfe.75.1611287030861; Thu, 21 Jan 2021 19:43:50 -0800 (PST) Received: from [192.168.10.23] (124-171-107-241.dyn.iinet.net.au. [124.171.107.241]) by smtp.gmail.com with UTF8SMTPSA id l14sm7131313pjy.15.2021.01.21.19.43.47 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 21 Jan 2021 19:43:49 -0800 (PST) To: linux-kernel@vger.kernel.org Cc: Peter Zijlstra , Ingo Molnar , Will Deacon , Dmitry Vyukov From: Alexey Kardashevskiy Subject: BUG: MAX_LOCKDEP_KEYS too low! Message-ID: Date: Fri, 22 Jan 2021 14:43:44 +1100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:85.0) Gecko/20100101 Thunderbird/85.0 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi! Syzkaller found this bug and it has a repro (below). I googled a similar bug in 2019 which was fixed so this seems new. The repro takes about a half a minute to produce the message, "grep lock-classes /proc/lockdep_stats" reports 8177 of 8192, before running the repro it is 702. It is a POWER8 box. The offender is htab->lockdep_key. If I run repro at the slow rate, no problems appears, traces show lockdep_unregister_key() is called and the leak is quite slow. Is this something known? Any hints how to debug this further? I'd give it a try since I have an easy reproducer. Thanks, root@le-dbg:~# egrep "BD.*htab->lockdep_key" /proc/lockdep | wc -l 7449 root@le-dbg:~# egrep "BD.*htab->lockdep_key" /proc/lockdep | tail -n 3 (____ptrval____) FD: 1 BD: 1 ....: &htab->lockdep_key#9531 (____ptrval____) FD: 1 BD: 1 ....: &htab->lockdep_key#9532 (____ptrval____) FD: 1 BD: 1 ....: &htab->lockdep_key#9533 // autogenerated by syzkaller (https://github.com/google/syzkaller) #define __unix__ 1 #define __gnu_linux__ 1 #define __linux__ 1 #define _GNU_SOURCE #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include static unsigned long long procid; static void sleep_ms(uint64_t ms) { usleep(ms * 1000); } static uint64_t current_time_ms(void) { struct timespec ts; if (clock_gettime(CLOCK_MONOTONIC, &ts)) exit(1); return (uint64_t)ts.tv_sec * 1000 + (uint64_t)ts.tv_nsec / 1000000; } static bool write_file(const char* file, const char* what, ...) { char buf[1024]; va_list args; va_start(args, what); vsnprintf(buf, sizeof(buf), what, args); va_end(args); buf[sizeof(buf) - 1] = 0; int len = strlen(buf); int fd = open(file, O_WRONLY | O_CLOEXEC); if (fd == -1) return false; if (write(fd, buf, len) != len) { int err = errno; close(fd); errno = err; return false; } close(fd); return true; } static void kill_and_wait(int pid, int* status) { kill(-pid, SIGKILL); kill(pid, SIGKILL); for (int i = 0; i < 100; i++) { if (waitpid(-1, status, WNOHANG | __WALL) == pid) return; usleep(1000); } DIR* dir = opendir("/sys/fs/fuse/connections"); if (dir) { for (;;) { struct dirent* ent = readdir(dir); if (!ent) break; if (strcmp(ent->d_name, ".") == 0 || strcmp(ent->d_name, "..") == 0) continue; char abort[300]; snprintf(abort, sizeof(abort), "/sys/fs/fuse/connections/%s/abort", ent->d_name); int fd = open(abort, O_WRONLY); if (fd == -1) { continue; } if (write(fd, abort, 1) < 0) { } close(fd); } closedir(dir); } else { } while (waitpid(-1, status, __WALL) != pid) { } } static void setup_test() { prctl(PR_SET_PDEATHSIG, SIGKILL, 0, 0, 0); setpgrp(); write_file("/proc/self/oom_score_adj", "1000"); } static void execute_one(void); #define WAIT_FLAGS __WALL static void loop(void) { int iter = 0; for (;; iter++) { int pid = fork(); if (pid < 0) exit(1); if (pid == 0) { setup_test(); execute_one(); exit(0); } int status = 0; uint64_t start = current_time_ms(); for (;;) { if (waitpid(-1, &status, WNOHANG | WAIT_FLAGS) == pid) break; sleep_ms(1); if (current_time_ms() - start < 5000) { continue; } kill_and_wait(pid, &status); break; } } } #ifndef __NR_bpf #define __NR_bpf 361 #endif #ifndef __NR_mmap #define __NR_mmap 90 #endif uint64_t r[1] = {0xffffffffffffffff}; void execute_one(void) { intptr_t res = 0; *(uint32_t*)0x20000280 = 9; *(uint32_t*)0x20000284 = 1; *(uint32_t*)0x20000288 = 6; *(uint32_t*)0x2000028c = 5; *(uint32_t*)0x20000290 = 0; *(uint32_t*)0x20000294 = -1; *(uint32_t*)0x20000298 = 0; *(uint8_t*)0x2000029c = 0; *(uint8_t*)0x2000029d = 0; *(uint8_t*)0x2000029e = 0; *(uint8_t*)0x2000029f = 0; *(uint8_t*)0x200002a0 = 0; *(uint8_t*)0x200002a1 = 0; *(uint8_t*)0x200002a2 = 0; *(uint8_t*)0x200002a3 = 0; *(uint8_t*)0x200002a4 = 0; *(uint8_t*)0x200002a5 = 0; *(uint8_t*)0x200002a6 = 0; *(uint8_t*)0x200002a7 = 0; *(uint8_t*)0x200002a8 = 0; *(uint8_t*)0x200002a9 = 0; *(uint8_t*)0x200002aa = 0; *(uint8_t*)0x200002ab = 0; *(uint32_t*)0x200002ac = 0; *(uint32_t*)0x200002b0 = -1; *(uint32_t*)0x200002b4 = 0; *(uint32_t*)0x200002b8 = 0; *(uint32_t*)0x200002bc = 0; res = syscall(__NR_bpf, 0ul, 0x20000280ul, 0x40ul); if (res != -1) r[0] = res; *(uint64_t*)0x20000100 = 0; *(uint64_t*)0x20000108 = 0; *(uint64_t*)0x20000110 = 0x200002c0; *(uint64_t*)0x20000118 = 0x20000000; *(uint32_t*)0x20000120 = 0x1000; *(uint32_t*)0x20000124 = r[0]; *(uint64_t*)0x20000128 = 0; *(uint64_t*)0x20000130 = 0; syscall(__NR_bpf, 0x1aul, 0x20000100ul, 0x38ul); } int main(void) { syscall(__NR_mmap, 0x1fff0000ul, 0x10000ul, 0ul, 0x32ul, -1, 0ul); syscall(__NR_mmap, 0x20000000ul, 0x1000000ul, 7ul, 0x32ul, -1, 0ul); syscall(__NR_mmap, 0x21000000ul, 0x10000ul, 0ul, 0x32ul, -1, 0ul); for (procid = 0; procid < 16; procid++) { if (fork() == 0) { loop(); } } sleep(1000000); return 0; } -- Alexey