Received: by 2002:a25:23cc:0:0:0:0:0 with SMTP id j195csp138765ybj; Mon, 4 May 2020 17:49:36 -0700 (PDT) X-Google-Smtp-Source: APiQypL8RiLDx4jxM4MqE3Q4NPeW/7zCogvlJxM8yn/D9jc3Ps4FGfxBbqwOIRj09MPA//1NoxoQ X-Received: by 2002:a17:907:4060:: with SMTP id ns24mr446130ejb.3.1588639775897; Mon, 04 May 2020 17:49:35 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1588639775; cv=none; d=google.com; s=arc-20160816; b=AdqMqVXUowdHNzQRR2Unh3nbb/0ZwBSsTLXVje5q1/04LA4nt2BodqEkJzpQBMZWbE R2VVs8ptcLp7BDM6NvEzJayTkXjbKBrZlSyeyAL3VkMdZZqgOYapHNMRNIHnCCnhTrsH 1FEhMI1meZSPuEosBjv/grQtR8/eaAqFIw3BEYUPVDW88IzSq6g60WdEqGmyQoaIiRNM S3opT2xffFYJCw7EuEEDjzmw31g0DAYOGyMDGkVoJUNIS78zfwwdLo6JAvdlQjXYWDaa MLRTZ9rPtybrZLbXiAdI0DpzuCPWK5LnLyYPkTxGyA01ZAvAikEbXaT8cdfREIza48n5 c7mA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:in-reply-to:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :dkim-signature; bh=7Hv8FYkIIgHaMpc0l6U71Q1YcuTc0hBo/riFkGviInU=; b=PW8XT8MlfQRdok22vrHpLSwbF80h7TSAPg8ccHfZYnc8fiY27W3qFTvh0oBP18d92W arQgSDRyRhNeL9WYUGwiWnI6bGotdin5XQttrMe1Uen5IyF5Qkyp8YpOFHsNbXz0d6ZN K+WtB4gw0n9RVH1T6gCDFdePt+Vl20WA85ssXZxIvMQSLS1JP1j56YtZz0Q3K706YQL2 Qnct2cpuhp0qhLRp20LSNl55C6a/nJUj3pxiUXZb0nbE36iqAAP/9eBQquqTrl2+9Fd7 7yHa/xkeVTm3gYO5KJQqSVmmLPVZ6N5GF8FEIXKiW5JpUBKQ54Dqy9kmpN4/YWVAg5Kr D2Pw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=KJUmanRl; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id m18si142926eja.298.2020.05.04.17.49.12; Mon, 04 May 2020 17:49:35 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=KJUmanRl; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726635AbgEEAro (ORCPT + 99 others); Mon, 4 May 2020 20:47:44 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:35942 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726421AbgEEArn (ORCPT ); Mon, 4 May 2020 20:47:43 -0400 Received: from mail-pg1-x543.google.com (mail-pg1-x543.google.com [IPv6:2607:f8b0:4864:20::543]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 583F6C061A0E for ; Mon, 4 May 2020 17:47:42 -0700 (PDT) Received: by mail-pg1-x543.google.com with SMTP id 207so240917pgc.6 for ; Mon, 04 May 2020 17:47:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=7Hv8FYkIIgHaMpc0l6U71Q1YcuTc0hBo/riFkGviInU=; b=KJUmanRldAExcvGsb+cJXKIjlry6iUvKhrhpaSsW+61QYX+JKgkpCPcDfiSENB81Ge FtZUU7BKWjLVrdRi1bpV/A0NV/mH3x4qvxhZ9lyOwaZprXHjonnPULIX83zneznlKTtF d86gXdwJqtx6OtdZ+j6z6kQ0BT6k/yqlVYmHSmi+Q9W5cJ+fWwlzUccCpKnIHmmBKAGg SN65OcK++Kid1hscv43XdcMETh2mUHg+9lETmWbMzPK9zWoNTb06UydiOJPzGpMYCllD HnjncwTxkVZBBIwwpuAxYjGLcj58ggeX6IBH1rBuxq1SpLYfqOM4txRL18im2qZIyDA4 7nIw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=7Hv8FYkIIgHaMpc0l6U71Q1YcuTc0hBo/riFkGviInU=; b=LFASv281IyvcVUUL41D+8y+ODjs5/bit8AM44bpvseqOdfyKsXNaI1BXD07XAvJVZd vfuekJ1W+pbXv5UJE1D0lPu++m5tdIYXYXqDwFlA/qBgF5oaeVq7Jn21ypt+zYYfM0LD 52FUZHJqKQutznj8vpiXb4Ft84l0bebX3DtuGPTH2xHJvYx1UejLw2Puz+LOI9ll1cSY w24Dafwr81YV3wgOfuucOVZg7jn4HdS4e7MiqVDcSmoA/T1CidZkGV6t7UEYhNRisH5o hJG1iSf926R5Wu7wuKa5YuKIDGnAPm2KRolfol6DaVApZNWnihlesc7yyJALkVHw5DTy g14A== X-Gm-Message-State: AGi0PuYaQ72CfSOnBzfqR2wCv3q3edzhvvwA5K0uYuP2kHdCT16A3Ux7 WSbtwXKNcN/dII9X/imPCeGIDg== X-Received: by 2002:a63:5a41:: with SMTP id k1mr861073pgm.424.1588639661583; Mon, 04 May 2020 17:47:41 -0700 (PDT) Received: from google.com ([2620:15c:2ce:0:9efe:9f1:9267:2b27]) by smtp.gmail.com with ESMTPSA id i8sm269103pfq.126.2020.05.04.17.47.40 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 04 May 2020 17:47:40 -0700 (PDT) Date: Mon, 4 May 2020 17:47:38 -0700 From: Fangrui Song To: Sedat Dilek , Nick Desaulniers Cc: Masahiro Yamada , Michal Marek , Andrew Morton , Changbin Du , Randy Dunlap , Krzysztof Kozlowski , linux-kbuild@vger.kernel.org, linux-kernel@vger.kernel.org, Clang-Built-Linux ML Subject: Re: [PATCH] Makefile: support compressed debug info Message-ID: <20200505004738.ew2lcp27c2n4jqia@google.com> References: <20200504031340.7103-1-nick.desaulniers@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2020-05-04, Sedat Dilek wrote: >On Mon, May 4, 2020 at 5:13 AM Nick Desaulniers > wrote: >> >> As debug information gets larger and larger, it helps significantly save >> the size of vmlinux images to compress the information in the debug >> information sections. Note: this debug info is typically split off from >> the final compressed kernel image, which is why vmlinux is what's used >> in conjunction with GDB. Minimizing the debug info size should have no >> impact on boot times, or final compressed kernel image size. >> >> All of the debug sections will have a `C` flag set. >> $ readelf -S >> >> $ bloaty vmlinux.gcc75.compressed.dwarf4 -- \ >> vmlinux.gcc75.uncompressed.dwarf4 >> >> FILE SIZE VM SIZE >> -------------- -------------- >> +0.0% +18 [ = ] 0 [Unmapped] >> -73.3% -114Ki [ = ] 0 .debug_aranges >> -76.2% -2.01Mi [ = ] 0 .debug_frame >> -73.6% -2.89Mi [ = ] 0 .debug_str >> -80.7% -4.66Mi [ = ] 0 .debug_abbrev >> -82.9% -4.88Mi [ = ] 0 .debug_ranges >> -70.5% -9.04Mi [ = ] 0 .debug_line >> -79.3% -10.9Mi [ = ] 0 .debug_loc >> -39.5% -88.6Mi [ = ] 0 .debug_info >> -18.2% -123Mi [ = ] 0 TOTAL >> >> $ bloaty vmlinux.clang11.compressed.dwarf4 -- \ >> vmlinux.clang11.uncompressed.dwarf4 >> >> FILE SIZE VM SIZE >> -------------- -------------- >> +0.0% +23 [ = ] 0 [Unmapped] >> -65.6% -871 [ = ] 0 .debug_aranges >> -77.4% -1.84Mi [ = ] 0 .debug_frame >> -82.9% -2.33Mi [ = ] 0 .debug_abbrev >> -73.1% -2.43Mi [ = ] 0 .debug_str >> -84.8% -3.07Mi [ = ] 0 .debug_ranges >> -65.9% -8.62Mi [ = ] 0 .debug_line >> -86.2% -40.0Mi [ = ] 0 .debug_loc >> -42.0% -64.1Mi [ = ] 0 .debug_info >> -22.1% -122Mi [ = ] 0 TOTAL >> > >Hi Nick, > >thanks for the patch. > >I have slightly modified it to adapt to Linux v5.7-rc4 (what was your base?). > >Which linker did you use and has it an impact if you switch from >ld.bfd to ld.lld? lld has supported the linker option --compress-debug-sections=zlib since about 5.0.0 (https://reviews.llvm.org/D31941) >I tried a first normal run and in a 2nd one with >CONFIG_DEBUG_INFO_COMPRESSED=y both with clang-10 and ld.lld-10. > >My numbers (sizes in MiB): > >[ diffconfig ] > >$ scripts/diffconfig /boot/config-5.7.0-rc4-1-amd64-clang >/boot/config-5.7.0-rc4-2-amd64-clang > BUILD_SALT "5.7.0-rc4-1-amd64-clang" -> "5.7.0-rc4-2-amd64-clang" >+DEBUG_INFO_COMPRESSED y > >[ compiler and linker ] > >$ clang-10 -v >ClangBuiltLinux clang version 10.0.1 >(https://github.com/llvm/llvm-project >92d5c1be9ee93850c0a8903f05f36a23ee835dc2) >Target: x86_64-unknown-linux-gnu >Thread model: posix >InstalledDir: /home/dileks/src/llvm-toolchain/install/bin >Found candidate GCC installation: /usr/lib/gcc/x86_64-linux-gnu/10 >Found candidate GCC installation: /usr/lib/gcc/x86_64-linux-gnu/8 >Found candidate GCC installation: /usr/lib/gcc/x86_64-linux-gnu/9 >Selected GCC installation: /usr/lib/gcc/x86_64-linux-gnu/10 >Candidate multilib: .;@m64 >Candidate multilib: 32;@m32 >Candidate multilib: x32;@mx32 >Selected multilib: .;@m64 > >$ ld.lld-10 -v >LLD 10.0.1 (https://github.com/llvm/llvm-project >92d5c1be9ee93850c0a8903f05f36a23ee835dc2) (compatible with GNU >linkers) > >[ sizes vmlinux ] > >$ du -m 5.7.0-rc4-*/vmlinux* >409 5.7.0-rc4-1-amd64-clang/vmlinux >7 5.7.0-rc4-1-amd64-clang/vmlinux.compressed >404 5.7.0-rc4-1-amd64-clang/vmlinux.o >324 5.7.0-rc4-2-amd64-clang/vmlinux >7 5.7.0-rc4-2-amd64-clang/vmlinux.compressed >299 5.7.0-rc4-2-amd64-clang/vmlinux.o > >[ readelf (.debug_info as example) ] > >$ readelf -S vmlinux.o > [33] .debug_info PROGBITS 0000000000000000 01d6a5e8 > 0000000006be1ee6 0000000000000000 0 0 1 > >$ readelf -S vmlinux.o > [33] .debug_info PROGBITS 0000000000000000 01749f18 > 0000000002ef04d2 0000000000000000 C 0 0 1 <--- >XXX: "C (compressed)" Flag > >Key to Flags: > W (write), A (alloc), X (execute), M (merge), S (strings), I (info), > L (link order), O (extra OS processing required), G (group), T (TLS), > C (compressed), x (unknown), o (OS specific), E (exclude), > l (large), p (processor specific) > >[ sizes linux-image debian packages ] > >$ du -m 5.7.0-rc4-*/linux-image*.deb >47 5.7.0-rc4-1-amd64-clang/linux-image-5.7.0-rc4-1-amd64-clang_5.7.0~rc4-1~bullseye+dileks1_amd64.deb >424 5.7.0-rc4-1-amd64-clang/linux-image-5.7.0-rc4-1-amd64-clang-dbg_5.7.0~rc4-1~bullseye+dileks1_amd64.deb >47 5.7.0-rc4-2-amd64-clang/linux-image-5.7.0-rc4-2-amd64-clang_5.7.0~rc4-2~bullseye+dileks1_amd64.deb >771 5.7.0-rc4-2-amd64-clang/linux-image-5.7.0-rc4-2-amd64-clang-dbg_5.7.0~rc4-2~bullseye+dileks1_amd64.deb > >[ sizes linux-git dir (compilation finished ] > >5.7.0-rc4-1-amd64-clang: 17963 /home/dileks/src/linux-kernel/linux >5.7.0-rc4-2-amd64-clang: 14328 /home/dileks/src/linux-kernel/linux > >[ xz compressed linux-image-dbg packages ] > >$ file linux-image-5.7.0-rc4-1-amd64-clang-dbg_5.7.0~rc4-1~bullseye+dileks1_amd64.deb >linux-image-5.7.0-rc4-1-amd64-clang-dbg_5.7.0~rc4-1~bullseye+dileks1_amd64.deb: >Debian binary package (format 2.0), with control.tar.xz, data >compression xz >$ file linux-image-5.7.0-rc4-2-amd64-clang-dbg_5.7.0~rc4-2~bullseye+dileks1_amd64.deb >linux-image-5.7.0-rc4-2-amd64-clang-dbg_5.7.0~rc4-2~bullseye+dileks1_amd64.deb: >Debian binary package (format 2.0), with control.tar.xz, data >compression xz > >[ file-lists ] > >$ dpkg --contents >linux-image-5.7.0-rc4-1-amd64-clang-dbg_5.7.0~rc4-1~bullseye+dileks1_amd64.deb >| wc -l >4395 >$ dpkg --contents >linux-image-5.7.0-rc4-2-amd64-clang-dbg_5.7.0~rc4-2~bullseye+dileks1_amd64.deb >| wc -l >4395 > >[ file-lists vmlinux ] > >$ dpkg --contents >linux-image-5.7.0-rc4-1-amd64-clang-dbg_5.7.0~rc4-1~bullseye+dileks1_amd64.deb >| grep vmlinux >-rwxr-xr-x root/root 428588312 2020-05-04 06:15 >./usr/lib/debug/lib/modules/5.7.0-rc4-1-amd64-clang/vmlinux >lrwxrwxrwx root/root 0 2020-05-04 06:15 >./usr/lib/debug/boot/vmlinux-5.7.0-rc4-1-amd64-clang -> >../lib/modules/5.7.0-rc4-1-amd64-clang/vmlinux >lrwxrwxrwx root/root 0 2020-05-04 06:15 >./usr/lib/debug/vmlinux-5.7.0-rc4-1-amd64-clang -> >lib/modules/5.7.0-rc4-1-amd64-clang/vmlinux > >$ dpkg --contents >linux-image-5.7.0-rc4-2-amd64-clang-dbg_5.7.0~rc4-2~bullseye+dileks1_amd64.deb >| grep vmlinux >-rwxr-xr-x root/root 339341456 2020-05-04 12:24 >./usr/lib/debug/lib/modules/5.7.0-rc4-2-amd64-clang/vmlinux >lrwxrwxrwx root/root 0 2020-05-04 12:24 >./usr/lib/debug/boot/vmlinux-5.7.0-rc4-2-amd64-clang -> >../lib/modules/5.7.0-rc4-2-amd64-clang/vmlinux >lrwxrwxrwx root/root 0 2020-05-04 12:24 >./usr/lib/debug/vmlinux-5.7.0-rc4-2-amd64-clang -> >lib/modules/5.7.0-rc4-2-amd64-clang/vmlinux > >[ conclusion ] > >As you can see there is a size-reduction in case of vmlinux/vmlinux.o >(debug) files... >...and my linux-git directory in total is smaller: 17963M vs. 14328M. > >But the resulting linux-image-dbg file is much fatter: 424M vs. 711M. >XZ-compressing the gz/zlib-compressed vmlinux (debug) file results in >a fatter linux-image-dbg package. > >For a usage of vmlinux (debug) in a VM scenario this might be nice but >seen from a debian repository perspective not. > >For the sake of completeness: I have just installed and booted the >"normal" linux-image debian package - not the debug packages. > >Thanks. > >Regards, >- Sedat - > >> Suggested-by: David Blaikie >> Signed-off-by: Nick Desaulniers >> --- >> Makefile | 5 +++++ >> lib/Kconfig.debug | 9 +++++++++ >> 2 files changed, 14 insertions(+) >> >> diff --git a/Makefile b/Makefile >> index 981eb902384b..313a054e5dc6 100644 >> --- a/Makefile >> +++ b/Makefile >> @@ -825,6 +825,11 @@ ifdef CONFIG_DEBUG_INFO_REDUCED >> DEBUG_CFLAGS += $(call cc-option, -femit-struct-debug-baseonly) \ >> $(call cc-option,-fno-var-tracking) >> endif >> + >> +ifdef CONFIG_DEBUG_INFO_COMPRESSED >> +DEBUG_CFLAGS += -gz=zlib >> +KBUILD_LDFLAGS += --compress-debug-sections=zlib >> +endif >> endif >> >> KBUILD_CFLAGS += $(DEBUG_CFLAGS) >> diff --git a/lib/Kconfig.debug b/lib/Kconfig.debug >> index f6f9a039f736..1f4a47ba6c1b 100644 >> --- a/lib/Kconfig.debug >> +++ b/lib/Kconfig.debug >> @@ -213,6 +213,15 @@ config DEBUG_INFO_REDUCED >> DEBUG_INFO build and compile times are reduced too. >> Only works with newer gcc versions. >> >> +config DEBUG_INFO_COMPRESSED >> + bool "Compressed debugging information" >> + depends on DEBUG_INFO >> + depends on $(cc-option,-gz=zlib) >> + depends on $(ld-option,--compress-debug-sections=zlib) >> + help >> + Compress the debug information using zlib. Requires GCC 5.0+ or Clang >> + 5.0+. >> + linker option --compress-debug-sections=zlib require binutils >= 2.26 (ld-option) Assembler option --compress-debug-sections=zlib also require binutils >= 2.26 (cc-option,-gz=zlib) >> config DEBUG_INFO_SPLIT >> bool "Produce split debuginfo in .dwo files" >> depends on DEBUG_INFO >> -- >> 2.17.1 >> >> -- >> You received this message because you are subscribed to the Google Groups "Clang Built Linux" group. >> To unsubscribe from this group and stop receiving emails from it, send an email to clang-built-linux+unsubscribe@googlegroups.com. >> To view this discussion on the web visit https://groups.google.com/d/msgid/clang-built-linux/20200504031340.7103-1-nick.desaulniers%40gmail.com. > >-- >You received this message because you are subscribed to the Google Groups "Clang Built Linux" group. >To unsubscribe from this group and stop receiving emails from it, send an email to clang-built-linux+unsubscribe@googlegroups.com. >To view this discussion on the web visit https://groups.google.com/d/msgid/clang-built-linux/CA%2BicZUUOaqeKeh6n4BJq2k6XQWAfNghUj57j42ZX5qyd3iOmLw%40mail.gmail.com.