Received: by 2002:a25:ad19:0:0:0:0:0 with SMTP id y25csp8015625ybi; Tue, 9 Jul 2019 07:49:41 -0700 (PDT) X-Google-Smtp-Source: APXvYqw5mIaIsAWAkKbMUPIoDyuDOInhw/L34qCZjOLU4Tj3v9A74x/R+xg9QfFF9iWAJDjl2j8m X-Received: by 2002:a17:90a:c68c:: with SMTP id n12mr510878pjt.29.1562683781249; Tue, 09 Jul 2019 07:49:41 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1562683781; cv=none; d=google.com; s=arc-20160816; b=I6CcTqop7hO3mX+yi3iyXiG+gDUzzpDzIwRg6S20+dqEVb6HGbe7pVO/T2sI7QRnX8 EtOPvhhQzU0nrTQ6DKWaVAg7BoVWl/dcInSfZNfT5xBC7wo1u2KBGF8/KRwJ5BXwlV26 ajf2l3J0niFg63vgi/AubS/BPR4aC6qmpzqLvI2SN/1Tw6yIGMv/97zwC/irooczpCyv m/u8yq+Ok4Vtuxe72spYktoB4csybGFSmc0UN1I0quINbbAHmsKQ2hDv+e1xSWHVYQQ1 FMYbEk05nq5Zqa1tKjk7wSQw5zcXUga+F9d3/p8yzgYauSFUdBl2I63FGyRcAblZFQiy Lh6g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:mime-version:user-agent:date:message-id :organization:subject:from:cc:to; bh=eExE7vgw+5iwxKSDAgn88S4BSmRinsbCHjxucvNyJw4=; b=eRWra82RbUoqT9VCSNM1giZvm9h/67RHVnO06/OWLFciq853CfMH6a9bMsi6qxBhL8 jMaiMl13K32i76ujQlY30s662PfgS8kk5GXzpMS1xIXkymWlnmdW/eHdHQZbEwFLvuVV 8Gdx4YWTmrbr1llS3vDJkSTthLRKtAmdrcsRGkI1jJ9Apm8JTpZ2pZKjWgiEguuYiG84 dp76c7KL2GIO+qLnwG3oDHT5damK4gA8ZLNfIByDl3FdDs0AyPnILp6qeFoU1HvA6xlr DHjDKMOhp0AymmBmu+RdRW0Cev07QCVaCam0zbdPEUv2tOGKD7HpVnphUdKCWna9U4CI jycQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id q24si15314785pls.7.2019.07.09.07.49.25; Tue, 09 Jul 2019 07:49:41 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726318AbfGIOsS (ORCPT + 99 others); Tue, 9 Jul 2019 10:48:18 -0400 Received: from mga17.intel.com ([192.55.52.151]:25410 "EHLO mga17.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726025AbfGIOsS (ORCPT ); Tue, 9 Jul 2019 10:48:18 -0400 X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga005.fm.intel.com ([10.253.24.32]) by fmsmga107.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 09 Jul 2019 07:48:17 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.63,470,1557212400"; d="scan'208";a="364159759" Received: from linux.intel.com ([10.54.29.200]) by fmsmga005.fm.intel.com with ESMTP; 09 Jul 2019 07:48:17 -0700 Received: from [10.125.252.233] (abudanko-mobl.ccr.corp.intel.com [10.125.252.233]) by linux.intel.com (Postfix) with ESMTP id 7012758046F; Tue, 9 Jul 2019 07:48:15 -0700 (PDT) To: Arnaldo Carvalho de Melo Cc: Jiri Olsa , Namhyung Kim , Alexander Shishkin , Peter Zijlstra , Ingo Molnar , Andi Kleen , linux-kernel From: Alexey Budankov Subject: [PATCH v1] perf session: fix loading of compressed data split across adjacent records Organization: Intel Corp. Message-ID: <4d839e1b-9c48-89c4-9702-a12217420611@linux.intel.com> Date: Tue, 9 Jul 2019 17:48:14 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.7.2 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Fix decompression failure found during the loading of compressed trace collected on larger scale systems (>48 cores). The error happened due to lack of decompression space for a mmaped buffer data chunk split across adjacent PERF_RECORD_COMPRESSED records. $ perf report -i bt.16384.data --stats failed to decompress (B): 63869 -> 0 : Destination buffer is too small user stack dump failure Can't parse sample, err = -14 0x2637e436 [0x4080]: failed to process type: 9 Error: failed to process sample $ perf test 71 71: Zstd perf.data compression/decompression : Ok Signed-off-by: Alexey Budankov --- tools/perf/util/session.c | 22 ++++++++++++++-------- tools/perf/util/session.h | 1 + tools/perf/util/zstd.c | 4 ++-- 3 files changed, 17 insertions(+), 10 deletions(-) diff --git a/tools/perf/util/session.c b/tools/perf/util/session.c index d0fd6c614e68..37efa1f43d8b 100644 --- a/tools/perf/util/session.c +++ b/tools/perf/util/session.c @@ -36,10 +36,16 @@ static int perf_session__process_compressed_event(struct perf_session *session, void *src; size_t decomp_size, src_size; u64 decomp_last_rem = 0; - size_t decomp_len = session->header.env.comp_mmap_len; + size_t mmap_len, decomp_len = session->header.env.comp_mmap_len; struct decomp *decomp, *decomp_last = session->decomp_last; - decomp = mmap(NULL, sizeof(struct decomp) + decomp_len, PROT_READ|PROT_WRITE, + if (decomp_last) { + decomp_last_rem = decomp_last->size - decomp_last->head; + decomp_len += decomp_last_rem; + } + + mmap_len = sizeof(struct decomp) + decomp_len; + decomp = mmap(NULL, mmap_len, PROT_READ|PROT_WRITE, MAP_ANONYMOUS|MAP_PRIVATE, -1, 0); if (decomp == MAP_FAILED) { pr_err("Couldn't allocate memory for decompression\n"); @@ -47,10 +53,10 @@ static int perf_session__process_compressed_event(struct perf_session *session, } decomp->file_pos = file_offset; + decomp->mmap_len = mmap_len; decomp->head = 0; - if (decomp_last) { - decomp_last_rem = decomp_last->size - decomp_last->head; + if (decomp_last_rem) { memcpy(decomp->data, &(decomp_last->data[decomp_last->head]), decomp_last_rem); decomp->size = decomp_last_rem; } @@ -61,7 +67,7 @@ static int perf_session__process_compressed_event(struct perf_session *session, decomp_size = zstd_decompress_stream(&(session->zstd_data), src, src_size, &(decomp->data[decomp_last_rem]), decomp_len - decomp_last_rem); if (!decomp_size) { - munmap(decomp, sizeof(struct decomp) + decomp_len); + munmap(decomp, mmap_len); pr_err("Couldn't decompress data\n"); return -1; } @@ -255,15 +261,15 @@ static void perf_session__delete_threads(struct perf_session *session) static void perf_session__release_decomp_events(struct perf_session *session) { struct decomp *next, *decomp; - size_t decomp_len; + size_t mmap_len; next = session->decomp; - decomp_len = session->header.env.comp_mmap_len; do { decomp = next; if (decomp == NULL) break; next = decomp->next; - munmap(decomp, decomp_len + sizeof(struct decomp)); + mmap_len = decomp->mmap_len; + munmap(decomp, mmap_len); } while (1); } diff --git a/tools/perf/util/session.h b/tools/perf/util/session.h index dd8920b745bc..863dbad87849 100644 --- a/tools/perf/util/session.h +++ b/tools/perf/util/session.h @@ -46,6 +46,7 @@ struct perf_session { struct decomp { struct decomp *next; u64 file_pos; + size_t mmap_len; u64 head; size_t size; char data[]; diff --git a/tools/perf/util/zstd.c b/tools/perf/util/zstd.c index 23bdb9884576..d2202392ffdb 100644 --- a/tools/perf/util/zstd.c +++ b/tools/perf/util/zstd.c @@ -99,8 +99,8 @@ size_t zstd_decompress_stream(struct zstd_data *data, void *src, size_t src_size while (input.pos < input.size) { ret = ZSTD_decompressStream(data->dstream, &output, &input); if (ZSTD_isError(ret)) { - pr_err("failed to decompress (B): %ld -> %ld : %s\n", - src_size, output.size, ZSTD_getErrorName(ret)); + pr_err("failed to decompress (B): %ld -> %ld, dst_size %ld : %s\n", + src_size, output.size, dst_size, ZSTD_getErrorName(ret)); break; } output.dst = dst + output.pos; -- 2.20.1