Received: by 2002:a25:31c3:0:0:0:0:0 with SMTP id x186csp6347611ybx; Mon, 11 Nov 2019 07:47:21 -0800 (PST) X-Google-Smtp-Source: APXvYqz8u+k4kB5rTw0hims/gEBbZzdmJPBziTHWUUWbPnGlE5ysy5m8fiAkEHukOUFUEe5fOXfa X-Received: by 2002:a17:906:80c:: with SMTP id e12mr23760707ejd.59.1573487241774; Mon, 11 Nov 2019 07:47:21 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1573487241; cv=none; d=google.com; s=arc-20160816; b=bMIVJUySEjUxACEy7wJghe2ttCgd7OjoK2ItomqY6WYY8+bWBDLjXwCeuuwHRFNWET pMvitjU75bNjBVA5BnffZm5M1sIsDmc8sTETbERTQrIbSFfkYIFlYJx0gQLTGTZaJv+C QOnHghnxs2965bvlu4I5eBSraKpH4ubpo4z3uSJT0uV4fimy4ExiJUh42b2ReDi1w6x5 p6DU4noDzHahqQlIBAKtpoyPgJ7BzLOBH9M33eOnCLzaAhPKY/QgGNaupTGBKq9lH/pB J4acioEyxtG+IpMhxesfwYugdTOJIugY0n4T502epQJD41AGf0Bq6AKtMAhvyec4IBq1 XaqQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-disposition :content-transfer-encoding:user-agent:in-reply-to:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=4hvCDZXTCZ2nFUfV3XkZPxJrmWvqepgR/qG1xYdpL+8=; b=rwxGMQssd11sBT45aFI1LDDD31WaPDC2iEf0NdqW6ZFvIVhVG3ffYj2AHW3rVNQmBQ BsEAzvzFTdWNzmYkcakPPX83JYNk1lsp1mNVR5aB4XHFdi2voUV2HhqWoj6K2Zt9bbZs MQbnjKTUCrgrWFor21s16+JfEr6dTbpYFJu8CAzDpKl61bzJJeOlVZO6aXfRwjjZHi+r jp/JRPaVnJMB4kHH3d+upK61W0dUdiiHkGLTLE86dcf2kRC1IvQ08fBp8/QK0cYKB7Oe ZWitOwk3uWfJIHDZLx9ty0HdSPCQUViAso8CsRFBByQLiBy3+7a86jdNqJWeFy5drbME mRDA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=UiDUPE6I; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id z4si14114198edi.38.2019.11.11.07.46.57; Mon, 11 Nov 2019 07:47:21 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=UiDUPE6I; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726932AbfKKPqY (ORCPT + 99 others); Mon, 11 Nov 2019 10:46:24 -0500 Received: from us-smtp-1.mimecast.com ([205.139.110.61]:59223 "EHLO us-smtp-1.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726877AbfKKPqY (ORCPT ); Mon, 11 Nov 2019 10:46:24 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1573487182; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4hvCDZXTCZ2nFUfV3XkZPxJrmWvqepgR/qG1xYdpL+8=; b=UiDUPE6Ijpc8GWtx1GLEbZhcNX2bWMauLsKOlh2gU1r1Ie5cS1JlqYVX6xHzL/bCgoC4u4 F10o+8SSswOOaM9qYFXPQUOcihy/1MjsDnQCxug3NOax15fjSKJ8bkFcwJ93fiDNb4ZXYY tmtkuhWlnIz/eey/WdSdjpG6wOk15H4= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-8-lM4pYcv4POCpGf9ctL-qDg-1; Mon, 11 Nov 2019 10:46:16 -0500 Received: from smtp.corp.redhat.com (int-mx05.intmail.prod.int.phx2.redhat.com [10.5.11.15]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id BBF8818B9F82; Mon, 11 Nov 2019 15:46:14 +0000 (UTC) Received: from krava (unknown [10.40.205.88]) by smtp.corp.redhat.com (Postfix) with SMTP id 210C05D6D4; Mon, 11 Nov 2019 15:46:12 +0000 (UTC) Date: Mon, 11 Nov 2019 16:46:12 +0100 From: Jiri Olsa To: Alexey Budankov Cc: Arnaldo Carvalho de Melo , Peter Zijlstra , Ingo Molnar , Alexander Shishkin , Namhyung Kim , Andi Kleen , linux-kernel Subject: Re: [RFC] perf session: Fix compression processing Message-ID: <20191111154612.GC26980@krava> References: <20191103222441.GE8251@krava> <20191111145640.GB26980@krava> <69782f54-f5f5-f89f-9c8d-172d4de331d0@linux.intel.com> MIME-Version: 1.0 In-Reply-To: <69782f54-f5f5-f89f-9c8d-172d4de331d0@linux.intel.com> User-Agent: Mutt/1.12.1 (2019-06-15) X-Scanned-By: MIMEDefang 2.79 on 10.5.11.15 X-MC-Unique: lM4pYcv4POCpGf9ctL-qDg-1 X-Mimecast-Spam-Score: 0 Content-Type: text/plain; charset=WINDOWS-1252 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Nov 11, 2019 at 06:41:47PM +0300, Alexey Budankov wrote: > On 11.11.2019 17:56, Jiri Olsa wrote: > > On Mon, Nov 11, 2019 at 05:38:49PM +0300, Alexey Budankov wrote: > >> > >> On 04.11.2019 1:24, Jiri Olsa wrote: > >>> hi, > >> > >>> --- > >>> The compressed data processing occasionally fails with: > >>> $ perf report --stdio -vv > >>> decomp (B): 44519 to 163000 > >>> decomp (B): 48119 to 174800 > >>> decomp (B): 65527 to 131072 > >>> fetch_mmaped_event: head=3D0x1ffe0 event->header_size=3D0x28, mmap_= size=3D0x20000: fuzzed perf.data? > >>> Error: > >>> failed to process sample > >>> ... > >>> > >>> It's caused by recent fuzzer fix that does not take into account > >>> that compressed data do not need to by fully present in the buffer, > >>> so it's ok to just return NULL and not to fail. > >>> > >>> Fixes: 57fc032ad643 ("perf session: Avoid infinite loop when seeing i= nvalid header.size") > >>> Link: http://lkml.kernel.org/n/tip-q1biqscs4stcmc9bs1iokfro@git.kerne= l.org > >>> Signed-off-by: Jiri Olsa > >>> --- > >>> tools/perf/util/session.c | 8 +++++--- > >>> 1 file changed, 5 insertions(+), 3 deletions(-) > >>> > >>> diff --git a/tools/perf/util/session.c b/tools/perf/util/session.c > >>> index f07b8ecb91bc..3589ed14a629 100644 > >>> --- a/tools/perf/util/session.c > >>> +++ b/tools/perf/util/session.c > >>> @@ -1959,7 +1959,7 @@ static int __perf_session__process_pipe_events(= struct perf_session *session) > >>> =20 > >>> static union perf_event * > >>> fetch_mmaped_event(struct perf_session *session, > >>> -=09=09 u64 head, size_t mmap_size, char *buf) > >>> +=09=09 u64 head, size_t mmap_size, char *buf, bool decomp) > >> > >> bools in interface make code less transparent. > >> > >>> { > >>> =09union perf_event *event; > >>> =20 > >>> @@ -1979,6 +1979,8 @@ fetch_mmaped_event(struct perf_session *session= , > >>> =09=09/* We're not fetching the event so swap back again */ > >>> =09=09if (session->header.needs_swap) > >>> =09=09=09perf_event_header__bswap(&event->header); > >>> +=09=09if (decomp) > >>> +=09=09=09return NULL; > >>> =09=09pr_debug("%s: head=3D%#" PRIx64 " event->header_size=3D%#x, mm= ap_size=3D%#zx: fuzzed perf.data?\n", > >>> =09=09=09 __func__, head, event->header.size, mmap_size); > >>> =09=09return ERR_PTR(-EINVAL); > >>> @@ -1997,7 +1999,7 @@ static int __perf_session__process_decomp_event= s(struct perf_session *session) > >>> =09=09return 0; > >>> =20 > >>> =09while (decomp->head < decomp->size && !session_done()) { > >>> -=09=09union perf_event *event =3D fetch_mmaped_event(session, decomp= ->head, decomp->size, decomp->data); > >>> +=09=09union perf_event *event =3D fetch_mmaped_event(session, decomp= ->head, decomp->size, decomp->data, true); > >> > >> It looks like this call can be skipped, at all, in this case. > >=20 > > not sure what you mean, we are in decomp code no? >=20 > Ok, it is inside "not fetching" branch.=20 > NULL return value means to proceed getting further over the trace. > Checking record type =3D=3D COMPRESSED at the higher level could=20 > probably be cleaner fix and also work faster. any chance you could post the fix? the patch I did was a quick fix to get the feature working for presentation ;-) you're probably thinking of the proper approach thanks, jirka