Received: by 2002:a5d:9c59:0:0:0:0:0 with SMTP id 25csp2180176iof; Tue, 7 Jun 2022 22:22:10 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzJ72R0DQT0tNR62Tb55cY3s9ZEF0PpE7sNH8mAnCsQDIzeA0NK5HElibN/Lv9sEa4mqwxT X-Received: by 2002:a17:902:da8b:b0:165:112b:b4e7 with SMTP id j11-20020a170902da8b00b00165112bb4e7mr32581438plx.85.1654665730351; Tue, 07 Jun 2022 22:22:10 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1654665730; cv=none; d=google.com; s=arc-20160816; b=EHHv9LzOBwaT786LXNK/i+ecW5YYt7vsjAQQ82Z5AzgwJlA1/1pOZveWk8v9lg/b4t Cdkj+5dcz8/Oo7EC31kc5EFpyxSGCgb3tpyFl0uw3X6bfL47h49pUumBKvq1w9zdv+iM h7sNL8+NK0DtjkPBqTjuTSsddKUoi5S1nl2myg5t9o5GCWshf4zCcB8Jv5Y6Dj6e9suz 45M/XdzDyMBENA2K3Zxi18hfXCcGpCuHXS/vO3hZmr8XNqmGBxs5WOU9HPzX8smvpiwN Hhr85rfuvmZ6oJrWOW7VzY79nvWngEL6A3kTqNyJu5IQ1+HVR7evEtoP4yioUJIpGvcu vGLQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :user-agent:references:in-reply-to:message-id:date:subject:cc:to :from:dkim-signature; bh=z9xC2N6nEdQTMC3utkaQ0ahXwilbDn/5Fb7oRP/Yauo=; b=j8fmlz0mpjAd6yy5Lu5pKAakco98in3wr6k1OAoc5diuIJMvE8RyiXjgqJ9D7GZ3KO tpoueNvgcs0dCnxUN9X3ZYYk2Fx3I897SJZ7z7Q+XBGrjvXm869VfNfyQCs69i8KdJXN RqagNyLnoD4pdqpqYAOtJLQMC8lkDx/VUsWXFxwr3h3T2IqyR3Sdk0M+SrboG8jeq9PY L81ynn+bm8yjZbjw7QbJjQPdaXTBs1Hlw+I8hhtAL8mEey+ciSjsbyRde89UObBf9bKw 6gkj+pnnqTSoolvK0WmRfw1++5iPZno+IO3xukzVHGnk1OFJ2YL46boZhu1YD/PChdoj O2gQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linuxfoundation.org header.s=korg header.b=CONORWZe; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linuxfoundation.org Return-Path: Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net. [23.128.96.19]) by mx.google.com with ESMTPS id 3-20020aa79203000000b0051871bf07bcsi24777199pfo.309.2022.06.07.22.22.09 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 07 Jun 2022 22:22:10 -0700 (PDT) Received-SPF: softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) client-ip=23.128.96.19; Authentication-Results: mx.google.com; dkim=pass header.i=@linuxfoundation.org header.s=korg header.b=CONORWZe; spf=softfail (google.com: domain of transitioning linux-kernel-owner@vger.kernel.org does not designate 23.128.96.19 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linuxfoundation.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id CA8D148278A; Tue, 7 Jun 2022 21:56:07 -0700 (PDT) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1354848AbiFGTND (ORCPT + 99 others); Tue, 7 Jun 2022 15:13:03 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:49228 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1352150AbiFGSZf (ORCPT ); Tue, 7 Jun 2022 14:25:35 -0400 Received: from ams.source.kernel.org (ams.source.kernel.org [IPv6:2604:1380:4601:e00::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id D0CAEEF050; Tue, 7 Jun 2022 10:54:43 -0700 (PDT) Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ams.source.kernel.org (Postfix) with ESMTPS id 585B6B82376; Tue, 7 Jun 2022 17:54:43 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id AE362C3411C; Tue, 7 Jun 2022 17:54:41 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=linuxfoundation.org; s=korg; t=1654624482; bh=rFUmO2eCpiuWmXjiSQBqGcHExDGAR+qKjNun3mFwazE=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=CONORWZeviQknHwnB2Bkhg6J21gvPsQ84sKMHqhOMkAjMQi5saEOHvNJlCbC9CJCn +NvkRpm5ESAmhcKq6TAo7dsoVjs/8xhv2wYCUV6kLuqyJMB8Eho+504xMwJuE6SzQ9 Hx/ETSLBKjnnQ1YaDFdtdgu8/i2+PVbVQLEaZ+I0= From: Greg Kroah-Hartman To: linux-kernel@vger.kernel.org Cc: Greg Kroah-Hartman , stable@vger.kernel.org, Nicolas Dufresne , Sebastian Fricke , Ezequiel Garcia , Hans Verkuil , Mauro Carvalho Chehab , Sasha Levin Subject: [PATCH 5.15 342/667] media: rkvdec: h264: Fix dpb_valid implementation Date: Tue, 7 Jun 2022 19:00:07 +0200 Message-Id: <20220607164945.018636763@linuxfoundation.org> X-Mailer: git-send-email 2.36.1 In-Reply-To: <20220607164934.766888869@linuxfoundation.org> References: <20220607164934.766888869@linuxfoundation.org> User-Agent: quilt/0.66 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-3.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RDNS_NONE,SPF_HELO_NONE,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Nicolas Dufresne [ Upstream commit 7ab889f09dfa70e8097ec1b9186fd228124112cb ] The ref builder only provided references that are marked as valid in the dpb. Thus the current implementation of dpb_valid would always set the flag to 1. This is not representing missing frames (this is called 'non-existing' pictures in the spec). In some context, these non-existing pictures still need to occupy a slot in the reference list according to the spec. Fixes: cd33c830448ba ("media: rkvdec: Add the rkvdec driver") Signed-off-by: Nicolas Dufresne Reviewed-by: Sebastian Fricke Reviewed-by: Ezequiel Garcia Signed-off-by: Hans Verkuil Signed-off-by: Mauro Carvalho Chehab Signed-off-by: Sasha Levin --- drivers/staging/media/rkvdec/rkvdec-h264.c | 33 ++++++++++++++++------ 1 file changed, 24 insertions(+), 9 deletions(-) diff --git a/drivers/staging/media/rkvdec/rkvdec-h264.c b/drivers/staging/media/rkvdec/rkvdec-h264.c index 951e19231da2..f5d8c6cb740b 100644 --- a/drivers/staging/media/rkvdec/rkvdec-h264.c +++ b/drivers/staging/media/rkvdec/rkvdec-h264.c @@ -112,6 +112,7 @@ struct rkvdec_h264_run { const struct v4l2_ctrl_h264_sps *sps; const struct v4l2_ctrl_h264_pps *pps; const struct v4l2_ctrl_h264_scaling_matrix *scaling_matrix; + int ref_buf_idx[V4L2_H264_NUM_DPB_ENTRIES]; }; struct rkvdec_h264_ctx { @@ -725,6 +726,26 @@ static void assemble_hw_pps(struct rkvdec_ctx *ctx, } } +static void lookup_ref_buf_idx(struct rkvdec_ctx *ctx, + struct rkvdec_h264_run *run) +{ + const struct v4l2_ctrl_h264_decode_params *dec_params = run->decode_params; + u32 i; + + for (i = 0; i < ARRAY_SIZE(dec_params->dpb); i++) { + struct v4l2_m2m_ctx *m2m_ctx = ctx->fh.m2m_ctx; + const struct v4l2_h264_dpb_entry *dpb = run->decode_params->dpb; + struct vb2_queue *cap_q = &m2m_ctx->cap_q_ctx.q; + int buf_idx = -1; + + if (dpb[i].flags & V4L2_H264_DPB_ENTRY_FLAG_ACTIVE) + buf_idx = vb2_find_timestamp(cap_q, + dpb[i].reference_ts, 0); + + run->ref_buf_idx[i] = buf_idx; + } +} + static void assemble_hw_rps(struct rkvdec_ctx *ctx, struct rkvdec_h264_run *run) { @@ -762,7 +783,7 @@ static void assemble_hw_rps(struct rkvdec_ctx *ctx, for (j = 0; j < RKVDEC_NUM_REFLIST; j++) { for (i = 0; i < h264_ctx->reflists.num_valid; i++) { - u8 dpb_valid = 0; + bool dpb_valid = run->ref_buf_idx[i] >= 0; u8 idx = 0; switch (j) { @@ -779,8 +800,6 @@ static void assemble_hw_rps(struct rkvdec_ctx *ctx, if (idx >= ARRAY_SIZE(dec_params->dpb)) continue; - dpb_valid = !!(dpb[idx].flags & - V4L2_H264_DPB_ENTRY_FLAG_ACTIVE); set_ps_field(hw_rps, DPB_INFO(i, j), idx | dpb_valid << 4); @@ -859,13 +878,8 @@ get_ref_buf(struct rkvdec_ctx *ctx, struct rkvdec_h264_run *run, unsigned int dpb_idx) { struct v4l2_m2m_ctx *m2m_ctx = ctx->fh.m2m_ctx; - const struct v4l2_h264_dpb_entry *dpb = run->decode_params->dpb; struct vb2_queue *cap_q = &m2m_ctx->cap_q_ctx.q; - int buf_idx = -1; - - if (dpb[dpb_idx].flags & V4L2_H264_DPB_ENTRY_FLAG_ACTIVE) - buf_idx = vb2_find_timestamp(cap_q, - dpb[dpb_idx].reference_ts, 0); + int buf_idx = run->ref_buf_idx[dpb_idx]; /* * If a DPB entry is unused or invalid, address of current destination @@ -1102,6 +1116,7 @@ static int rkvdec_h264_run(struct rkvdec_ctx *ctx) assemble_hw_scaling_list(ctx, &run); assemble_hw_pps(ctx, &run); + lookup_ref_buf_idx(ctx, &run); assemble_hw_rps(ctx, &run); config_registers(ctx, &run); -- 2.35.1