Received: by 2002:a05:6a10:1287:0:0:0:0 with SMTP id d7csp4269875pxv; Tue, 27 Jul 2021 03:12:34 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwpVXBuNNsm829hXA363DGyktcZPCb6WNVdLMaBM3HqOaKn5FHHbR1w2UBpCVIOWcOPuopv X-Received: by 2002:a5d:8456:: with SMTP id w22mr19002973ior.63.1627380754731; Tue, 27 Jul 2021 03:12:34 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1627380754; cv=none; d=google.com; s=arc-20160816; b=xLSnVXxoFWN6iilaBP6zehDMum8wZ2e2NP0As3HDsWwLvCgoSrf0898vHgfmdma7OR PC1O0VX/DBHTMxW1NpLcH5VFsDPNo81WwLEz2T0WMPSY8iGJynGK5JeWAYv4DRrphVfo ZdHQNlXeGgafxt/+IFtq87Qx7Vr4EUkrlDM0cOp8WTlldadya4O0ZoLOiPMjKK/qkGIK F3hoE5+xmcqC8fp5vzfSBOzPa/FHapoYjDQy1rsuNmWSV7avG2qG2nTaXElQN0nhqubi 0sEJK5xLQ5Az6A1Y1/hNC+5iHg2GtqYmpalH8XgcVZTVl8uKRITVyTKZEHOrdmJzkgUn QzOQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:message-id:date:subject:cc:to:from; bh=Jh0vBhG8PXsRSz5rnIHIDpgcA47l26X6Gd9R7ke02hQ=; b=jmoUusOv7Dbr8cAOCl4kxRk6rsFusRKgjf7TLbrQ7GP3UmpHoHix3BTJ59pTtz1j7c V9+5spOFUTry1XP3eNAs8T8L7MHiUvQXWFkEwk81FtCU3V5mf4uJZkH3AePJ3ZWcVlkb Ti6/PGicAQqoWnRNJBaBNumDisLm4+8uyeI7LAY9qD+/gNlxpclX8jvUkU7moeEqqNdk 9vwdikd/ONYiQmtYVke5NDroXeGbaWGhIG8v/BJGAmTdeAwcS0WHotKA7J6Ovy1TltLD yy3Zl1E647yK+VmzpSUXwIOtLsWE2Dnxv+Wvl/lFwtRNk/5zHYodkbejEzFPZrfYPBor C0JQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=mediatek.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id n13si2887244ioj.25.2021.07.27.03.12.23; Tue, 27 Jul 2021 03:12:34 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=mediatek.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S236226AbhG0KLc (ORCPT + 99 others); Tue, 27 Jul 2021 06:11:32 -0400 Received: from mailgw02.mediatek.com ([210.61.82.184]:43298 "EHLO mailgw02.mediatek.com" rhost-flags-OK-FAIL-OK-FAIL) by vger.kernel.org with ESMTP id S236103AbhG0KL2 (ORCPT ); Tue, 27 Jul 2021 06:11:28 -0400 X-UUID: a3a82cdf03284d71a076b33bff398ab0-20210727 X-UUID: a3a82cdf03284d71a076b33bff398ab0-20210727 Received: from mtkmbs10n1.mediatek.inc [(172.21.101.34)] by mailgw02.mediatek.com (envelope-from ) (Generic MTA with TLSv1.2 ECDHE-RSA-AES256-GCM-SHA384 256/256) with ESMTP id 1012851737; Tue, 27 Jul 2021 18:11:27 +0800 Received: from mtkcas07.mediatek.inc (172.21.101.84) by mtkmbs02n2.mediatek.inc (172.21.101.101) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Tue, 27 Jul 2021 18:11:25 +0800 Received: from localhost.localdomain (10.17.3.153) by mtkcas07.mediatek.inc (172.21.101.73) with Microsoft SMTP Server id 15.0.1497.2 via Frontend Transport; Tue, 27 Jul 2021 18:11:23 +0800 From: Yunfei Dong To: Yunfei Dong , Alexandre Courbot , Hans Verkuil , Tzung-Bi Shih , Tiffany Lin , Andrew-CT Chen , Mauro Carvalho Chehab , Rob Herring , Matthias Brugger , Tomasz Figa CC: Hsin-Yi Wang , Fritz Koenig , Irui Wang , , , , , , , Subject: [PATCH v3, 00/15] Using component framework to support multi hardware decode Date: Tue, 27 Jul 2021 18:10:36 +0800 Message-ID: <20210727101051.24418-1-yunfei.dong@mediatek.com> X-Mailer: git-send-email 2.18.0 MIME-Version: 1.0 Content-Type: text/plain X-MTK: N Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This series adds support for multi hardware decode into mtk-vcodec, by first adding component framework to manage each hardware information: interrupt, clock, register bases and power. Secondly add core thread to deal with core hardware message, at the same time, add msg queue for different hardware share messages. Lastly, the architecture of different specs are not the same, using specs type to separate them. This series has been tested with both MT8183 and MT8173. Decoding was working for both chips. Patches 1,2 rewrite get register bases and power on/off interface. Patch 3-5 add component framework to support multi hardware. Patches 6-14 add interfaces to support core hardware. ---- This patch dependents on "media: mtk-vcodec: support for MT8183 decoder"[1]. Multi hardware decode is based on stateless decoder, MT8183 is the first time to add stateless decoder. Otherwise it will cause conflict. Please also accept this patch together with [1]. [1]https://lore.kernel.org/patchwork/project/lkml/list/?series=507084 ---- Changes compared with v2: - Fix return value for patch 1/15 - Add this new patch to align vdec and venc wake up ctx interface for patch 2/15 - Fix comments for patch 4/15 - Change txt files to yaml for patch 5/15 - Generalize wake up ctx interface for stateless and stateful decode for patch 7/15 - Add document for structs and functions for patch 8/15 - Add condition to check the return value of kthread_run for patch 11/15 - Fix yaml check fail for patch 13/15 Changes compared with v1: - Fix many comments for patch 3/14 - Remove unnecessary code for patch 4/14 - Using enum mtk_vdec_hw_count instead of magic numbers for patch 6/14 - Reconstructed get/put lat buffer for lat and core hardware for patch 7/14 - Using yaml format to instead of txt file for patch 12/14 Yunfei Dong (15): media: mtk-vcodec: Get numbers of register bases from DT media: mtk-vcodec: Align vcodec wake up interrupt interface media: mtk-vcodec: Refactor vcodec pm interface media: mtk-vcodec: Use component framework to manage each hardware information dt-bindings: media: mtk-vcodec: Separate video encoder and decoder dt-bindings media: mtk-vcodec: Use pure single core for MT8183 media: mtk-vcodec: Add irq interface for multi hardware media: mtk-vcodec: Add msg queue feature for lat and core architecture media: mtk-vcodec: Generalize power and clock on/off interfaces media: mtk-vcodec: Add new interface to lock different hardware media: mtk-vcodec: Add core thread media: mtk-vcodec: Support 34bits dma address for vdec dt-bindings: media: mtk-vcodec: Adds decoder dt-bindings for mt8192 media: mtk-vcodec: Add core dec and dec end ipi msg media: mtk-vcodec: Use codec type to separate different hardware .../media/mediatek,vcodec-comp-decoder.yaml | 154 +++++++++ .../media/mediatek,vcodec-decoder.yaml | 138 ++++++++ .../media/mediatek,vcodec-encoder.yaml | 128 ++++++++ .../bindings/media/mediatek-vcodec.txt | 130 -------- drivers/media/platform/mtk-vcodec/Makefile | 2 + .../platform/mtk-vcodec/mtk_vcodec_dec.c | 4 +- .../platform/mtk-vcodec/mtk_vcodec_dec.h | 1 + .../platform/mtk-vcodec/mtk_vcodec_dec_drv.c | 296 +++++++++++++++--- .../platform/mtk-vcodec/mtk_vcodec_dec_hw.c | 184 +++++++++++ .../platform/mtk-vcodec/mtk_vcodec_dec_hw.h | 48 +++ .../platform/mtk-vcodec/mtk_vcodec_dec_pm.c | 98 ++++-- .../platform/mtk-vcodec/mtk_vcodec_dec_pm.h | 13 +- .../mtk-vcodec/mtk_vcodec_dec_stateful.c | 1 + .../mtk-vcodec/mtk_vcodec_dec_stateless.c | 1 + .../platform/mtk-vcodec/mtk_vcodec_drv.h | 76 ++++- .../platform/mtk-vcodec/mtk_vcodec_enc_drv.c | 12 +- .../platform/mtk-vcodec/mtk_vcodec_enc_pm.c | 1 - .../platform/mtk-vcodec/mtk_vcodec_intr.c | 27 +- .../platform/mtk-vcodec/mtk_vcodec_intr.h | 4 +- .../platform/mtk-vcodec/mtk_vcodec_util.c | 87 ++++- .../platform/mtk-vcodec/mtk_vcodec_util.h | 8 +- .../platform/mtk-vcodec/vdec/vdec_h264_if.c | 2 +- .../mtk-vcodec/vdec/vdec_h264_req_if.c | 2 +- .../platform/mtk-vcodec/vdec/vdec_vp8_if.c | 2 +- .../platform/mtk-vcodec/vdec/vdec_vp9_if.c | 2 +- .../media/platform/mtk-vcodec/vdec_drv_if.c | 21 +- .../media/platform/mtk-vcodec/vdec_ipi_msg.h | 16 +- .../platform/mtk-vcodec/vdec_msg_queue.c | 290 +++++++++++++++++ .../platform/mtk-vcodec/vdec_msg_queue.h | 157 ++++++++++ .../media/platform/mtk-vcodec/vdec_vpu_if.c | 46 ++- .../media/platform/mtk-vcodec/vdec_vpu_if.h | 22 ++ .../platform/mtk-vcodec/venc/venc_h264_if.c | 2 +- .../platform/mtk-vcodec/venc/venc_vp8_if.c | 2 +- 33 files changed, 1697 insertions(+), 280 deletions(-) create mode 100644 Documentation/devicetree/bindings/media/mediatek,vcodec-comp-decoder.yaml create mode 100644 Documentation/devicetree/bindings/media/mediatek,vcodec-decoder.yaml create mode 100644 Documentation/devicetree/bindings/media/mediatek,vcodec-encoder.yaml delete mode 100644 Documentation/devicetree/bindings/media/mediatek-vcodec.txt create mode 100644 drivers/media/platform/mtk-vcodec/mtk_vcodec_dec_hw.c create mode 100644 drivers/media/platform/mtk-vcodec/mtk_vcodec_dec_hw.h create mode 100644 drivers/media/platform/mtk-vcodec/vdec_msg_queue.c create mode 100644 drivers/media/platform/mtk-vcodec/vdec_msg_queue.h -- 2.25.1