Received: by 2002:a05:6a10:1287:0:0:0:0 with SMTP id d7csp3480739pxv; Mon, 19 Jul 2021 00:48:22 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzstPY83ouB6l796QdwrxggS4YVSQPrVW0/uIE4BTbCjfenuKQQ2lDuoPuyGMHv30+KJl69 X-Received: by 2002:a17:906:70c9:: with SMTP id g9mr26231594ejk.286.1626680902245; Mon, 19 Jul 2021 00:48:22 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1626680902; cv=none; d=google.com; s=arc-20160816; b=cDea+4N9hNy5XQW3BkHsfjw+ECZIUCcH8UxqUgBHBi+L/znzcjh4gp4i8uxjJqU+ka kGViEp7Hcn152Vt9ETq8ctLIHs67CSZMwTOecaNJifwCU4y5k+Z+y//hTd9XqEkJWz+5 WltnmcOklOZzJEBNW5ILNaLFz91phWdbCH5AC442ZSTopBnDGWYil6Rg4Wcfy4l81cos mQLLZC9WRJRc4lk37xWUJQ89cC/vQw4j9tWi2vMgrR2qkiWjwE6+hxaoGaJb7IJRM0g0 TTfCqOfwI5lpwf8+BmTa5cSx9d5fx23NT8dFzet2AEaBcJHPyrlbOWC9GtbBHP2vYNxH /ujQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:message-id:date:subject:cc:to:from; bh=XiTPLHqoGXEkVkBFh+boWFgI18TFT7jrQFWoui9XUI4=; b=bQr2sEI/R+OPzkEOTJQS+eIxwwWY9EYXo9qLhlFeaZRyD2TgdKg9xsayGGbRJGez1x 3bWxBF42vBm+XT3p7vFjcJnoXp5AINgTe7KpG2Nb1VqXf42GRduB2Ql3putkyvpsjuUf Vf+tiXWnF4y32NSyrAnMbzbsg/Zhc//b5AjEk2hXAb6e5GX2WtjrHDcxCtvLs2FW077r FRFywitIzaHTLKA8Ey+6QXs4liYRXBjsNnrV2Ygoq63Gp/8Q9bBlNA7o8keMXLv4M7W0 YHLqr70H5DN5QB4/ZRGeRttIL1LhTjk2HwoQLeoQp/Fqbn5QYgP9uluOtdnlGHIqbSLt d+wQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=mediatek.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id x5si19452476ejf.530.2021.07.19.00.47.59; Mon, 19 Jul 2021 00:48:22 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=mediatek.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234971AbhGSHt4 (ORCPT + 99 others); Mon, 19 Jul 2021 03:49:56 -0400 Received: from mailgw01.mediatek.com ([60.244.123.138]:40148 "EHLO mailgw01.mediatek.com" rhost-flags-OK-FAIL-OK-FAIL) by vger.kernel.org with ESMTP id S233759AbhGSHtz (ORCPT ); Mon, 19 Jul 2021 03:49:55 -0400 X-UUID: 3a42733cb4ad473f98bebb6ef44fb039-20210719 X-UUID: 3a42733cb4ad473f98bebb6ef44fb039-20210719 Received: from mtkcas11.mediatek.inc [(172.21.101.40)] by mailgw01.mediatek.com (envelope-from ) (Generic MTA with TLSv1.2 ECDHE-RSA-AES256-SHA384 256/256) with ESMTP id 1223271936; Mon, 19 Jul 2021 15:46:53 +0800 Received: from mtkcas11.mediatek.inc (172.21.101.40) by mtkmbs06n2.mediatek.inc (172.21.101.130) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 19 Jul 2021 15:46:52 +0800 Received: from mtksdccf07.mediatek.inc (172.21.84.99) by mtkcas11.mediatek.inc (172.21.101.73) with Microsoft SMTP Server id 15.0.1497.2 via Frontend Transport; Mon, 19 Jul 2021 15:46:52 +0800 From: Moudy Ho To: , Mauro Carvalho Chehab , Rob Herring , Matthias Brugger , Hans Verkuil , Jernej Skrabec CC: Maoguang Meng , daoyuan huang , Ping-Hsun Wu , Geert Uytterhoeven , Rob Landley , Laurent Pinchart , , , , , , , , , , , , , , Subject: [PATCH v5 0/3] media: mediatek: support mdp3 on mt8183 platform Date: Mon, 19 Jul 2021 15:46:37 +0800 Message-ID: <20210719074640.25058-1-moudy.ho@mediatek.com> X-Mailer: git-send-email 2.18.0 MIME-Version: 1.0 Content-Type: text/plain X-MTK: N Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Changes since v4: - Rebase on v5.13-rc1. - Remove the CMDQ flush flow to match the CMDQ API change. - Integrate four of MDP's direct-link subcomponents into MDP controller node from syscon node to avoid illegal clock usage. - Rewrite dt-binding in a JSON compatible subset of YAML - Fix a bit of macro argument precedence. Changes since v3: - Rebase on v5.9-rc1. - modify code for review comment from Rob Herring, cancel multiple nodes using same register base situation. - control IOMMU port through pm runtime get/put to DMA components' device. - SCP(VPU) driver revision. - stop queuing jobs(remove flush_workqueue()) after mdp_m2m_release(). - add computation of plane address with data_offset. - fix scale ratio check issue. - add default v4l2_format setting. Changes since v2: - modify code for review comment from Tomasz Figa & Alexandre Courbot - review comment from Rob Herring will offer code revision in v4, due to it's related to device node modification, will need to modify code architecture Changes since v1: - modify code for CMDQ v3 API support - EC ipi cmd migration - fix compliance test fail item (m2m cmd with -f) due to there is two problem in runing all format(-f) cmd: 1. out of memory before test complete Due to capture buffer mmap (refcount + 1) after reqbuf but seems no corresponding munmap called before device close. There are total 12XX items(formats) in format test and each format alloc 8 capture/output buffers. 2. unceasingly captureBufs() (randomly) Seems the break statement didn't catch the count == 0 situation: In v4l2-test-buffers.cpp, function: captureBufs() ... count--; if (!node->is_m2m && !count) break; Log is as attachment I will paste the test result with problem part in another e-mail Hi, This is the first version of RFC patch for Media Data Path 3 (MDP3), MDP3 is used for scaling and color format conversion. support using GCE to write register in critical time limitation. support V4L2 m2m device control. Moudy Ho (3): dt-binding: mt8183: Add Mediatek MDP3 dt-bindings dts: arm64: mt8183: Add Mediatek MDP3 nodes media: platform: mtk-mdp3: Add Mediatek MDP3 driver .../bindings/media/mediatek-mdp3.yaml | 274 ++++ arch/arm64/boot/dts/mediatek/mt8183.dtsi | 114 ++ drivers/media/platform/Kconfig | 19 + drivers/media/platform/Makefile | 2 + drivers/media/platform/mtk-mdp3/Makefile | 7 + drivers/media/platform/mtk-mdp3/isp_reg.h | 37 + .../media/platform/mtk-mdp3/mdp-platform.h | 58 + .../media/platform/mtk-mdp3/mdp_reg_ccorr.h | 75 + .../media/platform/mtk-mdp3/mdp_reg_rdma.h | 206 +++ drivers/media/platform/mtk-mdp3/mdp_reg_rsz.h | 109 ++ .../media/platform/mtk-mdp3/mdp_reg_wdma.h | 125 ++ .../media/platform/mtk-mdp3/mdp_reg_wrot.h | 115 ++ .../media/platform/mtk-mdp3/mmsys_config.h | 188 +++ drivers/media/platform/mtk-mdp3/mmsys_mutex.h | 35 + .../media/platform/mtk-mdp3/mmsys_reg_base.h | 38 + drivers/media/platform/mtk-mdp3/mtk-img-ipi.h | 282 ++++ .../media/platform/mtk-mdp3/mtk-mdp3-cmdq.c | 524 ++++++ .../media/platform/mtk-mdp3/mtk-mdp3-cmdq.h | 52 + .../media/platform/mtk-mdp3/mtk-mdp3-comp.c | 1439 +++++++++++++++++ .../media/platform/mtk-mdp3/mtk-mdp3-comp.h | 157 ++ .../media/platform/mtk-mdp3/mtk-mdp3-core.c | 261 +++ .../media/platform/mtk-mdp3/mtk-mdp3-core.h | 86 + .../media/platform/mtk-mdp3/mtk-mdp3-m2m.c | 797 +++++++++ .../media/platform/mtk-mdp3/mtk-mdp3-m2m.h | 42 + .../media/platform/mtk-mdp3/mtk-mdp3-regs.c | 746 +++++++++ .../media/platform/mtk-mdp3/mtk-mdp3-regs.h | 373 +++++ .../media/platform/mtk-mdp3/mtk-mdp3-vpu.c | 313 ++++ .../media/platform/mtk-mdp3/mtk-mdp3-vpu.h | 79 + 28 files changed, 6553 insertions(+) create mode 100644 Documentation/devicetree/bindings/media/mediatek-mdp3.yaml create mode 100644 drivers/media/platform/mtk-mdp3/Makefile create mode 100644 drivers/media/platform/mtk-mdp3/isp_reg.h create mode 100644 drivers/media/platform/mtk-mdp3/mdp-platform.h create mode 100644 drivers/media/platform/mtk-mdp3/mdp_reg_ccorr.h create mode 100644 drivers/media/platform/mtk-mdp3/mdp_reg_rdma.h create mode 100644 drivers/media/platform/mtk-mdp3/mdp_reg_rsz.h create mode 100644 drivers/media/platform/mtk-mdp3/mdp_reg_wdma.h create mode 100644 drivers/media/platform/mtk-mdp3/mdp_reg_wrot.h create mode 100644 drivers/media/platform/mtk-mdp3/mmsys_config.h create mode 100644 drivers/media/platform/mtk-mdp3/mmsys_mutex.h create mode 100644 drivers/media/platform/mtk-mdp3/mmsys_reg_base.h create mode 100644 drivers/media/platform/mtk-mdp3/mtk-img-ipi.h create mode 100644 drivers/media/platform/mtk-mdp3/mtk-mdp3-cmdq.c create mode 100644 drivers/media/platform/mtk-mdp3/mtk-mdp3-cmdq.h create mode 100644 drivers/media/platform/mtk-mdp3/mtk-mdp3-comp.c create mode 100644 drivers/media/platform/mtk-mdp3/mtk-mdp3-comp.h create mode 100644 drivers/media/platform/mtk-mdp3/mtk-mdp3-core.c create mode 100644 drivers/media/platform/mtk-mdp3/mtk-mdp3-core.h create mode 100644 drivers/media/platform/mtk-mdp3/mtk-mdp3-m2m.c create mode 100644 drivers/media/platform/mtk-mdp3/mtk-mdp3-m2m.h create mode 100644 drivers/media/platform/mtk-mdp3/mtk-mdp3-regs.c create mode 100644 drivers/media/platform/mtk-mdp3/mtk-mdp3-regs.h create mode 100644 drivers/media/platform/mtk-mdp3/mtk-mdp3-vpu.c create mode 100644 drivers/media/platform/mtk-mdp3/mtk-mdp3-vpu.h -- 2.18.0