Received: by 2002:a05:6359:c8b:b0:c7:702f:21d4 with SMTP id go11csp293558rwb; Wed, 28 Sep 2022 02:49:37 -0700 (PDT) X-Google-Smtp-Source: AMsMyM7V5PysFrl56G2kaBdGcKXMcnJPA78yDjx4p9Ypms2Do2XfmevfyQHgZQYfdDrI0VdMgcJg X-Received: by 2002:a63:5fc1:0:b0:43c:7ce5:e7a6 with SMTP id t184-20020a635fc1000000b0043c7ce5e7a6mr19335996pgb.455.1664358577004; Wed, 28 Sep 2022 02:49:37 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1664358576; cv=none; d=google.com; s=arc-20160816; b=JNldt5nqPJekqweSGVQz4ZvdT3R1NoxEhmcXu+Cru7YmhWlo3pCHA5/6amWKFYAy11 FT8V2MuPhewyuGHT3p09FqtpNtArJma1reHe7T1fSrFdT5E997k4bnt9NifH1sJ/Xy9D nripooabS7LwRdArItmvQp2UOeRCIGZXYL7q9AUKoq498wyvrqSKKKnnY5kTn/avMY/b Rya2mKF3WVtdAIitA4YD/jJq2Lp/42J2Zew2GyPy3fDHuycIq72aSpn2JUGrhl1k73wD Go5WiIq95/51Gdl0fcCKI42cJSqQ6sWNqRKLlFHMG6IEpMNKwms2wcHcaPjD1FcZN0gg UPgQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=YhKffE7HWSky3te3I2w0FYWJ7MbF5MJy9nexifyeAYg=; b=AqlyQ4qnU/CDdGeQFmju1vZ03H85DEzUyxI07FvfVtMPcJXPjCvFYUwKxQJEppNG/v QU/ZocSTEw5P97cRIDwLhCMAxXPAp8GT3aTYfJnind92Aw5N/lnaycPXL6E4KgbLeGbO +c5Od6+/jUb0b/Efgj2MEjr4E7yNdjuwkpJ4XdThhG/b2h1qQBsxFo3wRkUnRQzvRytl xDM1QAYF9A1WLgqDHSyAeulu5NvFBD5KdVjyNSscVASUOwwMJvLt746crM4UNHWGR0sP qW5YO8qht+5WeF1XOVRUlZOt5UKVQr5vyARmam3lyx9tAaWkxUKs7BvD4R3saHJQqlCd sn9Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@mediatek.com header.s=dk header.b=o4134wfq; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=mediatek.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id mw10-20020a17090b4d0a00b001fe2eaaf1d6si1932766pjb.62.2022.09.28.02.49.25; Wed, 28 Sep 2022 02:49:36 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@mediatek.com header.s=dk header.b=o4134wfq; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=mediatek.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233062AbiI1Jdi (ORCPT + 99 others); Wed, 28 Sep 2022 05:33:38 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:45980 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233778AbiI1JdS (ORCPT ); Wed, 28 Sep 2022 05:33:18 -0400 Received: from mailgw01.mediatek.com (unknown [60.244.123.138]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 89EC37B1CF; Wed, 28 Sep 2022 02:33:14 -0700 (PDT) X-UUID: 9eaa9ed8fdc34dc49f6ce5fa59d8b1da-20220928 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=mediatek.com; s=dk; h=Content-Type:Content-Transfer-Encoding:MIME-Version:Message-ID:Date:Subject:CC:To:From; bh=YhKffE7HWSky3te3I2w0FYWJ7MbF5MJy9nexifyeAYg=; b=o4134wfq+9zzxDwC5Xk7zgOYw3lzmzOVo4Bjs/ZSW9ad3F1dxQKg1AShy5ZAyZzeltSuSsNjXQ4u7NAkRrD18CDf/AAvvd2pQNlf2hStvrMPZUveU9LY2FsufJGgojc5nDkl7f9tXSfhtypAWHMNohIn3RxLeT/twbi/+GbaSio=; X-CID-P-RULE: Release_Ham X-CID-O-INFO: VERSION:1.1.11,REQID:4af41274-98d1-4e73-a356-baa4ad3f6cec,IP:0,U RL:0,TC:0,Content:-25,EDM:0,RT:0,SF:95,FILE:0,BULK:0,RULE:Release_Ham,ACTI ON:release,TS:70 X-CID-INFO: VERSION:1.1.11,REQID:4af41274-98d1-4e73-a356-baa4ad3f6cec,IP:0,URL :0,TC:0,Content:-25,EDM:0,RT:0,SF:95,FILE:0,BULK:0,RULE:Spam_GS981B3D,ACTI ON:quarantine,TS:70 X-CID-META: VersionHash:39a5ff1,CLOUDID:37744e07-1cee-4c38-b21b-a45f9682fdc0,B ulkID:220928173310SZOF030W,BulkQuantity:0,Recheck:0,SF:38|28|17|19|48,TC:n il,Content:0,EDM:-3,IP:nil,URL:1,File:nil,Bulk:nil,QS:nil,BEC:nil,COL:0 X-UUID: 9eaa9ed8fdc34dc49f6ce5fa59d8b1da-20220928 Received: from mtkmbs13n1.mediatek.inc [(172.21.101.193)] by mailgw01.mediatek.com (envelope-from ) (Generic MTA with TLSv1.2 ECDHE-RSA-AES256-GCM-SHA384 256/256) with ESMTP id 1451215718; Wed, 28 Sep 2022 17:33:08 +0800 Received: from mtkcas11.mediatek.inc (172.21.101.40) by mtkmbs13n1.mediatek.inc (172.21.101.193) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.2.792.15; Wed, 28 Sep 2022 17:33:07 +0800 Received: from localhost.localdomain (10.17.3.154) by mtkcas11.mediatek.inc (172.21.101.73) with Microsoft SMTP Server id 15.0.1497.2 via Frontend Transport; Wed, 28 Sep 2022 17:33:05 +0800 From: Irui Wang To: Hans Verkuil , Mauro Carvalho Chehab , Rob Herring , Matthias Brugger , Krzysztof Kozlowski , Tzung-Bi Shih , , , , kyrie wu CC: , , , , , , Tomasz Figa , , , kyrie wu Subject: [V16,0/15] Enable jpeg enc & dec multi-hardwares for MT8195 Date: Wed, 28 Sep 2022 17:32:43 +0800 Message-ID: <20220928093258.32384-1-irui.wang@mediatek.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-MTK: N X-Spam-Status: No, score=-2.0 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS, SPF_PASS,UNPARSEABLE_RELAY,URIBL_CSS autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: kyrie wu This series adds support for multi hardwares jpeg enc & dec, by first adding use of_platform_populate to manage each hardware information:interrupt, clock, register bases and power. Secondly add jpeg enc & dec work queue to deal with the encoding or decoding requests of multi-hardwares at the same time. Lastly, add output picture reorder function interface to eliminate the out of order images. This series has been tested with MT8195 Gstreamer. Encoding and decoding worked for this chip. Patches 1 Adds jpeg encoder dt-bindings for mt8195 Patches 2 jpeg encoder builds two module for using Multi-HW, export some functions to make them visible by other modules. Patches 3 use devm_of_platform_populate to manage multi-hardware. Patch 4 add jpeg encoding timeout function to judge hardware timeout. Patch 5 add encoding work queue to deal with multi-hardware encoding at the same time. Patch 6 add output picture reorder function to jpgenc order images. Patch 7 add stop cmd function to deal with jpgenc EOS operation. Patch 8 Adds jpeg decoder dt-bindings for mt8195 Patches 9 jpeg decoder builds three module for using Multi-HW, export some functions to make them visible by other modules. Patch 10 use of_platform_populate to manage multi-hardware. Patch 11 add jpeg decoding timeout function to judge hardware timeout. Patch 12 add decoding work queue to deal with multi-hardware decoding at the same time. Patch 13 add output picture reorder function to jpgdec order images. Patch 14 refactor jpegdec func interface for HW working. Patch 15 add stop cmd function to deal with jpgdec EOS operation. --- This series patches dependent on: media_stage tree: [1] https://git.linuxtv.org/media_stage.git/commit/?id=b3627647f9ea7473d10fb08a95fd7c4133a17ca4 patch1 new jpegdec dt-bindings included files [2] MM IOMMU binding: https://patchwork.kernel.org/project/linux-mediatek/patch/20220217113453.13658-2-yong.wu@mediatek.com/ [3] MT8195 power domain: https://patchwork.kernel.org/project/linux-mediatek/list/?series=580579 Changes compared with v15: - some modifications for patch v15's review comments. Changes compared with v14: - some modifications for patch v14's review comments. Changes compared with v13: - some modifications for patch v13's review comments. - fix kernel robot check errors. - fix kernel-doc check warns. - fix sparse check warns. - combine jpeg encoder series with decoder series into one single series. Changes compared with v12: - some modifications for patch v12's review comments. Changes compared with v11: - some modifications for patch v11's review comments. - fix yaml file check errors. Changes compared with v10: - some modifications for patch v10's review comments. - fix Gstreamer test errors. Changes compared with v9: - some modifications for patch v9's review comments. Changes compared with v8: - some modifications for patch v8's review comments. - add stop cmd function. Changes compared with v7: - some modifications for patch v6's review comments. Changes compared with v6: - new yaml file for mt8195 jpeg encoder. - some modifications for patch v5's review comments. Changes compared with v5: - use of_platform_populate to replace component framework to manage multi-hardware in patch 2. Changes compared with v4: - No change compaered with v4 Changes compared with v3: - Structure patches for consistency, non-backward compatible and do not break any existing functionality Changes compared with v2: - Split the last two patches into several patches to enhance readability - Correct some syntax errors - Explain why the component framework is used Changes compared with v1: - Add jpeg encoder dt-bindings for MT8195 - Use component framework to manage jpegenc HW - Add jpegenc output pic reorder function interface kyrie wu (15): dt-bindings: mediatek: Add mediatek, mt8195-jpgenc compatible mtk-jpegenc: export jpeg encoder functions mtk-jpegenc: support jpegenc multi-hardware mtk-jpegenc: add jpegenc timeout func interface mtk-jpegenc: add jpeg encode worker interface mtk-jpegenc: add output pic reorder interface mtk-jpegenc: add stop cmd interface for jpgenc dt-bindings: mediatek: Add mediatek,mt8195-jpgdec compatible media: mtk-jpegdec: export jpeg decoder functions media: mtk-jpegdec: support jpegdec multi-hardware media: mtk-jpegdec: add jpegdec timeout func interface media: mtk-jpegdec: add jpeg decode worker interface media: mtk-jpegdec: add output pic reorder interface media: mtk-jpegdec: refactor jpegdec func interface mtk-jpegdec: add stop cmd interface for jpgdec .../media/mediatek,mt8195-jpegdec.yaml | 168 ++++++ .../media/mediatek,mt8195-jpegenc.yaml | 146 ++++++ drivers/media/platform/mediatek/jpeg/Makefile | 14 +- .../platform/mediatek/jpeg/mtk_jpeg_core.c | 490 ++++++++++++++++-- .../platform/mediatek/jpeg/mtk_jpeg_core.h | 169 +++++- .../platform/mediatek/jpeg/mtk_jpeg_dec_hw.c | 315 ++++++++++- .../platform/mediatek/jpeg/mtk_jpeg_dec_hw.h | 6 +- .../platform/mediatek/jpeg/mtk_jpeg_dec_reg.h | 1 + .../platform/mediatek/jpeg/mtk_jpeg_enc_hw.c | 255 +++++++++ 9 files changed, 1481 insertions(+), 83 deletions(-) create mode 100644 Documentation/devicetree/bindings/media/mediatek,mt8195-jpegdec.yaml create mode 100644 Documentation/devicetree/bindings/media/mediatek,mt8195-jpegenc.yaml -- 2.18.0