Received: by 2002:a05:6358:701b:b0:131:369:b2a3 with SMTP id 27csp4099457rwo; Tue, 25 Jul 2023 00:04:57 -0700 (PDT) X-Google-Smtp-Source: APBJJlFzVyjvhJaqBkl7yUFB8vmaKf70S4ussUvqpyhrTLUFZiEJPXDXJvVueqSeVGeZoEiv39th X-Received: by 2002:a05:6a20:88:b0:131:dc49:13eb with SMTP id 8-20020a056a20008800b00131dc4913ebmr12872115pzg.35.1690268696939; Tue, 25 Jul 2023 00:04:56 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1690268696; cv=none; d=google.com; s=arc-20160816; b=jg1R0g1T7pr4cjxzXsCEK9cNFrP+A85GOP7baqt9I8vHgfxyLK5IW5llrsMJqy1GFv F1mXOSOPI/z8NI1dtFRt0jSH+zbk8hPxZKALzdP/sPlVUtnpUJyKBNcL7HWBcradDH0S V52glFMsdNR9jxJFvhfLg2SL1A5BLDfblnawcmzcg/Wo0AINxvyQHQovE/K4dr09U8JP qTEq3XK/VeR08kZRqqCih1f7VolrmUM0F5+OvquGnaMXKIowLhknFpxnod7ZIxuVAty9 lBuyrGymhzbS8E2QrBvlv+7EhfHzrUELHLpY7Ee1bIP1ofHYetE88kciLBH7bWrG6ghP CFjA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:message-id:date:subject:to:from; bh=K61irXdaYQGCAKynlz0AqlY2AqCC7zxlEY1Xd7vAJyw=; fh=cenhyE8QF/1S4DNSiISo8TX7BXBplJPKpDjrjL+zmAA=; b=VXE5+zIt/8nnRlVcs0PdxY7vkinPwtFdk+tZIx1YrLxFbYDJkn8MMbQoN/6KT0fecV lPqD32LWHScZPzli/QvTsTEzReVGl79zOpMdufG4tNVHm8WP16Xc9bnHHzlt/FMwIS6p 1UxaspBoCSfSN4uXRDdkxASBtOwFabv+50jkuK2G8sA0u5+MqR7nM5M8SUBgYXZCgACf ZozSUsH3RQ2dfmQqWKu0ZbMI/CDHXxSMhK4P4++JORq/OMUOBHnwedep2d48nkDt3QVy kDJNUtzZ3ezVtR7SzC+/HgOfk+L8Gm0ibtEXdZhFeh/pgOvYdhKGB9ksr9KYwXQXOHml FjuQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=nxp.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id bx9-20020a056a00428900b00682f9a7b6bdsi10365555pfb.119.2023.07.25.00.04.44; Tue, 25 Jul 2023 00:04:56 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=nxp.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232233AbjGYGqV (ORCPT + 99 others); Tue, 25 Jul 2023 02:46:21 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:54200 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229847AbjGYGqT (ORCPT ); Tue, 25 Jul 2023 02:46:19 -0400 Received: from inva020.nxp.com (inva020.nxp.com [92.121.34.13]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 70A221B3; Mon, 24 Jul 2023 23:46:18 -0700 (PDT) Received: from inva020.nxp.com (localhost [127.0.0.1]) by inva020.eu-rdc02.nxp.com (Postfix) with ESMTP id 14BF31A161D; Tue, 25 Jul 2023 08:46:17 +0200 (CEST) Received: from aprdc01srsp001v.ap-rdc01.nxp.com (aprdc01srsp001v.ap-rdc01.nxp.com [165.114.16.16]) by inva020.eu-rdc02.nxp.com (Postfix) with ESMTP id CEC341A1614; Tue, 25 Jul 2023 08:46:16 +0200 (CEST) Received: from localhost.localdomain (shlinux2.ap.freescale.net [10.192.224.44]) by aprdc01srsp001v.ap-rdc01.nxp.com (Postfix) with ESMTP id D18501800319; Tue, 25 Jul 2023 14:46:14 +0800 (+08) From: Shengjiu Wang To: hverkuil@xs4all.nl, sakari.ailus@iki.fi, tfiga@chromium.org, m.szyprowski@samsung.com, mchehab@kernel.org, linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, shengjiu.wang@gmail.com, Xiubo.Lee@gmail.com, festevam@gmail.com, nicoleotsuka@gmail.com, lgirdwood@gmail.com, broonie@kernel.org, perex@perex.cz, tiwai@suse.com, alsa-devel@alsa-project.org, linuxppc-dev@lists.ozlabs.org Subject: [RFC PATCH v2 0/7] Add audio support in v4l2 framework Date: Tue, 25 Jul 2023 14:12:13 +0800 Message-Id: <1690265540-25999-1-git-send-email-shengjiu.wang@nxp.com> X-Mailer: git-send-email 2.7.4 X-Virus-Scanned: ClamAV using ClamSMTP X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,SPF_HELO_NONE, SPF_PASS,T_SCC_BODY_TEXT_LINE,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Audio signal processing has the requirement for memory to memory similar as Video. This patch is to add this support in v4l2 framework, defined new buffer type V4L2_BUF_TYPE_AUDIO_CAPTURE and V4L2_BUF_TYPE_AUDIO_OUTPUT, defined new format v4l2_audio_format for audio case usage. The created audio device is named "/dev/audioX". And add memory to memory support for two kinds of i.MX ASRC module changes in v2: - decouple the implementation in v4l2 and ALSA - implement the memory to memory driver as a platfrom driver and move it to driver/media - move fsl_asrc_common.h to include/sound folder Shengjiu Wang (7): ASoC: fsl_asrc: define functions for memory to memory usage ASoC: fsl_easrc: define functions for memory to memory usage ASoC: fsl_asrc: move fsl_asrc_common.h to include/sound media: v4l2: Add audio capture and output support media: imx: fsl_asrc: Add memory to memory driver ASoC: fsl_asrc: register m2m platform device ASoC: fsl_easrc: register m2m platform device .../media/common/videobuf2/videobuf2-v4l2.c | 4 + drivers/media/platform/nxp/Kconfig | 12 + drivers/media/platform/nxp/Makefile | 1 + drivers/media/platform/nxp/fsl_asrc_m2m.c | 962 ++++++++++++++++++ drivers/media/v4l2-core/v4l2-dev.c | 17 + drivers/media/v4l2-core/v4l2-ioctl.c | 52 + include/media/v4l2-dev.h | 2 + include/media/v4l2-ioctl.h | 34 + .../fsl => include/sound}/fsl_asrc_common.h | 48 + include/uapi/linux/videodev2.h | 19 + sound/soc/fsl/fsl_asrc.c | 150 +++ sound/soc/fsl/fsl_asrc.h | 4 +- sound/soc/fsl/fsl_asrc_dma.c | 2 +- sound/soc/fsl/fsl_easrc.c | 227 +++++ sound/soc/fsl/fsl_easrc.h | 8 +- 15 files changed, 1539 insertions(+), 3 deletions(-) create mode 100644 drivers/media/platform/nxp/fsl_asrc_m2m.c rename {sound/soc/fsl => include/sound}/fsl_asrc_common.h (63%) -- 2.34.1