Received: by 2002:a05:7412:d008:b0:f9:6acb:47ec with SMTP id bd8csp423378rdb; Wed, 20 Dec 2023 00:43:49 -0800 (PST) X-Google-Smtp-Source: AGHT+IGessc7GyzZaLXlk9BnWBQ9KhIcpbi+zohJwaLWIVaP5pby8+0A3B15xJTsM2mDVZdlvH4J X-Received: by 2002:a05:6a00:3a15:b0:6d0:8b0d:b8c1 with SMTP id fj21-20020a056a003a1500b006d08b0db8c1mr19303952pfb.35.1703061829659; Wed, 20 Dec 2023 00:43:49 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1703061829; cv=none; d=google.com; s=arc-20160816; b=byHkIV+HaPmbhM9dSyQvm1WZm6JrKNZOGY93d0GeK3pL36coIN3+Nxa0Z+b5yrmMKn FAPKA5SImNX1oTePkWEP07PdO9ruVG92xBb1DK+eHa68SXWViu4umCIZxvXPEvAfgDWq aXtx0yISj3P4jtl0Y3/wxBv2w4RPl/ZlXukWlINMFyIzHMyUwI99yDUIFsQDIAUpZ/Lu LtdVYyfib95MddNvJrwErgP0VMd2SfT/4tRXgwMj78/LQlPUkPz5Fa8lzk4InYzcra2P qkbYZwszszowL5gT5JAMB3gR0tIEMgf1XHhAoNQqEs181HN5VLKq37H92j+vHlYi6Q3T PWPA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:list-unsubscribe:list-subscribe:list-id:precedence :dkim-signature; bh=FiOZE+7UgezUwljIZ0IizgfxHCrQJAp3IF03vc/Hvkk=; fh=FcVhwi8lkZOuLigBdpPi1jgYpMbGbfxMVgcYGH81j4U=; b=zvk/ttbmFvJCxRKd34dYygBe9go7AO4UoQQuwgNpy57CBc+7jUqzNVHpE6iw6RYX/T IbBH6xKgXqYiEBJCIokEfQnYZelngqfD+JvrjYN25MXB27R1rgD/zVbYLQOFhyRK1knO hZzzXK0Kr/z9C3YiYxmB3wpywOwxDNLiVA2nNyWD1BJ3rrmQ9LuZKT6uwLD/yzE9sHDx 4BybGX0LoVu4VUlWeNqtz7mF6JTdUOfIWFOdL4e3Axb8dW69JfrfmPvOHiM+f7oiSYN9 kRniMTL99qPHXhVp/W2Pk7HfA0dHvJoc5zyVGvpGCPoj70oIwebWajo3iTdPodDTiht1 iQ8w== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=uG2eXLbI; spf=pass (google.com: domain of linux-kernel+bounces-6590-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-kernel+bounces-6590-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org. [147.75.48.161]) by mx.google.com with ESMTPS id k190-20020a636fc7000000b005cdbebc0eedsi2177510pgc.538.2023.12.20.00.43.49 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 20 Dec 2023 00:43:49 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-6590-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) client-ip=147.75.48.161; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=uG2eXLbI; spf=pass (google.com: domain of linux-kernel+bounces-6590-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-kernel+bounces-6590-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sy.mirrors.kernel.org (Postfix) with ESMTPS id 159EFB23BB1 for ; Wed, 20 Dec 2023 08:41:40 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 975881DA31; Wed, 20 Dec 2023 08:40:07 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=linaro.org header.i=@linaro.org header.b="uG2eXLbI" X-Original-To: linux-kernel@vger.kernel.org Received: from mail-yw1-f181.google.com (mail-yw1-f181.google.com [209.85.128.181]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 30D78208B3 for ; Wed, 20 Dec 2023 08:40:04 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linaro.org Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linaro.org Received: by mail-yw1-f181.google.com with SMTP id 00721157ae682-5e6c8b70766so26868267b3.3 for ; Wed, 20 Dec 2023 00:40:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1703061604; x=1703666404; darn=vger.kernel.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=FiOZE+7UgezUwljIZ0IizgfxHCrQJAp3IF03vc/Hvkk=; b=uG2eXLbIl1B+cK7bgZ0Ah4+YOClOSn2x/cMH2ViHawxDcRz6qOCH4drQ47eL/nXnea PTAJtRJ66xs5fpYgwmhQSlpU+rQo0k5T0wbLHaUWlr8imBoCqDjkaATJcHuNZKSbgob1 26Wsqtdi1GBi5r33EIbk+LSLKlNVUZDcTa5gBHWo7sCOXBOqFKt+xOZ+7eUi7YcZWXKL cuid1LprIGd84WFYRTjB4yiKlMZ2oUP53gsOTvFNH5ydCJAnGlD6gGCHCRoJnhr/70kt 08kpmBCwLJrlf9OP0ZQoPD5ucLv/paGTJAFYoKP5YDGNcT8gvNXfqtNAJdxvB7UjRmmi v2kw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1703061604; x=1703666404; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=FiOZE+7UgezUwljIZ0IizgfxHCrQJAp3IF03vc/Hvkk=; b=jq1HvLH40VKUhz1khW1X64DFggiKabjWK3K7c173veVGHMVNYdG3KS+ZbrkdAw9utI guFDHWQz4+NKaEI0psS+rSeOoY8V4d5Uu8wTieHYgyp+LlXG/GvzrbNMul2zZ2/3CSmY fSNc+hGrWN8Z+IDFU02yjEi+DXxwdDtUb6MH2Oz7lJZNgG1Dt/6IQciLroiSQZT11G50 kIXBuZefoa+qc+Lm3K9eMP0BMF2N7cV6T6n1BcGPwN0wkvTh1LOKnMs0/HsN91rKDq8n 4S4M14ELIeN3bD/a3FE8+uPd/5VrmAmZkMfcUhcIwWFvOggXhzG0mS2ayGN8EaaDYNin 3Cmw== X-Gm-Message-State: AOJu0YxrloiQ6DHTBqwnXS4MeI2iPePybQ4H5liRFkF6GOTJ2jEJuYA6 PEM0I9xtdOxNZDIhTfPMTp/WyTkbGcg5XJlCS5rt+Q== X-Received: by 2002:a0d:d510:0:b0:5e8:8890:8afe with SMTP id x16-20020a0dd510000000b005e888908afemr382198ywd.78.1703061604134; Wed, 20 Dec 2023 00:40:04 -0800 (PST) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 References: <1702899149-21321-1-git-send-email-quic_dikshita@quicinc.com> <9d94317c-5da9-5494-26a2-12007761a1e5@quicinc.com> In-Reply-To: <9d94317c-5da9-5494-26a2-12007761a1e5@quicinc.com> From: Dmitry Baryshkov Date: Wed, 20 Dec 2023 10:39:52 +0200 Message-ID: Subject: Re: [PATCH v2 00/34] Qualcomm video encoder and decoder driver To: Vikash Garodia Cc: Dikshita Agarwal , linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, stanimir.k.varbanov@gmail.com, agross@kernel.org, andersson@kernel.org, konrad.dybcio@linaro.org, mchehab@kernel.org, bryan.odonoghue@linaro.org, linux-arm-msm@vger.kernel.org, quic_abhinavk@quicinc.com Content-Type: text/plain; charset="UTF-8" On Wed, 20 Dec 2023 at 10:14, Vikash Garodia wrote: > > Hi, > > On 12/20/2023 1:07 PM, Dmitry Baryshkov wrote: > > On Wed, 20 Dec 2023 at 08:32, Vikash Garodia wrote: > >> > >> Hi Dmitry, > >> > >> On 12/19/2023 12:08 AM, Dmitry Baryshkov wrote: > >>> On 18/12/2023 13:31, Dikshita Agarwal wrote: > >>>> This patch series introduces support for Qualcomm new video acceleration > >>>> hardware architecture, used for video stream decoding/encoding. This driver > >>>> is based on new communication protocol between video hardware and application > >>>> processor. > >>> > >>> This doesn't answer one important point, you have been asked for v1. What is the > >>> actual change point between Venus and Iris? What has been changed so much that > >>> it demands a separate driver. This is the main question for the cover letter, > >>> which has not been answered so far. > >>> > >>> From what I see from you bindings, the hardware is pretty close to what we see > >>> in the latest venus generations. I asssme that there was a change in the vcodec > >>> inteface to the firmware and other similar changes. Could you please point out, > >>> which parts of Venus driver do no longer work or are not applicable for sm8550 > >> > >> The motivation behind having a separate IRIS driver was discussed earlier in [1] > >> In the same discussion, it was ellaborated on how the impact would be with > >> change in the new firmware interface and other video layers in the driver. I can > >> add this in cover letter in the next revision. > > > > Ok. So the changes cover the HFI interface. Is that correct? > Change wise, yes. > > >> We see some duplication of code and to handle the same, the series brings in a > >> common code reusability between iris and venus. Aligning the common peices of > >> venus and iris will be a work in progress, once we land the base driver for iris. > > > > This is not how it usually works. Especially not with the patches you > > have posted. > > > > I have the following suggestion how this story can continue: > > You can _start_ by reworking venus driver, separating the HFI / > > firmware / etc interface to an internal interface in the driver. Then > > implement Iris as a plug in for that interface. I might be mistaken > > here, but I think this is the way how this can be beneficial for both > > the video en/decoding on both old and new platforms. > > HFI/firmware interface is already confined to HFI layer in the existing venus > driver. We explained in the previous discussion [1], on how the HFI change > impacts the other layers by taking example of a DRC usecase. Please have a look > considering the usecase and the impact it brings to other layers in the driver. I have looked at it. And I still see huge change in the interface side, but it doesn't tell me about the hardware changes. Have you evaluated the other opportunity? To have a common platform interface and firmware-specific backend? You have already done a part of it, but from a different perspective. You have tried to move common code out of the driver. Instead we are asking you to do a different thing. Move non-common code within the driver. Then add your code on top of that. > > [1] https://lore.kernel.org/lkml/8c97d866-1cab-0106-4ab3-3ca070945ef7@quicinc.com/ > > Short rationale: > > The venus driver has a history of supported platforms. There is > > already some kind of buffer management in place. Both developers and > > testers have spent their effort on finding issues there. Sending new > > driver means that we have to spend the same amount of efforts on this. > > Moreover, even from the porter point of view. You are creating new > > bindings for the new hardware. Which do not follow the > > venus-common.yaml. And they do not follow the defined bindings for the > > recent venus platforms. Which means that as a developer I have to care > > about two different ways to describe nearly the same hardware.>> Again qualcomm video team does not have a plan to support sm8550/x1e80100 on > >> venus as the changes are too interleaved to absorb in venus driver. And there is > >> significant interest in community to start validating video driver on sm8550 or > >> x1e80100. > >> > >> [1] https://lore.kernel.org/lkml/8c97d866-1cab-0106-4ab3-3ca070945ef7@quicinc.com/ > >> > >> Regards, > >> Vikash > > > > > > -- With best wishes Dmitry