Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   "Aakarsh Jain" <aakarsh.jain@samsung.com>
To:     "'Hans Verkuil'" <hverkuil-cisco@xs4all.nl>,
        <linux-arm-kernel@lists.infradead.org>,
        <linux-media@vger.kernel.org>, <linux-kernel@vger.kernel.org>,
        <devicetree@vger.kernel.org>
Cc:     <m.szyprowski@samsung.com>, <andrzej.hajda@intel.com>,
        <mchehab@kernel.org>, <ezequiel@vanguardiasur.com.ar>,
        <jernej.skrabec@gmail.com>, <benjamin.gaignard@collabora.com>,
        <stanimir.varbanov@linaro.org>, <dillon.minfei@gmail.com>,
        <david.plowman@raspberrypi.com>, <mark.rutland@arm.com>,
        <robh+dt@kernel.org>, <krzk+dt@kernel.org>, <andi@etezian.org>,
        <alim.akhtar@samsung.com>, <aswani.reddy@samsung.com>,
        <pankaj.dubey@samsung.com>, <linux-fsd@tesla.com>,
        <smitha.t@samsung.com>
In-Reply-To: <3b85e6ad-e734-8b36-37bf-06b9c560ca92@xs4all.nl>
Subject: RE: [Patch v3 05/15] Documention: v4l: Documentation for VP9 CIDs.
Date:   Wed, 14 Dec 2022 15:52:56 +0530
Message-ID: <000001d90fa6$0ff91470$2feb3d50$@samsung.com>
MIME-Version: 1.0
Content-Transfer-Encoding: quoted-printable
Thread-Index: AQIjXZOHgvokXGuofbg3rWbxTFZEMQHl4WsmAsDEgksBl6lGqq2mhHWw
Content-Language: en-in
Content-Type: text/plain; charset="utf-8"
CMS-TYPE: 105P
DLP-Filter: Pass
References: <20221011122516.32135-1-aakarsh.jain@samsung.com>
        <CGME20221011125155epcas5p1e47309b4dd767e81817c316aa0e8b7ca@epcas5p1.samsung.com>
        <20221011122516.32135-6-aakarsh.jain@samsung.com>
        <3b85e6ad-e734-8b36-37bf-06b9c560ca92@xs4all.nl>
Precedence: bulk


> -----Original Message-----
> From: Hans Verkuil =5Bmailto:hverkuil-cisco=40xs4all.nl=5D
> Sent: 24 November 2022 16:54
> To: aakarsh jain <aakarsh.jain=40samsung.com>; linux-arm-
> kernel=40lists.infradead.org; linux-media=40vger.kernel.org; linux-
> kernel=40vger.kernel.org; devicetree=40vger.kernel.org
> Cc: m.szyprowski=40samsung.com; andrzej.hajda=40intel.com;
> mchehab=40kernel.org; ezequiel=40vanguardiasur.com.ar;
> jernej.skrabec=40gmail.com; benjamin.gaignard=40collabora.com;
> stanimir.varbanov=40linaro.org; dillon.minfei=40gmail.com;
> david.plowman=40raspberrypi.com; mark.rutland=40arm.com;
> robh+dt=40kernel.org; krzk+dt=40kernel.org; andi=40etezian.org;
> alim.akhtar=40samsung.com; aswani.reddy=40samsung.com;
> pankaj.dubey=40samsung.com; linux-fsd=40tesla.com; smitha.t=40samsung.com
> Subject: Re: =5BPatch v3 05/15=5D Documention: v4l: Documentation for VP9=
 CIDs.
>=20
> On 11/10/2022 14:25, aakarsh jain wrote:
> > From: Smitha T Murthy <smitha.t=40samsung.com>
> >
> > Adds V4l2 controls for VP9 encoder documention.
> >
> > Cc: linux-fsd=40tesla.com
> > Signed-off-by: Smitha T Murthy <smitha.t=40samsung.com>
> > Signed-off-by: Aakarsh Jain <aakarsh.jain=40samsung.com>
> > ---
> >  .../media/v4l/ext-ctrls-codec.rst             =7C 167 ++++++++++++++++=
++
> >  1 file changed, 167 insertions(+)
> >
> > diff --git a/Documentation/userspace-api/media/v4l/ext-ctrls-codec.rst
> > b/Documentation/userspace-api/media/v4l/ext-ctrls-codec.rst
> > index 2a165ae063fb..2277d83a7cf0 100644
> > --- a/Documentation/userspace-api/media/v4l/ext-ctrls-codec.rst
> > +++ b/Documentation/userspace-api/media/v4l/ext-ctrls-codec.rst
> > =40=40 -2187,6 +2187,16 =40=40 enum v4l2_mpeg_video_vp8_profile -
> >      * - =60=60V4L2_MPEG_VIDEO_VP8_PROFILE_3=60=60
> >        - Profile 3
> >
> > +VP9 Control Reference
>=20
> This is wrong. There is a VPX Control Reference section for both VP8 and =
VP9
> controls. That's where this should be added. I suspect several of the con=
trols
> you are adding here already exist, e.g.
> V4L2_CID_MPEG_VIDEO_VPX_MIN_QP. The documentation may have to be
> updated to specify that it is for both VP8 and VP9.
>=20
Since MFC has different profiles, different quantization parameter ranges f=
or both VP8 and VP9. So we can't use same control ID's for both.
So for example in VP8 with control ID (V4L2_CID_MPEG_VIDEO_VPX_MIN_QP), QP =
ranges from 0-11 and in VP9 with control ID  (V4L2_CID_CODEC_VP9_MIN_QP) QP=
 ranges from 1-24. So we can't club together into single control.=20

> > +---------------------
> > +
> > +The VP9 controls include controls for encoding parameters of VP9
> > +video codec.
> > +
> > +.. _vp9-control-id:
> > +
> > +VP9 Control IDs
> > +
> >  .. _v4l2-mpeg-video-vp9-profile:
> >
> >  =60=60V4L2_CID_MPEG_VIDEO_VP9_PROFILE=60=60
> > =40=40 -2253,6 +2263,163 =40=40 enum v4l2_mpeg_video_vp9_level -
> >      * - =60=60V4L2_MPEG_VIDEO_VP9_LEVEL_6_2=60=60
> >        - Level 6.2
> >
> > +=60=60V4L2_CID_CODEC_VP9_I_FRAME_QP=60=60
>=20
> If you do need to add new controls, then please use the same
> MPEG_VIDEO_ prefix.
> It's a bit ugly and historical, but let's keep it consistent with the oth=
ers.
>=20
> Regards,
>=20
> 	Hans
>=20
> > +    Quantization parameter for an I frame for VP9. Valid range: from 1=
 to
> 255.
> > +
> > +=60=60V4L2_CID_CODEC_VP9_P_FRAME_QP=60=60
> > +    Quantization parameter for an P frame for VP9. Valid range: from 1=
 to
> 255.
> > +
> > +=60=60V4L2_CID_CODEC_VP9_MAX_QP=60=60
> > +    Maximum quantization parameter for VP9. Valid range: from 1 to 255=
.
> > +    Recommended range for MFC is from 230 to 255.
> > +
> > +=60=60V4L2_CID_CODEC_VP9_MIN_QP=60=60
> > +    Minimum quantization parameter for VP9. Valid range: from 1 to 255=
.
> > +    Recommended range for MFC is from 1 to 24.
> > +
> > +=60=60V4L2_CID_CODEC_VP9_RC_FRAME_RATE=60=60
> > +    Indicates the number of evenly spaced subintervals, called ticks, =
within
> > +    one second. This is a 16 bit unsigned integer and has a maximum va=
lue
> up to
> > +    0xffff and a minimum value of 1.
> > +
> > +=60=60V4L2_CID_CODEC_VP9_GF_REFRESH_PERIOD=60=60
> > +    Indicates the refresh period of the golden frame for VP9 encoder.
> > +
> > +.. _v4l2-vp9-golden-frame-sel:
> > +
> > +=60=60V4L2_CID_CODEC_VP9_GOLDEN_FRAMESEL=60=60
> > +    (enum)
> > +
> > +enum v4l2_mpeg_vp9_golden_framesel -
> > +    Selects the golden frame for encoding. Valid when NUM_OF_REF is 2.
> > +    Possible values are:
> > +
> > +.. raw:: latex
> > +
> > +    =5Cfootnotesize
> > +
> > +.. tabularcolumns:: =7Cp=7B9.0cm=7D=7Cp=7B8.0cm=7D=7C
> > +
> > +.. flat-table::
> > +    :header-rows:  0
> > +    :stub-columns: 0
> > +
> > +    * - =60=60V4L2_CID_CODEC_VP9_GOLDEN_FRAME_USE_PREV=60=60
> > +      - Use the (n-2)th frame as a golden frame, current frame index b=
eing
> > +        'n'.
> > +    * - =60=60V4L2_CID_CODEC_VP9_GOLDEN_FRAME_USE_REF_PERIOD=60=60
> > +      - Use the previous specific frame indicated by
> > +        =60=60V4L2_CID_CODEC_VP9_GF_REFRESH_PERIOD=60=60 as a
> > +        golden frame.
> > +
> > +.. raw:: latex
> > +
> > +    =5Cnormalsize
> > +
> > +
> > +=60=60V4L2_CID_CODEC_VP9_HIERARCHY_QP_ENABLE=60=60
> > +    Allows host to specify the quantization parameter values for each
> > +    temporal layer through HIERARCHICAL_QP_LAYER. This is valid only
> > +    if HIERARCHICAL_CODING_LAYER is greater than 1. Setting the contro=
l
> > +    value to 1 enables setting of the QP values for the layers.
> > +
> > +.. _v4l2-vp9-ref-number-of-pframes:
> > +
> > +=60=60V4L2_CID_CODEC_VP9_REF_NUMBER_FOR_PFRAMES=60=60
> > +    (enum)
> > +
> > +enum v4l2_mpeg_vp9_ref_num_for_pframes -
> > +    Number of reference pictures for encoding P frames.
> > +
> > +.. raw:: latex
> > +
> > +    =5Cfootnotesize
> > +
> > +.. tabularcolumns:: =7Cp=7B9.0cm=7D=7Cp=7B8.0cm=7D=7C
> > +
> > +.. flat-table::
> > +    :header-rows:  0
> > +    :stub-columns: 0
> > +
> > +    * - =60=60V4L2_CID_CODEC_VP9_1_REF_PFRAME=60=60
> > +      - Indicates one reference frame, last encoded frame will be sear=
ched.
> > +    * - =60=60V4L2_CID_CODEC_VP9_GOLDEN_FRAME_USE_REF_PERIOD=60=60
> > +      - Indicates 2 reference frames, last encoded frame and golden fr=
ame
> > +        will be searched.
> > +
> > +.. raw:: latex
> > +
> > +    =5Cnormalsize
> > +
> > +
> > +=60=60V4L2_CID_CODEC_VP9_HIERARCHICAL_CODING_LAYER=60=60
> > +    Indicates the number of hierarchial coding layer.
> > +    In normal encoding (non-hierarchial coding), it should be zero.
> > +    VP9 has upto 3 layer of encoder.
> > +
> > +=60=60V4L2_CID_CODEC_VP9_HIERARCHY_RC_ENABLE=60=60
> > +    Indicates enabling of bit rate for hierarchical coding layers VP9 =
encoder.
> > +
> > +=60=60V4L2_CID_CODEC_VP9_HIER_CODING_L0_BR=60=60
> > +    Indicates bit rate for hierarchical coding layer 0 for VP9 encoder=
.
> > +
> > +=60=60V4L2_CID_CODEC_VP9_HIER_CODING_L1_BR=60=60
> > +    Indicates bit rate for hierarchical coding layer 1 for VP9 encoder=
.
> > +
> > +=60=60V4L2_CID_CODEC_VP9_HIER_CODING_L2_BR=60=60
> > +    Indicates bit rate for hierarchical coding layer 2 for VP9 encoder=
.
> > +
> > +=60=60V4L2_CID_CODEC_VP9_HIER_CODING_L0_QP=60=60
> > +    Indicates quantization parameter for hierarchical coding layer 0.
> > +    Valid range: =5BV4L2_CID_CODEC_VP9_MIN_QP,
> > +    V4L2_CID_CODEC_VP9_MAX_QP=5D.
> > +
> > +=60=60V4L2_CID_CODEC_VP9_HIER_CODING_L1_QP=60=60
> > +    Indicates quantization parameter for hierarchical coding layer 1.
> > +    Valid range: =5BV4L2_CID_CODEC_VP9_MIN_QP,
> > +    V4L2_CID_CODEC_VP9_MAX_QP=5D.
> > +
> > +=60=60V4L2_CID_CODEC_VP9_HIER_CODING_L2_QP=60=60
> > +    Indicates quantization parameter for hierarchical coding layer 2.
> > +    Valid range: =5BV4L2_CID_CODEC_VP9_MIN_QP,
> > +    V4L2_CID_CODEC_VP9_MAX_QP=5D.
> > +
> > +.. _v4l2-vp9-max-partition-depth:
> > +
> > +=60=60V4L2_CID_CODEC_VP9_MAX_PARTITION_DEPTH=60=60
> > +    (enum)
> > +
> > +enum v4l2_mpeg_vp9_num_partitions -
> > +    Indicate maximum coding unit depth.
> > +
> > +.. raw:: latex
> > +
> > +    =5Cfootnotesize
> > +
> > +.. tabularcolumns:: =7Cp=7B9.0cm=7D=7Cp=7B8.0cm=7D=7C
> > +
> > +.. flat-table::
> > +    :header-rows:  0
> > +    :stub-columns: 0
> > +
> > +    * - =60=60V4L2_CID_CODEC_VP9_0_PARTITION=60=60
> > +      - No coding unit partition depth.
> > +    * - =60=60V4L2_CID_CODEC_VP9_1_PARTITION=60=60
> > +      - Allows one coding unit partition depth.
> > +
> > +.. raw:: latex
> > +
> > +    =5Cnormalsize
> > +
> > +
> > +=60=60V4L2_CID_CODEC_VP9_DISABLE_INTRA_PU_SPLIT=60=60
> > +    Zero indicates enable intra NxN PU split.
> > +    One indicates disable intra NxN PU split.
> > +
> > +=60=60V4L2_CID_CODEC_VP9_DISABLE_IVF_HEADER=60=60
> > +    Indicates IVF header generation. Zero indicates enable IVF format.
> > +    One indicates disable IVF format.
> > +
> >
> >  High Efficiency Video Coding (HEVC/H.265) Control Reference
> >
> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D
> =3D