Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <250358e5-d6bb-1941-8d93-023531626145@synaptics.com>
Date:   Thu, 31 Aug 2023 17:32:28 +0800
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101
 Thunderbird/102.13.0
Subject: Re: Stateless Encoding uAPI Discussion and Proposal
Content-Language: en-GB
To:     Nicolas Dufresne <nicolas.dufresne@collabora.com>
Cc:     Paul Kocialkowski <paul.kocialkowski@bootlin.com>,
        linux-kernel@vger.kernel.org, linux-media@vger.kernel.org,
        Hans Verkuil <hverkuil@xs4all.nl>,
        Sakari Ailus <sakari.ailus@iki.fi>,
        Andrzej Pietrasiewicz <andrzej.p@collabora.com>,
        Michael Tretter <m.tretter@pengutronix.de>,
        =?UTF-8?Q?Jernej_=c5=a0krabec?= <jernej.skrabec@gmail.com>,
        Chen-Yu Tsai <wens@csie.org>,
        Samuel Holland <samuel@sholland.org>,
        Thomas Petazzoni <thomas.petazzoni@bootlin.com>,
        ayaka <ayaka@soulik.info>
References: <ZK2NiQd1KnraAr20@aptenodytes> <ZNTp1e4gJ2zeYmS-@aptenodytes>
 <a2e8e01ea754232dd3562b34702b6600d7358605.camel@collabora.com>
 <ZNaVQ-zxIuCpGGha@aptenodytes>
 <720c476189552596cbd61dd74d6fa12818718036.camel@collabora.com>
 <39270c5e-24ab-8ff6-d925-7718b1fef3c4@synaptics.com>
 <a0fa6559c3933a5a4c8b7502282adae3429e0b57.camel@collabora.com>
 <52e9b710-5011-656b-aebf-8d57e6496ddd@synaptics.com>
 <e5b416f54fb18363c88813ab3240e6f9c48081f9.camel@collabora.com>
From:   Hsia-Jun Li <Randy.Li@synaptics.com>
In-Reply-To: <e5b416f54fb18363c88813ab3240e6f9c48081f9.camel@collabora.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?OXFKU09iL1FnaFJ6VldmN1Jqa2N4NmN5ekg1aXZYQWpQT3c0ZC9pZDhWWFRy?=
 =?utf-8?B?TzlqdVFFR2tIdHEyd0FNb2JOQlMrVzEzeWJiZExWZlhVZHVGWUVvNkMwYzk2?=
 =?utf-8?B?R3pNRXhuSlI5L2Y1N2RQUnVZQ0VDbHhlMm4vd3BZUmh6WS90cE16a0REc1pS?=
 =?utf-8?B?aW5OdDR3RkJqSXdWTWJ6Uk04SjYwS0ZhT2UrdUtYSDFQMVJ6YjkrZmZhU21Z?=
 =?utf-8?B?akZrTm9xbWVLVVBFWERqLzdWMUpjamtEQ1NoeVhLZVlkeTRXbnFvcTB0a1ZE?=
 =?utf-8?B?Mll5cCtSbndscGN2aXdrYjdpNzlZRk9YZlBnZkVqTi9iNHdFSmJIUVBTK1Jk?=
 =?utf-8?B?bkZqcEd3UTZUREY1ck5DdWJ2RGJSWVN0N0wzQkhsVzlDUktEZVJkeEI0UUdL?=
 =?utf-8?B?MWk4NkVTRkVXT1JVSS84NkcrRDQxcWR2b2U2ejNYTmlDZTdWSUNKYkhtb29t?=
 =?utf-8?B?TlZZNWhiZkFHYmxGQVBpdHJJaE0xdVMxSHZBbHozMXNqTGtDSTUwcDJkU1ht?=
 =?utf-8?B?NnFUWVAvNG9MZG9Pbkp3bzRMV25xUkhTeUtDNUVnUWlzNHBVbk9sYlVqUEZO?=
 =?utf-8?B?OUZTRVl5QW9SaDlRM0NFOWFiLysvNStpUUlBRXd2T1JBck0wZHFsR2k5OE9P?=
 =?utf-8?B?MzNVRVJXalhGR1hyRzQ5citjMHA0NEowMnU1ZnllTUNYbVFvamhtb0ZsVXZ0?=
 =?utf-8?B?dnBZdXh0TmlsblJPanMxV291clpldmg5d09rbDBLU21RdWNEWjcvSGk2L3Nz?=
 =?utf-8?B?d1A4NVNJZmdiSGpCYUxVUG5YUVlQdGs4K0pGSEhNaXNkV0pXWGlpTDR5NFZW?=
 =?utf-8?B?M1ViblRxdmNNZUxOYUIrV09oZytpOUFON1k1TzdodFJuS3ovV2xtVXVEK1hs?=
 =?utf-8?B?ZXh3YWhleHBrL2VyK1JIbUxJNHZ4Y1Y3bFJ1RXVVN1JDNFJrZEFJWnBaV2Yy?=
 =?utf-8?B?b3J4OEp4M3J6SVZBZGZyMnVsUVNGL0RXc0xRaDNFV3dxTDByUXVTb25kT1ds?=
 =?utf-8?B?dEtIK2dvdUIycnZHT05kYlJSYUxCaHFCSUNucmdFVUowekJvWXVHTkxyMUg3?=
 =?utf-8?B?RnhuQjNaSEdvSk9xaURrNFYrSytBMEhLV2hyYlVoREphZzVlRnFzZmpIMXQ3?=
 =?utf-8?B?dUtQT3lVS0ZUdFFhZy9JeGlBbGRBRDl3bjExbXlEM21SdFpVUW9kR2xWVnRx?=
 =?utf-8?B?U3dINGpzb2g3VWloNGxBWWtsTEhnRWRxcmd5OW50VDhYUHViWmFmTXdJSHFT?=
 =?utf-8?B?d3FNQXViL1RpVGxvVUpZM3VIYkdVTnRGbzVBM0l6WTdTdGMvYThSRWM2QlM3?=
 =?utf-8?B?ZUxzbWJoQVFvdUtXVWJWSk1KSEJSajNWbkM1R0xUa2RuMGxkU2lzelorWEcx?=
 =?utf-8?B?Ti85a253RWtXQkp6NmxIMTRyRmd2WUNUeVVIZVR1dHBVcFh3UVZOanRseDdx?=
 =?utf-8?B?T0VhbFRUZkI3MFNXMC9oekN2TTB0T2ZSL1dvVXFmUE8zaFllN3o2Q214bjl2?=
 =?utf-8?B?VHdTZmRwRzBicElDa0p6djZZQkJZaDN3UGI0TnczL2hYOUJqMGpacWVVcnlG?=
 =?utf-8?B?UDN3OEMvZTdDdFdZdXlkd0JiQ1FTeFJrQ1JIT0dxYnVQeFZHbG05REdDMkNN?=
 =?utf-8?B?Mzl2RUFzR01wNUpERUlhOStCSUk5dmhKSVh4WXBHM2sxaCtLNkVuV1JpVHNM?=
 =?utf-8?B?Z0RKTXU3Q3RnMmwyWlFSazJqN0RwaWg0ZGd6VWpxQUxuN3M0UmpPem9ReUJ5?=
 =?utf-8?B?dCt1Yit0dU1pQVRid28xb2dvYTJYTlh0V0tTQ2hEc1RQNTJSTTZOUzVDRmhU?=
 =?utf-8?B?T1NlNEg1azhYWnY0Tjk4ai9rdWVVd3VxRG5TZHc1RGwwVnJ0T2tqbE44UTVX?=
 =?utf-8?B?VWltQXM2eW40blZZbUFXSXVMeXYzKzY4c2tqcDJFVi96Ni90T3pMTDVWQUht?=
 =?utf-8?B?Qm9IUWp5WkJhRnZtQ0twUy9oUFdvdkVPR1ZuWGw0d3p5MDNBMk0venB5Umx2?=
 =?utf-8?B?KzN6K1VyM0s0YmJhWk5rWDVScjNMK3VaR0pPdVFUUGYvc0IzeTdUVVRZMkt5?=
 =?utf-8?B?UjJzMzc0WjRHcEhQOHVjN2xkN1BVU1FDd0lVT05KVEdxZ2JiTllmOXU4UG0r?=
 =?utf-8?Q?odpdM5A4CjeYB4Gn0plWLafl6?=
X-OriginatorOrg: synaptics.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 27bedecc-1489-49d7-2907-08dbaa05375b
X-MS-Exchange-CrossTenant-AuthSource: DM6PR03MB5196.namprd03.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 31 Aug 2023 09:32:38.7005
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 335d1fbc-2124-4173-9863-17e7051a2a0e
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: JIqm29bbaVb5oFV7LDlJUDWvqjxM6/q2zyM9bHVfad7zK3nf4SVgXnYDAHmuDo8Y+MEaLuVhK1Ekn46UciArgQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN7PR03MB7231
X-Spam-Status: No, score=-5.6 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A,
        RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org


On 8/30/23 23:18, Nicolas Dufresne wrote:
> CAUTION: Email originated externally, do not click links or open attachments unless you recognize the sender and know the content is safe.
> 
> 
> Le mercredi 23 août 2023 à 11:04 +0800, Hsia-Jun Li a écrit :
>>> It was suggested so far to leave h264 slice headers writing to the driver. This
>>> is motivated by H264 slice header not being byte aligned in size, so the
>> H.264, H.265 has the byte_alignment() in nalu. You don't need skip bits
>> feature which could be found in H1.
> 
> As you said so, I rechecked the H.264 grammar.
> 
> ...
>    slice_header( )
>    slice_data( )
> ...
> 
> There is lot of variable size items in the slice_header() syntax and no padding
> bits. And no padding at the start of any of the slice_data types. So no, the
> slice_header() syntax in H.264 is not byte aligned like you are claiming here.
> Its important to be super accurate about these things, as it will cause errors
> to be made. Please always double check.
To make a summary of the IRC.
H.264 and VP8 have no such alignment to byte padding bits.
While H.265 has that in 7.3.6.1 General slice segment header syntax.
Also, from 6.1 Frame syntax of AV1, I think frame_header_obu contains 
all the thing that software should prepare for a stateless encoder.
VP9 also has the trailing_bits() after uncompressed_header() (6.1
Frame syntax) would meet the byte alignment.

We may suggest we could use the hardware write-back or write offset bit 
functions which could be widely existed due the non-alignment bitstream 
syntax of the H.264 and VP8.

With such a hardware capability, we could save a cache operation than 
doing that in the kernel.
> 
> Nicolas

-- 
Hsia-Jun(Randy) Li