Received: by 2002:ac0:bc90:0:0:0:0:0 with SMTP id a16csp1480296img; Tue, 19 Mar 2019 08:30:39 -0700 (PDT) X-Google-Smtp-Source: APXvYqymunl+g7tXqogaQmRWwyuwiRHSsy/mVvVfiYahtxSPcHJXhM5MLkCHDZMa54XXAdnWNdAs X-Received: by 2002:a63:e051:: with SMTP id n17mr2366067pgj.19.1553009439083; Tue, 19 Mar 2019 08:30:39 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1553009439; cv=none; d=google.com; s=arc-20160816; b=bmX/+7tJxMaO5hMB0I6YlC65GTvw9rcVYObyMWz4aCC0jLbENuG3WgLFypY+q7xTz+ 9zUxJMDkhEJEJ0KgG3LPQPQVNP++HvqlRYLDVmavtpFqBmAJJLdsMrY4UKS0TTw/RtjW Q4djGXfdUaVV8ayueaRx/KAr9sl8VT/vEdxQsSIv3NYaoARB8Ea3dZtmjaCqr9MGiF3F x5cS0GFC21hPaBkxXm6qdY+XqOF9kJOAaUrbnjxDQCF8D8VxnYl+/XoujWEIl+v1PWbo tkZV6uKD1eXkXesCikPOhSKQWl/eKFTcW+PAGL2Tfu16WkJlVlbJ3jMVAQM/wgoDyef0 Zlvg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from; bh=p5Kfpd9qqc7xtOF7XFey86KB4GgRXNXNd8uMubEhbVc=; b=PAWQfTp1CkwFoim31U0CKMYs2f/kj3Umy7fJqtIk+MT6nzJE1cCZVdehnp7oWNmn95 2/ZvsXu5AkDhWiJqS8VES6sb04Vb8cBdMTlHFMQnunV4V3ONuD9E/uoA8zV3qEes6iLU 2757dDUuqDu3gWTCcNS5H5MjKdfHJfW71pGKE4W9YPcN2AcFfShAPcTQf1sq5TgJqRBM M/4Th5Z23O6dfoTB2X8hTWIErS7upXIyQafMCjwZiO7d970MYXd+xWzw8SpfME7+8ry1 zIwJ+03Ak+Zp73rOzSNG+cEraBvemenBlY+j7rhnKsNZwpO6OrYRWfNUGoWWKtTVltDe z+2w== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id j24si449662pll.135.2019.03.19.08.30.23; Tue, 19 Mar 2019 08:30:39 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727794AbfCSP3f (ORCPT + 99 others); Tue, 19 Mar 2019 11:29:35 -0400 Received: from relay7-d.mail.gandi.net ([217.70.183.200]:56323 "EHLO relay7-d.mail.gandi.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726612AbfCSP3e (ORCPT ); Tue, 19 Mar 2019 11:29:34 -0400 X-Originating-IP: 90.88.33.153 Received: from localhost (aaubervilliers-681-1-92-153.w90-88.abo.wanadoo.fr [90.88.33.153]) (Authenticated sender: maxime.ripard@bootlin.com) by relay7-d.mail.gandi.net (Postfix) with ESMTPSA id 0037520007; Tue, 19 Mar 2019 15:29:29 +0000 (UTC) From: Maxime Ripard To: hans.verkuil@cisco.com, acourbot@chromium.org, sakari.ailus@linux.intel.com, Laurent Pinchart Cc: tfiga@chromium.org, posciak@chromium.org, Paul Kocialkowski , Chen-Yu Tsai , linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-media@vger.kernel.org, nicolas.dufresne@collabora.com, jenskuske@gmail.com, jernej.skrabec@gmail.com, jonas@kwiboo.se, ezequiel@collabora.com, linux-sunxi@googlegroups.com, Thomas Petazzoni , Maxime Ripard Subject: [PATCH v6 0/2] media: cedrus: Add H264 decoding support Date: Tue, 19 Mar 2019 16:29:26 +0100 Message-Id: X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi, Here is a new version of the H264 decoding support in the cedrus driver. As you might already know, the cedrus driver relies on the Request API, and is a reverse engineered driver for the video decoding engine found on the Allwinner SoCs. This work has been possible thanks to the work done by the people behind libvdpau-sunxi found here: https://github.com/linux-sunxi/libvdpau-sunxi/ I've tested the various ABI using this gdb script: http://code.bulix.org/jl4se4-505620?raw And this test script: http://code.bulix.org/8zle4s-505623?raw The application compiled is quite trivial: http://code.bulix.org/e34zp8-505624?raw The output is: arm: builds/arm-test-v4l2-h264-structures SHA1: fd15b30328765c2caac877e8ea8452c829b2b1d8 x86: builds/x86-test-v4l2-h264-structures SHA1: fd15b30328765c2caac877e8ea8452c829b2b1d8 x64: builds/x64-test-v4l2-h264-structures SHA1: fd15b30328765c2caac877e8ea8452c829b2b1d8 arm64: builds/arm64-test-v4l2-h264-structures SHA1: fd15b30328765c2caac877e8ea8452c829b2b1d8 Let me know if there's any flaw using that test setup, or if you have any comments on the patches. Maxime Changes from v5: - Made the references to the H264 spec more explicit - Added a flag for the IDR pic - Fixed typos - Rebased on v5.1-rc1 Changes from v4: - Changed the luma and chroma weight and offset from s8 to s16 - Adjusted chroma and luma denominators masks in the driver - Casted the luma and chroma offset to prevent an overflow - ALways write the interrupt status register - Fix a bug in the sram write routine that would write something even if the length was 0 - Make the scaling lists mandatory - Made the reference list order explicit in the documentation - Made the fact that the slice structure can be an array - Renamed the slice format to V4L2_PIX_FMT_H264_SLICE_RAW - Rebased on Hans' tag br-v5.1s Changes from v3: - Reintroduced long term reference flag and documented it - Reintroduced ref_pic_list_p0/b0/b1 and documented it - Documented the DPB flags - Treat the scaling matrix as optional in the driver, as documented - Free the neighbor buffer - Increase the control IDs by a large margin to be safe of collisions - Reorder the fields documentation according to the structure layout - Change the tag documentation by the timestamp - Convert the sram array to size_t - Simplify the buffer retrieval from timestamp - Rebase Changes from v2: - Simplified _cedrus_write_ref_list as suggested by Jernej - Set whether the frame is used as reference using nal_ref_idc - Respect chroma_format_idc - Fixes for the scaling list and prediction tables - Wrote the documentation for the flags - Added a bunch of defines to the driver bit fields - Reworded the controls and data format descriptions as suggested by Hans - Reworked the controls' structure field size to avoid padding - Removed the long term reference flag - Reintroduced the neighbor info buffer - Removed the ref_pic_list_p0/b0/b1 arrays that are redundant with the one in the DPB - used the timestamps instead of tags - Rebased on 5.0-rc1 Changes from v1: - Rebased on 4.20 - Did the documentation for the userspace API - Used the tags instead of buffer IDs - Added a comment to explain why we still needed the swdec trigger - Reworked the MV col buffer in order to have one slot per frame - Removed the unused neighbor info buffer - Made sure to have the same structure offset and alignments across 32 bits and 64 bits architecture Maxime Ripard (1): media: cedrus: Add H264 decoding support Pawel Osciak (1): media: uapi: Add H264 low-level decoder API compound controls. Documentation/media/uapi/v4l/biblio.rst | 9 +- Documentation/media/uapi/v4l/ext-ctrls-codec.rst | 569 ++++++++++++++- Documentation/media/uapi/v4l/pixfmt-compressed.rst | 19 +- Documentation/media/uapi/v4l/vidioc-queryctrl.rst | 30 +- Documentation/media/videodev2.h.rst.exceptions | 5 +- drivers/media/v4l2-core/v4l2-ctrls.c | 42 +- drivers/media/v4l2-core/v4l2-ioctl.c | 1 +- drivers/staging/media/sunxi/cedrus/Makefile | 3 +- drivers/staging/media/sunxi/cedrus/cedrus.c | 31 +- drivers/staging/media/sunxi/cedrus/cedrus.h | 38 +- drivers/staging/media/sunxi/cedrus/cedrus_dec.c | 13 +- drivers/staging/media/sunxi/cedrus/cedrus_h264.c | 577 ++++++++++++++- drivers/staging/media/sunxi/cedrus/cedrus_hw.c | 4 +- drivers/staging/media/sunxi/cedrus/cedrus_regs.h | 91 ++- drivers/staging/media/sunxi/cedrus/cedrus_video.c | 9 +- include/media/h264-ctrls.h | 192 +++++- include/media/v4l2-ctrls.h | 13 +- include/uapi/linux/videodev2.h | 1 +- 18 files changed, 1644 insertions(+), 3 deletions(-) create mode 100644 drivers/staging/media/sunxi/cedrus/cedrus_h264.c create mode 100644 include/media/h264-ctrls.h base-commit: 9e98c678c2d6ae3a17cb2de55d17f69dddaa231b -- git-series 0.9.1