Received: by 2002:a25:8b91:0:0:0:0:0 with SMTP id j17csp4434050ybl; Mon, 3 Feb 2020 18:57:55 -0800 (PST) X-Google-Smtp-Source: APXvYqxInbj0ZUOmWfKQ4pgWagQh2p7gQq1T742zTVfyvbQHmcpoICp5zjOMtMbxMb5VhmfFT36m X-Received: by 2002:a9d:518b:: with SMTP id y11mr19316461otg.349.1580785075286; Mon, 03 Feb 2020 18:57:55 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1580785075; cv=none; d=google.com; s=arc-20160816; b=OrNyp/vWs3OtkQ+oMwznerjRJ82+vKXzg05Qi4dMa+pKkkROBB4ElUO+j424JUlCtk ya7GOo+zIbWemFxb2/urbssumdytrdKY5jrx8UUcwrRlxZ4HIWdyO4UipPMZfYq7gIVZ AIVz6cYNKP/dRXtFuXDYIMIdhIvk1ONiiCmKgurFAFVUAkkoScTT0/xI4riKOPVH5Rf+ 8BxvMhVg8bNmvcvTB8EvKWE38LizBMFkXlfuRMPgJab6N5hQtyEPBOMwyH/ro2inHNTV YwP7gzgue0nSuzLbKzcbpWSkvZwMXOk7OZKggYRuLg27B/WEYs9nhsm1fryCRoxr04tr U4vA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=XCoXerpkibNMJc6Hgw89GNrbvkXQaydO3ktnkMY7ZuE=; b=zb63Dw1Du9Py85waoiY5HRD58v8PR+Za7OrAq8j2VcrZnW6UuFisqgjfMyo0mZs10f LjUwasGFiasCrfpnpoCbpbqOm50psscYtlEG7hDX6QOz/v0cTCcmC837T57HAs0TBuNr YkMPtqgkxq1TFwqN4bK4Zy5fEYGkFD86xQkaKdiYu3/O7n9tyM5lShtIUsglkRQ3BimQ yOCecKsgAOBR/UpJQTGukfvOVNr3rY2jJntunl6FKSNmPjCcJojdmR8Ic0dWU/lzFJpc zoiK5ghgS99EUYEmnH6G+p5VNGrk3MnZ1GwRsKYpLDwiSOUyz8ykvEINNFt8S1j92oUI dMnQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@chromium.org header.s=google header.b=Em5+Jugv; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=chromium.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id l6si10434771otk.134.2020.02.03.18.57.42; Mon, 03 Feb 2020 18:57:55 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@chromium.org header.s=google header.b=Em5+Jugv; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=chromium.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727127AbgBDC4u (ORCPT + 99 others); Mon, 3 Feb 2020 21:56:50 -0500 Received: from mail-pf1-f195.google.com ([209.85.210.195]:44133 "EHLO mail-pf1-f195.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726872AbgBDC4u (ORCPT ); Mon, 3 Feb 2020 21:56:50 -0500 Received: by mail-pf1-f195.google.com with SMTP id y5so8645155pfb.11 for ; Mon, 03 Feb 2020 18:56:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=chromium.org; s=google; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=XCoXerpkibNMJc6Hgw89GNrbvkXQaydO3ktnkMY7ZuE=; b=Em5+Jugv6xehllNNi4uXLdPgJKITfVmMdCMwbomGAaIkpILIy4eYQPGKhp1NtWjVq2 ye3lOS2fg8bMbgh/kA3dW/ky3AU7lYGliacB1ILU4nhkHM7LknL91+8RTQs/a1qXo8tp kDP78o2Z4gdEWplfC18X7pnQJfBZITHEHcoQA= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=XCoXerpkibNMJc6Hgw89GNrbvkXQaydO3ktnkMY7ZuE=; b=lyBVbE55XfjwX0isvSw2JVVaTVH9l1+Bm+rNEPDLn2TR9TRymORMo9iWc7avBSfM5y ZTbVSmD/frFx3gZ+wo30VIhJwqjwKEugpXia8bK8N7yTq9+I8F8RyvLLNvAeCz69x5Vx Dx5Ulkn2OS22IrqQs4HdViFBeOLaLGTT3gwbMgR93rePpvhXVaCPfhByECaQwhhfGdn+ oipAkTjB1wLWFqrZ2q7pRGMTWbqKXypdYmjy+4gd9Pt0+Yn9HwsXnL0S2S5YkPiHz8d/ Zt/E3TYxjE/rHCL5qr43DIFVAKXsXNanS5WDwaGcdRzjfmn6lTbugpStYmzXcxJ+5deL AxuA== X-Gm-Message-State: APjAAAUcuzivpy1wKnsFL9ywspCu26zlrwCsErmbSiMK/bxpJ9tQn2xu tBBcfk+auciKLAWifMFhGD8z6Q== X-Received: by 2002:a63:cd15:: with SMTP id i21mr23171308pgg.453.1580785008498; Mon, 03 Feb 2020 18:56:48 -0800 (PST) Received: from tigerii.tok.corp.google.com ([2401:fa00:8f:203:5bbb:c872:f2b1:f53b]) by smtp.gmail.com with ESMTPSA id e1sm22491971pfl.98.2020.02.03.18.56.45 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 03 Feb 2020 18:56:47 -0800 (PST) From: Sergey Senozhatsky To: Hans Verkuil , Tomasz Figa , Mauro Carvalho Chehab , Kyungmin Park , Marek Szyprowski Cc: Sakari Ailus , Laurent Pinchart , Pawel Osciak , linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, Sergey Senozhatsky Subject: [RFC][PATCHv2 00/12] Implement V4L2_BUF_FLAG_NO_CACHE_* flags Date: Tue, 4 Feb 2020 11:56:29 +0900 Message-Id: <20200204025641.218376-1-senozhatsky@chromium.org> X-Mailer: git-send-email 2.25.0.341.g760bfbb309-goog MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hello, V2 of the patchset, reshuffled, added more documentation, addressed some of the feedback ;) Still in RFC, tho v1 link: https://lore.kernel.org/lkml/20191217032034.54897-1-senozhatsky@chromium.org/ --- This is a reworked version of the vb2 cache hints (V4L2_BUF_FLAG_NO_CACHE_INVALIDATE / V4L2_BUF_FLAG_NO_CACHE_CLEAN) support patch series which previsouly was developed by Sakari and Laurent [0]. The patch set attempts to preserve the existing behvaiour - cache sync is performed in ->prepare() and ->finish() (unless the buffer is DMA exported). User space can request “default behavior” override with cache management hints, which are handled on a per-buffer basis and should be supplied with v4l2_buffer ->flags during buffer preparation. There are two possible hints: - V4L2_BUF_FLAG_NO_CACHE_INVALIDATE No cache sync on ->finish() - V4L2_BUF_FLAG_NO_CACHE_CLEAN No cache sync on ->prepare() In order to keep things on the safe side, we also require driver to explicitly state which of its queues (if any) support user space cache management hints (such queues should have ->allow_cache_hints bit set). The patch set also (to some extent) simplifies allocators' ->prepare() and ->finish() callbacks. Namely, we move cache management decision making to the upper - core - layer. For example, if, previously, we would have something like this vb2_buffer_done() vb2_dc_finish() if (buf->db_attach) return; where each allocators' ->finish() callback would either bail out (DMA exported buffer, for instance) or sync, now that "bail out or sync" decision is made before we call into the allocator. Along with cache management hints, user space is also able to adjust queue's memory consistency attributes. Memory consistency attribute (dma_attrs) is per-queue, yet it plays its role on the allocator level, when we allocate buffers’ private memory (planes). For the time being, only one consistency attribute is supported: DMA_ATTR_NON_CONSISTENT. [0] https://www.mail-archive.com/linux-media@vger.kernel.org/msg112459.html Sergey Senozhatsky (12): videobuf2: add cache management members videobuf2: handle V4L2 buffer cache flags videobuf2: add V4L2_FLAG_MEMORY_NON_CONSISTENT flag videobuf2: add queue memory consistency parameter videobuf2: handle V4L2_FLAG_MEMORY_NON_CONSISTENT flag videobuf2: factor out planes prepare/finish functions videobuf2: do not sync caches when we are allowed not to videobuf2: check ->synced flag in prepare() and finish() videobuf2: let user-space know if driver supports cache hints videobuf2: add begin/end cpu_access callbacks to dma-contig videobuf2: add begin/end cpu_access callbacks to dma-sg videobuf2: don't test db_attach in dma-contig prepare and finish Documentation/media/uapi/v4l/buffer.rst | 27 +++++ .../media/uapi/v4l/vidioc-create-bufs.rst | 9 +- .../media/uapi/v4l/vidioc-reqbufs.rst | 22 +++- .../media/common/videobuf2/videobuf2-core.c | 110 +++++++++++++----- .../common/videobuf2/videobuf2-dma-contig.c | 39 ++++++- .../media/common/videobuf2/videobuf2-dma-sg.c | 30 +++-- .../media/common/videobuf2/videobuf2-v4l2.c | 59 +++++++++- drivers/media/dvb-core/dvb_vb2.c | 2 +- drivers/media/v4l2-core/v4l2-ioctl.c | 5 +- include/media/videobuf2-core.h | 17 ++- include/uapi/linux/videodev2.h | 11 +- 11 files changed, 273 insertions(+), 58 deletions(-) -- 2.25.0.341.g760bfbb309-goog