Received: by 2002:a25:31c3:0:0:0:0:0 with SMTP id x186csp989444ybx; Fri, 1 Nov 2019 14:43:50 -0700 (PDT) X-Google-Smtp-Source: APXvYqzEkOTYLl5Qw1AI8OhROvLycPYoztjW0s10jWNDQIcUiYWgKe5MEsuAU3cqoXTZzAOqwNGe X-Received: by 2002:a17:906:e57:: with SMTP id q23mr11978755eji.303.1572644630535; Fri, 01 Nov 2019 14:43:50 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1572644630; cv=none; d=google.com; s=arc-20160816; b=R5qPsen7UQMZqys714JgLViy5jf4rfsDDWKTfY1phlj40yYKJhKypyl3FuaklPF6E1 ciGIJHDlW+GbcvRQKTppTp3tRW+6ayG/1QP+SNt79zO5BqL4tVRpxM+/WpNao+UEdMom 1C7g7XWXk8JZHIJzXxI4Sc/dfHmS7LlE4G4/AVrt5sWfM+GtbpY7SU7xpRbZWSprVSMQ kV2Xj5ctY+/bNuc2CZmgeP0EOFYO8/nK/0W5ENm7dVj5EWlLEZnLdi+qzQhXvHp9qxK3 eAJyM5G9Rt2HtWMBwGDcUwJc7dE+qZTaSuTka2nqxHm37KuGnPwYmDfNJwXw+z45H3fL nbrw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:date:subject:cc:to:from :dkim-signature; bh=qw73byJosffXkuqCyMjGKLHzCzbk8f/W13zIdru5UDs=; b=oPAEmDQGWw9Ie8z9vZZizO5YhXCoMvHBULayEZx9/dyUNMi+nyzV3JHOf3kBSRBjDj 487/8UkTI6Uddj7rsqT1MHAdzAyiqE8ApAI2OSrxkWcmIl6KVKp6U87i2MDAlYSwTMTc J92qUSPRNua63PFEKAFXb+new0UcpnoPzSoxoMIar4rGWUrDN3vG5O2h84fPvmgR6Gzo Hbj27dEzTMxV0HfxG+c3jTUYYnkapa40WCb4ATColBUiA80aAXHl9izT6JMsl7oObYwP oUwIuQcARJ4iIiO++wDftcthtYQqZKS7ZKdK+YIFoKQ/7U9pA3U7O25+VNXT3IVmhyIo AEfw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=U4cNJVCb; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id n20si1225143edr.357.2019.11.01.14.43.27; Fri, 01 Nov 2019 14:43:50 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=U4cNJVCb; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727228AbfKAVmn (ORCPT + 99 others); Fri, 1 Nov 2019 17:42:43 -0400 Received: from mail-pg1-f193.google.com ([209.85.215.193]:39148 "EHLO mail-pg1-f193.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725989AbfKAVmm (ORCPT ); Fri, 1 Nov 2019 17:42:42 -0400 Received: by mail-pg1-f193.google.com with SMTP id p12so7260367pgn.6 for ; Fri, 01 Nov 2019 14:42:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id; bh=qw73byJosffXkuqCyMjGKLHzCzbk8f/W13zIdru5UDs=; b=U4cNJVCbks5NLLHVvES6/rHnlmhJhpSMl4fcP8dWEYgRQCUF/LViLyJ+r3ZlycmBiq U61vGyoMRuhx302M6+QRUXjQcvBE4HNWxrXru+uO+01oARndC8BJr50YVp1WG45/cQiU IJvSFPRE4mNvWR1Z9i7BOkTOp0rFTtS1gsvkL74U24eAVrwEgphnDYbo0igPqVCeSdSh MvMeuNuGNFrUEYPMyMwzTYe+YmDFC2bTBhMqVytVriYjs6Axrx7ciK3b+DeQEkIWZvZr 64yYVOQqb68IRFRymdr40JyPViSmEmFS9TVzhXIL1EZcwONBU4aTh3HjJwlyrC6I31s3 4Ieg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id; bh=qw73byJosffXkuqCyMjGKLHzCzbk8f/W13zIdru5UDs=; b=ZDoDK/Wh1ulSbsAt8ZOiJ7yVEAmt8zWkogwLMJz8oLSNKH6UW4jy8g5lm1AER1Dxoa ySUkDTzv53Qh7E4u7Tag4PmNWOvgOZckUlpuAr2XNUe7HK0yK6NllejelXpV9VdGzUvV jGanZA21eTT09vAs3dNvkicXpBBoRWA+K/ZOe+UInWQ1Cy/pqnnMYpwhtrghPAwAMrKh UcoqTnN2HizvyiYdEy9jQZLSPjvzjRpNSjL1RMk6XqL7C9psbRs0tc0zMneSqGfVA2H2 Pk+AZMO80DVvpnmfD/JOYheH1lF79n567BPoUbRiPtVRM0xfvmirhxPx44QgBlNnzB3M GX4g== X-Gm-Message-State: APjAAAUNHUmbN0uX09FXpUQsmn7I7r5sTeykYMu1T3id8IKjVoaVGaZD fX2w2MLOduqgAgF85cuhPPFR2uBwUFA= X-Received: by 2002:a63:6581:: with SMTP id z123mr15822936pgb.367.1572644561515; Fri, 01 Nov 2019 14:42:41 -0700 (PDT) Received: from localhost.localdomain ([2601:1c2:680:1319:692:26ff:feda:3a81]) by smtp.gmail.com with ESMTPSA id u36sm8299058pgn.29.2019.11.01.14.42.40 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 01 Nov 2019 14:42:41 -0700 (PDT) From: John Stultz To: lkml Cc: John Stultz , Laura Abbott , Benjamin Gaignard , Sumit Semwal , Liam Mark , Pratik Patel , Brian Starkey , Vincent Donnefort , Sudipto Paul , "Andrew F . Davis" , Christoph Hellwig , Chenbo Feng , Alistair Strachan , Hridya Valsaraju , Sandeep Patil , Hillf Danton , Dave Airlie , dri-devel@lists.freedesktop.org Subject: [PATCH v14 0/5] DMA-BUF Heaps (destaging ION) Date: Fri, 1 Nov 2019 21:42:33 +0000 Message-Id: <20191101214238.78015-1-john.stultz@linaro.org> X-Mailer: git-send-email 2.17.1 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This again? I know! Apologies to all who hoped I'd stop bothering them with this patch set, but I ran afoul of the DRM tree rules by not getting the userland patches properly reviewed prior to the patches landing (I mistakenly was waiting for the patches to land upstream before pushing the userland patches). Thus, these were correctly reverted from the drm-misc-next tree. My attempts to quickly fix the userland review issue didn't get very far, as the revert brought additional eyes to the patchset, and further interface changes were requested (comically, which is the exact reason I was waiting to push the userland changes :) So like groundhog day, here we are again, with v14: This patchset implements per-heap devices which can be opened directly and then an ioctl is used to allocate a dmabuf from the heap. The interface is similar, but much simpler then IONs, only providing an ALLOC ioctl (and a GET_FEATURES interface to help with any future changes to the interface). Also, I've provided relatively simple system and cma heaps. I've booted and tested these patches with AOSP on the HiKey960 using the kernel tree here: https://git.linaro.org/people/john.stultz/android-dev.git/log/?h=dev/dma-buf-heap And the userspace changes here: https://android-review.googlesource.com/c/device/linaro/hikey/+/909436 Compared to ION, this patchset is missing the system-contig, carveout and chunk heaps, as I don't have a device that uses those, so I'm unable to do much useful validation there. Additionally we have no upstream users of chunk or carveout, and the system-contig has been deprecated in the common/andoid-* kernels, so this should be ok. I've also removed the stats accounting, since any such accounting should be implemented by dma-buf core or the heaps themselves. New in v14: * Reworked ioctl handler to zero fill any difference in structure size, similar to what the DRM core does, as suggested by Dave Airlie * Removed now unnecessary reserved bits in allocate_data * Added get_features ioctl as suggested by Dave Airlie * Removed pr_warn_once messages as requested by Dave Airlie * Fix missing argment to WARN() in dma_heap_buffer_destroy() found and fixed by Dan Carpenter * Add check in fault hanlder that pgoff isn't larger then pagecount, reported by Dan Carpenter * Fix "redundant assignment to variable ret" issue reported by Colin King and fixed by Andrew Davis * Fix a missing return value in kselftest * Add calls to test the GET_FEATURES ioctl in ksefltest * Build fix reported by kernel test robot and fixed by Xiao Yang for kselftest * Minor kselftest Makefile cleanups Many thanks again to the folks above who found and submitted fixes to small issues while the patches were in -next! I've folded them in to the patch set here. The ioctl rework to avoid reserved fields, was mostly duplicated from the DRM core, but it does add some complexity to the ioctl handler so I'd appreciate extra review. It felt substantial enough that I've removed the previous reviewed by and acked-by tags, but please let me know if you'd like me to re-add yours back. Apologies again for my flub and the extra noise here! I really appreciate everyone's patience with with me. thanks -john Cc: Laura Abbott Cc: Benjamin Gaignard Cc: Sumit Semwal Cc: Liam Mark Cc: Pratik Patel Cc: Brian Starkey Cc: Vincent Donnefort Cc: Sudipto Paul Cc: Andrew F. Davis Cc: Christoph Hellwig Cc: Chenbo Feng Cc: Alistair Strachan Cc: Hridya Valsaraju Cc: Sandeep Patil Cc: Hillf Danton Cc: Dave Airlie Cc: dri-devel@lists.freedesktop.org Andrew F. Davis (1): dma-buf: Add dma-buf heaps framework John Stultz (4): dma-buf: heaps: Add heap helpers dma-buf: heaps: Add system heap to dmabuf heaps dma-buf: heaps: Add CMA heap to dmabuf heaps kselftests: Add dma-heap test MAINTAINERS | 18 + drivers/dma-buf/Kconfig | 11 + drivers/dma-buf/Makefile | 2 + drivers/dma-buf/dma-heap.c | 313 ++++++++++++++++++ drivers/dma-buf/heaps/Kconfig | 14 + drivers/dma-buf/heaps/Makefile | 4 + drivers/dma-buf/heaps/cma_heap.c | 178 ++++++++++ drivers/dma-buf/heaps/heap-helpers.c | 271 +++++++++++++++ drivers/dma-buf/heaps/heap-helpers.h | 55 +++ drivers/dma-buf/heaps/system_heap.c | 124 +++++++ include/linux/dma-heap.h | 59 ++++ include/uapi/linux/dma-heap.h | 77 +++++ tools/testing/selftests/dmabuf-heaps/Makefile | 6 + .../selftests/dmabuf-heaps/dmabuf-heap.c | 255 ++++++++++++++ 14 files changed, 1387 insertions(+) create mode 100644 drivers/dma-buf/dma-heap.c create mode 100644 drivers/dma-buf/heaps/Kconfig create mode 100644 drivers/dma-buf/heaps/Makefile create mode 100644 drivers/dma-buf/heaps/cma_heap.c create mode 100644 drivers/dma-buf/heaps/heap-helpers.c create mode 100644 drivers/dma-buf/heaps/heap-helpers.h create mode 100644 drivers/dma-buf/heaps/system_heap.c create mode 100644 include/linux/dma-heap.h create mode 100644 include/uapi/linux/dma-heap.h create mode 100644 tools/testing/selftests/dmabuf-heaps/Makefile create mode 100644 tools/testing/selftests/dmabuf-heaps/dmabuf-heap.c -- 2.17.1