Received: by 2002:ac0:bc90:0:0:0:0:0 with SMTP id a16csp1546266img; Tue, 19 Mar 2019 09:56:03 -0700 (PDT) X-Google-Smtp-Source: APXvYqxKvqnLIFvDM1RLHSe8sjTwKDIvNK1PrB2+vfiLgOf2iim7snlWPhSkiWCnbBTK4ZigmrDy X-Received: by 2002:aa7:8589:: with SMTP id w9mr3019246pfn.97.1553014563018; Tue, 19 Mar 2019 09:56:03 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1553014563; cv=none; d=google.com; s=arc-20160816; b=Jag7af19zU65wUuyzb+RVGID2rSr/qWCA6l0XWHEWiG53nBktRsa136N/u8POwvNQC A3ni5Rl5A/Ic4pEa41RTmQ08zZDji/SUuwamHPKONmAqfu0jA+ipbWXSe3aR0L5v430Y 45JVzwfHkMmfKGQ59a5oUjTZHjdHo7M2mvGxvwtZ2ZkuwVrQc+oMEhjrDnFv8p0KwR9e oDl42BwLkBrX6xWzzLU1ZKxyfqmeGq4h835wSVfEB5YmzBPrFV4TvL0iNuiwYQyQR6uS MMQ5a1T5DfrrsicRZndx/xn32KSih1Nms10MVSkk0HGbH+XyZ+0u1KU5UH2KSvUCU9HP d1Dg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:cc:to:subject :message-id:date:from:in-reply-to:references:mime-version :dkim-signature; bh=C2k/jvxT12JTCn06gWyv3Ma2kAVCCGm0MNm+5pepa5I=; b=Suek1P9D2bGmBj8+2DQr8DcJmJitPcb4FdwyEe8n3ECsUHiyjqSpqpwoFuckWSYymJ e/eaTRn6+9z1XBroYofsyo0Va5aN1agju2kOqGt0yt3exiPEM+D3BpStMD6LjopLJCjs ba9OoH917YPoqKplRtZ6TuDr27EphbQXXogXjqqbYNsI0AT4tpu9naSjzIR/TLIxibjm etpm2Dg0Ufa8Oe0xi/xws/X4oKyC/XeONLMEG987ydeiSiAdIYxeqg8HKE3g/mK++hgS NqX8blfKdPn4/q62VCfMLjsmwryNpenReOUq9XoPS0SJPtzh0mwWhYUnYrp/xisK7EUt oqzg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=Ge556CLM; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id d5si12586080pla.312.2019.03.19.09.55.47; Tue, 19 Mar 2019 09:56:03 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=Ge556CLM; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727799AbfCSQzF (ORCPT + 99 others); Tue, 19 Mar 2019 12:55:05 -0400 Received: from mail-qt1-f195.google.com ([209.85.160.195]:34286 "EHLO mail-qt1-f195.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727612AbfCSQzD (ORCPT ); Tue, 19 Mar 2019 12:55:03 -0400 Received: by mail-qt1-f195.google.com with SMTP id k2so22983995qtm.1 for ; Tue, 19 Mar 2019 09:55:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=C2k/jvxT12JTCn06gWyv3Ma2kAVCCGm0MNm+5pepa5I=; b=Ge556CLMfqtyErDjuoVo8+B8729uGBIpghuhOutjeyd5CT3k0RNr7WbZpZHwS02Fh/ 4Qz/t63Uwb1D23oFvouZ5cZhBtrk8RXVV+zXSOOyUeRY+kCIbAmsDQzqdwGgaOH0p7aa 0hgdWoKx8z8OsKwqrX9V0ZGRhTT3L76d/GzRFNLdcFkXPxcDjdZO5gNTrVCWE2h2sWxC SLLH9llFl/TYHFxzRHGw+p1UptqRr3Hvg/yeDWKc2hrmBLe5bqJsYvNK3Z5jvl90kQBn uLP8zGipr2wEN0tZO6qsIhmuYHf5FBA4jhYXJ6aIx3JGM3E5hW/2sxzP32of2FR5Pl2U pusw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=C2k/jvxT12JTCn06gWyv3Ma2kAVCCGm0MNm+5pepa5I=; b=Zng3Ppz18jN8YGoOolqVSDgDgUfO4Us2Ymh0DtuvXaDk+P21Fz2yK6oewEZ1DYYR2o 7Tnb8aaMDWsXiwAw5WoJZmI1cwtr1RvmeCEWlBvnhK/GsFoUUV7WrGYVa/CbPC+eBlfN hG+Tvfk8tEXHeqh8EAIh4M/jKVWRBlvd8BthixCOhL74uT2smbxe1TpXEtW2UzbTUweG TlcmjlB6hJqQXO03fyA2pXmV2I5IKiFoEm39cAQ9ucr0iFcXK9TWA1SCcRlHvl0x83wj +rw+9SsLJqGPGnDPSX6IKu6labHHly1PXILB2BaSmseJW+FkeWtTHniX0MoxLmOaIFei 0KSQ== X-Gm-Message-State: APjAAAX2K7ysSYgeP15YNF5cU47W6LmF/xNphf3IfIX7meIdjigfuj/x kAjH9QD6ucwcR6JCYXNIX3fg6LFiPwBWHjenGMYygg== X-Received: by 2002:aed:20e4:: with SMTP id 91mr2769929qtb.362.1553014501863; Tue, 19 Mar 2019 09:55:01 -0700 (PDT) MIME-Version: 1.0 References: <1551819273-640-1-git-send-email-john.stultz@linaro.org> In-Reply-To: From: Benjamin Gaignard Date: Tue, 19 Mar 2019 17:54:50 +0100 Message-ID: Subject: Re: [RFC][PATCH 0/5 v2] DMA-BUF Heaps (destaging ION) To: John Stultz Cc: Liam Mark , lkml , Laura Abbott , Greg KH , Sumit Semwal , Brian Starkey , "Andrew F . Davis" , Chenbo Feng , Alistair Strachan , dri-devel , Vincent Donnefort , Marissa Wall Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Le mer. 13 mars 2019 =C3=A0 23:31, John Stultz a = =C3=A9crit : > > On Wed, Mar 13, 2019 at 1:11 PM Liam Mark wrote: > > On Tue, 5 Mar 2019, John Stultz wrote: > > > > > > Eventual TODOS: > > > * Reimplement page-pool for system heap (working on this) > > > * Add stats accounting to system/cma heaps > > > * Make the kselftest actually useful > > > * Add other heaps folks see as useful (would love to get > > > some help from actual carveout/chunk users)! > > > > We use a modified carveout heap for certain secure use cases. > > Cool! It would be great to see if you have any concerns about adding > such a secure-carveout heap to this framework. I suspect it would be > fairly similar to how its integrated into ION, but particularly I'd be > interested in issues around the lack of private flags and other > allocation arguments like alignment. > > > Although there would probably be some benefit in discssing how the dma-= buf > > heap framework may want to support > > secure heaps in the future it is a large topic which I assume you don't > > want to tackle now. > > So I suspect others (Benjamin?) would have a more informed opinion on > the details, but the intent is to allow secure heap implementations. > I'm not sure what areas of concern you have for this allocation > framework in particular? yes I would be great to understand how you provide the information to tell that a dmabuf is secure (or not) since we can't add flag in dmabuf structure itself. An option is manage the access rights when a device attach itself to the dmabuf but in this case you need define a list of allowed devices per heap... If you have a good solution for secure heaps you are welcome :-) Benjamin > > > We don't have any non-secure carveout heap use cases but the client use > > case I have seen usually revolve around > > wanting large allocations to succeed very quickly. > > For example I have seen camera use cases which do very large allocation= s > > on camera bootup from the carveout heap, these allocations would come f= rom > > the carveout heap and fallback to the system heap when the carveout hea= p > > was full. > > Actual non-secure carveout heap can perhaps provide more detail. > > Yea, I'm aware that folks still see carveout as preferable to CMA due > to more consistent/predictable allocation latency. I think we still > have the issue that we don't have bindings to establish/configure > carveout regions w/ dts, and I'm not really wanting to hold up the > allocation API on that issue. > > > > Since we are making some fundamental changes to how ION worked and sinc= e > > Android is likely also be the largest user of the dma-buf heaps framewo= rk > > I think it would be good > > to have a path to resolve the issues which are currently preventing > > commercial Android releases from moving to the upstream version of ION. > > Yea, I do see solving the cache management efficiency issues as > critical for the dmabuf heaps to be actually usable (my previous > version of this patchset accidentally had my hacks to improve > performance rolled in!). And there are discussions going on in > various channels to try to figure out how to either change Android to > use dma-bufs more in line with how upstream expects, or what more > generic dma-buf changes we may need to allow Android to use dmabufs > with the expected performance they need. > > > I can understand if you don't necessarily want to put all/any of these > > changes into the dma-buf heaps framework as part of this series, but my > > hope is we can get > > the upstream community and the Android framework team to agree on what > > upstreamable changes to dma-buf heaps framework, and/or the Android > > framework, would be required in order for Android to move to the upstre= am > > dma-buf heaps framework for commercial devices. > > Yes. Though I also don't want to get the bigger dma-buf usage > discussion (which really affects all dmabuf exporters) too tied up > with this patch sets attempt to provide a usable allocation interface. > Part of the problem that I think we've seen with ION is that there is > a nest of of related issues, and the entire thing is just too big to > address at once, which I think is part of why ION has sat in staging > for so long. This patchset just tries to provide an dmabuf allocation > interface, and a few example exporter heap types. > > > I don't mean to make this specific to Android, but my assumption is tha= t > > many of the ION/dma-buf heaps issues which affect Android would likely > > affect other new large users of the dma-buf heaps framework, so if we > > resolve it for Android we would be helping these future users as well. > > And I do understand that some the issues facing Android may need to be > > resolved by making changes to Android framework. > > While true, I also think some of the assumptions in how the dma-bufs > are used (pre-attachment of all devices, etc) are maybe not so > realistic given how Android is using them. I do want to explore if > Android can change how they use dma-bufs, but I also worry that we > need to think about how we could loosen the expectations for dma-bufs, > as well as trying to figure out how to support things folks have > brought up like partial cache maintenance. > > > I think it would be helpful to try and get as much of this agreed upon = as > > possible before the dma-buf heaps framework moves out of staging. > > > > As part of my review I will highlight some of the issues which would > > affect Android. > > In my comments I will apply them to the system heap since that is what > > Android currently uses for a lot of its use cases. > > I realize that this new framework provides more flexibility to heaps, s= o > > perhaps some of these issues can be solved by creating a new type of > > system heap which Android can use, but even if the solution involves > > creating a new system heap I would like to make sure that this "new" > > system heap is upstreamable. > > So yea, I do realize I'm dodging the hard problem here, but I think > the cache-management/usage issue is far more generic. > > You're right that this implementation give a lot of flexibility to the > exporter heaps in how they implement the dmabuf ops (just like how > other device drivers that are dmabuf exporters have the same > flexibility), but I very much agree we don't want to add a system and > then later a "system-android" heap. So yea, a reasonable amount of > caution is warranted here. > > Thanks so much for the review and feedback! I'll try to address things > as I can as I'm traveling this week (so I may be a bit spotty). > > thanks > -john