Received: by 2002:a05:6a10:206:0:0:0:0 with SMTP id 6csp3513240pxj; Sun, 20 Jun 2021 23:45:59 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzOmQzS+NIG91EkOvfprA7RHTd5llZKmh7l9kKWrNrUuobMALBT9f8lbR4DySLjJkDLWB3P X-Received: by 2002:a05:6402:1d08:: with SMTP id dg8mr682112edb.299.1624257959539; Sun, 20 Jun 2021 23:45:59 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1624257959; cv=none; d=google.com; s=arc-20160816; b=TOrnhTFWfCCdL5txwJFhgurTWN0i7QUS63EcBSMTpO3crQdqlGPDKhNgvenYNZ5S38 KviWHuDvnpzc9Q5xKkRvZVvdZYuIaOEvucDy1DgoA0f6HQh6PbHvHOhiHoJsZNhwNejt 0Ijvgd2+bo9p92hC74v5dPbNQwasVgywyvbZLwmvRQ+mAHHkRvrSzHQ6s1vlF/nweefr M7Jd/8Tgzplmi0Snh0rCMzyN6ivopDM4NMmkNcl4GVRkIhUk699Q60JnYc8pTxrWANxj 0eZCZ8wmDaCeT6roXQlto3G1Jou+YvOtgvYiBv8KqkLYTd/vSpeojLtdxtX3qrVIWSgs 4XBg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=qYWJuyK1bUpXUNYlMG8y+I7VziTPyHJu5fz70XXNt7o=; b=IAf9wMEUxQq9RYN9UnDkLCtyo0vGnRgaJ2AMyqiVDmxagO8aqdrZWprBdfZ5nXgkav LjCbDmFlzi/ia6uw8iOwQWBpW0/u6/z2PszkRcWcjoNhFbvx+jia/UAhI4JVCOQJTrlc UIUqFv0IbBXurZQtvdrP8bNiSEIayb3OUwCL+wYoJX98NCV2QkIpqTUDQgEGOzi4W9Uj cB6NM63UlR32KDacvt6S6gedPxBpZ2c6QN2X1jSfykLJU12yldDYKVy5fy/kWBQeMSPe /17+U11Xp1i0xFLYD4M2NGVta24I1pc92jly/jWvA7mxKJWGmqYY5+yvA3QqVS0d2DV1 XsCA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@igel-co-jp.20150623.gappssmtp.com header.s=20150623 header.b=zSsBl46X; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id gq9si9253406ejb.720.2021.06.20.23.45.37; Sun, 20 Jun 2021 23:45:59 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@igel-co-jp.20150623.gappssmtp.com header.s=20150623 header.b=zSsBl46X; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229937AbhFUGqt (ORCPT + 99 others); Mon, 21 Jun 2021 02:46:49 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:37568 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229618AbhFUGqr (ORCPT ); Mon, 21 Jun 2021 02:46:47 -0400 Received: from mail-pg1-x532.google.com (mail-pg1-x532.google.com [IPv6:2607:f8b0:4864:20::532]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 07DB8C061756 for ; Sun, 20 Jun 2021 23:44:33 -0700 (PDT) Received: by mail-pg1-x532.google.com with SMTP id t13so1549711pgu.11 for ; Sun, 20 Jun 2021 23:44:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=igel-co-jp.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=qYWJuyK1bUpXUNYlMG8y+I7VziTPyHJu5fz70XXNt7o=; b=zSsBl46XOGZe6gvr8o3kSN6cTIPzym+tkv/0ToxwVp80014S9cjzeYVaJTe7IchkT3 KzO0Rrnnnb0txcx1hIR4xdteZ4vsg1vsE5Y2rnAl/G3FEoMMUe2KYfexSXNGEnx8OtaS ECt8k6XlbFEv1yvP34tPW4y704OmqqlCktx5y0nZXNr5gSEpSpphC9BAjnL5HgbeUDxo TAUXuI8SUtGC7pJsajJykD2gc7WtGj2LQTUZ5G9Rv5/EQwUDJDHyBKw9zMX/1Iq/8Y1Y i7XI+UqHlL1TCvgn8DVn8B21N4EHMGd/uaasHWQaYYI8Ky00kLsBtw7bGJMey2M24OBS 7H9A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=qYWJuyK1bUpXUNYlMG8y+I7VziTPyHJu5fz70XXNt7o=; b=gE4u2zJswd39cL/PIJTTXpDj1kqbxmHNeCxrbWGbPtLDJ9AZIbZ1s8tYVeKoFR+R8g tNNEG2OA+taPUpIf2X62QW/Zl6fuaHRkwd/9xdo91mLmYHHTZa3PqydWemtk1c8ae27t Ank1QsCwpPofDalGhBiH2KSwdcdlOWgm5MWq5Z+RdZuvpfBMDCmcjUuriPj651MN+9Yw U7VFKyw42CcL9Z4w0l8m8qiqyRa9HP1lb1XXyhNhqzo8/BO4bpjzW/ZjDCGmkU1AWSwe t8Ls7EURBqf0EQZ27NXQzIZfgctutnNM4pIdWYJ/LNk6pg1OhrmAAXTx/vwI8phfAJ8F DcaA== X-Gm-Message-State: AOAM533T8u1JDBN2fdkpmCzuUtdeKU2d4Tw7Fkxq/oVYbzCjYxB0Jnqf iUrEX0r0k8pFZSL7zSnggSjQcw== X-Received: by 2002:a62:ee16:0:b029:2fe:ffcf:775a with SMTP id e22-20020a62ee160000b02902feffcf775amr17476747pfi.59.1624257872488; Sun, 20 Jun 2021 23:44:32 -0700 (PDT) Received: from localhost.localdomain ([240b:10:c9a0:ca00:61b8:26ec:dc30:8823]) by smtp.gmail.com with ESMTPSA id o34sm12744450pgm.6.2021.06.20.23.44.28 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 20 Jun 2021 23:44:32 -0700 (PDT) From: Tomohito Esaki To: Maarten Lankhorst , Maxime Ripard , Thomas Zimmermann , David Airlie , Daniel Vetter , Laurent Pinchart , Kieran Bingham Cc: dri-devel@lists.freedesktop.org, linux-renesas-soc@vger.kernel.org, linux-kernel@vger.kernel.org, devicetree@vger.kernel.org, linux-doc@vger.kernel.org, Tomohito Esaki Subject: [PATH 0/4] [RFC] Support virtual DRM Date: Mon, 21 Jun 2021 15:43:59 +0900 Message-Id: <20210621064403.26663-1-etom@igel.co.jp> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hello Sorry, there was a typo in the dri-devel mail address, so I've resend it. --- Virtual DRM splits the overlay planes of a display controller into multiple virtual devices to allow each plane to be accessed by each process. This makes it possible to overlay images output from multiple processes on a display. For example, one process displays the camera image without compositor while another process overlays the UI. Virtual DRM driver doesn’t directly control the display hardware and has no access to the physical bus. Instead, the virtual DRM driver issues requests to the standard DRM device driver (parent) when the hardware needs to be controlled. The parent is modified to notify the virtual DRM driver of interruptevents from the display hardware. Therefore, in order to use virtual DRM, each DRM device driver needs to add code to support virutal DRM. The only driver supported in this patch series is rcar-du. This patch series is divided into multiple. The first patch adds vDRM feature to DRM, and the second patch support vDRM for the rcar-du driver. The other patches add documentation. In particular, I would appreciate your advice on the following points: * virtual DRM generalization I've only tested with rcar-du, is there anything I should consider to make virtual DRM work with other drivers? * Integration to upstream I think it is a good idea to add virtual DRM to the DRM core functionality, but I would appreciate any suggestions on what needs to be improved for integration to upstream. * dumb_create and fb_create callback I think that the dumb_create and fb_create callbacks need to be done by the parent, and it is preferable to use the parent's callbacks as they are. However, since the dumb buffer needs to be registered in the parent and the fb handle needs to be registered in the drm_file of the vDRM, the dumb_create callbacks from the parent driver cannot be used as is. Therefore, the current implementation of the dumb_create callback is workarround. What do you think is the best way to deal with this issue? Tomohito Esaki (4): Add Virtual DRM device driver rcar-du: Add support virtual DRM device dt-bindings: display: Add virtual DRM doc-rst: Add virtual DRM documentation .../devicetree/bindings/display/vdrm.yaml | 67 ++ Documentation/gpu/drivers.rst | 1 + Documentation/gpu/vdrm.rst | 51 ++ drivers/gpu/drm/Kconfig | 7 + drivers/gpu/drm/Makefile | 1 + drivers/gpu/drm/rcar-du/Kconfig | 4 + drivers/gpu/drm/rcar-du/Makefile | 1 + drivers/gpu/drm/rcar-du/rcar_du_crtc.c | 42 + drivers/gpu/drm/rcar-du/rcar_du_crtc.h | 13 + drivers/gpu/drm/rcar-du/rcar_du_drv.c | 13 + drivers/gpu/drm/rcar-du/rcar_du_drv.h | 3 + drivers/gpu/drm/rcar-du/rcar_du_vdrm.c | 191 ++++ drivers/gpu/drm/rcar-du/rcar_du_vdrm.h | 67 ++ drivers/gpu/drm/rcar-du/rcar_du_vsp.c | 22 + drivers/gpu/drm/rcar-du/rcar_du_vsp.h | 1 + drivers/gpu/drm/vdrm/vdrm_api.h | 68 ++ drivers/gpu/drm/vdrm/vdrm_drv.c | 859 ++++++++++++++++++ drivers/gpu/drm/vdrm/vdrm_drv.h | 80 ++ 18 files changed, 1491 insertions(+) create mode 100644 Documentation/devicetree/bindings/display/vdrm.yaml create mode 100644 Documentation/gpu/vdrm.rst create mode 100644 drivers/gpu/drm/rcar-du/rcar_du_vdrm.c create mode 100644 drivers/gpu/drm/rcar-du/rcar_du_vdrm.h create mode 100644 drivers/gpu/drm/vdrm/vdrm_api.h create mode 100644 drivers/gpu/drm/vdrm/vdrm_drv.c create mode 100644 drivers/gpu/drm/vdrm/vdrm_drv.h -- 2.25.1