Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67;
Subject: Re: [RFC 2/3] drm: Add helper iterator functions to iterate over
 plane damage.
To:     Deepak Rawat <drawat@vmware.com>, dri-devel@lists.freedesktop.org,
        syeh@vmware.com, linux-graphics-maintainer@vmware.com,
        ville.syrjala@linux.intel.com, lukasz.spintzyk@displaylink.com,
        noralf@tronnes.org, robdclark@gmail.com, gustavo@padovan.org,
        maarten.lankhorst@linux.intel.com, seanpaul@chromium.org,
        airlied@linux.ie, linux-kernel@vger.kernel.org
References: <1522885748-67122-1-git-send-email-drawat@vmware.com>
 <1522885748-67122-3-git-send-email-drawat@vmware.com>
 <20180405075205.GQ3881@phenom.ffwll.local>
From:   Thomas Hellstrom <thellstrom@vmware.com>
Message-ID: <0edfe662-6463-a143-e00a-d3d4bc06a229@vmware.com>
Date:   Thu, 5 Apr 2018 10:49:09 +0200
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101
 Thunderbird/52.6.0
MIME-Version: 1.0
In-Reply-To: <20180405075205.GQ3881@phenom.ffwll.local>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
Content-Language: en-US
Received-SPF: None (protection.outlook.com: vmware.com does not designate
 permitted sender hosts)
SpamDiagnosticOutput: 1:99
SpamDiagnosticMetadata: NSPM
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Apr 2018 08:49:24.5169 (UTC)
X-MS-Exchange-CrossTenant-Network-Message-Id: 6ae8ced9-e2de-49da-0c81-08d59ad22388
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: b39138ca-3cee-4b4a-a4d6-cd83d9dd62f0
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO2PR05MB763
Sender: linux-kernel-owner@vger.kernel.org
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On 04/05/2018 09:52 AM, Daniel Vetter wrote:
> On Wed, Apr 04, 2018 at 04:49:07PM -0700, Deepak Rawat wrote:
>> With damage property in drm_plane_state, this patch adds helper iterator
>> to traverse the damage clips. Iterator will return the damage rectangles
>> in framebuffer, plane or crtc coordinates as need by driver
>> implementation.
>>
>> Signed-off-by: Deepak Rawat <drawat@vmware.com>
> I'd really like selftest/unittests for this stuff. There's an awful lot of
> cornercases in this here (for any of the transformed iterators at least),
> and unit tests is the best way to make sure we handle them all correctly.
>
> Bonus points if you integrate the new selftests into igt so intel CI can
> run them, seel igt/tests/drm_mm.c for an example. drm_mm selftest is also
> the framework I'd copy for this stuff.
>
>> ---
>>   drivers/gpu/drm/drm_atomic_helper.c | 122 ++++++++++++++++++++++++++++++++++++
>>   include/drm/drm_atomic_helper.h     |  39 ++++++++++++
>>   2 files changed, 161 insertions(+)
>>
>> diff --git a/drivers/gpu/drm/drm_atomic_helper.c b/drivers/gpu/drm/drm_atomic_helper.c
>> index 55b44e3..355b514 100644
>> --- a/drivers/gpu/drm/drm_atomic_helper.c
>> +++ b/drivers/gpu/drm/drm_atomic_helper.c
>> @@ -3865,3 +3865,125 @@ void __drm_atomic_helper_private_obj_duplicate_state(struct drm_private_obj *obj
>>   	memcpy(state, obj->state, sizeof(*state));
>>   }
>>   EXPORT_SYMBOL(__drm_atomic_helper_private_obj_duplicate_state);
>> +
>> +/**
>> + * drm_atomic_helper_damage_iter_init - initialize the damage iterator
>> + * @iter: The iterator to initialize.
>> + * @type: Coordinate type caller is interested in.
>> + * @state: plane_state from which to iterate the damage clips.
>> + * @hdisplay: Width of crtc on which plane is scanned out.
>> + * @vdisplay: Height of crtc on which plane is scanned out.
>> + *
>> + * Initialize an iterator that is used to translate and clip a set of damage
>> + * rectangles in framebuffer coordinates to plane and crtc coordinates. The type
>> + * argument specify which type of coordinate to iterate in.
>> + *
>> + * Returns: 0 on success and negative error code on error. If an error code is
>> + * returned then it means the plane state should not update.
>> + */
>> +int
>> +drm_atomic_helper_damage_iter_init(struct drm_atomic_helper_damage_iter *iter,
>> +				   enum drm_atomic_helper_damage_clip_type type,
>> +				   const struct drm_plane_state *state,
>> +				   uint32_t hdisplay, uint32_t vdisplay)
>> +{
>> +	if (!state || !state->crtc || !state->fb)
>> +		return -EINVAL;
>> +
>> +	memset(iter, 0, sizeof(*iter));
>> +	iter->clips = (struct drm_rect *)state->damage_clips->data;
>> +	iter->num_clips = state->num_clips;
>> +	iter->type = type;
>> +
>> +	/*
>> +	 * Full update in case of scaling or rotation. In future support for
>> +	 * scaling/rotating damage clips can be added
>> +	 */
>> +	if (state->crtc_w != (state->src_w >> 16) ||
>> +	    state->crtc_h != state->src_h >> 16 || state->rotation != 0) {
>> +		iter->curr_clip = iter->num_clips;
>> +		return 0;
> Given there's no user of this I have no idea how this manages to provoke a
> full clip rect. selftest code would be perfect for stuff like this.
>
> Also, I think we should provide a full clip for the case of num_clips ==
> 0, so that driver code can simply iterate over all clips and doesn't ever
> have to handle the "no clip rects provided" case as a special case itself.
>
>> +	}
>> +
>> +	iter->fb_src.x1 = 0;
>> +	iter->fb_src.y1 = 0;
>> +	iter->fb_src.x2 = state->fb->width;
>> +	iter->fb_src.y2 = state->fb->height;
>> +
>> +	iter->plane_src.x1 = state->src_x >> 16;
>> +	iter->plane_src.y1 = state->src_y >> 16;
>> +	iter->plane_src.x2 = iter->plane_src.x1 + (state->src_w >> 16);
>> +	iter->plane_src.y2 = iter->plane_src.y1 + (state->src_h >> 16);
>> +	iter->translate_plane_x = -iter->plane_src.x1;
>> +	iter->translate_plane_y = -iter->plane_src.y1;
>> +
>> +	/* Clip plane src rect to fb dimensions */
>> +	drm_rect_intersect(&iter->plane_src, &iter->fb_src);
> This smells like driver bug. Also, see Ville's recent efforts to improve
> the atomic plane clipping, I think drm_plane_state already has all the
> clip rects you want.
>
>> +
>> +	iter->crtc_src.x1 = 0;
>> +	iter->crtc_src.y1 = 0;
>> +	iter->crtc_src.x2 = hdisplay;
>> +	iter->crtc_src.y2 = vdisplay;
>> +	iter->translate_crtc_x = -(iter->plane_src.x1 - state->crtc_x);
>> +	iter->translate_crtc_x = -(iter->plane_src.y1 - state->crtc_y);
>> +
>> +	/* Clip crtc src rect to plane dimensions */
>> +	drm_rect_translate(&iter->crtc_src, -iter->translate_crtc_x,
>> +			   -iter->translate_crtc_x);
> We can also scale.

I suggest we leave out scaling for now until someone actually needs it.

>
>> +	drm_rect_intersect(&iter->crtc_src, &iter->plane_src);
>> +
>> +	return 0;
>> +}
>> +EXPORT_SYMBOL(drm_atomic_helper_damage_iter_init);
>> +
>> +/**
>> + * drm_atomic_helper_damage_iter_next - advance the damage iterator
>> + * @iter: The iterator to advance.
>> + * @rect: Return a rectangle in coordinate specified during iterator init.
>> + *
>> + * Returns:  true if the output is valid, false if we've reached the end of the
>> + * rectangle list. If the first call return false, means need full update.
>> + */
>> +bool
>> +drm_atomic_helper_damage_iter_next(struct drm_atomic_helper_damage_iter *iter,
>> +				   struct drm_rect *rect)
>> +{
>> +	const struct drm_rect *curr_clip;
>> +
>> +next_clip:
>> +	if (iter->curr_clip >= iter->num_clips)
>> +		return false;
>> +
>> +	curr_clip = &iter->clips[iter->curr_clip];
>> +	iter->curr_clip++;
>> +
>> +	rect->x1 = curr_clip->x1;
>> +	rect->x2 = curr_clip->x2;
>> +	rect->y1 = curr_clip->y1;
>> +	rect->y2 = curr_clip->y2;
>> +
>> +	/* Clip damage rect within fb limit */
>> +	if (!drm_rect_intersect(rect, &iter->fb_src))
>> +		goto next_clip;
>> +	else if (iter->type & DRM_ATOMIC_HELPER_DAMAGE_CLIP_TYPE_FB)
>> +		return true;
>> +
>> +	/* Clip damage rect within plane limit */
>> +	if (!drm_rect_intersect(rect, &iter->plane_src))
>> +		goto next_clip;
>> +	else if (iter->type & DRM_ATOMIC_HELPER_DAMAGE_CLIP_TYPE_PLANE) {
>> +		drm_rect_translate(rect, iter->translate_plane_x,
>> +				   iter->translate_plane_y);
>> +		return true;
>> +	}
>> +
>> +	/* Clip damage rect within crtc limit */
>> +	if (!drm_rect_intersect(rect, &iter->crtc_src))
>> +		goto next_clip;
>> +
>> +	drm_rect_translate(rect, iter->translate_crtc_x,
>> +			   iter->translate_crtc_y);
>> +
>> +	return true;
>> +}
>> +EXPORT_SYMBOL(drm_atomic_helper_damage_iter_next);
>> diff --git a/include/drm/drm_atomic_helper.h b/include/drm/drm_atomic_helper.h
>> index 26aaba5..ebd4b66 100644
>> --- a/include/drm/drm_atomic_helper.h
>> +++ b/include/drm/drm_atomic_helper.h
>> @@ -36,6 +36,37 @@ struct drm_atomic_state;
>>   struct drm_private_obj;
>>   struct drm_private_state;
>>   
>> +/**
>> + * enum drm_atomic_helper_damage_clip_type - type of clips to iterator over
>> + *
>> + * While using drm_atomic_helper_damage_iter the type of clip coordinates caller
>> + * is interested in.
>> + */
>> +enum drm_atomic_helper_damage_clip_type {
>> +	DRM_ATOMIC_HELPER_DAMAGE_CLIP_TYPE_FB       = 0x0,
>> +	DRM_ATOMIC_HELPER_DAMAGE_CLIP_TYPE_PLANE    = 0x1,
>> +	DRM_ATOMIC_HELPER_DAMAGE_CLIP_TYPE_CRTC     = 0x2,
> I'm confused with what exactly these different types of iterators are
> supposed to achieve. TYPE_FB makes sense, that's what vmwgfx and other
> virtual drivers need to figure out which parts of a buffer to upload to
> the host.
>
> TYPE_PLANE I have no idea who needs that. I suggest we just drop it.
>
> TYPE_CRTC is what I'd want to use for manual upload hw, were instead of
> compositing the entire screen we can limit the uploaded area to 1 or 2
> rectangles (depending upon how the hw works). But those drivers want all
> the crtc clip rects for _all_ the planes combined, not for each plane
> individually.
>
> My suggestion is to drop TYPE_CRTC until someone needs it for a driver.
> And most likely the only iterator we want for TYPE_CRTC is one that gives
> you the overall damage area, including alpha/ctm/gamma/everything else,
> coalesced into just 1 clip rect. So probably an entirely different
> function.

Actually for vmwgfx, the display part of the hardware comes in different 
versions and we'd typically expect both the FB coordinates and the CRTC 
coordinates. In the latest version the surface backing the screen needs 
to exactly fit the CRTC scanout area, and if the FB doesn't do that, we 
need to create a surface that does and copy in the kernel driver. After 
that, as a second step, we need to notify the display system of the 
damaged area in CRTC coordinates.


> Summarizing all this, I'd simplify the iterator to:
>
> drm_atomic_helper_damage_iter_init(iter, plane_state);
>
> And leave the other 2 use-cases to the next patch series. For crtc damage
> we probably want:
>
> drm_atomic_helper_crtc_damage(drm_atomic_state, rect)
>
> Which internally loops over all planes and also takes all the other state
> changes into account. That way you also don't have to fix the scaling
> issue, since your current code only handles translation.
>
> Another bit: drm_atomic_helper.c is huge, I'd vote to put all this stuff
> into a new drm_damage_helper.[hc], including new section in drm-kms.rst
> and all that. Splitting up drm_atomic_helper.[hc] is somewhere on my todo
> ...
>
> Cheers, Daniel

/Thomas