Received: by 2002:a25:1985:0:0:0:0:0 with SMTP id 127csp989801ybz; Fri, 1 May 2020 12:15:26 -0700 (PDT) X-Google-Smtp-Source: APiQypKBreijLAHt6udqA3WbPU72bWHvB9Vaqifh+fSfp9kOApApH+YkiYdsPr6j/2VtLH90J4W3 X-Received: by 2002:a50:9e2a:: with SMTP id z39mr4869307ede.371.1588360526507; Fri, 01 May 2020 12:15:26 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1588360526; cv=none; d=google.com; s=arc-20160816; b=x/iwNG5gy7VVWkVBufe+dQOuryyT4LTEPTqJnAReh6tTCw/8ZOppC7W6imUOFAStk+ SDpAjbJWsdG7zvMpcaUqAymoz9gVi/UD5H3QifTQFEdoyWsg3Q62t5CSN67Bf4PCiZZu kpeu7+crnYj0aPwSjIU48TcWyH3bF+SvyFr6KJc6ig5LGFyo2eNy2GQpdoj6YUEzampi unuRgWiiFDjucpqssDZxp7qSfoSOEYZiy62zNYkYAjGI3JzX115QXN84aMP00IiMm/Z7 sq/EUD0Ldtdv2dQ5asLrKHQMEHqF5OB2A0e5B6UoxxEz41rWEhSV9mLegKoebdOsMyzA ugTg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:mime-version:user-agent:date:message-id:cc:to :subject:from:dkim-signature; bh=c5dK1AbklroYAW5CprN7zWLQ3v0LEJ5QJui3W0lSbjE=; b=GfbdRTs5uw/Y4wCdRE8VHA8sznc7tArwhJ4zEzMtX9/zcLHgaEmhMUNqkQI8EyjpQS iGEZrTDrmHxKwmjV8rIz7fgHUMBxZFlc9p4JACiM0oJJ0fcBBBAnuLEBGU9ISprx55a5 wwerZDE+/XvidYp+IpqcKTT9zWUWl61vyRW1Fv15WWseetWnSZ/y+dz+1ST0t646jDFg 0P8nOXncJVD4TEXLJmhTVIHQnBdfagLVuDCcd4tIqd2d/3xI4RV+Xh9vKkLifab84JEQ Ki5NjPsFOjMOFnukTy1d/Gzvk+rpt4Gi/3H+XqRDxODZdmptI5vYEQ1dnal2SjLRTPh1 JMng== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel-dk.20150623.gappssmtp.com header.s=20150623 header.b=hEYy9ALw; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id p7si2377507ejz.412.2020.05.01.12.15.01; Fri, 01 May 2020 12:15:26 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel-dk.20150623.gappssmtp.com header.s=20150623 header.b=hEYy9ALw; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730074AbgEATLM (ORCPT + 99 others); Fri, 1 May 2020 15:11:12 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:48082 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-FAIL-OK-FAIL) by vger.kernel.org with ESMTP id S1729930AbgEATLL (ORCPT ); Fri, 1 May 2020 15:11:11 -0400 Received: from mail-pg1-x543.google.com (mail-pg1-x543.google.com [IPv6:2607:f8b0:4864:20::543]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 7EE94C061A0E for ; Fri, 1 May 2020 12:11:11 -0700 (PDT) Received: by mail-pg1-x543.google.com with SMTP id n11so4932176pgl.9 for ; Fri, 01 May 2020 12:11:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel-dk.20150623.gappssmtp.com; s=20150623; h=from:subject:to:cc:message-id:date:user-agent:mime-version :content-language:content-transfer-encoding; bh=c5dK1AbklroYAW5CprN7zWLQ3v0LEJ5QJui3W0lSbjE=; b=hEYy9ALwvpi9Nj7vjZM+2BujSPtzR7pr1xzZJ2wJNrUpJf+DBpkALWi7IJBWqTRRz3 WAnthuChCJjH3p/TbVwJcXhanIYwAWdWqXur31qbmlShzOpg5tI8+GPn6ou4uN/7ciL+ 6A+Cs2qHOD4QYfz5nxFJbSvVLoEetDLQ1pCeHREsZiOHNNpV4LmOTtDS5vWuvbe2653o S84nBsCeciVYi4O67ejhg4ZacLv2GXwS2RFei7TDB8clqsltDIWndq/zDDE3k/PQ23sg P9OramRl01XAkPPSHlXGR4kYN2ZX35KLRR3VgvjTdY3K+f6aEzWSxdZnxLIRkMQ4Xbg/ vFXg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:subject:to:cc:message-id:date:user-agent :mime-version:content-language:content-transfer-encoding; bh=c5dK1AbklroYAW5CprN7zWLQ3v0LEJ5QJui3W0lSbjE=; b=PnaPXNp0mib3Q727lx61jH0QFbCrOwyVZ/uU4FWG2veo7MdbsCpallm1WCJyrXfIDD f89BVPp2NUqL7yJAQ3FDP3xciFzLwbvkl41ypkcPCHvtComaJXmICeAOHvHs9YTtbiE9 4RwkVnSh0+oxCQYcOHe40Ivnak1BleemLDCbzo5qLYVM9L94nE6hrq4KP0CAdtarXvBG sM/wm6QbYjSka0XBcMkpQH4/z3cvThkHdUBWRcdTFq4bvulltMZUcCX6tZoqfyZBUp3Q t1IP4yZ5OLUjiqRuVgvoQ0/eg4QeIRnYiUdPzBLWXngNwMUpgB0lm+yfqj1PmDzhlNta NSsA== X-Gm-Message-State: AGi0Pua13x6jvor96xELPo9OyoobSeyUFTMYxn/VeLFlzUuhxx+IVxXY qOLJMSDYXl6mxINDz+MGUfJXhuC29fdGIw== X-Received: by 2002:a62:be0c:: with SMTP id l12mr5465435pff.95.1588360270684; Fri, 01 May 2020 12:11:10 -0700 (PDT) Received: from [192.168.1.188] ([66.219.217.145]) by smtp.gmail.com with ESMTPSA id v64sm2865008pfb.20.2020.05.01.12.11.09 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 01 May 2020 12:11:10 -0700 (PDT) From: Jens Axboe Subject: [PATCH v4] eventfd: convert to f_op->read_iter() To: Alexander Viro Cc: linux-fsdevel , "linux-kernel@vger.kernel.org" Message-ID: <6b29f015-bd7c-0601-cf94-2c077285b933@kernel.dk> Date: Fri, 1 May 2020 13:11:09 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org eventfd is using ->read() as it's file_operations read handler, but this prevents passing in information about whether a given IO operation is blocking or not. We can only use the file flags for that. To support async (-EAGAIN/poll based) retries for io_uring, we need ->read_iter() support. Convert eventfd to using ->read_iter(). With ->read_iter(), we can support IOCB_NOWAIT. Ensure the fd setup is done such that we set file->f_mode with FMODE_NOWAIT. Signed-off-by: Jens Axboe --- Since v3: - Ensure we fiddle ->f_mode before doing fd_install() on the fd Since v2: - Cleanup eventfd_read() as per Al's suggestions Since v1: - Add FMODE_NOWAIT to the eventfd file diff --git a/fs/eventfd.c b/fs/eventfd.c index 78e41c7c3d05..20f0fd4d56e1 100644 --- a/fs/eventfd.c +++ b/fs/eventfd.c @@ -216,32 +216,32 @@ int eventfd_ctx_remove_wait_queue(struct eventfd_ctx *ctx, wait_queue_entry_t *w } EXPORT_SYMBOL_GPL(eventfd_ctx_remove_wait_queue); -static ssize_t eventfd_read(struct file *file, char __user *buf, size_t count, - loff_t *ppos) +static ssize_t eventfd_read(struct kiocb *iocb, struct iov_iter *to) { + struct file *file = iocb->ki_filp; struct eventfd_ctx *ctx = file->private_data; - ssize_t res; __u64 ucnt = 0; DECLARE_WAITQUEUE(wait, current); - if (count < sizeof(ucnt)) + if (iov_iter_count(to) < sizeof(ucnt)) return -EINVAL; - spin_lock_irq(&ctx->wqh.lock); - res = -EAGAIN; - if (ctx->count > 0) - res = sizeof(ucnt); - else if (!(file->f_flags & O_NONBLOCK)) { + if (!ctx->count) { + if ((file->f_flags & O_NONBLOCK) || + (iocb->ki_flags & IOCB_NOWAIT)) { + spin_unlock_irq(&ctx->wqh.lock); + return -EAGAIN; + } __add_wait_queue(&ctx->wqh, &wait); for (;;) { set_current_state(TASK_INTERRUPTIBLE); - if (ctx->count > 0) { - res = sizeof(ucnt); + if (ctx->count) break; - } if (signal_pending(current)) { - res = -ERESTARTSYS; - break; + __remove_wait_queue(&ctx->wqh, &wait); + __set_current_state(TASK_RUNNING); + spin_unlock_irq(&ctx->wqh.lock); + return -ERESTARTSYS; } spin_unlock_irq(&ctx->wqh.lock); schedule(); @@ -250,17 +250,14 @@ static ssize_t eventfd_read(struct file *file, char __user *buf, size_t count, __remove_wait_queue(&ctx->wqh, &wait); __set_current_state(TASK_RUNNING); } - if (likely(res > 0)) { - eventfd_ctx_do_read(ctx, &ucnt); - if (waitqueue_active(&ctx->wqh)) - wake_up_locked_poll(&ctx->wqh, EPOLLOUT); - } + eventfd_ctx_do_read(ctx, &ucnt); + if (waitqueue_active(&ctx->wqh)) + wake_up_locked_poll(&ctx->wqh, EPOLLOUT); spin_unlock_irq(&ctx->wqh.lock); - - if (res > 0 && put_user(ucnt, (__u64 __user *)buf)) + if (unlikely(copy_to_iter(&ucnt, sizeof(ucnt), to) != sizeof(ucnt))) return -EFAULT; - return res; + return sizeof(ucnt); } static ssize_t eventfd_write(struct file *file, const char __user *buf, size_t count, @@ -329,7 +326,7 @@ static const struct file_operations eventfd_fops = { #endif .release = eventfd_release, .poll = eventfd_poll, - .read = eventfd_read, + .read_iter = eventfd_read, .write = eventfd_write, .llseek = noop_llseek, }; @@ -406,6 +403,7 @@ EXPORT_SYMBOL_GPL(eventfd_ctx_fileget); static int do_eventfd(unsigned int count, int flags) { struct eventfd_ctx *ctx; + struct file *file; int fd; /* Check the EFD_* constants for consistency. */ @@ -425,11 +423,24 @@ static int do_eventfd(unsigned int count, int flags) ctx->flags = flags; ctx->id = ida_simple_get(&eventfd_ida, 0, 0, GFP_KERNEL); - fd = anon_inode_getfd("[eventfd]", &eventfd_fops, ctx, - O_RDWR | (flags & EFD_SHARED_FCNTL_FLAGS)); + flags &= EFD_SHARED_FCNTL_FLAGS; + flags |= O_RDWR; + fd = get_unused_fd_flags(flags); if (fd < 0) - eventfd_free_ctx(ctx); + goto err; + + file = anon_inode_getfile("[eventfd]", &eventfd_fops, ctx, flags); + if (IS_ERR(file)) { + put_unused_fd(fd); + fd = PTR_ERR(file); + goto err; + } + file->f_mode |= FMODE_NOWAIT; + fd_install(fd, file); + return fd; +err: + eventfd_free_ctx(ctx); return fd; } -- Jens Axboe