Received: by 2002:a05:6902:102b:0:0:0:0 with SMTP id x11csp1008065ybt; Fri, 19 Jun 2020 21:26:20 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzIbXC+YiB/ug7y+26k+STiFrg/wZdj+lP6IiA5nvKNY8+22pgE/e7qaKHfqTDo8+nRpf1w X-Received: by 2002:a17:906:16d3:: with SMTP id t19mr6287986ejd.297.1592627180169; Fri, 19 Jun 2020 21:26:20 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1592627180; cv=none; d=google.com; s=arc-20160816; b=ZRDZt/zHrpZ/c6FRSWfaFYR4+J2D/ywZgUWrOBTeZ7QvF9lXS+0xYvEmpP4MN4X2v1 MWAQv/e9MFdUuEciia7M0BO3ejJTBfQNe6ER7zsYWT7Tz5bYWqv8fhx9XuhAVJclKqkZ xjzvM0C0YHMn9MolciXUp43OOmT03IpRp0OY7UyR9JhO+SbO++m6R0CAl0sSbK+aodY/ UXyo2O+YiCHTft+ndU2UXHKFHRChHA10fJeTWto7ohvagcPmPnOuugjzZFzoamWD0+Jk fj3ZVNVVLbfZKKrgkz4xwjYCr7qVVAfXMUmWkdu53ivccEqWXJ1qq1NSW96FsHx5da3I ygrw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:user-agent:references :message-id:in-reply-to:subject:cc:to:from:date:dkim-signature; bh=rcl3Tsq20b25qpxfIY8/T/emiAI5DcC+fOswqOgue0s=; b=PI3oTZ8zugjO5PW6Qc41JcNwhhL87sBGKeLHaRWlwFGZx2rloSpF+6OMF9XpVEFPp2 IkQf+wQNZcjlG/yCMDu5h1ZLaW+snWBUtc2hSSna+nfP8gWE6TXvRva8XC3alWQDNXCR d44AAksd4NVxNbOGWuzVozwNZV3U4APOJf/YjD4+vPjAIbsJ4lHxg4p8QoysfeEC9QTS SofanfYskxaqw22nwntqH9BuIQDwJ0vkRastOTTzI9qiR40kruFDt1w00FIJWcNsDV2e HV79LNraJBgnGUW3HtiT1nyh6T4R6DRLF68OF1NgTxMUGVLTDaXtcRR7ZXkjQJ3/+TCF Cnww== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=h0aJNXfO; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id c18si5238117edt.202.2020.06.19.21.25.58; Fri, 19 Jun 2020 21:26:20 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=h0aJNXfO; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1732589AbgFSSjy (ORCPT + 99 others); Fri, 19 Jun 2020 14:39:54 -0400 Received: from us-smtp-delivery-1.mimecast.com ([207.211.31.120]:45237 "EHLO us-smtp-1.mimecast.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1731358AbgFSSjy (ORCPT ); Fri, 19 Jun 2020 14:39:54 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1592591992; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=rcl3Tsq20b25qpxfIY8/T/emiAI5DcC+fOswqOgue0s=; b=h0aJNXfOZ4rGi+/X4FmM9ej1WVju3jVh1h8Xe2HdX9BoyOB4q9N4wgRNT9BrUDaMs/rjWn wyCGjN8PoN7bMFHbhFDeUKLkDiOgRA5i8DaU3X5LnQMSMZd/8a5AiLcyupTdOjuo9i+tv0 h99brFhPPG6B/oPq1FKOzkAISEsZxbI= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-405-zYiwwnGWMAi2INwzf2hTCQ-1; Fri, 19 Jun 2020 14:39:48 -0400 X-MC-Unique: zYiwwnGWMAi2INwzf2hTCQ-1 Received: from smtp.corp.redhat.com (int-mx08.intmail.prod.int.phx2.redhat.com [10.5.11.23]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id EC7FF107ACCA; Fri, 19 Jun 2020 18:39:46 +0000 (UTC) Received: from file01.intranet.prod.int.rdu2.redhat.com (file01.intranet.prod.int.rdu2.redhat.com [10.11.5.7]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 5718619D7B; Fri, 19 Jun 2020 18:39:41 +0000 (UTC) Received: from file01.intranet.prod.int.rdu2.redhat.com (localhost [127.0.0.1]) by file01.intranet.prod.int.rdu2.redhat.com (8.14.4/8.14.4) with ESMTP id 05JIde6C026822; Fri, 19 Jun 2020 14:39:40 -0400 Received: from localhost (mpatocka@localhost) by file01.intranet.prod.int.rdu2.redhat.com (8.14.4/8.14.4/Submit) with ESMTP id 05JIddo9026818; Fri, 19 Jun 2020 14:39:39 -0400 X-Authentication-Warning: file01.intranet.prod.int.rdu2.redhat.com: mpatocka owned process doing -bs Date: Fri, 19 Jun 2020 14:39:39 -0400 (EDT) From: Mikulas Patocka X-X-Sender: mpatocka@file01.intranet.prod.int.rdu2.redhat.com To: Ignat Korchagin , Herbert Xu , "David S. Miller" cc: Mike Snitzer , agk@redhat.com, dm-devel@redhat.com, dm-crypt@saout.de, linux-kernel@vger.kernel.org, kernel-team@cloudflare.com Subject: Re: [RFC PATCH 0/1] dm-crypt excessive overhead In-Reply-To: <20200619165548.GA24779@redhat.com> Message-ID: References: <20200619164132.1648-1-ignat@cloudflare.com> <20200619165548.GA24779@redhat.com> User-Agent: Alpine 2.02 (LRH 1266 2009-07-14) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Scanned-By: MIMEDefang 2.84 on 10.5.11.23 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, 19 Jun 2020, Mike Snitzer wrote: > On Fri, Jun 19 2020 at 12:41pm -0400, > Ignat Korchagin wrote: > > > This is a follow up from the long-forgotten [1], but with some more convincing > > evidence. Consider the following script: > > > > [1]: https://www.spinics.net/lists/dm-crypt/msg07516.html > > [2]: https://blog.cloudflare.com/speeding-up-linux-disk-encryption/ > > > > Ignat Korchagin (1): > > Add DM_CRYPT_FORCE_INLINE flag to dm-crypt target > > > > drivers/md/dm-crypt.c | 55 +++++++++++++++++++++++++++++++++---------- > > 1 file changed, 43 insertions(+), 12 deletions(-) > > > > -- > > 2.20.1 > > > > Hi, > > I saw [2] and have been expecting something from cloudflare ever since. > Nice to see this submission. > > There is useful context in your 0th patch header. I'll likely merge > parts of this patch header with the more terse 1/1 header (reality is > there only needed to be a single patch submission). > > Will review and stage accordingly if all looks fine to me. Mikulas, > please have a look too. > > Thanks, > Mike + if (test_bit(DM_CRYPT_FORCE_INLINE, &cc->flags)) { + if (in_irq()) { + /* Crypto API will fail hard in hard IRQ context */ + tasklet_init(&io->tasklet, kcryptd_crypt_tasklet, (unsigned long)&io->work); + tasklet_schedule(&io->tasklet); + } else + kcryptd_crypt(&io->work); + } else { + INIT_WORK(&io->work, kcryptd_crypt); + queue_work(cc->crypt_queue, &io->work); + } I'm looking at this and I'd like to know why does the crypto API fail in hard-irq context and why does it work in tasklet context. What's the exact reason behind this? Mikulas