Received: by 2002:a05:6a10:a841:0:0:0:0 with SMTP id d1csp1666736pxy; Fri, 23 Apr 2021 13:52:25 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyIvXdHysTmT75JIcN14iLT1BAm56sKRawlNcJTeJUIQkmev6MC6WEnXPtUsNGfWE3r6zLv X-Received: by 2002:aa7:cc94:: with SMTP id p20mr6772388edt.353.1619211144920; Fri, 23 Apr 2021 13:52:24 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1619211144; cv=none; d=google.com; s=arc-20160816; b=WeSCSTO+lbMkSarkUIR+pC7PEJ88pSmnnyA1ROv5r3KXJjPTuZW9g8Q2JW5cY/vEab ERO8ZjpJLSlpjkf0bmDEGeAIR3aV44K/SLtDzb9EiCMAUrnJ9u/OEC19kR0RXlb953ig C6bNDda6ynZRh0y0YC0szWKYsPyJ3VzRGHMXEiYcnJuW/oe6IYxHSy6XDJiTafwOiY/M kRWZUMVUZMy9csCooITozB6S+lILLW2IhcZQVbT5CANB536MjlXa5IwKS4eOZqBjxMvQ k+P1b5UcYhXwasAhD5yE8c24GQexm0CDHQtbDBBrTCWGEiDav79MfmGWpTYrkvVpyHBR oX8g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from; bh=3HbWpojlomNjsGxsQgSOb8kYauo5cu+Ol/t+mU060fY=; b=ewWghhsRt8FqLb9jvyawvOI3FUH/1pMEQ4UXuN+sluj9dOiRh95g3+aHxCn0ur4Gvc 9XlA5NNws6I0liqsgKd6t2WJWOxFCImWpq2K39UaBxu/9Y/lCPBBXXyobCRsQQcvDMIK udb6q+2THRIu/kjauJ4YbqcY2Pyi3JY2XN2/CN6w39u7QhdTBKJ0zTgW4Bpxddzs2wYy HmI4AIrPllwggEuod2Z+bmWI4WE79O1jMHc8dcGKjbM9XNXax9zfzzIvLTg8pqG2KObf L/rTLN4zRaY/xiogOicJhRK8dp1fql5ydxiK8eGscUjwL1v1QHHydAWqSI4iQ4azCNnu QlDQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-ext4-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-ext4-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=collabora.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id l5si6710397ejq.495.2021.04.23.13.51.57; Fri, 23 Apr 2021 13:52:24 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-ext4-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-ext4-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-ext4-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=collabora.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232537AbhDWUwa (ORCPT + 99 others); Fri, 23 Apr 2021 16:52:30 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:42260 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229691AbhDWUw3 (ORCPT ); Fri, 23 Apr 2021 16:52:29 -0400 Received: from bhuna.collabora.co.uk (bhuna.collabora.co.uk [IPv6:2a00:1098:0:82:1000:25:2eeb:e3e3]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 4D9A0C061574; Fri, 23 Apr 2021 13:51:52 -0700 (PDT) Received: from [127.0.0.1] (localhost [127.0.0.1]) (Authenticated sender: shreeya) with ESMTPSA id B36B91F41B0E From: Shreeya Patel To: tytso@mit.edu, adilger.kernel@dilger.ca, jaegeuk@kernel.org, chao@kernel.org, krisman@collabora.com, ebiggers@google.com, drosen@google.com, ebiggers@kernel.org, yuchao0@huawei.com Cc: linux-ext4@vger.kernel.org, linux-kernel@vger.kernel.org, linux-f2fs-devel@lists.sourceforge.net, linux-fsdevel@vger.kernel.org, kernel@collabora.com, andre.almeida@collabora.com Subject: [PATCH v8 0/4] Make UTF-8 encoding loadable Date: Sat, 24 Apr 2021 02:21:32 +0530 Message-Id: <20210423205136.1015456-1-shreeya.patel@collabora.com> X-Mailer: git-send-email 2.30.2 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-ext4@vger.kernel.org utf8data.h_shipped has a large database table which is an auto-generated decodification trie for the unicode normalization functions and it is not necessary to carry this large table in the kernel unless it is required by the filesystem during boot time. Goal is to make UTF-8 encoding loadable by converting it into a module and adding a unicode subsystem layer between the filesystems and the utf8 module. This layer will then load the module whenever any filesystem that needs unicode is mounted or utf8 can also be built into the kernel incase it is required by the filesystem during boot time. Currently, only UTF-8 encoding is supported but if any other encodings are supported in future then the layer file would be responsible for loading the desired encoding module. 1st patch in the series resolves the warning reported by kernel test robot by using strscpy instead of strncpy. Unicode is the subsystem and utf8 is a charachter encoding for the subsystem, hence 2nd and 3rd patches in the series are renaming functions and file name to unicode for better understanding the difference between UTF-8 module and unicode layer. Last patch in the series adds the layer and utf8 module and also uses static calls which gives performance benefit when compared to indirect calls using function pointers. --- Changes in v8 - Improve the commit message of patch 1 to decribe about how overly-long strings should be handled. - Improve the commit messages in patches 2/3/4 to better understand the use of built-in option. - Improve the help text in Kconfig for avoiding contradictory statements. - Make spinlock definition static. - Use int instead of bool to avoid gcc warning. - Add a comment for decribing why we are using try_then_request_module() instead of request_module() Changes in v7 - Update the help text in Kconfig - Handle the unicode_load_static_call function failure by decrementing the reference. - Correct the code for handling built-in utf8 option as well. - Correct the synchronization for accessing utf8mod. - Make changes to unicode_unload() for handling the situation where utf8mod != NULL and um == NULL. Changes in v6 - Add spinlock to protect utf8mod and avoid NULL pointer dereference. - Change the static call function names for being consistent with kernel coding style. - Merge the unicode_load_module function with unicode_load as it is not really needed to have a separate function. - Use try_then_module_get instead of module_get to avoid loading the module even when it is already loaded. - Improve the commit message. Changes in v5 - Remove patch which adds NULL check in ext4/super.c and f2fs/super.c before calling unicode_unload(). - Rename global variables and default static call functions for better understanding - Make only config UNICODE_UTF8 visible and config UNICODE to be always enabled provided UNICODE_UTF8 is enabled. - Improve the documentation for Kconfig - Improve the commit message. Changes in v4 - Return error from the static calls instead of doing nothing and succeeding even without loading the module. - Remove the complete usage of utf8_ops and use static calls at all places. - Restore the static calls to default values when module is unloaded. - Decrement the reference of module after calling the unload function. - Remove spinlock as there will be no race conditions after removing utf8_ops. Changes in v3 - Add a patch which checks if utf8 is loaded before calling utf8_unload() in ext4 and f2fs filesystems - Return error if strscpy() returns value < 0 - Correct the conditions to prevent NULL pointer dereference while accessing functions via utf8_ops variable. - Add spinlock to avoid race conditions. - Use static_call() for preventing speculative execution attacks. Changes in v2 - Remove the duplicate file from the last patch. - Make the wrapper functions inline. - Remove msleep and use try_module_get() and module_put() for ensuring that module is loaded correctly and also doesn't get unloaded while in use. - Resolve the warning reported by kernel test robot. - Resolve all the checkpatch.pl warnings. Shreeya Patel (4): fs: unicode: Use strscpy() instead of strncpy() fs: unicode: Rename function names from utf8 to unicode fs: unicode: Rename utf8-core file to unicode-core fs: unicode: Add utf8 module and a unicode layer fs/ext4/hash.c | 2 +- fs/ext4/namei.c | 12 +- fs/ext4/super.c | 6 +- fs/f2fs/dir.c | 12 +- fs/f2fs/super.c | 6 +- fs/libfs.c | 6 +- fs/unicode/Kconfig | 26 ++- fs/unicode/Makefile | 5 +- fs/unicode/unicode-core.c | 175 +++++++++++++++++++++ fs/unicode/{utf8-core.c => unicode-utf8.c} | 98 +++++++----- fs/unicode/utf8-selftest.c | 8 +- include/linux/unicode.h | 100 ++++++++++-- 12 files changed, 374 insertions(+), 82 deletions(-) create mode 100644 fs/unicode/unicode-core.c rename fs/unicode/{utf8-core.c => unicode-utf8.c} (57%) -- 2.30.2