Received: by 2002:a05:7412:419a:b0:f3:1519:9f41 with SMTP id i26csp207420rdh; Thu, 23 Nov 2023 01:24:57 -0800 (PST) X-Google-Smtp-Source: AGHT+IHB/CG0sTb5jK16v5f38Qt1dOUi77LiTDoWGL1qMo33LJ7qW/kxQnQVQxo0FUlNy2bIULVn X-Received: by 2002:a05:6870:3b0a:b0:1f9:539b:e9f with SMTP id gh10-20020a0568703b0a00b001f9539b0e9fmr6593117oab.44.1700731497051; Thu, 23 Nov 2023 01:24:57 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1700731497; cv=none; d=google.com; s=arc-20160816; b=Lcw+6A4Ij+Khe1HYDwpwl8v05+tb6mRmeGkdY/NND2lbKlbj29zmjCdRYLI3ml3zgA aOMALEQ8YUuPvEBDgCIYe+NRRn9fMyIDgMRGiXqDB+RFoPLG+2ZdNReUISeqZKdu2Z5R Rvbv+22IVzVEKLzlud9YNQbElQ/C7JJHzjiSlhajXycmDkGisMYJ7aiIjcuspxfejum1 mxpPnpSPe+rZq8lsdljhy2gJFTlGWXDPSQMv1Llq2/ur6qOD8dSce8EpHNJJzWSH/7zU Ur5mVhRCQujJQnZNzEQcWDsE9HIhYuSU3Kvb8/g+t5Z1kKJVh/SOiAKzwb/gv8J5fC8B 3/Zg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=2nTcOC+LtQ42Ngx+YJj6RSKwsOPJ/n2gnSCL32HIqAQ=; fh=gDYt9MY/1X/h5fcLsrPXNJSbxtFOUO5bXnC2IdpKvq4=; b=oF/2Wayu1mpoGRom+AjeXhwE8VCLz17v5otIPYPw7EJ6Fw6oaPDZvb4YpjEzDa2mi8 jXaTTOndyHb6pcjjVoCnBNuopQhbVyyLlBiTTbe16VC0BesXbJenYf5Plo1/Yaz57FI6 wp779SwJyfTB8GAW32QdG9yzLgKplKX8Rd+DPjL79leC+KKTiAklEcRr9L8sx1oA0rUb ab7ytXMjOw23vwsDec9WX2WtSxPHAFgjZMkaZclaiREg7rYeq0ebwDRW1QOENMFas7q+ 8Ifz65ZBZB3ODV1fNfk5kks6uvetBqmsHC6FQvzEERdi0KxRARCw+s3+jdWVo0tuNmnU q3MA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@ibm.com header.s=pp1 header.b=MMqmQcUE; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:4 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=NONE dis=NONE) header.from=ibm.com Return-Path: Received: from howler.vger.email (howler.vger.email. [2620:137:e000::3:4]) by mx.google.com with ESMTPS id x39-20020a056a0018a700b006cbdeec441bsi897308pfh.236.2023.11.23.01.24.56 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 23 Nov 2023 01:24:57 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:4 as permitted sender) client-ip=2620:137:e000::3:4; Authentication-Results: mx.google.com; dkim=pass header.i=@ibm.com header.s=pp1 header.b=MMqmQcUE; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:4 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=NONE dis=NONE) header.from=ibm.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by howler.vger.email (Postfix) with ESMTP id 139C58083AD6; Thu, 23 Nov 2023 01:24:53 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.11 at howler.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232787AbjKWJYV (ORCPT + 99 others); Thu, 23 Nov 2023 04:24:21 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:50090 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231590AbjKWJYF (ORCPT ); Thu, 23 Nov 2023 04:24:05 -0500 Received: from mx0a-001b2d01.pphosted.com (mx0a-001b2d01.pphosted.com [148.163.156.1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id C1B10D40; Thu, 23 Nov 2023 01:24:11 -0800 (PST) Received: from pps.filterd (m0353727.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 3AN9MF1G014965; Thu, 23 Nov 2023 09:24:01 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=from : to : cc : subject : date : message-id : mime-version : content-transfer-encoding; s=pp1; bh=2nTcOC+LtQ42Ngx+YJj6RSKwsOPJ/n2gnSCL32HIqAQ=; b=MMqmQcUEZq79rIyC7vsBKFqaFf3M7c4cZpEceXMMlSS50pta03iQHIekfddqP3eQMDB9 iWoLvqFPakNPId4NjyX0e9afz3u9TBkQYFRwrYNFGyMrpohk8cp5//K29Jo7UPF6/ovX tZ/xYBPGKE1EcowoOHD4C1TuMufdZPSc/xi1yI5lw9gdUZka9Q4VdEUILgpMSffSyzhW /pLYtDnAePvozGR3zKvh/wUA7WuT2hW4kIHzotjI4mB7ML/YV9L9U3hiQVxTZsOPIk17 aIW/10jOJJpXXv3DoAxZ2Xrg+PrE8V/aGMivQYr6y9AIWigQKUUvGUTIXcmXQRyqhfb9 Lg== Received: from pps.reinject (localhost [127.0.0.1]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3uj41vr1ba-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 23 Nov 2023 09:24:00 +0000 Received: from m0353727.ppops.net (m0353727.ppops.net [127.0.0.1]) by pps.reinject (8.17.1.5/8.17.1.5) with ESMTP id 3AN9O0V4020253; Thu, 23 Nov 2023 09:24:00 GMT Received: from ppma22.wdc07v.mail.ibm.com (5c.69.3da9.ip4.static.sl-reverse.com [169.61.105.92]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3uj41vr1ag-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 23 Nov 2023 09:24:00 +0000 Received: from pps.filterd (ppma22.wdc07v.mail.ibm.com [127.0.0.1]) by ppma22.wdc07v.mail.ibm.com (8.17.1.19/8.17.1.19) with ESMTP id 3AN8n9wo019195; Thu, 23 Nov 2023 09:23:59 GMT Received: from smtprelay03.fra02v.mail.ibm.com ([9.218.2.224]) by ppma22.wdc07v.mail.ibm.com (PPS) with ESMTPS id 3uf7yyxcmg-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 23 Nov 2023 09:23:58 +0000 Received: from smtpav02.fra02v.mail.ibm.com (smtpav02.fra02v.mail.ibm.com [10.20.54.101]) by smtprelay03.fra02v.mail.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 3AN9NtSW22872598 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 23 Nov 2023 09:23:55 GMT Received: from smtpav02.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id BBA3D20043; Thu, 23 Nov 2023 09:23:55 +0000 (GMT) Received: from smtpav02.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 8B66F20040; Thu, 23 Nov 2023 09:23:55 +0000 (GMT) Received: from tuxmaker.boeblingen.de.ibm.com (unknown [9.152.85.9]) by smtpav02.fra02v.mail.ibm.com (Postfix) with ESMTP; Thu, 23 Nov 2023 09:23:55 +0000 (GMT) From: Sumanth Korikkar To: linux-mm , Andrew Morton , David Hildenbrand Cc: Oscar Salvador , Michal Hocko , "Aneesh Kumar K.V" , Anshuman Khandual , Gerald Schaefer , Sumanth Korikkar , Alexander Gordeev , Heiko Carstens , Vasily Gorbik , linux-s390 , LKML Subject: [PATCH v2 0/7] implement "memmap on memory" feature on s390 Date: Thu, 23 Nov 2023 10:23:36 +0100 Message-Id: <20231123092343.1703707-1-sumanthk@linux.ibm.com> X-Mailer: git-send-email 2.39.2 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-TM-AS-GCONF: 00 X-Proofpoint-ORIG-GUID: zuuuXLAf8N_7b7qftGG7aPIAUwD0EFUz X-Proofpoint-GUID: _5e-FcvAdXYXVfLL24ZRFjV4C388n41j X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.272,Aquarius:18.0.987,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2023-11-23_07,2023-11-22_01,2023-05-22_02 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=2 spamscore=2 lowpriorityscore=0 mlxscore=2 phishscore=0 mlxlogscore=167 clxscore=1015 bulkscore=0 adultscore=0 priorityscore=1501 suspectscore=0 impostorscore=0 malwarescore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2311060000 definitions=main-2311230067 X-Spam-Status: No, score=-0.8 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on howler.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (howler.vger.email [0.0.0.0]); Thu, 23 Nov 2023 01:24:53 -0800 (PST) Hi All, The patch series implements "memmap on memory" feature on s390. Patch 1 introduces new mhp_flag MHP_OFFLINE_INACCESSIBLE to mark memory as not accessible until memory hotplug online phase begins. Patch 2 avoids page_init_poison() on memmap during mhp addition phase, when mhp_flag MHP_OFFLINE_INACCESSIBLE is passed over from add_memory() Patch 3 introduces MEM_PREPARE_ONLINE/MEM_FINISH_OFFLINE memory notifiers to prepare the transition of memory to and from a physically accessible state. This enhancement is crucial for implementing the "memmap on memory" feature for s390 in a subsequent patch. Patches 4 allocates vmemmap pages from self-contained memory range for s390. It allocates memory map (struct pages array) from the hotplugged memory range, rather than using system memory by passing altmap to vmemmap functions. Patch 5 removes unhandled memory notifier types on s390. Patch 6 implements MEM_PREPARE_ONLINE/MEM_FINISH_OFFLINE memory notifiers on s390. MEM_PREPARE_ONLINE memory notifier makes memory block physical accessible via sclp assign command. The notifier ensures self-contained memory maps are accessible and hence enabling the "memmap on memory" on s390. MEM_FINISH_OFFLINE memory notifier shifts the memory block to an inaccessible state via sclp unassign command Patch 7 finally enables MHP_MEMMAP_ON_MEMORY on s390 These patches are rebased on top of three fixes: mm: use vmem_altmap code without CONFIG_ZONE_DEVICE mm/memory_hotplug: fix error handling in add_memory_resource() mm/memory_hotplug: add missing mem_hotplug_lock v2: * Fixes are integrated and hence removed from this patch series Suggestions from David: * Add new flag MHP_OFFLINE_INACCESSIBLE to avoid accessing memory during memory hotplug addition phase. * Avoid page_init_poison() on memmap during mhp addition phase, when MHP_OFFLINE_INACCESSIBLE mhp_flag is passed in add_memory(). * Do not skip add_pages() in arch_add_memory(). Similarly, remove similar hacks in arch_remove_memory(). * Use MHP_PREPARE_ONLINE/MHP_FINISH_OFFLINE naming convention for new memory notifiers. * Rearrange removal of unused s390 memory notifier. * Necessary commit messages changes. Thank you Sumanth Korikkar (7): mm/memory_hotplug: introduce mhp_flag MHP_OFFLINE_INACCESSIBLE mm/memory_hotplug: avoid poisoning memmap during mhp addition phase mm/memory_hotplug: introduce MEM_PREPARE_ONLINE/MEM_FINISH_OFFLINE notifiers s390/mm: allocate vmemmap pages from self-contained memory range s390/sclp: remove unhandled memory notifier type s390/mm: implement MEM_PREPARE_ONLINE/MEM_FINISH_OFFLINE notifiers s390: enable MHP_MEMMAP_ON_MEMORY arch/s390/Kconfig | 1 + arch/s390/mm/init.c | 3 -- arch/s390/mm/vmem.c | 62 +++++++++++++++++++--------------- drivers/base/memory.c | 23 +++++++++++-- drivers/s390/char/sclp_cmd.c | 31 ++++++++++++----- include/linux/memory.h | 3 ++ include/linux/memory_hotplug.h | 12 ++++++- include/linux/memremap.h | 1 + mm/memory_hotplug.c | 30 ++++++++++++++-- mm/sparse.c | 3 +- 10 files changed, 124 insertions(+), 45 deletions(-) -- 2.39.2