Received-SPF: pass (google.com: domain of linux-kernel+bounces-214312-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) client-ip=2604:1380:45e3:2400::1;
From: Lei Liu <liulei.rjpt@vivo.com>
To: Greg Kroah-Hartman <gregkh@linuxfoundation.org>,
	=?UTF-8?q?Arve=20Hj=C3=B8nnev=C3=A5g?= <arve@android.com>,
	Todd Kjos <tkjos@android.com>,
	Martijn Coenen <maco@android.com>,
	Joel Fernandes <joel@joelfernandes.org>,
	Christian Brauner <brauner@kernel.org>,
	Carlos Llamas <cmllamas@google.com>,
	Suren Baghdasaryan <surenb@google.com>,
	linux-kernel@vger.kernel.org
Cc: opensource.kernel@vivo.com,
	Lei Liu <liulei.rjpt@vivo.com>
Subject: [PATCH v2] binder_alloc: Replace kcalloc with kvcalloc to mitigate
Date: Fri, 14 Jun 2024 11:49:30 +0800
Message-Id: <20240614034930.8759-1-liulei.rjpt@vivo.com>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0:
	=?utf-8?B?MDFza0V5cEpQemVFV3d5cVdocHlvUXlxVXBMY01TNExYeUpSTXFjVzZqMWZO?=
 =?utf-8?B?aG1qTEpJN2gxWW1JMDdkUlhSbGFQTENFNjVDcHF6Q0lQVCtUWXJxeG1WOGxi?=
 =?utf-8?B?bnJjYWU2Z0ZJNS9MYysvc2hRVHRSTE9GZUFBMmNhdGtCMWFrOHRVcTlRbHVs?=
 =?utf-8?B?RUVwNmVFOHN0dGJGRzA0V2lKTXJDdUtSTXJteEo2NWNMUmdXeVZkV0tiQzg2?=
 =?utf-8?B?eE5vb1ZLVW1saWdwVXhZME1Fc3pyR2l6aE9vVjkycFRhNFVjZ0dyY3hmZEo4?=
 =?utf-8?B?T2Y4dGU0d0s1cm1zSHRLSEp1MFJCM3BGK2FIcTdRUjhOK2x1Q0ZIb05pVXps?=
 =?utf-8?B?SXVEZ2FjakNIYlNtVDNtTzRnM1NldzE1VTdWdHlxbjV4bTRoQkxYd0pKeXJm?=
 =?utf-8?B?TUpXa0hOTW8zTXVKNWltQkk1RTA4ZTBseHlVMVV6SUI5dGMwalZjbnhOZHNU?=
 =?utf-8?B?L0UycUw2azdxeEV0bDVsSWRWQWp3eTFFOVRSTWp0ZFlSdWdLTmtRakF1Titl?=
 =?utf-8?B?M01kWFZCNjhHY0RBR2M2Y2Y2anNkRHNqVHRycTNkVXJ5UzEwS1FQMHpNcFVt?=
 =?utf-8?B?b0IxZ2VETHBjelJSU0tNU0dtVU1kYkpNYnFHMllPeGx3eHo1OEJUUkNKLzVo?=
 =?utf-8?B?YmVFbFhqcjRCdlRSZkU4eDVEekpiK282amcxVlk2OGluZ3NLa0h1U3NpdWtr?=
 =?utf-8?B?eEw5UEFxN1luZlJBeHRmeVY1N3hNOVh0TUpTbnZhUGtTOWNxRXBJbUtocmhG?=
 =?utf-8?B?c085U3lVREczL3Bld21pWW8vTXc4ZGRFN0FoL3NTVEFTYjhwRDUzb04xVTg1?=
 =?utf-8?B?b2xMOUpTNlBSQkxhY3lPdkFaQXd4ZUpmVktpUDZVa0hsaFk3WkRCT2Qyc3J1?=
 =?utf-8?B?U2dXeUcvdjF6YTZlcXFxSlJ3QmRwV3Y1Mzh0REU3L1dOMVZyN0duME9WWExQ?=
 =?utf-8?B?dTMvdndlWjJzRERwN0VQWjh1bW15SDRjR0Q2NlYrWjlvaXh1WE5kZm1NbWYx?=
 =?utf-8?B?ZXZIQ1NTTllnUUdxV1VVTzk3TjhRRWtDVlJ0dVk5QS9QU1pwWE1lME1jQXIw?=
 =?utf-8?B?V1JpSDlDQ0xhOUlLNlVhY3daU3p2d1JWbGQvZ2dtdjl5UVlHQlRtWGM1OG11?=
 =?utf-8?B?RG45RC92aFQ1d3RwcTZBS3ZLMzNXZmZzL1dWT0crV0tBeVZ2ZGFWaTNER3dR?=
 =?utf-8?B?Uld2UFNkQ21XRUNINC9mSStKZFZGRUY3SFhxRlowVVNlWHJab2FaN3lJckZt?=
 =?utf-8?B?alFRMFJFd1RhQlAyb0t4S2VEZCtlYmJvUGNzMUJmZ1VhVjNacE02azI5b1FN?=
 =?utf-8?B?Z21GRGNLbXhvemdjT1U0YTFBV1NsV1dwT0dBMHBoaFhNQ1RPUjVBd2U0blZG?=
 =?utf-8?B?cFBWUStURWdYdmoxY2VXKzVrWG5QeWF2ZUtxRGtubXFpWkh3NEpzN2tjRXU5?=
 =?utf-8?B?OHIvS2hNK2JTMjlheUhtR2EvYTB1clFpaU85WTFOTnMwTzU2czQrN2MvZFdF?=
 =?utf-8?B?bytaby9adUMzRkhQTGp0N2pSWXZUOTlOMDVYVDBzMVVEcVBkL054OFJKN1FV?=
 =?utf-8?B?ZzZubHZGU2p6N1Z0dE1xa1lVNmZXcXFYWStSRGVkbUNwbk1iY0kyU2pqalNx?=
 =?utf-8?B?SysrRUlmWm1nTDlvU3R6ODhMcFhIai9xQmRpVUxwWC9ZL3k5M3hWcFZsbysz?=
 =?utf-8?B?SStEU0wxVVE4anNxNjZ3ZjBYV1prRm9xSi9SZmZ0eGZMYWEzRXozMlFZYnlq?=
 =?utf-8?B?Q1k1bzRPTFhjUjJvVDRYdnYzeUJpbmZhUjZMT1BRN3hNQnEzc2JZdW9PY0s0?=
 =?utf-8?B?ZjgyemlkY1U3NXFnV1FYNjZDVGw0NDJHcmxxTzhOYmQwSFcxbk1NdjNCcCt3?=
 =?utf-8?B?bmxLZVNTbzVmbUhIRGtiRGduclI0UEdUUnlQVXRKMG1vSXEraFJDbGVKQlMx?=
 =?utf-8?B?TmJRWC95OWdhQXFCOU9UdG1yYndnalEzQmpEQXNWQ0M2alVIazlCVDVlR1Bz?=
 =?utf-8?B?NXA5ak91VFNUd1dNaXd1K2hCS1U2NUF6K0ZaVll6QVBDKzl3YTNYMkJjSDdS?=
 =?utf-8?B?RzNhbFFVSS95eEhWSHlvbXRiczVJcS9kY2Y4M0RxZFJIeDIrbU1DNWNJbnIv?=
 =?utf-8?Q?XPBHdjo4g23xryf0Bw3PmvO6r?=
X-OriginatorOrg: vivo.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 530df132-1e5b-450e-79a2-08dc8c250666
X-MS-Exchange-CrossTenant-AuthSource: SEZPR06MB5624.apcprd06.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Jun 2024 03:49:43.1095
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 923e42dc-48d5-4cbe-b582-1a797a6412ed
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: h10Nusi+xlJDcdwOVXsGYQyaJm1jUiTzCotPC5la7j7V0pZfXKvJ0AlM0uh0YhkowWN2HmR699ixIF5M6f8D/A==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PUZPR06MB5649

1.In binder_alloc, there is a frequent need for order3 memory:
allocation, especially on small-memory mobile devices, which can lead
to OOM and cause foreground applications to be killed, resulting in
flashbacks.The kernel call stack after the issue occurred is as follows:
dumpsys invoked oom-killer:
gfp_mask=0x40dc0(GFP_KERNEL|__GFP_COMP|__GFP_ZERO), order=3,
oom_score_adj=-950
CPU: 6 PID: 31329 Comm: dumpsys Tainted: G        WC O
5.10.168-android12-9-00003-gc873b6b86254-ab10823632 #1
Call trace:
 dump_backtrace.cfi_jt+0x0/0x8
 dump_stack_lvl+0xdc/0x138
 dump_header+0x5c/0x2ac
 oom_kill_process+0x124/0x304
 out_of_memory+0x25c/0x5e0
 __alloc_pages_slowpath+0x690/0xf6c
 __alloc_pages_nodemask+0x1f4/0x3dc
 kmalloc_order+0x54/0x338
 kmalloc_order_trace+0x34/0x1bc
 __kmalloc+0x5e8/0x9c0
 binder_alloc_mmap_handler+0x88/0x1f8
 binder_mmap+0x90/0x10c
 mmap_region+0x44c/0xc14
 do_mmap+0x518/0x680
 vm_mmap_pgoff+0x15c/0x378
 ksys_mmap_pgoff+0x80/0x108
 __arm64_sys_mmap+0x38/0x48
 el0_svc_common+0xd4/0x270
 el0_svc+0x28/0x98
 el0_sync_handler+0x8c/0xf0
 el0_sync+0x1b4/0x1c0
Mem-Info:
active_anon:47096 inactive_anon:57927 isolated_anon:100
active_file:43790 inactive_file:44434 isolated_file:0
unevictable:14693 dirty:171 writeback:0\x0a slab_reclaimable:21676
slab_unreclaimable:81771\x0a mapped:84485 shmem:4275 pagetables:33367
bounce:0\x0a free:3772 free_pcp:198 free_cma:11
Node 0 active_anon:188384kB inactive_anon:231708kB active_file:175160kB
inactive_file:177736kB unevictable:58772kB isolated(anon):400kB
isolated(file):0kB mapped:337940kB dirty:684kB writeback:0kB
shmem:17100kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB
writeback_tmp:0kB kernel_stack:84960kB shadow_call_stack:21340kB
Normal free:15088kB min:8192kB low:42616kB high:46164kB
reserved_highatomic:4096KB active_anon:187644kB inactive_anon:231608kB
active_file:174552kB inactive_file:178012kB unevictable:58772kB
writepending:684kB present:3701440kB managed:3550144kB mlocked:58508kB
pagetables:133468kB bounce:0kB free_pcp:1048kB local_pcp:12kB
free_cma:44kB
Normal: 3313*4kB (UMEH) 165*8kB (UMEH) 35*16kB (H) 15*32kB (H) 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 15612kB
108356 total pagecache pages

2.We use kvcalloc to allocate memory, which can reduce system OOM
occurrences, as well as decrease the time and probability of failure
for order3 memory allocations. Additionally, it can also improve the
throughput of binder (as verified by Google's binder_benchmark testing
tool).

3.We have conducted multiple tests on an 12GB memory phone, and the
performance of kvcalloc is better. Below is a partial excerpt of the
test data.
throughput = (size * Iterations)/Time
kvcalloc->kvmalloc:
Benchmark-kvcalloc	Time	CPU	Iterations	throughput(Gb/s)
----------------------------------------------------------------
BM_sendVec_binder-4096	30926 ns	20481 ns	34457	4563.66↑
BM_sendVec_binder-8192	42667 ns	30837 ns	22631	4345.11↑
BM_sendVec_binder-16384	67586 ns	52381 ns	13318	3228.51↑
BM_sendVec_binder-32768	116496 ns	94893 ns	7416	2085.97↑
BM_sendVec_binder-65536	265482 ns	209214 ns	3530	871.40↑

kcalloc->kmalloc
Benchmark-kcalloc	Time	CPU	Iterations	throughput(Gb/s)
----------------------------------------------------------------
BM_sendVec_binder-4096	39070 ns	24207 ns	31063	3256.56
BM_sendVec_binder-8192	49476 ns	35099 ns	18817	3115.62
BM_sendVec_binder-16384	76866 ns	58924 ns	11883	2532.86
BM_sendVec_binder-32768	134022 ns	102788 ns	6535	1597.78
BM_sendVec_binder-65536	281004 ns	220028 ns	3135	731.14

Signed-off-by: Lei Liu <liulei.rjpt@vivo.com>
---
Changelog:
v1->v2:
1.The call stack for the OOM error during the stress test on a phone
with an additional 4GB of memory.
2.Corrected the error in the title of the test data table.
---
 drivers/android/binder_alloc.c | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

diff --git a/drivers/android/binder_alloc.c b/drivers/android/binder_alloc.c
index 2e1f261ec5c8..5dcab4a5e341 100644
--- a/drivers/android/binder_alloc.c
+++ b/drivers/android/binder_alloc.c
@@ -836,7 +836,7 @@ int binder_alloc_mmap_handler(struct binder_alloc *alloc,
 
 	alloc->buffer = vma->vm_start;
 
-	alloc->pages = kcalloc(alloc->buffer_size / PAGE_SIZE,
+	alloc->pages = kvcalloc(alloc->buffer_size / PAGE_SIZE,
 			       sizeof(alloc->pages[0]),
 			       GFP_KERNEL);
 	if (alloc->pages == NULL) {
@@ -869,7 +869,7 @@ int binder_alloc_mmap_handler(struct binder_alloc *alloc,
 	return 0;
 
 err_alloc_buf_struct_failed:
-	kfree(alloc->pages);
+	kvfree(alloc->pages);
 	alloc->pages = NULL;
 err_alloc_pages_failed:
 	alloc->buffer = 0;
@@ -939,7 +939,7 @@ void binder_alloc_deferred_release(struct binder_alloc *alloc)
 			__free_page(alloc->pages[i].page_ptr);
 			page_count++;
 		}
-		kfree(alloc->pages);
+		kvfree(alloc->pages);
 	}
 	spin_unlock(&alloc->lock);
 	if (alloc->mm)
-- 
2.34.1