Received: by 2002:a25:1985:0:0:0:0:0 with SMTP id 127csp1689814ybz; Thu, 16 Apr 2020 13:45:37 -0700 (PDT) X-Google-Smtp-Source: APiQypLwiORiAI6J5FRshXAGhNrig2mm/qaRqUGOnTcs6Y5yMLf0uONPcxXq7+vB0RNLUGHfTkDx X-Received: by 2002:a17:906:33d4:: with SMTP id w20mr4026862eja.284.1587069937148; Thu, 16 Apr 2020 13:45:37 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1587069937; cv=none; d=google.com; s=arc-20160816; b=wOJlUBD+x5m6iTHNNvKbR3jLNEWlrt4V/8mFu7VTCzj76hGsDZDJoaFAb3KbX/kmfd 0y9yhV7czBW0lkDsW/ZX6p1uCxaXwthY5tlvb19wtVewJ+vSJctzXvb9n6cdObcSVzeF eNbD+SEBVSFBOO2IbtMXqZXrCvTIAXypq15vcXmu2AG+0M8jLw+EI0v1lgrfIMpY0AEe XK+Ve+jKGgGl3Ih0FJzkCJVd+pu6u01AuBjW2DrujMpLl8sDacbpFa4F4+vJptiHEECQ YCpPcRwrXzO1x6wdtTGE7Ip28r4ufpZBdn9IJjocQj/zPH7JW10jkkNxvQeQh34PMDKp 9YuQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:in-reply-to:message-id:date :subject:cc:to:from:dmarc-filter:dkim-signature; bh=V7PkXwMi6fyFG9lzsTnj+iO0kcnhQ3zTKRa5Xvaust8=; b=DKANHcJrq7KPO+NtT8b/R7LmBgtX5MbvNQ/yyr0uCo6cVd0imTdNlYmeUlWxxWzHuE RS8HnUMiloqmP17ncFiSl4PkscOf38++M1vS1Cerdm4RvsfUNT7vhQtBebWkr95raRmi NjhA46TpMNhWW2eWoE+xcrD3SD15g0CqViN/icks6K4uxh+x8pWCvvEVSoE6hWFQH8fB l54or/Acep/D8cn8tZRThyVN1sQvDaws/Wt/jU9SbAOaZHZ+H0IuOuU2QT2EgwPi57RC j0ss3VGLag//tjCkLHeW0aaAIZUCHDe/avQGGR5I2fVV1UNZL1RAVqZf7GqjnP/0c631 FmIA== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@mg.codeaurora.org header.s=smtp header.b=N1Jp+Lnx; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id b24si7977716edy.239.2020.04.16.13.45.14; Thu, 16 Apr 2020 13:45:37 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=fail header.i=@mg.codeaurora.org header.s=smtp header.b=N1Jp+Lnx; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2389368AbgDPSje (ORCPT + 99 others); Thu, 16 Apr 2020 14:39:34 -0400 Received: from mail27.static.mailgun.info ([104.130.122.27]:44744 "EHLO mail27.static.mailgun.info" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729785AbgDPSj2 (ORCPT ); Thu, 16 Apr 2020 14:39:28 -0400 DKIM-Signature: a=rsa-sha256; v=1; c=relaxed/relaxed; d=mg.codeaurora.org; q=dns/txt; s=smtp; t=1587062366; h=References: In-Reply-To: Message-Id: Date: Subject: Cc: To: From: Sender; bh=V7PkXwMi6fyFG9lzsTnj+iO0kcnhQ3zTKRa5Xvaust8=; b=N1Jp+Lnx6du/48VkmxjgBgL2iSzMIcTNweYBFmAv+SxXP4GmStwEMdXggD316BY/4adLB0OT nRnneU7LrW6WyQIAz434qU/1glszA5BLUZkAxf0mlrjeVyTDEk9tNWCeSCYWhpcXvQQc5+so 4tgfKzSVoKnj0Hb244hI2RCKY4c= X-Mailgun-Sending-Ip: 104.130.122.27 X-Mailgun-Sid: WyI0MWYwYSIsICJsaW51eC1rZXJuZWxAdmdlci5rZXJuZWwub3JnIiwgImJlOWU0YSJd Received: from smtp.codeaurora.org (ec2-35-166-182-171.us-west-2.compute.amazonaws.com [35.166.182.171]) by mxa.mailgun.org with ESMTP id 5e98a64b.7f7804c6b768-smtp-out-n01; Thu, 16 Apr 2020 18:39:07 -0000 (UTC) Received: by smtp.codeaurora.org (Postfix, from userid 1001) id E89D3C4478F; Thu, 16 Apr 2020 18:39:06 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-caf-mail-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-1.0 required=2.0 tests=ALL_TRUSTED,SPF_NONE autolearn=unavailable autolearn_force=no version=3.4.0 Received: from rishabhb-linux.qualcomm.com (i-global254.qualcomm.com [199.106.103.254]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: rishabhb) by smtp.codeaurora.org (Postfix) with ESMTPSA id 6B7F0C433F2; Thu, 16 Apr 2020 18:39:05 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 smtp.codeaurora.org 6B7F0C433F2 Authentication-Results: aws-us-west-2-caf-mail-1.web.codeaurora.org; dmarc=none (p=none dis=none) header.from=codeaurora.org Authentication-Results: aws-us-west-2-caf-mail-1.web.codeaurora.org; spf=none smtp.mailfrom=rishabhb@codeaurora.org From: Rishabh Bhatnagar To: linux-remoteproc@vger.kernel.org, linux-kernel@vger.kernel.org Cc: bjorn.andersson@linaro.org, ohad@wizery.com, mathieu.poirier@linaro.org, tsoni@codeaurora.org, psodagud@codeaurora.org, sidgup@codeaurora.org, Rishabh Bhatnagar Subject: [PATCH 2/3] remoteproc: Add inline coredump functionality Date: Thu, 16 Apr 2020 11:38:31 -0700 Message-Id: <1587062312-4939-2-git-send-email-rishabhb@codeaurora.org> X-Mailer: git-send-email 1.9.1 In-Reply-To: <1587062312-4939-1-git-send-email-rishabhb@codeaurora.org> References: <1587062312-4939-1-git-send-email-rishabhb@codeaurora.org> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This patch adds the inline coredump functionality. The current coredump implementation uses vmalloc area to copy all the segments. But this might put a lot of strain on low memory targets as the firmware size sometimes is in ten's of MBs. The situation becomes worse if there are multiple remote processors undergoing recovery at the same time. This patch directly copies the device memory to userspace buffer and avoids extra memory usage. This requires recovery to be halted until data is read by userspace and free function is called. Signed-off-by: Rishabh Bhatnagar --- drivers/remoteproc/remoteproc_coredump.c | 130 +++++++++++++++++++++++++++++++ drivers/remoteproc/remoteproc_internal.h | 23 +++++- include/linux/remoteproc.h | 2 + 3 files changed, 153 insertions(+), 2 deletions(-) diff --git a/drivers/remoteproc/remoteproc_coredump.c b/drivers/remoteproc/remoteproc_coredump.c index 9de0467..888b7dec91 100644 --- a/drivers/remoteproc/remoteproc_coredump.c +++ b/drivers/remoteproc/remoteproc_coredump.c @@ -12,6 +12,84 @@ #include #include "remoteproc_internal.h" +static void rproc_free_dump(void *data) +{ + struct rproc_coredump_state *dump_state = data; + + complete(&dump_state->dump_done); +} + +static unsigned long resolve_addr(loff_t user_offset, + struct list_head *segments, + unsigned long *data_left) +{ + struct rproc_dump_segment *segment; + + list_for_each_entry(segment, segments, node) { + if (user_offset >= segment->size) + user_offset -= segment->size; + else + break; + } + + if (&segment->node == segments) { + *data_left = 0; + return 0; + } + + *data_left = segment->size - user_offset; + + return segment->da + user_offset; +} + +static ssize_t rproc_read_dump(char *buffer, loff_t offset, size_t count, + void *data, size_t header_size) +{ + void *device_mem; + size_t data_left, copy_size, bytes_left = count; + unsigned long addr; + struct rproc_coredump_state *dump_state = data; + struct rproc *rproc = dump_state->rproc; + void *elfcore = dump_state->header; + + /* Copy the header first */ + if (offset < header_size) { + copy_size = header_size - offset; + copy_size = min(copy_size, bytes_left); + + memcpy(buffer, elfcore + offset, copy_size); + offset += copy_size; + bytes_left -= copy_size; + buffer += copy_size; + } + + while (bytes_left) { + addr = resolve_addr(offset - header_size, + &rproc->dump_segments, &data_left); + /* EOF check */ + if (data_left == 0) { + pr_info("Ramdump complete %lld bytes read", offset); + break; + } + + copy_size = min_t(size_t, bytes_left, data_left); + + device_mem = rproc->ops->da_to_va(rproc, addr, copy_size); + if (!device_mem) { + pr_err("Address:%lx with size %zd out of remoteproc carveout\n", + addr, copy_size); + return -ENOMEM; + } + memcpy(buffer, device_mem, copy_size); + + offset += copy_size; + buffer += copy_size; + bytes_left -= copy_size; + } + + return count - bytes_left; +} + static void create_elf_header(void *data, int phnum, struct rproc *rproc) { struct elf32_phdr *phdr; @@ -55,6 +133,58 @@ static void create_elf_header(void *data, int phnum, struct rproc *rproc) } /** + * rproc_inline_coredump() - perform synchronized coredump + * @rproc: rproc handle + * + * This function will generate an ELF header for the registered segments + * and create a devcoredump device associated with rproc. This function + * directly copies the segments from device memory to userspace. The + * recovery is stalled until the enitire coredump is read. This approach + * avoids using extra vmalloc memory(which can be really large). + */ +void rproc_inline_coredump(struct rproc *rproc) +{ + struct rproc_dump_segment *segment; + struct elf32_phdr *phdr; + struct elf32_hdr *ehdr; + struct rproc_coredump_state *dump_state; + size_t header_size; + void *data; + int phnum = 0; + + if (list_empty(&rproc->dump_segments)) + return; + + header_size = sizeof(*ehdr); + list_for_each_entry(segment, &rproc->dump_segments, node) { + header_size += sizeof(*phdr); + + phnum++; + } + + data = vmalloc(header_size); + if (!data) + return; + + ehdr = data; + create_elf_header(data, phnum, rproc); + + dump_state = kzalloc(sizeof(*dump_state), GFP_KERNEL); + dump_state->rproc = rproc; + dump_state->header = data; + init_completion(&dump_state->dump_done); + + dev_coredumpm(&rproc->dev, NULL, dump_state, header_size, GFP_KERNEL, + rproc_read_dump, rproc_free_dump); + + /* Wait until the dump is read and free is called */ + wait_for_completion(&dump_state->dump_done); + + kfree(dump_state); +} +EXPORT_SYMBOL(rproc_inline_coredump); + +/** * rproc_default_coredump() - perform coredump * @rproc: rproc handle * diff --git a/drivers/remoteproc/remoteproc_internal.h b/drivers/remoteproc/remoteproc_internal.h index 28b6af2..ea6146e 100644 --- a/drivers/remoteproc/remoteproc_internal.h +++ b/drivers/remoteproc/remoteproc_internal.h @@ -24,6 +24,18 @@ struct rproc_debug_trace { struct rproc_mem_entry trace_mem; }; +struct rproc_coredump_state { + struct rproc *rproc; + void *header; + struct completion dump_done; +}; + +enum rproc_coredump_conf { + COREDUMP_DEFAULT, + COREDUMP_INLINE, + COREDUMP_DISABLED, +}; + /* from remoteproc_core.c */ void rproc_release(struct kref *kref); irqreturn_t rproc_vq_interrupt(struct rproc *rproc, int vq_id); @@ -49,6 +61,7 @@ struct dentry *rproc_create_trace_file(const char *name, struct rproc *rproc, /* from remoteproc_coredump.c */ void rproc_default_coredump(struct rproc *rproc); +void rproc_inline_coredump(struct rproc *rproc); void rproc_free_vring(struct rproc_vring *rvring); int rproc_alloc_vring(struct rproc_vdev *rvdev, int i); @@ -125,8 +138,14 @@ struct resource_table *rproc_find_loaded_rsc_table(struct rproc *rproc, static inline void rproc_coredump(struct rproc *rproc) { - return rproc_default_coredump(rproc); - + switch (rproc->coredump_conf) { + case COREDUMP_DEFAULT: + return rproc_default_coredump(rproc); + case COREDUMP_INLINE: + return rproc_inline_coredump(rproc); + default: + break; + } } #endif /* REMOTEPROC_INTERNAL_H */ diff --git a/include/linux/remoteproc.h b/include/linux/remoteproc.h index 16ad666..23298ce 100644 --- a/include/linux/remoteproc.h +++ b/include/linux/remoteproc.h @@ -459,6 +459,7 @@ struct rproc_dump_segment { * @dev: virtual device for refcounting and common remoteproc behavior * @power: refcount of users who need this rproc powered up * @state: state of the device + * @coredump_conf: Currenlty selected coredump configuration * @lock: lock which protects concurrent manipulations of the rproc * @dbg_dir: debugfs directory of this rproc device * @traces: list of trace buffers @@ -492,6 +493,7 @@ struct rproc { struct device dev; atomic_t power; unsigned int state; + unsigned int coredump_conf; struct mutex lock; struct dentry *dbg_dir; struct list_head traces; -- The Qualcomm Innovation Center, Inc. is a member of the Code Aurora Forum, a Linux Foundation Collaborative Project