Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.32 as permitted sender) client-ip=23.128.96.32;
Received-SPF: Pass (protection.outlook.com: domain of arm.com designates
 63.35.35.123 as permitted sender) receiver=protection.outlook.com;
 client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com;
 pr=C
Authentication-Results-Original: dkim=none (message not signed)
 header.d=none;dmarc=none action=none header.from=arm.com;
Date:   Mon, 30 Oct 2023 11:39:17 +0000
From:   "Szabolcs.Nagy@arm.com" <Szabolcs.Nagy@arm.com>
To:     Deepak Gupta <debug@rivosinc.com>
Cc:     Mark Brown <broonie@kernel.org>,
        "Edgecombe, Rick P" <rick.p.edgecombe@intel.com>,
        "dietmar.eggemann@arm.com" <dietmar.eggemann@arm.com>,
        "keescook@chromium.org" <keescook@chromium.org>,
        "brauner@kernel.org" <brauner@kernel.org>,
        "shuah@kernel.org" <shuah@kernel.org>,
        "mgorman@suse.de" <mgorman@suse.de>,
        "dave.hansen@linux.intel.com" <dave.hansen@linux.intel.com>,
        "fweimer@redhat.com" <fweimer@redhat.com>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        "vincent.guittot@linaro.org" <vincent.guittot@linaro.org>,
        "hjl.tools@gmail.com" <hjl.tools@gmail.com>,
        "rostedt@goodmis.org" <rostedt@goodmis.org>,
        "mingo@redhat.com" <mingo@redhat.com>,
        "tglx@linutronix.de" <tglx@linutronix.de>,
        "vschneid@redhat.com" <vschneid@redhat.com>,
        "catalin.marinas@arm.com" <catalin.marinas@arm.com>,
        "bristot@redhat.com" <bristot@redhat.com>,
        "will@kernel.org" <will@kernel.org>,
        "hpa@zytor.com" <hpa@zytor.com>,
        "peterz@infradead.org" <peterz@infradead.org>,
        "jannh@google.com" <jannh@google.com>,
        "bp@alien8.de" <bp@alien8.de>,
        "bsegall@google.com" <bsegall@google.com>,
        "linux-kselftest@vger.kernel.org" <linux-kselftest@vger.kernel.org>,
        "linux-api@vger.kernel.org" <linux-api@vger.kernel.org>,
        "x86@kernel.org" <x86@kernel.org>,
        "juri.lelli@redhat.com" <juri.lelli@redhat.com>, nd@arm.com
Subject: Re: [PATCH RFC RFT 2/5] fork: Add shadow stack support to clone3()
Message-ID: <ZT+V5VlXg/PsIfpM@arm.com>
References: <20231023-clone3-shadow-stack-v1-0-d867d0b5d4d0@kernel.org>
 <20231023-clone3-shadow-stack-v1-2-d867d0b5d4d0@kernel.org>
 <dc9a3dd544bbf859142c5582011a924b1c1bf6ed.camel@intel.com>
 <8b0c9332-ba56-4259-a71f-9789d28391f1@sirena.org.uk>
 <2ec0be71ade109873445a95f3f3c107711bb0943.camel@intel.com>
 <807a8142-7a8e-4563-9859-8e928156d7e5@sirena.org.uk>
 <ZTrOw97NFjUpANMg@debug.ba.rivosinc.com>
 <ZTuj565SqIb9KjQr@arm.com>
 <ZTxGovqKdhA5hYMz@debug.ba.rivosinc.com>
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
In-Reply-To: <ZTxGovqKdhA5hYMz@debug.ba.rivosinc.com>
MIME-Version: 1.0
NoDisclaimer: true
X-Microsoft-Antispam-Message-Info-Original: vse0kB4yFhg2Xbe+2Sp4mWIXbEsJ4uG9NpIaLAVGq3cU9t2jgfkkB/5gFEGuB7fFu3/+IuaF1ANtmF7n5LKVxI4KwUy2rntXyjwn7u9VcvkXmYdYxkA9PuY8ST416f8qeORRcE0VAaOlTU4HlZa9hQ0SS0DZxec5WwsaN4y/wivC8rVQEUiB31XEcpImFkzNcU9+j8w2DKjFtB7fb012AhvUadnUBmTHqm465XOlgzNYhMpywKBqoyTZpoO0l83U3hQcB+/KY3gaoxU5FMKjxpBOFG7rbGERi69TDAoo0lxt+Ks/HVbbVz2dH1VDx1rsA0OIRY0irbA3IC4gbrz3Q+YJtcJrFMPt4JXDdZQcIWKPcdv4o28l+k1IzbAi0VN3aXw4qzYpQ3Bau9pPErcjF3umlFzAeMPzTCN69C/X9vV8s8mLmlyOi5voZYS0nw3Xec5l4KTmSY0pOmln1vx+1Qm2Z3JYh3RGR+/6l3LJaVIkDvJ+7YiFzMg4KGtwjqKBHS2rZxOOgZlc7cEJdJq2xO5oVCuUJ3iReXryCXIw1aERiFBXCW7kNFlf9v/0t9PH
X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DB9PR08MB7179.eurprd08.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(366004)(376002)(39860400002)(346002)(396003)(136003)(230922051799003)(64100799003)(1800799009)(186009)(451199024)(66556008)(66476007)(54906003)(6916009)(316002)(38100700002)(6666004)(6506007)(6512007)(6486002)(478600001)(2616005)(66946007)(26005)(5660300002)(41300700001)(2906002)(7416002)(8676002)(8936002)(4326008)(86362001)(36756003);DIR:OUT;SFP:1101;
X-MS-Exchange-Transport-CrossTenantHeadersStamped: GV1PR08MB7708
Original-Authentication-Results: dkim=none (message not signed)
 header.d=none;dmarc=none action=none header.from=arm.com;
X-EOPAttributedMessage: 0
X-MS-Exchange-Transport-CrossTenantHeadersStripped: AM2PEPF0001C714.eurprd05.prod.outlook.com
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-Correlation-Id-Prvs: 4a1c4624-f69b-4485-2a72-08dbd93ce1cc
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: 7G73Rm3RgQpDOPh/BTIQfCvB8UVKWnVGs2Op4ikh8kjMpv7hU9f4Pu6c/BLRG9DD3GRUxsrXyfrDZtludliqKPJfmee4u9Cx1a/c/dP4pF5yAdrn1nJXobWkYHVj6BrLxT7Glkt59jrExKPevHIRbB89vP3qdNyCdtjx3zFccDnuVLuyXq5MeRxWXgCE7U1wa3GoxAAn8olZH50zUzikVqRWXPpyprOEc5pi2kztrPKENoXeHP9K1/aH2FZIc+TgT5q/sI6X7OrkYONZ4UtYNq1H5z/S8iUIzbTMyLIG00wMqWR0CXOUK21Rzz1fYTE7Ywv9YHJe/lrYOLJU5s+MMBlpH0poMUxcD+bcJPYOZoh9C86UIchdAxNgc0bdH5CATxSvmk471sDej4W8l2cIiuToNv1pBP92dUZBrX0j5NfkynJuGbSAkUrsBFE9lf9IFddQWf+xJtFnY6GxX645r7Q2UR23Bi9JdVCVBZai3Q+oSSK0wHiSisDUydOSsVDRXmaGpDUdvLjr82b0gdWfI8yEHZRKbhNwVqWJomKQRMXuoz65ccG0TpSiv+BadAD63+kdWiBVuWyZ3cHIDUrJ13dFl1KyzeaV1gNixe+XYslZ453hOmqGt3nR9I4hOwS7m905NcWX2OAd7CKJy+Bdc+7X+t/IufhpToPzgz70Y+8yaLepoPUq1XIgkyBFGVs2tJHDTauxQlXGHN7XT7VVN6KS97JPQTwrK3HRMKnR1YoNA4vpFp6wHvz71IAPRuo8
X-Forefront-Antispam-Report: CIP:63.35.35.123;CTRY:IE;LANG:en;SCL:1;SRV:;IPV:CAL;SFV:NSPM;H:64aa7808-outbound-1.mta.getcheckrecipient.com;PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com;CAT:NONE;SFS:(13230031)(4636009)(136003)(396003)(39860400002)(376002)(346002)(230922051799003)(64100799003)(82310400011)(186009)(1800799009)(451199024)(40470700004)(46966006)(36840700001)(6512007)(26005)(40460700003)(36756003)(40480700001)(86362001)(82740400003)(81166007)(356005)(2616005)(336012)(5660300002)(2906002)(478600001)(6506007)(36860700001)(47076005)(6666004)(8936002)(450100002)(6862004)(8676002)(6486002)(316002)(4326008)(54906003)(70206006)(41300700001)(70586007);DIR:OUT;SFP:1101;
X-OriginatorOrg: arm.com
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Oct 2023 11:39:48.5249
 (UTC)
X-MS-Exchange-CrossTenant-Network-Message-Id: 37a6f3bc-d80e-4ec8-a58f-08dbd93cec27
X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d
X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d;Ip=[63.35.35.123];Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com]
X-MS-Exchange-CrossTenant-AuthSource: AM2PEPF0001C714.eurprd05.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Anonymous
X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS2PR08MB9571
X-Spam-Status: No, score=-0.7 required=5.0 tests=DKIM_SIGNED,DKIM_VALID,
	HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,
	SPF_PASS,UNPARSEABLE_RELAY autolearn=unavailable autolearn_force=no
	version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on agentk.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (agentk.vger.email [0.0.0.0]); Mon, 30 Oct 2023 04:40:28 -0700 (PDT)

The 10/27/2023 16:24, Deepak Gupta wrote:
> On Fri, Oct 27, 2023 at 12:49:59PM +0100, Szabolcs.Nagy@arm.com wrote:
> > no. the lifetime is the issue: a stack in principle can outlive
> > a thread and resumed even after the original thread exited.
> > for that to work the shadow stack has to outlive the thread too.
> 
> I understand an application can pre-allocate a pool of stack and re-use
> them whenever it's spawning new threads using clone3 system call.
> 
> However, once a new thread has been spawned how can it resume?

a thread can getcontext then exit. later another thread
can setcontext and execute on the stack of the exited
thread and return to a previous stack frame there.

(unlikely to work on runtimes where tls or thread id is
exposed and thus may be cached on the stack. so not for
posix.. but e.g. a go runtime could do this)

> By resume I mean consume the callstack context from an earlier thread.
> Or you meant something else by `resume` here?
> 
> Can you give an example of such an application or runtime where a newly
> created thread consumes callstack context created by going away thread?

my claim was not that existing runtimes are doing this,
but that the linux interface contract allows this and
tieing the stack lifetime to the thread is a change of
contract.

> > (or the other way around: a stack can be freed before the thread
> > exits, if the thread pivots away from that stack.)
> 
> This is simply a thread saying that I am moving to a different stack.
> Again, interested in learning why would a thread do that. If I've to
> speculate on reasons, I could think of user runtime managing it's own
> pool of worker items (some people call them green threads) or current
> stack became too small.

switching stack is common, freeing the original stack may not be,
but there is nothing that prevents this and then the corresponding
shadow stack is clearly leaked if the kernel manages it. the amount
of leak is proportional to the number of live threads and the sum
of their original stack size which can be big.

but as i said i think this lifetime issue is minor compared
to other shadow stack issues, so it is ok if the shadow stack
is kernel managed.