Return-Path: Received: from mail-iw0-f174.google.com ([209.85.214.174]:60148 "EHLO mail-iw0-f174.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1758426Ab0KROLc convert rfc822-to-8bit (ORCPT ); Thu, 18 Nov 2010 09:11:32 -0500 Received: by iwn35 with SMTP id 35so3549109iwn.19 for ; Thu, 18 Nov 2010 06:11:31 -0800 (PST) In-Reply-To: <1290035454.3070.15.camel@heimdal.trondhjem.org> References: <1289964990-4480-1-git-send-email-andros@netapp.com> <1289964990-4480-2-git-send-email-andros@netapp.com> <1290035454.3070.15.camel@heimdal.trondhjem.org> Date: Thu, 18 Nov 2010 09:11:12 -0500 Message-ID: Subject: Re: [PATCH 1/3] NFS add minorversion to nfs_find_client search From: "William A. (Andy) Adamson" To: Trond Myklebust Cc: benny@panasas.com, linux-nfs@vger.kernel.org Content-Type: text/plain; charset=ISO-8859-1 Sender: linux-nfs-owner@vger.kernel.org List-ID: MIME-Version: 1.0 On Wed, Nov 17, 2010 at 6:10 PM, Trond Myklebust wrote: > On Tue, 2010-11-16 at 22:36 -0500, andros@netapp.com wrote: >> From: Andy Adamson >> >> The v4.0 and v4.1 callback threads share a pg_authenticate method. >> Minorversions do not share an nfs_client. >> >> Respond with an rpc auth error (SVC_DENIED) if the nfs_client matching the >> server address, nfs version, and minorversion is not found. > > No. We should simply drop the request. See comments below. > >> Signed-off-by: Andy Adamson >> --- >> ?fs/nfs/callback.c ? ? ?| ? 19 +++++++++++++------ >> ?fs/nfs/callback.h ? ? ?| ? ?4 ++-- >> ?fs/nfs/callback_proc.c | ? ?8 ++++---- >> ?fs/nfs/client.c ? ? ? ?| ? 16 +++++++++++----- >> ?fs/nfs/internal.h ? ? ?| ? ?2 +- >> ?5 files changed, 31 insertions(+), 18 deletions(-) >> >> diff --git a/fs/nfs/callback.c b/fs/nfs/callback.c >> index aeec017..962c5de 100644 >> --- a/fs/nfs/callback.c >> +++ b/fs/nfs/callback.c >> @@ -17,9 +17,7 @@ >> ?#include >> ?#include >> ?#include >> -#if defined(CONFIG_NFS_V4_1) >> ?#include >> -#endif >> >> ?#include >> >> @@ -346,19 +344,28 @@ static int check_gss_callback_principal(struct nfs_client *clp, >> ? ? ? return SVC_OK; >> ?} >> >> +/* >> + * Lookup the nfs_client that corresponds to this backchannel request. >> + * >> + * We only support NFSv4.1 callbacks on the fore channel connection, so >> + * the svc_is_backchannel test indicates which minorversion nfs_client we are >> + * searching for. >> + */ >> ?static int nfs_callback_authenticate(struct svc_rqst *rqstp) >> ?{ >> ? ? ? struct nfs_client *clp; >> ? ? ? RPC_IFDEBUG(char buf[RPC_MAX_ADDRBUFLEN]); >> + ? ? u32 minorversion = svc_is_backchannel(rqstp) ? 1 : 0; > > Hmm... Nope. minorversion == CB_COMPOUND4args->minorversion. Nope. We are in the pg_authenticate method called from svc_process_common in the RPC layer. We know nothing in the NFS layer. We won't know what CB_COMPOUND4args says until after decode. What's ugly is that the session information really belongs in the RPC layer. The other way I was thinking of coding this is to not share the svc_program for v4 and v4.1 callback services. Each svc_program can then declare it's own pg_authenticate method which will know if it's v4.0 or v4.1. > >> ? ? ? int ret = SVC_OK; >> >> ? ? ? /* Don't talk to strangers */ >> - ? ? clp = nfs_find_client(svc_addr(rqstp), 4); >> + ? ? clp = nfs_find_client(svc_addr(rqstp), 4, minorversion); > > Why do we need this at all in the NFSv4.1 case? Unlike minor version == > 0, we _know_ that it arrived on a socket that is associated to a > specific session. Can't we find a way to pass that information down to > the callback server thread? As long as we only support a single session to a server, and a single back channel using the fore channel connection, doesn't using the minorversion has the same effect? I believe there is only one nfs_client struct associated with the rq_addr, nfsversion, minorversion> tuple. By adding the minorversion, nfs_find_client now uses the same criteria as nfs_match_client which decides when to create a new nfs_client or use an existing one. Knowing which session is associated with the callback thread won't do us any good here where we have yet to decode the request session from CB_SEQUENCE. > >> ? ? ? if (clp == NULL) >> - ? ? ? ? ? ? return SVC_DROP; >> + ? ? ? ? ? ? return SVC_DENIED; > > Nope. SVC_DROP is correct. We shouldn't reply to unsolicited callbacks > at all... Should nfsd also do the same? In nfsd's pg_authenticate routine svcauth_gss_set_client, if the auth domain is not found - which I think is the same as not finding a matching nfs_client in the callback server, SVC_DENIED is returned. The other nfsd pg_authenticate routine, svcauth_unix_set_client, also returns SVC_DENIED when the ip_map_cache or lookup fails. So, nfsd replys with an rpc auth error to unsolicited requests. > >> >> - ? ? dprintk("%s: %s NFSv4 callback!\n", __func__, >> - ? ? ? ? ? ? ? ? ? ? svc_print_addr(rqstp, buf, sizeof(buf))); >> + ? ? dprintk("%s: %s NFSv4 callback! minorversion %d\n", __func__, >> + ? ? ? ? ? ? ? ? ? ? svc_print_addr(rqstp, buf, sizeof(buf)), >> + ? ? ? ? ? ? ? ? ? ? clp->cl_minorversion); >> >> ? ? ? switch (rqstp->rq_authop->flavour) { >> ? ? ? ? ? ? ? case RPC_AUTH_NULL: >> diff --git a/fs/nfs/callback.h b/fs/nfs/callback.h >> index b16dd1f..b69bec5 100644 >> --- a/fs/nfs/callback.h >> +++ b/fs/nfs/callback.h >> @@ -177,7 +177,7 @@ static inline void put_session_client(struct nfs4_session *session) >> ?static inline struct nfs_client * >> ?find_client_from_cps(struct cb_process_state *cps, struct sockaddr *addr) >> ?{ >> - ? ? return cps->session ? cps->session->clp : nfs_find_client(addr, 4); >> + ? ? return cps->session ? cps->session->clp : nfs_find_client(addr, 4, 0); >> ?} > > This is ugly. If we can save session info in 'struct cb_process_state', > then why can't we save the NFSv4.0 client too? We can. It will only be used if both CB_GETATTR and CB_RECALL appear in the same CB_COMPOUND, and there is no ordering. But I agree, we should save the nfs_client and dereference it in nfs4_callback_compound at the end of processing. > >> >> ?#else /* CONFIG_NFS_V4_1 */ >> @@ -189,7 +189,7 @@ static inline void nfs_client_return_layouts(struct nfs_client *clp) >> ?static inline struct nfs_client * >> ?find_client_from_cps(struct cb_process_state *cps, struct sockaddr *addr) >> ?{ >> - ? ? return nfs_find_client(addr, 4); >> + ? ? return nfs_find_client(addr, 4, 0); >> ?} >> >> ?static inline void put_session_client(struct nfs4_session *session) >> diff --git a/fs/nfs/callback_proc.c b/fs/nfs/callback_proc.c >> index b4c68e9..69d085a 100644 >> --- a/fs/nfs/callback_proc.c >> +++ b/fs/nfs/callback_proc.c >> @@ -505,13 +505,13 @@ validate_seqid(struct nfs4_slot_table *tbl, struct cb_sequenceargs * args) >> ? * Returns NULL if there are no connections with sessions, or if no session >> ? * matches the one of interest. >> ? */ >> - static struct nfs_client *find_client_with_session( >> - ? ? const struct sockaddr *addr, u32 nfsversion, >> - ? ? struct nfs4_sessionid *sessionid) >> +static struct nfs_client * >> +find_client_with_session(const struct sockaddr *addr, u32 nfsversion, >> + ? ? ? ? ? ? ? ? ? ? ?struct nfs4_sessionid *sessionid) >> ?{ >> ? ? ? struct nfs_client *clp; >> >> - ? ? clp = nfs_find_client(addr, 4); >> + ? ? clp = nfs_find_client(addr, 4, 1); > > We pass 'u32 nfsversion' as an argument, yet we hand code the > nfs_find_client version and minor version arguments? Yes - we should not pass the nfsversion. > >> ? ? ? if (clp == NULL) >> ? ? ? ? ? ? ? return NULL; >> >> diff --git a/fs/nfs/client.c b/fs/nfs/client.c >> index dbf43e7..ba7712c 100644 >> --- a/fs/nfs/client.c >> +++ b/fs/nfs/client.c >> @@ -371,7 +371,8 @@ EXPORT_SYMBOL(nfs_sockaddr_cmp); >> ? * Find a client by IP address and protocol version >> ? * - returns NULL if no such client >> ? */ >> -struct nfs_client *nfs_find_client(const struct sockaddr *addr, u32 nfsversion) >> +struct nfs_client *nfs_find_client(const struct sockaddr *addr, u32 nfsversion, >> + ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?u32 minorversion) >> ?{ >> ? ? ? struct nfs_client *clp; >> >> @@ -385,7 +386,8 @@ struct nfs_client *nfs_find_client(const struct sockaddr *addr, u32 nfsversion) >> ? ? ? ? ? ? ? ? ? ? ? continue; >> >> ? ? ? ? ? ? ? /* Different NFS versions cannot share the same nfs_client */ >> - ? ? ? ? ? ? if (clp->rpc_ops->version != nfsversion) >> + ? ? ? ? ? ? if (clp->rpc_ops->version != nfsversion || >> + ? ? ? ? ? ? ? ? clp->cl_minorversion != minorversion) >> ? ? ? ? ? ? ? ? ? ? ? continue; >> >> ? ? ? ? ? ? ? /* Match only the IP address, not the port number */ >> @@ -401,13 +403,16 @@ struct nfs_client *nfs_find_client(const struct sockaddr *addr, u32 nfsversion) >> ?} >> >> ?/* >> - * Find a client by IP address and protocol version >> - * - returns NULL if no such client >> + * Callback service RPC layer pg_authenticate method. >> + * >> + * Find a client by IP address, protocol version, and minorversion. >> + * Returns NULL if no such client >> ? */ >> ?struct nfs_client *nfs_find_client_next(struct nfs_client *clp) >> ?{ >> ? ? ? struct sockaddr *sap = (struct sockaddr *)&clp->cl_addr; >> ? ? ? u32 nfsvers = clp->rpc_ops->version; >> + ? ? u32 minorversion = clp->cl_minorversion; >> >> ? ? ? spin_lock(&nfs_client_lock); >> ? ? ? list_for_each_entry_continue(clp, &nfs_client_list, cl_share_link) { >> @@ -418,7 +423,8 @@ struct nfs_client *nfs_find_client_next(struct nfs_client *clp) >> ? ? ? ? ? ? ? ? ? ? ? continue; >> >> ? ? ? ? ? ? ? /* Different NFS versions cannot share the same nfs_client */ >> - ? ? ? ? ? ? if (clp->rpc_ops->version != nfsvers) >> + ? ? ? ? ? ? if (clp->rpc_ops->version != nfsvers || >> + ? ? ? ? ? ? ? ? clp->cl_minorversion != minorversion) >> ? ? ? ? ? ? ? ? ? ? ? continue; >> >> ? ? ? ? ? ? ? /* Match only the IP address, not the port number */ >> diff --git a/fs/nfs/internal.h b/fs/nfs/internal.h >> index 0a9ea58..d89aded 100644 >> --- a/fs/nfs/internal.h >> +++ b/fs/nfs/internal.h >> @@ -131,7 +131,7 @@ extern void nfs_umount(const struct nfs_mount_request *info); >> ?extern struct rpc_program nfs_program; >> >> ?extern void nfs_put_client(struct nfs_client *); >> -extern struct nfs_client *nfs_find_client(const struct sockaddr *, u32); >> +extern struct nfs_client *nfs_find_client(const struct sockaddr *, u32, u32); >> ?extern struct nfs_client *nfs_find_client_next(struct nfs_client *); >> ?extern struct nfs_server *nfs_create_server( >> ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? const struct nfs_parsed_mount_data *, > > > -- > To unsubscribe from this list: send the line "unsubscribe linux-nfs" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at ?http://vger.kernel.org/majordomo-info.html >