Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67;
Date:   Wed, 3 Jul 2019 22:34:33 +0200 (CEST)
From:   Thomas Gleixner <tglx@linutronix.de>
To:     Nadav Amit <namit@vmware.com>
cc:     LKML <linux-kernel@vger.kernel.org>,
        "x86@kernel.org" <x86@kernel.org>,
        Ricardo Neri <ricardo.neri-calderon@linux.intel.com>,
        Stephane Eranian <eranian@google.com>,
        Feng Tang <feng.tang@intel.com>
Subject: Re: [patch 16/18] x86/apic: Convert 32bit to IPI shorthand static
 key
In-Reply-To: <1DC35A28-DEBC-4A46-AC35-3AADD23AA40D@vmware.com>
Message-ID: <alpine.DEB.2.21.1907032213250.1802@nanos.tec.linutronix.de>
References: <20190703105431.096822793@linutronix.de> <20190703105917.044463061@linutronix.de> <1DC35A28-DEBC-4A46-AC35-3AADD23AA40D@vmware.com>
User-Agent: Alpine 2.21 (DEB 202 2017-01-01)
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Sender: linux-kernel-owner@vger.kernel.org
Precedence: bulk

Nadav,

On Wed, 3 Jul 2019, Nadav Amit wrote:
> > On Jul 3, 2019, at 3:54 AM, Thomas Gleixner <tglx@linutronix.de> wrote:
> > void default_send_IPI_all(int vector)
> > {
> > -	if (apic_ipi_shorthand_off || vector == NMI_VECTOR) {
> > +	if (static_branch_likely(&apic_use_ipi_shorthand)) {
> > 		apic->send_IPI_mask(cpu_online_mask, vector);
> > 	} else {
> > 		__default_send_IPI_shortcut(APIC_DEST_ALLINC, vector);
> 
> It may be better to check the static-key in native_send_call_func_ipi() (and
> other callers if there are any), and remove all the other checks in
> default_send_IPI_all(), x2apic_send_IPI_mask_allbutself(), etc.

That makes sense. Should have thought about that myself, but hunting that
APIC emulation issue was affecting my brain obviously :)
 
>  void native_send_call_func_ipi(const struct cpumask *mask)
>  {
> -	cpumask_var_t allbutself;
> -
> -	if (!alloc_cpumask_var(&allbutself, GFP_ATOMIC)) {
> -		apic->send_IPI_mask(mask, CALL_FUNCTION_VECTOR);
> -		return;
> +	int cpu, this_cpu = smp_processor_id();
> +	bool allbutself = true;
> +	bool self = false;
> +
> +	for_each_cpu_and_not(cpu, cpu_online_mask, mask) {
> +
> +		if (cpu != this_cpu) {
> +			allbutself = false;
> +			break;
> +		}
> +		self = true;

That accumulates to a large iteration in the worst case. 

>  	}
>  
> -	cpumask_copy(allbutself, cpu_online_mask);
> -	__cpumask_clear_cpu(smp_processor_id(), allbutself);
> -
> -	if (cpumask_equal(mask, allbutself) &&
> +	if (allbutself && !self &&
>  	    cpumask_equal(cpu_online_mask, cpu_callout_mask))

Hmm. I overlooked that one. Need to take a deeper look.

>  		apic->send_IPI_allbutself(CALL_FUNCTION_VECTOR);
>  	else
>  		apic->send_IPI_mask(mask, CALL_FUNCTION_VECTOR);

Let me think about it for a while.

Thanks,

	tglx