Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754485AbZJ2TsI (ORCPT ); Thu, 29 Oct 2009 15:48:08 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1754229AbZJ2TsH (ORCPT ); Thu, 29 Oct 2009 15:48:07 -0400 Received: from out02.mta.xmission.com ([166.70.13.232]:50575 "EHLO out02.mta.xmission.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754012AbZJ2TsF (ORCPT ); Thu, 29 Oct 2009 15:48:05 -0400 To: Yinghai Lu Cc: Kenji Kaneshige , Jesse Barnes , "linux-kernel\@vger.kernel.org" , "linux-pci\@vger.kernel.org" , Alex Chiang , Ivan Kokshaysky , Bjorn Helgaas Subject: Re: [PATCH] pci: pciehp update the slot bridge res to get big range for pcie devices References: <4ADEB601.8020200@kernel.org> <4AE52B68.3070501@jp.fujitsu.com> <4AE53883.3070709@kernel.org> <4AE5545E.1020900@jp.fujitsu.com> <4AE55D12.30403@kernel.org> <4AE57976.4060107@jp.fujitsu.com> <4AE5E37F.8070707@kernel.org> <4AE5EFDB.2060908@kernel.org> <4AE80170.6030402@jp.fujitsu.com> <4AE88305.8020207@kernel.org> <4AE897B4.9030206@kernel.org> <4AE8A080.1040208@kernel.org> <4AE8BA1D.5030908@kernel.org> <4AE8C4BF.8040306@kernel.org> <4AE95A57.6050504@kernel.org> <4AE9CA10.10302@kernel.org> From: ebiederm@xmission.com (Eric W. Biederman) Date: Thu, 29 Oct 2009 12:48:04 -0700 In-Reply-To: <4AE9CA10.10302@kernel.org> (Yinghai Lu's message of "Thu\, 29 Oct 2009 10\:00\:00 -0700") Message-ID: User-Agent: Gnus/5.11 (Gnus v5.11) Emacs/22.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-XM-SPF: eid=;;;mid=;;;hst=in02.mta.xmission.com;;;ip=76.21.114.89;;;frm=ebiederm@xmission.com;;;spf=neutral X-SA-Exim-Connect-IP: 76.21.114.89 X-SA-Exim-Mail-From: ebiederm@xmission.com X-SA-Exim-Version: 4.2.1 (built Thu, 25 Oct 2007 00:26:12 +0000) X-SA-Exim-Scanned: No (on in02.mta.xmission.com); Unknown failure Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 3083 Lines: 67 Yinghai Lu writes: > Eric W. Biederman wrote: >> Yinghai Lu writes: >> >>> Eric W. Biederman wrote: >>>> Yinghai Lu writes: >>>>> after closing look up the code, it looks it will not break your setup. >>>>> >>>>> 1. before the patches: >>>>> a. when master card is inserted, all bridge in that card will get assigned with min_size >>>>> b. when new cards is inserted to those slots in master card, will get assigned in the bridge size. >>>>> >>>>> 2. after the patches: v5 >>>>> a. booted up, all leaf bridge mmio get clearred. >>>>> b. when master card is inserted, all bridge in that card will get assigned with min_size, and master bridge will be sum of them >>>>> c. when new cards is inserted to those slots in master card, will get assigned in the bridge size. >>>>> >>>>> can you check those two patches in your setup to verify it? >>>> I have a much simpler case I will break, as I tried something similar by accident. >>> which kernel version? >>>> AMD cpu MCP55 with one pcie port setup as hotplug. >>>> The system only has 2GB of RAM. So plenty of space for pcie devices. >>> one or two ht chains? >> >> One chain. >> >>> do you still have lspci -tv with it? >>> >>>> If the firmware assigns nothing and linux at boot time assigns the pci mmio space: >>>> Reads from the bar of the hotplugged device work >>>> Writes to the bar of the hotplugged device, cause further writes to go to lala land. >>>> >>>> So I had to have the firmware make the assignment, because only it knows the >>>> details of the hidden AMD bar registers for each hypertransport chain etc. >>> that mean kernel doesn't get peer root bus res probed properly >> >> How do you do that without having drivers for the peer root bus? > > we have amd_bus.c to handle amd k8 system with two chains. but one chain is skipped. > (wonder if need to reenable that for one chain k8 system) I was running a 32bit kernel so this didn't kick in. That might have helped. At least as far as recognizing the resources weren't properly routed. If we don't setup the infrastructure so that we can reprogram those resources I'm not certain how much good it will do in general. > another intel_bus.c is on the way to 2.6.33. > > when use_crs is used, those info from pci conf space is not used but just print out for check if _CRS is right or not. If enough space is routed and we get accurate information I am certain that is fine. I am still worried about the change in policy though. Only rerouting things when there is a need gives us the best chance of working everywhere. Freeing unused resources on hotplug ports before we plug in a device scares me, because we do something that should but doesn't we reallocate them. If there is simply not enough room we can do something different. Eric -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/