Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Date:   Sun, 3 Jul 2022 00:22:18 -0400 (EDT)
From:   Cal Peake <cp@absolutedigital.net>
To:     Kernel Mailing List <linux-kernel@vger.kernel.org>
cc:     Bjorn Helgaas <bhelgaas@google.com>,
        Huacai Chen <chenhuacai@kernel.org>
Subject: [RFC] vgaarb: Add a module parm to use the first VGA device for
 boot
Message-ID: <5e3f182f-7b6e-5c7f-d9a9-7cd1417cc38d@absolutedigital.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Precedence: bulk

Hi,

I have a dual GPU system with the GPU in the first CPU PCIe slot for the 
host and the GPU in the second CPU PCIe slot being passed through to a 
virtual machine.

Currently, the VGA arbiter enumerates through all VGA devices in the order 
that they appear in on the bus with the last one ultimately getting the 
assignment for boot device.

This is a problem because once the VFIO PCI driver claims the second GPU, 
all display output is lost -- just empty black screens on both cards.

Setting VGA_ARB_MAX_GPUS to 1 helps a little: the X server will initialize 
on the first GPU like it should, but there's no VTs to be found (i.e. 
Alt-F1/F2/etc), just more black screens.

Below is an attempt at a fix by creating a kernel param to have the VGA 
arbiter use the first VGA device it finds for the boot device and then 
subsequently ignore the rest for this task.

-- 
Cal Peake

--- ./drivers/pci/vgaarb.c	2022-07-02 10:44:56.000000000 -0400
+++ ./drivers/pci/vgaarb.c	2022-07-02 22:55:24.291822548 -0400
@@ -35,6 +35,10 @@
 
 #include <linux/vgaarb.h>
 
+static bool use_first;
+module_param(use_first, bool, 0);
+MODULE_PARM_DESC(force, "Set to one to use the first VGA device for boot");
+
 static void vga_arbiter_notify_clients(void);
 /*
  * We keep a list of all vga devices in the system to speed
@@ -815,7 +819,8 @@ static bool vga_arbiter_add_pci_device(s
 		bus = bus->parent;
 	}
 
-	if (vga_is_boot_device(vgadev)) {
+	if (vga_is_boot_device(vgadev) &&
+	    (!use_first || (use_first && !vga_default_device()))) {
 		vgaarb_info(&pdev->dev, "setting as boot VGA device%s\n",
 			    vga_default_device() ?
 			    " (overriding previous)" : "");