Received: by 2002:a05:6358:1087:b0:cb:c9d3:cd90 with SMTP id j7csp1966912rwi; Sat, 15 Oct 2022 06:05:40 -0700 (PDT) X-Google-Smtp-Source: AMsMyM4bgtlxLmiCJKpCWBICISWUk9kxZdyIgjW1/o0De4xL0Af10j6t00hSWPWXXB7DzlsC0UZ4 X-Received: by 2002:a17:907:2bdb:b0:78d:cf5a:210e with SMTP id gv27-20020a1709072bdb00b0078dcf5a210emr1916722ejc.747.1665839140309; Sat, 15 Oct 2022 06:05:40 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1665839140; cv=none; d=google.com; s=arc-20160816; b=dGlsGVMJke3MmUbmEVXm1fTjHOvQk3KeUEQDUUL3zptL9r43xusk72I57d7pZItSHH aOXffz832XLSSWhk6JCgPhw23J7wPeeAfD+du7xe4eXvQOAu0v13hHcUx92NXx0MLmOi 0qdGLi1l0gp1gl1bo9xqXOtCqnsISPoUAAoJocdT4svvCfWFSByzg4JfBUa5+bdHdhHG uIhfUm+ehGOm7d/h2T6b0MBDu1VbXFBVyqR4u5CEewIGgThnEjuNA7vdHWTWrEBv/0eO rcW/JuI4IfueTPaKIGOUC/OzkXdycxeKy78AcFxeukR/kUF0R6Ra87kphR+var/fj+Ji bbsw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:message-id:subject:to:from:date :dkim-signature; bh=+tKMMXHtEvuvpGU/yqohge4E2+mVqvg5+vI+Qbzj4bA=; b=ZsHqGkzNaI4+9p4IHn2LFSpB58hCDCaDpA7fijCxcUW0s4CTAwEWg/HIxueXGTDZSS wMwqNJH689b/FD0OKiivAN+XuYtRzEncsSYooYW91Jx97kAA6gETbOvuS5N4htGPgWIV rXcQUSjM/dttm24cIwFc/oQjvK5lvp0Asu4Yz1Faax5ldKOe6EGpnx97LBZPzgf9kAQ0 SpUl/ot6rJbzSRtSJhoW38xrVh4cCp8hi9oFWtE75tifdLgl1OIgUGctMuY03636g7Ws UhiXiwI5YfFq64hEcqpOpzWtWvr8hGUZmTkp99kcDgwQiQrjEHxDWcR1NLI5hd6dFx3u jI8g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@dwd.de header.s=dwd-csg20210107 header.b=QQhjL9NI; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=dwd.de Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id dr8-20020a170907720800b00781b6ce15e1si5248102ejc.101.2022.10.15.06.05.13; Sat, 15 Oct 2022 06:05:40 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@dwd.de header.s=dwd-csg20210107 header.b=QQhjL9NI; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=dwd.de Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229663AbiJOMUP (ORCPT + 99 others); Sat, 15 Oct 2022 08:20:15 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:52716 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229600AbiJOMUN (ORCPT ); Sat, 15 Oct 2022 08:20:13 -0400 X-Greylist: delayed 387 seconds by postgrey-1.37 at lindbergh.monkeyblade.net; Sat, 15 Oct 2022 05:20:10 PDT Received: from ofcsgdbm.dwd.de (ofcsgdbm.dwd.de [141.38.3.245]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A96A926AC3 for ; Sat, 15 Oct 2022 05:20:10 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by ofcsg2dn3.dwd.de (Postfix) with ESMTP id 4MqMc6130Jz2x7n for ; Sat, 15 Oct 2022 12:13:42 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=dwd.de; h= content-type:content-type:mime-version:message-id:subject :subject:from:from:date:date:received:received:received:received :received:received:received:received; s=dwd-csg20210107; t= 1665836022; x=1667045623; bh=rbnkaQ34ZXsuiWCbvvrp/v0MWHx+Ep2AOKS 2c6cbgww=; b=QQhjL9NIfqyHMU5KRdjeYPAOzhE0evlP0dgWje0dAqtVXsJpcU8 ONPjPPZr/SyTmpKeKmaOqN7jWx1uEVygf4NZS7uUQbDTx9/LSHZnNjVHOxq5nxEQ VKwS8Van3VPADASOmAoUC765V7nk8+LOcw9KvG9/kgyxvkDDvL9y862DeCr7GTD5 sjV2EcuC1KOiQ3nULma0DmAB+zOSOicaIVR2R3tpuuLtCzO4QgLK7pcAxmLQ1Bza i69Tg4Xb6+PeV+0Tb9/zIUU8jILMkNIu3YPkQqUTWTDWn9klhs/i9fNrNLYJfcTt O2NdFp9NIf37h2MqKtw7qrTDGWTUA39CyCQ== X-Virus-Scanned: by amavisd-new at csg.dwd.de Received: from ofcsg2cteh1.dwd.de ([172.30.232.65]) by localhost (ofcsg2dn3.dwd.de [172.30.232.26]) (amavisd-new, port 10024) with ESMTP id yv6sbuQ2aEdk for ; Sat, 15 Oct 2022 12:13:42 +0000 (UTC) Received: from ofcsg2cteh1.dwd.de (unknown [127.0.0.1]) by DDEI (Postfix) with ESMTP id EA669C900F09 for ; Sat, 15 Oct 2022 12:13:41 +0000 (UTC) Received: from ofcsg2cteh1.dwd.de (unknown [127.0.0.1]) by DDEI (Postfix) with ESMTP id DBC84C900CEE for ; Sat, 15 Oct 2022 12:13:41 +0000 (UTC) X-DDEI-TLS-USAGE: Unused Received: from ofcsgdbm.dwd.de (unknown [172.30.232.26]) by ofcsg2cteh1.dwd.de (Postfix) with ESMTP for ; Sat, 15 Oct 2022 12:13:41 +0000 (UTC) Received: from ofcsgdbm.dwd.de by localhost (Postfix XFORWARD proxy); Sat, 15 Oct 2022 12:13:41 -0000 Received: from ofcsg2dvf2.dwd.de (ofcsg2dvf2.dwd.de [172.30.232.11]) by ofcsg2dn3.dwd.de (Postfix) with ESMTPS id 4MqMc5605Gz2wPY; Sat, 15 Oct 2022 12:13:41 +0000 (UTC) Received: from ofmailhub.dwd.de (ofldap.dwd.de [141.38.39.196]) by ofcsg2dvf2.dwd.de with ESMTP id 29FCDfc7031693-29FCDfc8031693; Sat, 15 Oct 2022 12:13:41 GMT Received: from praktifix.dwd.de (praktifix.dwd.de [141.38.44.46]) by ofmailhub.dwd.de (Postfix) with ESMTP id 7BCA0E25F1; Sat, 15 Oct 2022 12:13:41 +0000 (UTC) Date: Sat, 15 Oct 2022 12:13:41 +0000 (GMT) From: Holger Kiehl To: Jesse Brandeburg , Tony Nguyen , Eric Dumazet , Jakub Kicinski , Paolo Abeni , intel-wired-lan@lists.osuosl.org, netdev@vger.kernel.org, linux-kernel Subject: ice driver not loading with 256 CPU's? Message-ID: MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII X-FE-Last-Public-Client-IP: 141.38.39.196 X-FE-Policy-ID: 2:2:1:SYSTEM X-TMASE-Version: DDEI-5.1-9.0.1002-27202.007 X-TMASE-Result: 10--24.824500-10.000000 X-TMASE-MatchedRID: YjqSxrX+l3Iqc9ul+Xl+76zGfgakLdjamZiw53dqSN/7fZJfDdCIXIHQ 9Kct9aq8FFgbK/N4lN1i3n4ncgiU3raaK/A0riJAL9PWvrwT+Nb1q+x7zkhJWj3jhzzlBjmIfux gplZyxPWrdRXqI7myoH5meJa7guBS0lV5J+1nPDV1e7Xbb6Im2lgv+2jH1dCRtU0lCTMMyfBiY4 PRl594rYHA6IBd3vQs3wxn7Vlsd+Z5BTB1IjcvAp13aYUE0ivyuJpeHGRhXLGZLRO16GOkkit64 qbZa45+jiY8zO68gjmKiPY+pyEfReUgeblHhHsa2h1P6TA0pBtZDdHiTk9OcNkY+KIbxMxzszWb bhESzfdl6wrOTE1+QG0+CMNUhL8lvtK9mMOzEE4Zca7SN08UZMjjOhIFKSRyVpE+/BjC+jD9lXz FM91ErdbJbu0xXgB5CCfd2Lz11s4sm617PZ0pZ+LzNWBegCW28V63bO1QMncLbigRnpKlKTpcQT tiHDgWlExlQIQeRG0= X-TMASE-SNAP-Result: 1.821001.0001-0-1-22:0,33:0,34:0-0 X-TMASE-INERTIA: 0-0;;;; X-DDEI-PROCESSED-RESULT: Safe X-Spam-Status: No, score=-4.4 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_MED,SPF_HELO_NONE, SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hello, I have an AMD system with 2 sockets (each with a EPYC 7763 64-Core) with a total of 256 CPU's and a 4 port Intel 810 nic and get the following error during boot: Oct 15 10:53:35 hermes kernel: ice 0000:e2:00.1: The DDP package was successfully loaded: ICE OS Default Package version 1.3.26.0 Oct 15 10:53:35 hermes kernel: ice 0000:e2:00.1: not enough device MSI-X vectors. requested = 260, available = 252 Oct 15 10:53:35 hermes kernel: ice 0000:e2:00.1: ice_init_interrupt_scheme failed: -34 Oct 15 10:53:35 hermes kernel: ice: probe of 0000:e2:00.1 failed with error -5 Get this error when using default kernel from Alma9 or as above with kernel.org 6.0.2 kernel. Looking at the code (drivers/net/ethernet/intel/ice/ice_main.c ice_ena_msix_range() starting at line 3928) I would assume if I had less CPU's this would not be a problem. Any idea how I can get this working? Thanks, Holger e2:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C for SFP (rev 02) Subsystem: Intel Corporation Ethernet 25G 4P E810-XXV Adapter Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx- Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- SERR- Capabilities: [210 v1] Physical Layer 16.0 GT/s Capabilities: [250 v1] Lane Margining at the Receiver Kernel modules: ice