Received-SPF: pass (google.com: domain of linux-crypto-owner@vger.kernel.org designates 23.128.96.33 as permitted sender) client-ip=23.128.96.33;
Date:   Fri, 15 Sep 2023 06:55:05 +0100
From:   Giovanni Cabiddu <giovanni.cabiddu@intel.com>
To:     Kyle Sanderson <kyle.leet@gmail.com>
CC:     Linux-Kernal <linux-kernel@vger.kernel.org>, <qat-linux@intel.com>,
        "Greg KH" <gregkh@linuxfoundation.org>,
        Linus Torvalds <torvalds@linux-foundation.org>,
        Linux Crypto Mailing List <linux-crypto@vger.kernel.org>
Subject: Re: Linux 6.1.52 regression: Intel QAT kernel panic (memory
 corruption)
Message-ID: <ZQPxuZ2tifa9bQKJ@gcabiddu-mobl1.ger.corp.intel.com>
References: <CACsaVZ+LkHwTKO4XE_FFM62SbF3gGD4DZyse-9Y1UbJUgrhvfA@mail.gmail.com>
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <CACsaVZ+LkHwTKO4XE_FFM62SbF3gGD4DZyse-9Y1UbJUgrhvfA@mail.gmail.com>
Organization: Intel Research and Development Ireland Ltd - Co. Reg. #308263 -
 Collinstown Industrial Park, Leixlip, County Kildare - Ireland
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?WYA6Hoc+OLxR/riseT5vR+i329oX0Gp+1Fxwe3rVDs07yAyLIVvYYKkZODFx?=
 =?us-ascii?Q?CHhpvK0sHqeBfC57wS+tsshV0qq0E/6YQkaW2MT4g17VPu7sv78Sbt+wiJUd?=
 =?us-ascii?Q?oePTfFOPnLnSh42LfHgzpgI12EAhh1ZB7Y9xBkR1yRRYUqB2ik2u4o91/V4M?=
 =?us-ascii?Q?6sCy+tvf2c8gizZ+8oWD6m1pOqtmc1TrCsWxGq2C1lEggOzqfls1Pbin0cGq?=
 =?us-ascii?Q?gEmmeZh6zJB/S0Tv+60WvZg0gMQ/pbzCRC74Aaj4ulHZ+JO8+7bV/PpBRl/V?=
 =?us-ascii?Q?Rt7uy4aRcWgFRu3VuAb+Oy1GPRDQbk5vUvYPwkkFuzI5LTdEViKr5gu/5zG9?=
 =?us-ascii?Q?64N0HVg/aR1EV6pxMki5/5aXnA5NY/Gc3x3Kv9UHXLuuzeaAxEkm9g4WcuQd?=
 =?us-ascii?Q?b76F99RRG8qiawklWdvsiS5igddLakdXwureUMz9b0VdLIDfFqqoDnxIROW9?=
 =?us-ascii?Q?e6Gm0r0oFiXUOT+gpzFM8HdHWahVO/PmKNCEFvIggbv1lm7shG5/uiP0Wy7m?=
 =?us-ascii?Q?dtZD0nnkUXS8v6AelLbSMEioI51CtXiW4JGFGd7pBGPvWwNwSymPYr1CSCod?=
 =?us-ascii?Q?m/W1477+Rr5rt8BQNRrqyy8Avq5pUYvjFPIPlAAi+kdGytK+AY2VBcEKX3mr?=
 =?us-ascii?Q?ZhhoG/OeAmwe8jdBRVv0665gEfrJrIQyP8XcZy6+tubegJvkyNayzsf/IWAp?=
 =?us-ascii?Q?seR3vDdmZGzKdgxgTyumUSd10HWDFT5U1Z6me4fZkcH0mnbSMOYyRU2SioSL?=
 =?us-ascii?Q?+dQhJ0QkuORdzxCnAjJuXAe5I0Ja8GALsKBFhtSweQlrUkeV+AeOrEYnB0YI?=
 =?us-ascii?Q?sB42nDO6vTuFfW89sm2j2bl60NrZhFoT2wVWZKzU1edxqb03NCiiVuuUA6wy?=
 =?us-ascii?Q?5GowG32ohqudS+F6nze2PUs1oaf1fpMa1SzjgGliFy66M0jOzu7ldDMooPOf?=
 =?us-ascii?Q?ZGv6e364RsBQsMS/ZbEmEERto2l/nUzNbbUCjEYNdByDf1/tAoi35YgT3Z4q?=
 =?us-ascii?Q?f9wRqEYJOa3bfL9Er7u0ixkJOhxNCk1KCAH1cnktf30uV2MeUIR3OI6ngW7U?=
 =?us-ascii?Q?ZNc8Rb23w/u8FACmuD4Ha+pfRwGCRI1dttgyNQ64DwhDYGTjMwtnqXWdDlBZ?=
 =?us-ascii?Q?ACM7sr4PeCeLXM4ygDi1q1zWgK/g8+bT3wnNRWyW7pPRK7wXIbGIirVlPdjv?=
 =?us-ascii?Q?RyBhuT47OlmhkwKl0Yv6cPAm/lvouazXIv456eMMzPvf+oHEiqnAUobWqrk3?=
 =?us-ascii?Q?/BStUng7SwlM76zwg7BJLmfzVbC2QpKja8Qw5Xg7tZq9Lx8I6xFaaZDDcO31?=
 =?us-ascii?Q?0K7rWZKaXT2VY1K/XY8oUqoaZLyaaccapSXdtqtuyHcZj+uFtnt/50BKLwx2?=
 =?us-ascii?Q?6I4oCOe2yFUPWpmsOTG+xuNnw0X/satpzHAF7RWW/8EEERf7TMAKCwEMHi1m?=
 =?us-ascii?Q?25V9K5ArGz2xQarMWaEFK0rvbailKmSsxOuymrnoPwZxLPvczXkqhMiZUq2l?=
 =?us-ascii?Q?ULS2Nd2bdOpfF+ymXshPQLLVPZHDeLpHQOt5ve1v2F7bKBHKL+jtVLD7yf4W?=
 =?us-ascii?Q?ZIEtp1yv68nWry6XQAB2tYCL/TwHnBP4X7j86QhcB2ixGC9uweDszBR3+srl?=
 =?us-ascii?Q?fQ=3D=3D?=
X-MS-Exchange-CrossTenant-Network-Message-Id: d8a4380c-c920-42a1-a9a2-08dbb5b05504
X-MS-Exchange-CrossTenant-AuthSource: CY5PR11MB6366.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Sep 2023 05:55:14.9575
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: j6CqHv7Ug2nctigSasw/GB/14J9RrNSGLIm4ZFM0Q3IE4avafr+05OaGFRSbQLXFgIgTa8ZNDy4hd6YZXjhs+T712AKqHlue59OkR7cbjqI=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR11MB5280
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,
	MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=unavailable
	autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lipwig.vger.email
Precedence: bulk
List-ID: <linux-crypto.vger.kernel.org>
X-Mailing-List: linux-crypto@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (lipwig.vger.email [0.0.0.0]); Thu, 14 Sep 2023 22:55:37 -0700 (PDT)

On Thu, Sep 14, 2023 at 10:27:22PM -0700, Kyle Sanderson wrote:
> Hello Intel QAT Maintainers,
> 
> It looks like QAT has regressed again. The present symptom is just
> straight up memory corruption. I was running Canonical 6.1.0-1017-oem
> and it doesn't happen, with 6.1.0-1020-oem and 6.1.0-1021-oem it does.
> I don't know what these map to upstream, however with NixOS installed
> the same corruption failure occurs on 6.1.52. The stack traces give
> illegal instructions and all kinds of badness across all modules when
> the device is simply present on the system, resulting in a hung
> system, or a multitude of processes crashing and the system failing to
> start. Disabling the device in the system BIOS results in a working
> system, and no extreme corruption. kmem_cache_alloc_node is the common
> fixture in the traces (I don't have a serial line), but I suspect
> that's not where the problem is. The corruption this time happens
> without block crypto being involved, and simply booting the installer
> from a USB stick.
This is probably be related to [1].
Versions from 6.1.39 to 6.1.52 are affected. Fixed in v6.1.53.

[1] https://www.spinics.net/lists/stable/msg678947.html

Regards,

-- 
Giovanni