Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Date:   Wed, 21 Jun 2023 16:01:47 -0700
From:   Mike Kravetz <mike.kravetz@oracle.com>
To:     Andrew Morton <akpm@linux-foundation.org>
Cc:     linux-kernel@vger.kernel.org, linux-mm@kvack.org,
        linux-fsdevel@vger.kernel.org,
        Matthew Wilcox <willy@infradead.org>,
        Ackerley Tng <ackerleytng@google.com>,
        Sidhartha Kumar <sidhartha.kumar@oracle.com>,
        Muchun Song <songmuchun@bytedance.com>,
        Vishal Annapurve <vannapurve@google.com>,
        Erdem Aktas <erdemaktas@google.com>,
        Greg Kroah-Hartman <gregkh@linuxfoundation.org>,
        kernel test robot <oliver.sang@intel.com>
Subject: Re: [PATCH 1/2] Revert "page cache: fix page_cache_next/prev_miss
 off by one"
Message-ID: <20230621230147.GC4155@monkey>
References: <20230621212403.174710-1-mike.kravetz@oracle.com>
 <20230621151855.318449527a851cc0bb62fb34@linux-foundation.org>
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <20230621151855.318449527a851cc0bb62fb34@linux-foundation.org>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?hYvB0jrnZw5+f1i9cGY2PLrMZ6CglHzzsz9aRConLqJHFbmHQ7CphTVYcmWV?=
 =?us-ascii?Q?3GWD6phmSRCfzOSSX0P4xvkQQXjKtxopmaUqCTgsCkLax0NC5rj5bH0acD16?=
 =?us-ascii?Q?VxYQS05ul+I7N3miSsFFXPke/Lp31gxTQ4JcaEcAPEvQHFcmhQfW2RIG6Xut?=
 =?us-ascii?Q?PIKQhA/kPbYwHqs4BT41CUVpb5DKK+FImAaTMWQZCfT0G3RVIWo5pyQKhWPo?=
 =?us-ascii?Q?aw5noEsJ3NErJU+ZTLNDi5zWZ+qREU8SKqTSY5BLs85skCef3JzxggUsxAHR?=
 =?us-ascii?Q?3sBjBREBPmjAo1R6dRAQ2hVYWmVv0pZjfSYdZ4DWWOKkF7/s2LBOooKgOPX1?=
 =?us-ascii?Q?gZGr8d3c07qk4HnyDeFr73feh/Ox7ESMr92LHe/dEAIvABcDwvKiUpXFyMkR?=
 =?us-ascii?Q?Iu978MUgms4RobJq013ANvjJn0R6zqBrQ3IM2AiAFpY+BaueLsg1CaVssXhm?=
 =?us-ascii?Q?rsXbn0GrjKDf9wEdgCIg+nQN04V2B201f++rSp61QHBTWLD0U1xM/fAOajyY?=
 =?us-ascii?Q?RD+AA9KmCI8rxNBaXxGH98uYJXveoX/qZDLdu/AoPwxOhXJcrioSFKaQFUtj?=
 =?us-ascii?Q?bgFw8rLg9S6OKJpdxqO1B1TmTxf/7Qz0N0PvmRwcExz2o9Dib45SyliaRN4q?=
 =?us-ascii?Q?DHwdomgzolCPEI55ILVkWXcGJNK4iovtMLdkZak91MFUDbfojzKwAyDXRC6Q?=
 =?us-ascii?Q?l0E+vHfQMqJD4LbTtHdmlMT5W/I67XYWWgKPA9NKz90Hy+07BTMubEmi2MtI?=
 =?us-ascii?Q?2xZqHCqzAK6ssTLr8Bpdaa09VJ7A8ibIIf9Chb+EJ66f8uz1Or+jTTEryqcP?=
 =?us-ascii?Q?9QXEFcK8WI0ItcgH4r4HWV7EEXKzKACuBkc20TEB80EtYIu1Z3jpd+n2lTQy?=
 =?us-ascii?Q?vQXIzuar+Pzg7ikQINmj3/pt3dAbchk7sRzexAiJlgGVjTAWklptwx1cT+Hq?=
 =?us-ascii?Q?NIMR2KgwJlWKDAzbgAaY2nM/vsfS5zr5MAonV5WXfS1bZulNPftkWLqHIaAV?=
 =?us-ascii?Q?vmoiAC51/6YyBZyH7xw5YggBboQZjl7OZcYWh6Y//wCkQc2ttsl8P3pwaJjW?=
 =?us-ascii?Q?QyM2WdTsPdX4jMkDEXUiD/l5ASSdMrUFogFdJ0cTDSPyLMdT4N0x9gQOTdsy?=
 =?us-ascii?Q?ovk9vQHp3w9n1tDuxMAH6aEymSnfRyxs5oUBdBNrQTy9CD1RURVf+70/P8MK?=
 =?us-ascii?Q?Z9TmvVuAkK64Dbh1oYa3SK3nWpHImXwPeVDQbVC6vJ9TzdfRwiJ3EY2h1Kof?=
 =?us-ascii?Q?/C9pw8MevXUNOiKANPX1Hyark8N49mU+TSrLdDPn5EFUKUqHxQ2xnTlu+D2J?=
 =?us-ascii?Q?SDmlZBHy/QcOaeGcuHBkiaryBOUky1zdCYfLj08gTnXC6USI2V7SmFomLojW?=
 =?us-ascii?Q?jgoOJ/bpF5ndkhY7XO3sNGXaSlWb8etiSztkJsvpfZTTUYT4eF9GgxxB/wdf?=
 =?us-ascii?Q?hiScWz3B7F8f9SCFPgXq+ivcu3TfV/TNHfvngCC3V9SQeG6zIEOvAbUvhes9?=
 =?us-ascii?Q?TbZj+YoLOLXoHRG7n9A1tUoG0rkWDHqebqZGVO9Pg1gqkGJd4uYsQGtgx06j?=
 =?us-ascii?Q?Osx+yBulh4ODxpTmaog7AEWb49MI8Yn4qMa2UxoQlU0yh7V+q/A3phR8QN0A?=
 =?us-ascii?Q?kA=3D=3D?=
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: =?us-ascii?Q?wX9ERk9115D3YQJZr5RHTB8LMEu7vqCNfMi1dCArjseLIcvwkH6Kvin+rWc8?=
 =?us-ascii?Q?HOxMlZjvFcx0qG0U3UNRkN/koRJEi2369xv69OSfaMx01DE7NsOxxa+ez4kL?=
 =?us-ascii?Q?dXSQeXmjCyEoZ/El372ARJm3MGVBka6mtOKzPgs+dmEqu/EK3AsSbWI8qA2k?=
 =?us-ascii?Q?GgmLAWEskdZMlqqcbFytUzdNzEvdhNbfqcgrLGRMzS8UJo+h9XesYgCAI+7g?=
 =?us-ascii?Q?s45JkWX7b5b9mAFPFvq/5APdmuEC+BUx1yCt/R5i8RGQ4iC30FYkTImW1Q+/?=
 =?us-ascii?Q?7ofipmWm34l7mTy6WeDPBGOf+8aEK+/1iV8QTZfnETQdV6RmE8q1vg7NbpUb?=
 =?us-ascii?Q?hi/c46X/oa30Kf8jQYWalA3IIXFGw3W/ndzw89/RwUk4mEqSn44p3jsUcP9J?=
 =?us-ascii?Q?/IiyUsc7kmmBMgJts/HYgrSK/G8UF8eC7l7wLJ2n6oCmEUTYoQmJlVcyIEne?=
 =?us-ascii?Q?HEPamzCp0XddB/MQfYrSQv8OKQhVBYX8qKVjNYm38NZaEzIQjbQcRVvJc3Lf?=
 =?us-ascii?Q?LrMkD7Kidu67TGHL/3ZbX2GbZBbR2V+25e4sTTJIQ3xoPjEJpd2veds1pwEj?=
 =?us-ascii?Q?AlOApOxxtyztxnClvFvA414LIwH9SV88P3zph+5nb+9uooHHxyT3cNwMCCHQ?=
 =?us-ascii?Q?s9SIgcLwXbqy+Y6VlUIp1v+h9iPCi7TbZ4YxPX6vu4UJQi0UEgUhLGMRCsVc?=
 =?us-ascii?Q?gBJXEgoT6XxyjN8x/W7sN7UGiynDiMSk/NEsqTVuASFiLBz0C0TVnyuFP8mT?=
 =?us-ascii?Q?kOcR2GloTiFTTAqdndUxDbgGLrpesMDtu0HujcpgWZ9L269ip9Yx+gRGijw9?=
 =?us-ascii?Q?u3ZAARLh5zMpm118fWUeZXoZBPEWoXxFGw8WjyGuTbWXtimCDz1gRuFVu4cS?=
 =?us-ascii?Q?64eDkfOHSVW5jxkFJyWERwC1ufPlbs3YkltPxqOJvA6wDFPluVwt95EvFREx?=
 =?us-ascii?Q?OcMfdleQWhj/qUCH6FwYnZLsq4AQkWsz6Vh+00iSGxlPcXgIi3xV9OKwyoAb?=
 =?us-ascii?Q?2iI1yI3m581U1DBy89dH4QtlIw=3D=3D?=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 509658bf-03d1-4062-a650-08db72ab7f51
X-MS-Exchange-CrossTenant-AuthSource: BY5PR10MB4196.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Jun 2023 23:01:50.5526
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 4201SO+PS4Yy/PeEub/IR1bgpN5SHqa91dM8IaiPwc7Uy57LOUOFZyUKc3hCU9AjeIX/SwIlc6H3Mpb9PQUHWA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR10MB6462
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.254,Aquarius:18.0.957,Hydra:6.0.591,FMLib:17.11.176.26
 definitions=2023-06-21_12,2023-06-16_01,2023-05-22_02
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 bulkscore=0 malwarescore=0
 mlxlogscore=999 suspectscore=0 spamscore=0 adultscore=0 phishscore=0
 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.12.0-2305260000 definitions=main-2306210193
X-Proofpoint-GUID: Q4osNE2FOF_UuByBuso0v0JdhZZdqYhK
X-Proofpoint-ORIG-GUID: Q4osNE2FOF_UuByBuso0v0JdhZZdqYhK
X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_LOW,
        RCVD_IN_MSPIKE_H5,RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,SPF_NONE,
        T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On 06/21/23 15:18, Andrew Morton wrote:
> On Wed, 21 Jun 2023 14:24:02 -0700 Mike Kravetz <mike.kravetz@oracle.com> wrote:
> 
> > This reverts commit 9425c591e06a9ab27a145ba655fb50532cf0bcc9
> > 
> > The reverted commit fixed up routines primarily used by readahead code
> > such that they could also be used by hugetlb.  Unfortunately, this
> > caused a performance regression as pointed out by the Closes: tag.
> > 
> > The hugetlb code which uses page_cache_next_miss will be addressed in
> > a subsequent patch.
> 
> Often these throughput changes are caused by rather random
> alignment/layout changes and the code change itself was innocent.
> 
> Do we have an explanation for this regression, or was it a surprise?

It was not a total surprise.  As mentioned, the primary user of this
interface is the readahead code.  The code in question is in
ondemand_readahead.

		rcu_read_lock();
		start = page_cache_next_miss(ractl->mapping, index + 1,
				max_pages);
		rcu_read_unlock();

		if (!start || start - index > max_pages)
			return;

With the reverted changes, we will take that quick return when there are
no gaps in the range.  Previously we did not.

I am of the belief that page_cache_next_miss behavior did not match the
function description.  Matthew suggested page_cache_next_miss use in hugetlb
code and I can only guess that he also though it behaved as documented.

I do not know the readahead code well enough to know exactly what is
expected.  readahead certainly performs worse with my proposed changes.
Since we can easily 'fix' hugetlb code in another way, let's do that and
leave the readahead code alone unless someone more knowledgable can
provide insight.
-- 
Mike Kravetz