Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:2 as permitted sender) client-ip=2620:137:e000::3:2;
Message-ID: <0cee25a2-29f7-4481-8ab9-618f8491bf5b@axis.com>
Date:   Fri, 17 Nov 2023 17:36:43 +0100
User-Agent: Mozilla Thunderbird
Subject: Re: [cocci] [PATCH 1/2] scripts: coccicheck: Return error from
 run_cmd_parmap
Content-Language: en-US
To:     Julia Lawall <julia.lawall@inria.fr>,
        Anton Eliasson <anton.eliasson@axis.com>
Cc:     nicolas palix <nicolas.palix@imag.fr>, cocci <cocci@inria.fr>,
        linux-kernel <linux-kernel@vger.kernel.org>, kernel@axis.com
References: <20231003-coccicheck-v1-0-07d2d900a52a@axis.com>
 <20231003-coccicheck-v1-1-07d2d900a52a@axis.com>
 <978265928.4471013.1698960475973.JavaMail.zimbra@inria.fr>
From:   Anton Eliasson <antone@axis.com>
In-Reply-To: <978265928.4471013.1698960475973.JavaMail.zimbra@inria.fr>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?eFU5dndBSDVFYnF2RTA1Y0hNc0sxdGlpVXhqRGpOeHhLMGF5eVQ4bFhxdVox?=
 =?utf-8?B?MHJpM0V3Nmx1TTlCSnZpNlpLVytnVnkzZnpVOGZmUGVWTFd2RU94NmFZeEZu?=
 =?utf-8?B?TC8xS1JnN1dnT3k4QjhydStNZGZFQ1hKUzY2ZHR4a3ErdnVla1ZvTDVhc1hG?=
 =?utf-8?B?TDZjMHAwd2I5QlA2N3cwMFFpQ0xrNDVYQnVZZ0JCUTA0elhjNmhhd0hGa0dH?=
 =?utf-8?B?OHV6QjVrTVNwZm1heSs4TGluU3dVSmtIMk5Xc3VZdDFhK3ZLUndwUDB1RXhJ?=
 =?utf-8?B?R01ObkZBZFE2N1pBclROWHplMC9xeU0xanYxWG9NRFRnNjVOZ2FkazlUT1R4?=
 =?utf-8?B?OSsyaFgwODYxWTBzY0tYY1AxUi9jRXB3ZCtLNW5VaWNhMktIOWZlY1pzcnVq?=
 =?utf-8?B?aldhV0tmMkRWZDQyQ0Y5QzNIMW05U1d1aS9WTGduNWlOc1NHczhyWjVOK0U3?=
 =?utf-8?B?U2hqdjJFbnprNDh4RzBwVHYydjkwZk1JLzMxcW1iaWJOVks5d2dCU3VYTllL?=
 =?utf-8?B?ZW4rbDd4UmRVeVZ2MTBDTjBUM01PRUJPZ0JmaUkzc3FKSGFnQzdjbE5DTFAx?=
 =?utf-8?B?dXJjdDZ0T290WjZxM1B4YWYzNHdPZDdZUnNLWGEwSEpoKzljNStkZmRJUjFJ?=
 =?utf-8?B?YlBXbDdrS0ljSm5LSlE1bkpjV0g3Vng4UTMrblFPV0lvcThjd0Z3RDhFY1h3?=
 =?utf-8?B?aEcxKytXbUpvK3BYSWErZHRjZEJ1a01tV1U2bzM4MHArZVJMVVlyQ2V1NUJ6?=
 =?utf-8?B?Y2cwdzk0RGJIZm9yanRLendud2RQc0Qza0xaSFM5QkxJUDN6d09CV29Rckgv?=
 =?utf-8?B?SWZXbFZFV0thTnFkQVhZSk01VzM0QXNkOHdQQ1RrUk5yVXFpU24yZWZDZnZi?=
 =?utf-8?B?UUR0czRUdTdXU29UOTVLT0lXalhPdjhFY1pDcXVwL0taQTZrSzdzd25UTGxq?=
 =?utf-8?B?SmxPMms0blBsZkYvVFVveTRhUDl6MklncTR1SVN4T1VmSVZiS1NETUV6MHc1?=
 =?utf-8?B?eTNNZTJaUGg2ZnlYQkdpTkJnZy9LYUgyQ1NUTkdsYnVWOW5DWmplUzVpejZj?=
 =?utf-8?B?VjF2aXQ4RjV5eVcrMTI2eW9MekxJTzNQZEgzUFNlNUd4NlFrMk5GRmZYNTlN?=
 =?utf-8?B?T3dkeU1VL0xtS3ZrTmU5WEJCc1FvcElGSS91bXZjOTBBMSsvRzVkZXdoNjI0?=
 =?utf-8?B?TldkdUtPYzIvQ0g1U0VEcGxtK0kvajNiYjBsTU5xZ09leTRuQ21abzRwYisr?=
 =?utf-8?B?MURMUmFJQ0VxblA5eTdNeDJnL3ByWVhpSkRqVEg0OGZzTDZrRzBZUlNvdzlP?=
 =?utf-8?B?ZDZsSlk3Rm9UbkppNjZ4UUIyeFRQTHZFcGRjenlWSmN6bSthcXQzcHlrWEJH?=
 =?utf-8?B?bHZBcm9FTm9lM1QyaE1oRUJ6TXEvOEQva2h0OEczZWx6OC9mZWVPblpmTTN5?=
 =?utf-8?B?QUI0UmZuNGNaK3NiYVlnSHBIUTZHeld2aExzQ1ZmSHFwSCtjZGRKWmloRzVu?=
 =?utf-8?B?Rk5IOEw2QTM2YjZLQ3JqYWhHam5sNnp0VkpmVVEzSVlRWmNRK2J5OFBTUjFY?=
 =?utf-8?B?UHM2SDJsZ3RaL0ZDMFJFSEdiTEJYUWlrNjZMMVJOUmRycTJjWE1xZW1pc1RZ?=
 =?utf-8?B?cWdxVnNRSTdIejVod1NvTXNEa1RCSk1ETm1zWjVnR3ZNSHU1cmw3MFBrdXFN?=
 =?utf-8?B?SHdaeHFBVEZkTWtYVUtkNFlHT0dYVmlMamtTL1ptRjRZTFRkdmg2Wnhtc3Ey?=
 =?utf-8?B?c1liUkRWYWlCbTRJYnhrWHpWc1R5aSs1NU4wS09jSHhRMW5ZWFFmQnp6ckZ1?=
 =?utf-8?B?TkNqM2YwSTBZR3BsaVFOeGxQT0l3RWlsN0dLbUZ3SzF3Rm9QRjd0QXIvOTBs?=
 =?utf-8?B?YWQvcUVFM3VJOG5qK3FwZE05bHdhVnY5UHA3VjFjWDMyQXFpajM1OXRQSG41?=
 =?utf-8?B?SU5TL2dFeUZkWmJjNlpYbCtDSFhvOGdzSzZCcTZnR1hNMU1PclhTZzFTc2VY?=
 =?utf-8?B?bUpES3NxNy9Cb0hFMjNDc2RKZEJ5UFZyaUlseElRMEhleXA4UElCcXZPQmhy?=
 =?utf-8?B?L1lCRGpwRWFZQUZxSWNFVGdjcXR3WFFaMC9xb055WE10Y3MzN1JCRmhlMzMv?=
 =?utf-8?Q?pxstbpwCRqQHo+CtDOjR/4G33?=
X-OriginatorOrg: axis.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 79a5e188-83ee-4c6e-eb1c-08dbe78b63c9
X-MS-Exchange-CrossTenant-AuthSource: AS1PR02MB10348.eurprd02.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Nov 2023 16:36:46.4751
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 78703d3c-b907-432f-b066-88f7af9ca3af
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 7fxeaptECSxqxBj4lBf0A5umjpTADS9DroLrwD1CDnQ5r4OVx61pj7sGprotNxmt
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DBBPR02MB10793
X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIM_SIGNED,DKIM_VALID,
	DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,
	SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE,URIBL_BLOCKED
	autolearn=unavailable autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on agentk.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (agentk.vger.email [0.0.0.0]); Fri, 17 Nov 2023 08:37:20 -0800 (PST)

On 02/11/2023 22.27, Julia Lawall wrote:
>
> ----- Mail original -----
>> De: "Anton Eliasson" <anton.eliasson@axis.com>
>> À: "Julia Lawall" <Julia.Lawall@inria.fr>, "nicolas palix" <nicolas.palix@imag.fr>
>> Cc: "cocci" <cocci@inria.fr>, "linux-kernel" <linux-kernel@vger.kernel.org>, "Anton Eliasson" <anton.eliasson@axis.com>,
>> kernel@axis.com
>> Envoyé: Mardi 3 Octobre 2023 16:25:14
>> Objet: [cocci] [PATCH 1/2] scripts: coccicheck: Return error from run_cmd_parmap
>> Exiting on error breaks the chain mode. Return the error instead in
>> order for the caller to propagate it or in the case of chain, try the
>> next mode.
>>
>> Signed-off-by: Anton Eliasson <anton.eliasson@axis.com>
>> ---
>> scripts/coccicheck | 2 +-
>> 1 file changed, 1 insertion(+), 1 deletion(-)
>>
>> diff --git a/scripts/coccicheck b/scripts/coccicheck
>> index e52cb43fede6..95a312730e98 100755
>> --- a/scripts/coccicheck
>> +++ b/scripts/coccicheck
>> @@ -153,7 +153,7 @@ run_cmd_parmap() {
>> 	err=$?
>> 	if [[ $err -ne 0 ]]; then
>> 		echo "coccicheck failed"
>> -		exit $err
>> +		return $err
>> 	fi
>> }
>>
> I tried disabling OCaml in my version of Coccinelle and then ran make coccicheck with this patch.  But I didn't see any improvement.  On the other hand, it keeps going if I just remove the exit line entirely.  Is that what is wanted?  One can still see the coccicheck failed message.
>
> julia
>
Hi again!

It only makes a difference in chain mode, I think. Without my change 
coccicheck stops after encountering the first semantic patch that 
doesn't support the patch rule (see the console output below). With the 
change coccicheck keeps going with the next semantic patch which is what 
I expect. Do you see a different behavior?

However, I found now that with the change it gets harder to cancel 
coccicheck. A single ctrl-c is no longer enough. I basically have to 
hold down ctrl-c until all the script layers have returned and exited. 
So that's maybe not ideal.

> $ git describe
> v6.6
> $ make coccicheck MODE=chain
> You have selected the "chain" mode.
> All available modes will be tried (in that order): patch, report, 
> context, org
>
> Please check for false positives in the output before submitting a patch.
> When using "patch" mode, carefully review the patch before submitting it.
>
> /usr/bin/spatch -D patch --very-quiet --cocci-file 
> ./scripts/coccinelle/api/alloc/alloc_cast.cocci --no-includes 
> --include-headers --dir . -I ./arch/x86/include -I 
> ./arch/x86/include/generated -I ./include -I ./arch/x86/include/uapi 
> -I ./arch/x86/include/generated/uapi -I ./include/uapi -I 
> ./include/generated/uapi --include ./include/linux/compiler-version.h 
> --include ./include/linux/kconfig.h --jobs 16 --chunksize 1
> 14406 files match
> /usr/bin/spatch -D patch --very-quiet --cocci-file 
> ./scripts/coccinelle/api/alloc/pool_zalloc-simple.cocci --no-includes 
> --include-headers --dir . -I ./arch/x86/include -I 
> ./arch/x86/include/generated -I ./include -I ./arch/x86/include/uapi 
> -I ./arch/x86/include/generated/uapi -I ./include/uapi -I 
> ./include/generated/uapi --include ./include/linux/compiler-version.h 
> --include ./include/linux/kconfig.h --jobs 16 --chunksize 1
> 44 files match
> /usr/bin/spatch -D patch --very-quiet --cocci-file 
> ./scripts/coccinelle/api/alloc/zalloc-simple.cocci --no-includes 
> --include-headers --dir . -I ./arch/x86/include -I 
> ./arch/x86/include/generated -I ./include -I ./arch/x86/include/uapi 
> -I ./arch/x86/include/generated/uapi -I ./include/uapi -I 
> ./include/generated/uapi --include ./include/linux/compiler-version.h 
> --include ./include/linux/kconfig.h --jobs 16 --chunksize 1
> 2146 files match
> diff -u -p a/fs/direct-io.c b/fs/direct-io.c
> --- a/fs/direct-io.c
> +++ b/fs/direct-io.c
> @@ -1128,15 +1128,9 @@ ssize_t __blockdev_direct_IO(struct kioc
>      if (iov_iter_rw(iter) == READ && !count)
>          return 0;
>
> -    dio = kmem_cache_alloc(dio_cache, GFP_KERNEL);
> +    dio = kmem_cache_zalloc(dio_cache, GFP_KERNEL);
>      if (!dio)
>          return -ENOMEM;
> -    /*
> -     * Believe it or not, zeroing out the page array caused a .5%
> -     * performance regression in a database benchmark.  So, we take
> -     * care to only zero out what's needed.
> -     */
> -    memset(dio, 0, offsetof(struct dio, pages));
>
>      dio->flags = flags;
>      if (dio->flags & DIO_LOCKING && iov_iter_rw(iter) == READ) {
> /usr/bin/spatch -D patch --very-quiet --cocci-file 
> ./scripts/coccinelle/api/atomic_as_refcounter.cocci --include-headers 
> --very-quiet --dir . -I ./arch/x86/include -I 
> ./arch/x86/include/generated -I ./include -I ./arch/x86/include/uapi 
> -I ./arch/x86/include/generated/uapi -I ./include/uapi -I 
> ./include/generated/uapi --include ./include/linux/compiler-version.h 
> --include ./include/linux/kconfig.h --jobs 16 --chunksize 1
> virtual rule patch not supported
> coccicheck failed
> make[1]: *** [/home/antone/git/linux/Makefile:2005: coccicheck] Error 255
> make: *** [Makefile:234: __sub-make] Error 2