Date: Mon, 15 Jan 2018 14:08:36 +0100
From: Pavel Machek <pavel@ucw.cz>
To: Dmitry Vyukov <dvyukov@google.com>
Cc: Mike Galbraith <efault@gmx.de>,
        LKML <linux-kernel@vger.kernel.org>,
        Greg Kroah-Hartman <gregkh@linuxfoundation.org>,
        Andrew Morton <akpm@linux-foundation.org>,
        Linus Torvalds <torvalds@linux-foundation.org>,
        syzkaller <syzkaller@googlegroups.com>
Subject: Re: LKML admins (syzbot emails are not delivered)
Message-ID: <20180115130836.GA1408@amd>
References: <CACT4Y+ZNJRzPxxPQNR88vcPxD54mHY-evhMwR39iMsJh_NwaEA@mail.gmail.com>
 <20180104092552.GA991@amd>
 <1515058705.7875.25.camel@gmx.de>
 <20180104095628.GA4407@atrey.karlin.mff.cuni.cz>
 <CACT4Y+YB_p_p4ORbke1oZfkLSC8rnAD81Ra_fprsPSugGAQy8g@mail.gmail.com>
 <20180104111801.GA2220@amd>
 <CACT4Y+ZF9KDL-m9UqsKzt-zaAANjXZnrc30yfXUJj9tw2SFL_g@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha1;
        protocol="application/pgp-signature"; boundary="Dxnq1zWXvFF0Q93v"
Content-Disposition: inline
In-Reply-To: <CACT4Y+ZF9KDL-m9UqsKzt-zaAANjXZnrc30yfXUJj9tw2SFL_g@mail.gmail.com>
User-Agent: Mutt/1.5.23 (2014-03-12)
Sender: linux-kernel-owner@vger.kernel.org


--Dxnq1zWXvFF0Q93v
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Mon 2018-01-15 11:08:12, Dmitry Vyukov wrote:
> On Thu, Jan 4, 2018 at 12:18 PM, Pavel Machek <pavel@ucw.cz> wrote:
> > On Thu 2018-01-04 12:09:26, Dmitry Vyukov wrote:
> >> On Thu, Jan 4, 2018 at 10:56 AM, Pavel Machek <pavel@ucw.cz> wrote:
> >> >> On Thu, 2018-01-04 at 10:25 +0100, Pavel Machek wrote:
> >> >> > Hi!
> >> >> > >
> >> >> > > Some of syzbot emails don't appear on LKML mailing lists, while=
 they
> >> >> > > were mailed as any other emails. Here are few examples:
> >> >> > >
> >> >> > > "KASAN: use-after-free Read in rds_tcp_dev_event"
> >> >> > > https://groups.google.com/d/msg/syzkaller-bugs/nEeIAsNLWL4/1Gza=
mOmRAwAJ
> >> >> > >
> >> >> > > "general protection fault in __wake_up_common"
> >> >> > > https://groups.google.com/d/msg/syzkaller-bugs/4TrrZ0bIViw/rBcY=
LUJHAgAJ
> >> >> > >
> >> >> > > Does anybody know how to get in contact with real people behind=
 LKML
> >> >> > > and/or bugzilla?
> >> >> >
> >> >> > Not delivering syzbot emails might be good thing?
> >> >>
> >> >> Nah, the thing is finding and reporting bugs just like a human woul=
d,
> >> >> it just doesn't need sleep etc, so sometimes reports more than huma=
ns
> >> >> can keep up with.  It needs a smarter brother.. but then again, may=
be
> >> >> not, if bots start fixing things too, a lot of meatware hackers wou=
ld
> >> >> have to go find real jobs.
> >> >
> >> > Sending random, unrepeatable Oopses to lkml is not what humans would
> >> > do, and perhaps not something bots should do, either.
> >>
> >>
> >> Hi Pavel,
> >>
> >> I've answered this question here in full detail. In short, this is
> >> useful and actionable.
> >> https://groups.google.com/d/msg/syzkaller/2nVn_XkVhEE/GjjfISejCgAJ
> >
> > I've already deleted many such reports from my lkml folder. It
> > definitely is below quality of normal bug reports.
>=20
>=20
> Pavel, if you point to exact deficiencies in the process and propose
> ways to improve it, we can turn this into a positive, constructive and
> actionable discussion.
>=20
> In lots of cases (~50%) quality of syzbot reports is equal to human
> reports, or _higher_.
> It provides exact kernel commit, config, compiler, stand-alone C
> reproducer and a nice, symbolized report even with inline frames. You
> don't always get all of this from human reports.
>=20
> In the remaining cases (no reproducer), quality of syzbot reports is
> the _same_ as for human reports.
> Say, your machine randomly crashes. You reboot it, but it crashes
> again after some time. You try to repeat what you did before the crash
> (say, opened a particular web page), but it does not reproduce the
> crash. But one way or another, it happened and it's a kernel bug

I have not seen a good quality report from syzbot, yet.

Normally, humans agregate test reports, and test patches etc. Can you
step between robot and lkml, and provide same services humans usually
provide?

Thanks,

									Pavel
--=20
(english) http://www.livejournal.com/~pavelmachek
(cesky, pictures) http://atrey.karlin.mff.cuni.cz/~pavel/picture/horses/blo=
g.html

--Dxnq1zWXvFF0Q93v
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: Digital signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1

iEYEARECAAYFAlpcp9QACgkQMOfwapXb+vKdIACgs+57e/2/F1JigGrhkoKIXUz3
21sAoKwleFdHVjHNrNRBG+bHGiP5CrZA
=7eIv
-----END PGP SIGNATURE-----

--Dxnq1zWXvFF0Q93v--