Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1757294AbdIIAoT (ORCPT ); Fri, 8 Sep 2017 20:44:19 -0400 Received: from mx0b-00082601.pphosted.com ([67.231.153.30]:60460 "EHLO mx0b-00082601.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1757173AbdIIAoR (ORCPT ); Fri, 8 Sep 2017 20:44:17 -0400 Subject: Re: [GIT PULL] zstd support (lib, btrfs, squashfs) From: Chris Mason To: Linus Torvalds , Linux Kernel Mailing List , linux-btrfs , Herbert Xu , Nick Terrell , Phillip Lougher , Sean Purcell CC: David Sterba References: Message-ID: Date: Fri, 8 Sep 2017 20:43:52 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset="utf-8"; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Originating-IP: [2620:10d:c091:180::1:a2b2] X-ClientProxiedBy: CO2PR04CA0127.namprd04.prod.outlook.com (10.165.95.29) To BN6PR15MB1650.namprd15.prod.outlook.com (10.175.131.143) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 7ad35859-973b-4f0e-15cf-08d4f71bdcb9 X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(2017030254152)(300000503095)(300135400095)(2017052603199)(201703131423075)(201703031133081)(201702281549075)(300000504095)(300135200095)(300000505095)(300135600095)(300000506095)(300135500095);SRVR:BN6PR15MB1650; X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1650;3:5w5XIk3NSHGYroM7ek0pWZvSzWfU74jJWgzA3FFL6jPgAgjyPqrj6fK39Da0B977uPw+LQZs7pfZaO6Fh4SZE+TwgF3IZFg4X5bLcu1EQQ0ZUDOZGi5yfpIE7hD0msyMxW8OJTVd5R9ukTQs9qUeBEUs4J1OKqaOveJc35dVlyGpQflQVi0AAFLxERIKRrp0b12ju6fUyotd19za6NZFAzrB/cN6/wJuOk39UqSb8i/m4HcmT0/uGcAaKoPybIPb;25:UnG0bpVBGcqznp+o0ACKQ0vs4rm6abTtzcS/ZtQAkrLdSIcLZgcEhSNquO85UWj8Rf5GLxy1fOsnF0Agmfqf3fARf9HnV+0gmKdKW+YVgy9C6f30rIcy39Nl/+YADhJWd+PN2tND+Uv5YFpeFxjDKQPRf4dGDAZQ7Q/LLDwNN6/TTyJ2usxqe68ndKsWVVOXKd5FAfEc1v3bKqVhmFZntCdji32SNDK01u/yJL+dJMYETnXHCCQIrnkxp2MklXt3B7diL+pHvKN5QRiXzqqkOuwA1nt2vmY7vDFEV1R9+j+9LKFFhNbAzTq2oyRbpP8g8DB6WqwwjhvaGXqWSK1jEQ==;31:XN3FAWIMsrUta/edWJWDRndeN5cq1J+P34kfgu6VJ5W+veD4nVvulPC+Mvix6wVD0SXpv9Nrc4icJIUsTns633371NJHFsuS6D2E0r1QUi6meK3LAjw7zzNXyc+HpXeYDH8zXqIyr26m0AlT9k0MzJQA4tRrApKR7scAdJgWcZ955eQgMIC7plfh6pWcoiIKvaVYELGETFycsjMmssFkXymhFFmlMCJJ/5LE1td9hQY= X-MS-TrafficTypeDiagnostic: BN6PR15MB1650: X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1650;20:08afA//ySY/P5RtEuwXpcVIidqys4t7Ng+SOsTz453Lt6HDi+Odnse/+/KQJVmly1yl8W2NgDZKwdtHaudqsKyeR2Zhw324Sp0fsrJjaepLegljUVbz52ZRMHjJpEZF2qu9pAXbqjeEXggfBY2DNe+XYf94F/x9iB1oXu9ChId1TVOJ/NmhGbeVRfteZBjUrKhdv+7MoU0cxFRdJ2me2pWbXMgIWdIPBj+wu81sMf9LLk5WIRTTWRKcZBD9hmhYEuGTeQJpVm19lVDE8W3f9OqCmpV6huGBTxeYooybAdteOKa7N1xeGmC5ZVDllR9GJnu2a099eZ6MlANqFcojM9SzYFrBZoFk25n/7Eq8qPQfpEBy5Q7PiFHPJE4jDl7j8RgWs/WkR0nx5+A6nbXZdcIxrA6oU0nOFKJx12MQPdLgUpGmdZ8V3apY1C264GkWTfYcGRnIdErCSn7Np4UJGnyxcPwr17993TVIve/2mY0KAnCZahgjiE5ru+uBKAkTS;4:3zfTKqTPLSx7Fk1nLcR+3VE2S26rKPE+qLD28P/dyPEPZwtDnbY70peypY4amO1VQT1Octjc3C7ZlgqfWAz3I9O/0uWVwF5ieLV6s33fVRn3NqKWARnDjFPrRN+ITDgLtb9fVecoSOn+sNuhDOP4j1rqXp75t3RiXsRB7e979020sdk1J4UjEtCHPfRZcnwtYr8mknVKQ/b4wNZ3P4NfN4obpgkrNFDJf9PrVjNhN2mSd/tN9JnbnuT3VxS7URa7hlGnau/6apeN5hq8hvsDlaZ8gGsc8Xxz9o2sVQmq0GI= X-Exchange-Antispam-Report-Test: UriScan:(84791874153150); X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(2401047)(8121501046)(5005006)(93006095)(93001095)(100000703101)(100105400095)(3002001)(10201501046)(6041248)(20161123558100)(20161123555025)(20161123562025)(20161123560025)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123564025)(6072148)(201708071742011)(100000704101)(100105200095)(100000705101)(100105500095);SRVR:BN6PR15MB1650;BCL:0;PCL:0;RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095);SRVR:BN6PR15MB1650; X-Forefront-PRVS: 0425A67DEF X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(6009001)(199003)(24454002)(189002)(377454003)(50986999)(6246003)(101416001)(54356999)(68736007)(64126003)(97736004)(50466002)(4001350100001)(83506001)(106356001)(47776003)(65956001)(65806001)(76176999)(105586002)(23676002)(25786009)(36756003)(86362001)(7736002)(33646002)(31696002)(305945005)(6116002)(478600001)(81156014)(8936002)(8676002)(81166006)(5660300001)(53546010)(4326008)(2950100002)(65826007)(230700001)(31686004)(1706002)(6666003)(53936002)(42186005)(189998001)(6486002)(2906002)(229853002)(42262002);DIR:OUT;SFP:1102;SCL:1;SRVR:BN6PR15MB1650;H:[IPv6:2620:10d:c0a1:1110:8000::2082];FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtCTjZQUjE1TUIxNjUwOzIzOlhGR2w5RklEM1BMdUo3S2NVZnRZR0pNczZH?= =?utf-8?B?NXpoQkJFYXJmeFNud1diOWlJbG5nb016RWJlQ0l0M253dzIzOEtpOEVFVVhK?= =?utf-8?B?aFFEVW44N2xWR29Kam1zNWlNMlVtSGVTenN0RTJlUC9TZ1l3dkdRcm13YzBJ?= =?utf-8?B?UDZVUW1VWkk2QkEzZ1lOaC9yemZxWHFKTVJWNTY0cU9QaEU0QzliZmF3dGxa?= =?utf-8?B?RHFINjl2Sm9xQ1luQWEvYllhM1dKblg5ZmJMOEhOMmcyQVk1Z0tMMDMzNUhO?= =?utf-8?B?RVhYNlpEVlpKaUNFVGkwWndadGo3azRhd0FaUXc2aGVTQnQwb1J1a1dSZ29y?= =?utf-8?B?QkM2MytlR3N4MEZBY2p2ZEN6c1BwbjBlUkI0a2F2YVYrcy9PV202YTJhVmsv?= =?utf-8?B?YkZ3aHN0Uk9NZC9XM0ZuRERmdFkrZU5nbWdMZWpPZkY5NU5qVTcwU0ZQVllv?= =?utf-8?B?T3hlWnNDOVQ2MnA1b0NKU1BYVytVL25GQU1BQkFiSGFPaklmYTRNdm5na29D?= =?utf-8?B?djVkZHc1b29XUVg5c2RIMGVMVDlnR1Z4MkZObEJidlJwZzNJWGQyWVFsNGRJ?= =?utf-8?B?cm1ZMVVLaTdRdzhGK0FxbHVJclNPbldTVlZVTzN1Tml5OFBDU0RYWWUwSUE4?= =?utf-8?B?Zm5McVhucnR0RXhleVhFMzFOWkdsWDljc3ZjdFd1L3FyZ1hiYmQ1ZUwyOFNu?= =?utf-8?B?L2JaV0F4dTRVTjdUT09INzhTNGgvRlVIR0IyRXdjTnhmNlpTTTdsNlRHRm83?= =?utf-8?B?ZnJZaEhYdHZtL2l1WHZVVjRyTitPdlRZYWk0Nk9VSndMRmZGbTIvcmpEZnUr?= =?utf-8?B?QlFoVzJPZnVVZER1MmlXcERjZVJFWVJtQVQrSDIxSDJMdUZMKzZYdnl2MlRi?= =?utf-8?B?YldkY0dNNk5DYU9oTXlLTmNhcHFBKzJFYS8rdnduRWVpQzZUSVBDTEQxMDBJ?= =?utf-8?B?SnYvb01jQVlpNU9jVXZ3N3A4OFFOQVA2VlMxYXBjaXNROFl0MDcrWVd4MFBP?= =?utf-8?B?WHdzWGxKK3RScUhNYVJUQklyVG1VSGM0QThNRjhpcUNYaGZ4TjB3ZzY2R1B6?= =?utf-8?B?dWkwK1lHN1Mzbi9FQmdOYjczRUM0YTBuZENuSGpVbllsQVRzUmhUWUd0bWlV?= =?utf-8?B?U3VuUEZheUNjcEpqOGxnYWkwcytSc1pjVGRPNC9LQVZpeEg0cXNmVkx0NWhk?= =?utf-8?B?UmJEdWJxaC9RcEZJdk81Um9zMFUwM045Z2d6TW1pM3FibXpJOTlLcGwyRDdE?= =?utf-8?B?Vks5UnhZcEUzaHV2RW5tNDFSNVBoQTZVQm1RTFdPZmZnNVNrek9BSHYreE90?= =?utf-8?B?MU9aNXBoL1FRckxkd2EveFhMWktLdU53dmJUVTcrWEZBUmE5T21ndDNiQWth?= =?utf-8?B?V081dWdTK2hLL0p5ejBxUXRqVVB0dWxlcWozM29FZmF4bkt6VmNrN05qa2pl?= =?utf-8?B?MlZ4M1JWelV5OU5iVzUyNjVOZTdTSFF4UHY1OElqM3MzWHAyNHNkdHdtRGI5?= =?utf-8?B?OEhFTUZ1ejQvWjBtWDF3ZHZhVnZ6QmtkQ21tb1J3QXlQcXFIdC81KzhCcmJO?= =?utf-8?B?TFJxRTZwOWg1Z0Y2cmg4b3h0STRrZE1FM3JuVGl0MU9VaXhpTE5wSldicmpH?= =?utf-8?B?bFNNOUFRelhQWFplWWRtZFQ0TWk4dGRzeW1WTHc1TW52bmhmdHJtUEdnPT0=?= X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1650;6:L/P2KmM3rtQLQYR5eF9Jj0d/BH00ktAOtpBqU/bHxD1WZxbuVIAk4M8OhQNeDnuZ6o0MJ2DHD5T+bSaC6Tk0Yf7GnTrIyoQr2y0GmDJNcGdLU1gSHR+9wHcV3A5piv9GYwuNhKVdSP8rA5H1SI1kLOWIcyYnRlcvuPNRoaAkZ6eJ+W7cx7KC2DiCqfbmiVoo8NhgyvGRO32Tl9Afkx56V11Ols92QjcHrWweRmexUNCTIjLF80mR70czDKWqlUVeTU7EpxUD2ltB1/7ldEZNikZ6pOlcFRl0uzxIQ0Jq0HbLJuzAEu/lTax8h3hOgF61wXN1klCv70humHW44sHJJw==;5:VVNUHuAcPEpSC3jReQ0rJclEAAVDk7RYHdjUwLGlvGM+KtXGpMCCgiq1JEt2Z2FQU8ciiuM3h2ev75sj06hMtHAb79KFqSpvEqhboSE1eQUk7lhpaLxL39gS9Gya1EMv5O6JtA6q6r3hWbjvqZAVjA==;24:EW8pZxtzFWVcKKSuLh5HnvDgcyXtt081YnOavm4S7XKUKuz8XeKgDRbT+ATffgDlL5F0XdakI9RZ51TdKtq9x4aFsiecxiIg9VdPneuKaxY=;7:5Yarnljm/6+cQfJif6g0tjicjAN+SuLJiiwDASAnsf4W1ePuH8xVayzC0RRyN0dkJ3dzNXYQoGyow7HJc1H1IVtDvc7ark23A1CaUMhbXFMk9RNT7SI90VynkL02dySnKrFUv7T1SWsGCNFAV4c3bnEf1fecSWdARJw/l5byCzuaEX2OPzWinOWcF2aNp6UjOf2+JtB+PoGRm3FN0GV1bVpa5CDBgmfLx0bjTUsH8lI= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1650;20:HmNlutM92Ojak81Qd7g/y3tvIV6+iq4po939/jh0ct9zmZjkxEbr7r7FQK1j3ODuz56z5se6T4U91KgSfdi1Mr77Ei4ZedFNa2oQs0BL9b5UPGGwiNY7fL6gX8qlA0lsn39iPl2UD8f60mO+Q+BPBc9DQTqOEBkvdKwGcVICMq8= X-MS-Exchange-CrossTenant-OriginalArrivalTime: 09 Sep 2017 00:43:58.3658 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 8ae927fe-1255-47a7-a2af-5f3a069daaa2 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR15MB1650 X-OriginatorOrg: fb.com X-Proofpoint-Spam-Reason: safe X-FB-Internal: Safe X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2017-09-08_15:,, signatures=0 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1170 Lines: 28 On 09/08/2017 03:33 PM, Chris Mason wrote: > Hi Linus, > > Nick Terrell's patch series to add zstd support to the kernel has been > floating around for a while. After talking with Dave Sterba, Herbert and > Phillip, we decided to send the whole thing in as one pull request. > > I have it in my zstd branch: > > git://git.kernel.org/pub/scm/linux/kernel/git/mason/linux-btrfs.git zstd > > There's a trivial conflict with the main btrfs pull that Dave Sterba just > sent. His pull deletes BTRFS_COMPRESS_LAST in fs/btrfs/compression.h, and > I've put the sample resolution in a branch named zstd-4.14-merge. My > idea was that you'd take our main btrfs pull first and this one second, > but the conflicts are small enough it's not a big deal. > > zstd is a big win in speed over zlib and in compression ratio over lzo, and > the compression team here at FB has gotten great results using it in production. > Nick will continue to update the kernel side with new improvements from the > open source zstd userland code. Just to clarify, we've been testing the kernel side of this here at FB, but our zstd use in prod is limited to the application side. -chris