Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751229AbaG1DV5 (ORCPT ); Sun, 27 Jul 2014 23:21:57 -0400 Received: from mail-we0-f180.google.com ([74.125.82.180]:52815 "EHLO mail-we0-f180.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750727AbaG1DVz (ORCPT ); Sun, 27 Jul 2014 23:21:55 -0400 MIME-Version: 1.0 In-Reply-To: <53D5BBCA.3020109@gmail.com> References: <53D5BBCA.3020109@gmail.com> Date: Sun, 27 Jul 2014 23:21:53 -0400 Message-ID: Subject: Re: Multi Core Support for compression in compression.c From: Nick Krause To: Austin S Hemmelgarn Cc: "linux-kernel@vger.kernel.org" , "linux-btrfs@vger.kernel.org SYSTEM list:BTRFS FILE" Content-Type: text/plain; charset=UTF-8 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Sun, Jul 27, 2014 at 10:56 PM, Austin S Hemmelgarn wrote: > On 07/27/2014 04:47 PM, Nick Krause wrote: >> This may be a bad idea , but compression in brtfs seems to be only >> using one core to compress. >> Depending on the CPU used and the amount of cores in the CPU we can >> make this much faster >> with multiple cores. This seems bad by my reading at least I would >> recommend for writing compression >> we write a function to use a certain amount of cores based on the load >> of the system's CPU not using >> more then 75% of the system's CPU resources as my system when idle has >> never needed more >> then one core of my i5 2500k to run when with interrupts for opening >> eclipse are running. For reading >> compression on good core seems fine to me as testing other compression >> software for reads , it's >> way less CPU intensive. >> Cheers Nick > We would probably get a bigger benefit from taking an approach like > SquashFS has recently added, that is, allowing multi-threaded > decompression fro reads, and decompressing directly into the pagecache. > Such an approach would likely make zlib compression much more scalable > on large systems. > > Austin, That seems better then my idea as you seem to be more up to date on brtfs devolopment. If you and the other developers of brtfs are interested in adding this as a feature please let me known as I would like to help improve brtfs as the file system as an idea is great just seems like it needs a lot of work :). Nick -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/