Received: by 2002:a25:4158:0:0:0:0:0 with SMTP id o85csp867336yba; Wed, 24 Apr 2019 10:53:56 -0700 (PDT) X-Google-Smtp-Source: APXvYqxkQT3h4igkd6rxjEj91epz2DQ/AQTosz6re6mbm15L71M8GqvtExAeVyNU73vES/JezYBr X-Received: by 2002:a62:4115:: with SMTP id o21mr34726044pfa.153.1556128436660; Wed, 24 Apr 2019 10:53:56 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1556128436; cv=none; d=google.com; s=arc-20160816; b=0A6HUzqljtKQfqiZhfZxE25LOK+LqfrBinDdTwzkLL2Gn8HUR8v83XOhAqLEhW+3pX YCReAHOTIrxPssuaMonXCZsNiBGUdPeBwt7rAZZ1FuF/n6UhgDbOastTi9ajJdvPjuii cQ5ZNo5nJzQhrAP83oZpLnQLKhTikLWO6OZ+t6sYVCLjuvld8TdbUJQ9gLpKhuH80KuF H6HiQAsuOR96nzXpWFvlsB8dSo6wmA3fpFox+q1auc2HewXArTKaNcVMGXv//jZrKwQH NcJDcQFYd17Xi+/0wyTtineu1lPr4VbMEC8H4MOzA59vnaca/5DyTb/9ChLER7adAE0S emQQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :user-agent:references:in-reply-to:message-id:date:subject:cc:to :from:dkim-signature; bh=TpJ3JNUKNp9UkIE60CeA5K313ziu+440j1Yo0zLOk6g=; b=nMK0QXA4bg7WqbO3D0I+VB9TG0sU4EkwXxqRaU+5zfw2CTSSCi+bBsbXWvFg0XPjcd Kg72s9IiWjcFQMeMSkkkFBsIDmxB0qzmv2kbGNYgV1zM7HP3wdoJAQJs9WnkJGPnpIXz fegaMQPpP6Xa9qv6QvhWeH5TaIQYvd2YSAkjimPgu0oRYm2v4CBJen9xKqCGaNkgbBFQ bCTZxMkz18jrpyL+69MeES7y4kkBnsZNeNHdF+hCl2n4GCXevQ49eypFjzxVVNmh13A/ SX4OeWx6zvHy46S3Z5jpZfNmkL06O9qjqF2u0VdB76DOlmX4EZ85Ey3GkhxIKXh0mXJ2 qX3w== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=rm8WNb4Q; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id p14si18271513pgb.292.2019.04.24.10.53.41; Wed, 24 Apr 2019 10:53:56 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=rm8WNb4Q; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2390247AbfDXR2k (ORCPT + 99 others); Wed, 24 Apr 2019 13:28:40 -0400 Received: from mail.kernel.org ([198.145.29.99]:52598 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S2390279AbfDXR0k (ORCPT ); Wed, 24 Apr 2019 13:26:40 -0400 Received: from localhost (62-193-50-229.as16211.net [62.193.50.229]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 747EB2054F; Wed, 24 Apr 2019 17:26:39 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1556126800; bh=KMJlpz84FtI2Lw9Og8/66FMXGh/oV1Ks72vVbftnF8c=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=rm8WNb4QRpGlDNEyNgA0LplNJy94csdFvXztnIU1r/EWkkr+1sRv2SPERE9dWcH3F KkSiksW0bz1zDKcM9PWNcF86O92Qx4QuNFVPvz0D6kSlfTv1kT2ETL50OJ97VNCChW ODKCWKfzPcuIcII7iBJFFNYXeFLHqUfBtVK6NboQ= From: Greg Kroah-Hartman To: linux-kernel@vger.kernel.org Cc: Greg Kroah-Hartman , stable@vger.kernel.org, Gwendal Grignou , Enric Balletbo i Serra , Stable@vger.kernel.org, Jonathan Cameron Subject: [PATCH 4.14 20/70] iio: cros_ec: Fix the maths for gyro scale calculation Date: Wed, 24 Apr 2019 19:09:40 +0200 Message-Id: <20190424170910.301141320@linuxfoundation.org> X-Mailer: git-send-email 2.21.0 In-Reply-To: <20190424170906.751869122@linuxfoundation.org> References: <20190424170906.751869122@linuxfoundation.org> User-Agent: quilt/0.66 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Gwendal Grignou commit 3d02d7082e5823598090530c3988a35f69689943 upstream. Calculation did not use IIO_DEGREE_TO_RAD and implemented a variant to avoid precision loss as we aim a nano value. The offset added to avoid rounding error, though, doesn't give us a close result to the expected value. E.g. For 1000dps, the result should be: (1000 * pi ) / 180 >> 15 ~= 0.000532632218 But with current calculation we get $ cat scale 0.000547890 Fix the calculation by just doing the maths involved for a nano value val * pi * 10e12 / (180 * 2^15) so we get a closer result. $ cat scale 0.000532632 Fixes: c14dca07a31d ("iio: cros_ec_sensors: add ChromeOS EC Contiguous Sensors driver") Signed-off-by: Gwendal Grignou Signed-off-by: Enric Balletbo i Serra Cc: Signed-off-by: Jonathan Cameron Signed-off-by: Greg Kroah-Hartman --- drivers/iio/common/cros_ec_sensors/cros_ec_sensors.c | 7 ++++--- 1 file changed, 4 insertions(+), 3 deletions(-) --- a/drivers/iio/common/cros_ec_sensors/cros_ec_sensors.c +++ b/drivers/iio/common/cros_ec_sensors/cros_ec_sensors.c @@ -104,9 +104,10 @@ static int cros_ec_sensors_read(struct i * Do not use IIO_DEGREE_TO_RAD to avoid precision * loss. Round to the nearest integer. */ - *val = div_s64(val64 * 314159 + 9000000ULL, 1000); - *val2 = 18000 << (CROS_EC_SENSOR_BITS - 1); - ret = IIO_VAL_FRACTIONAL; + *val = 0; + *val2 = div_s64(val64 * 3141592653ULL, + 180 << (CROS_EC_SENSOR_BITS - 1)); + ret = IIO_VAL_INT_PLUS_NANO; break; case MOTIONSENSE_TYPE_MAG: /*