Return-Path: <linux-kernel-owner@vger.kernel.org>
Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand
        id S932968AbcKYRWX (ORCPT <rfc822;w@1wt.eu>);
        Fri, 25 Nov 2016 12:22:23 -0500
Received: from mail-bn3nam01on0081.outbound.protection.outlook.com ([104.47.33.81]:4096
        "EHLO NAM01-BN3-obe.outbound.protection.outlook.com"
        rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP
        id S932348AbcKYRVc (ORCPT <rfc822;linux-kernel@vger.kernel.org>);
        Fri, 25 Nov 2016 12:21:32 -0500
X-Greylist: delayed 163358 seconds by postgrey-1.27 at vger.kernel.org; Fri, 25 Nov 2016 12:21:29 EST
Authentication-Results: spf=none (sender IP is )
 smtp.mailfrom=Serguei.Sagalovitch@amd.com; 
Subject: Re: Enabling peer to peer device transactions for PCIe devices
To: Logan Gunthorpe <logang@deltatee.com>,
        =?UTF-8?Q?Christian_K=c3=b6nig?= <christian.koenig@amd.com>,
        Jason Gunthorpe <jgunthorpe@obsidianresearch.com>,
        Dan Williams <dan.j.williams@intel.com>
References: <75a1f44f-c495-7d1e-7e1c-17e89555edba@amd.com>
 <45c6e878-bece-7987-aee7-0e940044158c@deltatee.com>
 <20161123190515.GA12146@obsidianresearch.com>
 <7bc38037-b6ab-943f-59db-6280e16901ab@amd.com>
 <20161123193228.GC12146@obsidianresearch.com>
 <c2c88376-5ba7-37d1-4d3e-592383ebb00a@amd.com>
 <20161123203332.GA15062@obsidianresearch.com>
 <dd60bca8-0a35-7a3a-d3ab-b95bc3d9b973@deltatee.com>
 <20161123215510.GA16311@obsidianresearch.com>
 <CAPcyv4jVDC=8AbVa9v6LcXm9n8QHgizv_+gQJC4RTd-wtTESWQ@mail.gmail.com>
 <20161123232503.GA13965@obsidianresearch.com>
 <a33ec1cd-051f-8a24-0587-68707459c25c@amd.com>
 <5e1de9ee-34f5-136d-a07e-f949d492864f@deltatee.com>
 <c60815a1-aaac-52eb-1714-66abb28bdc01@amd.com>
 <209107c7-3098-ca70-7d62-b55021d01faa@deltatee.com>
CC: "Deucher, Alexander" <Alexander.Deucher@amd.com>,
        "linux-nvdimm@lists.01.org" <linux-nvdimm@ml01.01.org>,
        "linux-rdma@vger.kernel.org" <linux-rdma@vger.kernel.org>,
        "linux-pci@vger.kernel.org" <linux-pci@vger.kernel.org>,
        "Kuehling, Felix" <Felix.Kuehling@amd.com>,
        "Bridgman, John" <John.Bridgman@amd.com>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        "dri-devel@lists.freedesktop.org" <dri-devel@lists.freedesktop.org>,
        "Sander, Ben" <ben.sander@amd.com>,
        "Suthikulpanit, Suravee" <Suravee.Suthikulpanit@amd.com>,
        "Blinzer, Paul" <Paul.Blinzer@amd.com>,
        "Linux-media@vger.kernel.org" <Linux-media@vger.kernel.org>,
        Haggai Eran <haggaie@mellanox.com>
From: Serguei Sagalovitch <serguei.sagalovitch@amd.com>
Message-ID: <ea52d962-6c8e-92d9-eb1b-3ace4bf56126@amd.com>
Date: Fri, 25 Nov 2016 12:20:47 -0500
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101
 Thunderbird/45.4.0
MIME-Version: 1.0
In-Reply-To: <209107c7-3098-ca70-7d62-b55021d01faa@deltatee.com>
Content-Type: text/plain; charset="windows-1252"; format=flowed
Content-Transfer-Encoding: 7bit
X-Originating-IP: [165.204.55.251]
X-ClientProxiedBy: SN1PR05CA0005.namprd05.prod.outlook.com (10.163.68.143) To
 CY1PR12MB0697.namprd12.prod.outlook.com (10.163.238.158)
X-MS-Office365-Filtering-Correlation-Id: 463216c0-5f2a-4977-30b0-08d415576a18
X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001);SRVR:CY1PR12MB0697;
X-Microsoft-Exchange-Diagnostics: 1;CY1PR12MB0697;3:Za86IfVdiTLDyrAkKfGR3xgvNboZJ4X6z86y6irExSlLZcCFPlPP/0eQDX7D6/MmSVjgVSkUijpC806tL8vM599BhX+tjHPl3/DjfJ0FmqTUCeJRNYKHcxRGYbyl6t6xVWVrDvYhtzdJLc9d34wyrXrNhQiXfbMpObvkkkPFFiO5fqjvVaQEgnwG780Uz16T2DAz83xfbId9qinTNX7VWnOqBIkruh6g6KihF7fmqW2dAHXwCacVV7XcW5HcLCh4+GQdGSyuBrmEXd8KAcblmQ==
X-Microsoft-Exchange-Diagnostics: 1;CY1PR12MB0697;25:YChwKM+UV3D2iWHHm/v5/xGBceXye3C3GSO2bH1hGO6foKaF4KPA6hviZJJN3hF5x5YCSMfFqGkRr28LVx7v5Rh8kXjNUWyRKL0kcQA6P9S9DgbabGVyPeZxBGYsG4c0INIjiO7YxiAgmth0Viz4uN5XkeEdgU97KvWmPetl0YGg8l1K+TvBwKmn/9vv9b28l6TVvn3VeG6ca+MYG9rDiTxL8T9GOJLaCFUPi3s8YR1M2xDo0QUjmk/ilVAqUTV8nygnTjinlpmeGgLmMdocNV4/OMDGzCWU7IlRl9Kz8QJgozroXMDtbiIreYpkMmvxrRHF+8deaHkd5ZZFYVOxpILNRBoYRWmGV35Vga2fH8rVlx4fXFBzN87CibWceDzw+xTkvdNZvN1z3o8oBAYZ4Tc/ZZpuONYOw5iw3beImJNfoMvVe3NwATN8gGXmdnPI+2vSEw1Av6IYzKDAKLLq2knZREYn5XUc+agVQcb9t0sUfQD/v06gBUC5fF07B0KYY4eotB7DN4cUs40dFZKoJix+L1PZYDh/fJqIHCEuSXUQbklvEwo1/UTnIaBeLY/1OlR9BuuYhAzrLDO/6lGU+2rWrxinbbov5KheYH3fSDtX9l088idmy8UqR6lSKFMDKl+QUY17+0mgVjQUh2Ep8zc2inxzRNDOKVv4gFBbc39AaTpCVZaw5cNKORWAs1w6npFIKv9Bc6wPX/CZdu8S7g7S4FMWJvlm918tqpx7V/nq6PNFNWvpQ8w/ptKzkv/Tf19YBVKTCK99EtvrTr3JfQ==
X-Microsoft-Exchange-Diagnostics: 1;CY1PR12MB0697;31:j+61x1i0xMzksys6gd/k6hxvsV6K6giCn9hqKlftGG2wOkxmYWV49CHPTAI3QWZPbZDqF3OwtiF1OrJmhnxA3Z2fEZ60FcmQtS7P3klHh2UPb1Avo50lTk/EKuwjIigO+VGMYvy2kZ4gVUKy63dOLu13FrIp2zrhGGPZjHkWx+AzSCdd3Vy/zbeCekj5lmEUY1Y8UZSvE5EKKj8VKqe6FFTFu5dHKQlcM4mv2z3DVPsnxz2oThf9lIiocgZ03rLygUpouvhXTLlf4XZ25cXSbdQw8Iv+f7uAzrtC8gPfsP4=;20:8XIbOO3Je4QBYzHpoqnFdF3kI2dGhvMB0QeP7d5R69WAgRBqOFKB6dAz85kUCEtyL/kPw2HGMgPMUjtuRZTkbxpC2f6inQS+UrT5w8YGsGZ9nqBuHgKBgNFYn8D0HHEVO6OvUcvNCrs0HmB/VqV/5PPm7qNLSWX2td1AgnBiPsBo9Qq/y+vS1c377mc4suauOhwYGe1nm0KcsTrkw+MBmMJ41UimoBrrAc65cRz7XFvuWjoF6TAc44U7Mv+pEzROSJIECXPMuh4HTN1CGwqAEy3GsjsMpw0K8ZCP9WK96bdYKhbmTHb3htk8Tan2xaS0YZnGfQ9HXfjrv3JyGYr7e6MBOWeh6CB5xy0DsWsJDRo6+3kTR7NRp+0OU2QPRB7/SVObvTlvHItn/IvQsUVBoDDfstrjaFWV84E6F3RAPVIVtJcDTXsjEqxpcNwAVvXkTYMfChVqySLwmfT76XXpc6dOLj0/KJx/LnyWosdhTXblPN7QlbUjjydm8ghq00Jk
X-Microsoft-Antispam-PRVS: <CY1PR12MB0697FC20F406566F9B674426FE890@CY1PR12MB0697.namprd12.prod.outlook.com>
X-Exchange-Antispam-Report-Test: UriScan:;
X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6060326)(6045199)(6040361)(601004)(2401047)(8121501046)(5005006)(3002001)(10201501046)(6055026)(6061324)(6041248)(20161123560025)(20161123555025)(20161123562025)(20161123564025);SRVR:CY1PR12MB0697;BCL:0;PCL:0;RULEID:;SRVR:CY1PR12MB0697;
X-Microsoft-Exchange-Diagnostics: 1;CY1PR12MB0697;4:O0mrihTdnvMaAhER70dDff3H0E5Lr9rohVkTK6DJVWN1zVxHcDTOYZq/ZGKFxhk5q295MpV7G1HOswBFRbu6DLBX463Ms+/hnG+G6GOa/Ju05afN4akOZvjL5E3CGN9aLUz0Epksr4E2cWGqqQ+Fd7Yx1a+RaYx1unEtDRCJkD/TIG6+fXC5FlnbegXuB8Z17ml9LbCrJGWV3ZuhbUsE1Bzxd9n0jnANlchVJuWSICJmKqA6940UaNpiyoDP4uKHhL6BDylv35cnFpBj9+jGXn73nDMe5FkWptG2cM+HnA9AEIcGuaVuzfXStYbQmpL1W5DCMidO+Yw9Gh+lgHwPNBFJf825RBot9OYN69fK+EJjPbfuh2/xmA9xxnZdbThUFGKjR70ps3VffCoNjGpcu73FpIiu4JI0TKAk8REd/Ce0gVkeDdFmVVLROKEv3/rY/bke7Fe+voxbjbAd6QgQketsIUeMElzxjbPafNx5mqBObpexGJHd38nDsaCeb0bB2sB5mqtnOvi94oqy1i2efp5O+/J944OWgGs3515yKVnVKmq/YKO081/WGGGrH6XkT6sDIBXkUDJD1mxuzx/5YNfqrZZe2oIfTUWRT46YYBh5OZmRTBc33q6Zq3SM7ULm
X-Forefront-PRVS: 01371B902F
X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10009020)(4630300001)(6009001)(6049001)(7916002)(199003)(189002)(7416002)(33646002)(76176999)(2906002)(305945005)(50986999)(38730400001)(2950100002)(7846002)(64126003)(47776003)(230700001)(7736002)(54356999)(4326007)(23746002)(92566002)(68736007)(229853002)(101416001)(3846002)(83506001)(66066001)(4001350100001)(39400400001)(189998001)(39380400001)(5001770100001)(50466002)(65956001)(65806001)(97736004)(6116002)(39410400001)(105586002)(8676002)(5660300001)(42186005)(81166006)(6666003)(93886004)(65826007)(81156014)(86362001)(31686004)(36756003)(77096006)(31696002)(106356001)(39450400002);DIR:OUT;SFP:1101;SCL:1;SRVR:CY1PR12MB0697;H:[172.27.224.67];FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en;
X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1;CY1PR12MB0697;23:Q9mm0is9JCZUeNvC/jCNCm4Qmu6+rO2r8y2+u?=
 =?Windows-1252?Q?m5ZwO+suruz9FP+UbxFqNvtQ0yt5j4p+mqwnckzfMz/Toqf6h76xEQpr?=
 =?Windows-1252?Q?TDxn5vB7rW46Bqlq0/fF7fBfhimm53w9Jcn4ylHKaxqYlnaBzdWY0VQ4?=
 =?Windows-1252?Q?iKGJB5dYx9IYDZkKHU4KtsIalHg5JPTB0I0DIZJD9pn5rD3k2GFNTAUH?=
 =?Windows-1252?Q?etFzJaX8T/GFDpZMWA38p72SybgvYuGJHvOBH/ODuDeGs6Cd+W7hrLY0?=
 =?Windows-1252?Q?dZ15tFxuznY3QDQIY7g9ihHfU2wXy1Gc1oXwUh19Zs5xr9IJqeG2eVht?=
 =?Windows-1252?Q?Q4k4b1MFqDgld9oo5Z6QlnYgYCesoRwakrOY59M7x1sEDtf5gqC6WEFY?=
 =?Windows-1252?Q?AsLkOPPTnzW64ka7YwionS8yKl1hkP4xbcGHiXcRD0kXhorv6w8vKvfR?=
 =?Windows-1252?Q?cCouXroFSLIeMPZPyyW7cYWWjHUmSTLFqSMoik5z3MSIMPhlaw+r3c0H?=
 =?Windows-1252?Q?nyp7xxVcR0P3v2ZNtcydYj8o6lucm1HfEepIn0cijF7L55YowitdbqfM?=
 =?Windows-1252?Q?g48SE1n9ZV65QoeuA+Lo5HGlcvzNwVG2mgHBTg5aoMmNKFV9zQaDsAIi?=
 =?Windows-1252?Q?VL9FYIWoYo8SYhCPOjpiu4BqWZcHql8iwiT2/mzmLEz8WllN4gXnwY9R?=
 =?Windows-1252?Q?9tQ6S0veebMGS8rLAlaPYTN1ewsOq8I3kxnDJscpHoTK5MAC/Z8jJ0n8?=
 =?Windows-1252?Q?jzQNNUUXEmvx68sJ2tIot98pXionnXqbvRPtYZp5qhN0aAOJQO/52zwi?=
 =?Windows-1252?Q?Uux6KvFSX7OQq1ldGFvc/urOgFaZCJJqefWJ3lAUh6zzo0e6YN1R2rbW?=
 =?Windows-1252?Q?74Lm5YS8Xe7RmMQoZkIrkcVGN4pywx7+ZU+gIS1v7tTxKZFcBXP478nE?=
 =?Windows-1252?Q?f+Bww2NKKnsNJHupx1ot/B9gYNaMpX+CkAflofFtCn5JFWHWOfGBIstD?=
 =?Windows-1252?Q?35TTKdeNAJxvNo/7b2oBF3TAjBUrH1lQmuYRGp6mmV/1YYwUP0Ltkbko?=
 =?Windows-1252?Q?BZEdCLxgxcePtXDqAQVgx8I6JbG6F1nGD8q5EfKNWkKmaUG/RRd3uXel?=
 =?Windows-1252?Q?4NWnd97s33iCQ6BP2kWw9XeNcvYmUE+wERhBt+hvfOh0yLq5fRs+pCvK?=
 =?Windows-1252?Q?rrcrdRWednr97o/69kRq/5gfe2459Q7Fp14cQxuMxKXrJMD5DPpuyCxT?=
 =?Windows-1252?Q?O1vCAerS/h3soIUEkI2ynxWMtHJZ77dS7JW56w8saOqa7XpGJI45lRx3?=
 =?Windows-1252?Q?hInhjBAuTmObBb2tnw0S8E7XmCLslwLm7ybYxtMfaTbyxs5QyVS8K+r8?=
 =?Windows-1252?Q?ViaxDrE7aNmqwd0NDNH4Vf12rqEYXvgSlDwhPoN0CBfTI72HftfcAn//?=
 =?Windows-1252?Q?eFDOECkUjvnXJz0AKuM95Qwh486CmRz0kMpug7TfA=3D=3D?=
X-Microsoft-Exchange-Diagnostics: 1;CY1PR12MB0697;6:Cx6alZvCTw6BvpmK6mRMNv4bM53zFEiqjOTX8Ro+wlsB3TtrfDTMO/EVl+v2lCcDE27sMrAqmvEAfHCRI1jq37G1+rI1VwK5UBKtwcJAbC2NTSXV47QrufTLWm/sz5DHuKkIt0ELO65emeY9mcsOl78IRnZm0qYPrgPOdTeyAjaN/SuWDc9pU18JZoBEW/XWBE4W45tfGtNc0KzA8r1VF3FckWTG7+da9PzqP2cGzOT/qKEavHBNdQtjv8QabeHapXE+SatTOddnixQf4wU23KpZnDUqPm2K/kOF4k8OgLdWk2ulnWJ0mGdUfLfhgUavcSvJjL401tdp3RaKU2I3vyVExiIxDCWMH9fqVjJ+UopfYHwRLglSmm8pmiupr+GZ5sHrczjRCrNI6eYtrqjLd44fBTi9w2S4TCL8VDZQUivVWfAAFQxj0OThw4is+pYs1gMbvjyKLdvPjOe0aR2yHMXmvnnVOyKduNq5TDJ34+tWiDyP4z3oLya8kG/WcRex;5:qGi2kTMWacq+5rNnuVwZT9zzVkQyN0wHu/0u9NxU9OTdtHuLg2I683ejv3Rb6lyWumJplSaY+H24D+rFujk27bEwi6xF75lB0sP1+zlhUpt/WYsHkriN35UaI3Hh6ObhhBr957XUonHSoypOyMSlwX6aEbPPXMJaIhvq8Queoa4=;24:8/YZXbh6T5QmMPgVQMVsLs+PK/0Lei4WoTYNzuL3zd4S1N8774c4GIp3aaCL7B7A63kmYDRkpy9a+znffLb/Xh0iaKYi2pPLddh9yr27Eyc=
SpamDiagnosticOutput: 1:99
SpamDiagnosticMetadata: NSPM
X-Microsoft-Exchange-Diagnostics: 1;CY1PR12MB0697;7:oD7ihM5WMewXl7BQyESx/6PK0dYKeQFAHtcpb+FmiO5eQP9C0AjGdJXD+VHsVkcTWayFwnjMdkn3Gmjs918wJmi+1qkSXIzPXgiVENp31Z8Na3Uc9ofQ7dYtX3whYwVWZemzBMMIgf5ElwGDtyTAbHe0YpnlWKMwaeieQ0VwrrheGwkUNQEbKscD+p3ezJBqo0OKQaiprYtXMPxtlgQqsdRE7F1HgajVA/EeGkvqJQc49+mUa6D4NCmb5yr5vMSBNu2HoaiUH+VEtvmkknZ/7PzzDKG0XVno007F+jFjsjsin96JyxgxtPol/wOelp25TfzQ+n91bGCfYzCr0TCAAm/GgFI7DH73wrOQfAwZMh7+LpBja7hbPtf6+GbltI4RY6WHaLprLWqZrMIRb5G7m/n2jyWsNjVaRoT51xYnmEzGwA9lW0DY1jmUdW3KBhGlzKmMtvQUaNMS1nlqGRVAlg==;20:WoqeTLfz+yVGPwOy6Qy28kl84WIVW2vhhlHehzXJaIG84LlEsf38Yr6ztY/yPeLkwp36Ro90HBbfgo+uTXSiiXAL8H1Fx6njaZLK0HeRng5JI4MutvUoI2kWnBGj5dS3u0Fv23AcVKyV/r4ZIwq94hVGTcKQ3YdLVss5lbQ4O9/ntQB0Jh6JXpD2ZGR736SFLq1NOqXOqB5tjj0FlghrSMLp0JXJQTv3whxIyPJg/90Uk4sFqVvK9NFhUQri9n5L
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 25 Nov 2016 17:20:52.7610 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY1PR12MB0697
Sender: linux-kernel-owner@vger.kernel.org
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
Content-Length: 419
Lines: 11


> A white list may end up being rather complicated if it has to cover
> different CPU generations and system architectures. I feel this is a
> decision user space could easily make.
>
> Logan
I agreed that it is better to leave up to user space to check what is 
working
and what is not. I found that write is practically always working but 
read very
often not. Also sometimes system BIOS update could fix the issue.