Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S965182AbbFJPxV (ORCPT ); Wed, 10 Jun 2015 11:53:21 -0400 Received: from mx1.redhat.com ([209.132.183.28]:39056 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S965931AbbFJPsg (ORCPT ); Wed, 10 Jun 2015 11:48:36 -0400 Date: Wed, 10 Jun 2015 10:48:34 -0500 From: David Teigland To: Goldwyn Rodrigues Cc: linux-kernel@vger.kernel.org, NeilBrown Subject: Re: clustered MD Message-ID: <20150610154834.GC333@redhat.com> References: <20150609182102.GA4305@redhat.com> <55773DE1.7080107@suse.com> <20150609194505.GA17536@redhat.com> <557747AB.7080706@suse.com> <20150609203056.GB17536@redhat.com> <5577AFF4.6020505@suse.com> <20150610150151.GA333@redhat.com> <5578575F.1040006@suse.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5578575F.1040006@suse.com> User-Agent: Mutt/1.5.21 (2010-09-15) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 2133 Lines: 53 On Wed, Jun 10, 2015 at 10:27:27AM -0500, Goldwyn Rodrigues wrote: > I thought I answered that: > To use a software RAID1 across multiple nodes of a cluster. Let me > explain in more words.. > > In a cluster with multiple nodes with a shared storage, such as a > SAN. The shared device becomes a single point of failure. OK, shared storage, that's an important starting point that was never clear. > If the > device loses power, you will lose everything. A solution proposed is > to use software RAID, say with two SAN switches with different > devices and create a RAID1 on it. So if you lose power on one switch > or one of the device is fails the other is still available. Once you > get the other switch/device back up, it would resync the devices. OK, MD RAID1 on shared disks. > >, and exactly > >what breaks when you use raid1 in that way? Once we've established the > >technical problem, then I can fairly evaluate your solution for it. > > Data consistency breaks. If node 1 is writing to the RAID1 device, > you have to make sure the data between the two RAID devices is > consistent. With software raid, this is performed with bitmaps. The > DLM is used to maintain data consistency. What's different about disks being on SAN that breaks data consistency vs disks being locally attached? Where did the dlm come into the picture? > Device failure can be partial. Say, only node 1 sees that one of the > device has failed (link break). You need to "tell" other nodes not > to use the device and that the array is degraded. Why? > In case of node failure, the blocks of the failed nodes must be > synced before the cluster can continue operation. What do cluster/node failures have to do with syncing mirror copies? > Does that explain the situation? No. I don't see what clusters have to do with MD RAID1 devices, they seem like completely orthogonal concepts. -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/