raid array with 3T disks and GPT partition

Hi,

I'm trying to create a raid6 array from 10x3T disks. Since disks > 2T
must use the GPT partion table I used parted to created a single
partition on each drive with the correct GPT partion type.

Now how do I make sure that these partitions have the correct "raid
autodetect" (fd) id? Is it even still needed? I didn't find any way to
set that flag in (g)parted.

Thanks,
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: raid array with 3T disks and GPT partition

On 09/01/2011 05:47 PM, Louis-David Mitterrand wrote:
>
> Now how do I make sure that these partitions have the correct "raid
> autodetect" (fd) id? Is it even still needed? I didn't find any way to
> set that flag in (g)parted.
>
I used gdisk and entered FD00

--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: raid array with 3T disks and GPT partition

On Thu, Sep 01, 2011 at 05:53:02PM +0200, Pim Zandbergen wrote:
> On 09/01/2011 05:47 PM, Louis-David Mitterrand wrote:
> >
> >Now how do I make sure that these partitions have the correct "raid
> >autodetect" (fd) id? Is it even still needed? I didn't find any way to
> >set that flag in (g)parted.
> >
> I used gdisk and entered FD00

Didn't know this tool, thanks.

So (g)parted is not appropriate for creating raid-autodetect partitions?
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: raid array with 3T disks and GPT partition

--BOKacYhQ+x31HxR3
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Thu Sep 01, 2011 at 05:47:59PM +0200, Louis-David Mitterrand wrote:

> Hi,
>=20
> I'm trying to create a raid6 array from 10x3T disks. Since disks > 2T
> must use the GPT partion table I used parted to created a single
> partition on each drive with the correct GPT partion type.
>=20
> Now how do I make sure that these partitions have the correct "raid
> autodetect" (fd) id? Is it even still needed? I didn't find any way to
> set that flag in (g)parted.
>=20
It's only needed for kernel auto-assembly (in which case you're also
limited to 0.90 metadata and 2TB drives), so no, there's no need to use
that. 0xDA seems to be the recommended partition type for RAID arrays
nowadays - that should prevent the OS from trying to read them directly.

Cheers,
Robin
--=20
___ =20
( ' } | Robin Hill |
/ / ) | Little Jim says .... |
// !! | "He fallen in de water !!" |

--BOKacYhQ+x31HxR3
Content-Type: application/pgp-signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (GNU/Linux)

iEYEARECAAYFAk5fq9AACgkQShxCyD40xBIdgwCeOOytg123QcjPxf55WfGc YhW8
LiUAoJu/pBL4kfSlSdUwNJyh0b99vHKj
=1w/m
-----END PGP SIGNATURE-----

--BOKacYhQ+x31HxR3--
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: raid array with 3T disks and GPT partition

On 09/01/2011 05:57 PM, Louis-David Mitterrand wrote:
> So (g)parted is not appropriate for creating raid-autodetect partitions?

I can't tell. gdisk is the GPT equivalent of fdisk. It's command line
orientated and gives full low-level control. I'm comfortable with that.
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: raid array with 3T disks and GPT partition

On Thu, Sep 01, 2011 at 04:59:13PM +0100, Robin Hill wrote:
> On Thu Sep 01, 2011 at 05:47:59PM +0200, Louis-David Mitterrand wrote:
> >
> > I'm trying to create a raid6 array from 10x3T disks. Since disks > 2T
> > must use the GPT partion table I used parted to created a single
> > partition on each drive with the correct GPT partion type.
> >
> > Now how do I make sure that these partitions have the correct "raid
> > autodetect" (fd) id? Is it even still needed? I didn't find any way to
> > set that flag in (g)parted.
> >
> It's only needed for kernel auto-assembly (in which case you're also
> limited to 0.90 metadata and 2TB drives), so no, there's no need to use
> that. 0xDA seems to be the recommended partition type for RAID arrays
> nowadays - that should prevent the OS from trying to read them directly.

Auto-assembly and metadata are not related: I regularly use 1.2 metadata
on non-boot partitions and they auto-assemble fine.

However lilo won't boot on anything other than 0.9, this I found the
hard way :)

Kernel auto-assembly seems quite useful and desirable to me, especially
when using, say, initrd to unlock dm-crypt partitions (no need to
configure madadm.conf in the initrd).

BTW, what is that 0xDA type?

Cheers,
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: raid array with 3T disks and GPT partition

On 09/01/2011 12:33 PM, Louis-David Mitterrand wrote:
> On Thu, Sep 01, 2011 at 04:59:13PM +0100, Robin Hill wrote:
>> On Thu Sep 01, 2011 at 05:47:59PM +0200, Louis-David Mitterrand wrote:
>>>
>>> I'm trying to create a raid6 array from 10x3T disks. Since disks> 2T
>>> must use the GPT partion table I used parted to created a single
>>> partition on each drive with the correct GPT partion type.
>>>
>>> Now how do I make sure that these partitions have the correct "raid
>>> autodetect" (fd) id? Is it even still needed? I didn't find any way to
>>> set that flag in (g)parted.
>>>
>> It's only needed for kernel auto-assembly (in which case you're also
>> limited to 0.90 metadata and 2TB drives), so no, there's no need to use
>> that. 0xDA seems to be the recommended partition type for RAID arrays
>> nowadays - that should prevent the OS from trying to read them directly.
>
> Auto-assembly and metadata are not related: I regularly use 1.2 metadata
> on non-boot partitions and they auto-assemble fine.

They most certainly are related. There is kernel autoassembly, then
there is user space assembly that's done by udev. They are two
different things. The kernel will only autoassemble version 0.9 arrays,
any other arrays are assembled by user space either in the initramfs or
later on in the boot cycle. That you don't have to manually run mdadm
-As doesn't mean that the kernel autoassembly is working on those arrays.

> However lilo won't boot on anything other than 0.9, this I found the
> hard way :)

Lilo should be able to boot on version 1.0 arrays too. It's just
version 1.1 and 1.2 arrays that kill lilo. But, then again, lilo is so
long since dead that one has to wonder why you are still using it.

> Kernel auto-assembly seems quite useful and desirable to me, especially
> when using, say, initrd to unlock dm-crypt partitions (no need to
> configure madadm.conf in the initrd).
>
> BTW, what is that 0xDA type?

Non-FS Data, which we hijacked for our purposes as it will keep the
system (any OS in fact) from thinking there should be a filesystem
there, leaving it free for us to pick up anytime in the boot process.

--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: raid array with 3T disks and GPT partition

On 01/09/2011 17:33, Louis-David Mitterrand wrote:
[...]
> Auto-assembly and metadata are not related: I regularly use 1.2 metadata
> on non-boot partitions and they auto-assemble fine.

Not possible. The kernel will not auto-assemble anything other than 0.90
metadata. You must have mdadm in your initrd.

> However lilo won't boot on anything other than 0.9, this I found the
> hard way :)

I have had lilo boot from 1.0 metadata just fine. It does need to be the
metadata-at-the-end layout though, hence 1.0 but not 1.1 or 1.2.

> Kernel auto-assembly seems quite useful and desirable to me, especially
> when using, say, initrd to unlock dm-crypt partitions (no need to
> configure madadm.conf in the initrd).

Neil Brown took the decision ages ago not to add any more what ought to
be userland use-once tools into the kernel, and this is the general
direction across the whole kernel. If you have an initrd unlocking a
dm-crypt partition you might as well have mdadm in there as well
starting your arrays.

> BTW, what is that 0xDA type?

Non-FS data.

Cheers,

John.

--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: raid array with 3T disks and GPT partition

--WIyZ46R2i8wDzkSu
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Thu Sep 01, 2011 at 06:33:34PM +0200, Louis-David Mitterrand wrote:

> On Thu, Sep 01, 2011 at 04:59:13PM +0100, Robin Hill wrote:
> > On Thu Sep 01, 2011 at 05:47:59PM +0200, Louis-David Mitterrand wrote:
> > >=20
> > > I'm trying to create a raid6 array from 10x3T disks. Since disks > 2T
> > > must use the GPT partion table I used parted to created a single
> > > partition on each drive with the correct GPT partion type.
> > >=20
> > > Now how do I make sure that these partitions have the correct "raid
> > > autodetect" (fd) id? Is it even still needed? I didn't find any way to
> > > set that flag in (g)parted.
> > >=20
> > It's only needed for kernel auto-assembly (in which case you're also
> > limited to 0.90 metadata and 2TB drives), so no, there's no need to use
> > that. 0xDA seems to be the recommended partition type for RAID arrays
> > nowadays - that should prevent the OS from trying to read them directly.
>=20
> Auto-assembly and metadata are not related: I regularly use 1.2 metadata
> on non-boot partitions and they auto-assemble fine.
>=20
Kernel auto-assembly and metadata are related (see the description for
the --auto-detect option in the mdadm manual page). Most distributions
now use mdadm in an initrd for assembly, which will (of course) work
with any metadata version.

> However lilo won't boot on anything other than 0.9, this I found the
> hard way :)
>=20
LILO (and grub) should work with 0.9 or 1.0 metadata, as both of these
write the metadata at the end of the disk, leaving the start looking the
same as a normal disk (for RAID-1 anyway).

> Kernel auto-assembly seems quite useful and desirable to me, especially
> when using, say, initrd to unlock dm-crypt partitions (no need to
> configure madadm.conf in the initrd).
>=20
Kernel auto-assembly is not recommended by the main md developer.

> BTW, what is that 0xDA type?
>=20
0xDA is "non-FS data".

Cheers,
Robin
--=20
___ =20
( ' } | Robin Hill |
/ / ) | Little Jim says .... |
// !! | "He fallen in de water !!" |

--WIyZ46R2i8wDzkSu
Content-Type: application/pgp-signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (GNU/Linux)

iEYEARECAAYFAk5fub8ACgkQShxCyD40xBLezQCdHRD1jElfM2ah+X4X8/LV q6CU
kwwAoMmbvS2boPGcvcfLYkNTE236yLSq
=Dyi+
-----END PGP SIGNATURE-----

--WIyZ46R2i8wDzkSu--
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: raid array with 3T disks and GPT partition

>> However lilo won't boot on anything other than 0.9, this I found the
>> hard way :)
>
> Lilo should be able to boot on version 1.0 arrays too. It's just
> version 1.1 and 1.2 arrays that kill lilo. But, then again, lilo is
> so long since dead that one has to wonder why you are still using it.
>
At least lilo has an understandable way of working. grub2 is just.... a
big pain in the *ass as far as i am concerned.
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: raid array with 3T disks and GPT partition

On Thu, Sep 01, 2011 at 12:55:08PM -0400, Doug Ledford wrote:
> On 09/01/2011 12:33 PM, Louis-David Mitterrand wrote:
> >On Thu, Sep 01, 2011 at 04:59:13PM +0100, Robin Hill wrote:
> >>On Thu Sep 01, 2011 at 05:47:59PM +0200, Louis-David Mitterrand wrote:
> >>>
> >>>I'm trying to create a raid6 array from 10x3T disks. Since disks> 2T
> >>>must use the GPT partion table I used parted to created a single
> >>>partition on each drive with the correct GPT partion type.
> >>>
> >>>Now how do I make sure that these partitions have the correct "raid
> >>>autodetect" (fd) id? Is it even still needed? I didn't find any way to
> >>>set that flag in (g)parted.
> >>>
> >>It's only needed for kernel auto-assembly (in which case you're also
> >>limited to 0.90 metadata and 2TB drives), so no, there's no need to use
> >>that. 0xDA seems to be the recommended partition type for RAID arrays
> >>nowadays - that should prevent the OS from trying to read them directly.
> >
> >Auto-assembly and metadata are not related: I regularly use 1.2 metadata
> >on non-boot partitions and they auto-assemble fine.
>
> They most certainly are related. There is kernel autoassembly, then
> there is user space assembly that's done by udev. They are two
> different things. The kernel will only autoassemble version 0.9
> arrays, any other arrays are assembled by user space either in the
> initramfs or later on in the boot cycle. That you don't have to
> manually run mdadm -As doesn't mean that the kernel autoassembly is
> working on those arrays.

Ah, thanks for clearing that up. I thought that when mdadm was not
involved then is must be the kernel. Didn't realize udev was at work
there.
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: raid array with 3T disks and GPT partition

On 09/01/2011 03:20 PM, Louis-David Mitterrand wrote:
> On Thu, Sep 01, 2011 at 12:55:08PM -0400, Doug Ledford wrote:
>> On 09/01/2011 12:33 PM, Louis-David Mitterrand wrote:
>>> On Thu, Sep 01, 2011 at 04:59:13PM +0100, Robin Hill wrote:
>>>> On Thu Sep 01, 2011 at 05:47:59PM +0200, Louis-David Mitterrand wrote:
>>>>>
>>>>> I'm trying to create a raid6 array from 10x3T disks. Since disks> 2T
>>>>> must use the GPT partion table I used parted to created a single
>>>>> partition on each drive with the correct GPT partion type.
>>>>>
>>>>> Now how do I make sure that these partitions have the correct "raid
>>>>> autodetect" (fd) id? Is it even still needed? I didn't find any way to
>>>>> set that flag in (g)parted.
>>>>>
>>>> It's only needed for kernel auto-assembly (in which case you're also
>>>> limited to 0.90 metadata and 2TB drives), so no, there's no need to use
>>>> that. 0xDA seems to be the recommended partition type for RAID arrays
>>>> nowadays - that should prevent the OS from trying to read them directly.
>>>
>>> Auto-assembly and metadata are not related: I regularly use 1.2 metadata
>>> on non-boot partitions and they auto-assemble fine.
>>
>> They most certainly are related. There is kernel autoassembly, then
>> there is user space assembly that's done by udev. They are two
>> different things. The kernel will only autoassemble version 0.9
>> arrays, any other arrays are assembled by user space either in the
>> initramfs or later on in the boot cycle. That you don't have to
>> manually run mdadm -As doesn't mean that the kernel autoassembly is
>> working on those arrays.
>
> Ah, thanks for clearing that up. I thought that when mdadm was not
> involved then is must be the kernel. Didn't realize udev was at work
> there.

Well, udev calls mdadm. If the kernel doesn't autoassemble it, then
mdadm is involved at some point. On older systems, rc.sysinit called
mdadm to assemble non-boot arrays, on modern systems, udev calls mdadm.



--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: raid array with 3T disks and GPT partition

Rudy Zijlstra wrote:
>
>>> However lilo won't boot on anything other than 0.9, this I found the
>>> hard way :)
>>
>> Lilo should be able to boot on version 1.0 arrays too. It's just
>> version 1.1 and 1.2 arrays that kill lilo. But, then again, lilo is
>> so long since dead that one has to wonder why you are still using it.
>>
> At least lilo has an understandable way of working. grub2 is just....
> a big pain in the *ass as far as i am concerned.

I would say that grub seems easier to use than grub2. Haven't used lilo
since I got off Slackware, and it has an annoying limit of 19 bootable
kernels.

--
Bill Davidsen
We are not out of the woods yet, but we know the direction and have
taken the first step. The steps are many, but finite in number, and if
we persevere we will reach our destination. -me, 2010



--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html