Good storage solution

Good storage solution

am 29.09.2007 17:05:28 von qwertycat

I'm doing a PHP script on FreeBSD which servers multi-TBytes worth of
content mostly files ranging in size from 100KB to 600MB. Similar to a
file-sharing sites where users upload their pictures/videos/binary
files.

I'd prefer a simple storage system but not fimilar with large storage
as this. I'd prefer to serve the files in URLs in this format:
http://archive.site.com/$FILENAME

I'd have 4x FreeBSD servers (local LAN linked) each with 6x 500GB SATA
hard-drives (RAID5 array) totaling 12 TBytes storage between the
servers.

What would be your recommendation(s)?

Re: Good storage solution

am 29.09.2007 17:44:13 von Hans-Peter Sauer

In comp.sys.ibm.pc.hardware.storage qwertycat@googlemail.com wrote:
> I'm doing a PHP script on FreeBSD which servers multi-TBytes worth of
> content mostly files ranging in size from 100KB to 600MB. Similar to a
> file-sharing sites where users upload their pictures/videos/binary
> files.

> I'd prefer a simple storage system but not fimilar with large storage
> as this. I'd prefer to serve the files in URLs in this format:
> http://archive.site.com/$FILENAME

> I'd have 4x FreeBSD servers (local LAN linked) each with 6x 500GB SATA
> hard-drives (RAID5 array) totaling 12 TBytes storage between the
> servers.

> What would be your recommendation(s)?

What is your question? I have used RAID5/6 in TB range under Linux,
so I guess doung the same under FreeBSD should not be an issue.
Export via NFS and you are done.

Arno

Re: Good storage solution

am 02.10.2007 20:51:43 von qwertycat

On Sep 29, 4:44 pm, Arno Wagner wrote:
> What is your question? I have used RAID5/6 in TB range under Linux,
> so I guess doung the same under FreeBSD should not be an issue.
> Export via NFS and you are done.
>
> Arno

Can you provide any good links for tutorials on NFS? I have read
Wikipedia's page for but don't understand how I can use NFS to create
a virtual drive of 12TBytes spread over 4 servers and 24 hard drives.

Re: Good storage solution

am 02.10.2007 21:17:15 von unknown

Post removed (X-No-Archive: yes)

Re: Good storage solution

am 03.10.2007 01:47:42 von Hans-Peter Sauer

In comp.sys.ibm.pc.hardware.storage qwertycat@googlemail.com wrote:
> On Sep 29, 4:44 pm, Arno Wagner wrote:
>> What is your question? I have used RAID5/6 in TB range under Linux,
>> so I guess doung the same under FreeBSD should not be an issue.
>> Export via NFS and you are done.
>>
>> Arno

> Can you provide any good links for tutorials on NFS? I have read
> Wikipedia's page for but don't understand how I can use NFS to create
> a virtual drive of 12TBytes spread over 4 servers and 24 hard drives.

Oh, you want one unified filesystem? Doing that with more than
one computer may not be a good idea. If you do, some type of
cluster filesystem should be used. Otherwise you could get
serious trouble if one computer goes down.

Come to think of it, why not put the 24 disks all in one computer?
This may need a cube-type server case and three 8x SATA controllers,
but both are available.

Arno

Re: Good storage solution

am 03.10.2007 01:48:11 von Hans-Peter Sauer

In comp.sys.ibm.pc.hardware.storage Michael Vilain wrote:
> In article <1191351103.497497.188620@o80g2000hse.googlegroups.com>,
> qwertycat@googlemail.com wrote:

>> On Sep 29, 4:44 pm, Arno Wagner wrote:
>> > What is your question? I have used RAID5/6 in TB range under Linux,
>> > so I guess doung the same under FreeBSD should not be an issue.
>> > Export via NFS and you are done.
>> >
>> > Arno
>>
>> Can you provide any good links for tutorials on NFS? I have read
>> Wikipedia's page for but don't understand how I can use NFS to create
>> a virtual drive of 12TBytes spread over 4 servers and 24 hard drives.

> "That depends" on how you're using your storage. NFS is just the
> transport mechanism. Layout, redundancy, and BACKUPS are a bigger
> concern. You need someone who understands storage, optimization, and
> backups ASAP. Hire a consultant or go do a LOT of reading.

I have to say I agree to that.

Arno