A computer components & hardware forum. HardwareBanter

If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.

Go Back   Home » HardwareBanter forum » General Hardware & Peripherals » Storage & Hardrives
Site Map Home Register Authors List Search Today's Posts Mark Forums Read Web Partners

Storage Recommendations for a Single Web Application



 
 
Thread Tools Display Modes
  #1  
Old May 19th 04, 10:02 PM
Josh
external usenet poster
 
Posts: n/a
Default Storage Recommendations for a Single Web Application

I've been reading posts from this group for the past few days and have
a decent understanding of the differences between DAS, NAS, and SAN.
However, it seems like the majority of the discussion revolves around
enterprise-wide file/data storage and sharing.

If I'm planning a single website dedicated to the online storage and
retrieval of documents (files, images, etc.) and would like to get
some recommendations from the group. Specifically, my storage
requirements will grow with my customer base - starting out at a few
GB and growing to 5-10 TB (if successful).

My question - what type of network architecture would provide the most
cost efficient scalability (i.e. I don't want to pay for 3TB until I
need it). Does SAN make sense for a single website? Additionally,
I'm going to rent dedicated servers from Rackspace and I know they
have NAS and SAN services, so I'm not considering building my own.

Please feel free to point out dumb questions - I'm fairly ignorant of
networking.
  #2  
Old May 20th 04, 05:17 AM
Bill Todd
external usenet poster
 
Posts: n/a
Default


"Josh" wrote in message
om...
I've been reading posts from this group for the past few days and have
a decent understanding of the differences between DAS, NAS, and SAN.
However, it seems like the majority of the discussion revolves around
enterprise-wide file/data storage and sharing.

If I'm planning a single website dedicated to the online storage and
retrieval of documents (files, images, etc.) and would like to get
some recommendations from the group. Specifically, my storage
requirements will grow with my customer base - starting out at a few
GB and growing to 5-10 TB (if successful).

My question - what type of network architecture would provide the most
cost efficient scalability (i.e. I don't want to pay for 3TB until I
need it). Does SAN make sense for a single website? Additionally,
I'm going to rent dedicated servers from Rackspace and I know they
have NAS and SAN services, so I'm not considering building my own.

Please feel free to point out dumb questions - I'm fairly ignorant of
networking.


You say 'servers', suggesting that you believe that the access load will
exceed the capabilities of a single server. In that case, you've got to
decide how to distribute the load over multiple servers, whereas if you only
needed a single server, then the only question would be what kind of storage
to use with it, and the answer would probably be directly-attached storage
for the kind of capacities you're talking about - using attached RAID-type
boxes - unless your servers were located at a provider who could supply
unusually inexpensive (and suitably redundant) SAN storage (in which case
the issue of storage expandibility becomes their problem, not yours).

With multiple servers, the easiest though least flexible approach would be
to use DAS at each and partition the data statically across them (and the
least expensive as well, lacking the kind of SAN service I just mentioned).
This also provides at least one crude approach to expandability: just add
more servers and re-partition the data across them.

But if one of your servers went down, you'd then lose access to the portion
of your data that it held, unless you were using a shared SAN (again, likely
with redundant storage) and had made provisions for other servers to pick up
that portion of the data in a fail-over-style manner (which is an entire
subject in itself, e.g., since the data may not have been left in a
consistent state when the server failed). It's also possible to mirror data
from one server to a partner, using only DAS, such that the partner can take
over (again, modulo mechanisms to ensure data consistency) - but unless
you're running VMS or AIX (which on servers supplied by RackSpace seems
unlikely) you may need some third-party software to do this.

If you want all data to be accessible from all servers (to allow continued
operation in the event of a server failure), the easiest though most
brute-force approach would be to use provider-supplied NAS (with suitable
provider-supplied redundancy), though conceptually that's a bit silly since
you'd be serving files to your servers just so those servers could in turn
serve them elsewhere. Using the (suitably robust) NAS at least means that
the file system itself won't be left in an inconsistent state if one of your
servers fails, but that doesn't guarantee that your data will be internally
consistent (e.g., some multi-update transaction may have only partially
completed).

Or, you could run a 'SAN file system' on your servers that accessed shared
data on the SAN in a suitably-interlocked manner to ensure its coherency.
I'm not even going to begin to describe what that entails.

The bottom line is that unless you can live with an installation where
either only a single server is used or where data is statically distributed
across multiple servers, and in any event where the only mechanism for
taking over from a failed server is rebooting a new server to access the
failed server's data (presumably because it's on a SAN where the new server
can easily get to it, via normal file-system-recovery boot-up code that will
at least ensure the structural integrity of the file system on take-over,
though NAS could be used for this as well), you're likely biting off a far
more complex design than is implied by the simple "What kind of storage
should I use?" question you ask.

- bill



  #3  
Old May 20th 04, 12:51 PM
Josh
external usenet poster
 
Posts: n/a
Default

Bill - just wanted to say thanks for the great overview & recommendations!
 




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Recommendations on Upgrading Hard Drive Storage? Cyde Weys General 5 May 15th 04 05:44 PM
Enterprise Storage Management (ESM) FAQ Revision 2004/04/11 - Part 1/1 Will Spencer Storage & Hardrives 0 April 11th 04 07:24 AM
Enterprise Storage Management (ESM) FAQ Revision 2004/02/16 - Part 1/1 Will Spencer Storage & Hardrives 0 February 16th 04 09:23 PM
DVD RW & HDD Storage devices undecided...recommendations?? MT Homebuilt PC's 5 February 8th 04 11:28 PM
Terabyte Storage By Real-Storage Real-Storage Storage & Hardrives 2 October 23rd 03 04:18 PM


All times are GMT +1. The time now is 11:31 AM.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright ©2004-2024 HardwareBanter.
The comments are property of their posters.