We have about 2.5 terabytes of data we must store online at all times. The
bulk of our data is event data and it is written to tape immediately and
then parts are loaded in later on non-backed up filesystems for analysis.
So, no, we aren't at that capacity in one place, and we've never done a
migration/verification of that size.
I just went through some migrations from our ntfs Win2k file server to an
EMC Celerra (RedHat kernel, I think). I had trouble with ownership of
files, when/if the owner no longer existed. This, however, shouldn't be a
problem for you, if you are going Win2k to Win2k. You may want to check it
out. I did some fairly small chunks (100GB at a time) and verified with the
WinDiff utility that is part of the Win2k Deployment Tools (I think??).
National Superconducting Cyclotron Laboratory
Michigan State University
----- Original Message -----
From: "Cameron Ramo Williams" <[log in to unmask]>
To: <[log in to unmask]>
Sent: Tuesday, December 16, 2003 2:40 PM
Subject: Question about copying large amounts of data
> Hi NAG members
> I'm the sysadmin for the Center for Global Change and Earth Observations
> here on campus. Our Center currently houses approximately 5 Terabytes of
> imagery data on two Dell PowerVault NAS systems. Recently I have been
> to copy all of this data over to a second NAS array temporarily because
> current array (including the drives in the vaults) needs servicing. I
> pull the drives during the servicing and I have only about a 2 week time
> window to get the entire dataset copied and verified on the "mirror"
> What I want to do is basically copy the entire dataset, maintaining
> ownerships/permissions, and verify the copied files are the same as the
> originals. The files are stored on an NTFS file system and the NAS is
> running Windows 2000 Advanced Server. Obviously with this amount of data
> can't stream it all off to tape and reload it given the speed of streaming
> to tape and the sheer number of tapes I would have to have on hand to
> close to 5 TB. I was wondering if anyone here on campus has done similar
> copying/verification on a comparable sized datawarehouse, or at least has
> idea of what the best way to proceed in copying it all over to the second
> NAS with ownership and permissions intact. If you have any suggestions,
> me know.
> Also, just for my own knowledge here on campus, are there many other
> departments here that have datasets of a comparable size? The Library
> perhaps, or the Cyclotron lab?
> Thanks for any ideas you can suggest!
> Cameron R. Williams
> Information Technologist
> Center for Global Change and Earth Observations
> Michigan State University
> 101 Manly Miles
> East Lansing, MI 48825
> (517) 432-4675
> [log in to unmask]