[BBLISA] Fwd: Moving 100 GB and 1.3 million files
Robert Keyes
bob at sinister.com
Thu Jul 22 15:35:49 EDT 2010
One thing you might want to do is to keep from modifying the atime on the
source files. Perhaps mounting the source volume as read-only could do it,
but that might not be feasible. AFAIK, the Linux EXT filesystem is very
slow in deleting files, so perhaps copying them all first and then
deleting the originals later might work. Maybe someone mentioned that
already.
I have copied some filesystems considerably larger than 100GB, but maybe
not with 1.3 million files, and it's not taken days. Perhaps several
hours. And this not with fast machines, either.
Maybe, for the future, some of the applications that create a bunch of
small files can be made to create them under a tree that is a filesystem
inside a file on another filesystem. Then, you just unmount the inner
filesystem and copy it from the master filesystem to a filesystem on a new
device or machine, and then remount it. So you're not actually making new
inodes and directories when you copy.
More information about the bblisa
mailing list