[BBLISA] Fwd: Moving 100 GB and 1.3 million files

[Jeff Wasilko]

On Thu, Jul 22, 2010 at 01:25:37PM -0400, Ian Stokes-Rees wrote:
> Moving blocks of ~300k files totaling about 5-10 GB takes hours to
> complete.  Yesterday afternoon I started a move of 1.3 million files
> totaling about 94 GB.  20 hours later the transfer seems to be less than
> half done.
> 
> 
> 
> More details, for those who are interested:
> 
> The files at the origin are on RAID1 SATA disks (1 TB, ext3, Seagate
> Barracuda 7200 RPM), and I have a ganglia snapshot of the 24 hour status
> (you can see the start of the transfer about 20 hours ago):
> 
> http://dl.dropbox.com/u/1561496/shared/abitibi-origin.pdf
> 
> The destination is an Apple X-RAID array (4TB) connected to an Apple
> XServe.  The corresponding ganglia snapshot is here:
> 
> http://dl.dropbox.com/u/1561496/shared/macintel-destination.pdf

The network is not your bottleneck.

File creates (which require directory updates) are synchronous
operations, which means they have to hit the disk before proceeding.

What RAID level is your X-Raid? What filesystem are you using on the
destination?