David Markley » massive number of files http://www.davidmarkley.com Official Website of Me Wed, 01 Sep 2010 16:58:51 +0000 en hourly 1 http://wordpress.org/?v= Moving users to Isilon http://www.davidmarkley.com/isilon/moving-users-to-isilon http://www.davidmarkley.com/isilon/moving-users-to-isilon#comments Mon, 17 Mar 2008 20:46:49 +0000 David http://www.davidmarkley.com/uncategorized/moving-users-to-isilon Today at work is mainly dedicated for me to be moving over users to the Isilon clustered disk storage system.

There are many user accounts, and we’ve gotten all the small birds moved. Now, we have some massive (over 100GB) accounts to be moved. I’m working with GigE networks, so normally >100GB would not be a big deal.

However, the folder/file counts are huge. For a 200GB account, it typically ranges from 1-1.5 MILLION files. That’s right, MILLION. So, because of lovely indexing(going from an iSCSI NTFS NAS to a IFS Isilon Cluster) it takes a while to get things going. Once the copy is started, it starts moving along at a decent clip, but the time it takes to initially index the machine is what slows me down so much.

Very Slow Copying

If anyone knows a way to copy the data without the need for indexing every single file/folder, let me know please!

And that’s all for Moving users to Isilon

]]> http://www.davidmarkley.com/isilon/moving-users-to-isilon/feed 0