Take the 2-minute tour ×
Geographic Information Systems Stack Exchange is a question and answer site for cartographers, geographers and GIS professionals. It's 100% free, no registration required.

We're still running ArcGIS 9.3.1 for a short while longer, and have been tiling more of our data, which is great until we have to deploy it. Deploying currently consists of transferring the entirety of the tileset to the production machines, which takes about half of forever, especially on a deadline. We're currently using tar.gz, but would welcome a better approach. Tiling in place is not an option as there is not a "spare" server at the production facility.

Edit: I should mention that the destination server is a long way away, and behind a firewall, meaning that our access to it is limited, and mapping a drive or a share is Right Out. I'd be tempted to use external drives and FedEx, but that would require a physical person at the destination, which tends not to be the case for months at a time.

share|improve this question
    
Love to see an answer to this. We've got one service (for example) that has over 3M files (613MB, 11.5GB on disk); it just takes a long time to copy that many files. –  Michael Todd Nov 10 '10 at 20:16
    
It's crazy to not make an archive, but zip won't usually deal with that many files. Tar is pretty standard, but I was seriously hoping for a better solution. OTOH, we're migrating to 10, which makes a lot fewer files for a tileset. –  Herb Nov 11 '10 at 22:29
add comment

3 Answers

Maybe try RichCopy? I haven't moved tile caches with it, but I've used it with a few big file geodatabases. You can set the thread count and specify various checks for the copy.

http://technet.microsoft.com/en-gb/magazine/2009.04.utilityspotlight.aspx alt text

share|improve this answer
1  
Also, you can use command line arguments. You can also use the GUI initially to create the command line args and copy/paste them to your batch file. –  Jay Cummins Nov 10 '10 at 20:30
add comment

How about xcopy?

share|improve this answer
    
That's also extremely slow. From experience. –  Michael Todd Nov 10 '10 at 20:08
    
and use it with a .bat file with task scheduler for overnight (out of office time) for optimum speed in transfer across WAN/LAN etc. –  Mapperz Nov 10 '10 at 20:09
1  
or "robocopy" if you've got it. –  mwalker Nov 10 '10 at 20:29
add comment

jzip and ftp (filezilla)

share|improve this answer
    
Never heard of jzip...how's it compare to 7zip? –  Derek Swingley Nov 10 '10 at 20:16
    
How is it different from other compression utilities? jZip is built on proven and reliable 7-Zip technology. 7-Zip technology is fast and achieves compression ratios that are higher or equivalent to other leading compression programs. jZip differs from applications like WinZip when it comes to cost. jZip is FREE and we plan to keep it free for both home and enterprise users. We believe that the ability to create and open archive files should be free and available to all. –  Mapperz Nov 10 '10 at 20:28
    
so it is 7zip but seems more user friendly. –  Mapperz Nov 10 '10 at 20:29
1  
Thanks. I think I'll stick with 7zip's context menu. –  Derek Swingley Nov 10 '10 at 21:12
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.