Take the 2-minute tour ×
Geographic Information Systems Stack Exchange is a question and answer site for cartographers, geographers and GIS professionals. It's 100% free, no registration required.

I am trying to create seamless topomap WMS or TMS layer that covers the entire US (not interested in geo-pdfs). To do that, I need either the rasters (geo-tiffs, etc) or preferably vectors (whatever vector format readable by ArcGIS or GDAL/OGR) that are used to generate those maps - and I want to download it them in bulk (without having to click through one thousand interfaces to get each 1 degree quad).

Hard drive disk space is not an issue

Any link? :)

Update: this is what the terraserver images look like and hence my preference for the vector data.

terraserver tile

The TopoOSM layer generation looks promising, Topo OSM layer

but it seems the data for the entire US is not available from one location.

share|improve this question
    
It appears that the wms used by Microsoft's Terraserver is available through terraservice.net. –  jvangeld Apr 26 '11 at 18:11
    
I can't bulk download from them, just use their service –  Ragi Yaser Burhum Apr 26 '11 at 18:53
    
Perhaps see wiki.openstreetmap.org/wiki/Downloading_data for nabbing OSM data in larger pieces, and then of course the TopoOSM page you reference for a workflow. –  matt wilkie Apr 26 '11 at 20:25
    
I have all of OSM already and I do a daily sync. But it doesn't contain vector contours nor hydrography. I can generate contours from the NED data you pointed me to (if I scrape it), but I still have to find hydrography –  Ragi Yaser Burhum Apr 26 '11 at 20:46
    
The National Map website has several hydrography datasets. nationalmap.gov/viewers.html –  jvangeld Apr 26 '11 at 20:48

4 Answers 4

up vote 5 down vote accepted

What about the FREE 24K geotiff DRGs available through the Libre Map Project? All 24K DRGs for all 50 states are available there. They are collared, but I had access to GlobalMapper, which has a nice function that removes collars easily (and surely there are other ways to deal with those). They are filed nicely on the server at the Internet Archive and the Python script below, in conjunction with wget, fetches tons of 'em quickly and easily:

import os, shutil, string, time 

#  This script fetches raster images (DRGs) from the web using an os.system call to wget
#  The directory of states is at:  http://libremap.org/data/
#
#  Process:
#    For each 24K quad in the list, it gets both 
#    the tif, tfw, and fgd (metadata), then moves them to new home. Moves on to next image in list
#    Data is actually stored at the internet archive, with a URI like so:
#        http://www.archive.org/download/usgs_drg_ar_35094_a2/o35094a2.tif

wgetDir = 'C:/Program Files/wget/o'
list = [['32094f5','HARLETON','TX'],
        ['32094f6','ASHLAND','TX'],
        ['32094f7','GLENWOOD','TX'],
        ['32094f8','GILMER','TX']]
exts = ['tif', 'tfw', 'fgd']
url = 'http://www.archive.org/download/'
home = '//share/Imagery/EastTexas/TOPOs/24k/'
# List of images we want to fetch
images = list

if __name__ == '__main__':

    for image in images:
        for ext in exts:
            # Piece together out image/world file URI, so it looks like so:
            #    http://www.archive.org/download/usgs_drg_ar_35094_a2/o35094a2.tif
            fullurl = url + 'usgs_drg_' + image[2].lower() + '_' + image[0][:5] + '_' + image[0][5:] + '/o' + image[0] + '.' + ext
            # Get to wget thru an os.system call
            os.system('wget %s' % (fullurl))
            # Move the file to where we want it to live, with a descriptive filename, as in:
            #    AR_PRAIRIE_GROVE_o35094h3.tif
            shutil.move(wgetDir + image[0] + '.' + ext, 
            home + string.upper(image[2]) + '_' + string.replace(image[1], ' ', '_') + '_' + 'o' + image[0] + '.' + ext)

I usually build the list of input quads by selecting the quads I want from a 24K topo vector footprint in ArcMap, exporting out the records to a dbf (or better yet directly to Excel with XTools), then in Excel, build the list by concatenating the fields of interest together, something like:

="['" & quad_id & "','" & quad_name & "','" & state & "'],"

I then copy the list of lists into my script or a external module and call it from there. Maybe not the most elegant method, but it works nicely. HTH.

share|improve this answer
    
+1 for free nationwide DRG's. I had been downloading state-by-state from various universities. –  jvangeld Apr 27 '11 at 17:03
    
Thank Jared Benedict and these people for freeing the DRGs. –  Chad Cooper Apr 27 '11 at 17:49
    
Excellent answer. Thanks! –  Ragi Yaser Burhum Apr 27 '11 at 19:31

I don't know if it still works, but a couple of years ago I hacked together a method for downloading the US Seamless National Elevation Dataset in bulk that might work for topo raster maps too.

To bypass the map viewer put the coords on the URL like so:

http://extract.cr.usgs.gov/Website/distreq/RequestSummary.jsp?AL=71.0,56.0,-140.0,-150.0&PL=NAK01HZ

where this is your region of interest north,south and east,west in decimal degrees.

AL=71.0,56.0,-140.0,-150.0

and this is data set to choose from, in this case “National Elevation Dataset Alaska (NED) 2 Arc Second”

PL=NAK01HZ

If you use this technique, please be gentle. It’s not in our interests to force them to take protective measures and close this avenue.

Also don't overlook snail mail, it's high latency but has almost limitless bandwidth:

With regard to ordering the regional CD’s:

“You can order the entire U.S. in 30 meter resolution in either ArcGrid or GridFloat format. The data will be provided on a 250 GB external drive at a total price of $1005.00. This includes shipping and handling. This will cover the Conterminous U.S., Alaska (at 60 meter res), Hawaii, and the territorial islands. We no longer provide this on CD or DVD media.”

An incredibly good price in my opinion.

The contact address is webmapping@usgs.gov

Customer Service/Webmapping

Data and Applications Support
Department Science Applications
International Corporation (SAIC) at
U.S. Geological Survey - EROS (Earth Resources Observation and Science)
47914 252nd Street Sioux Falls, SD
57198-0001

Phone: 1-800-252-4547
Fax: (605)-594-6589

share|improve this answer
    
This is so sweet. Although it doesn't answer the question 100%, I have to upvote you for the coolness. –  Ragi Yaser Burhum Apr 26 '11 at 20:18
    
I wish I could give two answers points. Thank you again –  Ragi Yaser Burhum Apr 27 '11 at 19:32
    
@ak112358 has posted a revised process using essentially the same method at Programmatically download (seamless) NED tiles? –  matt wilkie Oct 17 '13 at 17:22

Do you really want to build your own or can you just use one that already exists?

WMS Feed: http://terraservice.net/ogccapabilities.ashx

share|improve this answer
    
I need transparency and terraserver only offers jpgs. And yes, I am crazy enough that I want to create my own so that I don't have to rely on terraserver's latency. Another issue is that I am building this for an offline mobile app, so I may get throttled by terraserver. –  Ragi Yaser Burhum Apr 26 '11 at 18:38
    
Thanks anyway :) –  Ragi Yaser Burhum Apr 26 '11 at 18:52

found here. http://cumulus.cr.usgs.gov/bulk.php not for download. Another great bandwidth option.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.