Merge multiple layers in different folder

Question

I am working with Korean topo map layers. They are 1:1000 scale and divided by each map section.

they are also stored in different folder.

Since a layer shows road has same name (e.g., a0010000_polygon.shp), i added the district name as a prefix (e.g., 376120547_blah blah_..._a0010000_polygon.shp)

Here is the problem. now, i need to merge each layers that have same suffix (i.e., merging all layers that ends with a0010000_polygon.shp in each folder) to make one large big huge layer

What i did is, iterate thru all the folder and using wildcard and make feature layer (add to the TOC). Then, drag the layers to merge toolbox..

there are at least 180 layers in each folder, and doing 180 times of this is kinda crazy.

Are there better way to solve this issue?

---

I came up with this model ... (using collect value) but still i need to adjust wildcard to iterate thru layers have same suffix :(

---

Oct. 16, 2016 I add this comment

my final (?) model looks like this. (it ain't final until it really works) what i did is that i create a table that contains all possible layers (See 'library' field)

then i iterated thru the table row and get the row value and put that in my model.. so that it merges all layers that have same name

the problem is that the shape layers in a folder doesn't have all layers in the library table (e.g., the library has all possible layers, which is 108. but shape layers in a folder has only 40 or sometimes 60) and therefore, it returns merging error lol

so i was thinking about using try / except python script and put that in a model check this --> [http://resources.esri.com/help/9.3/arcgisdesktop/com/gp_toolref/automating_your_work_with_models/branching_colon_implementing_if_then_else_logic.htm][5]

spent almost a week to solve this issue with modelbuilder and it has some limit i think. I will come up with better idea if i can. (so far the best way / easiest way is insert arcpy script try/except) but if there is anybody who knows more precise and elegance way to solve this, please share with us.

---

after i tried 'dru87''s code, i finished the work. I typed line by line into the console and run and it only returned the last string in the list.

instead, you must copy and paste the entire code and run it (of course, you need to change the workspace and stringSearch)

awesome. and nice. still i have the modelbuilder here and i prefer modelbuilder because i suck at python and if anybody can improve the model, please let me know!

Answer 1

As PolyGeo already suggested, using ModelBuilder for such a task is a bit messy. I had similar problems before, which I solved using arcpy. I adapted my script to your needs - try using this code in your command window in ArcCatalog (after setting your paths and search strings of course):

import arcpy, os

## 1. Set work environment and search string for shapefiles
workspace = r"C:\Users\sutter\Desktop\GIS_temp\stack_test"
## Put all your searchStrings in this list, separated by commas
searchStrings = ["*prefix*", "*.shp", "*stringXY*"]
outnameOmit = "*"


arcpy.env.workspace = workspace
arcpy.env.scratchworkspace = workspace
arcpy.env.overwriteOutput = True

for string in searchStrings:
    ## 2. Search workspace and subdirectories for feature classes that contain the search string and put them into a list called listShps:
    listShps = []
    for path, subdirs, files in os.walk(workspace):
        arcpy.env.workspace = path
        files = arcpy.ListFeatureClasses(string)
        for fc in files:
            listShps.append(os.path.join(path, fc))
    arcpy.env.workspace = workspace


    ## 3. Get feedback of how many feature classes were found:
    print u"A total number of {0} shapefiles with the search string {1} were found and added to the processing list".format(len(listShps), string)


    ## 4. Process the listed shapefiles:
    if listShps:
        for char in outnameOmit: string = string.replace(char, "")
        outName = u"{0}".format(string)
        outShp = u"{0}\{1}_merged.shp".format(workspace, outName)
        arcpy.Merge_management(listShps, outShp)
        print u"Merge for {0} complete.".format(string)
    else:
        print(u"No shapefiles match the search string {0}, merge operation skipped.".format(string))

print(u"All search strings processed. Script finished successfully.")

Let me know if this wasn't what you're looking for.