I have several shapefiles of the entire Amazon rainforest each with millions of polygons (they are fairly detailed and take some time to draw on ArcMap). I need each of these shapefiles to be spatially joined with another shapefile called landuseA (which, itself, is a very big file). Given how computer intensive this task is, I would like to use the multiprocessing module on python to improve performance. How do I do this?
I have read the blog post by Esri on the multiprocessing module, but I cannot figure out how I can use their example to write a script that will use multiple processors to execute a spatial join. Blog post is here: http://blogs.esri.com/esri/arcgis/2012/09/26/distributed-processing-with-arcgis-part-1/
If you have other suggestions for how this task might be better accomplished, feel free to share that too.