I have to publish 100 GB of data to a web portal in 2 or 3 layers using open source technologies.

The data comes from ArcGIS and are polygon features. So, I can save/export the data to any ArcGIS supported format.

I am thinking:

  • Bring the data from ArcGIS in .shp format, so there would be multiple shape files for each layer.
  • Use Geoserver to publish the vector data to WMS format
  • Use WMS in Leaflet to add the data to map

As I have 100GB of data, can the web map be fast enough to zoom and pan and search?

Is there any better way to do my task?

  • the .dbf part of a shapefile has a limit of 2gb... desktop.arcgis.com/en/arcmap/latest/manage-data/shapefiles/….
    – Mapperz
    Jun 16, 2021 at 16:28
  • 1
    Please provide more informations (like the use case and constraints, what do you mean by "a portal", ...) in it's current state your question is unanswerable (@Mapperz I think that mean they have at least 50 shapefile...)
    – J.R
    Jun 16, 2021 at 16:37
  • 1
    Also unclear is whether you mean Esri's ArcGIS Enterprise Portal or some other portal.
    – Vince
    Jun 16, 2021 at 17:09
  • I have updated the question. Please open it. Jun 17, 2021 at 3:35
  • The "2-3 layers" and 100GB of shapefile don't sync up. It would take at least 50 shapefile layers to store that much data.
    – Vince
    Jun 17, 2021 at 3:43

1 Answer 1


GeoServer will have no problem displaying the data, speed mostly depends on how you store the data, the best option is usually a well designed and indexed PostGIS database table.

If you need more speed (or just want to save cpu cycles) you can use GeoWebCache (built in to GeoServer) to cache the map tiles that are being requested by clients so they only need be drawn once.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.