I plan on visualising a huge dataset (probably around 20-30GB of data) using Mapbox in order to have a very nice map visualization. However I would like this visualization to be interactive and I am pretty sure that both JS and my browser will not really like such an amount of data, so I wanted to have my data filtering/processing operations conducted with python and the rendering done dynamically with JS and Mapbox. I have seen that there is Python API for Mapbox, but all of the examples I have seen so far of it simply create a geojson dataset once and a html page, but it seems that the rendering code in JS is not dynamically generated. Would you guys know if there is any way to achieve that?

  • You could look at github.com/mapbox/tippecanoe to turn your dataset into Vector Tiles which enables the browser to handle large datasets. – eczajk Sep 13 '18 at 15:20
  • @eczajk does that mean that I will have to upload my data online? I really can't do that, it might be sensitive data – LBes Sep 14 '18 at 12:24
  • You would need to use that tool to convert your GeoJSON to .mbtiles. Then you would need to serve the mbtiles to your application. You can do this by uploading mbtiles to MapBox or use another tile-server. – eczajk Sep 14 '18 at 12:48
  • @eczajk the problem with that solution is that I don't have anything interactive working... It's basically a static rendering that is pre-processed... I would need something that people could filter through (show other dimensions, filter out some years, select only some parts of the data...) – LBes Sep 14 '18 at 13:12
  • @eczajk don't you think that something similar to this is possible? nytimes.com/interactive/2015/07/08/us/census-race-map.html It is interactive and they do have a huge dataset too I suppose – LBes Sep 14 '18 at 14:28

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.