Skip to main content
edited body
Source Link
Hasan Mustafa
  • 3.3k
  • 1
  • 14
  • 41

I am serving vector tiles using TileStache, I have everything set up like I want. My data is stored in Postgres and I am using the VecTiles provider to serve GeoJSON tiles.

I want to cache all my tiles to make the tiles serve faster. I am using tilestache-seed.py to seed my cache. I am running tilestache-seed on several machines. Tilestache-seed worked really well uptill zoom level 13, but after that it is taking way too long to cache the tiles. Just for Zoom Level 16 I have 5023772 tiles to cache, and I am only getting 100k-200k tiles per day on each machine.

How can I make my tiles cache faster? Is there a way to fine tune tilestache-seed.py and make it seed faster?

Update: I have tried building spatial indexes on my tables (on the geometry column and the columns used for filtering data through the where clause) and I still haven't seen a significant increase in tiling speed. At this rate only Zoom 17 will take me a month and this time will only increase exponentially as I move towards Zoom 21

Update 2: I tried making materialized views as well and there is no discernible change in performance, so optimizing the database is not working. I think I will need to optimize the tilestache-seed.py itself, or devise a new way to cache the tiles.

Hardware Info I am running the caching processes on 8 different PCs, one of which is an i7 with 32gb ram and another is an i3 with 4gb ram but they both give me almost the same caching speed,  (approximately 100k tiles per day)

I am serving vector tiles using TileStache, I have everything set up like I want. My data is stored in Postgres and I am using the VecTiles provider to serve GeoJSON tiles.

I want to cache all my tiles to make the tiles serve faster. I am using tilestache-seed.py to seed my cache. I am running tilestache-seed on several machines. Tilestache-seed worked really well uptill zoom level 13, but after that it is taking way too long to cache the tiles. Just for Zoom Level 16 I have 5023772 tiles to cache, and I am only getting 100k-200k tiles per day on each machine.

How can I make my tiles cache faster? Is there a way to fine tune tilestache-seed.py and make it seed faster?

Update: I have tried building spatial indexes on my tables (on the geometry column and the columns used for filtering data through the where clause) and I still haven't seen a significant increase in tiling speed. At this rate only Zoom 17 will take me a month and this time will only increase exponentially as I move towards Zoom 21

Update 2: I tried making materialized views as well and there is no discernible change in performance, so optimizing the database is not working. I think I will need to optimize the tilestache-seed.py itself, or devise a new way to cache the tiles.

Hardware Info I am running the caching processes on 8 different PCs, one of which is an i7 with 32gb ram and another is an i3 with 4gb ram but they both give me almost the same caching speed,(approximately 100k tiles per day)

I am serving vector tiles using TileStache, I have everything set up like I want. My data is stored in Postgres and I am using the VecTiles provider to serve GeoJSON tiles.

I want to cache all my tiles to make the tiles serve faster. I am using tilestache-seed.py to seed my cache. I am running tilestache-seed on several machines. Tilestache-seed worked really well uptill zoom level 13, but after that it is taking way too long to cache the tiles. Just for Zoom Level 16 I have 5023772 tiles to cache, and I am only getting 100k-200k tiles per day on each machine.

How can I make my tiles cache faster? Is there a way to fine tune tilestache-seed.py and make it seed faster?

Update: I have tried building spatial indexes on my tables (on the geometry column and the columns used for filtering data through the where clause) and I still haven't seen a significant increase in tiling speed. At this rate only Zoom 17 will take me a month and this time will only increase exponentially as I move towards Zoom 21

Update 2: I tried making materialized views as well and there is no discernible change in performance, so optimizing the database is not working. I think I will need to optimize the tilestache-seed.py itself, or devise a new way to cache the tiles.

Hardware Info I am running the caching processes on 8 different PCs, one of which is an i7 with 32gb ram and another is an i3 with 4gb ram but they both give me almost the same caching speed  (approximately 100k tiles per day)

Notice removed Draw attention by Hasan Mustafa
Bounty Ended with Shahzad Bacha's answer chosen by Hasan Mustafa
edited title
Link
Hasan Mustafa
  • 3.3k
  • 1
  • 14
  • 41

Make TileStache cache faster Increase Tiles Caching Speed (TileStache)

edited tags
Link
Hasan Mustafa
  • 3.3k
  • 1
  • 14
  • 41
added 258 characters in body
Source Link
Hasan Mustafa
  • 3.3k
  • 1
  • 14
  • 41
Loading
Tweeted twitter.com/StackGIS/status/730050954259795968
deleted 307 characters in body
Source Link
Hasan Mustafa
  • 3.3k
  • 1
  • 14
  • 41
Loading
added 235 characters in body
Source Link
Hasan Mustafa
  • 3.3k
  • 1
  • 14
  • 41
Loading
Notice added Draw attention by Hasan Mustafa
Bounty Started worth 100 reputation by Hasan Mustafa
added 338 characters in body
Source Link
Hasan Mustafa
  • 3.3k
  • 1
  • 14
  • 41
Loading
added 15 characters in body
Source Link
Hasan Mustafa
  • 3.3k
  • 1
  • 14
  • 41
Loading
deleted 4 characters in body
Source Link
Hasan Mustafa
  • 3.3k
  • 1
  • 14
  • 41
Loading
deleted 4 characters in body
Source Link
Hasan Mustafa
  • 3.3k
  • 1
  • 14
  • 41
Loading
Source Link
Hasan Mustafa
  • 3.3k
  • 1
  • 14
  • 41
Loading