Questions tagged [pbf]
PBF Format ("Protocolbuffer Binary Format") is primarily intended as an alternative to the XML format.
77
questions
1
vote
1
answer
86
views
"Bad allocation" error when importing a large PBF file (OpenStreetMap) on PostgreSQL with osm2pgsql
I downloaded the 72 GB OpenStreetMap PBF file (planet-230619.osm.pbf) at this link https://planet.osm-hr.org/pbf/ and I am trying to import it into PostgreSQL + PostGIS with the library osm2pgsql ...
- 139
1
vote
0
answers
51
views
Convert downloaded mvt/pbf to new mbtiles file
I'm trying to do the following:
Determine what pbf files are needed for a certain user-defined bbox (DONE)
Download these files for all zoomlevels. (DONE)
Combine these pbf files into a new mbtiles ...
- 11
0
votes
2
answers
70
views
ogr2ogr cannot open datasource ogrinfo can open
I've got a random .osm.pbf from Geofabrik which I'm trying to extract a small region of:
$ ogr2ogr -f OSM -spat 7 48 8 49 data/osm/extract.osm.pbf data/osm/germany-latest.osm.pbf
ERROR 1: OSM driver ...
- 113
0
votes
0
answers
47
views
How to create mbtiles from pbf which will be compatible with TileServer GL?
I am new to GIS and trying to figure everything out. Right now my goal is to understand how to create an mbtiles vector file that can be served with TileServer GL. I have downloaded the free 2020 ...
1
vote
1
answer
50
views
Selecting layer for processing
I am currently trying to export a map as PBF vector tiles (Google Protocol Buffers (protobuf) details: https://protobuf.dev/ ) but I can't find a way to select the current layer in the toolbox (about ...
- 11
0
votes
0
answers
138
views
Converting OSM or PBF file to shapefile
I'm trying to get some OpenStreetMap data into the ESRI ecosystem. I've been using geofabrik.de to download the data. I tried using QGIS to convert, but it must have a field or size limit, because it ...
1
vote
0
answers
504
views
Write GeoPandas data into osm.pbf file using Python
I have sample nodes, edges data like below. I am using ElementTree to write the data into .osm file and then trying to convert into .osm.pbf using osmosis but when trying to convert from .osm to .osm....
- 145
0
votes
0
answers
90
views
How to create geometries with multiple outer polygons in mosaic
I am using Databricks Mosaic, where I am parsing an OSM PBF file and trying to convert it into spatial geom types [line, point, polygon, etc.]. I am able to process the relation having one outer ...
1
vote
1
answer
295
views
ogr2ogr conversion from pbf to mapbox mvt
I have downloaded traffic data from TomTom API which has come in the format https://api.tomtom.com/traffic/map/4/tile/flow/relative0/12/1207/1539.pbf?tileSize=256&key=*****
The PBF format is ...
1
vote
0
answers
119
views
Using GDAL to convert PBF to MVT for use in Mapbox
Is it possible to convert PBF file formats to MVT so that I can correctly view them on Mapbox using GDAL?
originally looked at ogr2ogr but that returned this message which I don't quite understand ...
- 21
2
votes
0
answers
78
views
Open Trip Planner doesn't seem to be accounting for turn restrictions - editing local OSM pbfs for scenario planning
We've been attempting to use Open Trip Planner (1.5) to test the impact of various street-network scenarios that include new ways, traffic filtering and vehicle turning restrictions. We are manually ...
0
votes
0
answers
140
views
Export QGIS project a PBF
I'm trying to export a QGIS project as a osm.pbf file to serve it later with this repo.
I've read this question but it has no answers.
Any clue?
- 1
1
vote
0
answers
147
views
Compact pbf vector tiles back to bundles from exploded vtpk
There is a great method available in ArcGIS Pro (ArcPy) arcpy.management.ExtractPackage to extract vtpk package including exploding bundle files Esri uses to pack standard pbf vector tiles together ...
- 9,566
1
vote
0
answers
64
views
OSMOSIS syntax for extracting buildings out of country.pbf via .polyfile
I am new to osmosis and osmfilter did not work with my .poly file. I do not get the syntax working. I like to extract all buildings within a poly file.
I tried just for all objects
C:\Program Files (...
- 529
2
votes
1
answer
104
views
OGR_INTERLEAVED_READING error with gdal_rasterize
I've been trying to rasterize big PBF (1.2GB) file using gdal_rasterize and got this error:
ERROR 1: Too many features have accumulated in lines layer. Use the OGR_INTERLEAVED_READING=YES ...
- 21
0
votes
1
answer
92
views
Osm2pgsql data dump in specific schema not working
While using osm2pgsql 1.6 i am trying to dump PBF into specific schema of postgres DB using following commands using docker. (i am setting database properties in docker env)
docker run -v /mnt/ne-...
- 1
0
votes
1
answer
153
views
Get coordinates of .pbf/.osm of ways and relations directly?
Is there a tool for pbf or osm files so that I can see the coordinates of ways and relations directly? Currently ways have only references to nodes. So if I want to have the coordinates of a way, I ...
- 85
2
votes
0
answers
266
views
How to configure Mapbox Vector Tiles (pbf files) cache in NGINX
I am using a Geoserver to serve Vector Tiles which are used by Mapbox JS Clients. To reduce the requests to the Geoserver I want to implement a caching functionality.
As webserver I use a NGINX. I ...
- 41
3
votes
1
answer
675
views
Applying filter on local OSM PBF file
Because I sometimes need to work without an internet connection, I use OpenStreetMap data by downloading regional data from https://download.geofabrik.de/ as "Australia_latest.osm.pbf", then ...
- 1,339
1
vote
1
answer
81
views
Finding the n farthest points from any man-made structure within a country
I am trying to find the farthest points from any man-made structure in Denmark.
I have acquired an OpenStreetMap data extract of Denmark from this page, in PBF format.
How do I compute a number of ...
- 19
0
votes
1
answer
299
views
Protecting Vector Tile Server Data
I am deploying a Vector Tile Server on AWS with data I don't want to make publicly available and there are two main elements I want to cover regarding the security of the data
The tile server needs ...
- 13
1
vote
0
answers
248
views
Sending vector tile PBF content as response from HTTP Azure function
I wrote Azure function (based on HTTP trigger) and need to return vector tile PBF as response.
I used following piece of C# code to send response from Azure function
return new FileContentResult(...
- 111
2
votes
0
answers
214
views
osmosis --used-node keyword does not grab all relevant nodes
I am trying to filter an osm.pbf file using osmosis. The following is my filter:
osmosis
--read-pbf-fast metadata-unfiltered.osm.pbf workers=8
--tf accept-ways <placeholder>
--tf reject-...
- 143
3
votes
1
answer
224
views
Can use not existing level tiles with Leaflet with maxNativeZoom, but the lines are fuzzy
Recently I have deployed WMTS with GeoServer, using MVT (PBF) format tiles.
I use Leaflet JS parsing PBF tiles.
Layer displaying and interactions are normal.
I have generated level 1-13 tiles ...
- 33
2
votes
0
answers
261
views
Exporting multiple shapefiles as vector tiles with PBF schema
I work in QGIS and I have to export 2000 shapefiles to vector-tiles with PBF schema.
I have one shape with all the geometries in a single layer and I also export them independently within the same ...
0
votes
1
answer
335
views
Generating PBF files on request similar to renderd/mod_tile PNG tiles [closed]
I am trying to build my own fantasy map with history information. I am running the website fork of OSM from https://www.openhistoricalmap.org/. I got the site running but the default layer is ...
- 99
2
votes
1
answer
620
views
Using ArcGIS Online PBF from FeatureServer in Leaflet
I'm looking for a way to use the PBF format from an ArcGIS Online FeatureServer in Leaflet.
There are lots of examples using L.vectorGrid.protobuf with URLs for PBF tiles structured like {z}/{x}/{y}....
- 121
1
vote
0
answers
214
views
Deploy OSM vector tiles in GeoServer
I'm playing around a bit with Mapbox Vector Tiles as part of my bachelor thesis and would like to deploy them via a local server.
Setup (realized with DOCKER):
PostGIS DB --> OSM data
Geoserver ...
- 61
2
votes
1
answer
958
views
Converting PBF to GeoJSON using python3-gdal module
How can I use the module python3-gdal to convert .pbf into .geojson using Python?
I've been exploring ogr in python3-gdal module but I can't figure out how to make it work.
I do a request, the ...
- 335
2
votes
2
answers
1k
views
Changing layer order of vector tile layer
I am creating a simple web map using vector tiles of type pbf.
The vector tiles are created with tippecanoe like:
tippecanoe -pC -P -z 19 -Z 15 -e builds --drop-densest-as-needed --extend-zooms-if-...
- 2,608
3
votes
2
answers
3k
views
Loading PBF vector tile data in QGIS
Is it possible to load the services in https://staging.gcm.telstra.com.au/gisserver/rest/services/Hosted into QGIS.
I have tried a Virtual Layer, Vector Tile and ArcGIS Map/Feature service with no ...
- 7,958
2
votes
1
answer
495
views
Serving pbf tiles with nginx
I have a folder structure /foo/bar/baz/static/tiles/{z}/{x}/{y}.pbf containing many tiles according to a z/x/y file structure.
With /foo/bar/baz/ containing an index.html and a style.json.
I have this ...
- 9,546
0
votes
0
answers
627
views
Fetching GeoServer vector tiles in Mapbox GL is slow
I want to create a basemap with Mapbox GL and GeoServer and PostGIS (to store layers). I use GeoServer 2.18 and the latest version of Mapbox GL. There are about 20 layers in PostGIS. One layer is the ...
- 5,825
3
votes
0
answers
748
views
How to generate more pbf zoom levels with mbtiles file?
I have a 8GB canada.mbtiles vector file which contains all of Canada up to zoom level 14.
How do I generate zoom 15,16 from this canada.mbtiles file? The goal is to serve smaller pbf on z15,16 for a ...
- 131
1
vote
1
answer
77
views
Control visibility of specific fields of a PBF file
I downloaded a PBF file from GeoFabrik (OpenstreetMap data) and loaded it into QGIS 3.14.
It gives me each a layer for lines, multilinestrings, multipolygons, points and another one called "other ...
- 185
3
votes
1
answer
604
views
Filter (query) OSM .pbf file in QGIS graphical modeler or Python (QuickOSM or related tools)
I would like to automate a simple operation in the QGIS graphical modeler or a simple Python script.
add all line features from a .pbf file
filter all features with certain values within a certain ...
- 271
2
votes
1
answer
551
views
CSV to Vector Tiles: Encoding polygons in Tippecanoe (or some other software)
I want to generate .pdf vector tiles from polygon features. From what I've found out, tippecanoe seems to be the way to go. Like so (found here):
tippecanoe --no-feature-limit --no-tile-size-limit --...
- 323
1
vote
1
answer
200
views
Compute area coverage density estimate from very large polygon dataset
I am trying to come up with a pipeline for turning very large OSM PBF files (eg buildings layer for a whole country: ~100M polygons) into a more manageable density estimate (with arbitrary precision).
...
- 132
2
votes
1
answer
2k
views
Fast way to extract bounding boxes from OSM PBF data…
Is there an efficient way to convert a set of node/relations in a PBF file, to the bounding boxes for each polygon, without going through a conversion to another GIS format?
Right now, my pipeline ...
- 132
2
votes
1
answer
354
views
Union MVT features based on attribute / id in OpenLayers render
Following Paul Ramsey's article about ST_Subdivide I was able to split the Natural Earth boundaries dataset. Generating tiles which intersect the boundaries of Canada and Russia on the fly is now ...
- 2,257
3
votes
1
answer
681
views
Displaying Telstra Vector Tile Server data in QGIS 3.14.16-Pi
I am running QGIS 3.14.16-Pi and am wanting to load the layers Telstra (Australian telephone company) provides on their GIS server.
https://staging.gcm.telstra.com.au/gisserver/rest/services/Hosted/
I ...
- 31
2
votes
0
answers
2k
views
From osm.pbf data to mbtiles (pbf vector tiles inside a sqlite3 container)?
I need to experiment with vector tiles based on OSM data.
To do that, I've downloaded an OSM *.osm.pbf data file from geofabrik.de.
I want now to store these data either as the standard /tileset/{Z}/{...
- 9,546
2
votes
1
answer
999
views
Convert a mbtiles tileset folder into a single .mbtiles SQLite file?
I have a root tileset folder structured with the standard tiling scheme /tileset/{Z}/{X}/{Y}.pbf.
When I try using GDAL, I think I miss something:
$ ogr2ogr -f MVT sqlite.mbtiles ./tileset
FAILURE:
...
- 9,546
0
votes
1
answer
1k
views
Using .pbf Vector Tiles generated with t-rex with OpenLayers errors with "Uncaught Error: Unimplemented type: 7"
I generated .pbf vector tiles with t-rex's generate command.
I then uploaded them to a directory served with the Apache HTTP server.
Trying to use the tiles with OpenLayers (6.4.3) resulted in no ...
- 10.2k
3
votes
0
answers
2k
views
How can I extract street information from an osm.pbf file to Excel?
I'm working on a project where I have to get all the streets of the city where I live, including colony, suburb, postal code, but I am a little confused about what process do I have to follow.
I have ...
- 31
0
votes
0
answers
100
views
Standalone GeoWebCache drop some parts of features in tiles
I have a local GeoServer with standalone GeoWebCache to serve vector tiles in PBF file format. The layer displays country borders in the world but the problem is in different tiles some parts of ...
- 75
0
votes
1
answer
646
views
Is there a way to obtain polyline of pbf file?
I need to find boundaries of pbf file. Ideally - polyline, if this not possible - can be simple(min,max lat,lon rectangle). I download pbf from geofabrik(http://download.geofabrik.de/russia/...
1
vote
0
answers
213
views
How to include a Mapbox Studio Tileset in Leaflet?
I would like to include in my Leaflet map a vector tile set that I uploaded to Mapbox Studio. I first uploaded a tileset to the tiles page of Mapbox studio. Then I created a new style and added my ...
- 423
2
votes
1
answer
1k
views
Create columns for specific "other tags" of OSM PBF files in QGIS
When downloading PBF files of Openstreetmap via Geofabrik, the file contains a field called "other_tags" which includes all the OSM tags for this feature. It is a String field and looks like "cycleway"...
- 32.6k
0
votes
1
answer
397
views
Strange coordinate after use tippecanoe and Mapbox/pbf
I am trying to make vector tile base on Mapbox pbf standard.
First, convert data from EPSG4326 to EPSG3857 and export as .json.
By using QGIS to export data and set CRS as EPSG3857.
Second, use ...
