I have a GeoDataFrame with 1,2M records, and want to write it into a GeoPackage file. Currently, it takes >20 minutes, and, as I calculated, average write speed is 100 recs/sec.
As I read in the comments, the problem is that Fiona frequently locks and unlocks the sqlite database of GeoPackage.
Is there a way to improve write performance?
- building Fiona on the machine?
- opening the file in a specific mode?
- setting environment parameters for Fiona & GDAL?
QGIS writes the same amount of records about 10 times faster, I'd be happy to see a similar improvement.
My OS is Ubuntu 18.04, but I also have a 18.10 one.