I am struggling with processing a huge data set.
I downloaded it from a German geodata site (https://download.geofabrik.de/europe/germany.html). I downloaded the ZIP of Bavaria and clipped the eight layers (landuse, water, traffic, transport, pois, pawf, natural and building) with a vector shapefile which has the boundary shape of Bavaria. Afterwards I merged all the layers together. The total ZIP has 581MB after clipping and merging the layers the final shapefile has around 4,8GB.
Someone has an idea what happend here?
I used QGIS 2.18.18.
My problem in particular is that I want to get the difference of the clipped and merged layer within the boundary Layer of Bavaria to get a new shapefile with all the empty areas but nothing works. Both GIS programs are calculating for hours and in the end I get an error message. I think the dataset is too big but I also tried to use the difference tool with only the smallest layer and the same happens. So it does work with the huge merged/clipped layer and not with the individual layers.
I worked with the Difference Tool on QGIS and with the Erase Tool on ArcGIS, I also tried the Symmetrical Difference Tool on ArcGIS. The problem is that there is no other possibility for me to get the data of open areas on a different way.
Has someone an idea what could solve my problem?
Is my dataset to big to be proceed with QGIS?
I don't think that my laptop is the problem (I have an Lenovo T470 with 8GB RAM, 64bit QGIS and Core i5 of the 7th Gen) because the computers which I can use at the University with ArcGIS are struggling too.
The yellow dots are my open areas which I need to work with and which I tried to cut out with the Difference, Erase or Symmetrical Difference tools.