I have a large number (100,000+) of raster files I need to process in QGIS (exporting to tiff, clipping to polygon layers, etc), for a total of approx 500GB. Can anyone advise if there's some way of handling these within QGIS (a raster GDB?)? Can to stretch into code if needs be, but would prefer a simple solution using embedded tools / plugins if possible. I've used batch processing tools but some of the larger sub folders have 9000 files and I'm having problems loading them into the batch processing window.
Currently height (DSM) .asc files, UK coverage but patchy. Would prefer to work within QGIS as I'm more familiar with it, but would consider any open source / free toolset.