- Vectorize your raster with Raster>Conversion>Polygonize.
- Then use the filed calculator and create a new field area: Function Geometry > $area
- Afterwards you can filter out the small polygons (right click on vector layer)
- Save the filtered layer to another vector layer.
- Rasterize the filtered vector layer (Raster>Conversion>Rasterize)