My attempt to extract building footprints from Sentinel-2 images using machine learning algorithm trained on Sentinel-2 images produced a lot of false positives and there is no sign that the algorithm actually learnt anything. When I tried the same architecture on another kind of dataset (MNIST, CIFAR-10), it worked perfectly.

My question is: Does it really make sense to use Sentinel-2 imagery with resolutions 10m for building extraction application?

Red = False Positives; Blue = Labels; Green = True Positives