A variogram makes no assumptions on the data, it is a measure of the data, and if binned, it is a summary measure of the data.
Your clustered points mean you will have a lot of close pairs of points going into your variogram. This might give you a good estimate of the variogram at small distance, which is a good thing. There's often problems when samples are spaced out, then you don't have a good estimate of the variogram at any distance below the distance of the closest pair. You don't have that problem.
Your clusters aren't regularly spaced, so you'll probably get a lot of distance pairs at a wide range of distances.
Your problems might come if you then go on to try and predict from the variogram, for example using Kriging. You'll get very large error estimates on points away from your clusters, most likely, compared to a sample design with more even coverage. Your estimates might only be useful within those circular buffers, and outside it might revert to a point estimate at the mean of your data with very wide errors.
Another problem might be bias in your sampling design. Suppose these are pollution measurements and you have clusters because you have put a few instruments in each town. You'll get biased predictions in the countryside. But again, that's not related to the variogram given the clustered sampling design that you have, its inherent in any biased sampling design.