5

When using a spatial interpolation method (any method) without having a way to validate it, besides sampling some points out, is there a way to count as well with the mean distance between observations and spatial distribution.

I wonder if there is another way to give one quality/accuracy measurement value, instead of giving all three different measurements of the surface quality separately.

6

Yes. The standard methods used to cross-validate and assess Kriging also apply, practically with no change, to almost any other method of interpolation. These include jackknifing, a form of leave-out-one cross-validation in which each data point is systematically removed from the dataset and predicted using the chosen variogram model. The discrepancy between the prediction, compared to the standard error of prediction, is a measure of (relative) accuracy of the predictor.

Obviously such cross-validation methods can be applied only to interpolators that supply some kind of quantitative measure of prediction error at each point. To apply them to other interpolators, you can still proceed as with kriging to estimate a variogram from the data. Use this variogram only to compute prediction standard errors, but use your chosen interpolator to do the predictions. Proceed as before. This ad hoc procedure is one reasonable and simple way to get a sense of how any interpolation procedure is performing.

You can also apply bootstrapping methods. They need to be specially adapted to spatial data to account for the expect spatial autocorrelation (so, once again--even if you are not using a kriging interpolator, you need to estimate a variogram). This is called spatial bootstrapping. It relies on repeated geostatistical simulation of an entire spatial dataset, using each replicate as a synthetic set of data with which to evaluate the accuracy of your chosen interpolator's predictions. After a large number of replications (usually at least 100 are chosen, more often 500 to 1000) the collected results of the prediction results can be assembled and assessed.

Notice that little can be done in the absence of some kind of quantitative model of the spatial autocorrelation (which is what the variogram provides), regardless of whether your chosen interpolator uses such a model.


This used to be a lot of work. (The first time I contemplated doing something like this, a quarter century ago, it took me several weeks to find and understand algorithms and write (Fortran) code to generate grids of simulated spatial data. Each simulation iteration would take minutes at a time on an 8 MHz PC souped up with a $1000 floating point coprocessor.) Today you can obtain, for free, with a quick Web search, tested code that performs such simulations almost instantaneously and use it to estimate variograms and collect thousands of simulation results within minutes.

1

Sorry if this answer is a bit vague but I'm not sure what kind of interpolation models you're dealing with. In general, if you want an indication of accuracy then you would need to compare the results of your analysis with actual measured values. In this instance I would suggest excluding a random sample of your data set when performing the interpolation and then measure how well the model predicts the values of the excluded sample. This allows you to play around with the models parameters to get a good prediction.

  • I already take into account the validation by using a sample of the observations. I want to know if there is more I can do, e.g. combine with other type of measurements (e.g., spatial distribution of the observations) and give one value for the quality/accuracy of the surface. – Gago-Silva Oct 3 '13 at 12:00
  • 2
    If the sample of observations has not been used to generate the surface then you could use a Sum of Squared Errors as an indication of the accuracy of the surface. As the name implies you add up the squared differences between the actual values of your excluded sample and the value that the surface predicts. This is a standard metric for evaluating the accuracy of a model. Here is a more technical description: link – dblanchett Oct 3 '13 at 13:12

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.