Converting distance between nautical miles and degrees using ArcObjects?

Question

We have a certain functionality developed that:

• Will check for a tolerance value (this input is given by the user as NM);
• Buffer a polygon by that value (all polygons are in WGS-84);
• Iterate through selection (buffer x points) and creates a record for each intersected point.

The tester at my corporation is saying the tool is giving wrong results. Here is his workflow, for testing:

• Creates a polygon;
• Define a nearby point;
• Measure the distance between the polygon and point (using measure tool);
• Configure tolerance to be larger or equal distance;
• RUn the tool;

I have a problem in the middle, is that our user needs to store these tolerance values as nautical miles, and I need to convert them to degrees for them to be used in our buffer (I'm using IUnitConverter). All buffers are constructed using ITopologicalOperator.

My guess is the conversion is being done purely in a numerical way and then, buffering by less than it should.

I've read tons of articles speaking about projection engine.dll, but that is for calculating distances, not buffers (I mean, if I need to implement a custom buffering solution, that will take into account each vertex).

Can you guys recommend an approach for this? How can I convert this measure and still hit these edge cases?

Answer 1

I know we had a bit of a discussion in the comments, but, I would like to put it out there what I think the solution is. So far, what you've told me is:

• You're data is in WGS-84 (i.e. mapUnit is in DecimalDegrees)
• You haven't specified DistanceUnit but I'm going to assume meters

Let's do the following workflow:

1. Create a polygon in WGS-84 in DecimalDegrees
2. Create a point in WGS-84 in DecimalDegrees
3. Measure the distance between polygon and point in Meters
4. Use IUnitConverter to present this to the tester in NM
5. Have the input input a tolerance in NM
6. Use IUnitConverter to convert this back to Meters
7. Run the buffer tool specifying the tolerance in Meters

Now, you can, if you wish move your logic moreso to DecimalDegrees as you've specified that the buffer tool can work that way. So, you can try to rework steps 6 & 7 as you wish. Currently, my gut feeling is your problem may be at step 3 where your DistanceUnit is different than your MapUnit.