Accessing GEOS functions in Python

Question

The issue: I am using Windows 7, 64-bit operating system with Python 3.2. I must continue to use Python 3.2 because of a dependency with another API. I need some functions in GEOS that are not currently supported by GDAL/OGR 1.8 and there is no port of Shapely for Python 3.2 on 64-bit Windows.

Spatialite has a beta version for 64-bits Windows but I can't get it to work and nobody in the main Stackoverflow list has a solution ( http://stackoverflow.com/questions/8590599/sqlite-load-extension-fail-for-spatialite-in-python ).

I don't want to have to go down the route of using PostGIS to get access occassinoally to one or two functions GDAL/OGR doesn't have....

The Question: SO: Can anybody explain how to either get Spatialite working or better still, how I can use CTypes to access the functionality in the GEOS dll (I know how to connect to it but I don't understand how to pass data, say wkt, in and get my result back out - http://stackoverflow.com/questions/8240674/using-geos-via-pythons-ctypes ).

I am VERY sorry for cross-posting but I really do need a solution. VERY many thanks.

Answer 1

I used the 2to3 tool (see geographika's answer) to convert Shapely-1.2.13 and then manually had to change 3 lines of code to handle Python 3.x's explicit handling of string and byte encoding. I have put this as a separate answer just for clarity and in case anybody else needs to do the same here are the lines I manually changed:

1. \geos.py (line 97)

   old: v = func().encode('ascii').split('-')[2]
   error: TypeError: Type str doesn't support the buffer API
   new: v = func().decode("utf-8").split('-')[2]

2. \geometry\base.py (line 60)

   old: EMPTY = wkb.deserialize('010700000000000000'.decode('hex'))
   error: AttributeError: 'str' object has no attribute 'decode'
   new: EMPTY = wkb.deserialize(bytes.fromhex('010700000000000000'))
   

3. \geometry\proxy.py (line 7)

   same as above

I then ran the same test as the developer and got the same result. With the above knowledge I could have done the conversion in less than 5 minutes... I just had to read up on how Python 3.x handles strings and bytes differently :).

Granted, this is not an exhaustive test but... so far so good and I hope this helps other Shapely people!

EDIT Running the doctests gives me a few more errors but they all seem to be of the same type.. so my fix will take a bit longer and I'll not document everything here but we're on the right track now!

Answer 2

In regards to Shapely and Python 3.2:

We're not yet testing or deploying Shapely on Python 3 + Windows. There's probably some non-conforming code in the shapely.geometry.geo module that prevents its import.

June, 2011 - http://old.nabble.com/Shapely-package-installation-td31879542.html

So you could try getting the Shapely source from GitHub and using the automated 2to3 tool to translate the code. Then rebuild for Windows (all the required files are in GitHub).

To see how to use ctypes and GEOS have a look at the Shapely source:

https://github.com/sgillies/shapely/blob/master/shapely/geos.py

However it may be time better spent trying to fix some Python inconsistencies in the Shapely source than trying to create another wrapper.

Answer 3

To follow up on MappaGnosis's answer from December 2011, here's how I did it with Shapely 1.2.17:

Download the source, extract, and cd into the source directory.

Use 2to3 to update all the Python code:

$ find ./ -type f -name '*.py' -exec 2to3 -w -n {} \;

Replace all the 'rb' with 'r' and 'wb' with 'w' in setup.py. This shouldn't have any consequences on a Unix-style platform, but I'm not sure about Windows.

Fix line 97 of shapely/geos.py:

- v = func()
+ v = func().decode("utf-8")

Fix line 87 of shapely/geometry/base.py:

- EMPTY = deserialize_wkb('010700000000000000'.decode('hex'))
+ EMPTY = deserialize_wkb(bytes.fromhex('010700000000000000'))

Install:

$ python setup.py install

I haven't done any testing of this hacked version to see how it works, but it does install, which is a start!