In addition to what has been mentioned above, OSSIM.
Another option is pktools, which is also worth a looksuite of utilities written in C++ for image processing with a focus on remote sensing applications. It relies on the Geospatial Data Abstraction Library (GDAL). It includes programs for image classification that use Support Vector Machine and Neural Network classifiers.