QGIS will load a spatial CSV just fine if it includes a field named "WKT" with the coordinates.  Make sure the geometry follows the proper syntax
http://en.wikipedia.org/wiki/Well-known_text.  

Open your CSV file in a spreadsheet first to make certain there are no rows with Nulls or Blanks in the WKT field, and that every representation is a valid WKT, else delete that row.