Unlike Arc you need to have the layer you want to identify highlighted in the table of contents as well as turned on. I think the deselect feature isn't doing anything if you don't currently have any layers selected.
Also see this answer:
http://gis.stackexchange.com/questions/34194/qgis-identify-features-button-issue