Unlike ArcArcMap you need to have the layer you want to identify highlighted in the table of contents as well as turned on. I think the deselect feature isn't doing anything if you don't currently have any layers selected. Also see this answer: QGIS identify features button issue