The answer has already been given, but I feel that you would benefit from knowing this resource: https://epsg.io
It references all the EPSG codes and gives for each: the unit, the ellipsoid, the datum and so on.
For instance for 4326: https://epsg.io/4326 it shows that the unit is degrees. In this case your question would probably not have been fully answered but it is a nice resource anyways when wondering the unit of a coordinate system for which you know the EPSG code.
As you can see 4326 is the EPSG code representing WGS84, so yes they are the same.
Your confusion probably stems from the fact that this coordinate system is based on an ellipsoid named WGS84 and a datum also named WGS84. Ellipsoid and datum are different in the sense that the ellipsoid defines the shape of the ellipse onto which the Earth is projected and that the datum defines where this ellipsoid "anchors" on Earth. The EPSG code represents the combination of the ellipsoid and the datum, so once you know it, you do not need to worry about the rest, it fully defines the horizontal coordinates system (including its unit).