Can we change this to be no fill color but just a yellow outline?
Currently stuck in v3.16 but I don't see this in the Dev version either.
So upgrading will solve this as per Matt's workflow and the option suggested in the comment by JGH will also resolve the issue. You can create a virtual layer to handle Point, Line and Polygon selections separately.
Layer Properties > Rendering
.