Esri defines Feature as a cartographic term:
[cartography] Any part of the earth's surface, or anything found on the earth's surface, that can be represented on a map. Features can represent various types of geographic entities, such as points, lines, polygons, or even more complex objects like networks or surfaces. Each feature typically has associated attributes that provide additional information, such as its name, population, or elevation, and may have additional, spatial characteristics, such as geographic coordinates.
https://support.esri.com/en-us/gis-dictionary/search?q=feature
Esri builds from there with feature types, feature class, feature datasets, feature services, etc.
To add confusion, closely related disciplines define it differently. In machine learning, for example, a feature is:
A feature is a measurable property of the object you’re trying to analyze. In datasets, features appear as columns.
https://www.datarobot.com/wiki/feature/
Is this the origin of the term 'Feature' in GIS and do any other disciplines use it in the same way?