I've been trying to evaluate Mapserver , i'm wondering if there's a way to handle the large size of Aerial image with any kind of Tiling or Caching .
Yes. We are using mapserver for our National aerial imagery service and other raster maps, and geowebcache for tiling and caching. There are other tiling cache servers around, and the newest one is mapcache, which is integrated with mapserver.
In my opinion the relevant issue is the image format. For a large aerial image it is recommended that you use a format that (a) achieves high a compression ratio and (b) features partial decompression.
As far as I know, the only formats that meet these two requirements are ECW, MrSID and GeoTIFF. Unfortunately ECW and MrSID are propietary. About GeoTIFF, there is a good Q & A at this website: "Should GDAL be set to produce GeoTIFF files with compression? Which algorithm should be used"
Despite it is a propietary format, it is posible to serve large aerial photos in ECW format with MapServer. I have done it and it works fine.