It seems like it would help a great deal to store as much of the image as possible on the GPU for panning and zooming, etc.
We deal with a lot of very large images. Many range from 8 GB to hundreds of GBs in size. At home I've got a 40" 4k monitor and a GTX Titan with 12 GB of video memory, and it performs amazingly well for everything I throw at it. It also looks great when viewing imagery. Is that setup overkill for GIS image processing work?
What GIS applications would see the most benefit from an abundance of GPU memory when dealing with large images?