GPU VRAM 10 GB vs 24 GB at 4K

My 1080TI has 11GB - so is there any point upgrading to a faster card with less memory?

At the moment it is definitely cpu bound with an old quad-core Xeon on a PCI 2.0 motherboard.
My rough calculation is I need a cpu x2 to x3 faster, a Ryzen on a PCI 4 motherboard is the plan, unless AM5/PCI 5 solutions become cheaper in Jan 2025.