I haven’t noticed this problem at all. In VFR or Flight Following there is usually plenty of time to get landing clearance. Are you appropriately slowed down?
Also, Flight Following doesn’t “hand you off” to tower because ATC doesn’t know where you are going. It’s up to you to contact the airport and ask to land.
And you don’t have to cancel Flight following. Just call the airport. This is normal