No. The tyres shouldn't go straight out of balance unless the weights fall off or the tyre rotates on the rim. It should be gradual as the tyre wears.
Do your tyres wear evenly? Do you still have standard suspension?
I would be checking swivel preload as others have mentioned.
An option to stop it (but not cure the problem) is to use dynamic balancing. Basically you put polymer beads in the tyre instead of weight on the outside. Above about 50 km/h it should balance perfectly, so no need to continually re-balance the tyres.

