Richard,
I don't think the damper is the sole source of the issue. - if at all.
'wandering' is attributable to worn bushings (or not correctly tightened with the vehicle at normal load and ride height (wheels on ground) and the toe setting will contribute to this in a negative way if toe out is excesive. You actually should be aiming for as close to zero toe as possible, and about 1mm total toe out is acceptable, but in that same vain, you also have to ensure it's relative to the caster and camber of the wheels. Given these are essentially 'static' - i.e. not easily modifiable, you're firmly back at square #1 with regards to observation and behaviours.
Check the bushes again, check that everything is properly torqued at normal load setting on level ground (i.e. 4 post hoist where possible) and then check all the bushes again for play (prybar) replace any with excessive free movement (i.e. low resistance). All bushes have some give, but they are quite linear in that respect and should provide a measure of resistance that is easily felt, where as worn ones will give out rather quickly by comparison.
I'd take a good look at the rear radius rod bushes at the chassis, and see if they are flogged out or not correctly tightened, then I'd move forward and check the panhard rod and lower radius arm bushes (roll the axle, check for freeplay).
A steering damper if it's truly stuffed, will have no resistance - that's easily confirmed by removing one of the pin ends and compressing it then extending it bu hand. It should be quite difficult to do this and require a fair bit of effort- if it is an easy one-handed effort then it's stuffed.
I doubt your swivel housings are knackered if you only recently rebuilt them - new swivel pins and bearings can take a bit of time to bed in though, so no harm in checking preload etc. - especially if you are going to give the front end a once-over inspection to check everything else.
don't forget to check wheel bearings etc - and the wear pattern on your tyres - certainly a 'bad' alignment will highlight this, and any excessive toe or issues with caster will manifest themselves in erratic wear patterns on the tyre, - and this is probably where I reckon you're going to find something... feathering or excessive wear on the inside of the tyre will be excessive toe, any cupping or lateral patch wear is a combination of caster and toe being incorrect.
make sure your tyres are correctly inflated for road use (at least 35psi) and if your steering feedback becomes excessive, then you have to investigate the damper as well.
but the once-over on all the bushes, close inspection, check for binding or freeplay, correct flex and resistance, and correctly torqued at static ride height first. Then test drive, and check again. any issues will become pretty obvious.
no more than 2mm toe out total (across the entire axle) i.e. 1mm per side is arguably borderline. keeping it between zero and 1mm total will get you better tyre wear and not make much difference to steering input.
Let us know what you find.
Roads?.. Where we're going, we don't need roads...
MY92 RRC 3.9 Ardennes Green
MY93 RRC LSE 300tdi/R380/LT230 British Racing Green
MY99 D2 V8 Kinversand
Bookmarks