I was thinking of widening the groove, but the remaining lip may not be sufficient to maintain the bush in position. Do you think a cup beneath the bush that picks up the mounting bolts and cradles the sides of the bush would work?
Boring the shaft size shouldn't be a problem.

