I like your attitude! You may as well grease the wheelbearings for assembly and then, yes, the oil will find it's way in if you leave out the seal at the inside of the stub axle. It will come from the swivel housings, and they're easy enough to check and top up.