Those circular bearings have fairly long channels to move in. Densely packed with a moderately liquidy grease, the shaft's in out motion should be restrained by the boot that covers the joint (same on both inboard and outboard sides I believe, but just one side gives like 2+ inches of play)
Should feel kinda like using a plunger on a toilet when you pull on it, air tight seals sucking it back into place.