Position::upstream/downstream should not need to call ensureLineBoxes