The Fringe: Rory got booed, but he was asking for it