Royals’ Duffy: ‘I just wasn’t putting people away’