The Kaiser Chiefs frontman has been given a seat on the panel for the 2014 series of the reality Tv show, along with Kylie Minogue, Sir Tom Jones and will.i.am.
The singer has now revealed he was first approached about the slot several years ago, but he lost the job to The Script star O'Donoghue, who left the show last year (13).
Wilson tells Britain's The Guardian, "(I) asked too many questions... At the time, I was a bit snobby about those kind of shows. But fact is, Saturday night, I'm not out in some bar in Hoxton (fashionable area of London). I'm watching The X Factor."