While the 32-year-old singer loves working with him on 'X Factor USA', she says she has to work hard to keep him in check.
Kelly - who has just joined the panel of the talent show - said: ''I love Simon! Of course he's a smart ass but he's very insightful. He does get on my nerves sometimes but in a good way. He thinks I'm crazy and I tell him to shut up.
''I want to make sure I'm not a dream crusher on the show. It's about being honest and giving constructive advice.''
Kelly is part of a new look judging panel for this year's series.
Britney, 31, signed a sensational $15 million deal to appear on the show but left after just one season, while executive L.A. quit his position after two seasons to concentrate on running his Epic Records music label.
Former Destiny's Child star Kelly previously acted as a judge on the UK version of 'The X Factor'.
Tired of their men behaving like egotistical, sport-obsessed, womanising jerks, four interconnected women prepare to...
Hockey-masked Friday the 13th stalker Jason Voorhees and glove-toting Nightmare on Elm Street slasher Freddy...