Jimmy, 72, is a west London neighbour of the former Take That star, 42, and has repeatedly filed objections with local planning officials aiming to block building work Robbie has commissioned on his $21.7 million (£17.5 million) property.
In July last year (15) the Royal Borough of Kensington and Chelsea planning committee approved the Angels singer's building application to renovate his home after a lengthy battle which caused Robbie to revise his plans for his new home.
In an unguarded moment during a lively interview with Italy's Radio DeeJay an emotional Robbie claimed the rocker was so obsessed with the ongoing building work he was displaying signs of mental illness.
"Jimmy has been sitting in his car outside our house, four hours at a time. He's recording the workmen to see if they're making too much noise," he alleged in remarks made during a break in the interview captured on camera. "The builders came in and he was asleep in his garden waiting. It's like a mental illness concentrating (sic)."
The Led Zeppelin guitarist lives in a property listed by the British government as architecturally significant, having been designed by Victorian architect William Burges.
The house has also been home to poet John Betjeman and the actor Richard Harris, who Jimmy purchased the property from in 1972.
Robbie has previously spoken of his anger at Jimmy for holding up his plans to renovate his mansion, and preventing him and his wife Ayda, 37, and their four-year-old daughter Theodora from moving into the property
"It's a great story, for you guys and for me, so everybody wins," he told British newspaper The Sun earlier this year (16). "Apart from us as a family, who would have liked to have been in 12 months ago but we can't."
Robbie bought the house from the estate of the late movie director Michael Winner, who lived in the property until his death in 2013.