The 59-year-old TV presenter was fired from the 'Today' show in November following a ''detailed complaint by a colleague'' submitted to bosses, which came after a string of other allegations were made against him by current and former NBC staff, but Matt and his wife are still living together at their home in Sag Harbor, New York.
It was recently suggested that their marriage is on the rocks after the duo - who have three children together - were both spotted without their wedding rings.
But a source told 'Entertainment Tonight': ''His only focus right now is his family.
''He's with them in the Hamptons and he's working on keeping a low profile while he deals with this tough situation.''
By contrast, an insider recently claimed that Annette fled their home and headed back to her native country after he was accused of ''inappropriate sexual behaviour in the workplace''.
She was rumoured to have returned to Amsterdam in the Netherlands with their children - Romy, 14, Thijs, 11, and Jack, 16 - following the allegations made against her husband.
The source claimed: ''Annette has taken their two younger kids out of school and is believed to have left the US and gone to her family in her native country.''
The former model - who has been married to the TV star for 20 years - filed for divorce from Matt in 2006, claiming he was controlling and insisting she suffered ''cruel and inhumane'' treatment from him due to his ''extreme anger.''
However, Annette withdrew the divorce papers a month later amid rumours Matt had offered her a $5 million deal to remain in the marriage.
From their newest EP 'What Did You Think When You Made Me This Way', Nothing But Thieves drop the lyric video for their single 'Take This Lonely...
The Lumineers honour their friend and hero Tom Petty with a sensational cover of his 1996 song 'Walls' from the 'She's the One' soundtrack.
Watch Olly Murs get his nerd on as he blags his way into an exclusive Snoop Dogg party (where Rowan Atkinson is the bartender) in the video for their...
From 'Happy' to 'Banana Pancakes', these are soaked in positivity.
Mariah Carey is the picture of glamour in the black and white video for her brand new single 'With You'. It's the lead single from her forthcoming...
Eminem draws attention to the negative response his 2017 album 'Revival' received in the video for his latest song 'Venom'; a song recorded for the...
With the recent release of her third, very well received album 'Hunter' just behind her, Anna had plenty of relatively new songs to showcase.