The former Full House star considers The Cosby Show actor one of his early mentors, but admits his image has been tarnished following accusations from more than 40 women claiming Cosby drugged and/or sexually assaulted them decades ago.
"I think any human being that does things that are despicable to other human beings will be slightly tarnished by history...," he tells HuffPost Live. "He was a mentor of mine, and I was on The Tonight Show (with Cosby) two weeks before Johnny Carson went off, and it's very sad.
"The man has been tarnished and it's just sad for all of the people involved."
"I had respect for Cosby because he changed stand-up comedy, and he was amazing on (TV series) I Spy years ago," he adds.
The funnyman has not been charged in connection to any of the allegations.
Cosby has been stripped of many endorsement deals and university posts, amid his sex scandal. He resigned from a board position at Temple University, where Saget studied, to save trustees any embarrassment.