The 21-year-old singer - who is currently dating 'Twilight Saga' star Ashley Greene - revealed he and his sibling met the former hairdresser on holiday in the Bahamas and Joe was initially attracted to her before Danielle snubbed him for Kevin.
He told Details magazine: "Actually, I hit on her first. And after that she and Kevin hit it off, of course. Now we have a fourth person travelling with us everywhere (on tour), so that's a different thing completely."
Joe is now very happy with Ashley and says the thing he likes most about her is that she puts his "feelings first".
The actor-and-musician appreciates what he has with the brunette beauty because he has had his heartbroken by a famous girl in the past.
Joe - who has previously romanced Taylor Swift, Camilla Belle and Demi Lovato - said: "I won't say her name, but I was in a relationship, and we tried to work things out, and she, you know - I was really upset because she - she broke up with me.
"I think what works about it with [Ashley] is she really puts my feelings first. She understands my busy schedule. She'll fly out to my shows - she's been to places in South America that I can't even pronounce."