Kate Pierson has guest vocals on two REM songs: "Me In Honey" and "Shiny Happy People", both on the Out of Time album. She also guest starred on Iggy Pop's "Candy" from his Brick By Brick album.
John Lennon was reportedly a fan of the band's debut album. He told Rolling Stone that "Rock Lobster" reminded him of Yoko's music, citing it as his inspiration to "'get out the old axe and wake the wife up!'"
Yoko also became a fan of the band and later a friend - and the band were inspired by her for their song "Don't Worry", to the point where her lawyers thought it was a cover of Yoko's song "Don't Worry, Kyoko" (it wasn't).
Shout-Out: "Juliet of the Spirits" is the title of a 1965 film, which also served as the inspiration for the song.
"Love Shack" features a musical shout out to the classic rock song "Born to be Wild".
Kate Pierson has said that one working name for the band was "Fellini's Children."