Compact Disc: 52nd Street was the first pop/rock music CD released in stores, when CDs were first available in Japan.
Creator Backlash: Joel got sick of "Piano Man" for a time and refused to sing it in concert. He got over it, though the audience tends to save him the trouble of singing it when he plays it nowadays. And reportedly, he's not any too fond of "Just the Way You Are," either, because it's a love song to someone he ended up divorcing. Joel also retired "Uptown Girl" (another love song to an ex-wife) from his stage show for a long time, but he eventually reintroduced it.
He doesn't necessarily hate "We Didn't Start The Fire", but he does consider it a "novelty song" and technically not one of his best melodies. He's also claimed it's one of the more difficult songs for him to perform, as he feels if he makes one mistake singing the lyrics, "the whole thing falls apart".
Creator Recovery: Billy Joel's very upbeat and poppy An Innocent Man, a tribute to Joel's musical influences from The Sixties, followed the cynical, sociopolitically charged The Nylon Curtain. While TNC was recorded during Billy's divorce from his first wife, AIM was a product of then-single Billy enjoying life as a bachelor and dating a number of supermodels, most notably his future second wife Christie Brinkley.
Greatest Hits: Several since 1985, especially after his "retirement" from releasing pop music in 1994. 1985's double-length "Greatest Hits, Vol. 1 & 2" sold 23x multi-platinum according to the RIAA, as of 2011, at least according toThe Other Wiki.
Old Shame: Before launching his solo career, Joel was part of a hard rock duo called Attila. They released exactly one album, which was critically savaged and which Joel to this day is thoroughly embarrassed by.
At least on a technical note, Cold Spring Harbor, his debut, counts too. Not so much due to the material, but to the mastering, which was accidentally done at too high a speed. Even with the remastered/corrected version currently out, he feels it still sounds weird to him.