File under Awesomely Unknown Trivia: the first musical record to come with an album cover was Rodgers and Hart's Musical Comedy Hits in 1938. The designer was Alex Steinweiss, for Columbia Records, who went on to do a ton of graphically inventive jazz and musical album covers. (The original cast recording of South Pacific, for one.
One of the sides is "Falling in Love with Love," from that year's The Boys from Syracuse:
Falling in love with love is falling for make believe. Falling in love with love is playing the fool; Caring too much in such a juvenile fancy. Learning to trust is just for children in school.