Souvenir was a promotional album released by Columbia Records in 1977 to promote Billy's pre-The Stranger songs. It was distributed mainly to disc jockeys and fan clubs. A limited picture disc version was also released. The first side of the album featured live performances of four songs from the 1976 video, Billy Joel Tonight, a concert by Billy at the Palmer Auditorium, Connecticut College in 1976. See Videos & DVDs. The second side of Souvenir featured studio versions of other songs from Billy's early albums. Souvenir is a rare find, and only available on vinyl. The picture disc is even more rare.
The album was a nice introduction to Billy's earlier songs, but did not include anything from Cold Spring Harbor which was released by Paramount, not Columbia. The live versions of "The Ballad of Billy the Kid," "Summer, Highland Falls," "New York State of Mind," and "Souvenir," were excellent, but rarely heard. And the live version of "New York State of Mind" was the only live version ever officially released until 2000 Years: The Millennium Concert.
This is not to be confused with the Australian boxed set called "Souvenir: The Ultimate Collection" from 1990 which featured five CDs: Greatest Hits, Volumes I and II (two discs), the Storm Front album, a CD of live songs from Yankee Stadium, and a CD of an interview with Billy. See Australian television advertisement for it here.