Listen to The Rock That Begot Thee online. The Rock That Begot Thee is an English language song and is sung by Jeremiah Ginsberg and Calvin Marsh. The Rock That Begot Thee, from the album Calvin Marsh Singing the Messianic Songs of Jeremiah Ginsberg, Vol. 2, was released in the year 2015. The duration of the song is 3:23. Download English songs online from JioSaavn.