Selvin was born on Christmas Day in Manzanillo, Oriente, Cuba. He was the older of two children, and the only son of Santiago Nelson Hall and Gladys Mabel Ferguson. His sister Elvira sang very well but was not inclined to pursue music; by contrast, from his earliest years, Selvin showed unusual musical gifts and innate creativity in writing music.