White Stone is a town in Lancaster County, Virginia, United States. The population was 352 at the 2010 census. The name "White Stone" refers to the accumulations of white stones in the area's waterways. The stones were dumped there in the colonial era by British ships that dumped their stone ballast to make room for cargo like tobacco to carry back to England.