These small towns and villages—including one that’s said to have the best olive oil in the world—offer as much culture, history, and adventure as the bustling cities.

SUMTER COUNTY, Fla. — The retirement community of The Villages is well known across the country. The 55 and up community is home to more than 150,000 residents and is recognized by many in Florida. As ...