Cave Spring IS also a city inside Floyd County, just 15 miles southwest of Rome, with a picturesque square and a mix of specialty shops, restaurants, and charming accommodations. Nestled just off the square is Rolater Park, featuring the town’s namesake cave, trails and lake.