Milwaukee and Richmond are about 669 miles apart by road. Split the difference and you arrive near Columbus, the city closest to the halfway point between them. That splits the trip almost evenly — about 6 hr 57 min from Milwaukee and 7 hr 12 min from Richmond.
That's a half-day drive from each side, so Columbus suits an overnight or a weekend rather than a quick coffee — long enough to want a reason to stay, short enough to drive.
If Columbus doesn't have what you're after, Cleveland and Cincinnati are also close to the midpoint and worth a look — each keeps the drive reasonably balanced between Milwaukee and Richmond.
City descriptions adapted from Wikipedia (CC BY-SA); photos via Wikimedia Commons, credited above.